2024-09-19T05:00:03.088 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T05:00:03.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T05:00:03.204 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911661 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/blogbench}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911661' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi120.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG+eUUWjaUqRfCBeYaNo3F22NOOQvFYuGJKQJ3+UsQYpgf9OUXsvwJf21qYaK6GTQCXnxZhzgfJC58Cm4T4B91w= smithi178.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOLoXId9YjhT8yTLV7KMAlpm0C9q/ENSYJnb69F0CuKll+AWCBuzR6iFj5CMtHGG+Iz3CNOdXsyJZ+KjfgVyUcs= smithi194.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEIIrmqark4UWfMLA0qb6W2yJaJdZCZOEs93gdXiAhotdLOdoX1gRpWaUUEpCfNiTE81GgZOoTxCj6WQgWT7f1c= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/blogbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T05:00:03.204 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T05:00:03.205 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T05:00:03.205 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T05:00:03.207 INFO:teuthology.task.internal:Checking packages... 2024-09-19T05:00:03.228 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T05:00:03.228 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T05:00:03.228 INFO:teuthology.packaging:ref: None 2024-09-19T05:00:03.228 INFO:teuthology.packaging:tag: None 2024-09-19T05:00:03.228 INFO:teuthology.packaging:branch: squid 2024-09-19T05:00:03.229 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:00:03.229 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T05:00:03.462 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T05:00:03.464 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T05:00:03.478 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T05:00:03.478 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T05:00:03.490 INFO:teuthology.task.internal:Saving configuration 2024-09-19T05:00:03.508 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T05:00:03.515 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T05:00:03.538 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911661', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 04:54:34.079059', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG+eUUWjaUqRfCBeYaNo3F22NOOQvFYuGJKQJ3+UsQYpgf9OUXsvwJf21qYaK6GTQCXnxZhzgfJC58Cm4T4B91w='} 2024-09-19T05:00:03.558 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911661', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 04:54:34.082969', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOLoXId9YjhT8yTLV7KMAlpm0C9q/ENSYJnb69F0CuKll+AWCBuzR6iFj5CMtHGG+Iz3CNOdXsyJZ+KjfgVyUcs='} 2024-09-19T05:00:03.577 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911661', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 04:54:34.081842', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEIIrmqark4UWfMLA0qb6W2yJaJdZCZOEs93gdXiAhotdLOdoX1gRpWaUUEpCfNiTE81GgZOoTxCj6WQgWT7f1c='} 2024-09-19T05:00:03.578 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T05:00:03.583 INFO:teuthology.task.internal:roles: ubuntu@smithi120.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T05:00:03.584 INFO:teuthology.task.internal:roles: ubuntu@smithi178.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T05:00:03.584 INFO:teuthology.task.internal:roles: ubuntu@smithi194.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T05:00:03.584 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T05:00:03.667 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efd73f3f520>, signals=[15]) 2024-09-19T05:00:03.667 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T05:00:03.673 INFO:teuthology.task.internal:Opening connections... 2024-09-19T05:00:03.674 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi120.front.sepia.ceph.com 2024-09-19T05:00:03.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:00:03.750 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi178.front.sepia.ceph.com 2024-09-19T05:00:03.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:00:03.826 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi194.front.sepia.ceph.com 2024-09-19T05:00:03.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:00:03.902 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T05:00:03.908 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2024-09-19T05:00:03.926 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2024-09-19T05:00:03.926 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-09-19T05:00:03.982 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2024-09-19T05:00:03.983 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9" 2024-09-19T05:00:03.983 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2024-09-19T05:00:03.983 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2024-09-19T05:00:03.983 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9" 2024-09-19T05:00:03.983 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9" 2024-09-19T05:00:03.983 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T05:00:03.983 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2024-09-19T05:00:03.983 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon" 2024-09-19T05:00:03.983 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T05:00:03.983 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2024-09-19T05:00:03.983 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T05:00:03.983 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T05:00:03.983 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T05:00:03.984 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-09-19T05:00:04.005 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2024-09-19T05:00:04.024 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2024-09-19T05:00:04.024 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2024-09-19T05:00:04.082 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="CentOS Stream" 2024-09-19T05:00:04.082 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="9" 2024-09-19T05:00:04.082 INFO:teuthology.orchestra.run.smithi178.stdout:ID="centos" 2024-09-19T05:00:04.082 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="rhel fedora" 2024-09-19T05:00:04.082 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="9" 2024-09-19T05:00:04.082 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el9" 2024-09-19T05:00:04.082 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T05:00:04.082 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2024-09-19T05:00:04.082 INFO:teuthology.orchestra.run.smithi178.stdout:LOGO="fedora-logo-icon" 2024-09-19T05:00:04.082 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T05:00:04.083 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://centos.org/" 2024-09-19T05:00:04.083 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T05:00:04.083 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T05:00:04.083 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T05:00:04.083 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2024-09-19T05:00:04.106 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2024-09-19T05:00:04.124 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2024-09-19T05:00:04.125 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-09-19T05:00:04.183 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2024-09-19T05:00:04.183 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2024-09-19T05:00:04.183 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2024-09-19T05:00:04.183 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2024-09-19T05:00:04.184 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2024-09-19T05:00:04.184 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2024-09-19T05:00:04.184 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T05:00:04.184 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2024-09-19T05:00:04.184 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2024-09-19T05:00:04.184 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T05:00:04.184 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2024-09-19T05:00:04.184 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T05:00:04.184 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T05:00:04.184 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T05:00:04.185 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-09-19T05:00:04.205 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T05:00:04.215 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T05:00:04.221 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T05:00:04.221 DEBUG:teuthology.orchestra.run.smithi120:> test '!' -e /home/ubuntu/cephtest 2024-09-19T05:00:04.224 DEBUG:teuthology.orchestra.run.smithi178:> test '!' -e /home/ubuntu/cephtest 2024-09-19T05:00:04.226 DEBUG:teuthology.orchestra.run.smithi194:> test '!' -e /home/ubuntu/cephtest 2024-09-19T05:00:04.243 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T05:00:04.249 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T05:00:04.249 DEBUG:teuthology.orchestra.run.smithi120:> test -z $(ls -A /var/lib/ceph) 2024-09-19T05:00:04.281 DEBUG:teuthology.orchestra.run.smithi178:> test -z $(ls -A /var/lib/ceph) 2024-09-19T05:00:04.284 DEBUG:teuthology.orchestra.run.smithi194:> test -z $(ls -A /var/lib/ceph) 2024-09-19T05:00:04.392 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T05:00:04.457 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T05:00:04.472 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-19T05:00:04.472 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-19T05:00:04.472 DEBUG:teuthology.orchestra.run.smithi120:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T05:00:04.473 DEBUG:teuthology.orchestra.run.smithi178:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T05:00:04.473 DEBUG:teuthology.orchestra.run.smithi194:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T05:00:04.490 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:00:04.490 DEBUG:teuthology.orchestra.run.smithi178:> uname -r 2024-09-19T05:00:04.491 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:00:04.491 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:00:04.492 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-09-19T05:00:04.492 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-09-19T05:00:04.548 INFO:teuthology.orchestra.run.smithi178.stdout:5.14.0-503.el9.x86_64 2024-09-19T05:00:04.548 INFO:teuthology.task.kernel:Running kernel on smithi178: 5.14.0-503.el9.x86_64 2024-09-19T05:00:04.549 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum install -y kernel 2024-09-19T05:00:04.550 INFO:teuthology.orchestra.run.smithi120.stdout:5.14.0-503.el9.x86_64 2024-09-19T05:00:04.550 INFO:teuthology.task.kernel:Running kernel on smithi120: 5.14.0-503.el9.x86_64 2024-09-19T05:00:04.550 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum install -y kernel 2024-09-19T05:00:04.551 INFO:teuthology.orchestra.run.smithi194.stdout:5.14.0-503.el9.x86_64 2024-09-19T05:00:04.551 INFO:teuthology.task.kernel:Running kernel on smithi194: 5.14.0-503.el9.x86_64 2024-09-19T05:00:04.551 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum install -y kernel 2024-09-19T05:00:06.929 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.3 MB 00:00 2024-09-19T05:00:07.016 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.3 MB 00:00 2024-09-19T05:00:08.016 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.3 MB 00:01 2024-09-19T05:00:09.825 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-19T05:00:12.420 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 20 MB 00:04 2024-09-19T05:00:14.084 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-19T05:00:15.585 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 19 kB 00:00 2024-09-19T05:00:15.975 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 20 MB 00:07 2024-09-19T05:00:16.638 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-19T05:00:16.931 INFO:teuthology.orchestra.run.smithi120.stdout:Extra Packages for Enterprise Linux 18 MB/s | 23 MB 00:01 2024-09-19T05:00:18.021 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - Extras packages 103 kB/s | 19 kB 00:00 2024-09-19T05:00:19.059 INFO:teuthology.orchestra.run.smithi178.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-19T05:00:20.208 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-19T05:00:21.742 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 19 kB 00:00 2024-09-19T05:00:22.270 INFO:teuthology.orchestra.run.smithi120.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-09-19T05:00:22.571 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-19T05:00:24.152 INFO:teuthology.orchestra.run.smithi120.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T05:00:24.152 INFO:teuthology.orchestra.run.smithi120.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T05:00:24.252 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-19T05:00:24.261 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-19T05:00:24.261 INFO:teuthology.orchestra.run.smithi120.stdout: Package Architecture Version Repository Size 2024-09-19T05:00:24.261 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-19T05:00:24.261 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-19T05:00:24.261 INFO:teuthology.orchestra.run.smithi120.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T05:00:24.261 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-09-19T05:00:24.262 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T05:00:24.262 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T05:00:24.262 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T05:00:24.262 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:00:24.262 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-19T05:00:24.262 INFO:teuthology.orchestra.run.smithi120.stdout:================================================================================ 2024-09-19T05:00:24.262 INFO:teuthology.orchestra.run.smithi120.stdout:Install 4 Packages 2024-09-19T05:00:24.262 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:00:24.262 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 79 M 2024-09-19T05:00:24.262 INFO:teuthology.orchestra.run.smithi120.stdout:Installed size: 126 M 2024-09-19T05:00:24.262 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-19T05:00:24.439 INFO:teuthology.orchestra.run.smithi178.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-19T05:00:24.680 INFO:teuthology.orchestra.run.smithi120.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 228 kB/s | 36 kB 00:00 2024-09-19T05:00:26.346 INFO:teuthology.orchestra.run.smithi178.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T05:00:26.346 INFO:teuthology.orchestra.run.smithi178.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T05:00:26.450 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-19T05:00:26.460 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-19T05:00:26.460 INFO:teuthology.orchestra.run.smithi178.stdout: Package Architecture Version Repository Size 2024-09-19T05:00:26.461 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-19T05:00:26.461 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-19T05:00:26.461 INFO:teuthology.orchestra.run.smithi178.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T05:00:26.461 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2024-09-19T05:00:26.461 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T05:00:26.461 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T05:00:26.461 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T05:00:26.461 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-19T05:00:26.461 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-19T05:00:26.461 INFO:teuthology.orchestra.run.smithi178.stdout:================================================================================ 2024-09-19T05:00:26.461 INFO:teuthology.orchestra.run.smithi178.stdout:Install 4 Packages 2024-09-19T05:00:26.461 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-19T05:00:26.462 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 79 M 2024-09-19T05:00:26.462 INFO:teuthology.orchestra.run.smithi178.stdout:Installed size: 126 M 2024-09-19T05:00:26.462 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-19T05:00:26.657 INFO:teuthology.orchestra.run.smithi178.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 455 kB/s | 36 kB 00:00 2024-09-19T05:00:27.943 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-19T05:00:29.833 INFO:teuthology.orchestra.run.smithi194.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T05:00:29.833 INFO:teuthology.orchestra.run.smithi194.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T05:00:29.932 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-19T05:00:29.939 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-19T05:00:29.939 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2024-09-19T05:00:29.939 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-19T05:00:29.939 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-19T05:00:29.939 INFO:teuthology.orchestra.run.smithi194.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T05:00:29.939 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-09-19T05:00:29.939 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T05:00:29.939 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T05:00:29.940 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T05:00:29.940 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:00:29.940 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-19T05:00:29.940 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-19T05:00:29.940 INFO:teuthology.orchestra.run.smithi194.stdout:Install 4 Packages 2024-09-19T05:00:29.940 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:00:29.941 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 79 M 2024-09-19T05:00:29.941 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 126 M 2024-09-19T05:00:29.941 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-19T05:00:30.103 INFO:teuthology.orchestra.run.smithi194.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 308 kB/s | 36 kB 00:00 2024-09-19T05:00:30.582 INFO:teuthology.orchestra.run.smithi178.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 3.9 MB/s | 16 MB 00:04 2024-09-19T05:00:31.338 INFO:teuthology.orchestra.run.smithi120.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 2.3 MB/s | 16 MB 00:06 2024-09-19T05:00:32.787 INFO:teuthology.orchestra.run.smithi194.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 5.6 MB/s | 16 MB 00:02 2024-09-19T05:00:33.948 INFO:teuthology.orchestra.run.smithi178.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 3.9 MB/s | 29 MB 00:07 2024-09-19T05:00:35.353 INFO:teuthology.orchestra.run.smithi194.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 5.4 MB/s | 29 MB 00:05 2024-09-19T05:00:35.662 INFO:teuthology.orchestra.run.smithi194.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 6.1 MB/s | 35 MB 00:05 2024-09-19T05:00:35.662 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:00:35.662 INFO:teuthology.orchestra.run.smithi194.stdout:Total 14 MB/s | 79 MB 00:05 2024-09-19T05:00:35.732 INFO:teuthology.orchestra.run.smithi178.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 3.8 MB/s | 35 MB 00:09 2024-09-19T05:00:35.732 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:00:35.732 INFO:teuthology.orchestra.run.smithi178.stdout:Total 8.5 MB/s | 79 MB 00:09 2024-09-19T05:00:36.351 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-19T05:00:36.412 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-19T05:00:36.696 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-19T05:00:36.696 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-19T05:00:36.784 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-19T05:00:36.784 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-19T05:00:37.463 INFO:teuthology.orchestra.run.smithi120.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 2.2 MB/s | 29 MB 00:12 2024-09-19T05:00:37.673 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-19T05:00:37.673 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-19T05:00:37.770 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-19T05:00:37.770 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-19T05:00:40.118 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-19T05:00:40.195 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-19T05:00:40.454 INFO:teuthology.orchestra.run.smithi120.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 2.2 MB/s | 35 MB 00:15 2024-09-19T05:00:40.455 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:00:40.455 INFO:teuthology.orchestra.run.smithi120.stdout:Total 4.9 MB/s | 79 MB 00:16 2024-09-19T05:00:40.737 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:00:40.830 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:00:40.900 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:00:40.990 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:00:41.139 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-19T05:00:41.486 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-19T05:00:41.486 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-19T05:00:42.442 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-19T05:00:42.443 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-19T05:00:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:00:43.709 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:00:43.739 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:00:43.845 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:00:44.886 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-19T05:00:45.557 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:00:45.757 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:00:48.515 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:00:48.599 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:00:48.649 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:00:48.684 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:00:48.697 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:00:48.813 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:00:53.495 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:00:53.531 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:00:53.599 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:00:53.670 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:00:58.452 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:01:31.806 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:01:31.846 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:01:31.904 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:01:31.944 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:01:32.144 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:01:32.144 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:01:32.144 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:01:32.144 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:01:32.299 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:01:32.299 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:01:32.299 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:01:32.299 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:01:32.971 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:01:32.971 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:01:32.971 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-19T05:01:32.972 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T05:01:32.972 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T05:01:32.972 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T05:01:32.972 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T05:01:32.972 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:01:32.972 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-19T05:01:33.127 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:01:33.128 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-19T05:01:33.128 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-19T05:01:33.128 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T05:01:33.128 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T05:01:33.128 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T05:01:33.128 INFO:teuthology.orchestra.run.smithi178.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T05:01:33.128 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-19T05:01:33.128 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-19T05:01:33.322 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:01:33.402 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:01:33.403 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:01:33.403 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T05:01:33.403 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T05:01:33.403 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T05:01:33.403 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-19T05:01:33.403 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi194.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T05:01:33.403 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:01:33.462 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:01:33.462 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:01:33.462 DEBUG:teuthology.orchestra.run.smithi194:> sudo rpm -qi grub2-tools 2024-09-19T05:01:33.469 DEBUG:teuthology.orchestra.run.smithi178:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:01:33.501 INFO:teuthology.orchestra.run.smithi194.stdout:Name : grub2-tools 2024-09-19T05:01:33.502 INFO:teuthology.orchestra.run.smithi194.stdout:Epoch : 1 2024-09-19T05:01:33.502 INFO:teuthology.orchestra.run.smithi194.stdout:Version : 2.06 2024-09-19T05:01:33.502 INFO:teuthology.orchestra.run.smithi194.stdout:Release : 82.el9 2024-09-19T05:01:33.502 INFO:teuthology.orchestra.run.smithi194.stdout:Architecture: x86_64 2024-09-19T05:01:33.502 INFO:teuthology.orchestra.run.smithi194.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T05:01:33.502 INFO:teuthology.orchestra.run.smithi194.stdout:Group : Unspecified 2024-09-19T05:01:33.503 INFO:teuthology.orchestra.run.smithi194.stdout:Size : 8274670 2024-09-19T05:01:33.503 INFO:teuthology.orchestra.run.smithi194.stdout:License : GPLv3+ 2024-09-19T05:01:33.503 INFO:teuthology.orchestra.run.smithi194.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T05:01:33.503 INFO:teuthology.orchestra.run.smithi194.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T05:01:33.503 INFO:teuthology.orchestra.run.smithi194.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T05:01:33.503 INFO:teuthology.orchestra.run.smithi194.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T05:01:33.503 INFO:teuthology.orchestra.run.smithi194.stdout:Packager : builder@centos.org 2024-09-19T05:01:33.503 INFO:teuthology.orchestra.run.smithi194.stdout:Vendor : CentOS 2024-09-19T05:01:33.503 INFO:teuthology.orchestra.run.smithi194.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T05:01:33.503 INFO:teuthology.orchestra.run.smithi194.stdout:Summary : Support tools for GRUB. 2024-09-19T05:01:33.503 INFO:teuthology.orchestra.run.smithi194.stdout:Description : 2024-09-19T05:01:33.503 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:01:33.504 INFO:teuthology.orchestra.run.smithi194.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T05:01:33.504 INFO:teuthology.orchestra.run.smithi194.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T05:01:33.504 INFO:teuthology.orchestra.run.smithi194.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T05:01:33.504 INFO:teuthology.orchestra.run.smithi194.stdout:hardware devices. 2024-09-19T05:01:33.504 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:01:33.504 INFO:teuthology.orchestra.run.smithi194.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T05:01:33.505 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T05:01:33.505 INFO:teuthology.task.kernel:Updating grub on smithi194 to boot 5.14.0-508.el9.x86_64 2024-09-19T05:01:33.505 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T05:01:33.560 INFO:teuthology.orchestra.run.smithi178.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:01:33.561 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:01:33.561 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T05:01:33.561 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T05:01:33.561 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T05:01:33.562 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-19T05:01:33.562 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi178.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T05:01:33.562 DEBUG:teuthology.orchestra.run.smithi178:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:01:33.620 INFO:teuthology.orchestra.run.smithi178.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:01:33.620 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:01:33.621 DEBUG:teuthology.orchestra.run.smithi178:> sudo rpm -qi grub2-tools 2024-09-19T05:01:33.655 INFO:teuthology.orchestra.run.smithi178.stdout:Name : grub2-tools 2024-09-19T05:01:33.655 INFO:teuthology.orchestra.run.smithi178.stdout:Epoch : 1 2024-09-19T05:01:33.655 INFO:teuthology.orchestra.run.smithi178.stdout:Version : 2.06 2024-09-19T05:01:33.655 INFO:teuthology.orchestra.run.smithi178.stdout:Release : 82.el9 2024-09-19T05:01:33.655 INFO:teuthology.orchestra.run.smithi178.stdout:Architecture: x86_64 2024-09-19T05:01:33.656 INFO:teuthology.orchestra.run.smithi178.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T05:01:33.656 INFO:teuthology.orchestra.run.smithi178.stdout:Group : Unspecified 2024-09-19T05:01:33.656 INFO:teuthology.orchestra.run.smithi178.stdout:Size : 8274670 2024-09-19T05:01:33.656 INFO:teuthology.orchestra.run.smithi178.stdout:License : GPLv3+ 2024-09-19T05:01:33.656 INFO:teuthology.orchestra.run.smithi178.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T05:01:33.656 INFO:teuthology.orchestra.run.smithi178.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T05:01:33.656 INFO:teuthology.orchestra.run.smithi178.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T05:01:33.656 INFO:teuthology.orchestra.run.smithi178.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T05:01:33.656 INFO:teuthology.orchestra.run.smithi178.stdout:Packager : builder@centos.org 2024-09-19T05:01:33.656 INFO:teuthology.orchestra.run.smithi178.stdout:Vendor : CentOS 2024-09-19T05:01:33.656 INFO:teuthology.orchestra.run.smithi178.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T05:01:33.656 INFO:teuthology.orchestra.run.smithi178.stdout:Summary : Support tools for GRUB. 2024-09-19T05:01:33.656 INFO:teuthology.orchestra.run.smithi178.stdout:Description : 2024-09-19T05:01:33.656 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-19T05:01:33.657 INFO:teuthology.orchestra.run.smithi178.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T05:01:33.657 INFO:teuthology.orchestra.run.smithi178.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T05:01:33.657 INFO:teuthology.orchestra.run.smithi178.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T05:01:33.657 INFO:teuthology.orchestra.run.smithi178.stdout:hardware devices. 2024-09-19T05:01:33.657 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-19T05:01:33.657 INFO:teuthology.orchestra.run.smithi178.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T05:01:33.663 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T05:01:33.663 INFO:teuthology.task.kernel:Updating grub on smithi178 to boot 5.14.0-508.el9.x86_64 2024-09-19T05:01:33.663 DEBUG:teuthology.orchestra.run.smithi178:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T05:01:34.152 INFO:teuthology.orchestra.run.smithi194.stderr:Generating grub configuration file ... 2024-09-19T05:01:34.314 INFO:teuthology.orchestra.run.smithi178.stderr:Generating grub configuration file ... 2024-09-19T05:01:35.461 INFO:teuthology.orchestra.run.smithi194.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T05:01:35.497 INFO:teuthology.orchestra.run.smithi194.stderr:done 2024-09-19T05:01:35.507 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2024-09-19T05:01:35.541 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.hbKi5gE4ZF 2024-09-19T05:01:35.541 DEBUG:teuthology.orchestra.run.smithi194:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hbKi5gE4ZF 2024-09-19T05:01:35.613 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.hbKi5gE4ZF 2024-09-19T05:01:35.664 INFO:teuthology.orchestra.run.smithi178.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T05:01:35.696 INFO:teuthology.orchestra.run.smithi178.stderr:done 2024-09-19T05:01:35.708 DEBUG:teuthology.orchestra.run.smithi178:> mktemp 2024-09-19T05:01:35.724 INFO:teuthology.orchestra.run.smithi178.stdout:/tmp/tmp.Naw17mQxaC 2024-09-19T05:01:35.724 DEBUG:teuthology.orchestra.run.smithi178:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Naw17mQxaC 2024-09-19T05:01:35.751 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.hbKi5gE4ZF is 6KB 2024-09-19T05:01:35.771 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.hbKi5gE4ZF 2024-09-19T05:01:35.786 DEBUG:teuthology.orchestra.run.smithi194:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T05:01:35.791 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0666 /tmp/tmp.Naw17mQxaC 2024-09-19T05:01:35.848 INFO:teuthology.orchestra.run.smithi194.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T05:01:35.849 INFO:teuthology.orchestra.run.smithi194.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T05:01:35.849 INFO:teuthology.orchestra.run.smithi194.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T05:01:35.849 INFO:teuthology.orchestra.run.smithi194.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T05:01:35.850 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T05:01:35.935 DEBUG:teuthology.orchestra.remote:smithi178:/tmp/tmp.Naw17mQxaC is 6KB 2024-09-19T05:01:35.984 DEBUG:teuthology.orchestra.run.smithi178:> rm -fr /tmp/tmp.Naw17mQxaC 2024-09-19T05:01:35.999 DEBUG:teuthology.orchestra.run.smithi178:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T05:01:36.004 DEBUG:teuthology.orchestra.run.smithi194:> sudo shutdown -r now 2024-09-19T05:01:36.066 INFO:teuthology.orchestra.run.smithi178.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T05:01:36.066 INFO:teuthology.orchestra.run.smithi178.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T05:01:36.066 INFO:teuthology.orchestra.run.smithi178.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T05:01:36.067 INFO:teuthology.orchestra.run.smithi178.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T05:01:36.067 DEBUG:teuthology.orchestra.run.smithi178:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T05:01:36.198 DEBUG:teuthology.orchestra.run.smithi178:> sudo shutdown -r now 2024-09-19T05:01:36.569 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:01:36.609 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:01:36.930 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:01:36.930 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T05:01:36.930 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T05:01:36.930 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T05:01:37.776 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T05:01:37.776 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:01:37.776 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-19T05:01:37.776 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T05:01:37.777 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T05:01:37.777 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T05:01:37.777 INFO:teuthology.orchestra.run.smithi120.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T05:01:37.777 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:01:37.777 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-19T05:01:38.144 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:01:38.235 INFO:teuthology.orchestra.run.smithi120.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:01:38.235 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:01:38.235 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T05:01:38.235 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T05:01:38.235 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T05:01:38.236 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-19T05:01:38.236 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi120.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T05:01:38.236 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T05:01:38.294 INFO:teuthology.orchestra.run.smithi120.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T05:01:38.294 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T05:01:38.295 DEBUG:teuthology.orchestra.run.smithi120:> sudo rpm -qi grub2-tools 2024-09-19T05:01:38.330 INFO:teuthology.orchestra.run.smithi120.stdout:Name : grub2-tools 2024-09-19T05:01:38.330 INFO:teuthology.orchestra.run.smithi120.stdout:Epoch : 1 2024-09-19T05:01:38.330 INFO:teuthology.orchestra.run.smithi120.stdout:Version : 2.06 2024-09-19T05:01:38.330 INFO:teuthology.orchestra.run.smithi120.stdout:Release : 82.el9 2024-09-19T05:01:38.330 INFO:teuthology.orchestra.run.smithi120.stdout:Architecture: x86_64 2024-09-19T05:01:38.330 INFO:teuthology.orchestra.run.smithi120.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T05:01:38.330 INFO:teuthology.orchestra.run.smithi120.stdout:Group : Unspecified 2024-09-19T05:01:38.331 INFO:teuthology.orchestra.run.smithi120.stdout:Size : 8274670 2024-09-19T05:01:38.331 INFO:teuthology.orchestra.run.smithi120.stdout:License : GPLv3+ 2024-09-19T05:01:38.331 INFO:teuthology.orchestra.run.smithi120.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T05:01:38.331 INFO:teuthology.orchestra.run.smithi120.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T05:01:38.331 INFO:teuthology.orchestra.run.smithi120.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T05:01:38.331 INFO:teuthology.orchestra.run.smithi120.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T05:01:38.331 INFO:teuthology.orchestra.run.smithi120.stdout:Packager : builder@centos.org 2024-09-19T05:01:38.331 INFO:teuthology.orchestra.run.smithi120.stdout:Vendor : CentOS 2024-09-19T05:01:38.331 INFO:teuthology.orchestra.run.smithi120.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T05:01:38.331 INFO:teuthology.orchestra.run.smithi120.stdout:Summary : Support tools for GRUB. 2024-09-19T05:01:38.331 INFO:teuthology.orchestra.run.smithi120.stdout:Description : 2024-09-19T05:01:38.331 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:01:38.331 INFO:teuthology.orchestra.run.smithi120.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T05:01:38.331 INFO:teuthology.orchestra.run.smithi120.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T05:01:38.332 INFO:teuthology.orchestra.run.smithi120.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T05:01:38.332 INFO:teuthology.orchestra.run.smithi120.stdout:hardware devices. 2024-09-19T05:01:38.332 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:01:38.332 INFO:teuthology.orchestra.run.smithi120.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T05:01:38.333 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T05:01:38.333 INFO:teuthology.task.kernel:Updating grub on smithi120 to boot 5.14.0-508.el9.x86_64 2024-09-19T05:01:38.333 DEBUG:teuthology.orchestra.run.smithi120:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T05:01:38.973 INFO:teuthology.orchestra.run.smithi120.stderr:Generating grub configuration file ... 2024-09-19T05:01:40.301 INFO:teuthology.orchestra.run.smithi120.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T05:01:40.327 INFO:teuthology.orchestra.run.smithi120.stderr:done 2024-09-19T05:01:40.338 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2024-09-19T05:01:40.354 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.cZq5X6HMGq 2024-09-19T05:01:40.354 DEBUG:teuthology.orchestra.run.smithi120:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.cZq5X6HMGq 2024-09-19T05:01:40.421 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.cZq5X6HMGq 2024-09-19T05:01:40.562 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.cZq5X6HMGq is 6KB 2024-09-19T05:01:40.610 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.cZq5X6HMGq 2024-09-19T05:01:40.625 DEBUG:teuthology.orchestra.run.smithi120:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T05:01:40.687 INFO:teuthology.orchestra.run.smithi120.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T05:01:40.687 INFO:teuthology.orchestra.run.smithi120.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T05:01:40.687 INFO:teuthology.orchestra.run.smithi120.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T05:01:40.687 INFO:teuthology.orchestra.run.smithi120.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T05:01:40.689 DEBUG:teuthology.orchestra.run.smithi120:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T05:01:40.839 DEBUG:teuthology.orchestra.run.smithi120:> sudo shutdown -r now 2024-09-19T05:02:06.029 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-19T05:02:06.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-19T05:02:06.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:02:06.201 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-19T05:02:06.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-19T05:02:06.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:02:10.847 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-19T05:02:10.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-19T05:02:10.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:02:40.705 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-09-19T05:02:45.309 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-09-19T05:02:49.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-19T05:02:49.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:02:52.765 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-09-19T05:02:54.312 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-19T05:02:54.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:03:04.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-19T05:03:04.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:03:06.033 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T05:03:12.701 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-09-19T05:03:15.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-19T05:03:15.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:03:15.409 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-09-19T05:03:15.776 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-19T05:03:15.777 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-508.el9.x86_64"... 2024-09-19T05:03:15.777 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-09-19T05:03:15.791 INFO:teuthology.orchestra.run.smithi194.stdout:5.14.0-508.el9.x86_64 2024-09-19T05:03:15.791 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T05:03:15.791 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T05:03:15.791 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T05:03:16.792 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-19T05:03:16.792 DEBUG:teuthology.orchestra.run.smithi194:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T05:03:16.876 INFO:teuthology.orchestra.run.smithi194.stdout:ttyS1 2024-09-19T05:03:16.916 DEBUG:teuthology.parallel:result is None 2024-09-19T05:03:24.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-19T05:03:24.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:03:25.212 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-09-19T05:03:25.573 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-19T05:03:25.574 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-19T05:03:25.574 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-09-19T05:03:25.589 INFO:teuthology.orchestra.run.smithi120.stdout:5.14.0-508.el9.x86_64 2024-09-19T05:03:25.589 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T05:03:25.589 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T05:03:25.589 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T05:03:26.591 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-19T05:03:26.591 DEBUG:teuthology.orchestra.run.smithi120:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T05:03:26.663 INFO:teuthology.orchestra.run.smithi120.stdout:ttyS1 2024-09-19T05:03:26.685 DEBUG:teuthology.parallel:result is None 2024-09-19T05:03:36.639 DEBUG:teuthology.orchestra.run.smithi178:> true 2024-09-19T05:03:37.123 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-19T05:03:37.124 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-19T05:03:37.124 DEBUG:teuthology.orchestra.run.smithi178:> uname -r 2024-09-19T05:03:37.138 INFO:teuthology.orchestra.run.smithi178.stdout:5.14.0-508.el9.x86_64 2024-09-19T05:03:37.138 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T05:03:37.139 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T05:03:37.139 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T05:03:38.139 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-19T05:03:38.140 DEBUG:teuthology.orchestra.run.smithi178:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T05:03:38.220 INFO:teuthology.orchestra.run.smithi178.stdout:ttyS1 2024-09-19T05:03:38.247 DEBUG:teuthology.parallel:result is None 2024-09-19T05:03:38.247 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T05:03:38.254 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T05:03:38.255 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T05:03:38.258 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T05:03:38.260 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T05:03:38.281 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T05:03:38.287 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T05:03:38.293 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T05:03:38.294 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T05:03:38.318 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T05:03:38.320 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T05:03:38.463 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T05:03:38.469 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T05:03:38.469 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T05:03:38.472 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T05:03:38.474 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T05:03:38.501 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:03:38.501 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:03:38.506 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:03:38.511 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:03:38.511 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:03:38.517 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T05:03:38.519 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T05:03:38.526 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T05:03:38.526 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T05:03:38.556 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T05:03:38.558 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T05:03:38.587 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T05:03:38.595 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T05:03:38.596 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T05:03:38.624 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T05:03:38.627 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T05:03:38.643 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:03:38.724 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:03:38.773 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:03:38.857 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:03:38.896 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T05:03:38.896 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T05:03:38.961 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:03:39.003 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:03:39.053 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:03:39.132 DEBUG:teuthology.orchestra.run.smithi178:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:03:39.176 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-19T05:03:39.176 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T05:03:39.240 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:03:39.286 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T05:03:39.346 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:03:39.432 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T05:03:39.476 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T05:03:39.476 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T05:03:39.544 DEBUG:teuthology.orchestra.run.smithi120:> sudo service rsyslog restart 2024-09-19T05:03:39.547 DEBUG:teuthology.orchestra.run.smithi178:> sudo service rsyslog restart 2024-09-19T05:03:39.550 DEBUG:teuthology.orchestra.run.smithi194:> sudo service rsyslog restart 2024-09-19T05:03:39.589 INFO:teuthology.orchestra.run.smithi178.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:03:39.602 INFO:teuthology.orchestra.run.smithi120.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:03:39.640 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:03:40.150 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T05:03:40.158 INFO:teuthology.task.internal:Starting timer... 2024-09-19T05:03:40.158 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T05:03:40.168 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T05:03:40.176 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T05:03:40.176 DEBUG:teuthology.orchestra.run.smithi120:> sudo service auditd rotate 2024-09-19T05:03:40.256 INFO:teuthology.orchestra.run.smithi120.stdout:Rotating logs: 2024-09-19T05:03:40.258 DEBUG:teuthology.orchestra.run.smithi178:> sudo service auditd rotate 2024-09-19T05:03:40.303 INFO:teuthology.orchestra.run.smithi178.stdout:Rotating logs: 2024-09-19T05:03:40.304 DEBUG:teuthology.orchestra.run.smithi194:> sudo service auditd rotate 2024-09-19T05:03:40.358 INFO:teuthology.orchestra.run.smithi194.stdout:Rotating logs: 2024-09-19T05:03:40.360 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T05:03:40.360 DEBUG:teuthology.orchestra.run.smithi120:> /usr/sbin/getenforce 2024-09-19T05:03:40.384 INFO:teuthology.orchestra.run.smithi120.stdout:Permissive 2024-09-19T05:03:40.384 DEBUG:teuthology.orchestra.run.smithi178:> /usr/sbin/getenforce 2024-09-19T05:03:40.424 INFO:teuthology.orchestra.run.smithi178.stdout:Permissive 2024-09-19T05:03:40.425 DEBUG:teuthology.orchestra.run.smithi194:> /usr/sbin/getenforce 2024-09-19T05:03:40.449 INFO:teuthology.orchestra.run.smithi194.stdout:Permissive 2024-09-19T05:03:40.449 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi120.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi178.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi194.front.sepia.ceph.com': 'permissive'} 2024-09-19T05:03:40.449 DEBUG:teuthology.orchestra.run.smithi120:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:03:40.477 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:03:40.478 DEBUG:teuthology.orchestra.run.smithi178:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:03:40.503 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:03:40.503 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:03:40.530 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:03:40.530 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T05:03:40.531 DEBUG:teuthology.orchestra.run.smithi120:> sudo /usr/sbin/setenforce permissive 2024-09-19T05:03:40.566 DEBUG:teuthology.orchestra.run.smithi178:> sudo /usr/sbin/setenforce permissive 2024-09-19T05:03:40.596 DEBUG:teuthology.orchestra.run.smithi194:> sudo /usr/sbin/setenforce permissive 2024-09-19T05:03:40.625 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T05:03:40.638 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-19T05:03:40.641 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-19T05:03:40.779 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T05:03:40.808 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T05:03:40.810 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi120.front.sepia.ceph.com,smithi178.front.sepia.ceph.com,smithi194.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T05:07:29.876 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi120.front.sepia.ceph.com'), Remote(name='ubuntu@smithi178.front.sepia.ceph.com'), Remote(name='ubuntu@smithi194.front.sepia.ceph.com')] 2024-09-19T05:07:29.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-19T05:07:29.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:07:29.955 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-09-19T05:07:30.036 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-19T05:07:30.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-19T05:07:30.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:07:30.112 DEBUG:teuthology.orchestra.run.smithi178:> true 2024-09-19T05:07:30.193 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-19T05:07:30.193 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-19T05:07:30.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T05:07:30.269 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-09-19T05:07:30.348 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-19T05:07:30.349 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T05:07:30.358 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T05:07:30.359 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T05:07:30.359 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:07:30.361 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T05:07:30.362 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:07:30.364 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T05:07:30.364 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:07:30.390 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T05:07:30.393 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T05:07:30.405 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T05:07:30.409 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T05:07:30.418 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T05:07:30.430 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: ntpd: command not found 2024-09-19T05:07:30.432 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T05:07:30.435 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: ntpd: command not found 2024-09-19T05:07:30.441 INFO:teuthology.orchestra.run.smithi120.stdout:506 Cannot talk to daemon 2024-09-19T05:07:30.446 INFO:teuthology.orchestra.run.smithi178.stdout:506 Cannot talk to daemon 2024-09-19T05:07:30.455 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T05:07:30.457 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: ntpd: command not found 2024-09-19T05:07:30.461 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T05:07:30.469 INFO:teuthology.orchestra.run.smithi194.stdout:506 Cannot talk to daemon 2024-09-19T05:07:30.469 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T05:07:30.476 INFO:teuthology.orchestra.run.smithi178.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T05:07:30.482 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T05:07:30.497 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T05:07:30.524 INFO:teuthology.orchestra.run.smithi120.stderr:bash: line 1: ntpq: command not found 2024-09-19T05:07:30.528 INFO:teuthology.orchestra.run.smithi120.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T05:07:30.528 INFO:teuthology.orchestra.run.smithi120.stdout:=============================================================================== 2024-09-19T05:07:30.528 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:07:30.528 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:07:30.528 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:07:30.528 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:07:30.533 INFO:teuthology.orchestra.run.smithi178.stderr:bash: line 1: ntpq: command not found 2024-09-19T05:07:30.538 INFO:teuthology.orchestra.run.smithi178.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T05:07:30.538 INFO:teuthology.orchestra.run.smithi178.stdout:=============================================================================== 2024-09-19T05:07:30.538 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:07:30.538 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:07:30.538 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:07:30.538 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:07:30.548 INFO:teuthology.orchestra.run.smithi194.stderr:bash: line 1: ntpq: command not found 2024-09-19T05:07:30.551 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T05:07:30.551 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2024-09-19T05:07:30.551 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:07:30.552 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:07:30.552 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:07:30.552 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:07:30.553 INFO:teuthology.run_tasks:Running task install... 2024-09-19T05:07:30.560 DEBUG:teuthology.task.install:project ceph 2024-09-19T05:07:30.561 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T05:07:30.561 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T05:07:30.561 INFO:teuthology.task.install:Using flavor: default 2024-09-19T05:07:30.566 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T05:07:30.566 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T05:07:30.567 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T05:07:30.567 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:07:30.569 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T05:07:30.569 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:07:30.570 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T05:07:30.570 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:07:30.710 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T05:07:30.710 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T05:07:30.728 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T05:07:30.728 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T05:07:30.733 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T05:07:30.733 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T05:07:30.824 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T05:07:30.824 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T05:07:30.824 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T05:07:30.836 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T05:07:30.836 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T05:07:30.836 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T05:07:30.845 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T05:07:30.845 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-19T05:07:30.845 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T05:07:30.850 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T05:07:30.850 DEBUG:teuthology.orchestra.run.smithi120:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T05:07:30.863 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T05:07:30.863 DEBUG:teuthology.orchestra.run.smithi194:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T05:07:30.870 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T05:07:30.871 DEBUG:teuthology.orchestra.run.smithi178:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T05:07:30.916 DEBUG:teuthology.orchestra.run.smithi120:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T05:07:30.929 DEBUG:teuthology.orchestra.run.smithi194:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T05:07:30.937 DEBUG:teuthology.orchestra.run.smithi178:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T05:07:30.991 DEBUG:teuthology.orchestra.run.smithi120:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T05:07:31.004 DEBUG:teuthology.orchestra.run.smithi194:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T05:07:31.013 DEBUG:teuthology.orchestra.run.smithi178:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T05:07:31.056 INFO:teuthology.orchestra.run.smithi120.stdout:check_obsoletes = 1 2024-09-19T05:07:31.057 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum clean all 2024-09-19T05:07:31.068 INFO:teuthology.orchestra.run.smithi194.stdout:check_obsoletes = 1 2024-09-19T05:07:31.069 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum clean all 2024-09-19T05:07:31.077 INFO:teuthology.orchestra.run.smithi178.stdout:check_obsoletes = 1 2024-09-19T05:07:31.079 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum clean all 2024-09-19T05:07:31.279 INFO:teuthology.orchestra.run.smithi120.stdout:45 files removed 2024-09-19T05:07:31.303 INFO:teuthology.orchestra.run.smithi178.stdout:45 files removed 2024-09-19T05:07:31.306 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T05:07:31.327 INFO:teuthology.orchestra.run.smithi194.stdout:45 files removed 2024-09-19T05:07:31.330 DEBUG:teuthology.orchestra.run.smithi178:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T05:07:31.358 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T05:07:31.860 INFO:teuthology.orchestra.run.smithi120.stdout:ceph packages for x86_64 309 kB/s | 84 kB 00:00 2024-09-19T05:07:31.887 INFO:teuthology.orchestra.run.smithi178.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-19T05:07:31.916 INFO:teuthology.orchestra.run.smithi194.stdout:ceph packages for x86_64 308 kB/s | 84 kB 00:00 2024-09-19T05:07:32.136 INFO:teuthology.orchestra.run.smithi120.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-19T05:07:32.171 INFO:teuthology.orchestra.run.smithi178.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T05:07:32.207 INFO:teuthology.orchestra.run.smithi194.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-19T05:07:32.403 INFO:teuthology.orchestra.run.smithi120.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-19T05:07:32.446 INFO:teuthology.orchestra.run.smithi178.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T05:07:32.474 INFO:teuthology.orchestra.run.smithi194.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-19T05:07:33.082 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-19T05:07:34.063 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.3 MB 00:01 2024-09-19T05:07:34.095 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.3 MB 00:01 2024-09-19T05:07:34.825 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-19T05:07:37.679 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - AppStream 8.0 MB/s | 20 MB 00:02 2024-09-19T05:07:39.009 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-19T05:07:40.121 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - AppStream 4.1 MB/s | 20 MB 00:04 2024-09-19T05:07:40.793 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-19T05:07:41.630 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-19T05:07:41.938 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-19T05:07:43.314 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - Extras packages 128 kB/s | 19 kB 00:00 2024-09-19T05:07:44.202 INFO:teuthology.orchestra.run.smithi120.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-19T05:07:44.555 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-19T05:07:46.323 INFO:teuthology.orchestra.run.smithi178.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 19 kB 00:00 2024-09-19T05:07:46.945 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-19T05:07:47.577 INFO:teuthology.orchestra.run.smithi178.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-19T05:07:49.124 INFO:teuthology.orchestra.run.smithi194.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:07:49.124 INFO:teuthology.orchestra.run.smithi194.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:07:49.137 INFO:teuthology.orchestra.run.smithi194.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T05:07:49.138 INFO:teuthology.orchestra.run.smithi194.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T05:07:49.139 INFO:teuthology.orchestra.run.smithi194.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T05:07:49.141 INFO:teuthology.orchestra.run.smithi194.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T05:07:49.142 INFO:teuthology.orchestra.run.smithi194.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T05:07:49.145 INFO:teuthology.orchestra.run.smithi194.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T05:07:49.146 INFO:teuthology.orchestra.run.smithi194.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T05:07:49.209 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-19T05:07:49.227 INFO:teuthology.orchestra.run.smithi194.stdout:====================================================================================== 2024-09-19T05:07:49.228 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-09-19T05:07:49.228 INFO:teuthology.orchestra.run.smithi194.stdout:====================================================================================== 2024-09-19T05:07:49.228 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-19T05:07:49.228 INFO:teuthology.orchestra.run.smithi194.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T05:07:49.228 INFO:teuthology.orchestra.run.smithi194.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T05:07:49.228 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T05:07:49.228 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T05:07:49.228 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T05:07:49.228 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T05:07:49.228 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T05:07:49.228 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T05:07:49.228 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T05:07:49.229 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T05:07:49.229 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T05:07:49.229 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T05:07:49.229 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T05:07:49.229 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T05:07:49.229 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T05:07:49.229 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T05:07:49.229 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T05:07:49.229 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T05:07:49.230 INFO:teuthology.orchestra.run.smithi194.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T05:07:49.230 INFO:teuthology.orchestra.run.smithi194.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T05:07:49.230 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T05:07:49.230 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T05:07:49.230 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T05:07:49.230 INFO:teuthology.orchestra.run.smithi194.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T05:07:49.230 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T05:07:49.230 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T05:07:49.230 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T05:07:49.230 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T05:07:49.230 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T05:07:49.230 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T05:07:49.230 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T05:07:49.231 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T05:07:49.231 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T05:07:49.231 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T05:07:49.231 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T05:07:49.231 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T05:07:49.231 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T05:07:49.231 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrading: 2024-09-19T05:07:49.231 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T05:07:49.231 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T05:07:49.231 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T05:07:49.231 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T05:07:49.231 INFO:teuthology.orchestra.run.smithi194.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T05:07:49.231 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T05:07:49.232 INFO:teuthology.orchestra.run.smithi194.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T05:07:49.232 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T05:07:49.232 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-09-19T05:07:49.232 INFO:teuthology.orchestra.run.smithi194.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T05:07:49.232 INFO:teuthology.orchestra.run.smithi194.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T05:07:49.232 INFO:teuthology.orchestra.run.smithi194.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T05:07:49.232 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T05:07:49.232 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T05:07:49.232 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T05:07:49.232 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T05:07:49.232 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T05:07:49.232 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T05:07:49.233 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T05:07:49.233 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T05:07:49.233 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T05:07:49.233 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T05:07:49.233 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T05:07:49.233 INFO:teuthology.orchestra.run.smithi194.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T05:07:49.233 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T05:07:49.233 INFO:teuthology.orchestra.run.smithi194.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T05:07:49.233 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T05:07:49.233 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T05:07:49.233 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T05:07:49.233 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T05:07:49.233 INFO:teuthology.orchestra.run.smithi194.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T05:07:49.233 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T05:07:49.234 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T05:07:49.234 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T05:07:49.234 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T05:07:49.234 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T05:07:49.234 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T05:07:49.234 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T05:07:49.234 INFO:teuthology.orchestra.run.smithi194.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T05:07:49.234 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T05:07:49.234 INFO:teuthology.orchestra.run.smithi194.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T05:07:49.234 INFO:teuthology.orchestra.run.smithi194.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T05:07:49.234 INFO:teuthology.orchestra.run.smithi194.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T05:07:49.234 INFO:teuthology.orchestra.run.smithi194.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T05:07:49.234 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T05:07:49.235 INFO:teuthology.orchestra.run.smithi194.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T05:07:49.235 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T05:07:49.235 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T05:07:49.235 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T05:07:49.235 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T05:07:49.235 INFO:teuthology.orchestra.run.smithi194.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T05:07:49.235 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T05:07:49.235 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T05:07:49.235 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T05:07:49.235 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T05:07:49.235 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T05:07:49.235 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T05:07:49.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T05:07:49.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T05:07:49.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T05:07:49.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T05:07:49.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T05:07:49.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T05:07:49.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T05:07:49.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T05:07:49.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T05:07:49.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T05:07:49.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T05:07:49.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T05:07:49.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T05:07:49.236 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T05:07:49.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T05:07:49.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T05:07:49.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T05:07:49.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T05:07:49.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T05:07:49.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T05:07:49.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T05:07:49.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T05:07:49.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T05:07:49.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T05:07:49.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T05:07:49.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T05:07:49.237 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T05:07:49.238 INFO:teuthology.orchestra.run.smithi194.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T05:07:49.238 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T05:07:49.238 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T05:07:49.238 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T05:07:49.238 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T05:07:49.238 INFO:teuthology.orchestra.run.smithi194.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T05:07:49.238 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T05:07:49.238 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T05:07:49.238 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T05:07:49.238 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T05:07:49.238 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T05:07:49.238 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T05:07:49.238 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T05:07:49.238 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T05:07:49.239 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T05:07:49.239 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T05:07:49.239 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T05:07:49.239 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T05:07:49.239 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T05:07:49.239 INFO:teuthology.orchestra.run.smithi194.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T05:07:49.239 INFO:teuthology.orchestra.run.smithi194.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T05:07:49.239 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T05:07:49.239 INFO:teuthology.orchestra.run.smithi194.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T05:07:49.239 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T05:07:49.239 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T05:07:49.239 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T05:07:49.239 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T05:07:49.240 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T05:07:49.240 INFO:teuthology.orchestra.run.smithi194.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T05:07:49.240 INFO:teuthology.orchestra.run.smithi194.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T05:07:49.240 INFO:teuthology.orchestra.run.smithi194.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T05:07:49.240 INFO:teuthology.orchestra.run.smithi194.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T05:07:49.240 INFO:teuthology.orchestra.run.smithi194.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T05:07:49.240 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T05:07:49.240 INFO:teuthology.orchestra.run.smithi194.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T05:07:49.240 INFO:teuthology.orchestra.run.smithi194.stdout:Installing weak dependencies: 2024-09-19T05:07:49.240 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T05:07:49.240 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:07:49.240 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-19T05:07:49.240 INFO:teuthology.orchestra.run.smithi194.stdout:====================================================================================== 2024-09-19T05:07:49.241 INFO:teuthology.orchestra.run.smithi194.stdout:Install 148 Packages 2024-09-19T05:07:49.241 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrade 8 Packages 2024-09-19T05:07:49.241 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:07:49.241 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 226 M 2024-09-19T05:07:49.241 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-19T05:07:49.667 INFO:teuthology.orchestra.run.smithi120.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-19T05:07:49.913 INFO:teuthology.orchestra.run.smithi194.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 51 kB/s | 6.6 kB 00:00 2024-09-19T05:07:50.096 INFO:teuthology.orchestra.run.smithi194.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 4.8 MB/s | 896 kB 00:00 2024-09-19T05:07:50.188 INFO:teuthology.orchestra.run.smithi194.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.5 MB/s | 145 kB 00:00 2024-09-19T05:07:50.263 INFO:teuthology.orchestra.run.smithi194.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-19T05:07:50.355 INFO:teuthology.orchestra.run.smithi194.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 17 MB/s | 1.5 MB 00:00 2024-09-19T05:07:50.439 INFO:teuthology.orchestra.run.smithi194.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 9.5 MB/s | 2.4 MB 00:00 2024-09-19T05:07:50.747 INFO:teuthology.orchestra.run.smithi194.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-09-19T05:07:50.948 INFO:teuthology.orchestra.run.smithi194.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 18 MB/s | 21 MB 00:01 2024-09-19T05:07:51.014 INFO:teuthology.orchestra.run.smithi194.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 379 kB/s | 25 kB 00:00 2024-09-19T05:07:51.348 INFO:teuthology.orchestra.run.smithi194.stdout:(10/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 19 MB/s | 17 MB 00:00 2024-09-19T05:07:51.398 INFO:teuthology.orchestra.run.smithi194.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 4.5 MB/s | 228 kB 00:00 2024-09-19T05:07:51.457 INFO:teuthology.orchestra.run.smithi194.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 464 kB/s | 27 kB 00:00 2024-09-19T05:07:51.507 INFO:teuthology.orchestra.run.smithi194.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 635 kB/s | 32 kB 00:00 2024-09-19T05:07:51.566 INFO:teuthology.orchestra.run.smithi194.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 13 MB/s | 751 kB 00:00 2024-09-19T05:07:51.699 INFO:teuthology.orchestra.run.smithi194.stdout:(15/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 11 MB/s | 11 MB 00:00 2024-09-19T05:07:51.724 INFO:teuthology.orchestra.run.smithi194.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 1.0 MB/s | 163 kB 00:00 2024-09-19T05:07:51.741 INFO:teuthology.orchestra.run.smithi194.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 3.0 MB/s | 127 kB 00:00 2024-09-19T05:07:51.775 INFO:teuthology.orchestra.run.smithi194.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 9.9 MB/s | 506 kB 00:00 2024-09-19T05:07:51.825 INFO:teuthology.orchestra.run.smithi194.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 906 kB/s | 45 kB 00:00 2024-09-19T05:07:51.869 INFO:teuthology.orchestra.run.smithi120.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:07:51.869 INFO:teuthology.orchestra.run.smithi120.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:07:51.875 INFO:teuthology.orchestra.run.smithi194.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.7 MB/s | 136 kB 00:00 2024-09-19T05:07:51.881 INFO:teuthology.orchestra.run.smithi120.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T05:07:51.882 INFO:teuthology.orchestra.run.smithi120.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T05:07:51.883 INFO:teuthology.orchestra.run.smithi120.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T05:07:51.883 INFO:teuthology.orchestra.run.smithi120.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T05:07:51.885 INFO:teuthology.orchestra.run.smithi120.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T05:07:51.888 INFO:teuthology.orchestra.run.smithi120.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T05:07:51.888 INFO:teuthology.orchestra.run.smithi120.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T05:07:51.926 INFO:teuthology.orchestra.run.smithi194.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 3.2 MB/s | 161 kB 00:00 2024-09-19T05:07:51.951 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2024-09-19T05:07:51.968 INFO:teuthology.orchestra.run.smithi120.stdout:====================================================================================== 2024-09-19T05:07:51.968 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2024-09-19T05:07:51.968 INFO:teuthology.orchestra.run.smithi120.stdout:====================================================================================== 2024-09-19T05:07:51.968 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2024-09-19T05:07:51.968 INFO:teuthology.orchestra.run.smithi120.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T05:07:51.968 INFO:teuthology.orchestra.run.smithi120.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T05:07:51.968 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T05:07:51.968 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T05:07:51.968 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T05:07:51.968 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T05:07:51.968 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T05:07:51.968 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T05:07:51.969 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T05:07:51.969 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T05:07:51.969 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T05:07:51.969 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T05:07:51.969 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T05:07:51.969 INFO:teuthology.orchestra.run.smithi120.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T05:07:51.969 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T05:07:51.969 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T05:07:51.969 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T05:07:51.969 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T05:07:51.969 INFO:teuthology.orchestra.run.smithi120.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T05:07:51.969 INFO:teuthology.orchestra.run.smithi120.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T05:07:51.970 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T05:07:51.970 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T05:07:51.970 INFO:teuthology.orchestra.run.smithi120.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T05:07:51.970 INFO:teuthology.orchestra.run.smithi120.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T05:07:51.972 INFO:teuthology.orchestra.run.smithi120.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T05:07:51.972 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T05:07:51.972 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T05:07:51.972 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T05:07:51.972 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T05:07:51.973 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T05:07:51.973 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T05:07:51.973 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T05:07:51.973 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T05:07:51.973 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T05:07:51.974 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T05:07:51.974 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T05:07:51.974 INFO:teuthology.orchestra.run.smithi120.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T05:07:51.974 INFO:teuthology.orchestra.run.smithi120.stdout:Upgrading: 2024-09-19T05:07:51.974 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T05:07:51.974 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T05:07:51.974 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T05:07:51.974 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T05:07:51.974 INFO:teuthology.orchestra.run.smithi120.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T05:07:51.974 INFO:teuthology.orchestra.run.smithi120.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T05:07:51.974 INFO:teuthology.orchestra.run.smithi120.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T05:07:51.974 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T05:07:51.975 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2024-09-19T05:07:51.975 INFO:teuthology.orchestra.run.smithi120.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T05:07:51.975 INFO:teuthology.orchestra.run.smithi120.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T05:07:51.975 INFO:teuthology.orchestra.run.smithi120.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T05:07:51.975 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T05:07:51.975 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T05:07:51.975 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T05:07:51.975 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T05:07:51.976 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T05:07:51.976 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T05:07:51.976 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T05:07:51.976 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T05:07:51.976 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T05:07:51.976 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T05:07:51.976 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T05:07:51.976 INFO:teuthology.orchestra.run.smithi120.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T05:07:51.976 INFO:teuthology.orchestra.run.smithi120.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T05:07:51.976 INFO:teuthology.orchestra.run.smithi120.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T05:07:51.977 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T05:07:51.977 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T05:07:51.977 INFO:teuthology.orchestra.run.smithi120.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T05:07:51.977 INFO:teuthology.orchestra.run.smithi120.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T05:07:51.977 INFO:teuthology.orchestra.run.smithi120.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T05:07:51.977 INFO:teuthology.orchestra.run.smithi120.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T05:07:51.977 INFO:teuthology.orchestra.run.smithi120.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T05:07:51.977 INFO:teuthology.orchestra.run.smithi120.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T05:07:51.977 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T05:07:51.977 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T05:07:51.977 INFO:teuthology.orchestra.run.smithi120.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T05:07:51.977 INFO:teuthology.orchestra.run.smithi120.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T05:07:51.978 INFO:teuthology.orchestra.run.smithi120.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T05:07:51.978 INFO:teuthology.orchestra.run.smithi120.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T05:07:51.978 INFO:teuthology.orchestra.run.smithi120.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T05:07:51.978 INFO:teuthology.orchestra.run.smithi120.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T05:07:51.978 INFO:teuthology.orchestra.run.smithi120.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T05:07:51.978 INFO:teuthology.orchestra.run.smithi120.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T05:07:51.978 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T05:07:51.978 INFO:teuthology.orchestra.run.smithi120.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T05:07:51.978 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T05:07:51.978 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T05:07:51.978 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T05:07:51.978 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T05:07:51.978 INFO:teuthology.orchestra.run.smithi120.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T05:07:51.978 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T05:07:51.979 INFO:teuthology.orchestra.run.smithi120.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T05:07:51.979 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T05:07:51.979 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T05:07:51.979 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T05:07:51.979 INFO:teuthology.orchestra.run.smithi120.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T05:07:51.979 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T05:07:51.979 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T05:07:51.979 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T05:07:51.980 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T05:07:51.980 INFO:teuthology.orchestra.run.smithi120.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T05:07:51.980 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T05:07:51.980 INFO:teuthology.orchestra.run.smithi120.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T05:07:51.980 INFO:teuthology.orchestra.run.smithi120.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T05:07:51.980 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T05:07:51.980 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T05:07:51.980 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T05:07:51.980 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T05:07:51.980 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T05:07:51.980 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T05:07:51.980 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T05:07:51.981 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T05:07:51.981 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T05:07:51.981 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T05:07:51.981 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T05:07:51.981 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T05:07:51.981 INFO:teuthology.orchestra.run.smithi120.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T05:07:51.981 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T05:07:51.981 INFO:teuthology.orchestra.run.smithi120.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T05:07:51.981 INFO:teuthology.orchestra.run.smithi120.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T05:07:51.981 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T05:07:51.981 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T05:07:51.981 INFO:teuthology.orchestra.run.smithi120.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T05:07:51.981 INFO:teuthology.orchestra.run.smithi120.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T05:07:51.981 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T05:07:51.982 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T05:07:51.982 INFO:teuthology.orchestra.run.smithi120.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T05:07:51.982 INFO:teuthology.orchestra.run.smithi120.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T05:07:51.982 INFO:teuthology.orchestra.run.smithi120.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T05:07:51.982 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T05:07:51.982 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T05:07:51.982 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T05:07:51.982 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T05:07:51.982 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T05:07:51.982 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T05:07:51.982 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T05:07:51.982 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T05:07:51.982 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T05:07:51.982 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T05:07:51.983 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T05:07:51.983 INFO:teuthology.orchestra.run.smithi120.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T05:07:51.983 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T05:07:51.983 INFO:teuthology.orchestra.run.smithi120.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T05:07:51.983 INFO:teuthology.orchestra.run.smithi120.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T05:07:51.983 INFO:teuthology.orchestra.run.smithi120.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T05:07:51.983 INFO:teuthology.orchestra.run.smithi120.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T05:07:51.983 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T05:07:51.983 INFO:teuthology.orchestra.run.smithi120.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T05:07:51.983 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T05:07:51.983 INFO:teuthology.orchestra.run.smithi120.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T05:07:51.983 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T05:07:51.983 INFO:teuthology.orchestra.run.smithi120.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T05:07:51.983 INFO:teuthology.orchestra.run.smithi120.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T05:07:51.984 INFO:teuthology.orchestra.run.smithi120.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T05:07:51.984 INFO:teuthology.orchestra.run.smithi120.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T05:07:51.984 INFO:teuthology.orchestra.run.smithi120.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T05:07:51.984 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T05:07:51.984 INFO:teuthology.orchestra.run.smithi120.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T05:07:51.984 INFO:teuthology.orchestra.run.smithi120.stdout:Installing weak dependencies: 2024-09-19T05:07:51.984 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T05:07:51.984 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:07:51.984 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2024-09-19T05:07:51.984 INFO:teuthology.orchestra.run.smithi120.stdout:====================================================================================== 2024-09-19T05:07:51.984 INFO:teuthology.orchestra.run.smithi120.stdout:Install 148 Packages 2024-09-19T05:07:51.984 INFO:teuthology.orchestra.run.smithi120.stdout:Upgrade 8 Packages 2024-09-19T05:07:51.984 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:07:51.985 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 226 M 2024-09-19T05:07:51.985 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2024-09-19T05:07:51.992 INFO:teuthology.orchestra.run.smithi194.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 4.7 MB/s | 320 kB 00:00 2024-09-19T05:07:52.085 INFO:teuthology.orchestra.run.smithi194.stdout:(23/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 16 MB/s | 5.3 MB 00:00 2024-09-19T05:07:52.110 INFO:teuthology.orchestra.run.smithi194.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 2.5 MB/s | 300 kB 00:00 2024-09-19T05:07:52.127 INFO:teuthology.orchestra.run.smithi194.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 2.3 MB/s | 99 kB 00:00 2024-09-19T05:07:52.161 INFO:teuthology.orchestra.run.smithi194.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T05:07:52.219 INFO:teuthology.orchestra.run.smithi194.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-19T05:07:52.269 INFO:teuthology.orchestra.run.smithi194.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 639 kB/s | 32 kB 00:00 2024-09-19T05:07:52.345 INFO:teuthology.orchestra.run.smithi194.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 14 MB/s | 3.1 MB 00:00 2024-09-19T05:07:52.370 INFO:teuthology.orchestra.run.smithi194.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.4 MB/s | 146 kB 00:00 2024-09-19T05:07:52.645 INFO:teuthology.orchestra.run.smithi194.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 12 MB/s | 3.6 MB 00:00 2024-09-19T05:07:52.729 INFO:teuthology.orchestra.run.smithi194.stdout:(32/156): ceph-mgr-diskprediction-local-19.1.1- 21 MB/s | 7.4 MB 00:00 2024-09-19T05:07:52.754 INFO:teuthology.orchestra.run.smithi194.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.2 MB/s | 249 kB 00:00 2024-09-19T05:07:52.779 INFO:teuthology.orchestra.run.smithi194.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 988 kB/s | 49 kB 00:00 2024-09-19T05:07:52.804 INFO:teuthology.orchestra.run.smithi194.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 329 kB/s | 16 kB 00:00 2024-09-19T05:07:52.830 INFO:teuthology.orchestra.run.smithi194.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.6 MB/s | 285 kB 00:00 2024-09-19T05:07:52.872 INFO:teuthology.orchestra.run.smithi194.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 439 kB/s | 18 kB 00:00 2024-09-19T05:07:52.905 INFO:teuthology.orchestra.run.smithi194.stdout:(38/156): cephadm-19.1.1-361.g2f599a46.el9.noar 7.4 MB/s | 765 kB 00:00 2024-09-19T05:07:52.958 INFO:teuthology.orchestra.run.smithi178.stdout:lab-extras 48 kB/s | 1.7 kB 00:00 2024-09-19T05:07:52.989 INFO:teuthology.orchestra.run.smithi194.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 684 kB/s | 80 kB 00:00 2024-09-19T05:07:53.047 INFO:teuthology.orchestra.run.smithi194.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T05:07:53.073 INFO:teuthology.orchestra.run.smithi194.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.7 MB/s | 801 kB 00:00 2024-09-19T05:07:53.106 INFO:teuthology.orchestra.run.smithi194.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-19T05:07:53.148 INFO:teuthology.orchestra.run.smithi194.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-09-19T05:07:53.165 INFO:teuthology.orchestra.run.smithi194.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-19T05:07:53.190 INFO:teuthology.orchestra.run.smithi194.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-09-19T05:07:53.216 INFO:teuthology.orchestra.run.smithi194.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-19T05:07:53.241 INFO:teuthology.orchestra.run.smithi194.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T05:07:53.310 INFO:teuthology.orchestra.run.smithi120.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 21 kB/s | 6.6 kB 00:00 2024-09-19T05:07:53.475 INFO:teuthology.orchestra.run.smithi194.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-09-19T05:07:53.525 INFO:teuthology.orchestra.run.smithi194.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-19T05:07:53.526 INFO:teuthology.orchestra.run.smithi120.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 4.0 MB/s | 896 kB 00:00 2024-09-19T05:07:53.567 INFO:teuthology.orchestra.run.smithi194.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-09-19T05:07:53.592 INFO:teuthology.orchestra.run.smithi194.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 323 kB/s | 22 kB 00:00 2024-09-19T05:07:53.619 INFO:teuthology.orchestra.run.smithi120.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.5 MB/s | 145 kB 00:00 2024-09-19T05:07:53.642 INFO:teuthology.orchestra.run.smithi194.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 657 kB/s | 33 kB 00:00 2024-09-19T05:07:53.693 INFO:teuthology.orchestra.run.smithi194.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-09-19T05:07:53.743 INFO:teuthology.orchestra.run.smithi194.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-09-19T05:07:53.785 INFO:teuthology.orchestra.run.smithi120.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 6.9 MB/s | 5.4 MB 00:00 2024-09-19T05:07:53.793 INFO:teuthology.orchestra.run.smithi194.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-19T05:07:53.869 INFO:teuthology.orchestra.run.smithi194.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-19T05:07:53.911 INFO:teuthology.orchestra.run.smithi194.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-19T05:07:53.927 INFO:teuthology.orchestra.run.smithi120.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 1.5 MB 00:00 2024-09-19T05:07:53.969 INFO:teuthology.orchestra.run.smithi120.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 6.8 MB/s | 2.4 MB 00:00 2024-09-19T05:07:54.077 INFO:teuthology.orchestra.run.smithi194.stdout:(58/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-19T05:07:54.211 INFO:teuthology.orchestra.run.smithi194.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.3 MB/s | 3.0 MB 00:00 2024-09-19T05:07:54.261 INFO:teuthology.orchestra.run.smithi194.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 3.1 MB/s | 581 kB 00:00 2024-09-19T05:07:54.286 INFO:teuthology.orchestra.run.smithi120.stdout:(7/156): ceph-common-19.1.1-361.g2f599a46.el9.x 17 MB/s | 21 MB 00:01 2024-09-19T05:07:54.287 INFO:teuthology.orchestra.run.smithi194.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 325 kB/s | 24 kB 00:00 2024-09-19T05:07:54.312 INFO:teuthology.orchestra.run.smithi194.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 948 kB/s | 47 kB 00:00 2024-09-19T05:07:54.361 INFO:teuthology.orchestra.run.smithi120.stdout:(8/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-09-19T05:07:54.370 INFO:teuthology.orchestra.run.smithi194.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-19T05:07:54.396 INFO:teuthology.orchestra.run.smithi194.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-19T05:07:54.421 INFO:teuthology.orchestra.run.smithi194.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 766 kB/s | 38 kB 00:00 2024-09-19T05:07:54.445 INFO:teuthology.orchestra.run.smithi120.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 302 kB/s | 25 kB 00:00 2024-09-19T05:07:54.820 INFO:teuthology.orchestra.run.smithi120.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 20 MB/s | 11 MB 00:00 2024-09-19T05:07:54.879 INFO:teuthology.orchestra.run.smithi120.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.8 MB/s | 228 kB 00:00 2024-09-19T05:07:54.938 INFO:teuthology.orchestra.run.smithi120.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 464 kB/s | 27 kB 00:00 2024-09-19T05:07:54.996 INFO:teuthology.orchestra.run.smithi120.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 546 kB/s | 32 kB 00:00 2024-09-19T05:07:55.071 INFO:teuthology.orchestra.run.smithi120.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 9.8 MB/s | 751 kB 00:00 2024-09-19T05:07:55.096 INFO:teuthology.orchestra.run.smithi194.stdout:(66/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 6.6 MB/s | 4.4 MB 00:00 2024-09-19T05:07:55.130 INFO:teuthology.orchestra.run.smithi120.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.7 MB/s | 163 kB 00:00 2024-09-19T05:07:55.135 INFO:teuthology.orchestra.run.smithi178.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:07:55.137 INFO:teuthology.orchestra.run.smithi178.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T05:07:55.150 INFO:teuthology.orchestra.run.smithi178.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T05:07:55.151 INFO:teuthology.orchestra.run.smithi178.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T05:07:55.152 INFO:teuthology.orchestra.run.smithi178.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T05:07:55.153 INFO:teuthology.orchestra.run.smithi178.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T05:07:55.155 INFO:teuthology.orchestra.run.smithi178.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T05:07:55.158 INFO:teuthology.orchestra.run.smithi178.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T05:07:55.159 INFO:teuthology.orchestra.run.smithi178.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T05:07:55.222 INFO:teuthology.orchestra.run.smithi178.stdout:Dependencies resolved. 2024-09-19T05:07:55.247 INFO:teuthology.orchestra.run.smithi178.stdout:====================================================================================== 2024-09-19T05:07:55.247 INFO:teuthology.orchestra.run.smithi178.stdout: Package Arch Version Repository Size 2024-09-19T05:07:55.247 INFO:teuthology.orchestra.run.smithi178.stdout:====================================================================================== 2024-09-19T05:07:55.247 INFO:teuthology.orchestra.run.smithi178.stdout:Installing: 2024-09-19T05:07:55.247 INFO:teuthology.orchestra.run.smithi178.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T05:07:55.247 INFO:teuthology.orchestra.run.smithi178.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T05:07:55.247 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T05:07:55.248 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T05:07:55.248 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T05:07:55.248 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T05:07:55.248 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T05:07:55.248 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T05:07:55.248 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T05:07:55.248 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T05:07:55.248 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T05:07:55.248 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T05:07:55.248 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T05:07:55.248 INFO:teuthology.orchestra.run.smithi178.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T05:07:55.249 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T05:07:55.249 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T05:07:55.249 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T05:07:55.249 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T05:07:55.249 INFO:teuthology.orchestra.run.smithi178.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T05:07:55.249 INFO:teuthology.orchestra.run.smithi178.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T05:07:55.249 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T05:07:55.249 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T05:07:55.249 INFO:teuthology.orchestra.run.smithi178.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T05:07:55.249 INFO:teuthology.orchestra.run.smithi178.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T05:07:55.249 INFO:teuthology.orchestra.run.smithi178.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T05:07:55.250 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T05:07:55.250 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T05:07:55.250 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T05:07:55.250 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T05:07:55.250 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T05:07:55.250 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T05:07:55.250 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T05:07:55.250 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T05:07:55.250 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T05:07:55.250 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T05:07:55.250 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T05:07:55.250 INFO:teuthology.orchestra.run.smithi178.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T05:07:55.251 INFO:teuthology.orchestra.run.smithi178.stdout:Upgrading: 2024-09-19T05:07:55.251 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T05:07:55.251 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T05:07:55.251 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T05:07:55.251 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T05:07:55.251 INFO:teuthology.orchestra.run.smithi178.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T05:07:55.251 INFO:teuthology.orchestra.run.smithi178.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T05:07:55.251 INFO:teuthology.orchestra.run.smithi178.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T05:07:55.251 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T05:07:55.251 INFO:teuthology.orchestra.run.smithi178.stdout:Installing dependencies: 2024-09-19T05:07:55.251 INFO:teuthology.orchestra.run.smithi178.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T05:07:55.252 INFO:teuthology.orchestra.run.smithi178.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T05:07:55.252 INFO:teuthology.orchestra.run.smithi178.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T05:07:55.252 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T05:07:55.252 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T05:07:55.252 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T05:07:55.252 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T05:07:55.252 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T05:07:55.252 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T05:07:55.252 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T05:07:55.252 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T05:07:55.252 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T05:07:55.253 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T05:07:55.253 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T05:07:55.253 INFO:teuthology.orchestra.run.smithi178.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T05:07:55.253 INFO:teuthology.orchestra.run.smithi178.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T05:07:55.253 INFO:teuthology.orchestra.run.smithi178.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T05:07:55.253 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T05:07:55.253 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T05:07:55.253 INFO:teuthology.orchestra.run.smithi178.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T05:07:55.253 INFO:teuthology.orchestra.run.smithi178.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T05:07:55.253 INFO:teuthology.orchestra.run.smithi178.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T05:07:55.253 INFO:teuthology.orchestra.run.smithi178.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T05:07:55.253 INFO:teuthology.orchestra.run.smithi178.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T05:07:55.254 INFO:teuthology.orchestra.run.smithi178.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T05:07:55.254 INFO:teuthology.orchestra.run.smithi178.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T05:07:55.254 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T05:07:55.254 INFO:teuthology.orchestra.run.smithi178.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T05:07:55.254 INFO:teuthology.orchestra.run.smithi178.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T05:07:55.254 INFO:teuthology.orchestra.run.smithi178.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T05:07:55.254 INFO:teuthology.orchestra.run.smithi178.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T05:07:55.254 INFO:teuthology.orchestra.run.smithi178.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T05:07:55.254 INFO:teuthology.orchestra.run.smithi178.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T05:07:55.254 INFO:teuthology.orchestra.run.smithi178.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T05:07:55.254 INFO:teuthology.orchestra.run.smithi178.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T05:07:55.255 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T05:07:55.255 INFO:teuthology.orchestra.run.smithi178.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T05:07:55.255 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T05:07:55.255 INFO:teuthology.orchestra.run.smithi178.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T05:07:55.255 INFO:teuthology.orchestra.run.smithi178.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T05:07:55.255 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T05:07:55.255 INFO:teuthology.orchestra.run.smithi178.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T05:07:55.255 INFO:teuthology.orchestra.run.smithi178.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T05:07:55.255 INFO:teuthology.orchestra.run.smithi178.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T05:07:55.255 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T05:07:55.255 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T05:07:55.256 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T05:07:55.256 INFO:teuthology.orchestra.run.smithi178.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T05:07:55.256 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T05:07:55.256 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T05:07:55.256 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T05:07:55.256 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T05:07:55.256 INFO:teuthology.orchestra.run.smithi178.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T05:07:55.256 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T05:07:55.256 INFO:teuthology.orchestra.run.smithi178.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T05:07:55.256 INFO:teuthology.orchestra.run.smithi178.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T05:07:55.256 INFO:teuthology.orchestra.run.smithi178.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T05:07:55.256 INFO:teuthology.orchestra.run.smithi178.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T05:07:55.257 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T05:07:55.257 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T05:07:55.257 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T05:07:55.257 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T05:07:55.257 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T05:07:55.257 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T05:07:55.257 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T05:07:55.257 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T05:07:55.257 INFO:teuthology.orchestra.run.smithi178.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T05:07:55.257 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T05:07:55.257 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T05:07:55.258 INFO:teuthology.orchestra.run.smithi178.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T05:07:55.258 INFO:teuthology.orchestra.run.smithi178.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T05:07:55.258 INFO:teuthology.orchestra.run.smithi178.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T05:07:55.258 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T05:07:55.258 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T05:07:55.258 INFO:teuthology.orchestra.run.smithi178.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T05:07:55.258 INFO:teuthology.orchestra.run.smithi178.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T05:07:55.258 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T05:07:55.258 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T05:07:55.258 INFO:teuthology.orchestra.run.smithi178.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T05:07:55.258 INFO:teuthology.orchestra.run.smithi178.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T05:07:55.258 INFO:teuthology.orchestra.run.smithi178.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T05:07:55.259 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T05:07:55.259 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T05:07:55.259 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T05:07:55.259 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T05:07:55.259 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T05:07:55.259 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T05:07:55.259 INFO:teuthology.orchestra.run.smithi178.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T05:07:55.259 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T05:07:55.259 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T05:07:55.259 INFO:teuthology.orchestra.run.smithi178.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T05:07:55.259 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T05:07:55.260 INFO:teuthology.orchestra.run.smithi178.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T05:07:55.260 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T05:07:55.260 INFO:teuthology.orchestra.run.smithi178.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T05:07:55.260 INFO:teuthology.orchestra.run.smithi178.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T05:07:55.260 INFO:teuthology.orchestra.run.smithi178.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T05:07:55.260 INFO:teuthology.orchestra.run.smithi178.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T05:07:55.260 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T05:07:55.260 INFO:teuthology.orchestra.run.smithi178.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T05:07:55.260 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T05:07:55.260 INFO:teuthology.orchestra.run.smithi178.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T05:07:55.260 INFO:teuthology.orchestra.run.smithi178.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T05:07:55.260 INFO:teuthology.orchestra.run.smithi178.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T05:07:55.261 INFO:teuthology.orchestra.run.smithi178.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T05:07:55.261 INFO:teuthology.orchestra.run.smithi178.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T05:07:55.261 INFO:teuthology.orchestra.run.smithi178.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T05:07:55.261 INFO:teuthology.orchestra.run.smithi178.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T05:07:55.261 INFO:teuthology.orchestra.run.smithi178.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T05:07:55.261 INFO:teuthology.orchestra.run.smithi178.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T05:07:55.261 INFO:teuthology.orchestra.run.smithi178.stdout:Installing weak dependencies: 2024-09-19T05:07:55.261 INFO:teuthology.orchestra.run.smithi178.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T05:07:55.261 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-19T05:07:55.261 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction Summary 2024-09-19T05:07:55.261 INFO:teuthology.orchestra.run.smithi178.stdout:====================================================================================== 2024-09-19T05:07:55.262 INFO:teuthology.orchestra.run.smithi178.stdout:Install 148 Packages 2024-09-19T05:07:55.262 INFO:teuthology.orchestra.run.smithi178.stdout:Upgrade 8 Packages 2024-09-19T05:07:55.262 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-19T05:07:55.262 INFO:teuthology.orchestra.run.smithi178.stdout:Total download size: 226 M 2024-09-19T05:07:55.262 INFO:teuthology.orchestra.run.smithi178.stdout:Downloading Packages: 2024-09-19T05:07:55.330 INFO:teuthology.orchestra.run.smithi194.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2024-09-19T05:07:55.331 INFO:teuthology.orchestra.run.smithi120.stdout:(16/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 17 MB 00:01 2024-09-19T05:07:55.356 INFO:teuthology.orchestra.run.smithi120.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 562 kB/s | 127 kB 00:00 2024-09-19T05:07:55.390 INFO:teuthology.orchestra.run.smithi120.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 8.5 MB/s | 506 kB 00:00 2024-09-19T05:07:55.397 INFO:teuthology.orchestra.run.smithi194.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.9 MB/s | 4.9 MB 00:01 2024-09-19T05:07:55.449 INFO:teuthology.orchestra.run.smithi120.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 774 kB/s | 45 kB 00:00 2024-09-19T05:07:55.455 INFO:teuthology.orchestra.run.smithi194.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-19T05:07:55.522 INFO:teuthology.orchestra.run.smithi194.stdout:(70/156): postgresql-contrib-13.16-1.el9.x86_64 4.6 MB/s | 910 kB 00:00 2024-09-19T05:07:55.523 INFO:teuthology.orchestra.run.smithi120.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.8 MB/s | 136 kB 00:00 2024-09-19T05:07:55.607 INFO:teuthology.orchestra.run.smithi120.stdout:(21/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 21 MB/s | 5.3 MB 00:00 2024-09-19T05:07:55.632 INFO:teuthology.orchestra.run.smithi120.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.5 MB/s | 161 kB 00:00 2024-09-19T05:07:55.668 INFO:teuthology.orchestra.run.smithi120.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 5.4 MB/s | 320 kB 00:00 2024-09-19T05:07:55.689 INFO:teuthology.orchestra.run.smithi194.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 6.1 MB/s | 1.0 MB 00:00 2024-09-19T05:07:55.700 INFO:teuthology.orchestra.run.smithi120.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 4.4 MB/s | 300 kB 00:00 2024-09-19T05:07:55.725 INFO:teuthology.orchestra.run.smithi120.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.7 MB/s | 99 kB 00:00 2024-09-19T05:07:55.739 INFO:teuthology.orchestra.run.smithi194.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-19T05:07:55.750 INFO:teuthology.orchestra.run.smithi120.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T05:07:55.834 INFO:teuthology.orchestra.run.smithi120.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.0 MB/s | 171 kB 00:00 2024-09-19T05:07:55.909 INFO:teuthology.orchestra.run.smithi120.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 17 MB/s | 3.1 MB 00:00 2024-09-19T05:07:55.935 INFO:teuthology.orchestra.run.smithi120.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 317 kB/s | 32 kB 00:00 2024-09-19T05:07:55.960 INFO:teuthology.orchestra.run.smithi120.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.9 MB/s | 146 kB 00:00 2024-09-19T05:07:56.302 INFO:teuthology.orchestra.run.smithi120.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 9.7 MB/s | 3.6 MB 00:00 2024-09-19T05:07:56.325 INFO:teuthology.orchestra.run.smithi178.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 36 kB/s | 6.6 kB 00:00 2024-09-19T05:07:56.331 INFO:teuthology.orchestra.run.smithi194.stdout:(73/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 9.2 MB/s | 49 MB 00:05 2024-09-19T05:07:56.394 INFO:teuthology.orchestra.run.smithi120.stdout:(32/156): ceph-mgr-diskprediction-local-19.1.1- 17 MB/s | 7.4 MB 00:00 2024-09-19T05:07:56.419 INFO:teuthology.orchestra.run.smithi120.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.1 MB/s | 249 kB 00:00 2024-09-19T05:07:56.444 INFO:teuthology.orchestra.run.smithi120.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 986 kB/s | 49 kB 00:00 2024-09-19T05:07:56.448 INFO:teuthology.orchestra.run.smithi194.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 527 kB/s | 61 kB 00:00 2024-09-19T05:07:56.470 INFO:teuthology.orchestra.run.smithi120.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 326 kB/s | 16 kB 00:00 2024-09-19T05:07:56.495 INFO:teuthology.orchestra.run.smithi120.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.5 MB/s | 285 kB 00:00 2024-09-19T05:07:56.557 INFO:teuthology.orchestra.run.smithi194.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-19T05:07:56.576 INFO:teuthology.orchestra.run.smithi178.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 3.5 MB/s | 896 kB 00:00 2024-09-19T05:07:56.579 INFO:teuthology.orchestra.run.smithi120.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 219 kB/s | 18 kB 00:00 2024-09-19T05:07:56.621 INFO:teuthology.orchestra.run.smithi120.stdout:(38/156): cephadm-19.1.1-361.g2f599a46.el9.noar 5.0 MB/s | 765 kB 00:00 2024-09-19T05:07:56.632 INFO:teuthology.orchestra.run.smithi194.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-09-19T05:07:56.651 INFO:teuthology.orchestra.run.smithi178.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.9 MB/s | 145 kB 00:00 2024-09-19T05:07:56.704 INFO:teuthology.orchestra.run.smithi120.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 638 kB/s | 80 kB 00:00 2024-09-19T05:07:56.741 INFO:teuthology.orchestra.run.smithi194.stdout:(77/156): postgresql-server-13.16-1.el9.x86_64. 4.5 MB/s | 5.8 MB 00:01 2024-09-19T05:07:56.766 INFO:teuthology.orchestra.run.smithi194.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 192 kB/s | 26 kB 00:00 2024-09-19T05:07:56.791 INFO:teuthology.orchestra.run.smithi194.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-19T05:07:56.817 INFO:teuthology.orchestra.run.smithi194.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-19T05:07:56.842 INFO:teuthology.orchestra.run.smithi194.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-09-19T05:07:56.859 INFO:teuthology.orchestra.run.smithi178.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 7.6 MB/s | 5.4 MB 00:00 2024-09-19T05:07:56.925 INFO:teuthology.orchestra.run.smithi194.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-19T05:07:56.993 INFO:teuthology.orchestra.run.smithi178.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 1.5 MB 00:00 2024-09-19T05:07:57.026 INFO:teuthology.orchestra.run.smithi194.stdout:(83/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.6 MB/s | 6.0 MB 00:01 2024-09-19T05:07:57.035 INFO:teuthology.orchestra.run.smithi178.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 6.2 MB/s | 2.4 MB 00:00 2024-09-19T05:07:57.076 INFO:teuthology.orchestra.run.smithi194.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T05:07:57.118 INFO:teuthology.orchestra.run.smithi194.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-19T05:07:57.151 INFO:teuthology.orchestra.run.smithi194.stdout:(86/156): python3-oauthlib-3.1.1-5.el9.noarch.r 984 kB/s | 222 kB 00:00 2024-09-19T05:07:57.163 INFO:teuthology.orchestra.run.smithi120.stdout:(40/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 18 MB/s | 49 MB 00:02 2024-09-19T05:07:57.188 INFO:teuthology.orchestra.run.smithi120.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 395 kB/s | 191 kB 00:00 2024-09-19T05:07:57.201 INFO:teuthology.orchestra.run.smithi194.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 269 kB 00:00 2024-09-19T05:07:57.227 INFO:teuthology.orchestra.run.smithi194.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-19T05:07:57.230 INFO:teuthology.orchestra.run.smithi120.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 801 kB 00:00 2024-09-19T05:07:57.272 INFO:teuthology.orchestra.run.smithi120.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-19T05:07:57.277 INFO:teuthology.orchestra.run.smithi194.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T05:07:57.302 INFO:teuthology.orchestra.run.smithi194.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-09-19T05:07:57.314 INFO:teuthology.orchestra.run.smithi120.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-09-19T05:07:57.327 INFO:teuthology.orchestra.run.smithi178.stdout:(7/156): ceph-common-19.1.1-361.g2f599a46.el9.x 18 MB/s | 21 MB 00:01 2024-09-19T05:07:57.328 INFO:teuthology.orchestra.run.smithi194.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T05:07:57.339 INFO:teuthology.orchestra.run.smithi120.stdout:(45/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2024-09-19T05:07:57.365 INFO:teuthology.orchestra.run.smithi120.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-19T05:07:57.378 INFO:teuthology.orchestra.run.smithi194.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 835 kB/s | 42 kB 00:00 2024-09-19T05:07:57.410 INFO:teuthology.orchestra.run.smithi178.stdout:(8/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-09-19T05:07:57.428 INFO:teuthology.orchestra.run.smithi194.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 886 kB/s | 44 kB 00:00 2024-09-19T05:07:57.429 INFO:teuthology.orchestra.run.smithi120.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.4 MB/s | 215 kB 00:00 2024-09-19T05:07:57.477 INFO:teuthology.orchestra.run.smithi178.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 377 kB/s | 25 kB 00:00 2024-09-19T05:07:57.482 INFO:teuthology.orchestra.run.smithi120.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 4.2 MB/s | 1.2 MB 00:00 2024-09-19T05:07:57.512 INFO:teuthology.orchestra.run.smithi194.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-19T05:07:57.570 INFO:teuthology.orchestra.run.smithi194.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 617 kB/s | 36 kB 00:00 2024-09-19T05:07:57.599 INFO:teuthology.orchestra.run.smithi120.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 689 kB 00:00 2024-09-19T05:07:57.624 INFO:teuthology.orchestra.run.smithi120.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 754 kB/s | 107 kB 00:00 2024-09-19T05:07:57.629 INFO:teuthology.orchestra.run.smithi194.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 813 kB/s | 47 kB 00:00 2024-09-19T05:07:57.641 INFO:teuthology.orchestra.run.smithi120.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 519 kB/s | 22 kB 00:00 2024-09-19T05:07:57.675 INFO:teuthology.orchestra.run.smithi120.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.7 MB/s | 943 kB 00:00 2024-09-19T05:07:57.692 INFO:teuthology.orchestra.run.smithi120.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 652 kB/s | 33 kB 00:00 2024-09-19T05:07:57.712 INFO:teuthology.orchestra.run.smithi194.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.6 MB/s | 304 kB 00:00 2024-09-19T05:07:57.725 INFO:teuthology.orchestra.run.smithi120.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 3.0 MB/s | 313 kB 00:00 2024-09-19T05:07:57.751 INFO:teuthology.orchestra.run.smithi120.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 310 kB/s | 18 kB 00:00 2024-09-19T05:07:57.763 INFO:teuthology.orchestra.run.smithi194.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-19T05:07:57.776 INFO:teuthology.orchestra.run.smithi120.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-09-19T05:07:57.802 INFO:teuthology.orchestra.run.smithi120.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-19T05:07:57.813 INFO:teuthology.orchestra.run.smithi194.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-19T05:07:57.827 INFO:teuthology.orchestra.run.smithi120.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 900 kB/s | 45 kB 00:00 2024-09-19T05:07:57.827 INFO:teuthology.orchestra.run.smithi178.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 21 MB/s | 11 MB 00:00 2024-09-19T05:07:57.863 INFO:teuthology.orchestra.run.smithi194.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T05:07:57.869 INFO:teuthology.orchestra.run.smithi120.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-19T05:07:57.894 INFO:teuthology.orchestra.run.smithi178.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.4 MB/s | 228 kB 00:00 2024-09-19T05:07:57.914 INFO:teuthology.orchestra.run.smithi194.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 899 kB/s | 45 kB 00:00 2024-09-19T05:07:57.920 INFO:teuthology.orchestra.run.smithi120.stdout:(60/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-09-19T05:07:57.944 INFO:teuthology.orchestra.run.smithi120.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 325 kB/s | 24 kB 00:00 2024-09-19T05:07:57.969 INFO:teuthology.orchestra.run.smithi178.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 361 kB/s | 27 kB 00:00 2024-09-19T05:07:57.970 INFO:teuthology.orchestra.run.smithi120.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-19T05:07:57.981 INFO:teuthology.orchestra.run.smithi194.stdout:(102/156): python3-numpy-1.20.1-5.el9.x86_64.rp 4.4 MB/s | 5.1 MB 00:01 2024-09-19T05:07:57.995 INFO:teuthology.orchestra.run.smithi120.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-19T05:07:58.020 INFO:teuthology.orchestra.run.smithi120.stdout:(64/156): libtool-2.4.6-46.el9.x86_64.rpm 2.9 MB/s | 581 kB 00:00 2024-09-19T05:07:58.045 INFO:teuthology.orchestra.run.smithi178.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 423 kB/s | 32 kB 00:00 2024-09-19T05:07:58.045 INFO:teuthology.orchestra.run.smithi120.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-19T05:07:58.071 INFO:teuthology.orchestra.run.smithi120.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-19T05:07:58.138 INFO:teuthology.orchestra.run.smithi120.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-09-19T05:07:58.197 INFO:teuthology.orchestra.run.smithi120.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 15 MB/s | 910 kB 00:00 2024-09-19T05:07:58.239 INFO:teuthology.orchestra.run.smithi120.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 3.2 MB/s | 137 kB 00:00 2024-09-19T05:07:58.279 INFO:teuthology.orchestra.run.smithi178.stdout:(14/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 14 MB/s | 17 MB 00:01 2024-09-19T05:07:58.304 INFO:teuthology.orchestra.run.smithi178.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 2.8 MB/s | 751 kB 00:00 2024-09-19T05:07:58.322 INFO:teuthology.orchestra.run.smithi120.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 16 MB/s | 4.9 MB 00:00 2024-09-19T05:07:58.329 INFO:teuthology.orchestra.run.smithi178.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 3.2 MB/s | 163 kB 00:00 2024-09-19T05:07:58.354 INFO:teuthology.orchestra.run.smithi178.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T05:07:58.379 INFO:teuthology.orchestra.run.smithi178.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 9.9 MB/s | 506 kB 00:00 2024-09-19T05:07:58.381 INFO:teuthology.orchestra.run.smithi120.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-19T05:07:58.414 INFO:teuthology.orchestra.run.smithi120.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-09-19T05:07:58.446 INFO:teuthology.orchestra.run.smithi178.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 676 kB/s | 45 kB 00:00 2024-09-19T05:07:58.447 INFO:teuthology.orchestra.run.smithi194.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 42 kB/s | 22 kB 00:00 2024-09-19T05:07:58.448 INFO:teuthology.orchestra.run.smithi120.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-19T05:07:58.490 INFO:teuthology.orchestra.run.smithi120.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-19T05:07:58.506 INFO:teuthology.orchestra.run.smithi194.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.3 MB/s | 548 kB 00:00 2024-09-19T05:07:58.539 INFO:teuthology.orchestra.run.smithi194.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-19T05:07:58.565 INFO:teuthology.orchestra.run.smithi194.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-09-19T05:07:58.565 INFO:teuthology.orchestra.run.smithi120.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 18 MB/s | 5.8 MB 00:00 2024-09-19T05:07:58.572 INFO:teuthology.orchestra.run.smithi178.stdout:(20/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 25 MB/s | 5.3 MB 00:00 2024-09-19T05:07:58.591 INFO:teuthology.orchestra.run.smithi120.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-19T05:07:58.597 INFO:teuthology.orchestra.run.smithi178.stdout:(21/156): python3-ceph-common-19.1.1-361.g2f599 908 kB/s | 136 kB 00:00 2024-09-19T05:07:58.616 INFO:teuthology.orchestra.run.smithi120.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-19T05:07:58.622 INFO:teuthology.orchestra.run.smithi178.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 3.1 MB/s | 161 kB 00:00 2024-09-19T05:07:58.641 INFO:teuthology.orchestra.run.smithi120.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-19T05:07:58.656 INFO:teuthology.orchestra.run.smithi178.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 5.3 MB/s | 320 kB 00:00 2024-09-19T05:07:58.667 INFO:teuthology.orchestra.run.smithi120.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-19T05:07:58.681 INFO:teuthology.orchestra.run.smithi178.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.0 MB/s | 300 kB 00:00 2024-09-19T05:07:58.690 INFO:teuthology.orchestra.run.smithi194.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-19T05:07:58.692 INFO:teuthology.orchestra.run.smithi120.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-19T05:07:58.706 INFO:teuthology.orchestra.run.smithi178.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T05:07:58.715 INFO:teuthology.orchestra.run.smithi194.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T05:07:58.717 INFO:teuthology.orchestra.run.smithi120.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 689 kB/s | 35 kB 00:00 2024-09-19T05:07:58.732 INFO:teuthology.orchestra.run.smithi178.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T05:07:58.740 INFO:teuthology.orchestra.run.smithi194.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T05:07:58.766 INFO:teuthology.orchestra.run.smithi194.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T05:07:58.790 INFO:teuthology.orchestra.run.smithi178.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-19T05:07:58.791 INFO:teuthology.orchestra.run.smithi194.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-19T05:07:58.801 INFO:teuthology.orchestra.run.smithi120.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-19T05:07:58.826 INFO:teuthology.orchestra.run.smithi120.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-19T05:07:58.841 INFO:teuthology.orchestra.run.smithi194.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-19T05:07:58.851 INFO:teuthology.orchestra.run.smithi120.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-19T05:07:58.857 INFO:teuthology.orchestra.run.smithi178.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 21 MB/s | 3.1 MB 00:00 2024-09-19T05:07:58.868 INFO:teuthology.orchestra.run.smithi120.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-09-19T05:07:58.875 INFO:teuthology.orchestra.run.smithi194.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-19T05:07:58.883 INFO:teuthology.orchestra.run.smithi178.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 346 kB/s | 32 kB 00:00 2024-09-19T05:07:58.885 INFO:teuthology.orchestra.run.smithi120.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 42 kB 00:00 2024-09-19T05:07:58.900 INFO:teuthology.orchestra.run.smithi194.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T05:07:58.908 INFO:teuthology.orchestra.run.smithi178.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.9 MB/s | 146 kB 00:00 2024-09-19T05:07:58.910 INFO:teuthology.orchestra.run.smithi120.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 6.3 MB/s | 269 kB 00:00 2024-09-19T05:07:58.925 INFO:teuthology.orchestra.run.smithi194.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T05:07:58.936 INFO:teuthology.orchestra.run.smithi120.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-19T05:07:58.959 INFO:teuthology.orchestra.run.smithi194.stdout:(116/156): protobuf-compiler-3.14.0-13.el9.x86_ 882 kB/s | 863 kB 00:00 2024-09-19T05:07:58.969 INFO:teuthology.orchestra.run.smithi120.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-09-19T05:07:58.985 INFO:teuthology.orchestra.run.smithi194.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 240 kB/s | 14 kB 00:00 2024-09-19T05:07:58.995 INFO:teuthology.orchestra.run.smithi120.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 872 kB/s | 51 kB 00:00 2024-09-19T05:07:59.020 INFO:teuthology.orchestra.run.smithi120.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T05:07:59.026 INFO:teuthology.orchestra.run.smithi194.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 10 MB/s | 358 kB 00:00 2024-09-19T05:07:59.060 INFO:teuthology.orchestra.run.smithi194.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 9.4 MB/s | 303 kB 00:00 2024-09-19T05:07:59.086 INFO:teuthology.orchestra.run.smithi194.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 8.7 MB/s | 220 kB 00:00 2024-09-19T05:07:59.095 INFO:teuthology.orchestra.run.smithi120.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-19T05:07:59.111 INFO:teuthology.orchestra.run.smithi194.stdout:(121/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.1 MB/s | 172 kB 00:00 2024-09-19T05:07:59.121 INFO:teuthology.orchestra.run.smithi120.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-19T05:07:59.146 INFO:teuthology.orchestra.run.smithi120.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 880 kB/s | 44 kB 00:00 2024-09-19T05:07:59.153 INFO:teuthology.orchestra.run.smithi194.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-09-19T05:07:59.171 INFO:teuthology.orchestra.run.smithi120.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-19T05:07:59.178 INFO:teuthology.orchestra.run.smithi194.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 432 kB/s | 11 kB 00:00 2024-09-19T05:07:59.197 INFO:teuthology.orchestra.run.smithi120.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-09-19T05:07:59.203 INFO:teuthology.orchestra.run.smithi194.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 709 kB/s | 18 kB 00:00 2024-09-19T05:07:59.222 INFO:teuthology.orchestra.run.smithi120.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 941 kB/s | 47 kB 00:00 2024-09-19T05:07:59.228 INFO:teuthology.orchestra.run.smithi194.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 930 kB/s | 23 kB 00:00 2024-09-19T05:07:59.247 INFO:teuthology.orchestra.run.smithi120.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-19T05:07:59.254 INFO:teuthology.orchestra.run.smithi194.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 779 kB/s | 19 kB 00:00 2024-09-19T05:07:59.273 INFO:teuthology.orchestra.run.smithi120.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-19T05:07:59.287 INFO:teuthology.orchestra.run.smithi194.stdout:(127/156): python3-grpcio-1.46.7-10.el9.x86_64. 10 MB/s | 2.0 MB 00:00 2024-09-19T05:07:59.298 INFO:teuthology.orchestra.run.smithi120.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-19T05:07:59.304 INFO:teuthology.orchestra.run.smithi194.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-19T05:07:59.308 INFO:teuthology.orchestra.run.smithi178.stdout:(31/156): ceph-mgr-diskprediction-local-19.1.1- 18 MB/s | 7.4 MB 00:00 2024-09-19T05:07:59.332 INFO:teuthology.orchestra.run.smithi120.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-19T05:07:59.357 INFO:teuthology.orchestra.run.smithi120.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 764 kB/s | 45 kB 00:00 2024-09-19T05:07:59.367 INFO:teuthology.orchestra.run.smithi178.stdout:(32/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 7.4 MB/s | 3.6 MB 00:00 2024-09-19T05:07:59.392 INFO:teuthology.orchestra.run.smithi178.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.9 MB/s | 249 kB 00:00 2024-09-19T05:07:59.418 INFO:teuthology.orchestra.run.smithi178.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 984 kB/s | 49 kB 00:00 2024-09-19T05:07:59.442 INFO:teuthology.orchestra.run.smithi178.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 328 kB/s | 16 kB 00:00 2024-09-19T05:07:59.463 INFO:teuthology.orchestra.run.smithi194.stdout:(129/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.5 MB/s | 16 MB 00:02 2024-09-19T05:07:59.468 INFO:teuthology.orchestra.run.smithi178.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.6 MB/s | 285 kB 00:00 2024-09-19T05:07:59.480 INFO:teuthology.orchestra.run.smithi194.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 264 kB/s | 46 kB 00:00 2024-09-19T05:07:59.505 INFO:teuthology.orchestra.run.smithi194.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 3.3 MB/s | 58 kB 00:00 2024-09-19T05:07:59.510 INFO:teuthology.orchestra.run.smithi178.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 11 MB/s | 765 kB 00:00 2024-09-19T05:07:59.535 INFO:teuthology.orchestra.run.smithi178.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 272 kB/s | 18 kB 00:00 2024-09-19T05:07:59.538 INFO:teuthology.orchestra.run.smithi194.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.5 MB/s | 272 kB 00:00 2024-09-19T05:07:59.564 INFO:teuthology.orchestra.run.smithi194.stdout:(133/156): python3-more-itertools-8.12.0-2.el9. 787 kB/s | 79 kB 00:00 2024-09-19T05:07:59.581 INFO:teuthology.orchestra.run.smithi194.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 393 kB/s | 16 kB 00:00 2024-09-19T05:07:59.599 INFO:teuthology.orchestra.run.smithi120.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-19T05:07:59.615 INFO:teuthology.orchestra.run.smithi194.stdout:(135/156): python3-kubernetes-26.1.0-2.el9.noar 3.1 MB/s | 1.0 MB 00:00 2024-09-19T05:07:59.639 INFO:teuthology.orchestra.run.smithi194.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 484 kB/s | 28 kB 00:00 2024-09-19T05:07:59.665 INFO:teuthology.orchestra.run.smithi194.stdout:(137/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 895 kB/s | 90 kB 00:00 2024-09-19T05:07:59.666 INFO:teuthology.orchestra.run.smithi120.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-19T05:07:59.690 INFO:teuthology.orchestra.run.smithi194.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-19T05:07:59.708 INFO:teuthology.orchestra.run.smithi120.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 7.2 MB/s | 308 kB 00:00 2024-09-19T05:07:59.715 INFO:teuthology.orchestra.run.smithi194.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-19T05:07:59.733 INFO:teuthology.orchestra.run.smithi120.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-19T05:07:59.740 INFO:teuthology.orchestra.run.smithi194.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-19T05:07:59.766 INFO:teuthology.orchestra.run.smithi194.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-19T05:07:59.791 INFO:teuthology.orchestra.run.smithi194.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 989 kB/s | 74 kB 00:00 2024-09-19T05:07:59.800 INFO:teuthology.orchestra.run.smithi120.stdout:(107/156): lua-devel-5.4.4-4.el9.x86_64.rpm 48 kB/s | 22 kB 00:00 2024-09-19T05:07:59.816 INFO:teuthology.orchestra.run.smithi194.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-19T05:07:59.842 INFO:teuthology.orchestra.run.smithi194.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-19T05:07:59.867 INFO:teuthology.orchestra.run.smithi194.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-19T05:07:59.892 INFO:teuthology.orchestra.run.smithi194.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T05:07:59.893 INFO:teuthology.orchestra.run.smithi120.stdout:(108/156): libarrow-9.0.0-11.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-09-19T05:07:59.917 INFO:teuthology.orchestra.run.smithi120.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 222 kB/s | 26 kB 00:00 2024-09-19T05:07:59.918 INFO:teuthology.orchestra.run.smithi194.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-19T05:07:59.943 INFO:teuthology.orchestra.run.smithi120.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 970 kB/s | 49 kB 00:00 2024-09-19T05:07:59.968 INFO:teuthology.orchestra.run.smithi194.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T05:07:59.968 INFO:teuthology.orchestra.run.smithi120.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-19T05:07:59.993 INFO:teuthology.orchestra.run.smithi120.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-19T05:08:00.002 INFO:teuthology.orchestra.run.smithi178.stdout:(39/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 19 MB/s | 49 MB 00:02 2024-09-19T05:08:00.027 INFO:teuthology.orchestra.run.smithi120.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-19T05:08:00.027 INFO:teuthology.orchestra.run.smithi178.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 154 kB/s | 80 kB 00:00 2024-09-19T05:08:00.053 INFO:teuthology.orchestra.run.smithi120.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T05:08:00.077 INFO:teuthology.orchestra.run.smithi120.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T05:08:00.094 INFO:teuthology.orchestra.run.smithi178.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 801 kB 00:00 2024-09-19T05:08:00.111 INFO:teuthology.orchestra.run.smithi120.stdout:(116/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.7 MB/s | 839 kB 00:00 2024-09-19T05:08:00.120 INFO:teuthology.orchestra.run.smithi178.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-19T05:08:00.128 INFO:teuthology.orchestra.run.smithi120.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-19T05:08:00.135 INFO:teuthology.orchestra.run.smithi194.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 14 MB/s | 2.3 MB 00:00 2024-09-19T05:08:00.145 INFO:teuthology.orchestra.run.smithi178.stdout:(43/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-19T05:08:00.153 INFO:teuthology.orchestra.run.smithi120.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-19T05:08:00.170 INFO:teuthology.orchestra.run.smithi178.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-19T05:08:00.178 INFO:teuthology.orchestra.run.smithi120.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-19T05:08:00.193 INFO:teuthology.orchestra.run.smithi194.stdout:(150/156): librados2-19.1.1-361.g2f599a46.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-19T05:08:00.225 INFO:teuthology.orchestra.run.smithi120.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-19T05:08:00.225 INFO:teuthology.orchestra.run.smithi178.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-19T05:08:00.225 INFO:teuthology.orchestra.run.smithi178.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-19T05:08:00.229 INFO:teuthology.orchestra.run.smithi120.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T05:08:00.243 INFO:teuthology.orchestra.run.smithi194.stdout:(151/156): NetworkManager-libnm-1.51.0-1.el9.x8 17 MB/s | 1.8 MB 00:00 2024-09-19T05:08:00.246 INFO:teuthology.orchestra.run.smithi178.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T05:08:00.254 INFO:teuthology.orchestra.run.smithi120.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-19T05:08:00.269 INFO:teuthology.orchestra.run.smithi194.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 545 kB/s | 41 kB 00:00 2024-09-19T05:08:00.279 INFO:teuthology.orchestra.run.smithi178.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 6.6 MB/s | 1.2 MB 00:00 2024-09-19T05:08:00.280 INFO:teuthology.orchestra.run.smithi120.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-19T05:08:00.294 INFO:teuthology.orchestra.run.smithi194.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 4.9 MB/s | 249 kB 00:00 2024-09-19T05:08:00.305 INFO:teuthology.orchestra.run.smithi120.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 701 kB/s | 18 kB 00:00 2024-09-19T05:08:00.331 INFO:teuthology.orchestra.run.smithi120.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 923 kB/s | 23 kB 00:00 2024-09-19T05:08:00.344 INFO:teuthology.orchestra.run.smithi194.stdout:(154/156): librbd1-19.1.1-361.g2f599a46.el9.x86 7.4 MB/s | 3.2 MB 00:00 2024-09-19T05:08:00.356 INFO:teuthology.orchestra.run.smithi120.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 782 kB/s | 19 kB 00:00 2024-09-19T05:08:00.381 INFO:teuthology.orchestra.run.smithi120.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 790 kB/s | 20 kB 00:00 2024-09-19T05:08:00.394 INFO:teuthology.orchestra.run.smithi194.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 24 MB/s | 2.4 MB 00:00 2024-09-19T05:08:00.405 INFO:teuthology.orchestra.run.smithi178.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 856 kB/s | 107 kB 00:00 2024-09-19T05:08:00.430 INFO:teuthology.orchestra.run.smithi178.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-09-19T05:08:00.447 INFO:teuthology.orchestra.run.smithi178.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 519 kB/s | 22 kB 00:00 2024-09-19T05:08:00.465 INFO:teuthology.orchestra.run.smithi120.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 7.8 MB/s | 2.0 MB 00:00 2024-09-19T05:08:00.469 INFO:teuthology.orchestra.run.smithi194.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 6.8 MB/s | 1.4 MB 00:00 2024-09-19T05:08:00.472 INFO:teuthology.orchestra.run.smithi178.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 7.3 MB/s | 313 kB 00:00 2024-09-19T05:08:00.476 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:08:00.476 INFO:teuthology.orchestra.run.smithi194.stdout:Total 20 MB/s | 226 MB 00:11 2024-09-19T05:08:00.498 INFO:teuthology.orchestra.run.smithi120.stdout:(129/156): protobuf-compiler-3.14.0-13.el9.x86_ 756 kB/s | 863 kB 00:01 2024-09-19T05:08:00.505 INFO:teuthology.orchestra.run.smithi178.stdout:(53/156): bison-3.7.4-5.el9.x86_64.rpm 3.5 MB/s | 943 kB 00:00 2024-09-19T05:08:00.531 INFO:teuthology.orchestra.run.smithi178.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 389 kB/s | 33 kB 00:00 2024-09-19T05:08:00.532 INFO:teuthology.orchestra.run.smithi120.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 692 kB/s | 46 kB 00:00 2024-09-19T05:08:00.557 INFO:teuthology.orchestra.run.smithi120.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.5 MB/s | 58 kB 00:00 2024-09-19T05:08:00.573 INFO:teuthology.orchestra.run.smithi178.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 271 kB/s | 11 kB 00:00 2024-09-19T05:08:00.583 INFO:teuthology.orchestra.run.smithi120.stdout:(132/156): python3-more-itertools-8.12.0-2.el9. 940 kB/s | 79 kB 00:00 2024-09-19T05:08:00.598 INFO:teuthology.orchestra.run.smithi178.stdout:(56/156): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-09-19T05:08:00.608 INFO:teuthology.orchestra.run.smithi120.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-09-19T05:08:00.633 INFO:teuthology.orchestra.run.smithi120.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-19T05:08:00.640 INFO:teuthology.orchestra.run.smithi178.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-19T05:08:00.658 INFO:teuthology.orchestra.run.smithi120.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-19T05:08:00.665 INFO:teuthology.orchestra.run.smithi178.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-19T05:08:00.684 INFO:teuthology.orchestra.run.smithi120.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-09-19T05:08:00.709 INFO:teuthology.orchestra.run.smithi120.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-19T05:08:00.743 INFO:teuthology.orchestra.run.smithi120.stdout:(138/156): python3-kubernetes-26.1.0-2.el9.noar 2.8 MB/s | 1.0 MB 00:00 2024-09-19T05:08:00.757 INFO:teuthology.orchestra.run.smithi178.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-09-19T05:08:00.768 INFO:teuthology.orchestra.run.smithi120.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-19T05:08:00.794 INFO:teuthology.orchestra.run.smithi120.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-19T05:08:00.799 INFO:teuthology.orchestra.run.smithi178.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 591 kB/s | 24 kB 00:00 2024-09-19T05:08:00.819 INFO:teuthology.orchestra.run.smithi120.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-19T05:08:00.844 INFO:teuthology.orchestra.run.smithi120.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 987 kB/s | 74 kB 00:00 2024-09-19T05:08:00.849 INFO:teuthology.orchestra.run.smithi178.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 952 kB/s | 47 kB 00:00 2024-09-19T05:08:00.869 INFO:teuthology.orchestra.run.smithi120.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T05:08:00.892 INFO:teuthology.orchestra.run.smithi178.stdout:(62/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.6 MB/s | 662 kB 00:00 2024-09-19T05:08:00.895 INFO:teuthology.orchestra.run.smithi120.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-19T05:08:00.920 INFO:teuthology.orchestra.run.smithi120.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-19T05:08:00.925 INFO:teuthology.orchestra.run.smithi178.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-19T05:08:00.945 INFO:teuthology.orchestra.run.smithi120.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T05:08:00.967 INFO:teuthology.orchestra.run.smithi178.stdout:(64/156): openblas-0.3.26-2.el9.x86_64.rpm 926 kB/s | 38 kB 00:00 2024-09-19T05:08:00.970 INFO:teuthology.orchestra.run.smithi120.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-19T05:08:00.992 INFO:teuthology.orchestra.run.smithi178.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-19T05:08:01.021 INFO:teuthology.orchestra.run.smithi120.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T05:08:01.159 INFO:teuthology.orchestra.run.smithi178.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.4 MB/s | 3.0 MB 00:00 2024-09-19T05:08:01.188 INFO:teuthology.orchestra.run.smithi120.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 14 MB/s | 3.4 MB 00:00 2024-09-19T05:08:01.388 INFO:teuthology.orchestra.run.smithi120.stdout:(150/156): librbd1-19.1.1-361.g2f599a46.el9.x86 7.6 MB/s | 3.2 MB 00:00 2024-09-19T05:08:01.472 INFO:teuthology.orchestra.run.smithi120.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 492 kB/s | 41 kB 00:00 2024-09-19T05:08:01.581 INFO:teuthology.orchestra.run.smithi120.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 2.2 MB/s | 249 kB 00:00 2024-09-19T05:08:01.593 INFO:teuthology.orchestra.run.smithi178.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-09-19T05:08:01.689 INFO:teuthology.orchestra.run.smithi120.stdout:(153/156): NetworkManager-1.51.0-1.el9.x86_64.r 3.5 MB/s | 2.3 MB 00:00 2024-09-19T05:08:01.714 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-19T05:08:01.731 INFO:teuthology.orchestra.run.smithi120.stdout:(154/156): NetworkManager-libnm-1.51.0-1.el9.x8 3.3 MB/s | 1.8 MB 00:00 2024-09-19T05:08:01.840 INFO:teuthology.orchestra.run.smithi120.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 5.2 MB/s | 1.4 MB 00:00 2024-09-19T05:08:01.860 INFO:teuthology.orchestra.run.smithi178.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 3.3 MB/s | 910 kB 00:00 2024-09-19T05:08:01.865 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-19T05:08:01.865 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-19T05:08:01.926 INFO:teuthology.orchestra.run.smithi178.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-19T05:08:02.194 INFO:teuthology.orchestra.run.smithi178.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.0 MB/s | 4.9 MB 00:01 2024-09-19T05:08:02.352 INFO:teuthology.orchestra.run.smithi178.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.3 MB/s | 4.4 MB 00:01 2024-09-19T05:08:02.381 INFO:teuthology.orchestra.run.smithi120.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 2.4 MB 00:00 2024-09-19T05:08:02.388 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:08:02.389 INFO:teuthology.orchestra.run.smithi120.stdout:Total 22 MB/s | 226 MB 00:10 2024-09-19T05:08:02.402 INFO:teuthology.orchestra.run.smithi178.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-19T05:08:02.545 INFO:teuthology.orchestra.run.smithi178.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 2.9 MB/s | 1.0 MB 00:00 2024-09-19T05:08:02.586 INFO:teuthology.orchestra.run.smithi178.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-19T05:08:02.670 INFO:teuthology.orchestra.run.smithi178.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-19T05:08:02.753 INFO:teuthology.orchestra.run.smithi178.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-19T05:08:02.795 INFO:teuthology.orchestra.run.smithi178.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 614 kB/s | 26 kB 00:00 2024-09-19T05:08:02.837 INFO:teuthology.orchestra.run.smithi178.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 461 kB/s | 19 kB 00:00 2024-09-19T05:08:02.912 INFO:teuthology.orchestra.run.smithi178.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-19T05:08:02.954 INFO:teuthology.orchestra.run.smithi178.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 838 kB/s | 35 kB 00:00 2024-09-19T05:08:03.621 INFO:teuthology.orchestra.run.smithi178.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 3.4 MB/s | 5.8 MB 00:01 2024-09-19T05:08:03.632 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2024-09-19T05:08:03.722 INFO:teuthology.orchestra.run.smithi178.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.5 MB/s | 250 kB 00:00 2024-09-19T05:08:03.785 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2024-09-19T05:08:03.785 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2024-09-19T05:08:03.805 INFO:teuthology.orchestra.run.smithi178.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-19T05:08:03.864 INFO:teuthology.orchestra.run.smithi178.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-19T05:08:03.897 INFO:teuthology.orchestra.run.smithi178.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 42 kB 00:00 2024-09-19T05:08:03.998 INFO:teuthology.orchestra.run.smithi178.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-09-19T05:08:04.073 INFO:teuthology.orchestra.run.smithi178.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-19T05:08:04.106 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-19T05:08:04.107 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-19T05:08:04.173 INFO:teuthology.orchestra.run.smithi178.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-09-19T05:08:04.249 INFO:teuthology.orchestra.run.smithi178.stdout:(89/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.2 MB/s | 6.0 MB 00:01 2024-09-19T05:08:04.274 INFO:teuthology.orchestra.run.smithi178.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 509 kB/s | 51 kB 00:00 2024-09-19T05:08:04.299 INFO:teuthology.orchestra.run.smithi178.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T05:08:04.341 INFO:teuthology.orchestra.run.smithi178.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-19T05:08:04.383 INFO:teuthology.orchestra.run.smithi178.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-19T05:08:04.500 INFO:teuthology.orchestra.run.smithi178.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-19T05:08:04.542 INFO:teuthology.orchestra.run.smithi178.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 860 kB/s | 36 kB 00:00 2024-09-19T05:08:04.584 INFO:teuthology.orchestra.run.smithi178.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-19T05:08:04.651 INFO:teuthology.orchestra.run.smithi178.stdout:(97/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.0 MB/s | 5.1 MB 00:01 2024-09-19T05:08:04.693 INFO:teuthology.orchestra.run.smithi178.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-19T05:08:04.751 INFO:teuthology.orchestra.run.smithi178.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 1.8 MB/s | 304 kB 00:00 2024-09-19T05:08:04.776 INFO:teuthology.orchestra.run.smithi178.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-19T05:08:04.818 INFO:teuthology.orchestra.run.smithi178.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 955 kB/s | 64 kB 00:00 2024-09-19T05:08:04.844 INFO:teuthology.orchestra.run.smithi178.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 670 kB/s | 45 kB 00:00 2024-09-19T05:08:04.919 INFO:teuthology.orchestra.run.smithi178.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-09-19T05:08:04.986 INFO:teuthology.orchestra.run.smithi178.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.0 MB/s | 548 kB 00:00 2024-09-19T05:08:05.019 INFO:teuthology.orchestra.run.smithi178.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-19T05:08:05.045 INFO:teuthology.orchestra.run.smithi178.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-19T05:08:05.070 INFO:teuthology.orchestra.run.smithi178.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.7 MB/s | 863 kB 00:00 2024-09-19T05:08:05.120 INFO:teuthology.orchestra.run.smithi178.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 520 kB/s | 26 kB 00:00 2024-09-19T05:08:05.154 INFO:teuthology.orchestra.run.smithi178.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-19T05:08:05.187 INFO:teuthology.orchestra.run.smithi178.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-19T05:08:05.255 INFO:teuthology.orchestra.run.smithi178.stdout:(111/156): libarrow-9.0.0-11.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-09-19T05:08:05.280 INFO:teuthology.orchestra.run.smithi178.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-09-19T05:08:05.313 INFO:teuthology.orchestra.run.smithi178.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-19T05:08:05.340 INFO:teuthology.orchestra.run.smithi178.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T05:08:05.373 INFO:teuthology.orchestra.run.smithi178.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-09-19T05:08:05.398 INFO:teuthology.orchestra.run.smithi178.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 548 kB/s | 32 kB 00:00 2024-09-19T05:08:05.423 INFO:teuthology.orchestra.run.smithi178.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-19T05:08:05.448 INFO:teuthology.orchestra.run.smithi178.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-19T05:08:05.482 INFO:teuthology.orchestra.run.smithi178.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-19T05:08:05.507 INFO:teuthology.orchestra.run.smithi178.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-19T05:08:05.532 INFO:teuthology.orchestra.run.smithi178.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T05:08:05.558 INFO:teuthology.orchestra.run.smithi178.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-19T05:08:05.575 INFO:teuthology.orchestra.run.smithi178.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 643 kB/s | 11 kB 00:00 2024-09-19T05:08:05.592 INFO:teuthology.orchestra.run.smithi178.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 1.1 MB/s | 18 kB 00:00 2024-09-19T05:08:05.609 INFO:teuthology.orchestra.run.smithi178.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-19T05:08:05.625 INFO:teuthology.orchestra.run.smithi178.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 1.2 MB/s | 19 kB 00:00 2024-09-19T05:08:05.642 INFO:teuthology.orchestra.run.smithi178.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-19T05:08:05.701 INFO:teuthology.orchestra.run.smithi178.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-09-19T05:08:05.726 INFO:teuthology.orchestra.run.smithi178.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T05:08:05.752 INFO:teuthology.orchestra.run.smithi178.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T05:08:05.777 INFO:teuthology.orchestra.run.smithi178.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T05:08:05.819 INFO:teuthology.orchestra.run.smithi178.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-09-19T05:08:05.844 INFO:teuthology.orchestra.run.smithi178.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-09-19T05:08:05.878 INFO:teuthology.orchestra.run.smithi178.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-19T05:08:05.903 INFO:teuthology.orchestra.run.smithi178.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-19T05:08:05.928 INFO:teuthology.orchestra.run.smithi178.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-09-19T05:08:05.954 INFO:teuthology.orchestra.run.smithi178.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-19T05:08:05.979 INFO:teuthology.orchestra.run.smithi178.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T05:08:05.991 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2024-09-19T05:08:05.991 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2024-09-19T05:08:05.996 INFO:teuthology.orchestra.run.smithi178.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.7 MB/s | 188 kB 00:00 2024-09-19T05:08:06.021 INFO:teuthology.orchestra.run.smithi178.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 855 kB/s | 36 kB 00:00 2024-09-19T05:08:06.046 INFO:teuthology.orchestra.run.smithi178.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-19T05:08:06.071 INFO:teuthology.orchestra.run.smithi178.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T05:08:06.105 INFO:teuthology.orchestra.run.smithi178.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-19T05:08:06.130 INFO:teuthology.orchestra.run.smithi178.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 803 kB/s | 20 kB 00:00 2024-09-19T05:08:06.164 INFO:teuthology.orchestra.run.smithi178.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-09-19T05:08:06.190 INFO:teuthology.orchestra.run.smithi178.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T05:08:06.240 INFO:teuthology.orchestra.run.smithi178.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-19T05:08:06.440 INFO:teuthology.orchestra.run.smithi178.stdout:(148/156): librados2-19.1.1-361.g2f599a46.el9.x 14 MB/s | 3.4 MB 00:00 2024-09-19T05:08:06.532 INFO:teuthology.orchestra.run.smithi178.stdout:(149/156): librbd1-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-19T05:08:06.632 INFO:teuthology.orchestra.run.smithi178.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-09-19T05:08:06.674 INFO:teuthology.orchestra.run.smithi178.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 983 kB/s | 41 kB 00:00 2024-09-19T05:08:06.716 INFO:teuthology.orchestra.run.smithi178.stdout:(152/156): NetworkManager-libnm-1.51.0-1.el9.x8 9.8 MB/s | 1.8 MB 00:00 2024-09-19T05:08:06.741 INFO:teuthology.orchestra.run.smithi178.stdout:(153/156): NetworkManager-tui-1.51.0-1.el9.x86_ 3.6 MB/s | 249 kB 00:00 2024-09-19T05:08:06.792 INFO:teuthology.orchestra.run.smithi178.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 18 MB/s | 1.4 MB 00:00 2024-09-19T05:08:06.850 INFO:teuthology.orchestra.run.smithi178.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-09-19T05:08:09.533 INFO:teuthology.orchestra.run.smithi178.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.1 MB/s | 16 MB 00:05 2024-09-19T05:08:09.538 INFO:teuthology.orchestra.run.smithi178.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:08:09.538 INFO:teuthology.orchestra.run.smithi178.stdout:Total 16 MB/s | 226 MB 00:14 2024-09-19T05:08:10.521 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-19T05:08:10.640 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T05:08:10.678 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T05:08:10.738 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T05:08:10.759 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction check 2024-09-19T05:08:10.773 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T05:08:10.799 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T05:08:10.863 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T05:08:10.908 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction check succeeded. 2024-09-19T05:08:10.908 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction test 2024-09-19T05:08:11.196 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T05:08:11.299 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:08:11.404 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:08:11.425 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:08:11.516 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:08:11.546 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:08:11.711 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T05:08:11.768 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T05:08:11.804 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:08:11.891 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:08:11.913 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:08:11.959 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:08:11.989 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:08:12.015 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:08:12.183 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:08:12.350 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:08:12.471 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2024-09-19T05:08:12.487 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T05:08:12.597 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:08:12.636 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T05:08:12.674 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T05:08:12.680 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:08:12.736 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T05:08:12.769 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T05:08:12.795 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T05:08:12.849 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T05:08:12.907 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:08:13.014 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T05:08:13.124 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T05:08:13.136 INFO:teuthology.orchestra.run.smithi178.stdout:Transaction test succeeded. 2024-09-19T05:08:13.137 INFO:teuthology.orchestra.run.smithi178.stdout:Running transaction 2024-09-19T05:08:13.174 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T05:08:13.177 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T05:08:13.211 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T05:08:13.277 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T05:08:13.280 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:08:13.320 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T05:08:13.353 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T05:08:13.402 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:08:13.405 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T05:08:13.437 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:08:13.437 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T05:08:13.464 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T05:08:13.528 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:08:13.534 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T05:08:13.558 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:08:13.587 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T05:08:13.618 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T05:08:13.667 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T05:08:13.719 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T05:08:13.745 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T05:08:13.780 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T05:08:13.781 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T05:08:13.808 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:08:13.823 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T05:08:13.852 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T05:08:13.912 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:08:13.921 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T05:08:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:08:13.966 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T05:08:14.005 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:08:14.027 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:08:14.040 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T05:08:14.048 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:08:14.173 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T05:08:14.196 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:08:14.227 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T05:08:14.373 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:08:14.526 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T05:08:14.625 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:08:14.728 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:08:14.745 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T05:08:14.830 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T05:08:14.859 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T05:08:14.902 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T05:08:14.940 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T05:08:14.952 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:08:14.983 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T05:08:15.060 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T05:08:15.145 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T05:08:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T05:08:15.208 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T05:08:15.219 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T05:08:15.251 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T05:08:15.281 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T05:08:15.314 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T05:08:15.355 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T05:08:15.360 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T05:08:15.386 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T05:08:15.392 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T05:08:15.421 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T05:08:15.436 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T05:08:15.469 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T05:08:15.485 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T05:08:15.504 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T05:08:15.513 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T05:08:15.547 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T05:08:15.583 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T05:08:15.590 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T05:08:15.643 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T05:08:15.675 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T05:08:15.718 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T05:08:15.725 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T05:08:15.775 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T05:08:15.810 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T05:08:15.815 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T05:08:15.829 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T05:08:15.872 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T05:08:15.901 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T05:08:15.919 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T05:08:15.958 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T05:08:15.969 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T05:08:15.999 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T05:08:16.015 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T05:08:16.031 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T05:08:16.056 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T05:08:16.089 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T05:08:16.153 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T05:08:16.230 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T05:08:16.283 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T05:08:16.285 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T05:08:16.321 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T05:08:16.360 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T05:08:16.392 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T05:08:16.431 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T05:08:16.463 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T05:08:16.492 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T05:08:16.527 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T05:08:16.561 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T05:08:16.802 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T05:08:16.808 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T05:08:16.896 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T05:08:16.943 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T05:08:16.986 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T05:08:17.024 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T05:08:17.074 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T05:08:17.077 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T05:08:17.190 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T05:08:17.237 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T05:08:17.242 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T05:08:17.268 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T05:08:17.286 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T05:08:17.340 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T05:08:17.373 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T05:08:17.413 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T05:08:17.427 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T05:08:17.445 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T05:08:17.481 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T05:08:17.528 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T05:08:17.564 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T05:08:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T05:08:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T05:08:17.786 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T05:08:17.834 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T05:08:17.876 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T05:08:17.979 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T05:08:18.019 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T05:08:18.067 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T05:08:18.100 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T05:08:18.133 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T05:08:18.145 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T05:08:18.198 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T05:08:18.232 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T05:08:18.265 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T05:08:18.324 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T05:08:18.379 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T05:08:18.424 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T05:08:18.511 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T05:08:18.551 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T05:08:18.570 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T05:08:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T05:08:18.678 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T05:08:18.722 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T05:08:18.745 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T05:08:18.759 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T05:08:18.782 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T05:08:18.793 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T05:08:18.821 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T05:08:18.856 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T05:08:18.866 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T05:08:18.889 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T05:08:18.931 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T05:08:18.965 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T05:08:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T05:08:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T05:08:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T05:08:19.239 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T05:08:19.299 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T05:08:19.430 INFO:teuthology.orchestra.run.smithi178.stdout: Preparing : 1/1 2024-09-19T05:08:19.525 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T05:08:19.570 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T05:08:19.608 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T05:08:19.637 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T05:08:19.662 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T05:08:19.695 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T05:08:19.721 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T05:08:19.769 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T05:08:20.018 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T05:08:20.071 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T05:08:20.105 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T05:08:20.121 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T05:08:20.206 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T05:08:20.247 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:08:20.268 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T05:08:20.313 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T05:08:20.401 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T05:08:20.433 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T05:08:20.546 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:08:20.573 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:08:20.617 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T05:08:20.639 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T05:08:20.665 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:08:20.698 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:08:20.709 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T05:08:20.875 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T05:08:20.904 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T05:08:20.925 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T05:08:20.952 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:08:20.983 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T05:08:21.011 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T05:08:21.044 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T05:08:21.048 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:08:21.070 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:08:21.133 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T05:08:21.163 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:08:21.190 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T05:08:21.345 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T05:08:21.349 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:08:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T05:08:21.399 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:08:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T05:08:21.490 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:08:21.520 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T05:08:21.536 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T05:08:21.557 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T05:08:21.652 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T05:08:21.760 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:08:21.829 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:08:22.036 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T05:08:22.048 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T05:08:22.060 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:08:22.140 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:08:22.157 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T05:08:22.170 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T05:08:22.244 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T05:08:22.276 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T05:08:22.319 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T05:08:22.390 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T05:08:22.435 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T05:08:22.468 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T05:08:22.512 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T05:08:22.544 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T05:08:22.572 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T05:08:22.639 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T05:08:22.693 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T05:08:22.725 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T05:08:22.769 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T05:08:22.771 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T05:08:22.857 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T05:08:22.896 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T05:08:22.939 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T05:08:22.952 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T05:08:22.968 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T05:08:23.037 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T05:08:23.082 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T05:08:23.117 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T05:08:23.157 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T05:08:23.254 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T05:08:23.296 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T05:08:23.351 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T05:08:23.598 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T05:08:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:08:23.742 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:08:23.774 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T05:08:23.810 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T05:08:23.868 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T05:08:23.955 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T05:08:23.993 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T05:08:24.028 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T05:08:24.066 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T05:08:24.108 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T05:08:24.279 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T05:08:24.327 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T05:08:24.381 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T05:08:24.389 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T05:08:24.422 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:08:24.454 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T05:08:24.479 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:08:24.486 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T05:08:24.493 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:08:24.507 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:08:24.524 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T05:08:24.540 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T05:08:24.569 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T05:08:24.605 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T05:08:24.648 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T05:08:24.698 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T05:08:24.832 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T05:08:24.875 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T05:08:24.908 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T05:08:25.010 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T05:08:25.042 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T05:08:25.060 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:08:25.083 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T05:08:25.102 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:08:25.116 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T05:08:25.140 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T05:08:25.194 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:08:25.194 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T05:08:25.194 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T05:08:25.194 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:08:25.229 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T05:08:25.231 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:08:25.357 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T05:08:25.389 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T05:08:25.417 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T05:08:25.458 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T05:08:25.498 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T05:08:25.631 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T05:08:25.786 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T05:08:25.816 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T05:08:25.849 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T05:08:25.891 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T05:08:25.925 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T05:08:26.012 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T05:08:26.055 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T05:08:26.086 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T05:08:26.188 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T05:08:26.236 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T05:08:26.768 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:08:26.804 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:08:26.942 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T05:08:26.984 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T05:08:27.018 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T05:08:27.123 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T05:08:27.173 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T05:08:27.225 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T05:08:27.314 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T05:08:27.354 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T05:08:27.356 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:08:27.408 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:08:27.503 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:08:27.504 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T05:08:27.504 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T05:08:27.504 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:08:27.538 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T05:08:27.563 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:08:27.576 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T05:08:27.655 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T05:08:28.296 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T05:08:28.408 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T05:08:29.663 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T05:08:29.739 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T05:08:29.766 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T05:08:29.799 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T05:08:30.108 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T05:08:30.171 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:08:30.261 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T05:08:30.292 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T05:08:30.329 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T05:08:30.807 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T05:08:30.832 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:08:30.905 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T05:08:30.936 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T05:08:33.268 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:08:33.309 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:08:33.856 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T05:08:33.893 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:08:33.987 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T05:08:33.987 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T05:08:33.987 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T05:08:33.987 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-19T05:08:34.019 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:08:37.129 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:08:37.130 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /sys 2024-09-19T05:08:37.130 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /proc 2024-09-19T05:08:37.130 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /mnt 2024-09-19T05:08:37.130 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /var/tmp 2024-09-19T05:08:37.130 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /home 2024-09-19T05:08:37.130 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /root 2024-09-19T05:08:37.130 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /tmp 2024-09-19T05:08:37.130 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:08:37.315 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:08:37.332 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:08:37.332 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:37.332 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T05:08:37.332 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:08:38.810 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:08:38.836 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:08:38.836 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:38.837 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T05:08:38.837 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:08:38.837 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:08:38.837 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:08:39.068 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:08:39.092 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:08:39.092 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:39.092 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T05:08:39.092 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:08:39.092 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:08:39.093 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:08:39.527 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:08:39.551 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:08:39.551 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:39.551 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T05:08:39.552 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:08:39.552 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:08:39.552 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:08:39.591 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:08:39.591 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /sys 2024-09-19T05:08:39.591 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /proc 2024-09-19T05:08:39.591 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /mnt 2024-09-19T05:08:39.592 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /var/tmp 2024-09-19T05:08:39.592 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /home 2024-09-19T05:08:39.592 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /root 2024-09-19T05:08:39.592 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /tmp 2024-09-19T05:08:39.592 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:08:39.657 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T05:08:39.714 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T05:08:39.769 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T05:08:39.774 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:08:39.791 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:08:39.791 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:39.791 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T05:08:39.791 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:08:39.955 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T05:08:40.003 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T05:08:40.080 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T05:08:40.168 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T05:08:40.307 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T05:08:40.357 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T05:08:40.401 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T05:08:40.437 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T05:08:40.883 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:08:40.911 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:08:40.942 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T05:08:41.005 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T05:08:41.034 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:08:41.279 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:08:41.306 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:08:41.306 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:41.307 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T05:08:41.307 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:08:41.307 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:08:41.307 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:08:41.531 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:08:41.555 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:08:41.555 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:41.555 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T05:08:41.555 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:08:41.555 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:08:41.555 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:08:41.989 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:08:42.013 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:08:42.013 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:42.013 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T05:08:42.013 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:08:42.014 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:08:42.014 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:08:42.080 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:08:42.111 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T05:08:42.118 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:08:42.160 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T05:08:42.215 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T05:08:42.401 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T05:08:42.457 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T05:08:42.534 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T05:08:42.623 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T05:08:42.778 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T05:08:42.842 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T05:08:42.873 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T05:08:42.901 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T05:08:43.085 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:08:43.119 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:08:43.223 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:08:43.355 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:08:43.383 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:08:43.389 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T05:08:43.414 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T05:08:43.421 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:08:43.446 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:08:43.446 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:43.446 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T05:08:43.447 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:08:43.447 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:08:43.447 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:08:43.476 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T05:08:43.497 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:08:43.509 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:08:43.514 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:08:43.607 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T05:08:43.669 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T05:08:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:08:44.591 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:08:44.593 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T05:08:44.632 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:08:44.657 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:08:44.657 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:44.657 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T05:08:44.657 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:08:44.657 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:08:44.657 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:08:44.700 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:08:44.723 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:08:44.723 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:44.723 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T05:08:44.723 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:08:44.775 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:08:44.799 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:08:44.799 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:44.799 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T05:08:44.799 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:08:44.799 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:08:44.800 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:08:45.109 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:08:45.133 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:08:45.134 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:45.134 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T05:08:45.134 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:08:45.134 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:08:45.134 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:08:45.554 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:08:45.583 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:08:45.658 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T05:08:45.658 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /sys 2024-09-19T05:08:45.658 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /proc 2024-09-19T05:08:45.658 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /mnt 2024-09-19T05:08:45.658 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /var/tmp 2024-09-19T05:08:45.659 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /home 2024-09-19T05:08:45.659 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /root 2024-09-19T05:08:45.659 INFO:teuthology.orchestra.run.smithi178.stdout:skipping the directory /tmp 2024-09-19T05:08:45.659 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-19T05:08:45.687 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:08:45.838 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:08:45.846 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T05:08:45.855 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T05:08:45.855 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:45.855 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T05:08:45.855 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-19T05:08:45.878 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:08:45.901 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:08:45.902 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:45.902 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T05:08:45.902 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:08:45.902 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:08:45.902 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:08:45.954 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:08:45.965 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:08:46.063 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T05:08:46.113 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T05:08:47.031 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T05:08:47.065 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:08:47.089 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:08:47.089 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:47.089 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T05:08:47.089 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:08:47.089 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:08:47.089 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:08:47.140 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:08:47.163 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:08:47.163 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:47.163 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T05:08:47.164 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:08:47.208 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:08:47.231 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:08:47.231 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:47.231 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T05:08:47.231 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:08:47.231 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:08:47.231 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:08:47.325 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:08:47.351 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T05:08:47.352 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:47.352 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T05:08:47.352 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:08:47.352 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T05:08:47.352 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-19T05:08:47.550 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:08:47.574 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:08:47.574 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:47.574 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T05:08:47.574 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:08:47.574 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:08:47.574 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:08:47.575 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:08:47.599 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T05:08:47.599 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:47.599 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T05:08:47.599 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:08:47.599 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T05:08:47.599 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-19T05:08:48.034 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:08:48.058 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T05:08:48.058 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:48.058 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T05:08:48.058 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:08:48.058 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T05:08:48.059 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-19T05:08:48.156 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T05:08:48.204 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T05:08:48.260 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T05:08:48.453 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T05:08:48.510 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T05:08:48.588 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T05:08:48.684 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T05:08:48.825 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T05:08:48.881 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T05:08:48.917 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T05:08:48.944 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T05:08:49.322 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:08:49.351 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T05:08:49.382 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T05:08:49.445 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T05:08:49.474 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:08:49.688 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T05:08:49.729 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T05:08:49.770 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T05:08:49.802 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T05:08:49.829 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T05:08:50.033 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T05:08:50.084 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T05:08:50.114 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T05:08:50.144 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T05:08:50.181 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T05:08:50.519 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T05:08:50.559 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:08:50.789 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:08:50.829 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:08:50.850 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:08:51.521 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T05:08:51.551 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:08:51.654 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T05:08:51.679 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T05:08:51.767 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T05:08:51.816 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T05:08:51.819 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T05:08:51.845 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:08:51.869 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T05:08:51.869 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:51.869 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T05:08:51.870 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:08:51.870 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T05:08:51.870 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-19T05:08:51.908 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T05:08:51.921 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:08:51.933 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T05:08:51.944 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T05:08:51.970 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T05:08:51.996 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T05:08:51.996 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:08:52.034 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T05:08:52.071 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:08:52.072 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:08:52.093 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T05:08:52.122 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T05:08:52.155 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:08:52.163 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T05:08:52.180 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T05:08:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:08:52.186 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:08:52.211 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T05:08:52.244 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T05:08:52.271 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T05:08:52.374 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:08:52.374 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:08:52.458 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T05:08:52.466 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:08:52.502 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T05:08:52.532 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T05:08:52.556 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:08:52.562 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T05:08:52.600 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T05:08:53.024 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T05:08:53.057 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:08:53.081 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T05:08:53.081 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:53.081 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T05:08:53.081 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:08:53.081 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T05:08:53.081 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-19T05:08:53.124 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:08:53.147 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T05:08:53.147 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:53.147 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T05:08:53.147 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-19T05:08:53.199 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:08:53.209 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:08:53.222 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T05:08:53.222 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:53.223 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T05:08:53.223 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:08:53.223 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T05:08:53.223 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-19T05:08:53.249 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:08:53.269 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:08:53.533 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:08:53.557 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T05:08:53.557 INFO:teuthology.orchestra.run.smithi178.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T05:08:53.557 INFO:teuthology.orchestra.run.smithi178.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T05:08:53.557 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:08:53.557 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T05:08:53.558 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-19T05:08:54.098 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T05:08:54.179 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T05:08:54.233 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T05:08:54.322 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T05:08:54.358 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T05:08:54.384 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T05:08:54.409 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T05:08:54.409 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:08:54.502 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:08:54.502 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:08:54.587 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:08:54.611 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T05:08:54.617 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:08:54.617 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:08:54.805 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:08:54.805 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:08:54.889 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:08:54.955 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:08:58.103 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T05:08:58.139 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:08:58.140 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T05:08:58.140 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T05:08:58.140 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T05:08:58.140 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T05:08:58.140 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T05:08:58.140 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T05:08:58.140 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T05:08:58.140 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:08:58.140 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:08:58.140 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:08:58.141 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T05:08:58.141 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T05:08:58.141 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:08:58.141 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T05:08:58.141 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T05:08:58.141 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T05:08:58.141 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T05:08:58.141 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T05:08:58.141 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T05:08:58.141 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T05:08:58.141 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T05:08:58.141 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T05:08:58.142 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T05:08:58.142 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T05:08:58.142 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T05:08:58.142 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T05:08:58.142 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T05:08:58.142 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T05:08:58.142 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T05:08:58.142 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T05:08:58.142 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T05:08:58.149 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T05:08:58.154 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T05:08:58.154 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T05:08:58.154 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T05:08:58.154 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T05:08:58.155 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T05:08:58.155 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T05:08:58.155 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T05:08:58.155 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T05:08:58.155 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T05:08:58.155 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T05:08:58.155 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T05:08:58.155 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T05:08:58.155 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T05:08:58.155 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T05:08:58.155 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T05:08:58.155 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T05:08:58.155 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T05:08:58.156 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T05:08:58.156 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T05:08:58.156 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T05:08:58.156 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T05:08:58.156 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T05:08:58.156 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T05:08:58.156 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T05:08:58.156 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T05:08:58.156 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T05:08:58.156 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T05:08:58.156 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T05:08:58.156 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T05:08:58.157 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T05:08:58.157 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T05:08:58.157 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T05:08:58.157 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T05:08:58.157 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T05:08:58.157 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T05:08:58.157 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T05:08:58.157 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T05:08:58.157 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T05:08:58.157 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T05:08:58.157 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T05:08:58.157 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T05:08:58.157 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T05:08:58.158 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T05:08:58.158 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T05:08:58.158 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T05:08:58.158 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T05:08:58.158 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T05:08:58.158 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T05:08:58.158 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T05:08:58.158 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T05:08:58.158 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T05:08:58.158 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T05:08:58.158 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T05:08:58.158 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T05:08:58.158 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T05:08:58.159 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T05:08:58.159 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T05:08:58.159 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T05:08:58.159 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T05:08:58.159 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T05:08:58.159 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T05:08:58.159 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T05:08:58.159 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T05:08:58.159 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T05:08:58.159 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T05:08:58.159 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T05:08:58.159 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T05:08:58.159 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T05:08:58.160 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T05:08:58.160 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T05:08:58.160 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T05:08:58.160 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T05:08:58.160 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T05:08:58.160 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T05:08:58.160 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T05:08:58.160 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T05:08:58.160 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T05:08:58.160 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T05:08:58.160 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T05:08:58.160 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T05:08:58.160 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T05:08:58.161 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T05:08:58.161 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T05:08:58.161 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T05:08:58.161 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T05:08:58.161 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T05:08:58.161 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T05:08:58.161 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T05:08:58.161 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T05:08:58.161 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T05:08:58.161 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T05:08:58.161 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T05:08:58.161 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T05:08:58.161 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T05:08:58.162 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T05:08:58.162 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T05:08:58.162 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T05:08:58.162 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T05:08:58.162 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T05:08:58.162 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T05:08:58.162 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T05:08:58.162 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T05:08:58.162 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T05:08:58.162 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T05:08:58.162 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T05:08:58.162 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T05:08:58.163 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T05:08:58.163 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T05:08:58.163 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T05:08:58.163 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T05:08:58.163 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T05:08:58.163 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T05:08:58.163 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T05:08:58.163 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T05:08:58.163 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T05:08:58.163 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T05:08:58.163 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T05:08:58.163 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T05:08:58.163 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T05:08:58.164 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T05:08:58.164 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T05:08:58.164 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T05:08:58.164 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T05:08:58.164 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T05:08:58.164 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T05:08:58.164 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T05:08:58.164 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T05:08:58.164 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T05:08:58.164 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T05:08:58.164 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T05:08:58.164 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T05:08:58.164 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T05:08:58.193 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T05:08:58.226 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T05:08:58.253 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T05:08:58.447 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T05:08:58.492 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T05:08:58.522 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T05:08:58.552 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T05:08:58.589 INFO:teuthology.orchestra.run.smithi178.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T05:08:59.157 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:08:59.212 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:08:59.232 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T05:09:00.057 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T05:09:00.150 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T05:09:00.194 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T05:09:00.295 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T05:09:00.336 INFO:teuthology.orchestra.run.smithi178.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T05:09:00.362 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T05:09:00.396 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T05:09:00.396 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:09:00.480 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T05:09:00.480 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:09:00.555 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T05:09:00.580 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T05:09:00.586 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:09:00.586 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:09:00.655 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:09:00.655 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T05:09:00.655 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T05:09:00.655 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T05:09:00.655 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T05:09:00.655 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T05:09:00.655 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T05:09:00.655 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T05:09:00.655 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:09:00.656 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:09:00.656 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:09:00.656 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T05:09:00.656 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T05:09:00.656 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:09:00.656 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T05:09:00.656 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T05:09:00.656 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T05:09:00.656 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T05:09:00.656 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T05:09:00.656 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T05:09:00.657 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T05:09:00.657 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T05:09:00.657 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T05:09:00.657 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T05:09:00.657 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T05:09:00.657 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T05:09:00.657 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T05:09:00.657 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T05:09:00.657 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T05:09:00.657 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T05:09:00.657 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T05:09:00.657 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T05:09:00.658 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T05:09:00.658 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T05:09:00.658 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T05:09:00.658 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T05:09:00.658 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T05:09:00.658 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T05:09:00.658 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T05:09:00.658 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T05:09:00.658 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T05:09:00.658 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T05:09:00.658 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T05:09:00.659 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T05:09:00.659 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T05:09:00.659 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T05:09:00.659 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T05:09:00.659 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T05:09:00.659 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T05:09:00.659 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T05:09:00.659 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T05:09:00.659 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T05:09:00.659 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T05:09:00.659 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T05:09:00.659 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T05:09:00.660 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T05:09:00.660 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T05:09:00.660 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T05:09:00.660 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T05:09:00.660 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T05:09:00.660 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T05:09:00.660 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T05:09:00.660 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T05:09:00.660 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T05:09:00.660 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T05:09:00.660 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T05:09:00.661 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T05:09:00.661 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T05:09:00.661 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T05:09:00.661 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T05:09:00.661 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T05:09:00.661 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T05:09:00.661 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T05:09:00.661 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T05:09:00.661 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T05:09:00.661 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T05:09:00.661 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T05:09:00.662 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T05:09:00.662 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T05:09:00.662 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T05:09:00.662 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T05:09:00.662 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T05:09:00.662 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T05:09:00.662 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T05:09:00.662 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T05:09:00.662 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T05:09:00.662 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T05:09:00.662 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T05:09:00.663 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T05:09:00.663 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T05:09:00.663 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T05:09:00.663 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T05:09:00.663 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T05:09:00.663 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T05:09:00.663 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T05:09:00.663 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T05:09:00.663 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T05:09:00.663 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T05:09:00.663 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T05:09:00.664 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T05:09:00.664 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T05:09:00.664 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T05:09:00.664 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T05:09:00.664 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T05:09:00.664 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T05:09:00.664 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T05:09:00.664 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T05:09:00.664 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T05:09:00.664 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T05:09:00.664 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T05:09:00.665 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T05:09:00.665 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T05:09:00.665 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T05:09:00.665 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T05:09:00.665 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T05:09:00.665 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T05:09:00.665 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T05:09:00.665 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T05:09:00.665 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T05:09:00.665 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T05:09:00.665 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T05:09:00.666 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T05:09:00.666 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T05:09:00.666 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T05:09:00.666 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T05:09:00.666 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T05:09:00.666 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T05:09:00.666 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T05:09:00.666 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T05:09:00.666 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T05:09:00.666 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T05:09:00.666 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T05:09:00.666 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T05:09:00.667 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T05:09:00.667 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T05:09:00.667 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T05:09:00.667 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T05:09:00.667 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T05:09:00.667 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T05:09:00.667 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T05:09:00.667 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T05:09:00.667 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T05:09:00.667 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T05:09:00.667 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T05:09:00.668 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T05:09:00.668 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T05:09:00.668 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T05:09:00.668 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T05:09:00.668 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T05:09:00.668 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T05:09:00.668 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T05:09:00.668 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T05:09:00.668 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T05:09:00.668 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T05:09:00.668 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T05:09:00.668 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T05:09:00.669 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T05:09:00.669 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T05:09:00.669 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T05:09:00.669 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T05:09:00.669 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T05:09:00.669 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T05:09:00.669 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T05:09:00.669 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T05:09:00.730 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:09:00.730 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:09:00.730 INFO:teuthology.orchestra.run.smithi194.stdout:Upgraded: 2024-09-19T05:09:00.730 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T05:09:00.731 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T05:09:00.731 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T05:09:00.731 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T05:09:00.731 INFO:teuthology.orchestra.run.smithi194.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.731 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.731 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T05:09:00.731 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T05:09:00.732 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-19T05:09:00.732 INFO:teuthology.orchestra.run.smithi194.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T05:09:00.732 INFO:teuthology.orchestra.run.smithi194.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T05:09:00.732 INFO:teuthology.orchestra.run.smithi194.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T05:09:00.732 INFO:teuthology.orchestra.run.smithi194.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T05:09:00.732 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.732 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.732 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.732 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.732 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:00.732 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.733 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.733 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.733 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:00.733 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:00.733 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:00.733 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:00.733 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:00.733 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.733 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.733 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:00.733 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.734 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.734 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.734 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:00.734 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:00.734 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.734 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.734 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:00.734 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T05:09:00.734 INFO:teuthology.orchestra.run.smithi194.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T05:09:00.734 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T05:09:00.735 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T05:09:00.735 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T05:09:00.735 INFO:teuthology.orchestra.run.smithi194.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T05:09:00.735 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T05:09:00.735 INFO:teuthology.orchestra.run.smithi194.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T05:09:00.735 INFO:teuthology.orchestra.run.smithi194.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T05:09:00.735 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T05:09:00.735 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T05:09:00.735 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.735 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.735 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.736 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T05:09:00.736 INFO:teuthology.orchestra.run.smithi194.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T05:09:00.736 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T05:09:00.736 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T05:09:00.736 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T05:09:00.736 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.736 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.736 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T05:09:00.737 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.737 INFO:teuthology.orchestra.run.smithi194.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T05:09:00.737 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T05:09:00.737 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T05:09:00.737 INFO:teuthology.orchestra.run.smithi194.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T05:09:00.737 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T05:09:00.737 INFO:teuthology.orchestra.run.smithi194.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T05:09:00.737 INFO:teuthology.orchestra.run.smithi194.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T05:09:00.737 INFO:teuthology.orchestra.run.smithi194.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T05:09:00.737 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T05:09:00.737 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T05:09:00.738 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T05:09:00.738 INFO:teuthology.orchestra.run.smithi194.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T05:09:00.738 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T05:09:00.738 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T05:09:00.738 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T05:09:00.738 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T05:09:00.738 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T05:09:00.738 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T05:09:00.738 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T05:09:00.738 INFO:teuthology.orchestra.run.smithi194.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T05:09:00.739 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T05:09:00.739 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T05:09:00.739 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T05:09:00.739 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.739 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.739 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.739 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T05:09:00.739 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T05:09:00.739 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T05:09:00.739 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T05:09:00.739 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T05:09:00.740 INFO:teuthology.orchestra.run.smithi194.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T05:09:00.740 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T05:09:00.740 INFO:teuthology.orchestra.run.smithi194.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T05:09:00.740 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T05:09:00.740 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T05:09:00.740 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T05:09:00.740 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T05:09:00.740 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T05:09:00.740 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T05:09:00.740 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T05:09:00.741 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T05:09:00.741 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T05:09:00.741 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T05:09:00.741 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T05:09:00.741 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T05:09:00.741 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T05:09:00.741 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T05:09:00.742 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T05:09:00.742 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T05:09:00.742 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T05:09:00.742 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T05:09:00.742 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T05:09:00.742 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T05:09:00.742 INFO:teuthology.orchestra.run.smithi194.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T05:09:00.742 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T05:09:00.743 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T05:09:00.743 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T05:09:00.743 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T05:09:00.743 INFO:teuthology.orchestra.run.smithi194.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T05:09:00.743 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T05:09:00.743 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T05:09:00.743 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T05:09:00.743 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T05:09:00.743 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T05:09:00.743 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T05:09:00.744 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.744 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.744 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T05:09:00.744 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T05:09:00.744 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T05:09:00.744 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.744 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T05:09:00.744 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T05:09:00.744 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T05:09:00.744 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T05:09:00.745 INFO:teuthology.orchestra.run.smithi194.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T05:09:00.745 INFO:teuthology.orchestra.run.smithi194.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T05:09:00.745 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T05:09:00.745 INFO:teuthology.orchestra.run.smithi194.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T05:09:00.745 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T05:09:00.745 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T05:09:00.745 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T05:09:00.745 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T05:09:00.745 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T05:09:00.745 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T05:09:00.745 INFO:teuthology.orchestra.run.smithi194.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T05:09:00.746 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.746 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.746 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:00.746 INFO:teuthology.orchestra.run.smithi194.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T05:09:00.746 INFO:teuthology.orchestra.run.smithi194.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T05:09:00.746 INFO:teuthology.orchestra.run.smithi194.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T05:09:00.746 INFO:teuthology.orchestra.run.smithi194.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T05:09:00.747 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T05:09:00.747 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T05:09:00.747 INFO:teuthology.orchestra.run.smithi194.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T05:09:00.747 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:09:00.747 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-19T05:09:00.766 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T05:09:00.766 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:09:00.849 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T05:09:00.915 INFO:teuthology.orchestra.run.smithi178.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:09:01.133 DEBUG:teuthology.parallel:result is None 2024-09-19T05:09:03.538 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:09:03.538 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:09:03.539 INFO:teuthology.orchestra.run.smithi120.stdout:Upgraded: 2024-09-19T05:09:03.539 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T05:09:03.539 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T05:09:03.539 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T05:09:03.539 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T05:09:03.539 INFO:teuthology.orchestra.run.smithi120.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.539 INFO:teuthology.orchestra.run.smithi120.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.539 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T05:09:03.539 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T05:09:03.539 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2024-09-19T05:09:03.539 INFO:teuthology.orchestra.run.smithi120.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T05:09:03.539 INFO:teuthology.orchestra.run.smithi120.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T05:09:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T05:09:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T05:09:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:03.540 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:03.541 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T05:09:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T05:09:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T05:09:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T05:09:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T05:09:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T05:09:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T05:09:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T05:09:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T05:09:03.542 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T05:09:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T05:09:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T05:09:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T05:09:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T05:09:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T05:09:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T05:09:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T05:09:03.543 INFO:teuthology.orchestra.run.smithi120.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T05:09:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T05:09:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T05:09:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T05:09:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T05:09:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T05:09:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T05:09:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T05:09:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T05:09:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T05:09:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T05:09:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T05:09:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T05:09:03.544 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T05:09:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T05:09:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T05:09:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T05:09:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T05:09:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T05:09:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T05:09:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T05:09:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T05:09:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T05:09:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.545 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T05:09:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T05:09:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T05:09:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T05:09:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T05:09:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T05:09:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T05:09:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T05:09:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T05:09:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T05:09:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T05:09:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T05:09:03.546 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T05:09:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T05:09:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T05:09:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T05:09:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T05:09:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T05:09:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T05:09:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T05:09:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T05:09:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T05:09:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T05:09:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T05:09:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T05:09:03.547 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T05:09:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T05:09:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T05:09:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T05:09:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T05:09:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T05:09:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T05:09:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T05:09:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T05:09:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T05:09:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T05:09:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T05:09:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T05:09:03.548 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T05:09:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T05:09:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T05:09:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T05:09:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T05:09:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T05:09:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T05:09:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T05:09:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T05:09:03.549 INFO:teuthology.orchestra.run.smithi120.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T05:09:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T05:09:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T05:09:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T05:09:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T05:09:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T05:09:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T05:09:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T05:09:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T05:09:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T05:09:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T05:09:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:03.550 INFO:teuthology.orchestra.run.smithi120.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T05:09:03.551 INFO:teuthology.orchestra.run.smithi120.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T05:09:03.551 INFO:teuthology.orchestra.run.smithi120.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T05:09:03.551 INFO:teuthology.orchestra.run.smithi120.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T05:09:03.551 INFO:teuthology.orchestra.run.smithi120.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T05:09:03.551 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T05:09:03.551 INFO:teuthology.orchestra.run.smithi120.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T05:09:03.551 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:09:03.552 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2024-09-19T05:09:03.969 DEBUG:teuthology.parallel:result is None 2024-09-19T05:09:06.678 INFO:teuthology.orchestra.run.smithi178.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:09:06.679 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T05:09:06.679 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T05:09:06.679 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T05:09:06.679 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T05:09:06.679 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T05:09:06.679 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T05:09:06.679 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T05:09:06.679 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T05:09:06.679 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T05:09:06.679 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T05:09:06.679 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T05:09:06.680 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T05:09:06.680 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T05:09:06.680 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T05:09:06.680 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T05:09:06.680 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T05:09:06.680 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T05:09:06.680 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T05:09:06.680 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T05:09:06.680 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T05:09:06.680 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T05:09:06.680 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T05:09:06.680 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T05:09:06.681 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T05:09:06.681 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T05:09:06.681 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T05:09:06.681 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T05:09:06.681 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T05:09:06.681 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T05:09:06.681 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T05:09:06.681 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T05:09:06.695 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T05:09:06.695 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T05:09:06.695 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T05:09:06.695 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T05:09:06.695 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T05:09:06.695 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T05:09:06.696 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T05:09:06.696 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T05:09:06.696 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T05:09:06.696 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T05:09:06.696 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T05:09:06.696 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T05:09:06.696 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T05:09:06.696 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T05:09:06.696 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T05:09:06.696 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T05:09:06.696 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T05:09:06.696 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T05:09:06.697 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T05:09:06.697 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T05:09:06.697 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T05:09:06.697 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T05:09:06.697 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T05:09:06.697 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T05:09:06.697 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T05:09:06.697 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T05:09:06.697 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T05:09:06.697 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T05:09:06.697 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T05:09:06.697 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T05:09:06.697 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T05:09:06.698 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T05:09:06.698 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T05:09:06.698 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T05:09:06.698 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T05:09:06.698 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T05:09:06.698 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T05:09:06.698 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T05:09:06.698 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T05:09:06.698 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T05:09:06.698 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T05:09:06.698 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T05:09:06.698 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T05:09:06.698 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T05:09:06.699 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T05:09:06.699 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T05:09:06.699 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T05:09:06.699 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T05:09:06.699 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T05:09:06.699 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T05:09:06.699 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T05:09:06.699 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T05:09:06.699 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T05:09:06.699 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T05:09:06.699 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T05:09:06.699 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T05:09:06.699 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T05:09:06.700 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T05:09:06.700 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T05:09:06.700 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T05:09:06.700 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T05:09:06.700 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T05:09:06.700 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T05:09:06.700 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T05:09:06.700 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T05:09:06.700 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T05:09:06.700 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T05:09:06.700 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T05:09:06.700 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T05:09:06.700 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T05:09:06.701 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T05:09:06.701 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T05:09:06.701 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T05:09:06.701 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T05:09:06.701 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T05:09:06.701 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T05:09:06.702 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T05:09:06.702 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T05:09:06.702 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T05:09:06.702 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T05:09:06.702 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T05:09:06.702 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T05:09:06.703 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T05:09:06.703 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T05:09:06.703 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T05:09:06.703 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T05:09:06.703 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T05:09:06.704 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T05:09:06.704 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T05:09:06.704 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T05:09:06.704 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T05:09:06.704 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T05:09:06.704 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T05:09:06.705 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T05:09:06.705 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T05:09:06.705 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T05:09:06.705 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T05:09:06.705 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T05:09:06.705 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T05:09:06.706 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T05:09:06.706 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T05:09:06.706 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T05:09:06.706 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T05:09:06.706 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T05:09:06.706 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T05:09:06.706 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T05:09:06.707 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T05:09:06.707 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T05:09:06.707 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T05:09:06.707 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T05:09:06.707 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T05:09:06.707 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T05:09:06.708 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T05:09:06.708 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T05:09:06.708 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T05:09:06.708 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T05:09:06.708 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T05:09:06.708 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T05:09:06.709 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T05:09:06.709 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T05:09:06.709 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T05:09:06.709 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T05:09:06.709 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T05:09:06.709 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T05:09:06.710 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T05:09:06.710 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T05:09:06.710 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T05:09:06.710 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T05:09:06.710 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T05:09:06.711 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T05:09:06.711 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T05:09:06.711 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T05:09:09.258 INFO:teuthology.orchestra.run.smithi178.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T05:09:09.259 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-19T05:09:09.259 INFO:teuthology.orchestra.run.smithi178.stdout:Upgraded: 2024-09-19T05:09:09.259 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T05:09:09.259 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T05:09:09.259 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T05:09:09.259 INFO:teuthology.orchestra.run.smithi178.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T05:09:09.259 INFO:teuthology.orchestra.run.smithi178.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.259 INFO:teuthology.orchestra.run.smithi178.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.259 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T05:09:09.259 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T05:09:09.260 INFO:teuthology.orchestra.run.smithi178.stdout:Installed: 2024-09-19T05:09:09.260 INFO:teuthology.orchestra.run.smithi178.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T05:09:09.260 INFO:teuthology.orchestra.run.smithi178.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T05:09:09.260 INFO:teuthology.orchestra.run.smithi178.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T05:09:09.260 INFO:teuthology.orchestra.run.smithi178.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T05:09:09.260 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.260 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.260 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.260 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.260 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:09.260 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.260 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.261 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.261 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:09.261 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:09.261 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:09.261 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:09.261 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:09.261 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.261 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.261 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:09.261 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.261 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.261 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.261 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:09.262 INFO:teuthology.orchestra.run.smithi178.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:09.262 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.262 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.262 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T05:09:09.262 INFO:teuthology.orchestra.run.smithi178.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T05:09:09.262 INFO:teuthology.orchestra.run.smithi178.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T05:09:09.262 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T05:09:09.262 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T05:09:09.262 INFO:teuthology.orchestra.run.smithi178.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T05:09:09.262 INFO:teuthology.orchestra.run.smithi178.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T05:09:09.262 INFO:teuthology.orchestra.run.smithi178.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T05:09:09.262 INFO:teuthology.orchestra.run.smithi178.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T05:09:09.263 INFO:teuthology.orchestra.run.smithi178.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T05:09:09.263 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T05:09:09.263 INFO:teuthology.orchestra.run.smithi178.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T05:09:09.263 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.263 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.263 INFO:teuthology.orchestra.run.smithi178.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.263 INFO:teuthology.orchestra.run.smithi178.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T05:09:09.263 INFO:teuthology.orchestra.run.smithi178.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T05:09:09.263 INFO:teuthology.orchestra.run.smithi178.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T05:09:09.263 INFO:teuthology.orchestra.run.smithi178.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T05:09:09.263 INFO:teuthology.orchestra.run.smithi178.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T05:09:09.263 INFO:teuthology.orchestra.run.smithi178.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.263 INFO:teuthology.orchestra.run.smithi178.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.263 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T05:09:09.264 INFO:teuthology.orchestra.run.smithi178.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.264 INFO:teuthology.orchestra.run.smithi178.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T05:09:09.264 INFO:teuthology.orchestra.run.smithi178.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T05:09:09.264 INFO:teuthology.orchestra.run.smithi178.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T05:09:09.264 INFO:teuthology.orchestra.run.smithi178.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T05:09:09.264 INFO:teuthology.orchestra.run.smithi178.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T05:09:09.264 INFO:teuthology.orchestra.run.smithi178.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T05:09:09.264 INFO:teuthology.orchestra.run.smithi178.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T05:09:09.265 INFO:teuthology.orchestra.run.smithi178.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T05:09:09.265 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T05:09:09.265 INFO:teuthology.orchestra.run.smithi178.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T05:09:09.265 INFO:teuthology.orchestra.run.smithi178.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T05:09:09.265 INFO:teuthology.orchestra.run.smithi178.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T05:09:09.265 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T05:09:09.265 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T05:09:09.265 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T05:09:09.265 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T05:09:09.266 INFO:teuthology.orchestra.run.smithi178.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T05:09:09.266 INFO:teuthology.orchestra.run.smithi178.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T05:09:09.266 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T05:09:09.266 INFO:teuthology.orchestra.run.smithi178.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T05:09:09.266 INFO:teuthology.orchestra.run.smithi178.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T05:09:09.266 INFO:teuthology.orchestra.run.smithi178.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T05:09:09.266 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T05:09:09.266 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.266 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.266 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.266 INFO:teuthology.orchestra.run.smithi178.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T05:09:09.266 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T05:09:09.266 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T05:09:09.267 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T05:09:09.267 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T05:09:09.267 INFO:teuthology.orchestra.run.smithi178.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T05:09:09.267 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T05:09:09.267 INFO:teuthology.orchestra.run.smithi178.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T05:09:09.267 INFO:teuthology.orchestra.run.smithi178.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T05:09:09.267 INFO:teuthology.orchestra.run.smithi178.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T05:09:09.267 INFO:teuthology.orchestra.run.smithi178.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T05:09:09.267 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T05:09:09.267 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T05:09:09.267 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T05:09:09.267 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T05:09:09.268 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T05:09:09.268 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T05:09:09.268 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T05:09:09.268 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T05:09:09.268 INFO:teuthology.orchestra.run.smithi178.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T05:09:09.268 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T05:09:09.268 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T05:09:09.268 INFO:teuthology.orchestra.run.smithi178.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T05:09:09.268 INFO:teuthology.orchestra.run.smithi178.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T05:09:09.268 INFO:teuthology.orchestra.run.smithi178.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T05:09:09.268 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T05:09:09.268 INFO:teuthology.orchestra.run.smithi178.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T05:09:09.268 INFO:teuthology.orchestra.run.smithi178.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T05:09:09.269 INFO:teuthology.orchestra.run.smithi178.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T05:09:09.269 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T05:09:09.269 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T05:09:09.269 INFO:teuthology.orchestra.run.smithi178.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T05:09:09.269 INFO:teuthology.orchestra.run.smithi178.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T05:09:09.269 INFO:teuthology.orchestra.run.smithi178.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T05:09:09.269 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T05:09:09.269 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T05:09:09.269 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T05:09:09.269 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T05:09:09.269 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T05:09:09.269 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T05:09:09.269 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.270 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.270 INFO:teuthology.orchestra.run.smithi178.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T05:09:09.270 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T05:09:09.270 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T05:09:09.270 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.270 INFO:teuthology.orchestra.run.smithi178.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T05:09:09.270 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T05:09:09.270 INFO:teuthology.orchestra.run.smithi178.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T05:09:09.270 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T05:09:09.270 INFO:teuthology.orchestra.run.smithi178.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T05:09:09.270 INFO:teuthology.orchestra.run.smithi178.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T05:09:09.270 INFO:teuthology.orchestra.run.smithi178.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T05:09:09.270 INFO:teuthology.orchestra.run.smithi178.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T05:09:09.271 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T05:09:09.271 INFO:teuthology.orchestra.run.smithi178.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T05:09:09.271 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T05:09:09.271 INFO:teuthology.orchestra.run.smithi178.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T05:09:09.271 INFO:teuthology.orchestra.run.smithi178.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T05:09:09.271 INFO:teuthology.orchestra.run.smithi178.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T05:09:09.271 INFO:teuthology.orchestra.run.smithi178.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T05:09:09.271 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.271 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.272 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T05:09:09.272 INFO:teuthology.orchestra.run.smithi178.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T05:09:09.272 INFO:teuthology.orchestra.run.smithi178.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T05:09:09.272 INFO:teuthology.orchestra.run.smithi178.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T05:09:09.272 INFO:teuthology.orchestra.run.smithi178.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T05:09:09.272 INFO:teuthology.orchestra.run.smithi178.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T05:09:09.272 INFO:teuthology.orchestra.run.smithi178.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T05:09:09.272 INFO:teuthology.orchestra.run.smithi178.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T05:09:09.272 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-19T05:09:09.273 INFO:teuthology.orchestra.run.smithi178.stdout:Complete! 2024-09-19T05:09:09.676 DEBUG:teuthology.parallel:result is None 2024-09-19T05:09:09.676 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:09:09.815 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T05:09:09.842 INFO:teuthology.orchestra.run.smithi120.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T05:09:09.842 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T05:09:09.842 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T05:09:09.844 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:09:09.992 DEBUG:teuthology.orchestra.run.smithi178:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T05:09:10.015 INFO:teuthology.orchestra.run.smithi178.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T05:09:10.015 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T05:09:10.015 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T05:09:10.017 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:09:10.155 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T05:09:10.182 INFO:teuthology.orchestra.run.smithi194.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T05:09:10.182 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T05:09:10.183 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T05:09:10.184 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T05:09:10.185 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T05:09:10.185 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T05:09:10.217 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-19T05:09:10.217 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T05:09:10.245 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T05:09:10.246 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T05:09:10.277 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T05:09:10.278 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T05:09:10.278 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T05:09:10.307 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T05:09:10.376 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-19T05:09:10.376 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T05:09:10.402 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T05:09:10.468 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T05:09:10.468 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T05:09:10.498 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T05:09:10.567 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T05:09:10.567 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T05:09:10.567 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T05:09:10.597 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T05:09:10.667 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-19T05:09:10.667 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T05:09:10.693 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T05:09:10.759 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T05:09:10.759 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T05:09:10.788 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T05:09:10.856 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T05:09:10.857 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T05:09:10.857 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T05:09:10.886 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T05:09:10.955 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-19T05:09:10.955 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T05:09:10.981 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T05:09:11.048 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T05:09:11.048 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T05:09:11.077 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T05:09:11.146 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T05:09:11.243 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2}} 2024-09-19T05:09:11.243 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:09:11.244 INFO:tasks.cephadm:Cluster fsid is 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:09:11.244 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T05:09:11.244 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.120', 'mon.b': '172.21.15.178', 'mon.c': '172.21.15.194'} 2024-09-19T05:09:11.244 INFO:tasks.cephadm:First mon is mon.a on smithi120 2024-09-19T05:09:11.244 INFO:tasks.cephadm:First mgr is x 2024-09-19T05:09:11.245 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T05:09:11.245 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname $(hostname -s) 2024-09-19T05:09:11.275 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname $(hostname -s) 2024-09-19T05:09:11.301 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname $(hostname -s) 2024-09-19T05:09:11.330 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T05:09:11.331 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:09:11.477 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T05:09:11.621 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:09:11.622 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T05:09:11.622 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T05:09:11.622 DEBUG:teuthology.orchestra.run.smithi120:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T05:09:12.021 INFO:teuthology.orchestra.run.smithi120.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 05:09 /home/ubuntu/cephtest/cephadm 2024-09-19T05:09:12.021 DEBUG:teuthology.orchestra.run.smithi178:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T05:09:12.415 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 05:09 /home/ubuntu/cephtest/cephadm 2024-09-19T05:09:12.415 DEBUG:teuthology.orchestra.run.smithi194:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T05:09:12.818 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 05:09 /home/ubuntu/cephtest/cephadm 2024-09-19T05:09:12.819 DEBUG:teuthology.orchestra.run.smithi120:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T05:09:12.839 DEBUG:teuthology.orchestra.run.smithi178:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T05:09:12.858 DEBUG:teuthology.orchestra.run.smithi194:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T05:09:12.891 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T05:09:12.891 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T05:09:12.894 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T05:09:12.900 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T05:09:14.437 INFO:teuthology.orchestra.run.smithi178.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T05:09:14.472 INFO:teuthology.orchestra.run.smithi120.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T05:09:14.535 INFO:teuthology.orchestra.run.smithi194.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T05:09:41.799 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-19T05:09:41.799 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:09:41.799 INFO:teuthology.orchestra.run.smithi194.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T05:09:41.799 INFO:teuthology.orchestra.run.smithi194.stdout: "repo_digests": [ 2024-09-19T05:09:41.799 INFO:teuthology.orchestra.run.smithi194.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T05:09:41.799 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-09-19T05:09:41.800 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-19T05:09:41.930 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2024-09-19T05:09:41.931 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:09:41.931 INFO:teuthology.orchestra.run.smithi178.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T05:09:41.931 INFO:teuthology.orchestra.run.smithi178.stdout: "repo_digests": [ 2024-09-19T05:09:41.931 INFO:teuthology.orchestra.run.smithi178.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T05:09:41.931 INFO:teuthology.orchestra.run.smithi178.stdout: ] 2024-09-19T05:09:41.931 INFO:teuthology.orchestra.run.smithi178.stdout:} 2024-09-19T05:09:47.038 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T05:09:47.038 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:09:47.038 INFO:teuthology.orchestra.run.smithi120.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T05:09:47.038 INFO:teuthology.orchestra.run.smithi120.stdout: "repo_digests": [ 2024-09-19T05:09:47.038 INFO:teuthology.orchestra.run.smithi120.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T05:09:47.038 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-19T05:09:47.039 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T05:09:47.063 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /etc/ceph 2024-09-19T05:09:47.118 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph 2024-09-19T05:09:47.151 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /etc/ceph 2024-09-19T05:09:47.185 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 777 /etc/ceph 2024-09-19T05:09:47.209 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 777 /etc/ceph 2024-09-19T05:09:47.237 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 777 /etc/ceph 2024-09-19T05:09:47.265 INFO:tasks.cephadm:Writing seed config... 2024-09-19T05:09:47.266 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T05:09:47.267 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T05:09:47.267 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T05:09:47.267 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T05:09:47.267 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T05:09:47.267 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T05:09:47.267 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T05:09:47.267 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T05:09:47.267 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T05:09:47.267 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T05:09:47.267 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T05:09:47.267 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T05:09:47.267 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T05:09:47.267 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T05:09:47.268 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T05:09:47.268 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T05:09:47.268 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T05:09:47.268 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T05:09:47.268 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T05:09:47.268 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T05:09:47.268 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-19T05:09:47.268 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T05:09:47.268 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T05:09:47.268 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T05:09:47.268 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T05:09:47.268 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T05:09:47.268 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T05:09:47.268 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T05:09:47.269 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T05:09:47.269 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T05:09:47.269 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-19T05:09:47.269 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-19T05:09:47.269 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-19T05:09:47.269 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T05:09:47.269 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T05:09:47.269 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-19T05:09:47.269 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-19T05:09:47.269 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T05:09:47.269 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T05:09:47.269 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-19T05:09:47.269 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T05:09:47.269 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T05:09:47.269 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T05:09:47.270 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T05:09:47.270 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T05:09:47.270 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T05:09:47.270 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T05:09:47.270 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-19T05:09:47.271 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T05:09:47.271 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T05:09:47.286 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 4e6e3df4-7645-11ef-bceb-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T05:09:47.286 DEBUG:teuthology.orchestra.run.smithi120:mon.a> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T05:09:47.329 DEBUG:teuthology.orchestra.run.smithi120:mgr.x> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T05:09:47.372 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T05:09:47.372 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.120 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:09:47.572 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2024-09-19T05:09:47.572 INFO:teuthology.orchestra.run.smithi120.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', '4e6e3df4-7645-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.120', '--skip-admin-label'] 2024-09-19T05:09:47.572 INFO:teuthology.orchestra.run.smithi120.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T05:09:47.572 INFO:teuthology.orchestra.run.smithi120.stdout:Verifying podman|docker is present... 2024-09-19T05:09:47.608 INFO:teuthology.orchestra.run.smithi120.stdout:/bin/podman: stdout 5.2.2 2024-09-19T05:09:47.608 INFO:teuthology.orchestra.run.smithi120.stdout:Verifying lvm2 is present... 2024-09-19T05:09:47.608 INFO:teuthology.orchestra.run.smithi120.stdout:Verifying time synchronization is in place... 2024-09-19T05:09:47.616 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T05:09:47.616 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T05:09:47.622 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T05:09:47.622 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout inactive 2024-09-19T05:09:47.629 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout enabled 2024-09-19T05:09:47.635 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout active 2024-09-19T05:09:47.635 INFO:teuthology.orchestra.run.smithi120.stdout:Unit chronyd.service is enabled and running 2024-09-19T05:09:47.635 INFO:teuthology.orchestra.run.smithi120.stdout:Repeating the final host check... 2024-09-19T05:09:47.657 INFO:teuthology.orchestra.run.smithi120.stdout:/bin/podman: stdout 5.2.2 2024-09-19T05:09:47.657 INFO:teuthology.orchestra.run.smithi120.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T05:09:47.657 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl is present 2024-09-19T05:09:47.657 INFO:teuthology.orchestra.run.smithi120.stdout:lvcreate is present 2024-09-19T05:09:47.664 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T05:09:47.664 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T05:09:47.670 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T05:09:47.670 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout inactive 2024-09-19T05:09:47.676 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout enabled 2024-09-19T05:09:47.683 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout active 2024-09-19T05:09:47.683 INFO:teuthology.orchestra.run.smithi120.stdout:Unit chronyd.service is enabled and running 2024-09-19T05:09:47.683 INFO:teuthology.orchestra.run.smithi120.stdout:Host looks OK 2024-09-19T05:09:47.683 INFO:teuthology.orchestra.run.smithi120.stdout:Cluster fsid: 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:09:47.683 INFO:teuthology.orchestra.run.smithi120.stdout:Acquiring lock 139801261020160 on /run/cephadm/4e6e3df4-7645-11ef-bceb-c7b262605968.lock 2024-09-19T05:09:47.683 INFO:teuthology.orchestra.run.smithi120.stdout:Lock 139801261020160 acquired on /run/cephadm/4e6e3df4-7645-11ef-bceb-c7b262605968.lock 2024-09-19T05:09:47.684 INFO:teuthology.orchestra.run.smithi120.stdout:Verifying IP 172.21.15.120 port 3300 ... 2024-09-19T05:09:47.684 INFO:teuthology.orchestra.run.smithi120.stdout:Verifying IP 172.21.15.120 port 6789 ... 2024-09-19T05:09:47.684 INFO:teuthology.orchestra.run.smithi120.stdout:Base mon IP(s) is [172.21.15.120:3300, 172.21.15.120:6789], mon addrv is [v2:172.21.15.120:3300,v1:172.21.15.120:6789] 2024-09-19T05:09:47.687 INFO:teuthology.orchestra.run.smithi120.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.120 metric 100 2024-09-19T05:09:47.687 INFO:teuthology.orchestra.run.smithi120.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.120 metric 100 2024-09-19T05:09:47.690 INFO:teuthology.orchestra.run.smithi120.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T05:09:47.690 INFO:teuthology.orchestra.run.smithi120.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-19T05:09:47.690 INFO:teuthology.orchestra.run.smithi120.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-19T05:09:47.693 INFO:teuthology.orchestra.run.smithi120.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T05:09:47.693 INFO:teuthology.orchestra.run.smithi120.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T05:09:47.693 INFO:teuthology.orchestra.run.smithi120.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T05:09:47.694 INFO:teuthology.orchestra.run.smithi120.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-19T05:09:47.694 INFO:teuthology.orchestra.run.smithi120.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:478f/64 scope link noprefixroute 2024-09-19T05:09:47.694 INFO:teuthology.orchestra.run.smithi120.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T05:09:47.694 INFO:teuthology.orchestra.run.smithi120.stdout:Mon IP `172.21.15.120` is in CIDR network `172.21.0.0/20` 2024-09-19T05:09:47.694 INFO:teuthology.orchestra.run.smithi120.stdout:Mon IP `172.21.15.120` is in CIDR network `172.21.0.0/20` 2024-09-19T05:09:47.694 INFO:teuthology.orchestra.run.smithi120.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T05:09:47.694 INFO:teuthology.orchestra.run.smithi120.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T05:09:47.695 INFO:teuthology.orchestra.run.smithi120.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T05:09:48.125 INFO:teuthology.orchestra.run.smithi120.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T05:09:48.125 INFO:teuthology.orchestra.run.smithi120.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T05:09:48.125 INFO:teuthology.orchestra.run.smithi120.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T05:09:48.125 INFO:teuthology.orchestra.run.smithi120.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T05:09:48.125 INFO:teuthology.orchestra.run.smithi120.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T05:09:48.125 INFO:teuthology.orchestra.run.smithi120.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T05:09:48.125 INFO:teuthology.orchestra.run.smithi120.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T05:09:49.012 INFO:teuthology.orchestra.run.smithi120.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T05:09:49.013 INFO:teuthology.orchestra.run.smithi120.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T05:09:49.013 INFO:teuthology.orchestra.run.smithi120.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T05:09:50.060 INFO:teuthology.orchestra.run.smithi120.stdout:stat: stdout 167 167 2024-09-19T05:09:50.060 INFO:teuthology.orchestra.run.smithi120.stdout:Creating initial keys... 2024-09-19T05:09:50.949 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph-authtool: stdout AQAesutm0mPrFRAAfJ3iouHRVgqG3qcYLsofNg== 2024-09-19T05:09:51.763 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph-authtool: stdout AQAfsutm0YnEDhAAHhuuXCVM4g4nYOlmHMi2DA== 2024-09-19T05:09:52.789 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph-authtool: stdout AQAgsutm+eMjBRAAL7C9lrx0tTNbz0I8yRJZWA== 2024-09-19T05:09:52.790 INFO:teuthology.orchestra.run.smithi120.stdout:Creating initial monmap... 2024-09-19T05:09:53.640 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T05:09:53.641 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T05:09:53.641 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:09:53.641 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T05:09:53.641 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool for a [v2:172.21.15.120:3300,v1:172.21.15.120:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T05:09:53.641 INFO:teuthology.orchestra.run.smithi120.stdout:setting min_mon_release = quincy 2024-09-19T05:09:53.641 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/monmaptool: set fsid to 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:09:53.641 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T05:09:53.641 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:09:53.641 INFO:teuthology.orchestra.run.smithi120.stdout:Creating mon... 2024-09-19T05:09:54.463 INFO:teuthology.orchestra.run.smithi120.stdout:create mon.a on 2024-09-19T05:09:54.666 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T05:09:54.805 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T05:09:54.969 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-4e6e3df4-7645-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-4e6e3df4-7645-11ef-bceb-c7b262605968.target. 2024-09-19T05:09:54.970 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-4e6e3df4-7645-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-4e6e3df4-7645-11ef-bceb-c7b262605968.target. 2024-09-19T05:09:55.211 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mon.a 2024-09-19T05:09:55.211 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T05:09:55.384 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4e6e3df4-7645-11ef-bceb-c7b262605968.target.wants/ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@.service. 2024-09-19T05:09:55.887 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T05:09:55.887 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout disabled 2024-09-19T05:09:55.895 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T05:09:55.895 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout inactive 2024-09-19T05:09:55.895 INFO:teuthology.orchestra.run.smithi120.stdout:firewalld.service is not enabled 2024-09-19T05:09:55.895 INFO:teuthology.orchestra.run.smithi120.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T05:09:55.896 INFO:teuthology.orchestra.run.smithi120.stdout:Waiting for mon to start... 2024-09-19T05:09:55.896 INFO:teuthology.orchestra.run.smithi120.stdout:Waiting for mon... 2024-09-19T05:09:56.937 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T05:09:56.938 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout id: 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:09:56.938 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T05:09:56.938 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 2024-09-19T05:09:56.938 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout services: 2024-09-19T05:09:56.938 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.543694s) 2024-09-19T05:09:56.938 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T05:09:56.938 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T05:09:56.938 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 2024-09-19T05:09:56.938 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout data: 2024-09-19T05:09:56.938 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T05:09:56.938 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T05:09:56.938 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T05:09:56.938 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T05:09:56.938 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 2024-09-19T05:09:56.939 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.317+0000 7f46151b2640 1 Processor -- start 2024-09-19T05:09:56.939 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.317+0000 7f46151b2640 1 -- start start 2024-09-19T05:09:56.939 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.318+0000 7f46151b2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4610107570 0x7f4610107970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:09:56.939 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.318+0000 7f46151b2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4610107f40 con 0x7f4610107570 2024-09-19T05:09:56.939 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.318+0000 7f460ed9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4610107570 0x7f4610107970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:09:56.939 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.318+0000 7f460ed9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4610107570 0x7f4610107970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45438/0 (socket says 172.21.15.120:45438) 2024-09-19T05:09:56.939 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.318+0000 7f460ed9d640 1 -- 172.21.15.120:0/2434070255 learned_addr learned my addr 172.21.15.120:0/2434070255 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:09:56.939 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.318+0000 7f460ed9d640 1 -- 172.21.15.120:0/2434070255 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4610108770 con 0x7f4610107570 2024-09-19T05:09:56.939 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.320+0000 7f460ed9d640 1 --2- 172.21.15.120:0/2434070255 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4610107570 0x7f4610107970 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4600009820 tx=0x7f460002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7c1b6407e78a95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:09:56.939 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.320+0000 7f460dd9b640 1 -- 172.21.15.120:0/2434070255 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4600037070 con 0x7f4610107570 2024-09-19T05:09:56.939 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.320+0000 7f460dd9b640 1 -- 172.21.15.120:0/2434070255 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4600032440 con 0x7f4610107570 2024-09-19T05:09:56.939 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.320+0000 7f460dd9b640 1 -- 172.21.15.120:0/2434070255 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4600032740 con 0x7f4610107570 2024-09-19T05:09:56.939 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.321+0000 7f46151b2640 1 -- 172.21.15.120:0/2434070255 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4610107570 msgr2=0x7f4610107970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:09:56.940 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.321+0000 7f46151b2640 1 --2- 172.21.15.120:0/2434070255 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4610107570 0x7f4610107970 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4600009820 tx=0x7f460002a270 comp rx=0 tx=0).stop 2024-09-19T05:09:56.940 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.321+0000 7f46151b2640 1 -- 172.21.15.120:0/2434070255 shutdown_connections 2024-09-19T05:09:56.940 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.321+0000 7f46151b2640 1 --2- 172.21.15.120:0/2434070255 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4610107570 0x7f4610107970 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:09:56.940 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.321+0000 7f46151b2640 1 -- 172.21.15.120:0/2434070255 >> 172.21.15.120:0/2434070255 conn(0x7f4610102d20 msgr2=0x7f4610105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:09:56.940 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.321+0000 7f46151b2640 1 -- 172.21.15.120:0/2434070255 shutdown_connections 2024-09-19T05:09:56.940 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.321+0000 7f46151b2640 1 -- 172.21.15.120:0/2434070255 wait complete. 2024-09-19T05:09:56.940 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.322+0000 7f46151b2640 1 Processor -- start 2024-09-19T05:09:56.940 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.322+0000 7f46151b2640 1 -- start start 2024-09-19T05:09:56.940 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.322+0000 7f46151b2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4610107570 0x7f461019cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:09:56.940 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.322+0000 7f46151b2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4610108d10 con 0x7f4610107570 2024-09-19T05:09:56.940 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.322+0000 7f460ed9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4610107570 0x7f461019cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:09:56.940 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.322+0000 7f460ed9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4610107570 0x7f461019cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45450/0 (socket says 172.21.15.120:45450) 2024-09-19T05:09:56.940 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.322+0000 7f460ed9d640 1 -- 172.21.15.120:0/1591263385 learned_addr learned my addr 172.21.15.120:0/1591263385 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:09:56.941 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.323+0000 7f460ed9d640 1 -- 172.21.15.120:0/1591263385 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461019d490 con 0x7f4610107570 2024-09-19T05:09:56.941 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.323+0000 7f460ed9d640 1 --2- 172.21.15.120:0/1591263385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4610107570 0x7f461019cf50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f46000090b0 tx=0x7f46000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:09:56.941 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.323+0000 7f45f7fff640 1 -- 172.21.15.120:0/1591263385 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4600041070 con 0x7f4610107570 2024-09-19T05:09:56.941 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.323+0000 7f45f7fff640 1 -- 172.21.15.120:0/1591263385 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f460003c7a0 con 0x7f4610107570 2024-09-19T05:09:56.941 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.323+0000 7f46151b2640 1 -- 172.21.15.120:0/1591263385 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f461019d720 con 0x7f4610107570 2024-09-19T05:09:56.941 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.324+0000 7f45f7fff640 1 -- 172.21.15.120:0/1591263385 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4600037040 con 0x7f4610107570 2024-09-19T05:09:56.941 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.324+0000 7f46151b2640 1 -- 172.21.15.120:0/1591263385 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46101a0410 con 0x7f4610107570 2024-09-19T05:09:56.941 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.324+0000 7f45f7fff640 1 -- 172.21.15.120:0/1591263385 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4600044070 con 0x7f4610107570 2024-09-19T05:09:56.941 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.324+0000 7f45f7fff640 1 -- 172.21.15.120:0/1591263385 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f460003d850 con 0x7f4610107570 2024-09-19T05:09:56.941 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.324+0000 7f46151b2640 1 -- 172.21.15.120:0/1591263385 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4610109360 con 0x7f4610107570 2024-09-19T05:09:56.941 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.327+0000 7f45f7fff640 1 -- 172.21.15.120:0/1591263385 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f460003cc80 con 0x7f4610107570 2024-09-19T05:09:56.941 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.387+0000 7f46151b2640 1 -- 172.21.15.120:0/1591263385 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f46101a09b0 con 0x7f4610107570 2024-09-19T05:09:56.942 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.387+0000 7f45f7fff640 1 -- 172.21.15.120:0/1591263385 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f460003da50 con 0x7f4610107570 2024-09-19T05:09:56.942 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.388+0000 7f46151b2640 1 -- 172.21.15.120:0/1591263385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4610107570 msgr2=0x7f461019cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:09:56.942 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.388+0000 7f46151b2640 1 --2- 172.21.15.120:0/1591263385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4610107570 0x7f461019cf50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f46000090b0 tx=0x7f46000046c0 comp rx=0 tx=0).stop 2024-09-19T05:09:56.942 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.388+0000 7f46151b2640 1 -- 172.21.15.120:0/1591263385 shutdown_connections 2024-09-19T05:09:56.942 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.388+0000 7f46151b2640 1 --2- 172.21.15.120:0/1591263385 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4610107570 0x7f461019cf50 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:09:56.942 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.388+0000 7f46151b2640 1 -- 172.21.15.120:0/1591263385 >> 172.21.15.120:0/1591263385 conn(0x7f4610102d20 msgr2=0x7f461007afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:09:56.942 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.388+0000 7f46151b2640 1 -- 172.21.15.120:0/1591263385 shutdown_connections 2024-09-19T05:09:56.942 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:56.388+0000 7f46151b2640 1 -- 172.21.15.120:0/1591263385 wait complete. 2024-09-19T05:09:56.942 INFO:teuthology.orchestra.run.smithi120.stdout:mon is available 2024-09-19T05:09:56.942 INFO:teuthology.orchestra.run.smithi120.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T05:09:57.951 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 2024-09-19T05:09:57.951 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T05:09:57.951 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout fsid = 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:09:57.951 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.120:3300,v1:172.21.15.120:6789] 2024-09-19T05:09:57.952 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T05:09:57.952 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T05:09:57.952 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T05:09:57.952 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T05:09:57.952 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 2024-09-19T05:09:57.952 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T05:09:57.952 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T05:09:57.952 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 2024-09-19T05:09:57.952 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T05:09:57.953 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T05:09:57.953 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T05:09:57.953 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T05:09:57.953 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T05:09:57.953 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T05:09:57.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.347+0000 7f923256b640 1 Processor -- start 2024-09-19T05:09:57.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.347+0000 7f923256b640 1 -- start start 2024-09-19T05:09:57.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.348+0000 7f923256b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f922c07de50 0x7f922c07c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:09:57.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.348+0000 7f923256b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f922c07c7f0 con 0x7f922c07de50 2024-09-19T05:09:57.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.348+0000 7f922bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f922c07de50 0x7f922c07c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:09:57.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.348+0000 7f922bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f922c07de50 0x7f922c07c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45456/0 (socket says 172.21.15.120:45456) 2024-09-19T05:09:57.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.348+0000 7f922bfff640 1 -- 172.21.15.120:0/1831035276 learned_addr learned my addr 172.21.15.120:0/1831035276 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:09:57.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.348+0000 7f922bfff640 1 -- 172.21.15.120:0/1831035276 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922c07c970 con 0x7f922c07de50 2024-09-19T05:09:57.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.349+0000 7f922bfff640 1 --2- 172.21.15.120:0/1831035276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f922c07de50 0x7f922c07c2b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f921c009820 tx=0x7f921c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d76743a89b7c35a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:09:57.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.349+0000 7f922affd640 1 -- 172.21.15.120:0/1831035276 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f921c037070 con 0x7f922c07de50 2024-09-19T05:09:57.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.349+0000 7f922affd640 1 -- 172.21.15.120:0/1831035276 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f921c032440 con 0x7f922c07de50 2024-09-19T05:09:57.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.349+0000 7f922affd640 1 -- 172.21.15.120:0/1831035276 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f921c032740 con 0x7f922c07de50 2024-09-19T05:09:57.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.349+0000 7f923256b640 1 -- 172.21.15.120:0/1831035276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f922c07de50 msgr2=0x7f922c07c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:09:57.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.349+0000 7f923256b640 1 --2- 172.21.15.120:0/1831035276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f922c07de50 0x7f922c07c2b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f921c009820 tx=0x7f921c02a270 comp rx=0 tx=0).stop 2024-09-19T05:09:57.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.350+0000 7f923256b640 1 -- 172.21.15.120:0/1831035276 shutdown_connections 2024-09-19T05:09:57.956 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.350+0000 7f923256b640 1 --2- 172.21.15.120:0/1831035276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f922c07de50 0x7f922c07c2b0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:09:57.956 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.350+0000 7f923256b640 1 -- 172.21.15.120:0/1831035276 >> 172.21.15.120:0/1831035276 conn(0x7f922c102d50 msgr2=0x7f922c105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:09:57.956 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.350+0000 7f923256b640 1 -- 172.21.15.120:0/1831035276 shutdown_connections 2024-09-19T05:09:57.956 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.350+0000 7f923256b640 1 -- 172.21.15.120:0/1831035276 wait complete. 2024-09-19T05:09:57.956 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.350+0000 7f923256b640 1 Processor -- start 2024-09-19T05:09:57.957 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.350+0000 7f923256b640 1 -- start start 2024-09-19T05:09:57.957 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.350+0000 7f923256b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f922c07de50 0x7f922c19cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:09:57.957 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.350+0000 7f923256b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f922c07cf10 con 0x7f922c07de50 2024-09-19T05:09:57.957 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.351+0000 7f922bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f922c07de50 0x7f922c19cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:09:57.957 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.351+0000 7f922bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f922c07de50 0x7f922c19cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45470/0 (socket says 172.21.15.120:45470) 2024-09-19T05:09:57.957 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.351+0000 7f922bfff640 1 -- 172.21.15.120:0/201814245 learned_addr learned my addr 172.21.15.120:0/201814245 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:09:57.957 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.351+0000 7f922bfff640 1 -- 172.21.15.120:0/201814245 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922c19d4b0 con 0x7f922c07de50 2024-09-19T05:09:57.957 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.351+0000 7f922bfff640 1 --2- 172.21.15.120:0/201814245 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f922c07de50 0x7f922c19cf70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f921c0090b0 tx=0x7f921c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:09:57.957 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.351+0000 7f92297fa640 1 -- 172.21.15.120:0/201814245 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f921c041070 con 0x7f922c07de50 2024-09-19T05:09:57.958 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.351+0000 7f92297fa640 1 -- 172.21.15.120:0/201814245 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f921c03c7a0 con 0x7f922c07de50 2024-09-19T05:09:57.958 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.351+0000 7f923256b640 1 -- 172.21.15.120:0/201814245 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f922c19d740 con 0x7f922c07de50 2024-09-19T05:09:57.958 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.351+0000 7f92297fa640 1 -- 172.21.15.120:0/201814245 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f921c037040 con 0x7f922c07de50 2024-09-19T05:09:57.958 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.351+0000 7f923256b640 1 -- 172.21.15.120:0/201814245 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f922c1a0430 con 0x7f922c07de50 2024-09-19T05:09:57.958 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.351+0000 7f92297fa640 1 -- 172.21.15.120:0/201814245 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f921c044070 con 0x7f922c07de50 2024-09-19T05:09:57.958 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.351+0000 7f92297fa640 1 -- 172.21.15.120:0/201814245 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f921c03d3f0 con 0x7f922c07de50 2024-09-19T05:09:57.958 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.352+0000 7f923256b640 1 -- 172.21.15.120:0/201814245 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f922c07c330 con 0x7f922c07de50 2024-09-19T05:09:57.958 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.354+0000 7f92297fa640 1 -- 172.21.15.120:0/201814245 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f921c046450 con 0x7f922c07de50 2024-09-19T05:09:57.958 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.411+0000 7f923256b640 1 -- 172.21.15.120:0/201814245 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f922c02d910 con 0x7f922c07de50 2024-09-19T05:09:57.959 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.413+0000 7f92297fa640 1 -- 172.21.15.120:0/201814245 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+431 (secure 0 0 0) 0x7f921c046630 con 0x7f922c07de50 2024-09-19T05:09:57.959 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.414+0000 7f92297fa640 1 -- 172.21.15.120:0/201814245 <== mon.0 v2:172.21.15.120:3300/0 8 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f921c056070 con 0x7f922c07de50 2024-09-19T05:09:57.959 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.414+0000 7f923256b640 1 -- 172.21.15.120:0/201814245 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f922c07de50 msgr2=0x7f922c19cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:09:57.959 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.414+0000 7f923256b640 1 --2- 172.21.15.120:0/201814245 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f922c07de50 0x7f922c19cf70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f921c0090b0 tx=0x7f921c0046c0 comp rx=0 tx=0).stop 2024-09-19T05:09:57.959 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.414+0000 7f923256b640 1 -- 172.21.15.120:0/201814245 shutdown_connections 2024-09-19T05:09:57.960 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.414+0000 7f923256b640 1 --2- 172.21.15.120:0/201814245 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f922c07de50 0x7f922c19cf70 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:09:57.960 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.414+0000 7f923256b640 1 -- 172.21.15.120:0/201814245 >> 172.21.15.120:0/201814245 conn(0x7f922c102d50 msgr2=0x7f922c103d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:09:57.960 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.414+0000 7f923256b640 1 -- 172.21.15.120:0/201814245 shutdown_connections 2024-09-19T05:09:57.960 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:57.414+0000 7f923256b640 1 -- 172.21.15.120:0/201814245 wait complete. 2024-09-19T05:09:57.960 INFO:teuthology.orchestra.run.smithi120.stdout:Generating new minimal ceph.conf... 2024-09-19T05:09:58.972 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.338+0000 7f139cbaa640 1 Processor -- start 2024-09-19T05:09:58.973 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.338+0000 7f139cbaa640 1 -- start start 2024-09-19T05:09:58.973 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.338+0000 7f139cbaa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13981064f0 0x7f13981068f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:09:58.973 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.338+0000 7f139cbaa640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1398106ec0 con 0x7f13981064f0 2024-09-19T05:09:58.973 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.338+0000 7f139659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13981064f0 0x7f13981068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:09:58.973 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.338+0000 7f139659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13981064f0 0x7f13981068f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45486/0 (socket says 172.21.15.120:45486) 2024-09-19T05:09:58.973 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.338+0000 7f139659c640 1 -- 172.21.15.120:0/1438697995 learned_addr learned my addr 172.21.15.120:0/1438697995 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:09:58.973 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.339+0000 7f139659c640 1 -- 172.21.15.120:0/1438697995 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13981076f0 con 0x7f13981064f0 2024-09-19T05:09:58.973 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.339+0000 7f139659c640 1 --2- 172.21.15.120:0/1438697995 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13981064f0 0x7f13981068f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1388009820 tx=0x7f138802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fbb0e78447c374f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:09:58.973 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.340+0000 7f139559a640 1 -- 172.21.15.120:0/1438697995 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1388037070 con 0x7f13981064f0 2024-09-19T05:09:58.973 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.340+0000 7f139559a640 1 -- 172.21.15.120:0/1438697995 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f13880328d0 con 0x7f13981064f0 2024-09-19T05:09:58.973 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.340+0000 7f139559a640 1 -- 172.21.15.120:0/1438697995 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13880307d0 con 0x7f13981064f0 2024-09-19T05:09:58.973 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.340+0000 7f139cbaa640 1 -- 172.21.15.120:0/1438697995 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13981064f0 msgr2=0x7f13981068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:09:58.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.340+0000 7f139cbaa640 1 --2- 172.21.15.120:0/1438697995 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13981064f0 0x7f13981068f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1388009820 tx=0x7f138802a270 comp rx=0 tx=0).stop 2024-09-19T05:09:58.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.340+0000 7f139cbaa640 1 -- 172.21.15.120:0/1438697995 shutdown_connections 2024-09-19T05:09:58.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.340+0000 7f139cbaa640 1 --2- 172.21.15.120:0/1438697995 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13981064f0 0x7f13981068f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:09:58.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.340+0000 7f139cbaa640 1 -- 172.21.15.120:0/1438697995 >> 172.21.15.120:0/1438697995 conn(0x7f1398101ca0 msgr2=0x7f13981040c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:09:58.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.340+0000 7f139cbaa640 1 -- 172.21.15.120:0/1438697995 shutdown_connections 2024-09-19T05:09:58.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.340+0000 7f139cbaa640 1 -- 172.21.15.120:0/1438697995 wait complete. 2024-09-19T05:09:58.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.341+0000 7f139cbaa640 1 Processor -- start 2024-09-19T05:09:58.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.341+0000 7f139cbaa640 1 -- start start 2024-09-19T05:09:58.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.341+0000 7f139cbaa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13981064f0 0x7f139819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:09:58.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.341+0000 7f139cbaa640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f139810aaa0 con 0x7f13981064f0 2024-09-19T05:09:58.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.341+0000 7f139659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13981064f0 0x7f139819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:09:58.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.341+0000 7f139659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13981064f0 0x7f139819a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45488/0 (socket says 172.21.15.120:45488) 2024-09-19T05:09:58.974 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.341+0000 7f139659c640 1 -- 172.21.15.120:0/494896447 learned_addr learned my addr 172.21.15.120:0/494896447 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:09:58.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.342+0000 7f139659c640 1 -- 172.21.15.120:0/494896447 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139819a9f0 con 0x7f13981064f0 2024-09-19T05:09:58.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.342+0000 7f139659c640 1 --2- 172.21.15.120:0/494896447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13981064f0 0x7f139819a4b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f13880097f0 tx=0x7f1388030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:09:58.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.342+0000 7f13877fe640 1 -- 172.21.15.120:0/494896447 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1388037040 con 0x7f13981064f0 2024-09-19T05:09:58.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.342+0000 7f13877fe640 1 -- 172.21.15.120:0/494896447 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f1388032bb0 con 0x7f13981064f0 2024-09-19T05:09:58.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.342+0000 7f139cbaa640 1 -- 172.21.15.120:0/494896447 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f139819ac80 con 0x7f13981064f0 2024-09-19T05:09:58.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.342+0000 7f13877fe640 1 -- 172.21.15.120:0/494896447 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f138803a390 con 0x7f13981064f0 2024-09-19T05:09:58.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.342+0000 7f139cbaa640 1 -- 172.21.15.120:0/494896447 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f139819d970 con 0x7f13981064f0 2024-09-19T05:09:58.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.342+0000 7f13877fe640 1 -- 172.21.15.120:0/494896447 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f138803a580 con 0x7f13981064f0 2024-09-19T05:09:58.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.342+0000 7f13877fe640 1 -- 172.21.15.120:0/494896447 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1388044b50 con 0x7f13981064f0 2024-09-19T05:09:58.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.343+0000 7f139cbaa640 1 -- 172.21.15.120:0/494896447 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f139810ac20 con 0x7f13981064f0 2024-09-19T05:09:58.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.345+0000 7f13877fe640 1 -- 172.21.15.120:0/494896447 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1388032d60 con 0x7f13981064f0 2024-09-19T05:09:58.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.402+0000 7f139cbaa640 1 -- 172.21.15.120:0/494896447 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f139819de50 con 0x7f13981064f0 2024-09-19T05:09:58.975 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.403+0000 7f13877fe640 1 -- 172.21.15.120:0/494896447 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+177 (secure 0 0 0) 0x7f138803aa00 con 0x7f13981064f0 2024-09-19T05:09:58.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.404+0000 7f139cbaa640 1 -- 172.21.15.120:0/494896447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13981064f0 msgr2=0x7f139819a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:09:58.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.404+0000 7f139cbaa640 1 --2- 172.21.15.120:0/494896447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13981064f0 0x7f139819a4b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f13880097f0 tx=0x7f1388030d00 comp rx=0 tx=0).stop 2024-09-19T05:09:58.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.404+0000 7f139cbaa640 1 -- 172.21.15.120:0/494896447 shutdown_connections 2024-09-19T05:09:58.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.404+0000 7f139cbaa640 1 --2- 172.21.15.120:0/494896447 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f13981064f0 0x7f139819a4b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:09:58.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.404+0000 7f139cbaa640 1 -- 172.21.15.120:0/494896447 >> 172.21.15.120:0/494896447 conn(0x7f1398101ca0 msgr2=0x7f13981027d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:09:58.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.404+0000 7f139cbaa640 1 -- 172.21.15.120:0/494896447 shutdown_connections 2024-09-19T05:09:58.976 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:09:58.404+0000 7f139cbaa640 1 -- 172.21.15.120:0/494896447 wait complete. 2024-09-19T05:09:58.976 INFO:teuthology.orchestra.run.smithi120.stdout:Restarting the monitor... 2024-09-19T05:09:59.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:09:58 smithi120 systemd[1]: Stopping Ceph mon.a for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:09:59.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:09:59 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-a[30580]: 2024-09-19T05:09:59.242+0000 7f471aae4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:09:59.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:09:59 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-a[30580]: 2024-09-19T05:09:59.242+0000 7f471aae4640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T05:09:59.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:09:59 smithi120 podman[30832]: 2024-09-19 05:09:59.386218594 +0000 UTC m=+0.255185969 container died 91014e8566db6c54ddfbe67cd7dc14f024f87402f1b0294ae155fbe3c17d525b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T05:09:59.965 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:09:59 smithi120 podman[30832]: 2024-09-19 05:09:59.709369318 +0000 UTC m=+0.578336696 container cleanup 91014e8566db6c54ddfbe67cd7dc14f024f87402f1b0294ae155fbe3c17d525b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:09:59.965 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:09:59 smithi120 bash[30832]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-a 2024-09-19T05:09:59.965 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:09:59 smithi120 podman[30843]: 2024-09-19 05:09:59.877224371 +0000 UTC m=+0.484663129 container remove 91014e8566db6c54ddfbe67cd7dc14f024f87402f1b0294ae155fbe3c17d525b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T05:10:00.287 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 systemd[1]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T05:10:00.287 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 systemd[1]: Stopped Ceph mon.a for 4e6e3df4-7645-11ef-bceb-c7b262605968. 2024-09-19T05:10:00.287 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 systemd[1]: Starting Ceph mon.a for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:10:00.564 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 podman[30937]: 2024-09-19 05:10:00.28622481 +0000 UTC m=+0.108332724 container create a28e9bf433a094a08ba46af8f257dd4bf8535ac96b4ce09600540fefa85ef061 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-a, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T05:10:00.565 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 podman[30937]: 2024-09-19 05:10:00.193605647 +0000 UTC m=+0.015713569 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:10:00.565 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 podman[30937]: 2024-09-19 05:10:00.480059696 +0000 UTC m=+0.302167618 container init a28e9bf433a094a08ba46af8f257dd4bf8535ac96b4ce09600540fefa85ef061 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T05:10:00.565 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 podman[30937]: 2024-09-19 05:10:00.483099037 +0000 UTC m=+0.305206951 container start a28e9bf433a094a08ba46af8f257dd4bf8535ac96b4ce09600540fefa85ef061 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True) 2024-09-19T05:10:00.565 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T05:10:00.565 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T05:10:00.565 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: pidfile_write: ignore empty --pid-file 2024-09-19T05:10:00.565 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: load: jerasure load: lrc 2024-09-19T05:10:00.565 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: RocksDB version: 7.9.2 2024-09-19T05:10:00.565 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Git sha 0 2024-09-19T05:10:00.566 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T05:10:00.566 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: DB SUMMARY 2024-09-19T05:10:00.566 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: DB Session ID: JNR5E0YODG3H9DQW84F3 2024-09-19T05:10:00.566 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: CURRENT file: CURRENT 2024-09-19T05:10:00.566 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T05:10:00.566 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T05:10:00.566 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T05:10:00.566 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105526 ; 2024-09-19T05:10:00.566 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.error_if_exists: 0 2024-09-19T05:10:00.568 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.create_if_missing: 0 2024-09-19T05:10:00.568 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.paranoid_checks: 1 2024-09-19T05:10:00.568 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T05:10:00.568 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T05:10:00.568 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T05:10:00.568 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.env: 0x557f2d4ea940 2024-09-19T05:10:00.568 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T05:10:00.568 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.info_log: 0x557f2f8096e0 2024-09-19T05:10:00.568 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T05:10:00.569 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.statistics: (nil) 2024-09-19T05:10:00.569 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.use_fsync: 0 2024-09-19T05:10:00.569 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_log_file_size: 0 2024-09-19T05:10:00.569 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T05:10:00.569 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T05:10:00.569 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T05:10:00.569 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T05:10:00.569 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.allow_fallocate: 1 2024-09-19T05:10:00.569 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T05:10:00.569 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T05:10:00.569 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.use_direct_reads: 0 2024-09-19T05:10:00.570 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T05:10:00.570 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T05:10:00.570 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.db_log_dir: 2024-09-19T05:10:00.570 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.wal_dir: 2024-09-19T05:10:00.570 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T05:10:00.570 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T05:10:00.570 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T05:10:00.570 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T05:10:00.570 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T05:10:00.570 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T05:10:00.570 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T05:10:00.570 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T05:10:00.570 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.write_buffer_manager: 0x557f2f818dc0 2024-09-19T05:10:00.571 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T05:10:00.571 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T05:10:00.571 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T05:10:00.571 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T05:10:00.571 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T05:10:00.571 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T05:10:00.571 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T05:10:00.571 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T05:10:00.571 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.unordered_write: 0 2024-09-19T05:10:00.572 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T05:10:00.572 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T05:10:00.572 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T05:10:00.572 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T05:10:00.572 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.row_cache: None 2024-09-19T05:10:00.572 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.wal_filter: None 2024-09-19T05:10:00.572 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T05:10:00.572 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T05:10:00.572 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.two_write_queues: 0 2024-09-19T05:10:00.572 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T05:10:00.572 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.wal_compression: 0 2024-09-19T05:10:00.573 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.atomic_flush: 0 2024-09-19T05:10:00.573 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T05:10:00.573 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T05:10:00.573 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T05:10:00.573 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.log_readahead_size: 0 2024-09-19T05:10:00.573 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T05:10:00.573 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T05:10:00.573 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T05:10:00.573 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T05:10:00.573 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T05:10:00.573 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T05:10:00.573 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T05:10:00.574 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_background_jobs: 2 2024-09-19T05:10:00.574 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_background_compactions: -1 2024-09-19T05:10:00.574 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_subcompactions: 1 2024-09-19T05:10:00.574 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T05:10:00.574 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T05:10:00.574 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T05:10:00.574 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T05:10:00.574 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T05:10:00.574 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T05:10:00.574 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T05:10:00.574 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T05:10:00.574 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_open_files: -1 2024-09-19T05:10:00.575 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T05:10:00.575 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T05:10:00.575 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T05:10:00.575 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T05:10:00.575 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_background_flushes: -1 2024-09-19T05:10:00.575 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Compression algorithms supported: 2024-09-19T05:10:00.575 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: kZSTD supported: 0 2024-09-19T05:10:00.575 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: kXpressCompression supported: 0 2024-09-19T05:10:00.575 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: kBZip2Compression supported: 0 2024-09-19T05:10:00.576 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T05:10:00.576 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: kLZ4Compression supported: 1 2024-09-19T05:10:00.576 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: kZlibCompression supported: 1 2024-09-19T05:10:00.576 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T05:10:00.576 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: kSnappyCompression supported: 1 2024-09-19T05:10:00.576 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T05:10:00.576 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T05:10:00.576 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T05:10:00.576 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T05:10:00.577 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T05:10:00.577 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.merge_operator: 2024-09-19T05:10:00.577 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.compaction_filter: None 2024-09-19T05:10:00.577 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T05:10:00.577 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T05:10:00.577 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T05:10:00.577 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T05:10:00.577 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557f2f809320) 2024-09-19T05:10:00.577 INFO:journalctl@ceph.mon.a.smithi120.stdout: cache_index_and_filter_blocks: 1 2024-09-19T05:10:00.577 INFO:journalctl@ceph.mon.a.smithi120.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T05:10:00.577 INFO:journalctl@ceph.mon.a.smithi120.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T05:10:00.578 INFO:journalctl@ceph.mon.a.smithi120.stdout: pin_top_level_index_and_filter: 1 2024-09-19T05:10:00.578 INFO:journalctl@ceph.mon.a.smithi120.stdout: index_type: 0 2024-09-19T05:10:00.578 INFO:journalctl@ceph.mon.a.smithi120.stdout: data_block_index_type: 0 2024-09-19T05:10:00.578 INFO:journalctl@ceph.mon.a.smithi120.stdout: index_shortening: 1 2024-09-19T05:10:00.578 INFO:journalctl@ceph.mon.a.smithi120.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T05:10:00.578 INFO:journalctl@ceph.mon.a.smithi120.stdout: checksum: 4 2024-09-19T05:10:00.579 INFO:journalctl@ceph.mon.a.smithi120.stdout: no_block_cache: 0 2024-09-19T05:10:00.579 INFO:journalctl@ceph.mon.a.smithi120.stdout: block_cache: 0x557f2f7fd1f0 2024-09-19T05:10:00.579 INFO:journalctl@ceph.mon.a.smithi120.stdout: block_cache_name: BinnedLRUCache 2024-09-19T05:10:00.579 INFO:journalctl@ceph.mon.a.smithi120.stdout: block_cache_options: 2024-09-19T05:10:00.579 INFO:journalctl@ceph.mon.a.smithi120.stdout: capacity : 536870912 2024-09-19T05:10:00.580 INFO:journalctl@ceph.mon.a.smithi120.stdout: num_shard_bits : 4 2024-09-19T05:10:00.580 INFO:journalctl@ceph.mon.a.smithi120.stdout: strict_capacity_limit : 0 2024-09-19T05:10:00.580 INFO:journalctl@ceph.mon.a.smithi120.stdout: high_pri_pool_ratio: 0.000 2024-09-19T05:10:00.580 INFO:journalctl@ceph.mon.a.smithi120.stdout: block_cache_compressed: (nil) 2024-09-19T05:10:00.580 INFO:journalctl@ceph.mon.a.smithi120.stdout: persistent_cache: (nil) 2024-09-19T05:10:00.581 INFO:journalctl@ceph.mon.a.smithi120.stdout: block_size: 4096 2024-09-19T05:10:00.581 INFO:journalctl@ceph.mon.a.smithi120.stdout: block_size_deviation: 10 2024-09-19T05:10:00.581 INFO:journalctl@ceph.mon.a.smithi120.stdout: block_restart_interval: 16 2024-09-19T05:10:00.581 INFO:journalctl@ceph.mon.a.smithi120.stdout: index_block_restart_interval: 1 2024-09-19T05:10:00.581 INFO:journalctl@ceph.mon.a.smithi120.stdout: metadata_block_size: 4096 2024-09-19T05:10:00.581 INFO:journalctl@ceph.mon.a.smithi120.stdout: partition_filters: 0 2024-09-19T05:10:00.581 INFO:journalctl@ceph.mon.a.smithi120.stdout: use_delta_encoding: 1 2024-09-19T05:10:00.582 INFO:journalctl@ceph.mon.a.smithi120.stdout: filter_policy: bloomfilter 2024-09-19T05:10:00.582 INFO:journalctl@ceph.mon.a.smithi120.stdout: whole_key_filtering: 1 2024-09-19T05:10:00.582 INFO:journalctl@ceph.mon.a.smithi120.stdout: verify_compression: 0 2024-09-19T05:10:00.582 INFO:journalctl@ceph.mon.a.smithi120.stdout: read_amp_bytes_per_bit: 0 2024-09-19T05:10:00.582 INFO:journalctl@ceph.mon.a.smithi120.stdout: format_version: 5 2024-09-19T05:10:00.582 INFO:journalctl@ceph.mon.a.smithi120.stdout: enable_index_compression: 1 2024-09-19T05:10:00.582 INFO:journalctl@ceph.mon.a.smithi120.stdout: block_align: 0 2024-09-19T05:10:00.582 INFO:journalctl@ceph.mon.a.smithi120.stdout: max_auto_readahead_size: 262144 2024-09-19T05:10:00.582 INFO:journalctl@ceph.mon.a.smithi120.stdout: prepopulate_block_cache: 0 2024-09-19T05:10:00.582 INFO:journalctl@ceph.mon.a.smithi120.stdout: initial_auto_readahead_size: 8192 2024-09-19T05:10:00.582 INFO:journalctl@ceph.mon.a.smithi120.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T05:10:00.583 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T05:10:00.583 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T05:10:00.583 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.compression: NoCompression 2024-09-19T05:10:00.583 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T05:10:00.583 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T05:10:00.583 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T05:10:00.583 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.num_levels: 7 2024-09-19T05:10:00.583 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T05:10:00.583 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T05:10:00.584 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T05:10:00.584 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T05:10:00.584 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T05:10:00.584 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T05:10:00.584 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T05:10:00.584 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T05:10:00.584 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T05:10:00.584 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T05:10:00.584 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T05:10:00.585 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T05:10:00.585 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T05:10:00.585 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T05:10:00.585 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T05:10:00.585 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T05:10:00.585 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T05:10:00.585 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T05:10:00.585 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T05:10:00.586 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T05:10:00.586 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T05:10:00.586 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T05:10:00.586 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T05:10:00.586 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T05:10:00.586 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T05:10:00.586 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T05:10:00.586 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T05:10:00.586 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T05:10:00.586 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T05:10:00.587 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T05:10:00.587 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T05:10:00.587 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T05:10:00.587 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T05:10:00.587 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T05:10:00.587 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T05:10:00.588 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T05:10:00.588 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T05:10:00.588 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T05:10:00.588 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T05:10:00.588 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T05:10:00.588 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T05:10:00.588 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T05:10:00.588 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T05:10:00.588 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T05:10:00.588 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T05:10:00.589 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T05:10:00.589 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T05:10:00.589 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T05:10:00.589 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T05:10:00.589 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T05:10:00.589 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T05:10:00.589 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T05:10:00.589 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T05:10:00.589 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T05:10:00.589 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.inplace_update_support: 0 2024-09-19T05:10:00.589 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T05:10:00.589 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T05:10:00.590 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T05:10:00.590 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T05:10:00.590 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.bloom_locality: 0 2024-09-19T05:10:00.590 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.max_successive_merges: 0 2024-09-19T05:10:00.590 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T05:10:00.590 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T05:10:00.590 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T05:10:00.590 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T05:10:00.590 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.ttl: 2592000 2024-09-19T05:10:00.590 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T05:10:00.590 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T05:10:00.590 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T05:10:00.591 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.enable_blob_files: false 2024-09-19T05:10:00.591 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.min_blob_size: 0 2024-09-19T05:10:00.591 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T05:10:00.591 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T05:10:00.591 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T05:10:00.591 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T05:10:00.591 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T05:10:00.591 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T05:10:00.591 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T05:10:00.591 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T05:10:00.591 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T05:10:00.592 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T05:10:00.592 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 59e7b090-1454-417a-87f5-e46cb2d4f533 2024-09-19T05:10:00.592 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726722600508909, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T05:10:00.592 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T05:10:00.592 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726722600509915, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100520, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 330, "table_properties": {"data_size": 98414, "index_size": 298, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14373, "raw_average_key_size": 49, "raw_value_size": 90678, "raw_average_value_size": 313, "num_data_blocks": 12, "num_entries": 289, "num_filter_entries": 289, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726722600, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "59e7b090-1454-417a-87f5-e46cb2d4f533", "db_session_id": "JNR5E0YODG3H9DQW84F3", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T05:10:00.592 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726722600510016, "job": 1, "event": "recovery_finished"} 2024-09-19T05:10:00.592 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T05:10:00.592 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T05:10:00.593 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557f2f82ae00 2024-09-19T05:10:00.593 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: DB pointer 0x557f2f926000 2024-09-19T05:10:00.593 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T05:10:00.593 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T05:10:00.593 INFO:journalctl@ceph.mon.a.smithi120.stdout: ** DB Stats ** 2024-09-19T05:10:00.593 INFO:journalctl@ceph.mon.a.smithi120.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T05:10:00.593 INFO:journalctl@ceph.mon.a.smithi120.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T05:10:00.594 INFO:journalctl@ceph.mon.a.smithi120.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T05:10:00.594 INFO:journalctl@ceph.mon.a.smithi120.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T05:10:00.594 INFO:journalctl@ceph.mon.a.smithi120.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T05:10:00.594 INFO:journalctl@ceph.mon.a.smithi120.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T05:10:00.594 INFO:journalctl@ceph.mon.a.smithi120.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T05:10:00.595 INFO:journalctl@ceph.mon.a.smithi120.stdout: 2024-09-19T05:10:00.595 INFO:journalctl@ceph.mon.a.smithi120.stdout: ** Compaction Stats [default] ** 2024-09-19T05:10:00.595 INFO:journalctl@ceph.mon.a.smithi120.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T05:10:00.595 INFO:journalctl@ceph.mon.a.smithi120.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T05:10:00.595 INFO:journalctl@ceph.mon.a.smithi120.stdout: L0 2/0 100.02 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T05:10:00.595 INFO:journalctl@ceph.mon.a.smithi120.stdout: Sum 2/0 100.02 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T05:10:00.595 INFO:journalctl@ceph.mon.a.smithi120.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 150.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T05:10:00.595 INFO:journalctl@ceph.mon.a.smithi120.stdout: 2024-09-19T05:10:00.595 INFO:journalctl@ceph.mon.a.smithi120.stdout: ** Compaction Stats [default] ** 2024-09-19T05:10:00.595 INFO:journalctl@ceph.mon.a.smithi120.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T05:10:00.595 INFO:journalctl@ceph.mon.a.smithi120.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T05:10:00.596 INFO:journalctl@ceph.mon.a.smithi120.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 150.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T05:10:00.596 INFO:journalctl@ceph.mon.a.smithi120.stdout: 2024-09-19T05:10:00.596 INFO:journalctl@ceph.mon.a.smithi120.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T05:10:00.596 INFO:journalctl@ceph.mon.a.smithi120.stdout: 2024-09-19T05:10:00.596 INFO:journalctl@ceph.mon.a.smithi120.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T05:10:00.596 INFO:journalctl@ceph.mon.a.smithi120.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T05:10:00.596 INFO:journalctl@ceph.mon.a.smithi120.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T05:10:00.596 INFO:journalctl@ceph.mon.a.smithi120.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T05:10:00.596 INFO:journalctl@ceph.mon.a.smithi120.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T05:10:00.596 INFO:journalctl@ceph.mon.a.smithi120.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T05:10:00.596 INFO:journalctl@ceph.mon.a.smithi120.stdout: Cumulative compaction: 0.00 GB write, 31.18 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T05:10:00.597 INFO:journalctl@ceph.mon.a.smithi120.stdout: Interval compaction: 0.00 GB write, 31.18 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T05:10:00.597 INFO:journalctl@ceph.mon.a.smithi120.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T05:10:00.597 INFO:journalctl@ceph.mon.a.smithi120.stdout: Block cache BinnedLRUCache@0x557f2f7fd1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-19T05:10:00.597 INFO:journalctl@ceph.mon.a.smithi120.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-19T05:10:00.597 INFO:journalctl@ceph.mon.a.smithi120.stdout: 2024-09-19T05:10:00.597 INFO:journalctl@ceph.mon.a.smithi120.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T05:10:00.597 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: starting mon.a rank 0 at public addrs [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] at bind addrs [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:10:00.597 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: mon.a@-1(???) e1 preinit fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:10:00.598 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: mon.a@-1(???).mds e1 new map 2024-09-19T05:10:00.598 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: mon.a@-1(???).mds e1 print_map 2024-09-19T05:10:00.598 INFO:journalctl@ceph.mon.a.smithi120.stdout: e1 2024-09-19T05:10:00.598 INFO:journalctl@ceph.mon.a.smithi120.stdout: btime 2024-09-19T05:09:55:846992+0000 2024-09-19T05:10:00.598 INFO:journalctl@ceph.mon.a.smithi120.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T05:10:00.598 INFO:journalctl@ceph.mon.a.smithi120.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T05:10:00.598 INFO:journalctl@ceph.mon.a.smithi120.stdout: legacy client fscid: -1 2024-09-19T05:10:00.598 INFO:journalctl@ceph.mon.a.smithi120.stdout: 2024-09-19T05:10:00.598 INFO:journalctl@ceph.mon.a.smithi120.stdout: No filesystems configured 2024-09-19T05:10:00.598 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T05:10:00.599 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:10:00.599 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:10:00.599 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:10:00.599 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T05:10:00.599 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 bash[30937]: a28e9bf433a094a08ba46af8f257dd4bf8535ac96b4ce09600540fefa85ef061 2024-09-19T05:10:00.599 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 systemd[1]: Started Ceph mon.a for 4e6e3df4-7645-11ef-bceb-c7b262605968. 2024-09-19T05:10:00.600 INFO:teuthology.orchestra.run.smithi120.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T05:10:00.850 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T05:10:00.850 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: monmap epoch 1 2024-09-19T05:10:00.850 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:10:00.850 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: last_changed 2024-09-19T05:09:53.071491+0000 2024-09-19T05:10:00.850 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: created 2024-09-19T05:09:53.071491+0000 2024-09-19T05:10:00.850 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: min_mon_release 19 (squid) 2024-09-19T05:10:00.850 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: election_strategy: 1 2024-09-19T05:10:00.851 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: 0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T05:10:00.851 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: fsmap 2024-09-19T05:10:00.851 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T05:10:00.851 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:00 smithi120 ceph-mon[30956]: mgrmap e1: no daemons active 2024-09-19T05:10:01.589 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.929+0000 7f106e190640 1 Processor -- start 2024-09-19T05:10:01.594 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.929+0000 7f106e190640 1 -- start start 2024-09-19T05:10:01.594 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.929+0000 7f106e190640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f106807de90 0x7f106807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:01.594 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.929+0000 7f106e190640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f106807c8c0 con 0x7f106807de90 2024-09-19T05:10:01.594 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.930+0000 7f10677fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f106807de90 0x7f106807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:01.594 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.930+0000 7f10677fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f106807de90 0x7f106807c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45504/0 (socket says 172.21.15.120:45504) 2024-09-19T05:10:01.594 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.930+0000 7f10677fe640 1 -- 172.21.15.120:0/3734121569 learned_addr learned my addr 172.21.15.120:0/3734121569 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:01.594 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.930+0000 7f10677fe640 1 -- 172.21.15.120:0/3734121569 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f106807ca40 con 0x7f106807de90 2024-09-19T05:10:01.595 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.932+0000 7f10677fe640 1 --2- 172.21.15.120:0/3734121569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f106807de90 0x7f106807c2f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1058009820 tx=0x7f105802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1390c6cb3d93ef0c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:01.595 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.932+0000 7f10667fc640 1 -- 172.21.15.120:0/3734121569 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1058037070 con 0x7f106807de90 2024-09-19T05:10:01.595 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.932+0000 7f10667fc640 1 -- 172.21.15.120:0/3734121569 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f10580328d0 con 0x7f106807de90 2024-09-19T05:10:01.595 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.932+0000 7f10667fc640 1 -- 172.21.15.120:0/3734121569 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10580307d0 con 0x7f106807de90 2024-09-19T05:10:01.595 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.933+0000 7f106e190640 1 -- 172.21.15.120:0/3734121569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f106807de90 msgr2=0x7f106807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:01.595 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.933+0000 7f106e190640 1 --2- 172.21.15.120:0/3734121569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f106807de90 0x7f106807c2f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1058009820 tx=0x7f105802a270 comp rx=0 tx=0).stop 2024-09-19T05:10:01.595 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.933+0000 7f106e190640 1 -- 172.21.15.120:0/3734121569 shutdown_connections 2024-09-19T05:10:01.595 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.933+0000 7f106e190640 1 --2- 172.21.15.120:0/3734121569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f106807de90 0x7f106807c2f0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:01.595 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.933+0000 7f106e190640 1 -- 172.21.15.120:0/3734121569 >> 172.21.15.120:0/3734121569 conn(0x7f1068102d50 msgr2=0x7f1068105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:01.595 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.933+0000 7f106e190640 1 -- 172.21.15.120:0/3734121569 shutdown_connections 2024-09-19T05:10:01.595 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.933+0000 7f106e190640 1 -- 172.21.15.120:0/3734121569 wait complete. 2024-09-19T05:10:01.595 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.933+0000 7f106e190640 1 Processor -- start 2024-09-19T05:10:01.595 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.934+0000 7f106e190640 1 -- start start 2024-09-19T05:10:01.596 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.934+0000 7f106e190640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f106807de90 0x7f106819d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:01.596 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.934+0000 7f106e190640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f106810dbd0 con 0x7f106807de90 2024-09-19T05:10:01.596 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.934+0000 7f10677fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f106807de90 0x7f106819d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:01.596 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.934+0000 7f10677fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f106807de90 0x7f106819d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45514/0 (socket says 172.21.15.120:45514) 2024-09-19T05:10:01.596 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.934+0000 7f10677fe640 1 -- 172.21.15.120:0/1606219354 learned_addr learned my addr 172.21.15.120:0/1606219354 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:01.596 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.934+0000 7f10677fe640 1 -- 172.21.15.120:0/1606219354 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f106819dd00 con 0x7f106807de90 2024-09-19T05:10:01.596 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.934+0000 7f10677fe640 1 --2- 172.21.15.120:0/1606219354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f106807de90 0x7f106819d7c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1058030520 tx=0x7f1058032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:01.596 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.934+0000 7f1064ff9640 1 -- 172.21.15.120:0/1606219354 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1058042070 con 0x7f106807de90 2024-09-19T05:10:01.596 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.935+0000 7f1064ff9640 1 -- 172.21.15.120:0/1606219354 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f1058030cc0 con 0x7f106807de90 2024-09-19T05:10:01.596 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.935+0000 7f106e190640 1 -- 172.21.15.120:0/1606219354 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f106819df90 con 0x7f106807de90 2024-09-19T05:10:01.596 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.935+0000 7f1064ff9640 1 -- 172.21.15.120:0/1606219354 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1058037040 con 0x7f106807de90 2024-09-19T05:10:01.596 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.935+0000 7f106e190640 1 -- 172.21.15.120:0/1606219354 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10681a0c80 con 0x7f106807de90 2024-09-19T05:10:01.596 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.935+0000 7f1064ff9640 1 -- 172.21.15.120:0/1606219354 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1058045070 con 0x7f106807de90 2024-09-19T05:10:01.597 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.935+0000 7f1064ff9640 1 -- 172.21.15.120:0/1606219354 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1058047da0 con 0x7f106807de90 2024-09-19T05:10:01.597 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.936+0000 7f106e190640 1 -- 172.21.15.120:0/1606219354 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f106807c370 con 0x7f106807de90 2024-09-19T05:10:01.597 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.938+0000 7f1064ff9640 1 -- 172.21.15.120:0/1606219354 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1058047440 con 0x7f106807de90 2024-09-19T05:10:01.597 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.994+0000 7f106e190640 1 -- 172.21.15.120:0/1606219354 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f10681a0e50 con 0x7f106807de90 2024-09-19T05:10:01.597 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.997+0000 7f1064ff9640 1 -- 172.21.15.120:0/1606219354 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f105803c750 con 0x7f106807de90 2024-09-19T05:10:01.597 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.997+0000 7f106e190640 1 -- 172.21.15.120:0/1606219354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f106807de90 msgr2=0x7f106819d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:01.597 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.997+0000 7f106e190640 1 --2- 172.21.15.120:0/1606219354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f106807de90 0x7f106819d7c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1058030520 tx=0x7f1058032dd0 comp rx=0 tx=0).stop 2024-09-19T05:10:01.597 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.998+0000 7f106e190640 1 -- 172.21.15.120:0/1606219354 shutdown_connections 2024-09-19T05:10:01.597 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.998+0000 7f106e190640 1 --2- 172.21.15.120:0/1606219354 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f106807de90 0x7f106819d7c0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:01.597 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.998+0000 7f106e190640 1 -- 172.21.15.120:0/1606219354 >> 172.21.15.120:0/1606219354 conn(0x7f1068102d50 msgr2=0x7f1068103910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:01.597 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.998+0000 7f106e190640 1 -- 172.21.15.120:0/1606219354 shutdown_connections 2024-09-19T05:10:01.597 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:00.998+0000 7f106e190640 1 -- 172.21.15.120:0/1606219354 wait complete. 2024-09-19T05:10:01.597 INFO:teuthology.orchestra.run.smithi120.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T05:10:01.620 INFO:teuthology.orchestra.run.smithi120.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:10:01.620 INFO:teuthology.orchestra.run.smithi120.stdout:Creating mgr... 2024-09-19T05:10:01.620 INFO:teuthology.orchestra.run.smithi120.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T05:10:01.621 INFO:teuthology.orchestra.run.smithi120.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T05:10:01.873 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mgr.x 2024-09-19T05:10:01.873 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T05:10:02.018 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4e6e3df4-7645-11ef-bceb-c7b262605968.target.wants/ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@.service. 2024-09-19T05:10:02.248 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:01 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1606219354' entity='client.admin' 2024-09-19T05:10:02.249 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:02 smithi120 systemd[1]: Starting Ceph mgr.x for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:10:02.542 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:02 smithi120 podman[31169]: 2024-09-19 05:10:02.247579142 +0000 UTC m=+0.107875090 container create 63d3454a719e2966570606779b94a1342dd950e697a4fb854684cf24c0ffa63c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T05:10:02.542 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:02 smithi120 podman[31169]: 2024-09-19 05:10:02.155315393 +0000 UTC m=+0.015611298 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T05:10:02.542 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:02 smithi120 podman[31169]: 2024-09-19 05:10:02.457903448 +0000 UTC m=+0.318199358 container init 63d3454a719e2966570606779b94a1342dd950e697a4fb854684cf24c0ffa63c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T05:10:02.542 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:02 smithi120 podman[31169]: 2024-09-19 05:10:02.460646394 +0000 UTC m=+0.320942300 container start 63d3454a719e2966570606779b94a1342dd950e697a4fb854684cf24c0ffa63c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T05:10:02.542 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:02 smithi120 bash[31169]: 63d3454a719e2966570606779b94a1342dd950e697a4fb854684cf24c0ffa63c 2024-09-19T05:10:02.556 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T05:10:02.556 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout disabled 2024-09-19T05:10:02.564 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T05:10:02.564 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout inactive 2024-09-19T05:10:02.564 INFO:teuthology.orchestra.run.smithi120.stdout:firewalld.service is not enabled 2024-09-19T05:10:02.564 INFO:teuthology.orchestra.run.smithi120.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T05:10:02.572 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T05:10:02.572 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout disabled 2024-09-19T05:10:02.580 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T05:10:02.580 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout inactive 2024-09-19T05:10:02.580 INFO:teuthology.orchestra.run.smithi120.stdout:firewalld.service is not enabled 2024-09-19T05:10:02.580 INFO:teuthology.orchestra.run.smithi120.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T05:10:02.580 INFO:teuthology.orchestra.run.smithi120.stdout:Waiting for mgr to start... 2024-09-19T05:10:02.580 INFO:teuthology.orchestra.run.smithi120.stdout:Waiting for mgr... 2024-09-19T05:10:02.792 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:02 smithi120 systemd[1]: Started Ceph mgr.x for 4e6e3df4-7645-11ef-bceb-c7b262605968. 2024-09-19T05:10:02.792 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:02 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:02.581+0000 7f3ba6b3b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T05:10:02.792 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:02 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:02.641+0000 7f3ba6b3b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:10:02.792 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:02 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:02.790+0000 7f3ba6b3b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:10:03.068 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:02 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:02.860+0000 7f3ba6b3b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:10:03.068 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:03 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:03.015+0000 7f3ba6b3b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:10:03.364 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:03 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/4263223659' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T05:10:03.365 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:03 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:03.168+0000 7f3ba6b3b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:10:03.625 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:03 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:03.488+0000 7f3ba6b3b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:10:03.625 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:03 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:03.548+0000 7f3ba6b3b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:10:03.670 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 2024-09-19T05:10:03.671 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:10:03.671 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "fsid": "4e6e3df4-7645-11ef-bceb-c7b262605968", 2024-09-19T05:10:03.671 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T05:10:03.671 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T05:10:03.671 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T05:10:03.671 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T05:10:03.671 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:10:03.671 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T05:10:03.671 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T05:10:03.671 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 0 2024-09-19T05:10:03.671 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:10:03.672 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T05:10:03.672 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T05:10:03.672 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:10:03.672 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-19T05:10:03.672 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T05:10:03.672 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:10:03.672 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T05:10:03.672 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T05:10:03.672 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:10:03.672 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T05:10:03.672 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:10:03.672 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T05:10:03.672 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T05:10:03.673 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T05:10:03.673 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T05:10:03.673 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T05:10:03.673 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T05:10:03.673 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:10:03.673 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T05:10:03.673 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T05:10:03.673 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T05:10:03.673 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T05:10:03.673 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T05:10:03.673 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T05:10:03.673 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T05:10:03.673 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T05:10:03.673 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T05:10:03.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:10:03.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T05:10:03.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:10:03.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T05:09:55:846992+0000", 2024-09-19T05:10:03.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T05:10:03.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T05:10:03.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:10:03.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T05:10:03.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T05:10:03.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T05:10:03.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T05:10:03.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T05:10:03.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T05:10:03.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T05:10:03.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:10:03.675 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T05:10:03.675 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:10:03.675 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T05:10:03.675 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:10:03.675 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T05:09:55.847706+0000", 2024-09-19T05:10:03.675 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T05:10:03.675 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:10:03.675 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T05:10:03.675 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:10:03.675 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:02.997+0000 7f5059b47640 1 Processor -- start 2024-09-19T05:10:03.675 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:02.997+0000 7f5059b47640 1 -- start start 2024-09-19T05:10:03.675 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:02.998+0000 7f5059b47640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5054107fe0 0x7f505410a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:03.675 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:02.998+0000 7f5059b47640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5054063510 con 0x7f5054107fe0 2024-09-19T05:10:03.676 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:02.998+0000 7f50537fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5054107fe0 0x7f505410a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:03.676 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:02.998+0000 7f50537fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5054107fe0 0x7f505410a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45546/0 (socket says 172.21.15.120:45546) 2024-09-19T05:10:03.676 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:02.998+0000 7f50537fe640 1 -- 172.21.15.120:0/2741989531 learned_addr learned my addr 172.21.15.120:0/2741989531 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:03.676 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:02.998+0000 7f50537fe640 1 -- 172.21.15.120:0/2741989531 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505410a910 con 0x7f5054107fe0 2024-09-19T05:10:03.676 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:02.999+0000 7f50537fe640 1 --2- 172.21.15.120:0/2741989531 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5054107fe0 0x7f505410a3d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5044009820 tx=0x7f504402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19bbf1c29d0d565 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:03.676 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:02.999+0000 7f50527fc640 1 -- 172.21.15.120:0/2741989531 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5044037070 con 0x7f5054107fe0 2024-09-19T05:10:03.676 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:02.999+0000 7f50527fc640 1 -- 172.21.15.120:0/2741989531 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f50440328d0 con 0x7f5054107fe0 2024-09-19T05:10:03.676 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:02.999+0000 7f50527fc640 1 -- 172.21.15.120:0/2741989531 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50440307d0 con 0x7f5054107fe0 2024-09-19T05:10:03.676 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.000+0000 7f5059b47640 1 -- 172.21.15.120:0/2741989531 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5054107fe0 msgr2=0x7f505410a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:03.676 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.000+0000 7f5059b47640 1 --2- 172.21.15.120:0/2741989531 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5054107fe0 0x7f505410a3d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5044009820 tx=0x7f504402a270 comp rx=0 tx=0).stop 2024-09-19T05:10:03.676 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.000+0000 7f5059b47640 1 -- 172.21.15.120:0/2741989531 shutdown_connections 2024-09-19T05:10:03.676 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.000+0000 7f5059b47640 1 --2- 172.21.15.120:0/2741989531 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5054107fe0 0x7f505410a3d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:03.676 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.000+0000 7f5059b47640 1 -- 172.21.15.120:0/2741989531 >> 172.21.15.120:0/2741989531 conn(0x7f5054101c00 msgr2=0x7f5054104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:03.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.000+0000 7f5059b47640 1 -- 172.21.15.120:0/2741989531 shutdown_connections 2024-09-19T05:10:03.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.000+0000 7f5059b47640 1 -- 172.21.15.120:0/2741989531 wait complete. 2024-09-19T05:10:03.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.001+0000 7f5059b47640 1 Processor -- start 2024-09-19T05:10:03.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.001+0000 7f5059b47640 1 -- start start 2024-09-19T05:10:03.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.001+0000 7f5059b47640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5054107fe0 0x7f505419b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:03.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.001+0000 7f5059b47640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f505410b950 con 0x7f5054107fe0 2024-09-19T05:10:03.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.001+0000 7f50537fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5054107fe0 0x7f505419b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:03.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.001+0000 7f50537fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5054107fe0 0x7f505419b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45550/0 (socket says 172.21.15.120:45550) 2024-09-19T05:10:03.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.001+0000 7f50537fe640 1 -- 172.21.15.120:0/4263223659 learned_addr learned my addr 172.21.15.120:0/4263223659 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:03.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.002+0000 7f50537fe640 1 -- 172.21.15.120:0/4263223659 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505419ba90 con 0x7f5054107fe0 2024-09-19T05:10:03.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.002+0000 7f50537fe640 1 --2- 172.21.15.120:0/4263223659 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5054107fe0 0x7f505419b550 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f50440097f0 tx=0x7f5044030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:03.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.002+0000 7f5050ff9640 1 -- 172.21.15.120:0/4263223659 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5044037040 con 0x7f5054107fe0 2024-09-19T05:10:03.677 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.002+0000 7f5050ff9640 1 -- 172.21.15.120:0/4263223659 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f5044032bb0 con 0x7f5054107fe0 2024-09-19T05:10:03.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.002+0000 7f5059b47640 1 -- 172.21.15.120:0/4263223659 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f505419bd20 con 0x7f5054107fe0 2024-09-19T05:10:03.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.002+0000 7f5050ff9640 1 -- 172.21.15.120:0/4263223659 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f504403a390 con 0x7f5054107fe0 2024-09-19T05:10:03.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.002+0000 7f5059b47640 1 -- 172.21.15.120:0/4263223659 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f505419ea10 con 0x7f5054107fe0 2024-09-19T05:10:03.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.002+0000 7f5050ff9640 1 -- 172.21.15.120:0/4263223659 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f504403a5d0 con 0x7f5054107fe0 2024-09-19T05:10:03.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.002+0000 7f5050ff9640 1 -- 172.21.15.120:0/4263223659 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5044044bf0 con 0x7f5054107fe0 2024-09-19T05:10:03.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.003+0000 7f5059b47640 1 -- 172.21.15.120:0/4263223659 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5054108440 con 0x7f5054107fe0 2024-09-19T05:10:03.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.005+0000 7f5050ff9640 1 -- 172.21.15.120:0/4263223659 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5044044400 con 0x7f5054107fe0 2024-09-19T05:10:03.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.066+0000 7f5059b47640 1 -- 172.21.15.120:0/4263223659 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f505419ef80 con 0x7f5054107fe0 2024-09-19T05:10:03.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.067+0000 7f5050ff9640 1 -- 172.21.15.120:0/4263223659 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f5044032d60 con 0x7f5054107fe0 2024-09-19T05:10:03.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.068+0000 7f5059b47640 1 -- 172.21.15.120:0/4263223659 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5054107fe0 msgr2=0x7f505419b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:03.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.068+0000 7f5059b47640 1 --2- 172.21.15.120:0/4263223659 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5054107fe0 0x7f505419b550 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f50440097f0 tx=0x7f5044030d00 comp rx=0 tx=0).stop 2024-09-19T05:10:03.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.068+0000 7f5059b47640 1 -- 172.21.15.120:0/4263223659 shutdown_connections 2024-09-19T05:10:03.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.068+0000 7f5059b47640 1 --2- 172.21.15.120:0/4263223659 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5054107fe0 0x7f505419b550 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:03.678 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.068+0000 7f5059b47640 1 -- 172.21.15.120:0/4263223659 >> 172.21.15.120:0/4263223659 conn(0x7f5054101c00 msgr2=0x7f5054102790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:03.679 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.068+0000 7f5059b47640 1 -- 172.21.15.120:0/4263223659 shutdown_connections 2024-09-19T05:10:03.679 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:03.068+0000 7f5059b47640 1 -- 172.21.15.120:0/4263223659 wait complete. 2024-09-19T05:10:03.679 INFO:teuthology.orchestra.run.smithi120.stdout:mgr not available, waiting (1/15)... 2024-09-19T05:10:04.125 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:03 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:03.736+0000 7f3ba6b3b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:10:04.875 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:04 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:04.608+0000 7f3ba6b3b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:10:04.875 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:04 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:04.674+0000 7f3ba6b3b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:10:05.635 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:05 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:05.377+0000 7f3ba6b3b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T05:10:05.635 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:05 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:05.491+0000 7f3ba6b3b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:10:05.635 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:05 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:05.633+0000 7f3ba6b3b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:10:05.899 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:05 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:05.697+0000 7f3ba6b3b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:10:05.899 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:05 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:05.848+0000 7f3ba6b3b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T05:10:06.150 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:05 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:05.919+0000 7f3ba6b3b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:10:06.150 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:05 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:05.983+0000 7f3ba6b3b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:10:06.150 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:06 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:06.148+0000 7f3ba6b3b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:10:06.427 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:06 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/4172186365' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T05:10:06.427 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:06 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:06.218+0000 7f3ba6b3b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:10:06.428 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:06 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:06.283+0000 7f3ba6b3b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:10:06.428 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:06 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:06.365+0000 7f3ba6b3b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:10:06.810 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:06 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:06.425+0000 7f3ba6b3b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:10:06.810 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:06 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:06.486+0000 7f3ba6b3b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:10:06.836 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 2024-09-19T05:10:06.836 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:10:06.836 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "fsid": "4e6e3df4-7645-11ef-bceb-c7b262605968", 2024-09-19T05:10:06.836 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T05:10:06.836 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T05:10:06.836 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T05:10:06.836 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T05:10:06.836 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:10:06.837 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T05:10:06.837 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T05:10:06.837 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 0 2024-09-19T05:10:06.837 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:10:06.837 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T05:10:06.837 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T05:10:06.837 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:10:06.837 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-19T05:10:06.837 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T05:10:06.837 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:10:06.837 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T05:10:06.837 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T05:10:06.837 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:10:06.837 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T05:10:06.837 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:10:06.838 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T05:10:06.838 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T05:10:06.838 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T05:10:06.845 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T05:10:06.845 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T05:10:06.845 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T05:10:06.845 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:10:06.845 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T05:10:06.845 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T05:10:06.845 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T05:10:06.846 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T05:10:06.846 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T05:10:06.846 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T05:10:06.846 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T05:10:06.846 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T05:10:06.846 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T05:10:06.846 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:10:06.846 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T05:10:06.846 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:10:06.846 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T05:09:55:846992+0000", 2024-09-19T05:10:06.846 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T05:10:06.846 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T05:10:06.846 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:10:06.846 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T05:10:06.847 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T05:10:06.847 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T05:10:06.847 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T05:10:06.847 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T05:10:06.847 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T05:10:06.847 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T05:10:06.847 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:10:06.847 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T05:10:06.847 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:10:06.848 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T05:10:06.848 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:10:06.848 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T05:09:55.847706+0000", 2024-09-19T05:10:06.848 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T05:10:06.848 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:10:06.848 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T05:10:06.848 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:10:06.849 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.084+0000 7f8aa9d7d640 1 Processor -- start 2024-09-19T05:10:06.849 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.084+0000 7f8aa9d7d640 1 -- start start 2024-09-19T05:10:06.849 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.084+0000 7f8aa9d7d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8aa4108080 0x7f8aa410a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:06.849 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.084+0000 7f8aa9d7d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa407be60 con 0x7f8aa4108080 2024-09-19T05:10:06.849 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.084+0000 7f8aa37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8aa4108080 0x7f8aa410a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:06.849 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.084+0000 7f8aa37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8aa4108080 0x7f8aa410a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57250/0 (socket says 172.21.15.120:57250) 2024-09-19T05:10:06.849 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.084+0000 7f8aa37fe640 1 -- 172.21.15.120:0/2582999149 learned_addr learned my addr 172.21.15.120:0/2582999149 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:06.849 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.085+0000 7f8aa37fe640 1 -- 172.21.15.120:0/2582999149 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa410a9b0 con 0x7f8aa4108080 2024-09-19T05:10:06.849 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.085+0000 7f8aa37fe640 1 --2- 172.21.15.120:0/2582999149 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8aa4108080 0x7f8aa410a470 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009820 tx=0x7f8a9402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620f14d0100420f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:06.849 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.085+0000 7f8aa2ffd640 1 -- 172.21.15.120:0/2582999149 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a94037070 con 0x7f8aa4108080 2024-09-19T05:10:06.849 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.085+0000 7f8aa2ffd640 1 -- 172.21.15.120:0/2582999149 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f8a940328d0 con 0x7f8aa4108080 2024-09-19T05:10:06.849 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.085+0000 7f8aa2ffd640 1 -- 172.21.15.120:0/2582999149 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a940307d0 con 0x7f8aa4108080 2024-09-19T05:10:06.849 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.086+0000 7f8aa9d7d640 1 -- 172.21.15.120:0/2582999149 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8aa4108080 msgr2=0x7f8aa410a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:06.850 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.086+0000 7f8aa9d7d640 1 --2- 172.21.15.120:0/2582999149 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8aa4108080 0x7f8aa410a470 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009820 tx=0x7f8a9402a270 comp rx=0 tx=0).stop 2024-09-19T05:10:06.850 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.086+0000 7f8aa9d7d640 1 -- 172.21.15.120:0/2582999149 shutdown_connections 2024-09-19T05:10:06.850 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.086+0000 7f8aa9d7d640 1 --2- 172.21.15.120:0/2582999149 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8aa4108080 0x7f8aa410a470 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:06.850 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.086+0000 7f8aa9d7d640 1 -- 172.21.15.120:0/2582999149 >> 172.21.15.120:0/2582999149 conn(0x7f8aa4101d00 msgr2=0x7f8aa4104120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:06.850 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.087+0000 7f8aa9d7d640 1 -- 172.21.15.120:0/2582999149 shutdown_connections 2024-09-19T05:10:06.850 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.087+0000 7f8aa9d7d640 1 -- 172.21.15.120:0/2582999149 wait complete. 2024-09-19T05:10:06.850 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.087+0000 7f8aa9d7d640 1 Processor -- start 2024-09-19T05:10:06.850 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.087+0000 7f8aa9d7d640 1 -- start start 2024-09-19T05:10:06.850 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.087+0000 7f8aa9d7d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8aa4108080 0x7f8aa419b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:06.850 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.087+0000 7f8aa9d7d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa410b990 con 0x7f8aa4108080 2024-09-19T05:10:06.850 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.087+0000 7f8aa37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8aa4108080 0x7f8aa419b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:06.850 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.087+0000 7f8aa37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8aa4108080 0x7f8aa419b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57264/0 (socket says 172.21.15.120:57264) 2024-09-19T05:10:06.850 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.087+0000 7f8aa37fe640 1 -- 172.21.15.120:0/4172186365 learned_addr learned my addr 172.21.15.120:0/4172186365 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:06.851 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.088+0000 7f8aa37fe640 1 -- 172.21.15.120:0/4172186365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa419baf0 con 0x7f8aa4108080 2024-09-19T05:10:06.851 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.088+0000 7f8aa37fe640 1 --2- 172.21.15.120:0/4172186365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8aa4108080 0x7f8aa419b5b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8a940097f0 tx=0x7f8a94030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:06.851 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.088+0000 7f8aa17fa640 1 -- 172.21.15.120:0/4172186365 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a94037040 con 0x7f8aa4108080 2024-09-19T05:10:06.851 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.088+0000 7f8aa17fa640 1 -- 172.21.15.120:0/4172186365 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f8a9403b3f0 con 0x7f8aa4108080 2024-09-19T05:10:06.851 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.088+0000 7f8aa9d7d640 1 -- 172.21.15.120:0/4172186365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aa419bd80 con 0x7f8aa4108080 2024-09-19T05:10:06.851 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.088+0000 7f8aa17fa640 1 -- 172.21.15.120:0/4172186365 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a9403a520 con 0x7f8aa4108080 2024-09-19T05:10:06.851 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.088+0000 7f8aa9d7d640 1 -- 172.21.15.120:0/4172186365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aa419ea70 con 0x7f8aa4108080 2024-09-19T05:10:06.851 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.088+0000 7f8aa17fa640 1 -- 172.21.15.120:0/4172186365 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8a9403a6c0 con 0x7f8aa4108080 2024-09-19T05:10:06.851 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.088+0000 7f8aa17fa640 1 -- 172.21.15.120:0/4172186365 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8a94044b00 con 0x7f8aa4108080 2024-09-19T05:10:06.851 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.089+0000 7f8aa9d7d640 1 -- 172.21.15.120:0/4172186365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aa41084e0 con 0x7f8aa4108080 2024-09-19T05:10:06.851 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.091+0000 7f8aa17fa640 1 -- 172.21.15.120:0/4172186365 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8a9403b980 con 0x7f8aa4108080 2024-09-19T05:10:06.851 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.151+0000 7f8aa9d7d640 1 -- 172.21.15.120:0/4172186365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f8aa419eff0 con 0x7f8aa4108080 2024-09-19T05:10:06.851 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.152+0000 7f8aa17fa640 1 -- 172.21.15.120:0/4172186365 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f8a9403b5a0 con 0x7f8aa4108080 2024-09-19T05:10:06.852 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.153+0000 7f8aa9d7d640 1 -- 172.21.15.120:0/4172186365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8aa4108080 msgr2=0x7f8aa419b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:06.852 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.153+0000 7f8aa9d7d640 1 --2- 172.21.15.120:0/4172186365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8aa4108080 0x7f8aa419b5b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8a940097f0 tx=0x7f8a94030d00 comp rx=0 tx=0).stop 2024-09-19T05:10:06.852 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.153+0000 7f8aa9d7d640 1 -- 172.21.15.120:0/4172186365 shutdown_connections 2024-09-19T05:10:06.852 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.153+0000 7f8aa9d7d640 1 --2- 172.21.15.120:0/4172186365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8aa4108080 0x7f8aa419b5b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:06.852 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.153+0000 7f8aa9d7d640 1 -- 172.21.15.120:0/4172186365 >> 172.21.15.120:0/4172186365 conn(0x7f8aa4101d00 msgr2=0x7f8aa4102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:06.852 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.153+0000 7f8aa9d7d640 1 -- 172.21.15.120:0/4172186365 shutdown_connections 2024-09-19T05:10:06.852 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:06.153+0000 7f8aa9d7d640 1 -- 172.21.15.120:0/4172186365 wait complete. 2024-09-19T05:10:06.852 INFO:teuthology.orchestra.run.smithi120.stdout:mgr not available, waiting (2/15)... 2024-09-19T05:10:07.625 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:07 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:07.277+0000 7f3ba6b3b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:10:07.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:07 smithi120 ceph-mon[30956]: Activating manager daemon x 2024-09-19T05:10:07.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:07 smithi120 ceph-mon[30956]: mgrmap e2: x(active, starting, since 0.00307466s) 2024-09-19T05:10:07.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:07 smithi120 ceph-mon[30956]: from='mgr.14100 172.21.15.120:0/2386153661' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T05:10:07.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:07 smithi120 ceph-mon[30956]: from='mgr.14100 172.21.15.120:0/2386153661' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T05:10:07.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:07 smithi120 ceph-mon[30956]: from='mgr.14100 172.21.15.120:0/2386153661' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T05:10:07.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:07 smithi120 ceph-mon[30956]: from='mgr.14100 172.21.15.120:0/2386153661' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:10:07.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:07 smithi120 ceph-mon[30956]: from='mgr.14100 172.21.15.120:0/2386153661' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T05:10:07.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:07 smithi120 ceph-mon[30956]: Manager daemon x is now available 2024-09-19T05:10:07.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:07 smithi120 ceph-mon[30956]: from='mgr.14100 172.21.15.120:0/2386153661' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T05:10:07.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:07 smithi120 ceph-mon[30956]: from='mgr.14100 172.21.15.120:0/2386153661' entity='mgr.x' 2024-09-19T05:10:07.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:07 smithi120 ceph-mon[30956]: from='mgr.14100 172.21.15.120:0/2386153661' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T05:10:07.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:07 smithi120 ceph-mon[30956]: from='mgr.14100 172.21.15.120:0/2386153661' entity='mgr.x' 2024-09-19T05:10:07.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:07 smithi120 ceph-mon[30956]: from='mgr.14100 172.21.15.120:0/2386153661' entity='mgr.x' 2024-09-19T05:10:09.491 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:09 smithi120 ceph-mon[30956]: mgrmap e3: x(active, since 1.00693s) 2024-09-19T05:10:10.048 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 2024-09-19T05:10:10.048 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:10:10.049 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "fsid": "4e6e3df4-7645-11ef-bceb-c7b262605968", 2024-09-19T05:10:10.049 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T05:10:10.049 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T05:10:10.049 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T05:10:10.049 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T05:10:10.049 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:10:10.049 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T05:10:10.049 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T05:10:10.049 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 0 2024-09-19T05:10:10.049 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:10:10.049 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T05:10:10.049 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T05:10:10.049 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:10:10.049 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-19T05:10:10.050 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T05:10:10.050 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:10:10.050 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T05:10:10.050 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T05:10:10.050 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:10:10.050 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T05:10:10.050 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:10:10.050 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T05:10:10.050 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T05:10:10.050 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T05:10:10.050 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T05:10:10.050 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T05:10:10.050 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T05:10:10.050 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:10:10.058 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T05:10:10.058 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T05:10:10.059 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T05:10:10.059 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T05:10:10.059 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T05:10:10.059 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T05:10:10.059 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T05:10:10.059 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T05:10:10.059 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T05:10:10.059 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:10:10.059 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T05:10:10.059 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:10:10.059 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T05:09:55:846992+0000", 2024-09-19T05:10:10.059 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T05:10:10.059 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T05:10:10.059 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:10:10.060 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T05:10:10.060 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T05:10:10.060 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T05:10:10.060 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T05:10:10.060 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T05:10:10.060 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T05:10:10.060 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T05:10:10.060 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout ], 2024-09-19T05:10:10.060 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T05:10:10.060 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:10:10.060 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T05:10:10.060 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T05:10:10.060 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T05:09:55.847706+0000", 2024-09-19T05:10:10.060 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T05:10:10.061 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout }, 2024-09-19T05:10:10.061 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T05:10:10.061 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:10:10.061 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.250+0000 7fa4679cc640 1 Processor -- start 2024-09-19T05:10:10.061 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.251+0000 7fa4679cc640 1 -- start start 2024-09-19T05:10:10.061 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.251+0000 7fa4679cc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa46007de70 0x7fa46007c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:10.061 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.251+0000 7fa4679cc640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa46007c8a0 con 0x7fa46007de70 2024-09-19T05:10:10.061 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.251+0000 7fa465768640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa46007de70 0x7fa46007c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:10.061 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.251+0000 7fa465768640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa46007de70 0x7fa46007c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57324/0 (socket says 172.21.15.120:57324) 2024-09-19T05:10:10.061 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.251+0000 7fa465768640 1 -- 172.21.15.120:0/602155319 learned_addr learned my addr 172.21.15.120:0/602155319 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:10.061 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.251+0000 7fa465768640 1 -- 172.21.15.120:0/602155319 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46007ca20 con 0x7fa46007de70 2024-09-19T05:10:10.061 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.252+0000 7fa465768640 1 --2- 172.21.15.120:0/602155319 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa46007de70 0x7fa46007c2d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa458009820 tx=0x7fa45802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e95574522d4e026 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:10.061 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.252+0000 7fa45ffff640 1 -- 172.21.15.120:0/602155319 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa458037070 con 0x7fa46007de70 2024-09-19T05:10:10.061 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.252+0000 7fa45ffff640 1 -- 172.21.15.120:0/602155319 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fa4580328d0 con 0x7fa46007de70 2024-09-19T05:10:10.062 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.252+0000 7fa45ffff640 1 -- 172.21.15.120:0/602155319 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4580307d0 con 0x7fa46007de70 2024-09-19T05:10:10.062 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.253+0000 7fa4679cc640 1 -- 172.21.15.120:0/602155319 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa46007de70 msgr2=0x7fa46007c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:10.062 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.253+0000 7fa4679cc640 1 --2- 172.21.15.120:0/602155319 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa46007de70 0x7fa46007c2d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa458009820 tx=0x7fa45802a270 comp rx=0 tx=0).stop 2024-09-19T05:10:10.062 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.253+0000 7fa4679cc640 1 -- 172.21.15.120:0/602155319 shutdown_connections 2024-09-19T05:10:10.062 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.253+0000 7fa4679cc640 1 --2- 172.21.15.120:0/602155319 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa46007de70 0x7fa46007c2d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:10.062 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.253+0000 7fa4679cc640 1 -- 172.21.15.120:0/602155319 >> 172.21.15.120:0/602155319 conn(0x7fa460102d50 msgr2=0x7fa460105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:10.062 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.253+0000 7fa4679cc640 1 -- 172.21.15.120:0/602155319 shutdown_connections 2024-09-19T05:10:10.062 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.253+0000 7fa4679cc640 1 -- 172.21.15.120:0/602155319 wait complete. 2024-09-19T05:10:10.062 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.254+0000 7fa4679cc640 1 Processor -- start 2024-09-19T05:10:10.062 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.254+0000 7fa4679cc640 1 -- start start 2024-09-19T05:10:10.062 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.254+0000 7fa4679cc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa46007de70 0x7fa46019d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:10.062 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.254+0000 7fa4679cc640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa46010db90 con 0x7fa46007de70 2024-09-19T05:10:10.062 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.254+0000 7fa465768640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa46007de70 0x7fa46019d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:10.062 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.254+0000 7fa465768640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa46007de70 0x7fa46019d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57336/0 (socket says 172.21.15.120:57336) 2024-09-19T05:10:10.063 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.254+0000 7fa465768640 1 -- 172.21.15.120:0/2295322215 learned_addr learned my addr 172.21.15.120:0/2295322215 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:10.063 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.254+0000 7fa465768640 1 -- 172.21.15.120:0/2295322215 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46019dd00 con 0x7fa46007de70 2024-09-19T05:10:10.063 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.254+0000 7fa465768640 1 --2- 172.21.15.120:0/2295322215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa46007de70 0x7fa46019d7c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa4580097f0 tx=0x7fa458030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:10.063 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.255+0000 7fa45e7fc640 1 -- 172.21.15.120:0/2295322215 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa458037040 con 0x7fa46007de70 2024-09-19T05:10:10.063 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.255+0000 7fa45e7fc640 1 -- 172.21.15.120:0/2295322215 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fa45803b3f0 con 0x7fa46007de70 2024-09-19T05:10:10.063 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.255+0000 7fa4679cc640 1 -- 172.21.15.120:0/2295322215 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa46019df90 con 0x7fa46007de70 2024-09-19T05:10:10.063 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.255+0000 7fa45e7fc640 1 -- 172.21.15.120:0/2295322215 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa45803a520 con 0x7fa46007de70 2024-09-19T05:10:10.063 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.255+0000 7fa4679cc640 1 -- 172.21.15.120:0/2295322215 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4601a0c80 con 0x7fa46007de70 2024-09-19T05:10:10.063 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.255+0000 7fa45e7fc640 1 -- 172.21.15.120:0/2295322215 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 3) ==== 46344+0+0 (secure 0 0 0) 0x7fa458032820 con 0x7fa46007de70 2024-09-19T05:10:10.063 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.256+0000 7fa45e7fc640 1 --2- 172.21.15.120:0/2295322215 >> [v2:172.21.15.120:6800/3412493069,v1:172.21.15.120:6801/3412493069] conn(0x7fa448039050 0x7fa44803b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:10.063 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.256+0000 7fa4679cc640 1 -- 172.21.15.120:0/2295322215 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa46007c350 con 0x7fa46007de70 2024-09-19T05:10:10.063 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.256+0000 7fa45e7fc640 1 -- 172.21.15.120:0/2295322215 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa45806c190 con 0x7fa46007de70 2024-09-19T05:10:10.063 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.256+0000 7fa464f67640 1 --2- 172.21.15.120:0/2295322215 >> [v2:172.21.15.120:6800/3412493069,v1:172.21.15.120:6801/3412493069] conn(0x7fa448039050 0x7fa44803b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:10.063 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.256+0000 7fa464f67640 1 --2- 172.21.15.120:0/2295322215 >> [v2:172.21.15.120:6800/3412493069,v1:172.21.15.120:6801/3412493069] conn(0x7fa448039050 0x7fa44803b510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa45400ad30 tx=0x7fa4540093f0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:10.063 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.261+0000 7fa45e7fc640 1 -- 172.21.15.120:0/2295322215 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa4580371e0 con 0x7fa46007de70 2024-09-19T05:10:10.064 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.286+0000 7fa45e7fc640 1 -- 172.21.15.120:0/2295322215 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7fa45803a710 con 0x7fa46007de70 2024-09-19T05:10:10.064 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.489+0000 7fa4679cc640 1 -- 172.21.15.120:0/2295322215 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa4601a0e50 con 0x7fa46007de70 2024-09-19T05:10:10.064 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.490+0000 7fa45e7fc640 1 -- 172.21.15.120:0/2295322215 <== mon.0 v2:172.21.15.120:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7fa4601a0e50 con 0x7fa46007de70 2024-09-19T05:10:10.064 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.492+0000 7fa4679cc640 1 -- 172.21.15.120:0/2295322215 >> [v2:172.21.15.120:6800/3412493069,v1:172.21.15.120:6801/3412493069] conn(0x7fa448039050 msgr2=0x7fa44803b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:10.064 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.492+0000 7fa4679cc640 1 --2- 172.21.15.120:0/2295322215 >> [v2:172.21.15.120:6800/3412493069,v1:172.21.15.120:6801/3412493069] conn(0x7fa448039050 0x7fa44803b510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa45400ad30 tx=0x7fa4540093f0 comp rx=0 tx=0).stop 2024-09-19T05:10:10.064 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.492+0000 7fa4679cc640 1 -- 172.21.15.120:0/2295322215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa46007de70 msgr2=0x7fa46019d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:10.064 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.492+0000 7fa4679cc640 1 --2- 172.21.15.120:0/2295322215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa46007de70 0x7fa46019d7c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa4580097f0 tx=0x7fa458030d00 comp rx=0 tx=0).stop 2024-09-19T05:10:10.064 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.492+0000 7fa4679cc640 1 -- 172.21.15.120:0/2295322215 shutdown_connections 2024-09-19T05:10:10.064 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.492+0000 7fa4679cc640 1 --2- 172.21.15.120:0/2295322215 >> [v2:172.21.15.120:6800/3412493069,v1:172.21.15.120:6801/3412493069] conn(0x7fa448039050 0x7fa44803b510 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:10.064 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.492+0000 7fa4679cc640 1 --2- 172.21.15.120:0/2295322215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa46007de70 0x7fa46019d7c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:10.064 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.492+0000 7fa4679cc640 1 -- 172.21.15.120:0/2295322215 >> 172.21.15.120:0/2295322215 conn(0x7fa460102d50 msgr2=0x7fa460103910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:10.064 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.492+0000 7fa4679cc640 1 -- 172.21.15.120:0/2295322215 shutdown_connections 2024-09-19T05:10:10.064 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:09.492+0000 7fa4679cc640 1 -- 172.21.15.120:0/2295322215 wait complete. 2024-09-19T05:10:10.064 INFO:teuthology.orchestra.run.smithi120.stdout:mgr is available 2024-09-19T05:10:10.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:10 smithi120 ceph-mon[30956]: mgrmap e4: x(active, since 2s) 2024-09-19T05:10:10.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:10 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2295322215' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T05:10:11.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:11 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2684827153' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T05:10:14.950 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 2024-09-19T05:10:14.950 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T05:10:14.950 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout fsid = 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:10:14.950 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.120:3300,v1:172.21.15.120:6789] 2024-09-19T05:10:14.950 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T05:10:14.950 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T05:10:14.950 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T05:10:14.950 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T05:10:14.950 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 2024-09-19T05:10:14.950 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T05:10:14.951 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T05:10:14.951 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 2024-09-19T05:10:14.951 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T05:10:14.951 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T05:10:14.951 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T05:10:14.951 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T05:10:14.951 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T05:10:14.951 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T05:10:14.951 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.489+0000 7fda4d831640 1 Processor -- start 2024-09-19T05:10:14.951 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.489+0000 7fda4d831640 1 -- start start 2024-09-19T05:10:14.951 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.489+0000 7fda4d831640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda481064f0 0x7fda481068f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:14.951 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.489+0000 7fda4d831640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fda48106ec0 con 0x7fda481064f0 2024-09-19T05:10:14.951 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.489+0000 7fda46ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda481064f0 0x7fda481068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:14.951 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.489+0000 7fda46ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda481064f0 0x7fda481068f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57338/0 (socket says 172.21.15.120:57338) 2024-09-19T05:10:14.952 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.489+0000 7fda46ffd640 1 -- 172.21.15.120:0/1184950534 learned_addr learned my addr 172.21.15.120:0/1184950534 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:14.952 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.489+0000 7fda46ffd640 1 -- 172.21.15.120:0/1184950534 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda481076f0 con 0x7fda481064f0 2024-09-19T05:10:14.952 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.490+0000 7fda46ffd640 1 --2- 172.21.15.120:0/1184950534 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda481064f0 0x7fda481068f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fda38009820 tx=0x7fda3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd8bd46a7821499d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:14.952 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.490+0000 7fda467fc640 1 -- 172.21.15.120:0/1184950534 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda38037070 con 0x7fda481064f0 2024-09-19T05:10:14.952 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.490+0000 7fda467fc640 1 -- 172.21.15.120:0/1184950534 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fda380328d0 con 0x7fda481064f0 2024-09-19T05:10:14.952 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.490+0000 7fda467fc640 1 -- 172.21.15.120:0/1184950534 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda380307d0 con 0x7fda481064f0 2024-09-19T05:10:14.952 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.491+0000 7fda4d831640 1 -- 172.21.15.120:0/1184950534 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda481064f0 msgr2=0x7fda481068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:14.952 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.491+0000 7fda4d831640 1 --2- 172.21.15.120:0/1184950534 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda481064f0 0x7fda481068f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fda38009820 tx=0x7fda3802a270 comp rx=0 tx=0).stop 2024-09-19T05:10:14.952 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.491+0000 7fda4d831640 1 -- 172.21.15.120:0/1184950534 shutdown_connections 2024-09-19T05:10:14.952 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.491+0000 7fda4d831640 1 --2- 172.21.15.120:0/1184950534 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda481064f0 0x7fda481068f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:14.952 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.491+0000 7fda4d831640 1 -- 172.21.15.120:0/1184950534 >> 172.21.15.120:0/1184950534 conn(0x7fda48101ca0 msgr2=0x7fda481040c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:14.952 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.491+0000 7fda4d831640 1 -- 172.21.15.120:0/1184950534 shutdown_connections 2024-09-19T05:10:14.952 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.491+0000 7fda4d831640 1 -- 172.21.15.120:0/1184950534 wait complete. 2024-09-19T05:10:14.953 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.491+0000 7fda4d831640 1 Processor -- start 2024-09-19T05:10:14.953 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.491+0000 7fda4d831640 1 -- start start 2024-09-19T05:10:14.953 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.492+0000 7fda4d831640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda481064f0 0x7fda4819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:14.953 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.492+0000 7fda4d831640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fda4810aaa0 con 0x7fda481064f0 2024-09-19T05:10:14.953 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.492+0000 7fda46ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda481064f0 0x7fda4819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:14.953 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.492+0000 7fda46ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda481064f0 0x7fda4819a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57348/0 (socket says 172.21.15.120:57348) 2024-09-19T05:10:14.953 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.492+0000 7fda46ffd640 1 -- 172.21.15.120:0/2684827153 learned_addr learned my addr 172.21.15.120:0/2684827153 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:14.953 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.492+0000 7fda46ffd640 1 -- 172.21.15.120:0/2684827153 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda4819aa00 con 0x7fda481064f0 2024-09-19T05:10:14.953 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.492+0000 7fda46ffd640 1 --2- 172.21.15.120:0/2684827153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda481064f0 0x7fda4819a4c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fda38030520 tx=0x7fda38032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:14.953 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.492+0000 7fda4c82f640 1 -- 172.21.15.120:0/2684827153 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda38042070 con 0x7fda481064f0 2024-09-19T05:10:14.953 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.492+0000 7fda4c82f640 1 -- 172.21.15.120:0/2684827153 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fda38030cc0 con 0x7fda481064f0 2024-09-19T05:10:14.953 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.492+0000 7fda4d831640 1 -- 172.21.15.120:0/2684827153 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda4819ac90 con 0x7fda481064f0 2024-09-19T05:10:14.953 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.492+0000 7fda4c82f640 1 -- 172.21.15.120:0/2684827153 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda38037040 con 0x7fda481064f0 2024-09-19T05:10:14.953 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.492+0000 7fda4d831640 1 -- 172.21.15.120:0/2684827153 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda4819d980 con 0x7fda481064f0 2024-09-19T05:10:14.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.493+0000 7fda4c82f640 1 -- 172.21.15.120:0/2684827153 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7fda38045070 con 0x7fda481064f0 2024-09-19T05:10:14.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.493+0000 7fda4c82f640 1 --2- 172.21.15.120:0/2684827153 >> [v2:172.21.15.120:6800/3412493069,v1:172.21.15.120:6801/3412493069] conn(0x7fda340391b0 0x7fda3403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:14.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.493+0000 7fda4d831640 1 -- 172.21.15.120:0/2684827153 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda4810ac20 con 0x7fda481064f0 2024-09-19T05:10:14.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.493+0000 7fda4c82f640 1 -- 172.21.15.120:0/2684827153 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fda3806c280 con 0x7fda481064f0 2024-09-19T05:10:14.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.493+0000 7fda3e7fc640 1 --2- 172.21.15.120:0/2684827153 >> [v2:172.21.15.120:6800/3412493069,v1:172.21.15.120:6801/3412493069] conn(0x7fda340391b0 0x7fda3403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:14.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.494+0000 7fda3e7fc640 1 --2- 172.21.15.120:0/2684827153 >> [v2:172.21.15.120:6800/3412493069,v1:172.21.15.120:6801/3412493069] conn(0x7fda340391b0 0x7fda3403b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fda300098c0 tx=0x7fda30006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:14.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.498+0000 7fda4c82f640 1 -- 172.21.15.120:0/2684827153 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fda38045360 con 0x7fda481064f0 2024-09-19T05:10:14.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.668+0000 7fda4d831640 1 -- 172.21.15.120:0/2684827153 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fda4819db50 con 0x7fda481064f0 2024-09-19T05:10:14.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.669+0000 7fda4c82f640 1 -- 172.21.15.120:0/2684827153 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+431 (secure 0 0 0) 0x7fda38046dd0 con 0x7fda481064f0 2024-09-19T05:10:14.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.671+0000 7fda4d831640 1 -- 172.21.15.120:0/2684827153 >> [v2:172.21.15.120:6800/3412493069,v1:172.21.15.120:6801/3412493069] conn(0x7fda340391b0 msgr2=0x7fda3403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:14.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.671+0000 7fda4d831640 1 --2- 172.21.15.120:0/2684827153 >> [v2:172.21.15.120:6800/3412493069,v1:172.21.15.120:6801/3412493069] conn(0x7fda340391b0 0x7fda3403b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fda300098c0 tx=0x7fda30006db0 comp rx=0 tx=0).stop 2024-09-19T05:10:14.954 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.671+0000 7fda4d831640 1 -- 172.21.15.120:0/2684827153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda481064f0 msgr2=0x7fda4819a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:14.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.671+0000 7fda4d831640 1 --2- 172.21.15.120:0/2684827153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda481064f0 0x7fda4819a4c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fda38030520 tx=0x7fda38032dd0 comp rx=0 tx=0).stop 2024-09-19T05:10:14.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.671+0000 7fda4d831640 1 -- 172.21.15.120:0/2684827153 shutdown_connections 2024-09-19T05:10:14.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.671+0000 7fda4d831640 1 --2- 172.21.15.120:0/2684827153 >> [v2:172.21.15.120:6800/3412493069,v1:172.21.15.120:6801/3412493069] conn(0x7fda340391b0 0x7fda3403b670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:14.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.671+0000 7fda4d831640 1 --2- 172.21.15.120:0/2684827153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fda481064f0 0x7fda4819a4c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:14.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.671+0000 7fda4d831640 1 -- 172.21.15.120:0/2684827153 >> 172.21.15.120:0/2684827153 conn(0x7fda48101ca0 msgr2=0x7fda481027a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:14.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.671+0000 7fda4d831640 1 -- 172.21.15.120:0/2684827153 shutdown_connections 2024-09-19T05:10:14.955 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:10.671+0000 7fda4d831640 1 -- 172.21.15.120:0/2684827153 wait complete. 2024-09-19T05:10:14.955 INFO:teuthology.orchestra.run.smithi120.stdout:Enabling cephadm module... 2024-09-19T05:10:18.752 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:18 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/893669432' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T05:10:18.752 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:18 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: ignoring --setuser ceph since I am not root 2024-09-19T05:10:18.752 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:18 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: ignoring --setgroup ceph since I am not root 2024-09-19T05:10:18.752 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:18 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:18.691+0000 7fecefd00040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T05:10:18.752 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:18 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:18.750+0000 7fecefd00040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:10:19.075 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:18 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:18.898+0000 7fecefd00040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:10:19.075 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:18 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:18.964+0000 7fecefd00040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:10:19.375 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:19 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:19.112+0000 7fecefd00040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:10:19.375 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:19 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:19.251+0000 7fecefd00040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:10:19.810 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:19 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/893669432' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T05:10:19.810 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:19 smithi120 ceph-mon[30956]: mgrmap e5: x(active, since 11s) 2024-09-19T05:10:19.810 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:19 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:19.562+0000 7fecefd00040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:10:19.811 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:19 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:19.622+0000 7fecefd00040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:10:19.811 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:19 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:19.808+0000 7fecefd00040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:10:21.125 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:20 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:20.689+0000 7fecefd00040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:10:21.125 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:20 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:20.758+0000 7fecefd00040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:10:21.726 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:21 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:21.466+0000 7fecefd00040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T05:10:21.726 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:21 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:21.581+0000 7fecefd00040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:10:22.006 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:21 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:21.724+0000 7fecefd00040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:10:22.006 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:21 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:21.786+0000 7fecefd00040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:10:22.006 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:21 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:21.937+0000 7fecefd00040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T05:10:22.006 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:22 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:22.004+0000 7fecefd00040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:10:22.289 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:22 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:22.063+0000 7fecefd00040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:10:22.289 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:22 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:22.222+0000 7fecefd00040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:10:22.289 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:22 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:22.287+0000 7fecefd00040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:10:22.556 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:22 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:22.353+0000 7fecefd00040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:10:22.556 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:22 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:22.435+0000 7fecefd00040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:10:22.556 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:22 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:22.496+0000 7fecefd00040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:10:22.556 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:22 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:22.554+0000 7fecefd00040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:10:23.625 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:23 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:23.345+0000 7fecefd00040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:10:23.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:23 smithi120 ceph-mon[30956]: Active manager daemon x restarted 2024-09-19T05:10:23.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:23 smithi120 ceph-mon[30956]: Activating manager daemon x 2024-09-19T05:10:23.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:23 smithi120 ceph-mon[30956]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T05:10:23.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:23 smithi120 ceph-mon[30956]: mgrmap e6: x(active, starting, since 0.00401602s) 2024-09-19T05:10:23.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:23 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:10:23.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:23 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T05:10:23.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:23 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T05:10:23.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:23 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T05:10:23.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:23 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T05:10:23.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:23 smithi120 ceph-mon[30956]: Manager daemon x is now available 2024-09-19T05:10:23.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:23 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' 2024-09-19T05:10:23.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:23 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' 2024-09-19T05:10:23.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:23 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:10:23.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:23 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:10:23.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:23 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T05:10:23.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:23 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T05:10:24.323 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.269+0000 7f3e5a08b640 1 Processor -- start 2024-09-19T05:10:24.323 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.269+0000 7f3e5a08b640 1 -- start start 2024-09-19T05:10:24.323 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.269+0000 7f3e5a08b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e541075c0 0x7f3e541079c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:24.324 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.269+0000 7f3e5a08b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3e54107f90 con 0x7f3e541075c0 2024-09-19T05:10:24.324 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.270+0000 7f3e537fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e541075c0 0x7f3e541079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:24.324 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.270+0000 7f3e537fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e541075c0 0x7f3e541079c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50530/0 (socket says 172.21.15.120:50530) 2024-09-19T05:10:24.324 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.270+0000 7f3e537fe640 1 -- 172.21.15.120:0/1137040732 learned_addr learned my addr 172.21.15.120:0/1137040732 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:24.324 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.270+0000 7f3e537fe640 1 -- 172.21.15.120:0/1137040732 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e541087c0 con 0x7f3e541075c0 2024-09-19T05:10:24.324 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.271+0000 7f3e537fe640 1 --2- 172.21.15.120:0/1137040732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e541075c0 0x7f3e541079c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009e80 tx=0x7f3e4402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e4f139639ee5ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:24.324 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.271+0000 7f3e527fc640 1 -- 172.21.15.120:0/1137040732 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e44036070 con 0x7f3e541075c0 2024-09-19T05:10:24.324 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.271+0000 7f3e527fc640 1 -- 172.21.15.120:0/1137040732 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f3e44031890 con 0x7f3e541075c0 2024-09-19T05:10:24.324 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.271+0000 7f3e527fc640 1 -- 172.21.15.120:0/1137040732 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e44007980 con 0x7f3e541075c0 2024-09-19T05:10:24.325 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.271+0000 7f3e5a08b640 1 -- 172.21.15.120:0/1137040732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e541075c0 msgr2=0x7f3e541079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:24.325 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.271+0000 7f3e5a08b640 1 --2- 172.21.15.120:0/1137040732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e541075c0 0x7f3e541079c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009e80 tx=0x7f3e4402a7a0 comp rx=0 tx=0).stop 2024-09-19T05:10:24.325 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.271+0000 7f3e5a08b640 1 -- 172.21.15.120:0/1137040732 shutdown_connections 2024-09-19T05:10:24.325 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.271+0000 7f3e5a08b640 1 --2- 172.21.15.120:0/1137040732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e541075c0 0x7f3e541079c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:24.325 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.271+0000 7f3e5a08b640 1 -- 172.21.15.120:0/1137040732 >> 172.21.15.120:0/1137040732 conn(0x7f3e54102d50 msgr2=0x7f3e54105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:24.325 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.272+0000 7f3e5a08b640 1 -- 172.21.15.120:0/1137040732 shutdown_connections 2024-09-19T05:10:24.325 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.272+0000 7f3e5a08b640 1 -- 172.21.15.120:0/1137040732 wait complete. 2024-09-19T05:10:24.325 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.272+0000 7f3e5a08b640 1 Processor -- start 2024-09-19T05:10:24.325 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.272+0000 7f3e5a08b640 1 -- start start 2024-09-19T05:10:24.325 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.272+0000 7f3e5a08b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e541075c0 0x7f3e5407db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:24.325 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.273+0000 7f3e5a08b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5410bb70 con 0x7f3e541075c0 2024-09-19T05:10:24.326 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.273+0000 7f3e537fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e541075c0 0x7f3e5407db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:24.326 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.273+0000 7f3e537fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e541075c0 0x7f3e5407db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50534/0 (socket says 172.21.15.120:50534) 2024-09-19T05:10:24.326 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.273+0000 7f3e537fe640 1 -- 172.21.15.120:0/893669432 learned_addr learned my addr 172.21.15.120:0/893669432 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:24.326 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.273+0000 7f3e537fe640 1 -- 172.21.15.120:0/893669432 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e5407e0a0 con 0x7f3e541075c0 2024-09-19T05:10:24.326 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.273+0000 7f3e537fe640 1 --2- 172.21.15.120:0/893669432 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e541075c0 0x7f3e5407db60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3e44007bb0 tx=0x7f3e44031c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:24.326 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.273+0000 7f3e50ff9640 1 -- 172.21.15.120:0/893669432 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e44041020 con 0x7f3e541075c0 2024-09-19T05:10:24.326 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.273+0000 7f3e50ff9640 1 -- 172.21.15.120:0/893669432 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f3e4403c900 con 0x7f3e541075c0 2024-09-19T05:10:24.326 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.273+0000 7f3e5a08b640 1 -- 172.21.15.120:0/893669432 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e5407c290 con 0x7f3e541075c0 2024-09-19T05:10:24.326 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.273+0000 7f3e50ff9640 1 -- 172.21.15.120:0/893669432 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e44036040 con 0x7f3e541075c0 2024-09-19T05:10:24.326 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.273+0000 7f3e5a08b640 1 -- 172.21.15.120:0/893669432 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e5407c7d0 con 0x7f3e541075c0 2024-09-19T05:10:24.326 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.274+0000 7f3e50ff9640 1 -- 172.21.15.120:0/893669432 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f3e44044020 con 0x7f3e541075c0 2024-09-19T05:10:24.327 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.274+0000 7f3e50ff9640 1 --2- 172.21.15.120:0/893669432 >> [v2:172.21.15.120:6800/3412493069,v1:172.21.15.120:6801/3412493069] conn(0x7f3e3c0391b0 0x7f3e3c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:24.327 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.274+0000 7f3e50ff9640 1 -- 172.21.15.120:0/893669432 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f3e4406d370 con 0x7f3e541075c0 2024-09-19T05:10:24.327 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.274+0000 7f3e5a08b640 1 -- 172.21.15.120:0/893669432 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e54107a40 con 0x7f3e541075c0 2024-09-19T05:10:24.327 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.274+0000 7f3e52ffd640 1 --2- 172.21.15.120:0/893669432 >> [v2:172.21.15.120:6800/3412493069,v1:172.21.15.120:6801/3412493069] conn(0x7f3e3c0391b0 0x7f3e3c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:24.327 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.275+0000 7f3e52ffd640 1 --2- 172.21.15.120:0/893669432 >> [v2:172.21.15.120:6800/3412493069,v1:172.21.15.120:6801/3412493069] conn(0x7f3e3c0391b0 0x7f3e3c03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3e480098c0 tx=0x7f3e48006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:24.327 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.279+0000 7f3e50ff9640 1 -- 172.21.15.120:0/893669432 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3e4404b020 con 0x7f3e541075c0 2024-09-19T05:10:24.327 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.492+0000 7f3e5a08b640 1 -- 172.21.15.120:0/893669432 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f3e5407d090 con 0x7f3e541075c0 2024-09-19T05:10:24.327 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.543+0000 7f3e50ff9640 1 -- 172.21.15.120:0/893669432 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f3e440432c0 con 0x7f3e541075c0 2024-09-19T05:10:24.327 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.545+0000 7f3e50ff9640 1 -- 172.21.15.120:0/893669432 <== mon.0 v2:172.21.15.120:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f3e4403ac90 con 0x7f3e541075c0 2024-09-19T05:10:24.327 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.546+0000 7f3e5a08b640 1 -- 172.21.15.120:0/893669432 >> [v2:172.21.15.120:6800/3412493069,v1:172.21.15.120:6801/3412493069] conn(0x7f3e3c0391b0 msgr2=0x7f3e3c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:24.327 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.546+0000 7f3e5a08b640 1 --2- 172.21.15.120:0/893669432 >> [v2:172.21.15.120:6800/3412493069,v1:172.21.15.120:6801/3412493069] conn(0x7f3e3c0391b0 0x7f3e3c03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3e480098c0 tx=0x7f3e48006db0 comp rx=0 tx=0).stop 2024-09-19T05:10:24.327 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.546+0000 7f3e5a08b640 1 -- 172.21.15.120:0/893669432 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e541075c0 msgr2=0x7f3e5407db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:24.327 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.546+0000 7f3e5a08b640 1 --2- 172.21.15.120:0/893669432 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e541075c0 0x7f3e5407db60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3e44007bb0 tx=0x7f3e44031c70 comp rx=0 tx=0).stop 2024-09-19T05:10:24.328 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.546+0000 7f3e5a08b640 1 -- 172.21.15.120:0/893669432 shutdown_connections 2024-09-19T05:10:24.328 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.546+0000 7f3e5a08b640 1 --2- 172.21.15.120:0/893669432 >> [v2:172.21.15.120:6800/3412493069,v1:172.21.15.120:6801/3412493069] conn(0x7f3e3c0391b0 0x7f3e3c03b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:24.328 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.546+0000 7f3e5a08b640 1 --2- 172.21.15.120:0/893669432 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3e541075c0 0x7f3e5407db60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:24.328 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.546+0000 7f3e5a08b640 1 -- 172.21.15.120:0/893669432 >> 172.21.15.120:0/893669432 conn(0x7f3e54102d50 msgr2=0x7f3e541038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:24.328 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.546+0000 7f3e5a08b640 1 -- 172.21.15.120:0/893669432 shutdown_connections 2024-09-19T05:10:24.328 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:18.546+0000 7f3e5a08b640 1 -- 172.21.15.120:0/893669432 wait complete. 2024-09-19T05:10:24.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:24 smithi120 ceph-mon[30956]: Found migration_current of "None". Setting to last migration. 2024-09-19T05:10:24.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:24 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' 2024-09-19T05:10:24.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:24 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' 2024-09-19T05:10:24.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:24 smithi120 ceph-mon[30956]: mgrmap e7: x(active, since 1.00614s) 2024-09-19T05:10:25.375 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:25 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:25.091+0000 7fec5c865640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:05:10:25] ENGINE Error in HTTPServer.serve 2024-09-19T05:10:25.376 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:25 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: Traceback (most recent call last): 2024-09-19T05:10:25.376 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:25 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T05:10:25.376 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:25 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: self._connections.run(self.expiration_interval) 2024-09-19T05:10:25.376 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:25 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T05:10:25.376 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:25 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: self._run(expiration_interval) 2024-09-19T05:10:25.376 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:25 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T05:10:25.376 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:25 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T05:10:25.376 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:25 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T05:10:25.376 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:25 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T05:10:25.376 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:25 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T05:10:25.376 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:25 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: s = self.context.wrap_socket( 2024-09-19T05:10:25.376 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:25 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T05:10:25.376 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:25 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: return self.sslsocket_class._create( 2024-09-19T05:10:25.377 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:25 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T05:10:25.377 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:25 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: self.do_handshake() 2024-09-19T05:10:25.377 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:25 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T05:10:25.377 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:25 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: self._sslobj.do_handshake() 2024-09-19T05:10:25.377 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:25 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T05:10:25.377 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:25 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:25.547 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:10:25.547 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 7, 2024-09-19T05:10:25.548 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T05:10:25.548 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T05:10:25.548 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T05:10:25.548 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:10:25.548 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.728+0000 7fd681ce8640 1 Processor -- start 2024-09-19T05:10:25.548 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.728+0000 7fd681ce8640 1 -- start start 2024-09-19T05:10:25.548 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.728+0000 7fd681ce8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd67c107560 0x7fd67c107960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:25.548 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.728+0000 7fd681ce8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c107f30 con 0x7fd67c107560 2024-09-19T05:10:25.548 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.728+0000 7fd67b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd67c107560 0x7fd67c107960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:25.548 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.728+0000 7fd67b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd67c107560 0x7fd67c107960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50612/0 (socket says 172.21.15.120:50612) 2024-09-19T05:10:25.548 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.728+0000 7fd67b7fe640 1 -- 172.21.15.120:0/1065254314 learned_addr learned my addr 172.21.15.120:0/1065254314 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:25.548 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.728+0000 7fd67b7fe640 1 -- 172.21.15.120:0/1065254314 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67c108760 con 0x7fd67c107560 2024-09-19T05:10:25.549 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.729+0000 7fd67b7fe640 1 --2- 172.21.15.120:0/1065254314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd67c107560 0x7fd67c107960 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd66c009820 tx=0x7fd66c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=187f676b46c0425b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:25.549 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.729+0000 7fd67a7fc640 1 -- 172.21.15.120:0/1065254314 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd66c037070 con 0x7fd67c107560 2024-09-19T05:10:25.549 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.729+0000 7fd67a7fc640 1 -- 172.21.15.120:0/1065254314 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fd66c0328d0 con 0x7fd67c107560 2024-09-19T05:10:25.549 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.729+0000 7fd67a7fc640 1 -- 172.21.15.120:0/1065254314 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd66c0307d0 con 0x7fd67c107560 2024-09-19T05:10:25.549 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.730+0000 7fd681ce8640 1 -- 172.21.15.120:0/1065254314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd67c107560 msgr2=0x7fd67c107960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:25.549 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.730+0000 7fd681ce8640 1 --2- 172.21.15.120:0/1065254314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd67c107560 0x7fd67c107960 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd66c009820 tx=0x7fd66c02a270 comp rx=0 tx=0).stop 2024-09-19T05:10:25.549 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.730+0000 7fd681ce8640 1 -- 172.21.15.120:0/1065254314 shutdown_connections 2024-09-19T05:10:25.549 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.730+0000 7fd681ce8640 1 --2- 172.21.15.120:0/1065254314 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd67c107560 0x7fd67c107960 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:25.549 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.730+0000 7fd681ce8640 1 -- 172.21.15.120:0/1065254314 >> 172.21.15.120:0/1065254314 conn(0x7fd67c102cd0 msgr2=0x7fd67c105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:25.549 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.730+0000 7fd681ce8640 1 -- 172.21.15.120:0/1065254314 shutdown_connections 2024-09-19T05:10:25.549 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.730+0000 7fd681ce8640 1 -- 172.21.15.120:0/1065254314 wait complete. 2024-09-19T05:10:25.549 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.731+0000 7fd681ce8640 1 Processor -- start 2024-09-19T05:10:25.549 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.731+0000 7fd681ce8640 1 -- start start 2024-09-19T05:10:25.550 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.731+0000 7fd681ce8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd67c107560 0x7fd67c19b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:25.550 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.731+0000 7fd681ce8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c10bb10 con 0x7fd67c107560 2024-09-19T05:10:25.550 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.731+0000 7fd67b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd67c107560 0x7fd67c19b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:25.550 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.731+0000 7fd67b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd67c107560 0x7fd67c19b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50628/0 (socket says 172.21.15.120:50628) 2024-09-19T05:10:25.550 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.731+0000 7fd67b7fe640 1 -- 172.21.15.120:0/846138147 learned_addr learned my addr 172.21.15.120:0/846138147 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:25.550 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.731+0000 7fd67b7fe640 1 -- 172.21.15.120:0/846138147 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67c19ba60 con 0x7fd67c107560 2024-09-19T05:10:25.550 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.732+0000 7fd67b7fe640 1 --2- 172.21.15.120:0/846138147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd67c107560 0x7fd67c19b520 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd66c009940 tx=0x7fd66c032e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:25.550 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.732+0000 7fd678ff9640 1 -- 172.21.15.120:0/846138147 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd66c042070 con 0x7fd67c107560 2024-09-19T05:10:25.550 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.732+0000 7fd678ff9640 1 -- 172.21.15.120:0/846138147 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fd66c030c80 con 0x7fd67c107560 2024-09-19T05:10:25.550 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.732+0000 7fd681ce8640 1 -- 172.21.15.120:0/846138147 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd67c19bcf0 con 0x7fd67c107560 2024-09-19T05:10:25.550 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.732+0000 7fd681ce8640 1 -- 172.21.15.120:0/846138147 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd67c19e9e0 con 0x7fd67c107560 2024-09-19T05:10:25.550 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.732+0000 7fd678ff9640 1 -- 172.21.15.120:0/846138147 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd66c037040 con 0x7fd67c107560 2024-09-19T05:10:25.550 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.733+0000 7fd678ff9640 1 -- 172.21.15.120:0/846138147 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fd66c045070 con 0x7fd67c107560 2024-09-19T05:10:25.550 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.733+0000 7fd678ff9640 1 --2- 172.21.15.120:0/846138147 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fd6640390f0 0x7fd66403b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:25.551 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.733+0000 7fd678ff9640 1 -- 172.21.15.120:0/846138147 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd66c06cfa0 con 0x7fd67c107560 2024-09-19T05:10:25.551 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.733+0000 7fd681ce8640 1 -- 172.21.15.120:0/846138147 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd67c10bc90 con 0x7fd67c107560 2024-09-19T05:10:25.551 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.733+0000 7fd67affd640 1 --2- 172.21.15.120:0/846138147 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fd6640390f0 0x7fd66403b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:25.551 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.734+0000 7fd67affd640 1 --2- 172.21.15.120:0/846138147 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fd6640390f0 0x7fd66403b5b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd6700098c0 tx=0x7fd670006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:25.551 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.738+0000 7fd678ff9640 1 -- 172.21.15.120:0/846138147 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd66c045360 con 0x7fd67c107560 2024-09-19T05:10:25.551 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.974+0000 7fd681ce8640 1 -- 172.21.15.120:0/846138147 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fd67c19ebb0 con 0x7fd67c107560 2024-09-19T05:10:25.551 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.975+0000 7fd678ff9640 1 -- 172.21.15.120:0/846138147 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v7) ==== 56+0+88 (secure 0 0 0) 0x7fd66c03ae50 con 0x7fd67c107560 2024-09-19T05:10:25.551 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.978+0000 7fd681ce8640 1 -- 172.21.15.120:0/846138147 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fd6640390f0 msgr2=0x7fd66403b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:25.551 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.978+0000 7fd681ce8640 1 --2- 172.21.15.120:0/846138147 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fd6640390f0 0x7fd66403b5b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd6700098c0 tx=0x7fd670006db0 comp rx=0 tx=0).stop 2024-09-19T05:10:25.551 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.978+0000 7fd681ce8640 1 -- 172.21.15.120:0/846138147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd67c107560 msgr2=0x7fd67c19b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:25.551 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.978+0000 7fd681ce8640 1 --2- 172.21.15.120:0/846138147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd67c107560 0x7fd67c19b520 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd66c009940 tx=0x7fd66c032e10 comp rx=0 tx=0).stop 2024-09-19T05:10:25.551 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.978+0000 7fd681ce8640 1 -- 172.21.15.120:0/846138147 shutdown_connections 2024-09-19T05:10:25.551 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.978+0000 7fd681ce8640 1 --2- 172.21.15.120:0/846138147 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fd6640390f0 0x7fd66403b5b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:25.552 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.978+0000 7fd681ce8640 1 --2- 172.21.15.120:0/846138147 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd67c107560 0x7fd67c19b520 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:25.552 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.978+0000 7fd681ce8640 1 -- 172.21.15.120:0/846138147 >> 172.21.15.120:0/846138147 conn(0x7fd67c102cd0 msgr2=0x7fd67c103830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:25.552 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.978+0000 7fd681ce8640 1 -- 172.21.15.120:0/846138147 shutdown_connections 2024-09-19T05:10:25.552 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:24.979+0000 7fd681ce8640 1 -- 172.21.15.120:0/846138147 wait complete. 2024-09-19T05:10:25.552 INFO:teuthology.orchestra.run.smithi120.stdout:Waiting for the mgr to restart... 2024-09-19T05:10:25.552 INFO:teuthology.orchestra.run.smithi120.stdout:Waiting for mgr epoch 7... 2024-09-19T05:10:25.664 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:25 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/846138147' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T05:10:25.665 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:25 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:10:26.604 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:10:26.604 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 8, 2024-09-19T05:10:26.604 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T05:10:26.604 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:10:26.604 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.944+0000 7fdacab78640 1 Processor -- start 2024-09-19T05:10:26.604 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.944+0000 7fdacab78640 1 -- start start 2024-09-19T05:10:26.604 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.944+0000 7fdacab78640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdac41080a0 0x7fdac410a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:26.604 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.944+0000 7fdacab78640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fdac407be60 con 0x7fdac41080a0 2024-09-19T05:10:26.604 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.944+0000 7fdac8914640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdac41080a0 0x7fdac410a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:26.605 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.944+0000 7fdac8914640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdac41080a0 0x7fdac410a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45736/0 (socket says 172.21.15.120:45736) 2024-09-19T05:10:26.605 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.944+0000 7fdac8914640 1 -- 172.21.15.120:0/2427943681 learned_addr learned my addr 172.21.15.120:0/2427943681 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:26.605 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.945+0000 7fdac8914640 1 -- 172.21.15.120:0/2427943681 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac410a9d0 con 0x7fdac41080a0 2024-09-19T05:10:26.605 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.945+0000 7fdac8914640 1 --2- 172.21.15.120:0/2427943681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdac41080a0 0x7fdac410a490 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdab8009820 tx=0x7fdab802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbcab3dea2a63b58 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:26.605 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.945+0000 7fdac37fe640 1 -- 172.21.15.120:0/2427943681 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdab8037070 con 0x7fdac41080a0 2024-09-19T05:10:26.605 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.945+0000 7fdac37fe640 1 -- 172.21.15.120:0/2427943681 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fdab80328d0 con 0x7fdac41080a0 2024-09-19T05:10:26.605 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.945+0000 7fdac37fe640 1 -- 172.21.15.120:0/2427943681 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdab80307d0 con 0x7fdac41080a0 2024-09-19T05:10:26.605 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.946+0000 7fdacab78640 1 -- 172.21.15.120:0/2427943681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdac41080a0 msgr2=0x7fdac410a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:26.605 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.946+0000 7fdacab78640 1 --2- 172.21.15.120:0/2427943681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdac41080a0 0x7fdac410a490 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdab8009820 tx=0x7fdab802a270 comp rx=0 tx=0).stop 2024-09-19T05:10:26.605 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.946+0000 7fdacab78640 1 -- 172.21.15.120:0/2427943681 shutdown_connections 2024-09-19T05:10:26.605 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.946+0000 7fdacab78640 1 --2- 172.21.15.120:0/2427943681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdac41080a0 0x7fdac410a490 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:26.605 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.946+0000 7fdacab78640 1 -- 172.21.15.120:0/2427943681 >> 172.21.15.120:0/2427943681 conn(0x7fdac4101ca0 msgr2=0x7fdac41040c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:26.606 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.946+0000 7fdacab78640 1 -- 172.21.15.120:0/2427943681 shutdown_connections 2024-09-19T05:10:26.606 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.946+0000 7fdacab78640 1 -- 172.21.15.120:0/2427943681 wait complete. 2024-09-19T05:10:26.606 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.947+0000 7fdacab78640 1 Processor -- start 2024-09-19T05:10:26.606 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.947+0000 7fdacab78640 1 -- start start 2024-09-19T05:10:26.606 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.947+0000 7fdacab78640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdac41080a0 0x7fdac419b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:26.606 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.947+0000 7fdacab78640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fdac410b9b0 con 0x7fdac41080a0 2024-09-19T05:10:26.606 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.947+0000 7fdac8914640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdac41080a0 0x7fdac419b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:26.606 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.947+0000 7fdac8914640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdac41080a0 0x7fdac419b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45744/0 (socket says 172.21.15.120:45744) 2024-09-19T05:10:26.606 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.947+0000 7fdac8914640 1 -- 172.21.15.120:0/1664139770 learned_addr learned my addr 172.21.15.120:0/1664139770 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:26.607 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.947+0000 7fdac8914640 1 -- 172.21.15.120:0/1664139770 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac419bac0 con 0x7fdac41080a0 2024-09-19T05:10:26.607 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.947+0000 7fdac8914640 1 --2- 172.21.15.120:0/1664139770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdac41080a0 0x7fdac419b580 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdab8030520 tx=0x7fdab8032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:26.607 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.947+0000 7fdac1ffb640 1 -- 172.21.15.120:0/1664139770 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdab8042070 con 0x7fdac41080a0 2024-09-19T05:10:26.607 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.947+0000 7fdac1ffb640 1 -- 172.21.15.120:0/1664139770 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fdab8030cc0 con 0x7fdac41080a0 2024-09-19T05:10:26.607 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.947+0000 7fdacab78640 1 -- 172.21.15.120:0/1664139770 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdac419bd50 con 0x7fdac41080a0 2024-09-19T05:10:26.607 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.947+0000 7fdac1ffb640 1 -- 172.21.15.120:0/1664139770 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdab8037040 con 0x7fdac41080a0 2024-09-19T05:10:26.607 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.948+0000 7fdacab78640 1 -- 172.21.15.120:0/1664139770 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdac419ea40 con 0x7fdac41080a0 2024-09-19T05:10:26.607 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.948+0000 7fdac1ffb640 1 -- 172.21.15.120:0/1664139770 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fdab8045070 con 0x7fdac41080a0 2024-09-19T05:10:26.607 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.949+0000 7fdac1ffb640 1 --2- 172.21.15.120:0/1664139770 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fdab40391b0 0x7fdab403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:26.607 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.949+0000 7fdac1ffb640 1 -- 172.21.15.120:0/1664139770 --> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fdab403bd80 con 0x7fdab40391b0 2024-09-19T05:10:26.607 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.949+0000 7fdac1ffb640 1 -- 172.21.15.120:0/1664139770 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fdab806c4f0 con 0x7fdac41080a0 2024-09-19T05:10:26.608 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.949+0000 7fdac3fff640 1 --2- 172.21.15.120:0/1664139770 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fdab40391b0 0x7fdab403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:26.608 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.949+0000 7fdac3fff640 1 --2- 172.21.15.120:0/1664139770 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fdab40391b0 0x7fdab403b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdab00098c0 tx=0x7fdab0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:26.608 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.949+0000 7fdac1ffb640 1 -- 172.21.15.120:0/1664139770 <== mgr.14118 v2:172.21.15.120:6800/50152720 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fdab403bd80 con 0x7fdab40391b0 2024-09-19T05:10:26.608 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.956+0000 7fdacab78640 1 -- 172.21.15.120:0/1664139770 --> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fdac4108500 con 0x7fdab40391b0 2024-09-19T05:10:26.608 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.956+0000 7fdac1ffb640 1 -- 172.21.15.120:0/1664139770 <== mgr.14118 v2:172.21.15.120:6800/50152720 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fdac4108500 con 0x7fdab40391b0 2024-09-19T05:10:26.608 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.956+0000 7fdacab78640 1 -- 172.21.15.120:0/1664139770 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fdab40391b0 msgr2=0x7fdab403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:26.608 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.956+0000 7fdacab78640 1 --2- 172.21.15.120:0/1664139770 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fdab40391b0 0x7fdab403b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdab00098c0 tx=0x7fdab0006db0 comp rx=0 tx=0).stop 2024-09-19T05:10:26.609 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.956+0000 7fdacab78640 1 -- 172.21.15.120:0/1664139770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdac41080a0 msgr2=0x7fdac419b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:26.609 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.956+0000 7fdacab78640 1 --2- 172.21.15.120:0/1664139770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdac41080a0 0x7fdac419b580 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdab8030520 tx=0x7fdab8032dd0 comp rx=0 tx=0).stop 2024-09-19T05:10:26.609 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.956+0000 7fdacab78640 1 -- 172.21.15.120:0/1664139770 shutdown_connections 2024-09-19T05:10:26.609 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.956+0000 7fdacab78640 1 --2- 172.21.15.120:0/1664139770 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fdab40391b0 0x7fdab403b670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:26.609 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.956+0000 7fdacab78640 1 --2- 172.21.15.120:0/1664139770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdac41080a0 0x7fdac419b580 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:26.609 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.956+0000 7fdacab78640 1 -- 172.21.15.120:0/1664139770 >> 172.21.15.120:0/1664139770 conn(0x7fdac4101ca0 msgr2=0x7fdac4102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:26.609 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.957+0000 7fdacab78640 1 -- 172.21.15.120:0/1664139770 shutdown_connections 2024-09-19T05:10:26.609 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:25.957+0000 7fdacab78640 1 -- 172.21.15.120:0/1664139770 wait complete. 2024-09-19T05:10:26.609 INFO:teuthology.orchestra.run.smithi120.stdout:mgr epoch 7 is available 2024-09-19T05:10:26.609 INFO:teuthology.orchestra.run.smithi120.stdout:Setting orchestrator backend to cephadm... 2024-09-19T05:10:26.713 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:26 smithi120 ceph-mon[30956]: [19/Sep/2024:05:10:24] ENGINE Bus STARTING 2024-09-19T05:10:26.713 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:26 smithi120 ceph-mon[30956]: [19/Sep/2024:05:10:25] ENGINE Serving on https://172.21.15.120:7150 2024-09-19T05:10:26.713 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:26 smithi120 ceph-mon[30956]: [19/Sep/2024:05:10:25] ENGINE Error in HTTPServer.serve 2024-09-19T05:10:26.713 INFO:journalctl@ceph.mon.a.smithi120.stdout: Traceback (most recent call last): 2024-09-19T05:10:26.713 INFO:journalctl@ceph.mon.a.smithi120.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T05:10:26.713 INFO:journalctl@ceph.mon.a.smithi120.stdout: self._connections.run(self.expiration_interval) 2024-09-19T05:10:26.714 INFO:journalctl@ceph.mon.a.smithi120.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T05:10:26.714 INFO:journalctl@ceph.mon.a.smithi120.stdout: self._run(expiration_interval) 2024-09-19T05:10:26.714 INFO:journalctl@ceph.mon.a.smithi120.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T05:10:26.714 INFO:journalctl@ceph.mon.a.smithi120.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T05:10:26.714 INFO:journalctl@ceph.mon.a.smithi120.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T05:10:26.714 INFO:journalctl@ceph.mon.a.smithi120.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T05:10:26.714 INFO:journalctl@ceph.mon.a.smithi120.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T05:10:26.714 INFO:journalctl@ceph.mon.a.smithi120.stdout: s = self.context.wrap_socket( 2024-09-19T05:10:26.714 INFO:journalctl@ceph.mon.a.smithi120.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T05:10:26.714 INFO:journalctl@ceph.mon.a.smithi120.stdout: return self.sslsocket_class._create( 2024-09-19T05:10:26.714 INFO:journalctl@ceph.mon.a.smithi120.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T05:10:26.714 INFO:journalctl@ceph.mon.a.smithi120.stdout: self.do_handshake() 2024-09-19T05:10:26.714 INFO:journalctl@ceph.mon.a.smithi120.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T05:10:26.714 INFO:journalctl@ceph.mon.a.smithi120.stdout: self._sslobj.do_handshake() 2024-09-19T05:10:26.715 INFO:journalctl@ceph.mon.a.smithi120.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T05:10:26.715 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:26 smithi120 ceph-mon[30956]: [19/Sep/2024:05:10:25] ENGINE Serving on http://172.21.15.120:8765 2024-09-19T05:10:26.715 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:26 smithi120 ceph-mon[30956]: [19/Sep/2024:05:10:25] ENGINE Bus STARTED 2024-09-19T05:10:26.715 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:26 smithi120 ceph-mon[30956]: mgrmap e8: x(active, since 2s) 2024-09-19T05:10:27.695 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:27 smithi120 ceph-mon[30956]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T05:10:27.695 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:27 smithi120 ceph-mon[30956]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T05:10:27.695 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:27 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' 2024-09-19T05:10:27.695 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:27 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:10:27.702 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.950+0000 7f56f7612640 1 Processor -- start 2024-09-19T05:10:27.702 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.950+0000 7f56f7612640 1 -- start start 2024-09-19T05:10:27.702 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.950+0000 7f56f7612640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f01064f0 0x7f56f01068f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:27.702 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.950+0000 7f56f7612640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f56f0106ec0 con 0x7f56f01064f0 2024-09-19T05:10:27.702 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.951+0000 7f56f53ae640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f01064f0 0x7f56f01068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:27.703 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.951+0000 7f56f53ae640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f01064f0 0x7f56f01068f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45756/0 (socket says 172.21.15.120:45756) 2024-09-19T05:10:27.703 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.951+0000 7f56f53ae640 1 -- 172.21.15.120:0/1976256722 learned_addr learned my addr 172.21.15.120:0/1976256722 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:27.703 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.951+0000 7f56f53ae640 1 -- 172.21.15.120:0/1976256722 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f01076f0 con 0x7f56f01064f0 2024-09-19T05:10:27.703 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.952+0000 7f56f53ae640 1 --2- 172.21.15.120:0/1976256722 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f01064f0 0x7f56f01068f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f56ec009820 tx=0x7f56ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c26bdb8567de5e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:27.703 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.952+0000 7f56e7fff640 1 -- 172.21.15.120:0/1976256722 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56ec037070 con 0x7f56f01064f0 2024-09-19T05:10:27.703 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.952+0000 7f56e7fff640 1 -- 172.21.15.120:0/1976256722 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f56ec0328d0 con 0x7f56f01064f0 2024-09-19T05:10:27.703 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.952+0000 7f56e7fff640 1 -- 172.21.15.120:0/1976256722 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56ec0307d0 con 0x7f56f01064f0 2024-09-19T05:10:27.703 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.952+0000 7f56f7612640 1 -- 172.21.15.120:0/1976256722 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f01064f0 msgr2=0x7f56f01068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:27.703 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.952+0000 7f56f7612640 1 --2- 172.21.15.120:0/1976256722 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f01064f0 0x7f56f01068f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f56ec009820 tx=0x7f56ec02a270 comp rx=0 tx=0).stop 2024-09-19T05:10:27.703 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.952+0000 7f56f7612640 1 -- 172.21.15.120:0/1976256722 shutdown_connections 2024-09-19T05:10:27.703 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.952+0000 7f56f7612640 1 --2- 172.21.15.120:0/1976256722 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f01064f0 0x7f56f01068f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:27.704 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.952+0000 7f56f7612640 1 -- 172.21.15.120:0/1976256722 >> 172.21.15.120:0/1976256722 conn(0x7f56f0101ca0 msgr2=0x7f56f01040c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:27.704 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.952+0000 7f56f7612640 1 -- 172.21.15.120:0/1976256722 shutdown_connections 2024-09-19T05:10:27.704 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.952+0000 7f56f7612640 1 -- 172.21.15.120:0/1976256722 wait complete. 2024-09-19T05:10:27.704 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.953+0000 7f56f7612640 1 Processor -- start 2024-09-19T05:10:27.704 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.953+0000 7f56f7612640 1 -- start start 2024-09-19T05:10:27.704 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.953+0000 7f56f7612640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f01064f0 0x7f56f0191720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:27.704 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.953+0000 7f56f7612640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f56f010aaa0 con 0x7f56f01064f0 2024-09-19T05:10:27.704 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.953+0000 7f56f53ae640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f01064f0 0x7f56f0191720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:27.704 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.953+0000 7f56f53ae640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f01064f0 0x7f56f0191720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45760/0 (socket says 172.21.15.120:45760) 2024-09-19T05:10:27.704 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.953+0000 7f56f53ae640 1 -- 172.21.15.120:0/3507438394 learned_addr learned my addr 172.21.15.120:0/3507438394 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:27.704 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.954+0000 7f56f53ae640 1 -- 172.21.15.120:0/3507438394 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f0191c60 con 0x7f56f01064f0 2024-09-19T05:10:27.705 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.954+0000 7f56f53ae640 1 --2- 172.21.15.120:0/3507438394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f01064f0 0x7f56f0191720 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f56ec030520 tx=0x7f56ec032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:27.705 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.954+0000 7f56e67fc640 1 -- 172.21.15.120:0/3507438394 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56ec042070 con 0x7f56f01064f0 2024-09-19T05:10:27.705 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.954+0000 7f56e67fc640 1 -- 172.21.15.120:0/3507438394 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f56ec030cc0 con 0x7f56f01064f0 2024-09-19T05:10:27.705 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.954+0000 7f56f7612640 1 -- 172.21.15.120:0/3507438394 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f018fe50 con 0x7f56f01064f0 2024-09-19T05:10:27.705 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.954+0000 7f56e67fc640 1 -- 172.21.15.120:0/3507438394 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56ec037040 con 0x7f56f01064f0 2024-09-19T05:10:27.705 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.954+0000 7f56f7612640 1 -- 172.21.15.120:0/3507438394 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f0190390 con 0x7f56f01064f0 2024-09-19T05:10:27.705 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.955+0000 7f56e67fc640 1 -- 172.21.15.120:0/3507438394 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f56ec045070 con 0x7f56f01064f0 2024-09-19T05:10:27.705 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.955+0000 7f56e67fc640 1 --2- 172.21.15.120:0/3507438394 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f56dc0391b0 0x7f56dc03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:27.705 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.955+0000 7f56e67fc640 1 -- 172.21.15.120:0/3507438394 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f56ec06c2b0 con 0x7f56f01064f0 2024-09-19T05:10:27.705 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.955+0000 7f56f7612640 1 -- 172.21.15.120:0/3507438394 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56f010ac20 con 0x7f56f01064f0 2024-09-19T05:10:27.705 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.955+0000 7f56f4bad640 1 --2- 172.21.15.120:0/3507438394 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f56dc0391b0 0x7f56dc03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:27.705 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.955+0000 7f56f4bad640 1 --2- 172.21.15.120:0/3507438394 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f56dc0391b0 0x7f56dc03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f56e00098c0 tx=0x7f56e0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:27.705 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:26.960+0000 7f56e67fc640 1 -- 172.21.15.120:0/3507438394 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f56ec046e00 con 0x7f56f01064f0 2024-09-19T05:10:27.706 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:27.138+0000 7f56f7612640 1 -- 172.21.15.120:0/3507438394 --> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f56f0195420 con 0x7f56dc0391b0 2024-09-19T05:10:27.706 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:27.143+0000 7f56e67fc640 1 -- 172.21.15.120:0/3507438394 <== mgr.14118 v2:172.21.15.120:6800/50152720 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f56f0195420 con 0x7f56dc0391b0 2024-09-19T05:10:27.706 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:27.145+0000 7f56f7612640 1 -- 172.21.15.120:0/3507438394 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f56dc0391b0 msgr2=0x7f56dc03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:27.706 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:27.145+0000 7f56f7612640 1 --2- 172.21.15.120:0/3507438394 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f56dc0391b0 0x7f56dc03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f56e00098c0 tx=0x7f56e0006db0 comp rx=0 tx=0).stop 2024-09-19T05:10:27.706 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:27.145+0000 7f56f7612640 1 -- 172.21.15.120:0/3507438394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f01064f0 msgr2=0x7f56f0191720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:27.706 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:27.145+0000 7f56f7612640 1 --2- 172.21.15.120:0/3507438394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f01064f0 0x7f56f0191720 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f56ec030520 tx=0x7f56ec032dd0 comp rx=0 tx=0).stop 2024-09-19T05:10:27.706 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:27.145+0000 7f56f7612640 1 -- 172.21.15.120:0/3507438394 shutdown_connections 2024-09-19T05:10:27.706 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:27.145+0000 7f56f7612640 1 --2- 172.21.15.120:0/3507438394 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f56dc0391b0 0x7f56dc03b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:27.706 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:27.145+0000 7f56f7612640 1 --2- 172.21.15.120:0/3507438394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f56f01064f0 0x7f56f0191720 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:27.706 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:27.145+0000 7f56f7612640 1 -- 172.21.15.120:0/3507438394 >> 172.21.15.120:0/3507438394 conn(0x7f56f0101ca0 msgr2=0x7f56f0102b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:27.706 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:27.145+0000 7f56f7612640 1 -- 172.21.15.120:0/3507438394 shutdown_connections 2024-09-19T05:10:27.706 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:27.145+0000 7f56f7612640 1 -- 172.21.15.120:0/3507438394 wait complete. 2024-09-19T05:10:28.601 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:28 smithi120 ceph-mon[30956]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:10:28.884 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T05:10:28.884 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.073+0000 7fc486b8f640 1 Processor -- start 2024-09-19T05:10:28.885 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.074+0000 7fc486b8f640 1 -- start start 2024-09-19T05:10:28.885 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.074+0000 7fc486b8f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc480108d50 0x7fc480109150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:28.885 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.074+0000 7fc486b8f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc480109720 con 0x7fc480108d50 2024-09-19T05:10:28.885 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.074+0000 7fc48492b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc480108d50 0x7fc480109150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:28.885 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.074+0000 7fc48492b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc480108d50 0x7fc480109150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45762/0 (socket says 172.21.15.120:45762) 2024-09-19T05:10:28.885 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.074+0000 7fc48492b640 1 -- 172.21.15.120:0/3793391302 learned_addr learned my addr 172.21.15.120:0/3793391302 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:28.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.074+0000 7fc48492b640 1 -- 172.21.15.120:0/3793391302 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc480105610 con 0x7fc480108d50 2024-09-19T05:10:28.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.075+0000 7fc48492b640 1 --2- 172.21.15.120:0/3793391302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc480108d50 0x7fc480109150 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc474009820 tx=0x7fc47402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee20a21e0867fd11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:28.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.075+0000 7fc47f7fe640 1 -- 172.21.15.120:0/3793391302 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc474037070 con 0x7fc480108d50 2024-09-19T05:10:28.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.075+0000 7fc47f7fe640 1 -- 172.21.15.120:0/3793391302 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fc4740328d0 con 0x7fc480108d50 2024-09-19T05:10:28.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.075+0000 7fc47f7fe640 1 -- 172.21.15.120:0/3793391302 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4740307d0 con 0x7fc480108d50 2024-09-19T05:10:28.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.076+0000 7fc486b8f640 1 -- 172.21.15.120:0/3793391302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc480108d50 msgr2=0x7fc480109150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:28.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.076+0000 7fc486b8f640 1 --2- 172.21.15.120:0/3793391302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc480108d50 0x7fc480109150 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc474009820 tx=0x7fc47402a270 comp rx=0 tx=0).stop 2024-09-19T05:10:28.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.076+0000 7fc486b8f640 1 -- 172.21.15.120:0/3793391302 shutdown_connections 2024-09-19T05:10:28.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.076+0000 7fc486b8f640 1 --2- 172.21.15.120:0/3793391302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc480108d50 0x7fc480109150 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:28.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.076+0000 7fc486b8f640 1 -- 172.21.15.120:0/3793391302 >> 172.21.15.120:0/3793391302 conn(0x7fc4801013e0 msgr2=0x7fc480103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:28.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.076+0000 7fc486b8f640 1 -- 172.21.15.120:0/3793391302 shutdown_connections 2024-09-19T05:10:28.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.076+0000 7fc486b8f640 1 -- 172.21.15.120:0/3793391302 wait complete. 2024-09-19T05:10:28.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.076+0000 7fc486b8f640 1 Processor -- start 2024-09-19T05:10:28.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.076+0000 7fc486b8f640 1 -- start start 2024-09-19T05:10:28.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.076+0000 7fc486b8f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc480108d50 0x7fc48019b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:28.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.077+0000 7fc486b8f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc48010bce0 con 0x7fc480108d50 2024-09-19T05:10:28.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.077+0000 7fc48492b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc480108d50 0x7fc48019b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:28.889 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.077+0000 7fc48492b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc480108d50 0x7fc48019b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45770/0 (socket says 172.21.15.120:45770) 2024-09-19T05:10:28.889 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.077+0000 7fc48492b640 1 -- 172.21.15.120:0/1868013216 learned_addr learned my addr 172.21.15.120:0/1868013216 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:28.889 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.077+0000 7fc48492b640 1 -- 172.21.15.120:0/1868013216 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc48019bc10 con 0x7fc480108d50 2024-09-19T05:10:28.889 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.077+0000 7fc48492b640 1 --2- 172.21.15.120:0/1868013216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc480108d50 0x7fc48019b6d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc4740097f0 tx=0x7fc474030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:28.889 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.077+0000 7fc47dffb640 1 -- 172.21.15.120:0/1868013216 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc474037040 con 0x7fc480108d50 2024-09-19T05:10:28.890 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.077+0000 7fc47dffb640 1 -- 172.21.15.120:0/1868013216 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fc474032bb0 con 0x7fc480108d50 2024-09-19T05:10:28.890 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.077+0000 7fc486b8f640 1 -- 172.21.15.120:0/1868013216 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc48019bea0 con 0x7fc480108d50 2024-09-19T05:10:28.890 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.077+0000 7fc47dffb640 1 -- 172.21.15.120:0/1868013216 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc47403a390 con 0x7fc480108d50 2024-09-19T05:10:28.890 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.077+0000 7fc486b8f640 1 -- 172.21.15.120:0/1868013216 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc48019eb90 con 0x7fc480108d50 2024-09-19T05:10:28.890 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.078+0000 7fc47dffb640 1 -- 172.21.15.120:0/1868013216 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fc47403a5d0 con 0x7fc480108d50 2024-09-19T05:10:28.891 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.078+0000 7fc486b8f640 1 -- 172.21.15.120:0/1868013216 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4801091d0 con 0x7fc480108d50 2024-09-19T05:10:28.891 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.078+0000 7fc47dffb640 1 --2- 172.21.15.120:0/1868013216 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fc4700391b0 0x7fc47003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:28.891 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.079+0000 7fc47dffb640 1 -- 172.21.15.120:0/1868013216 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc47406c4c0 con 0x7fc480108d50 2024-09-19T05:10:28.891 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.079+0000 7fc47ffff640 1 --2- 172.21.15.120:0/1868013216 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fc4700391b0 0x7fc47003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:28.891 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.079+0000 7fc47ffff640 1 --2- 172.21.15.120:0/1868013216 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fc4700391b0 0x7fc47003b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc46c0098c0 tx=0x7fc46c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:28.892 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.083+0000 7fc47dffb640 1 -- 172.21.15.120:0/1868013216 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc474040210 con 0x7fc480108d50 2024-09-19T05:10:28.892 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.254+0000 7fc486b8f640 1 -- 172.21.15.120:0/1868013216 --> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fc480102670 con 0x7fc4700391b0 2024-09-19T05:10:28.892 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.255+0000 7fc47dffb640 1 -- 172.21.15.120:0/1868013216 <== mgr.14118 v2:172.21.15.120:6800/50152720 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fc480102670 con 0x7fc4700391b0 2024-09-19T05:10:28.892 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.257+0000 7fc486b8f640 1 -- 172.21.15.120:0/1868013216 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fc4700391b0 msgr2=0x7fc47003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:28.892 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.257+0000 7fc486b8f640 1 --2- 172.21.15.120:0/1868013216 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fc4700391b0 0x7fc47003b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc46c0098c0 tx=0x7fc46c006db0 comp rx=0 tx=0).stop 2024-09-19T05:10:28.892 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.257+0000 7fc486b8f640 1 -- 172.21.15.120:0/1868013216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc480108d50 msgr2=0x7fc48019b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:28.893 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.257+0000 7fc486b8f640 1 --2- 172.21.15.120:0/1868013216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc480108d50 0x7fc48019b6d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc4740097f0 tx=0x7fc474030d00 comp rx=0 tx=0).stop 2024-09-19T05:10:28.893 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.257+0000 7fc486b8f640 1 -- 172.21.15.120:0/1868013216 shutdown_connections 2024-09-19T05:10:28.893 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.257+0000 7fc486b8f640 1 --2- 172.21.15.120:0/1868013216 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fc4700391b0 0x7fc47003b670 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:28.893 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.257+0000 7fc486b8f640 1 --2- 172.21.15.120:0/1868013216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc480108d50 0x7fc48019b6d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:28.893 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.257+0000 7fc486b8f640 1 -- 172.21.15.120:0/1868013216 >> 172.21.15.120:0/1868013216 conn(0x7fc4801013e0 msgr2=0x7fc480101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:28.894 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.257+0000 7fc486b8f640 1 -- 172.21.15.120:0/1868013216 shutdown_connections 2024-09-19T05:10:28.894 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:28.257+0000 7fc486b8f640 1 -- 172.21.15.120:0/1868013216 wait complete. 2024-09-19T05:10:28.894 INFO:teuthology.orchestra.run.smithi120.stdout:Generating ssh key... 2024-09-19T05:10:29.437 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:29 smithi120 ceph-mon[30956]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:10:29.876 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:29 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: Generating public/private rsa key pair. 2024-09-19T05:10:29.876 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:29 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: Your identification has been saved in /tmp/tmp8t5t1ud6/key 2024-09-19T05:10:29.876 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:29 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: Your public key has been saved in /tmp/tmp8t5t1ud6/key.pub 2024-09-19T05:10:29.876 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:29 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: The key fingerprint is: 2024-09-19T05:10:29.876 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:29 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: SHA256:tBQh+P331uBahe19fFBFzlgYc04pKPEx1Xwq4/zdR+I ceph-4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:10:29.877 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:29 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: The key's randomart image is: 2024-09-19T05:10:29.877 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:29 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: +---[RSA 3072]----+ 2024-09-19T05:10:29.877 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:29 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: | .. oo.oo.=+B| 2024-09-19T05:10:29.877 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:29 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: | . . o..o..&o| 2024-09-19T05:10:29.877 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:29 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: | . .o .. o.*| 2024-09-19T05:10:29.877 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:29 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: | .o.. o .+ | 2024-09-19T05:10:29.878 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:29 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: | S. o oo o| 2024-09-19T05:10:29.878 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:29 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: | . + o=o| 2024-09-19T05:10:29.878 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:29 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: | . =.*B| 2024-09-19T05:10:29.878 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:29 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: | .E B| 2024-09-19T05:10:29.878 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:29 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: | .o .| 2024-09-19T05:10:29.878 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:29 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: +----[SHA256]-----+ 2024-09-19T05:10:30.149 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.256+0000 7f32dc28f640 1 Processor -- start 2024-09-19T05:10:30.149 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.256+0000 7f32dc28f640 1 -- start start 2024-09-19T05:10:30.149 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.256+0000 7f32dc28f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32d41075c0 0x7f32d41079c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:30.150 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.256+0000 7f32dc28f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f32d4107f90 con 0x7f32d41075c0 2024-09-19T05:10:30.150 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.257+0000 7f32da02b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32d41075c0 0x7f32d41079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:30.150 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.257+0000 7f32da02b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32d41075c0 0x7f32d41079c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45782/0 (socket says 172.21.15.120:45782) 2024-09-19T05:10:30.150 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.257+0000 7f32da02b640 1 -- 172.21.15.120:0/635784337 learned_addr learned my addr 172.21.15.120:0/635784337 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:30.150 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.257+0000 7f32da02b640 1 -- 172.21.15.120:0/635784337 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d41087c0 con 0x7f32d41075c0 2024-09-19T05:10:30.150 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.257+0000 7f32da02b640 1 --2- 172.21.15.120:0/635784337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32d41075c0 0x7f32d41079c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009820 tx=0x7f32d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1c25e673884490 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:30.150 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.258+0000 7f32d9029640 1 -- 172.21.15.120:0/635784337 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d0037070 con 0x7f32d41075c0 2024-09-19T05:10:30.150 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.258+0000 7f32d9029640 1 -- 172.21.15.120:0/635784337 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f32d00328d0 con 0x7f32d41075c0 2024-09-19T05:10:30.150 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.258+0000 7f32d9029640 1 -- 172.21.15.120:0/635784337 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d00307d0 con 0x7f32d41075c0 2024-09-19T05:10:30.150 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.258+0000 7f32dc28f640 1 -- 172.21.15.120:0/635784337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32d41075c0 msgr2=0x7f32d41079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:30.150 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.258+0000 7f32dc28f640 1 --2- 172.21.15.120:0/635784337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32d41075c0 0x7f32d41079c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f32d0009820 tx=0x7f32d002a270 comp rx=0 tx=0).stop 2024-09-19T05:10:30.150 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.258+0000 7f32dc28f640 1 -- 172.21.15.120:0/635784337 shutdown_connections 2024-09-19T05:10:30.150 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.258+0000 7f32dc28f640 1 --2- 172.21.15.120:0/635784337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32d41075c0 0x7f32d41079c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:30.151 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.258+0000 7f32dc28f640 1 -- 172.21.15.120:0/635784337 >> 172.21.15.120:0/635784337 conn(0x7f32d4102d50 msgr2=0x7f32d4105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:30.151 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.258+0000 7f32dc28f640 1 -- 172.21.15.120:0/635784337 shutdown_connections 2024-09-19T05:10:30.151 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.258+0000 7f32dc28f640 1 -- 172.21.15.120:0/635784337 wait complete. 2024-09-19T05:10:30.151 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.259+0000 7f32dc28f640 1 Processor -- start 2024-09-19T05:10:30.151 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.259+0000 7f32dc28f640 1 -- start start 2024-09-19T05:10:30.151 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.259+0000 7f32dc28f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32d41075c0 0x7f32d419b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:30.151 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.259+0000 7f32dc28f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f32d410bb70 con 0x7f32d41075c0 2024-09-19T05:10:30.151 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.259+0000 7f32da02b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32d41075c0 0x7f32d419b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:30.151 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.259+0000 7f32da02b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32d41075c0 0x7f32d419b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45790/0 (socket says 172.21.15.120:45790) 2024-09-19T05:10:30.151 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.259+0000 7f32da02b640 1 -- 172.21.15.120:0/2206354719 learned_addr learned my addr 172.21.15.120:0/2206354719 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:30.151 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.259+0000 7f32da02b640 1 -- 172.21.15.120:0/2206354719 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d419bb00 con 0x7f32d41075c0 2024-09-19T05:10:30.151 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.259+0000 7f32da02b640 1 --2- 172.21.15.120:0/2206354719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32d41075c0 0x7f32d419b5c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f32d0030520 tx=0x7f32d0032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:30.151 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.260+0000 7f32cb7fe640 1 -- 172.21.15.120:0/2206354719 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d0042070 con 0x7f32d41075c0 2024-09-19T05:10:30.151 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.260+0000 7f32dc28f640 1 -- 172.21.15.120:0/2206354719 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32d419bd90 con 0x7f32d41075c0 2024-09-19T05:10:30.152 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.260+0000 7f32cb7fe640 1 -- 172.21.15.120:0/2206354719 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f32d0030cc0 con 0x7f32d41075c0 2024-09-19T05:10:30.152 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.260+0000 7f32cb7fe640 1 -- 172.21.15.120:0/2206354719 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d0037040 con 0x7f32d41075c0 2024-09-19T05:10:30.152 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.260+0000 7f32dc28f640 1 -- 172.21.15.120:0/2206354719 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32d419ea80 con 0x7f32d41075c0 2024-09-19T05:10:30.152 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.261+0000 7f32cb7fe640 1 -- 172.21.15.120:0/2206354719 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f32d0045070 con 0x7f32d41075c0 2024-09-19T05:10:30.152 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.261+0000 7f32dc28f640 1 -- 172.21.15.120:0/2206354719 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32d410bcf0 con 0x7f32d41075c0 2024-09-19T05:10:30.152 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.261+0000 7f32cb7fe640 1 --2- 172.21.15.120:0/2206354719 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f32c00391b0 0x7f32c003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:30.152 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.261+0000 7f32cb7fe640 1 -- 172.21.15.120:0/2206354719 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f32d006c3b0 con 0x7f32d41075c0 2024-09-19T05:10:30.152 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.261+0000 7f32d982a640 1 --2- 172.21.15.120:0/2206354719 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f32c00391b0 0x7f32c003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:30.152 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.261+0000 7f32d982a640 1 --2- 172.21.15.120:0/2206354719 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f32c00391b0 0x7f32c003b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f32c40098c0 tx=0x7f32c4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:30.152 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.266+0000 7f32cb7fe640 1 -- 172.21.15.120:0/2206354719 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f32d003ac60 con 0x7f32d41075c0 2024-09-19T05:10:30.152 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.435+0000 7f32dc28f640 1 -- 172.21.15.120:0/2206354719 --> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f32d4103fe0 con 0x7f32c00391b0 2024-09-19T05:10:30.152 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.615+0000 7f32cb7fe640 1 -- 172.21.15.120:0/2206354719 <== mgr.14118 v2:172.21.15.120:6800/50152720 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f32d4103fe0 con 0x7f32c00391b0 2024-09-19T05:10:30.152 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.617+0000 7f32dc28f640 1 -- 172.21.15.120:0/2206354719 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f32c00391b0 msgr2=0x7f32c003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:30.153 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.617+0000 7f32dc28f640 1 --2- 172.21.15.120:0/2206354719 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f32c00391b0 0x7f32c003b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f32c40098c0 tx=0x7f32c4006db0 comp rx=0 tx=0).stop 2024-09-19T05:10:30.153 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.617+0000 7f32dc28f640 1 -- 172.21.15.120:0/2206354719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32d41075c0 msgr2=0x7f32d419b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:30.153 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.617+0000 7f32dc28f640 1 --2- 172.21.15.120:0/2206354719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32d41075c0 0x7f32d419b5c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f32d0030520 tx=0x7f32d0032dd0 comp rx=0 tx=0).stop 2024-09-19T05:10:30.153 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.617+0000 7f32dc28f640 1 -- 172.21.15.120:0/2206354719 shutdown_connections 2024-09-19T05:10:30.153 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.617+0000 7f32dc28f640 1 --2- 172.21.15.120:0/2206354719 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f32c00391b0 0x7f32c003b670 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:30.153 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.617+0000 7f32dc28f640 1 --2- 172.21.15.120:0/2206354719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32d41075c0 0x7f32d419b5c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:30.153 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.617+0000 7f32dc28f640 1 -- 172.21.15.120:0/2206354719 >> 172.21.15.120:0/2206354719 conn(0x7f32d4102d50 msgr2=0x7f32d41038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:30.153 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.617+0000 7f32dc28f640 1 -- 172.21.15.120:0/2206354719 shutdown_connections 2024-09-19T05:10:30.153 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:29.617+0000 7f32dc28f640 1 -- 172.21.15.120:0/2206354719 wait complete. 2024-09-19T05:10:30.522 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:30 smithi120 ceph-mon[30956]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:10:30.522 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:30 smithi120 ceph-mon[30956]: Generating ssh key... 2024-09-19T05:10:30.522 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:30 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' 2024-09-19T05:10:30.522 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:30 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' 2024-09-19T05:10:31.252 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQufTn6mY6xa7EsRpCKUFYZKEbYGALv152w/r1C/hXY0TesibJszdkEmJQZPjZCHpelrjqTfdKeIi7qm2c1F7qfwub/kLsuLQ7Be8PZOLlv+93E9jXelH55EPRllAWoskKL4xOumpzD7Z+EjIsACM0A0Okz/TlySzwqM36u9lUZC4dUcz7b3/RAPUrMsmvq2cqvcvp38SRaJ+91H/N9fn0mME4kQGi1kdjM6nyd5cLz+zndp7UVT1B8IAWqteAKiuMpyuTT47xBMugHJzJP6H8xwDifC9S5IIzDDHuTsSbWJwmBYCs7jVC3sOpU1Qhr8KIGzD5rr8LWW62q4TZAr1GaolybhHcOvw2kLMYkMxhzQOGwsU4AGqwQIVm07SyjDhlUgQwiBksY7ayKCpQzu3BUcSP+h0hwFpQRxkIsegZ2Dh5z1gMo/gKeSeX3rfQCbY25bYcDpxVNOt18juuuxTJvEnEQ54ZHHYzIBEi1ItUjGts7hS0qXh+vGpWpgiubbE= ceph-4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:10:31.258 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.519+0000 7f50ee7ed640 1 Processor -- start 2024-09-19T05:10:31.258 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.520+0000 7f50ee7ed640 1 -- start start 2024-09-19T05:10:31.258 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.520+0000 7f50ee7ed640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50e8106470 0x7f50e8106870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:31.258 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.520+0000 7f50ee7ed640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f50e8106e40 con 0x7f50e8106470 2024-09-19T05:10:31.258 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.520+0000 7f50e7fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50e8106470 0x7f50e8106870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:31.258 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.520+0000 7f50e7fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50e8106470 0x7f50e8106870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45794/0 (socket says 172.21.15.120:45794) 2024-09-19T05:10:31.258 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.520+0000 7f50e7fff640 1 -- 172.21.15.120:0/3584142778 learned_addr learned my addr 172.21.15.120:0/3584142778 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:31.258 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.520+0000 7f50e7fff640 1 -- 172.21.15.120:0/3584142778 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e8107670 con 0x7f50e8106470 2024-09-19T05:10:31.259 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.521+0000 7f50e7fff640 1 --2- 172.21.15.120:0/3584142778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50e8106470 0x7f50e8106870 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f50d8009820 tx=0x7f50d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ecb95ba947a677c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:31.259 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.521+0000 7f50e6ffd640 1 -- 172.21.15.120:0/3584142778 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50d8037070 con 0x7f50e8106470 2024-09-19T05:10:31.259 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.521+0000 7f50e6ffd640 1 -- 172.21.15.120:0/3584142778 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f50d80328d0 con 0x7f50e8106470 2024-09-19T05:10:31.259 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.521+0000 7f50e6ffd640 1 -- 172.21.15.120:0/3584142778 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50d80307d0 con 0x7f50e8106470 2024-09-19T05:10:31.259 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.522+0000 7f50ee7ed640 1 -- 172.21.15.120:0/3584142778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50e8106470 msgr2=0x7f50e8106870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:31.259 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.522+0000 7f50ee7ed640 1 --2- 172.21.15.120:0/3584142778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50e8106470 0x7f50e8106870 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f50d8009820 tx=0x7f50d802a270 comp rx=0 tx=0).stop 2024-09-19T05:10:31.259 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.522+0000 7f50ee7ed640 1 -- 172.21.15.120:0/3584142778 shutdown_connections 2024-09-19T05:10:31.259 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.522+0000 7f50ee7ed640 1 --2- 172.21.15.120:0/3584142778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50e8106470 0x7f50e8106870 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:31.259 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.522+0000 7f50ee7ed640 1 -- 172.21.15.120:0/3584142778 >> 172.21.15.120:0/3584142778 conn(0x7f50e8101c00 msgr2=0x7f50e8104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:31.259 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.522+0000 7f50ee7ed640 1 -- 172.21.15.120:0/3584142778 shutdown_connections 2024-09-19T05:10:31.260 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.522+0000 7f50ee7ed640 1 -- 172.21.15.120:0/3584142778 wait complete. 2024-09-19T05:10:31.260 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.523+0000 7f50ee7ed640 1 Processor -- start 2024-09-19T05:10:31.260 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.523+0000 7f50ee7ed640 1 -- start start 2024-09-19T05:10:31.260 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.523+0000 7f50ee7ed640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50e8106470 0x7f50e819b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:31.260 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.523+0000 7f50ee7ed640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f50e810aa20 con 0x7f50e8106470 2024-09-19T05:10:31.260 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.523+0000 7f50e7fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50e8106470 0x7f50e819b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:31.260 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.523+0000 7f50e7fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50e8106470 0x7f50e819b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45810/0 (socket says 172.21.15.120:45810) 2024-09-19T05:10:31.260 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.523+0000 7f50e7fff640 1 -- 172.21.15.120:0/3309852471 learned_addr learned my addr 172.21.15.120:0/3309852471 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:31.261 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.523+0000 7f50e7fff640 1 -- 172.21.15.120:0/3309852471 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e819baa0 con 0x7f50e8106470 2024-09-19T05:10:31.261 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.523+0000 7f50e7fff640 1 --2- 172.21.15.120:0/3309852471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50e8106470 0x7f50e819b560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f50d80097f0 tx=0x7f50d8030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:31.261 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.524+0000 7f50e57fa640 1 -- 172.21.15.120:0/3309852471 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50d8037040 con 0x7f50e8106470 2024-09-19T05:10:31.261 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.524+0000 7f50e57fa640 1 -- 172.21.15.120:0/3309852471 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f50d8032bb0 con 0x7f50e8106470 2024-09-19T05:10:31.261 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.524+0000 7f50e57fa640 1 -- 172.21.15.120:0/3309852471 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50d803a390 con 0x7f50e8106470 2024-09-19T05:10:31.261 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.524+0000 7f50ee7ed640 1 -- 172.21.15.120:0/3309852471 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e819bd30 con 0x7f50e8106470 2024-09-19T05:10:31.261 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.524+0000 7f50ee7ed640 1 -- 172.21.15.120:0/3309852471 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e819ea20 con 0x7f50e8106470 2024-09-19T05:10:31.261 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.525+0000 7f50e57fa640 1 -- 172.21.15.120:0/3309852471 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f50d803a580 con 0x7f50e8106470 2024-09-19T05:10:31.261 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.525+0000 7f50e57fa640 1 --2- 172.21.15.120:0/3309852471 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f50d0039200 0x7f50d003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:31.261 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.525+0000 7f50e57fa640 1 -- 172.21.15.120:0/3309852471 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f50d806c680 con 0x7f50e8106470 2024-09-19T05:10:31.261 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.525+0000 7f50ee7ed640 1 -- 172.21.15.120:0/3309852471 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e810aba0 con 0x7f50e8106470 2024-09-19T05:10:31.262 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.525+0000 7f50e77fe640 1 --2- 172.21.15.120:0/3309852471 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f50d0039200 0x7f50d003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:31.262 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.525+0000 7f50e77fe640 1 --2- 172.21.15.120:0/3309852471 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f50d0039200 0x7f50d003b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f50dc0098c0 tx=0x7f50dc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:31.262 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.530+0000 7f50e57fa640 1 -- 172.21.15.120:0/3309852471 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f50d8032dd0 con 0x7f50e8106470 2024-09-19T05:10:31.262 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.697+0000 7f50ee7ed640 1 -- 172.21.15.120:0/3309852471 --> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f50e8102e50 con 0x7f50d0039200 2024-09-19T05:10:31.262 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.697+0000 7f50e57fa640 1 -- 172.21.15.120:0/3309852471 <== mgr.14118 v2:172.21.15.120:6800/50152720 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f50e8102e50 con 0x7f50d0039200 2024-09-19T05:10:31.262 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.700+0000 7f50ee7ed640 1 -- 172.21.15.120:0/3309852471 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f50d0039200 msgr2=0x7f50d003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:31.262 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.700+0000 7f50ee7ed640 1 --2- 172.21.15.120:0/3309852471 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f50d0039200 0x7f50d003b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f50dc0098c0 tx=0x7f50dc006db0 comp rx=0 tx=0).stop 2024-09-19T05:10:31.262 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.700+0000 7f50ee7ed640 1 -- 172.21.15.120:0/3309852471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50e8106470 msgr2=0x7f50e819b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:31.262 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.700+0000 7f50ee7ed640 1 --2- 172.21.15.120:0/3309852471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50e8106470 0x7f50e819b560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f50d80097f0 tx=0x7f50d8030d00 comp rx=0 tx=0).stop 2024-09-19T05:10:31.262 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.700+0000 7f50ee7ed640 1 -- 172.21.15.120:0/3309852471 shutdown_connections 2024-09-19T05:10:31.263 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.700+0000 7f50ee7ed640 1 --2- 172.21.15.120:0/3309852471 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f50d0039200 0x7f50d003b6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:31.263 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.700+0000 7f50ee7ed640 1 --2- 172.21.15.120:0/3309852471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50e8106470 0x7f50e819b560 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:31.263 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.700+0000 7f50ee7ed640 1 -- 172.21.15.120:0/3309852471 >> 172.21.15.120:0/3309852471 conn(0x7f50e8101c00 msgr2=0x7f50e8102740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:31.263 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.700+0000 7f50ee7ed640 1 -- 172.21.15.120:0/3309852471 shutdown_connections 2024-09-19T05:10:31.263 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:30.700+0000 7f50ee7ed640 1 -- 172.21.15.120:0/3309852471 wait complete. 2024-09-19T05:10:31.263 INFO:teuthology.orchestra.run.smithi120.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T05:10:31.263 INFO:teuthology.orchestra.run.smithi120.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T05:10:31.263 INFO:teuthology.orchestra.run.smithi120.stdout:Adding host smithi120... 2024-09-19T05:10:31.847 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:31 smithi120 ceph-mon[30956]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:10:33.055 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:32 smithi120 ceph-mon[30956]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi120", "addr": "172.21.15.120", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:10:33.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:33 smithi120 ceph-mon[30956]: Deploying cephadm binary to smithi120 2024-09-19T05:10:35.549 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout Added host 'smithi120' with addr '172.21.15.120' 2024-09-19T05:10:35.550 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.666+0000 7f5678a01640 1 Processor -- start 2024-09-19T05:10:35.550 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.666+0000 7f5678a01640 1 -- start start 2024-09-19T05:10:35.550 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.666+0000 7f5678a01640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5674105dd0 0x7f56741061d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:35.550 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.666+0000 7f5678a01640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5674063510 con 0x7f5674105dd0 2024-09-19T05:10:35.550 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.666+0000 7f567259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5674105dd0 0x7f56741061d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:35.550 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.666+0000 7f567259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5674105dd0 0x7f56741061d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45820/0 (socket says 172.21.15.120:45820) 2024-09-19T05:10:35.550 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.666+0000 7f567259c640 1 -- 172.21.15.120:0/3316460788 learned_addr learned my addr 172.21.15.120:0/3316460788 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:35.550 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.667+0000 7f567259c640 1 -- 172.21.15.120:0/3316460788 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5674106710 con 0x7f5674105dd0 2024-09-19T05:10:35.550 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.667+0000 7f567259c640 1 --2- 172.21.15.120:0/3316460788 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5674105dd0 0x7f56741061d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5664009820 tx=0x7f566402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d12fd1927013f2e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:35.550 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.667+0000 7f5671d9b640 1 -- 172.21.15.120:0/3316460788 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5664037070 con 0x7f5674105dd0 2024-09-19T05:10:35.550 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.667+0000 7f5671d9b640 1 -- 172.21.15.120:0/3316460788 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f56640328d0 con 0x7f5674105dd0 2024-09-19T05:10:35.551 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.667+0000 7f5671d9b640 1 -- 172.21.15.120:0/3316460788 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56640307d0 con 0x7f5674105dd0 2024-09-19T05:10:35.551 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.668+0000 7f5678a01640 1 -- 172.21.15.120:0/3316460788 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5674105dd0 msgr2=0x7f56741061d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:35.551 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.668+0000 7f5678a01640 1 --2- 172.21.15.120:0/3316460788 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5674105dd0 0x7f56741061d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5664009820 tx=0x7f566402a270 comp rx=0 tx=0).stop 2024-09-19T05:10:35.551 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.668+0000 7f5678a01640 1 -- 172.21.15.120:0/3316460788 shutdown_connections 2024-09-19T05:10:35.551 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.668+0000 7f5678a01640 1 --2- 172.21.15.120:0/3316460788 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5674105dd0 0x7f56741061d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:35.551 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.668+0000 7f5678a01640 1 -- 172.21.15.120:0/3316460788 >> 172.21.15.120:0/3316460788 conn(0x7f5674101c00 msgr2=0x7f5674104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:35.551 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.668+0000 7f5678a01640 1 -- 172.21.15.120:0/3316460788 shutdown_connections 2024-09-19T05:10:35.551 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.668+0000 7f5678a01640 1 -- 172.21.15.120:0/3316460788 wait complete. 2024-09-19T05:10:35.551 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.669+0000 7f5678a01640 1 Processor -- start 2024-09-19T05:10:35.551 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.669+0000 7f5678a01640 1 -- start start 2024-09-19T05:10:35.551 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.669+0000 7f5678a01640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5674105dd0 0x7f567419d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:35.552 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.669+0000 7f5678a01640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f56741077b0 con 0x7f5674105dd0 2024-09-19T05:10:35.552 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.669+0000 7f567259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5674105dd0 0x7f567419d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:35.552 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.669+0000 7f567259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5674105dd0 0x7f567419d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45826/0 (socket says 172.21.15.120:45826) 2024-09-19T05:10:35.552 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.669+0000 7f567259c640 1 -- 172.21.15.120:0/422345438 learned_addr learned my addr 172.21.15.120:0/422345438 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:35.552 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.669+0000 7f567259c640 1 -- 172.21.15.120:0/422345438 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f567419dc50 con 0x7f5674105dd0 2024-09-19T05:10:35.552 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.669+0000 7f567259c640 1 --2- 172.21.15.120:0/422345438 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5674105dd0 0x7f567419d710 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f56640097f0 tx=0x7f5664030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:35.552 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.669+0000 7f566b7fe640 1 -- 172.21.15.120:0/422345438 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5664037040 con 0x7f5674105dd0 2024-09-19T05:10:35.552 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.669+0000 7f566b7fe640 1 -- 172.21.15.120:0/422345438 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f5664032bb0 con 0x7f5674105dd0 2024-09-19T05:10:35.552 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.669+0000 7f5678a01640 1 -- 172.21.15.120:0/422345438 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f567419dee0 con 0x7f5674105dd0 2024-09-19T05:10:35.553 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.669+0000 7f566b7fe640 1 -- 172.21.15.120:0/422345438 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f566403a390 con 0x7f5674105dd0 2024-09-19T05:10:35.553 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.670+0000 7f5678a01640 1 -- 172.21.15.120:0/422345438 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56741a0bd0 con 0x7f5674105dd0 2024-09-19T05:10:35.553 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.670+0000 7f566b7fe640 1 -- 172.21.15.120:0/422345438 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f566403a5d0 con 0x7f5674105dd0 2024-09-19T05:10:35.553 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.671+0000 7f5678a01640 1 -- 172.21.15.120:0/422345438 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56741061d0 con 0x7f5674105dd0 2024-09-19T05:10:35.554 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.671+0000 7f566b7fe640 1 --2- 172.21.15.120:0/422345438 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f56600391b0 0x7f566003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:35.554 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.671+0000 7f566b7fe640 1 -- 172.21.15.120:0/422345438 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f566406c620 con 0x7f5674105dd0 2024-09-19T05:10:35.554 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.671+0000 7f566bfff640 1 --2- 172.21.15.120:0/422345438 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f56600391b0 0x7f566003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:35.554 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.671+0000 7f566bfff640 1 --2- 172.21.15.120:0/422345438 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f56600391b0 0x7f566003b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f565c0098c0 tx=0x7f565c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:35.554 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.675+0000 7f566b7fe640 1 -- 172.21.15.120:0/422345438 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5664032dd0 con 0x7f5674105dd0 2024-09-19T05:10:35.554 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:31.846+0000 7f5678a01640 1 -- 172.21.15.120:0/422345438 --> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi120", "addr": "172.21.15.120", "target": ["mon-mgr", ""]}) -- 0x7f567402dab0 con 0x7f56600391b0 2024-09-19T05:10:35.554 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:34.982+0000 7f566b7fe640 1 -- 172.21.15.120:0/422345438 <== mgr.14118 v2:172.21.15.120:6800/50152720 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f567402dab0 con 0x7f56600391b0 2024-09-19T05:10:35.554 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:34.985+0000 7f5678a01640 1 -- 172.21.15.120:0/422345438 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f56600391b0 msgr2=0x7f566003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:35.554 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:34.985+0000 7f5678a01640 1 --2- 172.21.15.120:0/422345438 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f56600391b0 0x7f566003b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f565c0098c0 tx=0x7f565c006db0 comp rx=0 tx=0).stop 2024-09-19T05:10:35.554 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:34.985+0000 7f5678a01640 1 -- 172.21.15.120:0/422345438 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5674105dd0 msgr2=0x7f567419d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:35.555 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:34.985+0000 7f5678a01640 1 --2- 172.21.15.120:0/422345438 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5674105dd0 0x7f567419d710 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f56640097f0 tx=0x7f5664030d00 comp rx=0 tx=0).stop 2024-09-19T05:10:35.555 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:34.985+0000 7f5678a01640 1 -- 172.21.15.120:0/422345438 shutdown_connections 2024-09-19T05:10:35.555 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:34.985+0000 7f5678a01640 1 --2- 172.21.15.120:0/422345438 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f56600391b0 0x7f566003b670 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:35.555 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:34.985+0000 7f5678a01640 1 --2- 172.21.15.120:0/422345438 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5674105dd0 0x7f567419d710 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:35.555 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:34.985+0000 7f5678a01640 1 -- 172.21.15.120:0/422345438 >> 172.21.15.120:0/422345438 conn(0x7f5674101c00 msgr2=0x7f56741943d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:35.555 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:34.985+0000 7f5678a01640 1 -- 172.21.15.120:0/422345438 shutdown_connections 2024-09-19T05:10:35.555 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:34.985+0000 7f5678a01640 1 -- 172.21.15.120:0/422345438 wait complete. 2024-09-19T05:10:35.556 INFO:teuthology.orchestra.run.smithi120.stdout:Deploying unmanaged mon service... 2024-09-19T05:10:36.052 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:35 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' 2024-09-19T05:10:36.052 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:35 smithi120 ceph-mon[30956]: Added host smithi120 2024-09-19T05:10:36.052 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:35 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:10:37.037 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T05:10:37.037 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.041+0000 7f0119c87640 1 Processor -- start 2024-09-19T05:10:37.037 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.041+0000 7f0119c87640 1 -- start start 2024-09-19T05:10:37.037 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.041+0000 7f0119c87640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01141075c0 0x7f01141079c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:37.037 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.041+0000 7f0119c87640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0114107f90 con 0x7f01141075c0 2024-09-19T05:10:37.037 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.041+0000 7f01137fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01141075c0 0x7f01141079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:37.037 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.041+0000 7f01137fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01141075c0 0x7f01141079c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55326/0 (socket says 172.21.15.120:55326) 2024-09-19T05:10:37.037 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.041+0000 7f01137fe640 1 -- 172.21.15.120:0/2691105773 learned_addr learned my addr 172.21.15.120:0/2691105773 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:37.037 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.041+0000 7f01137fe640 1 -- 172.21.15.120:0/2691105773 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01141087c0 con 0x7f01141075c0 2024-09-19T05:10:37.038 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.042+0000 7f01137fe640 1 --2- 172.21.15.120:0/2691105773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01141075c0 0x7f01141079c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0104009820 tx=0x7f010402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d63df9a9a5e0c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:37.038 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.042+0000 7f01127fc640 1 -- 172.21.15.120:0/2691105773 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0104037070 con 0x7f01141075c0 2024-09-19T05:10:37.038 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.042+0000 7f01127fc640 1 -- 172.21.15.120:0/2691105773 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f01040328d0 con 0x7f01141075c0 2024-09-19T05:10:37.038 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.042+0000 7f01127fc640 1 -- 172.21.15.120:0/2691105773 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01040307d0 con 0x7f01141075c0 2024-09-19T05:10:37.038 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.043+0000 7f0119c87640 1 -- 172.21.15.120:0/2691105773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01141075c0 msgr2=0x7f01141079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:37.038 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.043+0000 7f0119c87640 1 --2- 172.21.15.120:0/2691105773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01141075c0 0x7f01141079c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0104009820 tx=0x7f010402a270 comp rx=0 tx=0).stop 2024-09-19T05:10:37.038 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.043+0000 7f0119c87640 1 -- 172.21.15.120:0/2691105773 shutdown_connections 2024-09-19T05:10:37.038 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.043+0000 7f0119c87640 1 --2- 172.21.15.120:0/2691105773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01141075c0 0x7f01141079c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:37.038 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.043+0000 7f0119c87640 1 -- 172.21.15.120:0/2691105773 >> 172.21.15.120:0/2691105773 conn(0x7f0114102d50 msgr2=0x7f0114105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:37.038 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.043+0000 7f0119c87640 1 -- 172.21.15.120:0/2691105773 shutdown_connections 2024-09-19T05:10:37.038 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.043+0000 7f0119c87640 1 -- 172.21.15.120:0/2691105773 wait complete. 2024-09-19T05:10:37.038 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.043+0000 7f0119c87640 1 Processor -- start 2024-09-19T05:10:37.038 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.044+0000 7f0119c87640 1 -- start start 2024-09-19T05:10:37.038 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.044+0000 7f0119c87640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01141075c0 0x7f011407db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:37.039 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.044+0000 7f0119c87640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f011410bb70 con 0x7f01141075c0 2024-09-19T05:10:37.039 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.044+0000 7f01137fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01141075c0 0x7f011407db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:37.039 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.044+0000 7f01137fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01141075c0 0x7f011407db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55338/0 (socket says 172.21.15.120:55338) 2024-09-19T05:10:37.039 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.044+0000 7f01137fe640 1 -- 172.21.15.120:0/241647165 learned_addr learned my addr 172.21.15.120:0/241647165 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:37.039 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.044+0000 7f01137fe640 1 -- 172.21.15.120:0/241647165 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f011407e0a0 con 0x7f01141075c0 2024-09-19T05:10:37.039 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.044+0000 7f01137fe640 1 --2- 172.21.15.120:0/241647165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01141075c0 0x7f011407db60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0104030520 tx=0x7f0104032dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:37.039 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.044+0000 7f0110ff9640 1 -- 172.21.15.120:0/241647165 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0104042070 con 0x7f01141075c0 2024-09-19T05:10:37.039 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.044+0000 7f0110ff9640 1 -- 172.21.15.120:0/241647165 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7f0104030cc0 con 0x7f01141075c0 2024-09-19T05:10:37.039 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.044+0000 7f0119c87640 1 -- 172.21.15.120:0/241647165 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f011407c290 con 0x7f01141075c0 2024-09-19T05:10:37.039 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.044+0000 7f0110ff9640 1 -- 172.21.15.120:0/241647165 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0104037040 con 0x7f01141075c0 2024-09-19T05:10:37.039 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.044+0000 7f0119c87640 1 -- 172.21.15.120:0/241647165 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f011407c7d0 con 0x7f01141075c0 2024-09-19T05:10:37.039 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.045+0000 7f0110ff9640 1 -- 172.21.15.120:0/241647165 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f0104045070 con 0x7f01141075c0 2024-09-19T05:10:37.039 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.045+0000 7f0119c87640 1 -- 172.21.15.120:0/241647165 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0114107a40 con 0x7f01141075c0 2024-09-19T05:10:37.039 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.045+0000 7f0110ff9640 1 --2- 172.21.15.120:0/241647165 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f00fc0391b0 0x7f00fc03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:37.039 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.045+0000 7f0110ff9640 1 -- 172.21.15.120:0/241647165 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f010406c250 con 0x7f01141075c0 2024-09-19T05:10:37.040 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.046+0000 7f0112ffd640 1 --2- 172.21.15.120:0/241647165 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f00fc0391b0 0x7f00fc03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:37.040 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.046+0000 7f0112ffd640 1 --2- 172.21.15.120:0/241647165 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f00fc0391b0 0x7f00fc03b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f01080098c0 tx=0x7f0108006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:37.040 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.050+0000 7f0110ff9640 1 -- 172.21.15.120:0/241647165 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0104045360 con 0x7f01141075c0 2024-09-19T05:10:37.040 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.240+0000 7f0119c87640 1 -- 172.21.15.120:0/241647165 --> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f0114103fe0 con 0x7f00fc0391b0 2024-09-19T05:10:37.040 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.245+0000 7f0110ff9640 1 -- 172.21.15.120:0/241647165 <== mgr.14118 v2:172.21.15.120:6800/50152720 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f0114103fe0 con 0x7f00fc0391b0 2024-09-19T05:10:37.040 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.247+0000 7f0119c87640 1 -- 172.21.15.120:0/241647165 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f00fc0391b0 msgr2=0x7f00fc03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:37.040 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.247+0000 7f0119c87640 1 --2- 172.21.15.120:0/241647165 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f00fc0391b0 0x7f00fc03b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f01080098c0 tx=0x7f0108006db0 comp rx=0 tx=0).stop 2024-09-19T05:10:37.040 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.247+0000 7f0119c87640 1 -- 172.21.15.120:0/241647165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01141075c0 msgr2=0x7f011407db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:37.040 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.247+0000 7f0119c87640 1 --2- 172.21.15.120:0/241647165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01141075c0 0x7f011407db60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0104030520 tx=0x7f0104032dd0 comp rx=0 tx=0).stop 2024-09-19T05:10:37.040 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.247+0000 7f0119c87640 1 -- 172.21.15.120:0/241647165 shutdown_connections 2024-09-19T05:10:37.040 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.247+0000 7f0119c87640 1 --2- 172.21.15.120:0/241647165 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f00fc0391b0 0x7f00fc03b670 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:37.041 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.247+0000 7f0119c87640 1 --2- 172.21.15.120:0/241647165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f01141075c0 0x7f011407db60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:37.041 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.247+0000 7f0119c87640 1 -- 172.21.15.120:0/241647165 >> 172.21.15.120:0/241647165 conn(0x7f0114102d50 msgr2=0x7f01141038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:37.041 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.248+0000 7f0119c87640 1 -- 172.21.15.120:0/241647165 shutdown_connections 2024-09-19T05:10:37.041 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:36.248+0000 7f0119c87640 1 -- 172.21.15.120:0/241647165 wait complete. 2024-09-19T05:10:37.041 INFO:teuthology.orchestra.run.smithi120.stdout:Deploying unmanaged mgr service... 2024-09-19T05:10:37.283 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:37 smithi120 ceph-mon[30956]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:10:37.387 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:37 smithi120 ceph-mon[30956]: Saving service mon spec with placement count:5 2024-09-19T05:10:37.387 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:37 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' 2024-09-19T05:10:38.867 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:38 smithi120 ceph-mon[30956]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:10:38.868 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:38 smithi120 ceph-mon[30956]: Saving service mgr spec with placement count:2 2024-09-19T05:10:38.868 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:38 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' 2024-09-19T05:10:38.868 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:38 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' 2024-09-19T05:10:38.868 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:38 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' 2024-09-19T05:10:38.879 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T05:10:38.880 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.446+0000 7fe24ce4b640 1 Processor -- start 2024-09-19T05:10:38.880 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.446+0000 7fe24ce4b640 1 -- start start 2024-09-19T05:10:38.880 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.446+0000 7fe24ce4b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe248106470 0x7fe248106870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:38.880 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.446+0000 7fe24ce4b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe248106e40 con 0x7fe248106470 2024-09-19T05:10:38.880 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.446+0000 7fe24659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe248106470 0x7fe248106870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:38.880 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.446+0000 7fe24659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe248106470 0x7fe248106870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55354/0 (socket says 172.21.15.120:55354) 2024-09-19T05:10:38.881 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.446+0000 7fe24659c640 1 -- 172.21.15.120:0/4042041949 learned_addr learned my addr 172.21.15.120:0/4042041949 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:38.881 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.447+0000 7fe24659c640 1 -- 172.21.15.120:0/4042041949 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe248107670 con 0x7fe248106470 2024-09-19T05:10:38.881 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.447+0000 7fe24659c640 1 --2- 172.21.15.120:0/4042041949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe248106470 0x7fe248106870 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe238009820 tx=0x7fe23802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d74269753540457 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:38.881 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.447+0000 7fe245d9b640 1 -- 172.21.15.120:0/4042041949 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe238037070 con 0x7fe248106470 2024-09-19T05:10:38.881 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.448+0000 7fe245d9b640 1 -- 172.21.15.120:0/4042041949 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fe2380328d0 con 0x7fe248106470 2024-09-19T05:10:38.882 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.448+0000 7fe245d9b640 1 -- 172.21.15.120:0/4042041949 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2380307d0 con 0x7fe248106470 2024-09-19T05:10:38.882 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.448+0000 7fe24ce4b640 1 -- 172.21.15.120:0/4042041949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe248106470 msgr2=0x7fe248106870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:38.882 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.448+0000 7fe24ce4b640 1 --2- 172.21.15.120:0/4042041949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe248106470 0x7fe248106870 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe238009820 tx=0x7fe23802a270 comp rx=0 tx=0).stop 2024-09-19T05:10:38.882 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.448+0000 7fe24ce4b640 1 -- 172.21.15.120:0/4042041949 shutdown_connections 2024-09-19T05:10:38.882 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.448+0000 7fe24ce4b640 1 --2- 172.21.15.120:0/4042041949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe248106470 0x7fe248106870 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:38.882 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.448+0000 7fe24ce4b640 1 -- 172.21.15.120:0/4042041949 >> 172.21.15.120:0/4042041949 conn(0x7fe248101c00 msgr2=0x7fe248104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:38.883 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.448+0000 7fe24ce4b640 1 -- 172.21.15.120:0/4042041949 shutdown_connections 2024-09-19T05:10:38.883 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.448+0000 7fe24ce4b640 1 -- 172.21.15.120:0/4042041949 wait complete. 2024-09-19T05:10:38.883 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.449+0000 7fe24ce4b640 1 Processor -- start 2024-09-19T05:10:38.883 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.449+0000 7fe24ce4b640 1 -- start start 2024-09-19T05:10:38.883 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.449+0000 7fe24ce4b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe248106470 0x7fe24819b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:38.883 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.449+0000 7fe24ce4b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe24810aa20 con 0x7fe248106470 2024-09-19T05:10:38.884 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.449+0000 7fe24659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe248106470 0x7fe24819b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:38.884 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.449+0000 7fe24659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe248106470 0x7fe24819b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55360/0 (socket says 172.21.15.120:55360) 2024-09-19T05:10:38.884 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.449+0000 7fe24659c640 1 -- 172.21.15.120:0/333165966 learned_addr learned my addr 172.21.15.120:0/333165966 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:38.884 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.449+0000 7fe24659c640 1 -- 172.21.15.120:0/333165966 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24819bb20 con 0x7fe248106470 2024-09-19T05:10:38.884 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.450+0000 7fe24659c640 1 --2- 172.21.15.120:0/333165966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe248106470 0x7fe24819b5e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe2380097f0 tx=0x7fe238030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:38.885 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.450+0000 7fe23f7fe640 1 -- 172.21.15.120:0/333165966 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe238037040 con 0x7fe248106470 2024-09-19T05:10:38.885 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.450+0000 7fe23f7fe640 1 -- 172.21.15.120:0/333165966 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1071+0+0 (secure 0 0 0) 0x7fe238032bb0 con 0x7fe248106470 2024-09-19T05:10:38.885 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.450+0000 7fe23f7fe640 1 -- 172.21.15.120:0/333165966 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe23803a390 con 0x7fe248106470 2024-09-19T05:10:38.885 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.450+0000 7fe24ce4b640 1 -- 172.21.15.120:0/333165966 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe24819bdb0 con 0x7fe248106470 2024-09-19T05:10:38.885 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.450+0000 7fe24ce4b640 1 -- 172.21.15.120:0/333165966 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe24819eaa0 con 0x7fe248106470 2024-09-19T05:10:38.885 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.451+0000 7fe23f7fe640 1 -- 172.21.15.120:0/333165966 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fe23803a5d0 con 0x7fe248106470 2024-09-19T05:10:38.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.451+0000 7fe23f7fe640 1 --2- 172.21.15.120:0/333165966 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fe2340391b0 0x7fe23403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:38.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.451+0000 7fe23f7fe640 1 -- 172.21.15.120:0/333165966 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe23806c450 con 0x7fe248106470 2024-09-19T05:10:38.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.451+0000 7fe23ffff640 1 --2- 172.21.15.120:0/333165966 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fe2340391b0 0x7fe23403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:38.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.451+0000 7fe24ce4b640 1 -- 172.21.15.120:0/333165966 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2481068f0 con 0x7fe248106470 2024-09-19T05:10:38.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.451+0000 7fe23ffff640 1 --2- 172.21.15.120:0/333165966 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fe2340391b0 0x7fe23403b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe2300098c0 tx=0x7fe230006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:38.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.456+0000 7fe23f7fe640 1 -- 172.21.15.120:0/333165966 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe238040210 con 0x7fe248106470 2024-09-19T05:10:38.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.638+0000 7fe24ce4b640 1 -- 172.21.15.120:0/333165966 --> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fe24802d8d0 con 0x7fe2340391b0 2024-09-19T05:10:38.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.645+0000 7fe23f7fe640 1 -- 172.21.15.120:0/333165966 <== mgr.14118 v2:172.21.15.120:6800/50152720 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe24802d8d0 con 0x7fe2340391b0 2024-09-19T05:10:38.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.647+0000 7fe24ce4b640 1 -- 172.21.15.120:0/333165966 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fe2340391b0 msgr2=0x7fe23403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:38.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.647+0000 7fe24ce4b640 1 --2- 172.21.15.120:0/333165966 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fe2340391b0 0x7fe23403b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe2300098c0 tx=0x7fe230006db0 comp rx=0 tx=0).stop 2024-09-19T05:10:38.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.647+0000 7fe24ce4b640 1 -- 172.21.15.120:0/333165966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe248106470 msgr2=0x7fe24819b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:38.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.647+0000 7fe24ce4b640 1 --2- 172.21.15.120:0/333165966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe248106470 0x7fe24819b5e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe2380097f0 tx=0x7fe238030d00 comp rx=0 tx=0).stop 2024-09-19T05:10:38.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.647+0000 7fe24ce4b640 1 -- 172.21.15.120:0/333165966 shutdown_connections 2024-09-19T05:10:38.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.647+0000 7fe24ce4b640 1 --2- 172.21.15.120:0/333165966 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fe2340391b0 0x7fe23403b670 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:38.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.647+0000 7fe24ce4b640 1 --2- 172.21.15.120:0/333165966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe248106470 0x7fe24819b5e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:38.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.647+0000 7fe24ce4b640 1 -- 172.21.15.120:0/333165966 >> 172.21.15.120:0/333165966 conn(0x7fe248101c00 msgr2=0x7fe248102b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:38.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.648+0000 7fe24ce4b640 1 -- 172.21.15.120:0/333165966 shutdown_connections 2024-09-19T05:10:38.889 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:37.648+0000 7fe24ce4b640 1 -- 172.21.15.120:0/333165966 wait complete. 2024-09-19T05:10:40.662 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:40 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1773331707' entity='client.admin' 2024-09-19T05:10:40.662 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:40 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' 2024-09-19T05:10:40.670 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.290+0000 7fc17eb04640 1 Processor -- start 2024-09-19T05:10:40.670 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.290+0000 7fc17eb04640 1 -- start start 2024-09-19T05:10:40.670 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.290+0000 7fc17eb04640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1781075c0 0x7fc1781079c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:40.670 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.290+0000 7fc17eb04640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc178107f90 con 0x7fc1781075c0 2024-09-19T05:10:40.670 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.290+0000 7fc17c8a0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1781075c0 0x7fc1781079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:40.670 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.290+0000 7fc17c8a0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1781075c0 0x7fc1781079c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55372/0 (socket says 172.21.15.120:55372) 2024-09-19T05:10:40.670 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.290+0000 7fc17c8a0640 1 -- 172.21.15.120:0/230588281 learned_addr learned my addr 172.21.15.120:0/230588281 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:40.671 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.291+0000 7fc17c8a0640 1 -- 172.21.15.120:0/230588281 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1781087c0 con 0x7fc1781075c0 2024-09-19T05:10:40.671 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.291+0000 7fc17c8a0640 1 --2- 172.21.15.120:0/230588281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1781075c0 0x7fc1781079c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009820 tx=0x7fc16c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97fbc1e1c3319d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:40.671 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.292+0000 7fc1777fe640 1 -- 172.21.15.120:0/230588281 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc16c037070 con 0x7fc1781075c0 2024-09-19T05:10:40.671 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.292+0000 7fc1777fe640 1 -- 172.21.15.120:0/230588281 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc16c0328f0 con 0x7fc1781075c0 2024-09-19T05:10:40.671 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.292+0000 7fc1777fe640 1 -- 172.21.15.120:0/230588281 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc16c030740 con 0x7fc1781075c0 2024-09-19T05:10:40.671 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.292+0000 7fc17eb04640 1 -- 172.21.15.120:0/230588281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1781075c0 msgr2=0x7fc1781079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:40.671 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.292+0000 7fc17eb04640 1 --2- 172.21.15.120:0/230588281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1781075c0 0x7fc1781079c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009820 tx=0x7fc16c02a270 comp rx=0 tx=0).stop 2024-09-19T05:10:40.671 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.292+0000 7fc17eb04640 1 -- 172.21.15.120:0/230588281 shutdown_connections 2024-09-19T05:10:40.671 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.292+0000 7fc17eb04640 1 --2- 172.21.15.120:0/230588281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1781075c0 0x7fc1781079c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:40.671 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.292+0000 7fc17eb04640 1 -- 172.21.15.120:0/230588281 >> 172.21.15.120:0/230588281 conn(0x7fc178102d50 msgr2=0x7fc178105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:40.672 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.292+0000 7fc17eb04640 1 -- 172.21.15.120:0/230588281 shutdown_connections 2024-09-19T05:10:40.672 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.292+0000 7fc17eb04640 1 -- 172.21.15.120:0/230588281 wait complete. 2024-09-19T05:10:40.672 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.293+0000 7fc17eb04640 1 Processor -- start 2024-09-19T05:10:40.672 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.293+0000 7fc17eb04640 1 -- start start 2024-09-19T05:10:40.672 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.293+0000 7fc17eb04640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1781075c0 0x7fc17819b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:40.672 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.293+0000 7fc17eb04640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc17810bb70 con 0x7fc1781075c0 2024-09-19T05:10:40.672 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.293+0000 7fc17c8a0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1781075c0 0x7fc17819b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:40.672 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.293+0000 7fc17c8a0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1781075c0 0x7fc17819b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55388/0 (socket says 172.21.15.120:55388) 2024-09-19T05:10:40.672 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.293+0000 7fc17c8a0640 1 -- 172.21.15.120:0/1773331707 learned_addr learned my addr 172.21.15.120:0/1773331707 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:40.673 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.293+0000 7fc17c8a0640 1 -- 172.21.15.120:0/1773331707 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17819bb30 con 0x7fc1781075c0 2024-09-19T05:10:40.673 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.293+0000 7fc17c8a0640 1 --2- 172.21.15.120:0/1773331707 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1781075c0 0x7fc17819b5f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0097f0 tx=0x7fc16c030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:40.673 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.294+0000 7fc175ffb640 1 -- 172.21.15.120:0/1773331707 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc16c042070 con 0x7fc1781075c0 2024-09-19T05:10:40.673 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.294+0000 7fc175ffb640 1 -- 172.21.15.120:0/1773331707 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc16c030e80 con 0x7fc1781075c0 2024-09-19T05:10:40.673 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.294+0000 7fc17eb04640 1 -- 172.21.15.120:0/1773331707 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc17819bdc0 con 0x7fc1781075c0 2024-09-19T05:10:40.673 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.294+0000 7fc175ffb640 1 -- 172.21.15.120:0/1773331707 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc16c037040 con 0x7fc1781075c0 2024-09-19T05:10:40.673 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.294+0000 7fc17eb04640 1 -- 172.21.15.120:0/1773331707 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc17819eab0 con 0x7fc1781075c0 2024-09-19T05:10:40.673 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.295+0000 7fc175ffb640 1 -- 172.21.15.120:0/1773331707 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fc16c045070 con 0x7fc1781075c0 2024-09-19T05:10:40.673 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.295+0000 7fc17eb04640 1 -- 172.21.15.120:0/1773331707 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc17810bcf0 con 0x7fc1781075c0 2024-09-19T05:10:40.673 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.295+0000 7fc175ffb640 1 --2- 172.21.15.120:0/1773331707 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fc168039200 0x7fc16803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:40.673 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.295+0000 7fc175ffb640 1 -- 172.21.15.120:0/1773331707 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc16c06c4c0 con 0x7fc1781075c0 2024-09-19T05:10:40.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.295+0000 7fc177fff640 1 --2- 172.21.15.120:0/1773331707 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fc168039200 0x7fc16803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:40.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.296+0000 7fc177fff640 1 --2- 172.21.15.120:0/1773331707 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fc168039200 0x7fc16803b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc1640098c0 tx=0x7fc164006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:40.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.300+0000 7fc175ffb640 1 -- 172.21.15.120:0/1773331707 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc16c045360 con 0x7fc1781075c0 2024-09-19T05:10:40.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.489+0000 7fc17eb04640 1 -- 172.21.15.120:0/1773331707 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fc178107a40 con 0x7fc1781075c0 2024-09-19T05:10:40.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.492+0000 7fc175ffb640 1 -- 172.21.15.120:0/1773331707 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fc16c03db70 con 0x7fc1781075c0 2024-09-19T05:10:40.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.494+0000 7fc17eb04640 1 -- 172.21.15.120:0/1773331707 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fc168039200 msgr2=0x7fc16803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:40.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.494+0000 7fc17eb04640 1 --2- 172.21.15.120:0/1773331707 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fc168039200 0x7fc16803b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc1640098c0 tx=0x7fc164006db0 comp rx=0 tx=0).stop 2024-09-19T05:10:40.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.494+0000 7fc17eb04640 1 -- 172.21.15.120:0/1773331707 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1781075c0 msgr2=0x7fc17819b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:40.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.494+0000 7fc17eb04640 1 --2- 172.21.15.120:0/1773331707 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1781075c0 0x7fc17819b5f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0097f0 tx=0x7fc16c030c70 comp rx=0 tx=0).stop 2024-09-19T05:10:40.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.494+0000 7fc17eb04640 1 -- 172.21.15.120:0/1773331707 shutdown_connections 2024-09-19T05:10:40.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.494+0000 7fc17eb04640 1 --2- 172.21.15.120:0/1773331707 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7fc168039200 0x7fc16803b6c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:40.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.494+0000 7fc17eb04640 1 --2- 172.21.15.120:0/1773331707 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1781075c0 0x7fc17819b5f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:40.674 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.494+0000 7fc17eb04640 1 -- 172.21.15.120:0/1773331707 >> 172.21.15.120:0/1773331707 conn(0x7fc178102d50 msgr2=0x7fc178103900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:40.675 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.494+0000 7fc17eb04640 1 -- 172.21.15.120:0/1773331707 shutdown_connections 2024-09-19T05:10:40.675 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:39.495+0000 7fc17eb04640 1 -- 172.21.15.120:0/1773331707 wait complete. 2024-09-19T05:10:41.885 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.095+0000 7f84e9d01640 1 Processor -- start 2024-09-19T05:10:41.885 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.095+0000 7f84e9d01640 1 -- start start 2024-09-19T05:10:41.885 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.096+0000 7f84e9d01640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84e41075c0 0x7f84e41079c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:41.885 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.096+0000 7f84e9d01640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f84e4107f90 con 0x7f84e41075c0 2024-09-19T05:10:41.885 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.096+0000 7f84e37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84e41075c0 0x7f84e41079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:41.885 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.096+0000 7f84e37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84e41075c0 0x7f84e41079c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55402/0 (socket says 172.21.15.120:55402) 2024-09-19T05:10:41.885 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.096+0000 7f84e37fe640 1 -- 172.21.15.120:0/1946389691 learned_addr learned my addr 172.21.15.120:0/1946389691 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:41.885 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.096+0000 7f84e37fe640 1 -- 172.21.15.120:0/1946389691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e41087c0 con 0x7f84e41075c0 2024-09-19T05:10:41.885 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.097+0000 7f84e37fe640 1 --2- 172.21.15.120:0/1946389691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84e41075c0 0x7f84e41079c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009820 tx=0x7f84d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eff527ddd061cef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:41.885 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.097+0000 7f84e2ffd640 1 -- 172.21.15.120:0/1946389691 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84d4037070 con 0x7f84e41075c0 2024-09-19T05:10:41.885 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.097+0000 7f84e2ffd640 1 -- 172.21.15.120:0/1946389691 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f84d40328f0 con 0x7f84e41075c0 2024-09-19T05:10:41.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.097+0000 7f84e2ffd640 1 -- 172.21.15.120:0/1946389691 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84d4030740 con 0x7f84e41075c0 2024-09-19T05:10:41.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.097+0000 7f84e9d01640 1 -- 172.21.15.120:0/1946389691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84e41075c0 msgr2=0x7f84e41079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:41.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.097+0000 7f84e9d01640 1 --2- 172.21.15.120:0/1946389691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84e41075c0 0x7f84e41079c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009820 tx=0x7f84d402a270 comp rx=0 tx=0).stop 2024-09-19T05:10:41.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.097+0000 7f84e9d01640 1 -- 172.21.15.120:0/1946389691 shutdown_connections 2024-09-19T05:10:41.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.097+0000 7f84e9d01640 1 --2- 172.21.15.120:0/1946389691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84e41075c0 0x7f84e41079c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:41.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.097+0000 7f84e9d01640 1 -- 172.21.15.120:0/1946389691 >> 172.21.15.120:0/1946389691 conn(0x7f84e4102d50 msgr2=0x7f84e4105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:41.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.098+0000 7f84e9d01640 1 -- 172.21.15.120:0/1946389691 shutdown_connections 2024-09-19T05:10:41.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.098+0000 7f84e9d01640 1 -- 172.21.15.120:0/1946389691 wait complete. 2024-09-19T05:10:41.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.098+0000 7f84e9d01640 1 Processor -- start 2024-09-19T05:10:41.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.098+0000 7f84e9d01640 1 -- start start 2024-09-19T05:10:41.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.098+0000 7f84e9d01640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84e41075c0 0x7f84e419b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:41.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.098+0000 7f84e9d01640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f84e410bb70 con 0x7f84e41075c0 2024-09-19T05:10:41.886 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.099+0000 7f84e37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84e41075c0 0x7f84e419b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:41.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.099+0000 7f84e37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84e41075c0 0x7f84e419b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55410/0 (socket says 172.21.15.120:55410) 2024-09-19T05:10:41.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.099+0000 7f84e37fe640 1 -- 172.21.15.120:0/2161810930 learned_addr learned my addr 172.21.15.120:0/2161810930 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:41.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.099+0000 7f84e37fe640 1 -- 172.21.15.120:0/2161810930 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e419bb20 con 0x7f84e41075c0 2024-09-19T05:10:41.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.099+0000 7f84e37fe640 1 --2- 172.21.15.120:0/2161810930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84e41075c0 0x7f84e419b5e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009940 tx=0x7f84d40327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:41.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.099+0000 7f84e17fa640 1 -- 172.21.15.120:0/2161810930 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84d4042070 con 0x7f84e41075c0 2024-09-19T05:10:41.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.099+0000 7f84e17fa640 1 -- 172.21.15.120:0/2161810930 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f84d4030d00 con 0x7f84e41075c0 2024-09-19T05:10:41.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.099+0000 7f84e9d01640 1 -- 172.21.15.120:0/2161810930 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e419bdb0 con 0x7f84e41075c0 2024-09-19T05:10:41.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.099+0000 7f84e17fa640 1 -- 172.21.15.120:0/2161810930 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84d4037040 con 0x7f84e41075c0 2024-09-19T05:10:41.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.099+0000 7f84e9d01640 1 -- 172.21.15.120:0/2161810930 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e419eaa0 con 0x7f84e41075c0 2024-09-19T05:10:41.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.100+0000 7f84e17fa640 1 -- 172.21.15.120:0/2161810930 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f84d4045070 con 0x7f84e41075c0 2024-09-19T05:10:41.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.100+0000 7f84e9d01640 1 -- 172.21.15.120:0/2161810930 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84e410bcf0 con 0x7f84e41075c0 2024-09-19T05:10:41.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.100+0000 7f84e17fa640 1 --2- 172.21.15.120:0/2161810930 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f84d0039200 0x7f84d003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:41.887 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.100+0000 7f84e17fa640 1 -- 172.21.15.120:0/2161810930 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f84d406c480 con 0x7f84e41075c0 2024-09-19T05:10:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.100+0000 7f84daffd640 1 --2- 172.21.15.120:0/2161810930 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f84d0039200 0x7f84d003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.101+0000 7f84daffd640 1 --2- 172.21.15.120:0/2161810930 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f84d0039200 0x7f84d003b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f84cc0098c0 tx=0x7f84cc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.105+0000 7f84e17fa640 1 -- 172.21.15.120:0/2161810930 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f84d4046e00 con 0x7f84e41075c0 2024-09-19T05:10:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.291+0000 7f84e9d01640 1 -- 172.21.15.120:0/2161810930 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f84e4107a40 con 0x7f84e41075c0 2024-09-19T05:10:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.295+0000 7f84e17fa640 1 -- 172.21.15.120:0/2161810930 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f84d4045360 con 0x7f84e41075c0 2024-09-19T05:10:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.297+0000 7f84e9d01640 1 -- 172.21.15.120:0/2161810930 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f84d0039200 msgr2=0x7f84d003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.297+0000 7f84e9d01640 1 --2- 172.21.15.120:0/2161810930 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f84d0039200 0x7f84d003b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f84cc0098c0 tx=0x7f84cc006db0 comp rx=0 tx=0).stop 2024-09-19T05:10:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.297+0000 7f84e9d01640 1 -- 172.21.15.120:0/2161810930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84e41075c0 msgr2=0x7f84e419b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.297+0000 7f84e9d01640 1 --2- 172.21.15.120:0/2161810930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84e41075c0 0x7f84e419b5e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009940 tx=0x7f84d40327b0 comp rx=0 tx=0).stop 2024-09-19T05:10:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.297+0000 7f84e9d01640 1 -- 172.21.15.120:0/2161810930 shutdown_connections 2024-09-19T05:10:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.297+0000 7f84e9d01640 1 --2- 172.21.15.120:0/2161810930 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f84d0039200 0x7f84d003b6c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.297+0000 7f84e9d01640 1 --2- 172.21.15.120:0/2161810930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f84e41075c0 0x7f84e419b5e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.297+0000 7f84e9d01640 1 -- 172.21.15.120:0/2161810930 >> 172.21.15.120:0/2161810930 conn(0x7f84e4102d50 msgr2=0x7f84e41038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:41.888 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.297+0000 7f84e9d01640 1 -- 172.21.15.120:0/2161810930 shutdown_connections 2024-09-19T05:10:41.889 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:41.297+0000 7f84e9d01640 1 -- 172.21.15.120:0/2161810930 wait complete. 2024-09-19T05:10:41.889 INFO:teuthology.orchestra.run.smithi120.stdout:Enabling the dashboard module... 2024-09-19T05:10:42.508 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:42 smithi120 ceph-mon[30956]: from='mgr.14118 172.21.15.120:0/4043651396' entity='mgr.x' 2024-09-19T05:10:42.508 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:42 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2161810930' entity='client.admin' 2024-09-19T05:10:43.455 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:43 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: ignoring --setuser ceph since I am not root 2024-09-19T05:10:43.456 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:43 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: ignoring --setgroup ceph since I am not root 2024-09-19T05:10:43.456 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:43 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:43.317+0000 7f3990fcf040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T05:10:43.456 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:43 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:43.375+0000 7f3990fcf040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:10:43.457 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:43 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/4017457566' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T05:10:43.737 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:43 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:43.524+0000 7f3990fcf040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:10:43.738 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:43 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:43.589+0000 7f3990fcf040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:10:43.738 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:43 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:43.735+0000 7f3990fcf040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:10:44.066 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:43 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:43.879+0000 7f3990fcf040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:10:44.074 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.273+0000 7f7fcb2fc640 1 Processor -- start 2024-09-19T05:10:44.074 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.273+0000 7f7fcb2fc640 1 -- start start 2024-09-19T05:10:44.074 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.273+0000 7f7fcb2fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fc41075c0 0x7f7fc41079c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:44.074 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.273+0000 7f7fcb2fc640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc4107f90 con 0x7f7fc41075c0 2024-09-19T05:10:44.074 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.274+0000 7f7fc9098640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fc41075c0 0x7f7fc41079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:44.074 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.274+0000 7f7fc9098640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fc41075c0 0x7f7fc41079c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55414/0 (socket says 172.21.15.120:55414) 2024-09-19T05:10:44.074 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.274+0000 7f7fc9098640 1 -- 172.21.15.120:0/3332214904 learned_addr learned my addr 172.21.15.120:0/3332214904 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:44.074 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.274+0000 7f7fc9098640 1 -- 172.21.15.120:0/3332214904 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc41087c0 con 0x7f7fc41075c0 2024-09-19T05:10:44.074 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.274+0000 7f7fc9098640 1 --2- 172.21.15.120:0/3332214904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fc41075c0 0x7f7fc41079c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0009820 tx=0x7f7fc002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6d2c256927bd44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:44.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.275+0000 7f7fbbfff640 1 -- 172.21.15.120:0/3332214904 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc0037070 con 0x7f7fc41075c0 2024-09-19T05:10:44.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.275+0000 7f7fbbfff640 1 -- 172.21.15.120:0/3332214904 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7fc00328f0 con 0x7f7fc41075c0 2024-09-19T05:10:44.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.275+0000 7f7fbbfff640 1 -- 172.21.15.120:0/3332214904 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc0030740 con 0x7f7fc41075c0 2024-09-19T05:10:44.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.275+0000 7f7fcb2fc640 1 -- 172.21.15.120:0/3332214904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fc41075c0 msgr2=0x7f7fc41079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:44.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.275+0000 7f7fcb2fc640 1 --2- 172.21.15.120:0/3332214904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fc41075c0 0x7f7fc41079c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0009820 tx=0x7f7fc002a270 comp rx=0 tx=0).stop 2024-09-19T05:10:44.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.275+0000 7f7fcb2fc640 1 -- 172.21.15.120:0/3332214904 shutdown_connections 2024-09-19T05:10:44.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.275+0000 7f7fcb2fc640 1 --2- 172.21.15.120:0/3332214904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fc41075c0 0x7f7fc41079c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:44.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.275+0000 7f7fcb2fc640 1 -- 172.21.15.120:0/3332214904 >> 172.21.15.120:0/3332214904 conn(0x7f7fc4102d50 msgr2=0x7f7fc4105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:44.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.275+0000 7f7fcb2fc640 1 -- 172.21.15.120:0/3332214904 shutdown_connections 2024-09-19T05:10:44.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.275+0000 7f7fcb2fc640 1 -- 172.21.15.120:0/3332214904 wait complete. 2024-09-19T05:10:44.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.276+0000 7f7fcb2fc640 1 Processor -- start 2024-09-19T05:10:44.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.276+0000 7f7fcb2fc640 1 -- start start 2024-09-19T05:10:44.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.276+0000 7f7fcb2fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fc41075c0 0x7f7fc419b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:44.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.276+0000 7f7fcb2fc640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc410bb70 con 0x7f7fc41075c0 2024-09-19T05:10:44.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.276+0000 7f7fc9098640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fc41075c0 0x7f7fc419b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:44.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.276+0000 7f7fc9098640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fc41075c0 0x7f7fc419b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55430/0 (socket says 172.21.15.120:55430) 2024-09-19T05:10:44.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.276+0000 7f7fc9098640 1 -- 172.21.15.120:0/4017457566 learned_addr learned my addr 172.21.15.120:0/4017457566 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:44.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.277+0000 7f7fc9098640 1 -- 172.21.15.120:0/4017457566 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc419bb20 con 0x7f7fc41075c0 2024-09-19T05:10:44.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.277+0000 7f7fc9098640 1 --2- 172.21.15.120:0/4017457566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fc41075c0 0x7f7fc419b5e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0009940 tx=0x7f7fc00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:44.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.277+0000 7f7fba7fc640 1 -- 172.21.15.120:0/4017457566 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc0042070 con 0x7f7fc41075c0 2024-09-19T05:10:44.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.277+0000 7f7fba7fc640 1 -- 172.21.15.120:0/4017457566 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7fc0030d00 con 0x7f7fc41075c0 2024-09-19T05:10:44.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.277+0000 7f7fcb2fc640 1 -- 172.21.15.120:0/4017457566 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc419bdb0 con 0x7f7fc41075c0 2024-09-19T05:10:44.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.277+0000 7f7fba7fc640 1 -- 172.21.15.120:0/4017457566 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc0037040 con 0x7f7fc41075c0 2024-09-19T05:10:44.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.277+0000 7f7fcb2fc640 1 -- 172.21.15.120:0/4017457566 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc419eaa0 con 0x7f7fc41075c0 2024-09-19T05:10:44.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.278+0000 7f7fba7fc640 1 -- 172.21.15.120:0/4017457566 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f7fc0045070 con 0x7f7fc41075c0 2024-09-19T05:10:44.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.278+0000 7f7fcb2fc640 1 -- 172.21.15.120:0/4017457566 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fc410bcf0 con 0x7f7fc41075c0 2024-09-19T05:10:44.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.278+0000 7f7fba7fc640 1 --2- 172.21.15.120:0/4017457566 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f7fb00391b0 0x7f7fb003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:44.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.278+0000 7f7fba7fc640 1 -- 172.21.15.120:0/4017457566 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7fc006c3b0 con 0x7f7fc41075c0 2024-09-19T05:10:44.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.278+0000 7f7fc8897640 1 --2- 172.21.15.120:0/4017457566 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f7fb00391b0 0x7f7fb003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:44.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.278+0000 7f7fc8897640 1 --2- 172.21.15.120:0/4017457566 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f7fb00391b0 0x7f7fb003b670 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40098c0 tx=0x7f7fb4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:44.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.283+0000 7f7fba7fc640 1 -- 172.21.15.120:0/4017457566 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7fc003b330 con 0x7f7fc41075c0 2024-09-19T05:10:44.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:42.506+0000 7f7fcb2fc640 1 -- 172.21.15.120:0/4017457566 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f7fc419ec70 con 0x7f7fc41075c0 2024-09-19T05:10:44.078 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:43.170+0000 7f7fba7fc640 1 -- 172.21.15.120:0/4017457566 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f7fc0045d20 con 0x7f7fc41075c0 2024-09-19T05:10:44.078 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:43.172+0000 7f7fba7fc640 1 -- 172.21.15.120:0/4017457566 <== mon.0 v2:172.21.15.120:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f7fc003cb00 con 0x7f7fc41075c0 2024-09-19T05:10:44.078 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:43.173+0000 7f7fcb2fc640 1 -- 172.21.15.120:0/4017457566 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f7fb00391b0 msgr2=0x7f7fb003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:44.078 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:43.173+0000 7f7fcb2fc640 1 --2- 172.21.15.120:0/4017457566 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f7fb00391b0 0x7f7fb003b670 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40098c0 tx=0x7f7fb4006db0 comp rx=0 tx=0).stop 2024-09-19T05:10:44.078 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:43.173+0000 7f7fcb2fc640 1 -- 172.21.15.120:0/4017457566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fc41075c0 msgr2=0x7f7fc419b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:44.078 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:43.173+0000 7f7fcb2fc640 1 --2- 172.21.15.120:0/4017457566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fc41075c0 0x7f7fc419b5e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0009940 tx=0x7f7fc00327b0 comp rx=0 tx=0).stop 2024-09-19T05:10:44.078 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:43.173+0000 7f7fcb2fc640 1 -- 172.21.15.120:0/4017457566 shutdown_connections 2024-09-19T05:10:44.078 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:43.173+0000 7f7fcb2fc640 1 --2- 172.21.15.120:0/4017457566 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7f7fb00391b0 0x7f7fb003b670 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:44.078 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:43.173+0000 7f7fcb2fc640 1 --2- 172.21.15.120:0/4017457566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7fc41075c0 0x7f7fc419b5e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:44.078 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:43.173+0000 7f7fcb2fc640 1 -- 172.21.15.120:0/4017457566 >> 172.21.15.120:0/4017457566 conn(0x7f7fc4102d50 msgr2=0x7f7fc41038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:44.078 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:43.173+0000 7f7fcb2fc640 1 -- 172.21.15.120:0/4017457566 shutdown_connections 2024-09-19T05:10:44.078 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:43.173+0000 7f7fcb2fc640 1 -- 172.21.15.120:0/4017457566 wait complete. 2024-09-19T05:10:44.326 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:44 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/4017457566' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T05:10:44.326 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:44 smithi120 ceph-mon[30956]: mgrmap e9: x(active, since 19s) 2024-09-19T05:10:44.327 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:44 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:44.197+0000 7f3990fcf040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:10:44.327 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:44 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:44.257+0000 7f3990fcf040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:10:44.625 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:44 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:44.456+0000 7f3990fcf040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:10:45.344 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:10:45.350 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T05:10:45.351 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T05:10:45.351 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T05:10:45.351 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T05:10:45.351 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:10:45.351 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.521+0000 7fef04512640 1 Processor -- start 2024-09-19T05:10:45.351 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.521+0000 7fef04512640 1 -- start start 2024-09-19T05:10:45.351 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.521+0000 7fef04512640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feefc107fe0 0x7feefc10a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:45.351 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.521+0000 7fef04512640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7feefc063510 con 0x7feefc107fe0 2024-09-19T05:10:45.351 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.522+0000 7fef022ae640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feefc107fe0 0x7feefc10a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:45.351 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.522+0000 7fef022ae640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feefc107fe0 0x7feefc10a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55464/0 (socket says 172.21.15.120:55464) 2024-09-19T05:10:45.351 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.522+0000 7fef022ae640 1 -- 172.21.15.120:0/1160539038 learned_addr learned my addr 172.21.15.120:0/1160539038 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:45.351 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.522+0000 7fef022ae640 1 -- 172.21.15.120:0/1160539038 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feefc10a910 con 0x7feefc107fe0 2024-09-19T05:10:45.351 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.523+0000 7fef022ae640 1 --2- 172.21.15.120:0/1160539038 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feefc107fe0 0x7feefc10a3d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feeec009820 tx=0x7feeec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0259fb38bc1eb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:45.352 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.523+0000 7fef012ac640 1 -- 172.21.15.120:0/1160539038 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeec037070 con 0x7feefc107fe0 2024-09-19T05:10:45.352 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.523+0000 7fef012ac640 1 -- 172.21.15.120:0/1160539038 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feeec0328f0 con 0x7feefc107fe0 2024-09-19T05:10:45.352 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.523+0000 7fef012ac640 1 -- 172.21.15.120:0/1160539038 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeec030740 con 0x7feefc107fe0 2024-09-19T05:10:45.352 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.524+0000 7fef04512640 1 -- 172.21.15.120:0/1160539038 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feefc107fe0 msgr2=0x7feefc10a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:45.352 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.524+0000 7fef04512640 1 --2- 172.21.15.120:0/1160539038 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feefc107fe0 0x7feefc10a3d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7feeec009820 tx=0x7feeec02a270 comp rx=0 tx=0).stop 2024-09-19T05:10:45.352 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.524+0000 7fef04512640 1 -- 172.21.15.120:0/1160539038 shutdown_connections 2024-09-19T05:10:45.352 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.524+0000 7fef04512640 1 --2- 172.21.15.120:0/1160539038 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feefc107fe0 0x7feefc10a3d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:45.352 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.524+0000 7fef04512640 1 -- 172.21.15.120:0/1160539038 >> 172.21.15.120:0/1160539038 conn(0x7feefc101c00 msgr2=0x7feefc104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:45.352 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.524+0000 7fef04512640 1 -- 172.21.15.120:0/1160539038 shutdown_connections 2024-09-19T05:10:45.352 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.524+0000 7fef04512640 1 -- 172.21.15.120:0/1160539038 wait complete. 2024-09-19T05:10:45.352 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.524+0000 7fef04512640 1 Processor -- start 2024-09-19T05:10:45.352 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.524+0000 7fef04512640 1 -- start start 2024-09-19T05:10:45.352 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.525+0000 7fef04512640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feefc107fe0 0x7feefc19b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:45.353 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.525+0000 7fef04512640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7feefc10b990 con 0x7feefc107fe0 2024-09-19T05:10:45.353 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.525+0000 7fef022ae640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feefc107fe0 0x7feefc19b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:45.353 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.525+0000 7fef022ae640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feefc107fe0 0x7feefc19b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55466/0 (socket says 172.21.15.120:55466) 2024-09-19T05:10:45.353 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.525+0000 7fef022ae640 1 -- 172.21.15.120:0/3137662472 learned_addr learned my addr 172.21.15.120:0/3137662472 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:45.353 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.525+0000 7fef022ae640 1 -- 172.21.15.120:0/3137662472 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feefc19bab0 con 0x7feefc107fe0 2024-09-19T05:10:45.353 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.525+0000 7fef022ae640 1 --2- 172.21.15.120:0/3137662472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feefc107fe0 0x7feefc19b570 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feeec0097f0 tx=0x7feeec030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:45.353 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.525+0000 7feef37fe640 1 -- 172.21.15.120:0/3137662472 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeec042070 con 0x7feefc107fe0 2024-09-19T05:10:45.353 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.525+0000 7feef37fe640 1 -- 172.21.15.120:0/3137662472 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feeec030d80 con 0x7feefc107fe0 2024-09-19T05:10:45.353 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.525+0000 7fef04512640 1 -- 172.21.15.120:0/3137662472 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feefc19bd40 con 0x7feefc107fe0 2024-09-19T05:10:45.353 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.525+0000 7feef37fe640 1 -- 172.21.15.120:0/3137662472 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feeec037040 con 0x7feefc107fe0 2024-09-19T05:10:45.353 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.525+0000 7fef04512640 1 -- 172.21.15.120:0/3137662472 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feefc19ea30 con 0x7feefc107fe0 2024-09-19T05:10:45.353 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.526+0000 7fef04512640 1 -- 172.21.15.120:0/3137662472 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feefc108440 con 0x7feefc107fe0 2024-09-19T05:10:45.353 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.527+0000 7feef37fe640 1 -- 172.21.15.120:0/3137662472 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7feeec045070 con 0x7feefc107fe0 2024-09-19T05:10:45.354 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.527+0000 7feef37fe640 1 --2- 172.21.15.120:0/3137662472 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7feee8039200 0x7feee803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:45.354 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.527+0000 7feef37fe640 1 -- 172.21.15.120:0/3137662472 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7feeec06c4e0 con 0x7feefc107fe0 2024-09-19T05:10:45.354 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.527+0000 7fef01aad640 1 -- 172.21.15.120:0/3137662472 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7feee8039200 msgr2=0x7feee803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.120:6800/50152720 2024-09-19T05:10:45.354 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.527+0000 7fef01aad640 1 --2- 172.21.15.120:0/3137662472 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7feee8039200 0x7feee803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:10:45.354 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.532+0000 7feef37fe640 1 -- 172.21.15.120:0/3137662472 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feeec045360 con 0x7feefc107fe0 2024-09-19T05:10:45.354 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.728+0000 7fef01aad640 1 -- 172.21.15.120:0/3137662472 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7feee8039200 msgr2=0x7feee803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.120:6800/50152720 2024-09-19T05:10:45.354 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.728+0000 7fef01aad640 1 --2- 172.21.15.120:0/3137662472 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7feee8039200 0x7feee803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:10:45.354 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.746+0000 7fef04512640 1 -- 172.21.15.120:0/3137662472 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7feefc19ec00 con 0x7feefc107fe0 2024-09-19T05:10:45.354 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.746+0000 7feef37fe640 1 -- 172.21.15.120:0/3137662472 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7feefc19ec00 con 0x7feefc107fe0 2024-09-19T05:10:45.354 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.749+0000 7fef04512640 1 -- 172.21.15.120:0/3137662472 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7feee8039200 msgr2=0x7feee803b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:10:45.354 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.749+0000 7fef04512640 1 --2- 172.21.15.120:0/3137662472 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7feee8039200 0x7feee803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:45.355 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.749+0000 7fef04512640 1 -- 172.21.15.120:0/3137662472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feefc107fe0 msgr2=0x7feefc19b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:45.355 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.749+0000 7fef04512640 1 --2- 172.21.15.120:0/3137662472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feefc107fe0 0x7feefc19b570 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feeec0097f0 tx=0x7feeec030c70 comp rx=0 tx=0).stop 2024-09-19T05:10:45.355 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.749+0000 7fef04512640 1 -- 172.21.15.120:0/3137662472 shutdown_connections 2024-09-19T05:10:45.355 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.749+0000 7fef04512640 1 --2- 172.21.15.120:0/3137662472 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7feee8039200 0x7feee803b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:45.355 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.749+0000 7fef04512640 1 --2- 172.21.15.120:0/3137662472 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feefc107fe0 0x7feefc19b570 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:45.355 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.749+0000 7fef04512640 1 -- 172.21.15.120:0/3137662472 >> 172.21.15.120:0/3137662472 conn(0x7feefc101c00 msgr2=0x7feefc102790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:45.355 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.749+0000 7fef04512640 1 -- 172.21.15.120:0/3137662472 shutdown_connections 2024-09-19T05:10:45.355 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:44.749+0000 7fef04512640 1 -- 172.21.15.120:0/3137662472 wait complete. 2024-09-19T05:10:45.355 INFO:teuthology.orchestra.run.smithi120.stdout:Waiting for the mgr to restart... 2024-09-19T05:10:45.355 INFO:teuthology.orchestra.run.smithi120.stdout:Waiting for mgr epoch 9... 2024-09-19T05:10:45.451 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:45 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/3137662472' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T05:10:45.451 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:45 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:45.380+0000 7f3990fcf040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:10:45.727 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:45 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:45.449+0000 7f3990fcf040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:10:46.285 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:46 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:46.168+0000 7f3990fcf040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T05:10:46.285 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:46 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:46.283+0000 7f3990fcf040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:10:46.625 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:46 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:46.426+0000 7f3990fcf040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:10:46.625 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:46 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:46.486+0000 7f3990fcf040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:10:46.918 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:46 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:46.633+0000 7f3990fcf040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T05:10:46.918 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:46 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:46.700+0000 7f3990fcf040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:10:46.918 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:46 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:46.759+0000 7f3990fcf040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:10:46.918 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:46 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:46.916+0000 7f3990fcf040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:10:47.189 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:46 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:46.980+0000 7f3990fcf040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:10:47.189 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:47 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:47.047+0000 7f3990fcf040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:10:47.189 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:47 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:47.128+0000 7f3990fcf040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:10:47.189 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:47 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:47.187+0000 7f3990fcf040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:10:47.625 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:47 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:47.246+0000 7f3990fcf040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:10:48.375 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:48 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:48.025+0000 7f3990fcf040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:10:48.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:48 smithi120 ceph-mon[30956]: Active manager daemon x restarted 2024-09-19T05:10:48.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:48 smithi120 ceph-mon[30956]: Activating manager daemon x 2024-09-19T05:10:48.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:48 smithi120 ceph-mon[30956]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T05:10:48.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:48 smithi120 ceph-mon[30956]: mgrmap e10: x(active, starting, since 0.00333561s) 2024-09-19T05:10:48.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:10:48.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T05:10:48.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T05:10:48.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T05:10:48.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T05:10:48.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:48 smithi120 ceph-mon[30956]: Manager daemon x is now available 2024-09-19T05:10:48.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:10:48.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T05:10:48.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T05:10:49.852 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:49 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:49.532+0000 7f38f6a98640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:05:10:49] ENGINE Error in HTTPServer.serve 2024-09-19T05:10:49.852 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:49 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: Traceback (most recent call last): 2024-09-19T05:10:49.852 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:49 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T05:10:49.853 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:49 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: self._connections.run(self.expiration_interval) 2024-09-19T05:10:49.853 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:49 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T05:10:49.853 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:49 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: self._run(expiration_interval) 2024-09-19T05:10:49.853 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:49 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T05:10:49.853 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:49 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T05:10:49.853 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:49 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T05:10:49.853 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:49 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T05:10:49.853 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:49 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T05:10:49.853 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:49 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: s = self.context.wrap_socket( 2024-09-19T05:10:49.853 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:49 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T05:10:49.853 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:49 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: return self.sslsocket_class._create( 2024-09-19T05:10:49.853 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:49 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T05:10:49.854 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:49 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: self.do_handshake() 2024-09-19T05:10:49.854 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:49 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T05:10:49.854 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:49 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: self._sslobj.do_handshake() 2024-09-19T05:10:49.854 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:49 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T05:10:49.854 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:10:49 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:10:49.861 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout { 2024-09-19T05:10:49.861 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T05:10:49.861 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T05:10:49.861 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout } 2024-09-19T05:10:49.861 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.803+0000 7ff8b7b0b640 1 Processor -- start 2024-09-19T05:10:49.861 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.803+0000 7ff8b7b0b640 1 -- start start 2024-09-19T05:10:49.862 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.803+0000 7ff8b7b0b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8b0107a70 0x7ff8b0107e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:49.862 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.803+0000 7ff8b7b0b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b0108440 con 0x7ff8b0107a70 2024-09-19T05:10:49.862 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.804+0000 7ff8b58a7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8b0107a70 0x7ff8b0107e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:49.862 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.804+0000 7ff8b58a7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8b0107a70 0x7ff8b0107e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35420/0 (socket says 172.21.15.120:35420) 2024-09-19T05:10:49.862 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.804+0000 7ff8b58a7640 1 -- 172.21.15.120:0/3720739866 learned_addr learned my addr 172.21.15.120:0/3720739866 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:49.862 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.804+0000 7ff8b58a7640 1 -- 172.21.15.120:0/3720739866 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b01066d0 con 0x7ff8b0107a70 2024-09-19T05:10:49.862 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.805+0000 7ff8b58a7640 1 --2- 172.21.15.120:0/3720739866 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8b0107a70 0x7ff8b0107e70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009820 tx=0x7ff8ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4463cf8ad95d4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:49.862 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.805+0000 7ff8b48a5640 1 -- 172.21.15.120:0/3720739866 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8ac037070 con 0x7ff8b0107a70 2024-09-19T05:10:49.862 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.805+0000 7ff8b48a5640 1 -- 172.21.15.120:0/3720739866 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff8ac0328f0 con 0x7ff8b0107a70 2024-09-19T05:10:49.862 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.805+0000 7ff8b48a5640 1 -- 172.21.15.120:0/3720739866 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8ac030740 con 0x7ff8b0107a70 2024-09-19T05:10:49.862 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.805+0000 7ff8b7b0b640 1 -- 172.21.15.120:0/3720739866 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8b0107a70 msgr2=0x7ff8b0107e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:49.862 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.805+0000 7ff8b7b0b640 1 --2- 172.21.15.120:0/3720739866 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8b0107a70 0x7ff8b0107e70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009820 tx=0x7ff8ac02a270 comp rx=0 tx=0).stop 2024-09-19T05:10:49.862 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.806+0000 7ff8b7b0b640 1 -- 172.21.15.120:0/3720739866 shutdown_connections 2024-09-19T05:10:49.863 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.806+0000 7ff8b7b0b640 1 --2- 172.21.15.120:0/3720739866 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8b0107a70 0x7ff8b0107e70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:49.863 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.806+0000 7ff8b7b0b640 1 -- 172.21.15.120:0/3720739866 >> 172.21.15.120:0/3720739866 conn(0x7ff8b0101470 msgr2=0x7ff8b0103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:49.863 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.806+0000 7ff8b7b0b640 1 -- 172.21.15.120:0/3720739866 shutdown_connections 2024-09-19T05:10:49.863 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.806+0000 7ff8b7b0b640 1 -- 172.21.15.120:0/3720739866 wait complete. 2024-09-19T05:10:49.863 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.806+0000 7ff8b7b0b640 1 Processor -- start 2024-09-19T05:10:49.863 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.806+0000 7ff8b7b0b640 1 -- start start 2024-09-19T05:10:49.863 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.806+0000 7ff8b7b0b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8b0107a70 0x7ff8b019b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:49.863 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.806+0000 7ff8b7b0b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b010aa90 con 0x7ff8b0107a70 2024-09-19T05:10:49.863 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.807+0000 7ff8b58a7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8b0107a70 0x7ff8b019b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:49.863 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.807+0000 7ff8b58a7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8b0107a70 0x7ff8b019b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35422/0 (socket says 172.21.15.120:35422) 2024-09-19T05:10:49.863 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.807+0000 7ff8b58a7640 1 -- 172.21.15.120:0/350361108 learned_addr learned my addr 172.21.15.120:0/350361108 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:49.863 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.807+0000 7ff8b58a7640 1 -- 172.21.15.120:0/350361108 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b019bb30 con 0x7ff8b0107a70 2024-09-19T05:10:49.863 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.807+0000 7ff8b58a7640 1 --2- 172.21.15.120:0/350361108 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8b0107a70 0x7ff8b019b5f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009940 tx=0x7ff8ac0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:49.864 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.807+0000 7ff8a2ffd640 1 -- 172.21.15.120:0/350361108 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8ac042070 con 0x7ff8b0107a70 2024-09-19T05:10:49.864 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.807+0000 7ff8a2ffd640 1 -- 172.21.15.120:0/350361108 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff8ac030d00 con 0x7ff8b0107a70 2024-09-19T05:10:49.864 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.807+0000 7ff8b7b0b640 1 -- 172.21.15.120:0/350361108 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8b019bdc0 con 0x7ff8b0107a70 2024-09-19T05:10:49.864 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.807+0000 7ff8a2ffd640 1 -- 172.21.15.120:0/350361108 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8ac037040 con 0x7ff8b0107a70 2024-09-19T05:10:49.864 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.807+0000 7ff8b7b0b640 1 -- 172.21.15.120:0/350361108 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8b019eab0 con 0x7ff8b0107a70 2024-09-19T05:10:49.864 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.808+0000 7ff8a2ffd640 1 -- 172.21.15.120:0/350361108 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7ff8ac045070 con 0x7ff8b0107a70 2024-09-19T05:10:49.864 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.808+0000 7ff8a2ffd640 1 --2- 172.21.15.120:0/350361108 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7ff89c039200 0x7ff89c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:49.864 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.808+0000 7ff8b7b0b640 1 -- 172.21.15.120:0/350361108 --> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff8b0107ef0 con 0x7ff89c039200 2024-09-19T05:10:49.864 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.808+0000 7ff8a2ffd640 1 -- 172.21.15.120:0/350361108 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff8ac06d230 con 0x7ff8b0107a70 2024-09-19T05:10:49.864 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.808+0000 7ff8b50a6640 1 -- 172.21.15.120:0/350361108 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7ff89c039200 msgr2=0x7ff89c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.120:6800/50152720 2024-09-19T05:10:49.865 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:45.808+0000 7ff8b50a6640 1 --2- 172.21.15.120:0/350361108 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7ff89c039200 0x7ff89c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:10:49.865 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:46.009+0000 7ff8b50a6640 1 -- 172.21.15.120:0/350361108 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7ff89c039200 msgr2=0x7ff89c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.120:6800/50152720 2024-09-19T05:10:49.865 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:46.009+0000 7ff8b50a6640 1 --2- 172.21.15.120:0/350361108 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7ff89c039200 0x7ff89c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:10:49.865 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:46.410+0000 7ff8b50a6640 1 -- 172.21.15.120:0/350361108 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7ff89c039200 msgr2=0x7ff89c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.120:6800/50152720 2024-09-19T05:10:49.865 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:46.410+0000 7ff8b50a6640 1 --2- 172.21.15.120:0/350361108 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7ff89c039200 0x7ff89c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T05:10:49.865 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:47.211+0000 7ff8b50a6640 1 -- 172.21.15.120:0/350361108 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7ff89c039200 msgr2=0x7ff89c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.120:6800/50152720 2024-09-19T05:10:49.865 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:47.211+0000 7ff8b50a6640 1 --2- 172.21.15.120:0/350361108 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7ff89c039200 0x7ff89c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T05:10:49.865 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:48.029+0000 7ff8a2ffd640 1 -- 172.21.15.120:0/350361108 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7ff8ac06bce0 con 0x7ff8b0107a70 2024-09-19T05:10:49.866 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:48.029+0000 7ff8a2ffd640 1 -- 172.21.15.120:0/350361108 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7ff89c039200 msgr2=0x7ff89c03b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:10:49.866 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:48.029+0000 7ff8a2ffd640 1 --2- 172.21.15.120:0/350361108 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7ff89c039200 0x7ff89c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:49.866 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:49.030+0000 7ff8a2ffd640 1 -- 172.21.15.120:0/350361108 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7ff8ac02fd80 con 0x7ff8b0107a70 2024-09-19T05:10:49.866 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:49.030+0000 7ff8a2ffd640 1 --2- 172.21.15.120:0/350361108 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7ff89c03cad0 0x7ff89c03eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:49.866 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:49.030+0000 7ff8a2ffd640 1 -- 172.21.15.120:0/350361108 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff8ac043e50 con 0x7ff89c03cad0 2024-09-19T05:10:49.866 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:49.031+0000 7ff8b50a6640 1 --2- 172.21.15.120:0/350361108 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7ff89c03cad0 0x7ff89c03eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:49.866 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:49.032+0000 7ff8b50a6640 1 --2- 172.21.15.120:0/350361108 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7ff89c03cad0 0x7ff89c03eec0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4003980 tx=0x7ff8a4006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:49.866 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:49.032+0000 7ff8a2ffd640 1 -- 172.21.15.120:0/350361108 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7ff8ac043e50 con 0x7ff89c03cad0 2024-09-19T05:10:49.866 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:49.039+0000 7ff8b7b0b640 1 -- 172.21.15.120:0/350361108 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7ff8b0074b50 con 0x7ff89c03cad0 2024-09-19T05:10:49.866 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:49.039+0000 7ff8a2ffd640 1 -- 172.21.15.120:0/350361108 <== mgr.14150 v2:172.21.15.120:6800/955692128 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7ff8b0074b50 con 0x7ff89c03cad0 2024-09-19T05:10:49.866 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:49.039+0000 7ff8b7b0b640 1 -- 172.21.15.120:0/350361108 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7ff89c03cad0 msgr2=0x7ff89c03eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:49.866 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:49.039+0000 7ff8b7b0b640 1 --2- 172.21.15.120:0/350361108 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7ff89c03cad0 0x7ff89c03eec0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4003980 tx=0x7ff8a4006e10 comp rx=0 tx=0).stop 2024-09-19T05:10:49.866 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:49.039+0000 7ff8b7b0b640 1 -- 172.21.15.120:0/350361108 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8b0107a70 msgr2=0x7ff8b019b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:49.867 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:49.039+0000 7ff8b7b0b640 1 --2- 172.21.15.120:0/350361108 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8b0107a70 0x7ff8b019b5f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009940 tx=0x7ff8ac0327b0 comp rx=0 tx=0).stop 2024-09-19T05:10:49.867 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:49.039+0000 7ff8b7b0b640 1 -- 172.21.15.120:0/350361108 shutdown_connections 2024-09-19T05:10:49.867 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:49.040+0000 7ff8b7b0b640 1 --2- 172.21.15.120:0/350361108 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7ff89c03cad0 0x7ff89c03eec0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:49.867 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:49.040+0000 7ff8b7b0b640 1 --2- 172.21.15.120:0/350361108 >> [v2:172.21.15.120:6800/50152720,v1:172.21.15.120:6801/50152720] conn(0x7ff89c039200 0x7ff89c03b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:49.867 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:49.040+0000 7ff8b7b0b640 1 --2- 172.21.15.120:0/350361108 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8b0107a70 0x7ff8b019b5f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:49.867 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:49.040+0000 7ff8b7b0b640 1 -- 172.21.15.120:0/350361108 >> 172.21.15.120:0/350361108 conn(0x7ff8b0101470 msgr2=0x7ff8b0102350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:49.867 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:49.040+0000 7ff8b7b0b640 1 -- 172.21.15.120:0/350361108 shutdown_connections 2024-09-19T05:10:49.867 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:49.040+0000 7ff8b7b0b640 1 -- 172.21.15.120:0/350361108 wait complete. 2024-09-19T05:10:49.867 INFO:teuthology.orchestra.run.smithi120.stdout:mgr epoch 9 is available 2024-09-19T05:10:49.867 INFO:teuthology.orchestra.run.smithi120.stdout:Generating a dashboard self-signed certificate... 2024-09-19T05:10:50.104 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:50 smithi120 ceph-mon[30956]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T05:10:50.105 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:50 smithi120 ceph-mon[30956]: mgrmap e11: x(active, since 1.00571s) 2024-09-19T05:10:50.105 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:50 smithi120 ceph-mon[30956]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T05:10:50.105 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:50 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:10:51.072 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T05:10:51.072 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.274+0000 7f8b2ce2d640 1 Processor -- start 2024-09-19T05:10:51.072 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.275+0000 7f8b2ce2d640 1 -- start start 2024-09-19T05:10:51.072 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.275+0000 7f8b2ce2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b28106470 0x7f8b28106870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:51.073 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.275+0000 7f8b2ce2d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8b28106e40 con 0x7f8b28106470 2024-09-19T05:10:51.073 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.275+0000 7f8b2659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b28106470 0x7f8b28106870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:51.073 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.275+0000 7f8b2659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b28106470 0x7f8b28106870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35488/0 (socket says 172.21.15.120:35488) 2024-09-19T05:10:51.073 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.275+0000 7f8b2659c640 1 -- 172.21.15.120:0/1343460343 learned_addr learned my addr 172.21.15.120:0/1343460343 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:51.073 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.275+0000 7f8b2659c640 1 -- 172.21.15.120:0/1343460343 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b28107670 con 0x7f8b28106470 2024-09-19T05:10:51.073 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.276+0000 7f8b2659c640 1 --2- 172.21.15.120:0/1343460343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b28106470 0x7f8b28106870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009820 tx=0x7f8b1802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d271877eed4e76e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:51.074 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.276+0000 7f8b25d9b640 1 -- 172.21.15.120:0/1343460343 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b18037070 con 0x7f8b28106470 2024-09-19T05:10:51.074 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.276+0000 7f8b25d9b640 1 -- 172.21.15.120:0/1343460343 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8b180328f0 con 0x7f8b28106470 2024-09-19T05:10:51.074 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.276+0000 7f8b25d9b640 1 -- 172.21.15.120:0/1343460343 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b18030740 con 0x7f8b28106470 2024-09-19T05:10:51.074 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.277+0000 7f8b2ce2d640 1 -- 172.21.15.120:0/1343460343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b28106470 msgr2=0x7f8b28106870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:51.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.277+0000 7f8b2ce2d640 1 --2- 172.21.15.120:0/1343460343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b28106470 0x7f8b28106870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009820 tx=0x7f8b1802a270 comp rx=0 tx=0).stop 2024-09-19T05:10:51.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.277+0000 7f8b2ce2d640 1 -- 172.21.15.120:0/1343460343 shutdown_connections 2024-09-19T05:10:51.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.277+0000 7f8b2ce2d640 1 --2- 172.21.15.120:0/1343460343 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b28106470 0x7f8b28106870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:51.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.277+0000 7f8b2ce2d640 1 -- 172.21.15.120:0/1343460343 >> 172.21.15.120:0/1343460343 conn(0x7f8b28101c00 msgr2=0x7f8b28104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:51.075 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.277+0000 7f8b2ce2d640 1 -- 172.21.15.120:0/1343460343 shutdown_connections 2024-09-19T05:10:51.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.277+0000 7f8b2ce2d640 1 -- 172.21.15.120:0/1343460343 wait complete. 2024-09-19T05:10:51.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.277+0000 7f8b2ce2d640 1 Processor -- start 2024-09-19T05:10:51.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.277+0000 7f8b2ce2d640 1 -- start start 2024-09-19T05:10:51.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.278+0000 7f8b2ce2d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b28106470 0x7f8b280630b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:51.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.278+0000 7f8b2ce2d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2810aa20 con 0x7f8b28106470 2024-09-19T05:10:51.076 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.278+0000 7f8b2659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b28106470 0x7f8b280630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:51.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.278+0000 7f8b2659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b28106470 0x7f8b280630b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35498/0 (socket says 172.21.15.120:35498) 2024-09-19T05:10:51.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.278+0000 7f8b2659c640 1 -- 172.21.15.120:0/1611236246 learned_addr learned my addr 172.21.15.120:0/1611236246 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:51.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.278+0000 7f8b2659c640 1 -- 172.21.15.120:0/1611236246 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b2819e2e0 con 0x7f8b28106470 2024-09-19T05:10:51.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.278+0000 7f8b2659c640 1 --2- 172.21.15.120:0/1611236246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b28106470 0x7f8b280630b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8b180097f0 tx=0x7f8b18030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:51.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.278+0000 7f8b1f7fe640 1 -- 172.21.15.120:0/1611236246 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b18042070 con 0x7f8b28106470 2024-09-19T05:10:51.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.278+0000 7f8b1f7fe640 1 -- 172.21.15.120:0/1611236246 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8b18030d80 con 0x7f8b28106470 2024-09-19T05:10:51.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.278+0000 7f8b2ce2d640 1 -- 172.21.15.120:0/1611236246 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b2819e4b0 con 0x7f8b28106470 2024-09-19T05:10:51.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.278+0000 7f8b1f7fe640 1 -- 172.21.15.120:0/1611236246 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b18037040 con 0x7f8b28106470 2024-09-19T05:10:51.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.278+0000 7f8b2ce2d640 1 -- 172.21.15.120:0/1611236246 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b2819e850 con 0x7f8b28106470 2024-09-19T05:10:51.077 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.279+0000 7f8b1f7fe640 1 -- 172.21.15.120:0/1611236246 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f8b18045070 con 0x7f8b28106470 2024-09-19T05:10:51.078 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.279+0000 7f8b1f7fe640 1 --2- 172.21.15.120:0/1611236246 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f8b140390f0 0x7f8b1403b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:51.078 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.279+0000 7f8b2ce2d640 1 -- 172.21.15.120:0/1611236246 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b281068f0 con 0x7f8b28106470 2024-09-19T05:10:51.078 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.279+0000 7f8b1f7fe640 1 -- 172.21.15.120:0/1611236246 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8b1806c2a0 con 0x7f8b28106470 2024-09-19T05:10:51.078 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.279+0000 7f8b1ffff640 1 --2- 172.21.15.120:0/1611236246 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f8b140390f0 0x7f8b1403b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:51.078 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.280+0000 7f8b1ffff640 1 --2- 172.21.15.120:0/1611236246 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f8b140390f0 0x7f8b1403b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8b100098c0 tx=0x7f8b10006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:51.078 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.284+0000 7f8b1f7fe640 1 -- 172.21.15.120:0/1611236246 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8b18045360 con 0x7f8b28106470 2024-09-19T05:10:51.078 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.463+0000 7f8b2ce2d640 1 -- 172.21.15.120:0/1611236246 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f8b28102ef0 con 0x7f8b140390f0 2024-09-19T05:10:51.078 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.477+0000 7f8b1f7fe640 1 -- 172.21.15.120:0/1611236246 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f8b1803d430 con 0x7f8b28106470 2024-09-19T05:10:51.078 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.531+0000 7f8b1f7fe640 1 -- 172.21.15.120:0/1611236246 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f8b28102ef0 con 0x7f8b140390f0 2024-09-19T05:10:51.078 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.534+0000 7f8b2ce2d640 1 -- 172.21.15.120:0/1611236246 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f8b140390f0 msgr2=0x7f8b1403b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:51.079 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.534+0000 7f8b2ce2d640 1 --2- 172.21.15.120:0/1611236246 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f8b140390f0 0x7f8b1403b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8b100098c0 tx=0x7f8b10006db0 comp rx=0 tx=0).stop 2024-09-19T05:10:51.079 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.534+0000 7f8b2ce2d640 1 -- 172.21.15.120:0/1611236246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b28106470 msgr2=0x7f8b280630b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:51.079 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.534+0000 7f8b2ce2d640 1 --2- 172.21.15.120:0/1611236246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b28106470 0x7f8b280630b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8b180097f0 tx=0x7f8b18030c70 comp rx=0 tx=0).stop 2024-09-19T05:10:51.079 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.534+0000 7f8b2ce2d640 1 -- 172.21.15.120:0/1611236246 shutdown_connections 2024-09-19T05:10:51.079 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.534+0000 7f8b2ce2d640 1 --2- 172.21.15.120:0/1611236246 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f8b140390f0 0x7f8b1403b5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:51.079 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.534+0000 7f8b2ce2d640 1 --2- 172.21.15.120:0/1611236246 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8b28106470 0x7f8b280630b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:51.079 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.534+0000 7f8b2ce2d640 1 -- 172.21.15.120:0/1611236246 >> 172.21.15.120:0/1611236246 conn(0x7f8b28101c00 msgr2=0x7f8b281027e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:51.079 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.534+0000 7f8b2ce2d640 1 -- 172.21.15.120:0/1611236246 shutdown_connections 2024-09-19T05:10:51.079 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:50.534+0000 7f8b2ce2d640 1 -- 172.21.15.120:0/1611236246 wait complete. 2024-09-19T05:10:51.079 INFO:teuthology.orchestra.run.smithi120.stdout:Creating initial admin user... 2024-09-19T05:10:51.267 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:51 smithi120 ceph-mon[30956]: [19/Sep/2024:05:10:49] ENGINE Bus STARTING 2024-09-19T05:10:51.267 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:51 smithi120 ceph-mon[30956]: [19/Sep/2024:05:10:49] ENGINE Serving on http://172.21.15.120:8765 2024-09-19T05:10:51.267 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:51 smithi120 ceph-mon[30956]: [19/Sep/2024:05:10:49] ENGINE Serving on https://172.21.15.120:7150 2024-09-19T05:10:51.267 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:51 smithi120 ceph-mon[30956]: [19/Sep/2024:05:10:49] ENGINE Bus STARTED 2024-09-19T05:10:51.267 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:51 smithi120 ceph-mon[30956]: [19/Sep/2024:05:10:49] ENGINE Error in HTTPServer.serve 2024-09-19T05:10:51.267 INFO:journalctl@ceph.mon.a.smithi120.stdout: Traceback (most recent call last): 2024-09-19T05:10:51.268 INFO:journalctl@ceph.mon.a.smithi120.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T05:10:51.268 INFO:journalctl@ceph.mon.a.smithi120.stdout: self._connections.run(self.expiration_interval) 2024-09-19T05:10:51.268 INFO:journalctl@ceph.mon.a.smithi120.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T05:10:51.268 INFO:journalctl@ceph.mon.a.smithi120.stdout: self._run(expiration_interval) 2024-09-19T05:10:51.268 INFO:journalctl@ceph.mon.a.smithi120.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T05:10:51.268 INFO:journalctl@ceph.mon.a.smithi120.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T05:10:51.268 INFO:journalctl@ceph.mon.a.smithi120.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T05:10:51.268 INFO:journalctl@ceph.mon.a.smithi120.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T05:10:51.268 INFO:journalctl@ceph.mon.a.smithi120.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T05:10:51.268 INFO:journalctl@ceph.mon.a.smithi120.stdout: s = self.context.wrap_socket( 2024-09-19T05:10:51.269 INFO:journalctl@ceph.mon.a.smithi120.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T05:10:51.269 INFO:journalctl@ceph.mon.a.smithi120.stdout: return self.sslsocket_class._create( 2024-09-19T05:10:51.269 INFO:journalctl@ceph.mon.a.smithi120.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T05:10:51.269 INFO:journalctl@ceph.mon.a.smithi120.stdout: self.do_handshake() 2024-09-19T05:10:51.269 INFO:journalctl@ceph.mon.a.smithi120.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T05:10:51.269 INFO:journalctl@ceph.mon.a.smithi120.stdout: self._sslobj.do_handshake() 2024-09-19T05:10:51.269 INFO:journalctl@ceph.mon.a.smithi120.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T05:10:51.269 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:51 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:10:51.269 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:51 smithi120 ceph-mon[30956]: mgrmap e12: x(active, since 2s) 2024-09-19T05:10:51.269 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:51 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:10:51.269 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:51 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:10:52.192 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:52 smithi120 ceph-mon[30956]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:10:52.192 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:52 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:10:52.762 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$doO7dA5H2xXGSr7LIcpiN.pMfbX8/HewZpUsNTlvWdXXVrdtDQRW6", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726722651, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T05:10:52.762 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.442+0000 7f3f1f298640 1 Processor -- start 2024-09-19T05:10:52.763 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.442+0000 7f3f1f298640 1 -- start start 2024-09-19T05:10:52.763 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.442+0000 7f3f1f298640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f181075c0 0x7f3f181079c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:52.763 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.442+0000 7f3f1f298640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3f18107f90 con 0x7f3f181075c0 2024-09-19T05:10:52.763 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.442+0000 7f3f1d034640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f181075c0 0x7f3f181079c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:52.763 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.442+0000 7f3f1d034640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f181075c0 0x7f3f181079c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35500/0 (socket says 172.21.15.120:35500) 2024-09-19T05:10:52.763 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.442+0000 7f3f1d034640 1 -- 172.21.15.120:0/2021489615 learned_addr learned my addr 172.21.15.120:0/2021489615 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:52.763 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.442+0000 7f3f1d034640 1 -- 172.21.15.120:0/2021489615 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f181087c0 con 0x7f3f181075c0 2024-09-19T05:10:52.763 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.443+0000 7f3f1d034640 1 --2- 172.21.15.120:0/2021489615 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f181075c0 0x7f3f181079c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009820 tx=0x7f3f0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb516c1a4fdd9c7e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:52.763 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.443+0000 7f3f0bfff640 1 -- 172.21.15.120:0/2021489615 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f0c037070 con 0x7f3f181075c0 2024-09-19T05:10:52.763 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.443+0000 7f3f0bfff640 1 -- 172.21.15.120:0/2021489615 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3f0c0328f0 con 0x7f3f181075c0 2024-09-19T05:10:52.763 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.443+0000 7f3f0bfff640 1 -- 172.21.15.120:0/2021489615 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f0c030740 con 0x7f3f181075c0 2024-09-19T05:10:52.763 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.444+0000 7f3f1f298640 1 -- 172.21.15.120:0/2021489615 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f181075c0 msgr2=0x7f3f181079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:52.763 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.444+0000 7f3f1f298640 1 --2- 172.21.15.120:0/2021489615 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f181075c0 0x7f3f181079c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009820 tx=0x7f3f0c02a270 comp rx=0 tx=0).stop 2024-09-19T05:10:52.764 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.444+0000 7f3f1f298640 1 -- 172.21.15.120:0/2021489615 shutdown_connections 2024-09-19T05:10:52.764 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.444+0000 7f3f1f298640 1 --2- 172.21.15.120:0/2021489615 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f181075c0 0x7f3f181079c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:52.764 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.444+0000 7f3f1f298640 1 -- 172.21.15.120:0/2021489615 >> 172.21.15.120:0/2021489615 conn(0x7f3f18102d50 msgr2=0x7f3f18105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:52.764 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.444+0000 7f3f1f298640 1 -- 172.21.15.120:0/2021489615 shutdown_connections 2024-09-19T05:10:52.764 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.444+0000 7f3f1f298640 1 -- 172.21.15.120:0/2021489615 wait complete. 2024-09-19T05:10:52.764 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.444+0000 7f3f1f298640 1 Processor -- start 2024-09-19T05:10:52.764 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.444+0000 7f3f1f298640 1 -- start start 2024-09-19T05:10:52.764 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.445+0000 7f3f1f298640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f181075c0 0x7f3f1807db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:52.764 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.445+0000 7f3f1f298640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1810bb70 con 0x7f3f181075c0 2024-09-19T05:10:52.764 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.445+0000 7f3f1d034640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f181075c0 0x7f3f1807db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:52.764 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.445+0000 7f3f1d034640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f181075c0 0x7f3f1807db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35512/0 (socket says 172.21.15.120:35512) 2024-09-19T05:10:52.764 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.445+0000 7f3f1d034640 1 -- 172.21.15.120:0/2791590132 learned_addr learned my addr 172.21.15.120:0/2791590132 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:52.764 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.445+0000 7f3f1d034640 1 -- 172.21.15.120:0/2791590132 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1807e0a0 con 0x7f3f181075c0 2024-09-19T05:10:52.765 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.445+0000 7f3f1d034640 1 --2- 172.21.15.120:0/2791590132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f181075c0 0x7f3f1807db60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0097f0 tx=0x7f3f0c030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:52.765 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.445+0000 7f3f0a7fc640 1 -- 172.21.15.120:0/2791590132 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f0c042070 con 0x7f3f181075c0 2024-09-19T05:10:52.765 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.445+0000 7f3f0a7fc640 1 -- 172.21.15.120:0/2791590132 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3f0c030e80 con 0x7f3f181075c0 2024-09-19T05:10:52.765 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.445+0000 7f3f1f298640 1 -- 172.21.15.120:0/2791590132 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f1807c290 con 0x7f3f181075c0 2024-09-19T05:10:52.765 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.445+0000 7f3f0a7fc640 1 -- 172.21.15.120:0/2791590132 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f0c037040 con 0x7f3f181075c0 2024-09-19T05:10:52.765 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.445+0000 7f3f1f298640 1 -- 172.21.15.120:0/2791590132 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f1807c7d0 con 0x7f3f181075c0 2024-09-19T05:10:52.765 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.446+0000 7f3f0a7fc640 1 -- 172.21.15.120:0/2791590132 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f3f0c045070 con 0x7f3f181075c0 2024-09-19T05:10:52.765 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.446+0000 7f3f0a7fc640 1 --2- 172.21.15.120:0/2791590132 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3f04039260 0x7f3f0403b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:52.765 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.446+0000 7f3f0a7fc640 1 -- 172.21.15.120:0/2791590132 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3f0c06c430 con 0x7f3f181075c0 2024-09-19T05:10:52.765 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.446+0000 7f3f1f298640 1 -- 172.21.15.120:0/2791590132 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f18107a40 con 0x7f3f181075c0 2024-09-19T05:10:52.765 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.446+0000 7f3f1c833640 1 --2- 172.21.15.120:0/2791590132 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3f04039260 0x7f3f0403b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:52.765 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.447+0000 7f3f1c833640 1 --2- 172.21.15.120:0/2791590132 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3f04039260 0x7f3f0403b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3f140098c0 tx=0x7f3f14006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:52.765 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.451+0000 7f3f0a7fc640 1 -- 172.21.15.120:0/2791590132 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3f0c045360 con 0x7f3f181075c0 2024-09-19T05:10:52.765 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.646+0000 7f3f1f298640 1 -- 172.21.15.120:0/2791590132 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f3f1807d100 con 0x7f3f04039260 2024-09-19T05:10:52.766 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.871+0000 7f3f0a7fc640 1 -- 172.21.15.120:0/2791590132 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f3f1807d100 con 0x7f3f04039260 2024-09-19T05:10:52.766 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.873+0000 7f3f1f298640 1 -- 172.21.15.120:0/2791590132 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3f04039260 msgr2=0x7f3f0403b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:52.766 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.873+0000 7f3f1f298640 1 --2- 172.21.15.120:0/2791590132 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3f04039260 0x7f3f0403b720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3f140098c0 tx=0x7f3f14006db0 comp rx=0 tx=0).stop 2024-09-19T05:10:52.766 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.873+0000 7f3f1f298640 1 -- 172.21.15.120:0/2791590132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f181075c0 msgr2=0x7f3f1807db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:52.766 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.873+0000 7f3f1f298640 1 --2- 172.21.15.120:0/2791590132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f181075c0 0x7f3f1807db60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0097f0 tx=0x7f3f0c030c70 comp rx=0 tx=0).stop 2024-09-19T05:10:52.766 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.873+0000 7f3f1f298640 1 -- 172.21.15.120:0/2791590132 shutdown_connections 2024-09-19T05:10:52.766 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.873+0000 7f3f1f298640 1 --2- 172.21.15.120:0/2791590132 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3f04039260 0x7f3f0403b720 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:52.766 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.873+0000 7f3f1f298640 1 --2- 172.21.15.120:0/2791590132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f181075c0 0x7f3f1807db60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:52.766 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.873+0000 7f3f1f298640 1 -- 172.21.15.120:0/2791590132 >> 172.21.15.120:0/2791590132 conn(0x7f3f18102d50 msgr2=0x7f3f18103900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:52.766 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.873+0000 7f3f1f298640 1 -- 172.21.15.120:0/2791590132 shutdown_connections 2024-09-19T05:10:52.766 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:51.873+0000 7f3f1f298640 1 -- 172.21.15.120:0/2791590132 wait complete. 2024-09-19T05:10:52.767 INFO:teuthology.orchestra.run.smithi120.stdout:Fetching dashboard port number... 2024-09-19T05:10:53.105 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:53 smithi120 ceph-mon[30956]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:10:54.243 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T05:10:54.243 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.093+0000 7fafb429c640 1 Processor -- start 2024-09-19T05:10:54.243 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.093+0000 7fafb429c640 1 -- start start 2024-09-19T05:10:54.243 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.094+0000 7fafb429c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafac108060 0x7fafac10a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:54.243 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.094+0000 7fafb429c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fafac063490 con 0x7fafac108060 2024-09-19T05:10:54.244 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.094+0000 7fafb2038640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafac108060 0x7fafac10a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:54.244 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.094+0000 7fafb2038640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafac108060 0x7fafac10a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35520/0 (socket says 172.21.15.120:35520) 2024-09-19T05:10:54.244 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.094+0000 7fafb2038640 1 -- 172.21.15.120:0/3882386043 learned_addr learned my addr 172.21.15.120:0/3882386043 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:54.244 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.094+0000 7fafb2038640 1 -- 172.21.15.120:0/3882386043 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafac10a990 con 0x7fafac108060 2024-09-19T05:10:54.244 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.095+0000 7fafb2038640 1 --2- 172.21.15.120:0/3882386043 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafac108060 0x7fafac10a450 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fafa8009820 tx=0x7fafa802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7e8d10d2c85119 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:54.244 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.095+0000 7fafb1036640 1 -- 172.21.15.120:0/3882386043 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafa8037070 con 0x7fafac108060 2024-09-19T05:10:54.244 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.095+0000 7fafb1036640 1 -- 172.21.15.120:0/3882386043 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fafa80328f0 con 0x7fafac108060 2024-09-19T05:10:54.244 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.095+0000 7fafb1036640 1 -- 172.21.15.120:0/3882386043 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafa8030740 con 0x7fafac108060 2024-09-19T05:10:54.244 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.096+0000 7fafb429c640 1 -- 172.21.15.120:0/3882386043 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafac108060 msgr2=0x7fafac10a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:54.244 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.096+0000 7fafb429c640 1 --2- 172.21.15.120:0/3882386043 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafac108060 0x7fafac10a450 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fafa8009820 tx=0x7fafa802a270 comp rx=0 tx=0).stop 2024-09-19T05:10:54.244 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.096+0000 7fafb429c640 1 -- 172.21.15.120:0/3882386043 shutdown_connections 2024-09-19T05:10:54.244 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.096+0000 7fafb429c640 1 --2- 172.21.15.120:0/3882386043 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafac108060 0x7fafac10a450 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:54.244 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.096+0000 7fafb429c640 1 -- 172.21.15.120:0/3882386043 >> 172.21.15.120:0/3882386043 conn(0x7fafac101c00 msgr2=0x7fafac104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:54.245 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.096+0000 7fafb429c640 1 -- 172.21.15.120:0/3882386043 shutdown_connections 2024-09-19T05:10:54.245 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.096+0000 7fafb429c640 1 -- 172.21.15.120:0/3882386043 wait complete. 2024-09-19T05:10:54.245 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.096+0000 7fafb429c640 1 Processor -- start 2024-09-19T05:10:54.245 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.096+0000 7fafb429c640 1 -- start start 2024-09-19T05:10:54.245 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.096+0000 7fafb429c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafac108060 0x7fafac1078e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:54.245 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.097+0000 7fafb429c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fafac10b950 con 0x7fafac108060 2024-09-19T05:10:54.245 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.097+0000 7fafb2038640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafac108060 0x7fafac1078e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:54.245 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.097+0000 7fafb2038640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafac108060 0x7fafac1078e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35528/0 (socket says 172.21.15.120:35528) 2024-09-19T05:10:54.245 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.097+0000 7fafb2038640 1 -- 172.21.15.120:0/3424928433 learned_addr learned my addr 172.21.15.120:0/3424928433 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:54.245 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.097+0000 7fafb2038640 1 -- 172.21.15.120:0/3424928433 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafac107e20 con 0x7fafac108060 2024-09-19T05:10:54.245 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.097+0000 7fafb2038640 1 --2- 172.21.15.120:0/3424928433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafac108060 0x7fafac1078e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fafa8030cc0 tx=0x7fafa8030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:54.246 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.097+0000 7faf9f7fe640 1 -- 172.21.15.120:0/3424928433 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafa8042070 con 0x7fafac108060 2024-09-19T05:10:54.246 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.097+0000 7fafb429c640 1 -- 172.21.15.120:0/3424928433 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafac106010 con 0x7fafac108060 2024-09-19T05:10:54.246 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.097+0000 7faf9f7fe640 1 -- 172.21.15.120:0/3424928433 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fafa8030e60 con 0x7fafac108060 2024-09-19T05:10:54.246 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.097+0000 7faf9f7fe640 1 -- 172.21.15.120:0/3424928433 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafa8037040 con 0x7fafac108060 2024-09-19T05:10:54.246 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.097+0000 7fafb429c640 1 -- 172.21.15.120:0/3424928433 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafac106550 con 0x7fafac108060 2024-09-19T05:10:54.246 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.098+0000 7faf9f7fe640 1 -- 172.21.15.120:0/3424928433 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fafa8045070 con 0x7fafac108060 2024-09-19T05:10:54.246 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.098+0000 7fafb429c640 1 -- 172.21.15.120:0/3424928433 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafac1084c0 con 0x7fafac108060 2024-09-19T05:10:54.246 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.098+0000 7faf9f7fe640 1 --2- 172.21.15.120:0/3424928433 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7faf98039200 0x7faf9803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:54.246 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.099+0000 7faf9f7fe640 1 -- 172.21.15.120:0/3424928433 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fafa806c4b0 con 0x7fafac108060 2024-09-19T05:10:54.246 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.099+0000 7fafb1837640 1 --2- 172.21.15.120:0/3424928433 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7faf98039200 0x7faf9803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:54.246 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.099+0000 7fafb1837640 1 --2- 172.21.15.120:0/3424928433 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7faf98039200 0x7faf9803b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fafa00098c0 tx=0x7fafa0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:54.247 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.103+0000 7faf9f7fe640 1 -- 172.21.15.120:0/3424928433 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fafa8045360 con 0x7fafac108060 2024-09-19T05:10:54.247 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.280+0000 7fafb429c640 1 -- 172.21.15.120:0/3424928433 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fafac106cf0 con 0x7fafac108060 2024-09-19T05:10:54.247 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.280+0000 7faf9f7fe640 1 -- 172.21.15.120:0/3424928433 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fafa803ad90 con 0x7fafac108060 2024-09-19T05:10:54.247 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.282+0000 7fafb429c640 1 -- 172.21.15.120:0/3424928433 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7faf98039200 msgr2=0x7faf9803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:54.247 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.282+0000 7fafb429c640 1 --2- 172.21.15.120:0/3424928433 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7faf98039200 0x7faf9803b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fafa00098c0 tx=0x7fafa0006db0 comp rx=0 tx=0).stop 2024-09-19T05:10:54.247 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.282+0000 7fafb429c640 1 -- 172.21.15.120:0/3424928433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafac108060 msgr2=0x7fafac1078e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:54.247 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.282+0000 7fafb429c640 1 --2- 172.21.15.120:0/3424928433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafac108060 0x7fafac1078e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fafa8030cc0 tx=0x7fafa8030cf0 comp rx=0 tx=0).stop 2024-09-19T05:10:54.247 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.282+0000 7fafb429c640 1 -- 172.21.15.120:0/3424928433 shutdown_connections 2024-09-19T05:10:54.247 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.283+0000 7fafb429c640 1 --2- 172.21.15.120:0/3424928433 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7faf98039200 0x7faf9803b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:54.247 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.283+0000 7fafb429c640 1 --2- 172.21.15.120:0/3424928433 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fafac108060 0x7fafac1078e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:54.247 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.283+0000 7fafb429c640 1 -- 172.21.15.120:0/3424928433 >> 172.21.15.120:0/3424928433 conn(0x7fafac101c00 msgr2=0x7fafac102780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:54.247 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.283+0000 7fafb429c640 1 -- 172.21.15.120:0/3424928433 shutdown_connections 2024-09-19T05:10:54.247 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:53.283+0000 7fafb429c640 1 -- 172.21.15.120:0/3424928433 wait complete. 2024-09-19T05:10:54.248 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T05:10:54.248 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout disabled 2024-09-19T05:10:54.252 INFO:teuthology.orchestra.run.smithi120.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T05:10:54.252 INFO:teuthology.orchestra.run.smithi120.stdout:systemctl: stdout inactive 2024-09-19T05:10:54.253 INFO:teuthology.orchestra.run.smithi120.stdout:firewalld.service is not enabled 2024-09-19T05:10:54.253 INFO:teuthology.orchestra.run.smithi120.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T05:10:54.254 INFO:teuthology.orchestra.run.smithi120.stdout:Ceph Dashboard is now available at: 2024-09-19T05:10:54.254 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:10:54.255 INFO:teuthology.orchestra.run.smithi120.stdout: URL: https://smithi120.front.sepia.ceph.com:8443/ 2024-09-19T05:10:54.255 INFO:teuthology.orchestra.run.smithi120.stdout: User: admin 2024-09-19T05:10:54.255 INFO:teuthology.orchestra.run.smithi120.stdout: Password: csx50p3sq9 2024-09-19T05:10:54.255 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:10:54.255 INFO:teuthology.orchestra.run.smithi120.stdout:Saving cluster configuration to /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config directory 2024-09-19T05:10:54.361 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:54 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/3424928433' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T05:10:55.254 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:55 smithi120 ceph-mon[30956]: mgrmap e13: x(active, since 6s) 2024-09-19T05:10:55.254 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:55 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/4158581935' entity='client.admin' 2024-09-19T05:10:55.487 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.678+0000 7f50e34fc640 1 Processor -- start 2024-09-19T05:10:55.488 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.678+0000 7f50e34fc640 1 -- start start 2024-09-19T05:10:55.488 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.678+0000 7f50e34fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50dc07de90 0x7f50dc07c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:55.488 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.678+0000 7f50e34fc640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc07c8c0 con 0x7f50dc07de90 2024-09-19T05:10:55.488 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.679+0000 7f50e1298640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50dc07de90 0x7f50dc07c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:55.488 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.679+0000 7f50e1298640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50dc07de90 0x7f50dc07c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35538/0 (socket says 172.21.15.120:35538) 2024-09-19T05:10:55.488 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.679+0000 7f50e1298640 1 -- 172.21.15.120:0/3921419949 learned_addr learned my addr 172.21.15.120:0/3921419949 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:55.488 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.679+0000 7f50e1298640 1 -- 172.21.15.120:0/3921419949 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50dc07ca40 con 0x7f50dc07de90 2024-09-19T05:10:55.488 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.680+0000 7f50e1298640 1 --2- 172.21.15.120:0/3921419949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50dc07de90 0x7f50dc07c2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f50d8009e80 tx=0x7f50d802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2448f058501329f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:55.489 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.680+0000 7f50d3fff640 1 -- 172.21.15.120:0/3921419949 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50d8036070 con 0x7f50dc07de90 2024-09-19T05:10:55.489 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.680+0000 7f50d3fff640 1 -- 172.21.15.120:0/3921419949 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f50d80318b0 con 0x7f50dc07de90 2024-09-19T05:10:55.489 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.680+0000 7f50d3fff640 1 -- 172.21.15.120:0/3921419949 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50d8007930 con 0x7f50dc07de90 2024-09-19T05:10:55.489 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.680+0000 7f50e34fc640 1 -- 172.21.15.120:0/3921419949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50dc07de90 msgr2=0x7f50dc07c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:55.489 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.680+0000 7f50e34fc640 1 --2- 172.21.15.120:0/3921419949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50dc07de90 0x7f50dc07c2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f50d8009e80 tx=0x7f50d802a7a0 comp rx=0 tx=0).stop 2024-09-19T05:10:55.489 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.680+0000 7f50e34fc640 1 -- 172.21.15.120:0/3921419949 shutdown_connections 2024-09-19T05:10:55.489 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.680+0000 7f50e34fc640 1 --2- 172.21.15.120:0/3921419949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50dc07de90 0x7f50dc07c2f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:55.489 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.680+0000 7f50e34fc640 1 -- 172.21.15.120:0/3921419949 >> 172.21.15.120:0/3921419949 conn(0x7f50dc102d50 msgr2=0x7f50dc105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:55.489 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.680+0000 7f50e34fc640 1 -- 172.21.15.120:0/3921419949 shutdown_connections 2024-09-19T05:10:55.489 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.680+0000 7f50e34fc640 1 -- 172.21.15.120:0/3921419949 wait complete. 2024-09-19T05:10:55.489 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.681+0000 7f50e34fc640 1 Processor -- start 2024-09-19T05:10:55.489 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.681+0000 7f50e34fc640 1 -- start start 2024-09-19T05:10:55.489 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.681+0000 7f50e34fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50dc07de90 0x7f50dc19d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:55.489 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.681+0000 7f50e34fc640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc10dc30 con 0x7f50dc07de90 2024-09-19T05:10:55.490 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.681+0000 7f50e1298640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50dc07de90 0x7f50dc19d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:55.490 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.681+0000 7f50e1298640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50dc07de90 0x7f50dc19d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35548/0 (socket says 172.21.15.120:35548) 2024-09-19T05:10:55.490 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.681+0000 7f50e1298640 1 -- 172.21.15.120:0/4158581935 learned_addr learned my addr 172.21.15.120:0/4158581935 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:55.490 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.681+0000 7f50e1298640 1 -- 172.21.15.120:0/4158581935 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50dc19dd10 con 0x7f50dc07de90 2024-09-19T05:10:55.490 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.682+0000 7f50e1298640 1 --2- 172.21.15.120:0/4158581935 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50dc07de90 0x7f50dc19d7d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f50d8031cc0 tx=0x7f50d8031cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:55.490 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.682+0000 7f50d27fc640 1 -- 172.21.15.120:0/4158581935 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50d8036050 con 0x7f50dc07de90 2024-09-19T05:10:55.490 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.682+0000 7f50d27fc640 1 -- 172.21.15.120:0/4158581935 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f50d8042070 con 0x7f50dc07de90 2024-09-19T05:10:55.490 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.682+0000 7f50d27fc640 1 -- 172.21.15.120:0/4158581935 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50d803db10 con 0x7f50dc07de90 2024-09-19T05:10:55.490 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.682+0000 7f50e34fc640 1 -- 172.21.15.120:0/4158581935 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50dc19dfa0 con 0x7f50dc07de90 2024-09-19T05:10:55.490 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.682+0000 7f50e34fc640 1 -- 172.21.15.120:0/4158581935 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50dc1a0c90 con 0x7f50dc07de90 2024-09-19T05:10:55.490 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.683+0000 7f50d27fc640 1 -- 172.21.15.120:0/4158581935 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f50d803b740 con 0x7f50dc07de90 2024-09-19T05:10:55.490 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.683+0000 7f50d27fc640 1 --2- 172.21.15.120:0/4158581935 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f50c80392a0 0x7f50c803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:55.490 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.683+0000 7f50d27fc640 1 -- 172.21.15.120:0/4158581935 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f50d806da70 con 0x7f50dc07de90 2024-09-19T05:10:55.490 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.683+0000 7f50e34fc640 1 -- 172.21.15.120:0/4158581935 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50dc07c370 con 0x7f50dc07de90 2024-09-19T05:10:55.491 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.683+0000 7f50e0a97640 1 --2- 172.21.15.120:0/4158581935 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f50c80392a0 0x7f50c803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:55.491 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.683+0000 7f50e0a97640 1 --2- 172.21.15.120:0/4158581935 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f50c80392a0 0x7f50c803b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0098c0 tx=0x7f50cc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:55.491 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.687+0000 7f50d27fc640 1 -- 172.21.15.120:0/4158581935 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f50d806d030 con 0x7f50dc07de90 2024-09-19T05:10:55.491 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.940+0000 7f50e34fc640 1 -- 172.21.15.120:0/4158581935 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f50dc1a0e60 con 0x7f50dc07de90 2024-09-19T05:10:55.491 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.942+0000 7f50d27fc640 1 -- 172.21.15.120:0/4158581935 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f50d8037d50 con 0x7f50dc07de90 2024-09-19T05:10:55.491 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T05:10:55.492 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.944+0000 7f50e34fc640 1 -- 172.21.15.120:0/4158581935 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f50c80392a0 msgr2=0x7f50c803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:55.492 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.944+0000 7f50e34fc640 1 --2- 172.21.15.120:0/4158581935 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f50c80392a0 0x7f50c803b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0098c0 tx=0x7f50cc006db0 comp rx=0 tx=0).stop 2024-09-19T05:10:55.492 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.944+0000 7f50e34fc640 1 -- 172.21.15.120:0/4158581935 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50dc07de90 msgr2=0x7f50dc19d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:55.492 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.944+0000 7f50e34fc640 1 --2- 172.21.15.120:0/4158581935 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50dc07de90 0x7f50dc19d7d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f50d8031cc0 tx=0x7f50d8031cf0 comp rx=0 tx=0).stop 2024-09-19T05:10:55.492 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.944+0000 7f50e34fc640 1 -- 172.21.15.120:0/4158581935 shutdown_connections 2024-09-19T05:10:55.492 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.944+0000 7f50e34fc640 1 --2- 172.21.15.120:0/4158581935 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f50c80392a0 0x7f50c803b760 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:55.492 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.944+0000 7f50e34fc640 1 --2- 172.21.15.120:0/4158581935 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50dc07de90 0x7f50dc19d7d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:55.492 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.944+0000 7f50e34fc640 1 -- 172.21.15.120:0/4158581935 >> 172.21.15.120:0/4158581935 conn(0x7f50dc102d50 msgr2=0x7f50dc103910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:55.493 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.945+0000 7f50e34fc640 1 -- 172.21.15.120:0/4158581935 shutdown_connections 2024-09-19T05:10:55.493 INFO:teuthology.orchestra.run.smithi120.stdout:/usr/bin/ceph: stderr 2024-09-19T05:10:54.945+0000 7f50e34fc640 1 -- 172.21.15.120:0/4158581935 wait complete. 2024-09-19T05:10:55.493 INFO:teuthology.orchestra.run.smithi120.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T05:10:55.493 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:10:55.493 INFO:teuthology.orchestra.run.smithi120.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:10:55.493 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:10:55.493 INFO:teuthology.orchestra.run.smithi120.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T05:10:55.493 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:10:55.493 INFO:teuthology.orchestra.run.smithi120.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T05:10:55.493 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:10:55.493 INFO:teuthology.orchestra.run.smithi120.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T05:10:55.493 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:10:55.493 INFO:teuthology.orchestra.run.smithi120.stdout: ceph telemetry on 2024-09-19T05:10:55.493 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:10:55.494 INFO:teuthology.orchestra.run.smithi120.stdout:For more information see: 2024-09-19T05:10:55.494 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:10:55.494 INFO:teuthology.orchestra.run.smithi120.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T05:10:55.494 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:10:55.494 INFO:teuthology.orchestra.run.smithi120.stdout:Bootstrap complete. 2024-09-19T05:10:55.526 INFO:tasks.cephadm:Fetching config... 2024-09-19T05:10:55.526 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T05:10:55.527 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T05:10:55.543 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T05:10:55.543 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T05:10:55.543 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T05:10:55.599 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T05:10:55.599 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T05:10:55.599 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T05:10:55.664 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T05:10:55.665 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T05:10:55.665 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T05:10:55.721 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T05:10:55.721 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQufTn6mY6xa7EsRpCKUFYZKEbYGALv152w/r1C/hXY0TesibJszdkEmJQZPjZCHpelrjqTfdKeIi7qm2c1F7qfwub/kLsuLQ7Be8PZOLlv+93E9jXelH55EPRllAWoskKL4xOumpzD7Z+EjIsACM0A0Okz/TlySzwqM36u9lUZC4dUcz7b3/RAPUrMsmvq2cqvcvp38SRaJ+91H/N9fn0mME4kQGi1kdjM6nyd5cLz+zndp7UVT1B8IAWqteAKiuMpyuTT47xBMugHJzJP6H8xwDifC9S5IIzDDHuTsSbWJwmBYCs7jVC3sOpU1Qhr8KIGzD5rr8LWW62q4TZAr1GaolybhHcOvw2kLMYkMxhzQOGwsU4AGqwQIVm07SyjDhlUgQwiBksY7ayKCpQzu3BUcSP+h0hwFpQRxkIsegZ2Dh5z1gMo/gKeSeX3rfQCbY25bYcDpxVNOt18juuuxTJvEnEQ54ZHHYzIBEi1ItUjGts7hS0qXh+vGpWpgiubbE= ceph-4e6e3df4-7645-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T05:10:55.795 INFO:teuthology.orchestra.run.smithi120.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQufTn6mY6xa7EsRpCKUFYZKEbYGALv152w/r1C/hXY0TesibJszdkEmJQZPjZCHpelrjqTfdKeIi7qm2c1F7qfwub/kLsuLQ7Be8PZOLlv+93E9jXelH55EPRllAWoskKL4xOumpzD7Z+EjIsACM0A0Okz/TlySzwqM36u9lUZC4dUcz7b3/RAPUrMsmvq2cqvcvp38SRaJ+91H/N9fn0mME4kQGi1kdjM6nyd5cLz+zndp7UVT1B8IAWqteAKiuMpyuTT47xBMugHJzJP6H8xwDifC9S5IIzDDHuTsSbWJwmBYCs7jVC3sOpU1Qhr8KIGzD5rr8LWW62q4TZAr1GaolybhHcOvw2kLMYkMxhzQOGwsU4AGqwQIVm07SyjDhlUgQwiBksY7ayKCpQzu3BUcSP+h0hwFpQRxkIsegZ2Dh5z1gMo/gKeSeX3rfQCbY25bYcDpxVNOt18juuuxTJvEnEQ54ZHHYzIBEi1ItUjGts7hS0qXh+vGpWpgiubbE= ceph-4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:10:55.806 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQufTn6mY6xa7EsRpCKUFYZKEbYGALv152w/r1C/hXY0TesibJszdkEmJQZPjZCHpelrjqTfdKeIi7qm2c1F7qfwub/kLsuLQ7Be8PZOLlv+93E9jXelH55EPRllAWoskKL4xOumpzD7Z+EjIsACM0A0Okz/TlySzwqM36u9lUZC4dUcz7b3/RAPUrMsmvq2cqvcvp38SRaJ+91H/N9fn0mME4kQGi1kdjM6nyd5cLz+zndp7UVT1B8IAWqteAKiuMpyuTT47xBMugHJzJP6H8xwDifC9S5IIzDDHuTsSbWJwmBYCs7jVC3sOpU1Qhr8KIGzD5rr8LWW62q4TZAr1GaolybhHcOvw2kLMYkMxhzQOGwsU4AGqwQIVm07SyjDhlUgQwiBksY7ayKCpQzu3BUcSP+h0hwFpQRxkIsegZ2Dh5z1gMo/gKeSeX3rfQCbY25bYcDpxVNOt18juuuxTJvEnEQ54ZHHYzIBEi1ItUjGts7hS0qXh+vGpWpgiubbE= ceph-4e6e3df4-7645-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T05:10:55.938 INFO:teuthology.orchestra.run.smithi178.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQufTn6mY6xa7EsRpCKUFYZKEbYGALv152w/r1C/hXY0TesibJszdkEmJQZPjZCHpelrjqTfdKeIi7qm2c1F7qfwub/kLsuLQ7Be8PZOLlv+93E9jXelH55EPRllAWoskKL4xOumpzD7Z+EjIsACM0A0Okz/TlySzwqM36u9lUZC4dUcz7b3/RAPUrMsmvq2cqvcvp38SRaJ+91H/N9fn0mME4kQGi1kdjM6nyd5cLz+zndp7UVT1B8IAWqteAKiuMpyuTT47xBMugHJzJP6H8xwDifC9S5IIzDDHuTsSbWJwmBYCs7jVC3sOpU1Qhr8KIGzD5rr8LWW62q4TZAr1GaolybhHcOvw2kLMYkMxhzQOGwsU4AGqwQIVm07SyjDhlUgQwiBksY7ayKCpQzu3BUcSP+h0hwFpQRxkIsegZ2Dh5z1gMo/gKeSeX3rfQCbY25bYcDpxVNOt18juuuxTJvEnEQ54ZHHYzIBEi1ItUjGts7hS0qXh+vGpWpgiubbE= ceph-4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:10:55.951 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQufTn6mY6xa7EsRpCKUFYZKEbYGALv152w/r1C/hXY0TesibJszdkEmJQZPjZCHpelrjqTfdKeIi7qm2c1F7qfwub/kLsuLQ7Be8PZOLlv+93E9jXelH55EPRllAWoskKL4xOumpzD7Z+EjIsACM0A0Okz/TlySzwqM36u9lUZC4dUcz7b3/RAPUrMsmvq2cqvcvp38SRaJ+91H/N9fn0mME4kQGi1kdjM6nyd5cLz+zndp7UVT1B8IAWqteAKiuMpyuTT47xBMugHJzJP6H8xwDifC9S5IIzDDHuTsSbWJwmBYCs7jVC3sOpU1Qhr8KIGzD5rr8LWW62q4TZAr1GaolybhHcOvw2kLMYkMxhzQOGwsU4AGqwQIVm07SyjDhlUgQwiBksY7ayKCpQzu3BUcSP+h0hwFpQRxkIsegZ2Dh5z1gMo/gKeSeX3rfQCbY25bYcDpxVNOt18juuuxTJvEnEQ54ZHHYzIBEi1ItUjGts7hS0qXh+vGpWpgiubbE= ceph-4e6e3df4-7645-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T05:10:56.001 INFO:teuthology.orchestra.run.smithi194.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQufTn6mY6xa7EsRpCKUFYZKEbYGALv152w/r1C/hXY0TesibJszdkEmJQZPjZCHpelrjqTfdKeIi7qm2c1F7qfwub/kLsuLQ7Be8PZOLlv+93E9jXelH55EPRllAWoskKL4xOumpzD7Z+EjIsACM0A0Okz/TlySzwqM36u9lUZC4dUcz7b3/RAPUrMsmvq2cqvcvp38SRaJ+91H/N9fn0mME4kQGi1kdjM6nyd5cLz+zndp7UVT1B8IAWqteAKiuMpyuTT47xBMugHJzJP6H8xwDifC9S5IIzDDHuTsSbWJwmBYCs7jVC3sOpU1Qhr8KIGzD5rr8LWW62q4TZAr1GaolybhHcOvw2kLMYkMxhzQOGwsU4AGqwQIVm07SyjDhlUgQwiBksY7ayKCpQzu3BUcSP+h0hwFpQRxkIsegZ2Dh5z1gMo/gKeSeX3rfQCbY25bYcDpxVNOt18juuuxTJvEnEQ54ZHHYzIBEi1ItUjGts7hS0qXh+vGpWpgiubbE= ceph-4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:10:56.014 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T05:10:56.264 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:10:56.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.831+0000 7f9800c4a640 1 -- 172.21.15.120:0/1976389411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97fc100520 msgr2=0x7f97fc100920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:56.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.831+0000 7f9800c4a640 1 --2- 172.21.15.120:0/1976389411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97fc100520 0x7f97fc100920 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f97ec009880 tx=0x7f97ec02a5d0 comp rx=0 tx=0).stop 2024-09-19T05:10:56.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.831+0000 7f9800c4a640 1 -- 172.21.15.120:0/1976389411 shutdown_connections 2024-09-19T05:10:56.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.831+0000 7f9800c4a640 1 --2- 172.21.15.120:0/1976389411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97fc100520 0x7f97fc100920 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:56.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.831+0000 7f9800c4a640 1 -- 172.21.15.120:0/1976389411 >> 172.21.15.120:0/1976389411 conn(0x7f97fc0fbcb0 msgr2=0x7f97fc0fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:56.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.831+0000 7f9800c4a640 1 -- 172.21.15.120:0/1976389411 shutdown_connections 2024-09-19T05:10:56.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.831+0000 7f9800c4a640 1 -- 172.21.15.120:0/1976389411 wait complete. 2024-09-19T05:10:56.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.832+0000 7f9800c4a640 1 Processor -- start 2024-09-19T05:10:56.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.832+0000 7f9800c4a640 1 -- start start 2024-09-19T05:10:56.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.832+0000 7f9800c4a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97fc100520 0x7f97fc0fdb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:56.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.832+0000 7f9800c4a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc1064e0 con 0x7f97fc100520 2024-09-19T05:10:56.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.832+0000 7f97fa59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97fc100520 0x7f97fc0fdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:56.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.832+0000 7f97fa59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97fc100520 0x7f97fc0fdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44992/0 (socket says 172.21.15.120:44992) 2024-09-19T05:10:56.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.832+0000 7f97fa59c640 1 -- 172.21.15.120:0/365708527 learned_addr learned my addr 172.21.15.120:0/365708527 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:56.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.832+0000 7f97fa59c640 1 -- 172.21.15.120:0/365708527 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc0fe0b0 con 0x7f97fc100520 2024-09-19T05:10:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.832+0000 7f97fa59c640 1 --2- 172.21.15.120:0/365708527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97fc100520 0x7f97fc0fdb70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f97ec009230 tx=0x7f97ec0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.833+0000 7f97f37fe640 1 -- 172.21.15.120:0/365708527 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97ec03f070 con 0x7f97fc100520 2024-09-19T05:10:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.833+0000 7f97f37fe640 1 -- 172.21.15.120:0/365708527 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f97ec003aa0 con 0x7f97fc100520 2024-09-19T05:10:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.833+0000 7f9800c4a640 1 -- 172.21.15.120:0/365708527 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97fc0fc2a0 con 0x7f97fc100520 2024-09-19T05:10:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.833+0000 7f97f37fe640 1 -- 172.21.15.120:0/365708527 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97ec035030 con 0x7f97fc100520 2024-09-19T05:10:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.833+0000 7f9800c4a640 1 -- 172.21.15.120:0/365708527 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97fc0fc7e0 con 0x7f97fc100520 2024-09-19T05:10:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.833+0000 7f97f37fe640 1 -- 172.21.15.120:0/365708527 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f97ec042070 con 0x7f97fc100520 2024-09-19T05:10:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.834+0000 7f97f37fe640 1 --2- 172.21.15.120:0/365708527 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f97e8039300 0x7f97e803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.834+0000 7f9800c4a640 1 -- 172.21.15.120:0/365708527 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97fc106c60 con 0x7f97fc100520 2024-09-19T05:10:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.834+0000 7f97f37fe640 1 -- 172.21.15.120:0/365708527 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f97ec06d0f0 con 0x7f97fc100520 2024-09-19T05:10:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.834+0000 7f97f3fff640 1 --2- 172.21.15.120:0/365708527 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f97e8039300 0x7f97e803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:56.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.834+0000 7f97f3fff640 1 --2- 172.21.15.120:0/365708527 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f97e8039300 0x7f97e803b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f97e40098c0 tx=0x7f97e4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:56.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:56.838+0000 7f97f37fe640 1 -- 172.21.15.120:0/365708527 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f97ec02f300 con 0x7f97fc100520 2024-09-19T05:10:57.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:57.008+0000 7f9800c4a640 1 -- 172.21.15.120:0/365708527 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f97fc190220 con 0x7f97fc100520 2024-09-19T05:10:57.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:57.011+0000 7f97f37fe640 1 -- 172.21.15.120:0/365708527 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f97ec031a70 con 0x7f97fc100520 2024-09-19T05:10:57.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:57.013+0000 7f9800c4a640 1 -- 172.21.15.120:0/365708527 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f97e8039300 msgr2=0x7f97e803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:57.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:57.013+0000 7f9800c4a640 1 --2- 172.21.15.120:0/365708527 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f97e8039300 0x7f97e803b7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f97e40098c0 tx=0x7f97e4006db0 comp rx=0 tx=0).stop 2024-09-19T05:10:57.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:57.013+0000 7f9800c4a640 1 -- 172.21.15.120:0/365708527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97fc100520 msgr2=0x7f97fc0fdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:57.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:57.013+0000 7f9800c4a640 1 --2- 172.21.15.120:0/365708527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97fc100520 0x7f97fc0fdb70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f97ec009230 tx=0x7f97ec0048f0 comp rx=0 tx=0).stop 2024-09-19T05:10:57.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:57.013+0000 7f9800c4a640 1 -- 172.21.15.120:0/365708527 shutdown_connections 2024-09-19T05:10:57.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:57.013+0000 7f9800c4a640 1 --2- 172.21.15.120:0/365708527 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f97e8039300 0x7f97e803b7c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:57.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:57.013+0000 7f9800c4a640 1 --2- 172.21.15.120:0/365708527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97fc100520 0x7f97fc0fdb70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:57.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:57.013+0000 7f9800c4a640 1 -- 172.21.15.120:0/365708527 >> 172.21.15.120:0/365708527 conn(0x7f97fc0fbcb0 msgr2=0x7f97fc06a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:57.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:57.013+0000 7f9800c4a640 1 -- 172.21.15.120:0/365708527 shutdown_connections 2024-09-19T05:10:57.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:57.013+0000 7f9800c4a640 1 -- 172.21.15.120:0/365708527 wait complete. 2024-09-19T05:10:57.764 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T05:10:57.765 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T05:10:58.054 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:58 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/365708527' entity='client.admin' 2024-09-19T05:10:58.054 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:58 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:10:58.054 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:58 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:10:58.054 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:58 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi120", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:10:58.054 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:58 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:10:58.054 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:58 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:10:58.054 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:58 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:10:58.278 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:10:58.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.782+0000 7fbef6a01640 1 -- 172.21.15.120:0/1721769928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbef00ff8e0 msgr2=0x7fbef00ffce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:58.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.782+0000 7fbef6a01640 1 --2- 172.21.15.120:0/1721769928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbef00ff8e0 0x7fbef00ffce0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbee0009880 tx=0x7fbee002a5d0 comp rx=0 tx=0).stop 2024-09-19T05:10:58.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.782+0000 7fbef6a01640 1 -- 172.21.15.120:0/1721769928 shutdown_connections 2024-09-19T05:10:58.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.782+0000 7fbef6a01640 1 --2- 172.21.15.120:0/1721769928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbef00ff8e0 0x7fbef00ffce0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:58.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.782+0000 7fbef6a01640 1 -- 172.21.15.120:0/1721769928 >> 172.21.15.120:0/1721769928 conn(0x7fbef00fb430 msgr2=0x7fbef00fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:58.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.782+0000 7fbef6a01640 1 -- 172.21.15.120:0/1721769928 shutdown_connections 2024-09-19T05:10:58.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.782+0000 7fbef6a01640 1 -- 172.21.15.120:0/1721769928 wait complete. 2024-09-19T05:10:58.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.783+0000 7fbef6a01640 1 Processor -- start 2024-09-19T05:10:58.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.783+0000 7fbef6a01640 1 -- start start 2024-09-19T05:10:58.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.783+0000 7fbef6a01640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbef00ff8e0 0x7fbef019d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:58.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.783+0000 7fbef6a01640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbef01013e0 con 0x7fbef00ff8e0 2024-09-19T05:10:58.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.784+0000 7fbeeffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbef00ff8e0 0x7fbef019d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:58.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.784+0000 7fbeeffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbef00ff8e0 0x7fbef019d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45004/0 (socket says 172.21.15.120:45004) 2024-09-19T05:10:58.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.784+0000 7fbeeffff640 1 -- 172.21.15.120:0/1939010037 learned_addr learned my addr 172.21.15.120:0/1939010037 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:10:58.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.784+0000 7fbeeffff640 1 -- 172.21.15.120:0/1939010037 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef019d850 con 0x7fbef00ff8e0 2024-09-19T05:10:58.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.784+0000 7fbeeffff640 1 --2- 172.21.15.120:0/1939010037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbef00ff8e0 0x7fbef019d310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbee0005ec0 tx=0x7fbee00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:58.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.784+0000 7fbeed7fa640 1 -- 172.21.15.120:0/1939010037 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee003f070 con 0x7fbef00ff8e0 2024-09-19T05:10:58.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.784+0000 7fbeed7fa640 1 -- 172.21.15.120:0/1939010037 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbee0003aa0 con 0x7fbef00ff8e0 2024-09-19T05:10:58.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.784+0000 7fbef6a01640 1 -- 172.21.15.120:0/1939010037 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbef019dae0 con 0x7fbef00ff8e0 2024-09-19T05:10:58.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.784+0000 7fbeed7fa640 1 -- 172.21.15.120:0/1939010037 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbee0035030 con 0x7fbef00ff8e0 2024-09-19T05:10:58.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.784+0000 7fbef6a01640 1 -- 172.21.15.120:0/1939010037 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbef01a07d0 con 0x7fbef00ff8e0 2024-09-19T05:10:58.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.785+0000 7fbeed7fa640 1 -- 172.21.15.120:0/1939010037 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7fbee0042070 con 0x7fbef00ff8e0 2024-09-19T05:10:58.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.785+0000 7fbeed7fa640 1 --2- 172.21.15.120:0/1939010037 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fbed80392a0 0x7fbed803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:10:58.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.785+0000 7fbef6a01640 1 -- 172.21.15.120:0/1939010037 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbef0101b60 con 0x7fbef00ff8e0 2024-09-19T05:10:58.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.786+0000 7fbeed7fa640 1 -- 172.21.15.120:0/1939010037 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbee006d190 con 0x7fbef00ff8e0 2024-09-19T05:10:58.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.786+0000 7fbeef7fe640 1 --2- 172.21.15.120:0/1939010037 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fbed80392a0 0x7fbed803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:10:58.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.786+0000 7fbeef7fe640 1 --2- 172.21.15.120:0/1939010037 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fbed80392a0 0x7fbed803b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbee40098c0 tx=0x7fbee4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:10:58.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.790+0000 7fbeed7fa640 1 -- 172.21.15.120:0/1939010037 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbee00433b0 con 0x7fbef00ff8e0 2024-09-19T05:10:58.967 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.966+0000 7fbef6a01640 1 -- 172.21.15.120:0/1939010037 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fbef002d830 con 0x7fbed80392a0 2024-09-19T05:10:58.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.969+0000 7fbeed7fa640 1 -- 172.21.15.120:0/1939010037 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbef002d830 con 0x7fbed80392a0 2024-09-19T05:10:58.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.971+0000 7fbef6a01640 1 -- 172.21.15.120:0/1939010037 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fbed80392a0 msgr2=0x7fbed803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:58.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.971+0000 7fbef6a01640 1 --2- 172.21.15.120:0/1939010037 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fbed80392a0 0x7fbed803b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbee40098c0 tx=0x7fbee4006db0 comp rx=0 tx=0).stop 2024-09-19T05:10:58.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.971+0000 7fbef6a01640 1 -- 172.21.15.120:0/1939010037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbef00ff8e0 msgr2=0x7fbef019d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:10:58.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.971+0000 7fbef6a01640 1 --2- 172.21.15.120:0/1939010037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbef00ff8e0 0x7fbef019d310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbee0005ec0 tx=0x7fbee00048f0 comp rx=0 tx=0).stop 2024-09-19T05:10:58.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.971+0000 7fbef6a01640 1 -- 172.21.15.120:0/1939010037 shutdown_connections 2024-09-19T05:10:58.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.971+0000 7fbef6a01640 1 --2- 172.21.15.120:0/1939010037 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fbed80392a0 0x7fbed803b760 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:58.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.971+0000 7fbef6a01640 1 --2- 172.21.15.120:0/1939010037 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbef00ff8e0 0x7fbef019d310 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:10:58.973 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.971+0000 7fbef6a01640 1 -- 172.21.15.120:0/1939010037 >> 172.21.15.120:0/1939010037 conn(0x7fbef00fb430 msgr2=0x7fbef0106860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:10:58.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.971+0000 7fbef6a01640 1 -- 172.21.15.120:0/1939010037 shutdown_connections 2024-09-19T05:10:58.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:10:58.972+0000 7fbef6a01640 1 -- 172.21.15.120:0/1939010037 wait complete. 2024-09-19T05:11:00.191 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:59 smithi120 ceph-mon[30956]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:11:00.191 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:59 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:00.191 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:59 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:11:00.191 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:59 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:00.191 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:59 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:11:00.191 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:59 smithi120 ceph-mon[30956]: Updating smithi120:/etc/ceph/ceph.conf 2024-09-19T05:11:00.192 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:59 smithi120 ceph-mon[30956]: Updating smithi120:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:11:00.192 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:59 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:00.192 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:59 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:00.192 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:10:59 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:00.219 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi178 2024-09-19T05:11:00.219 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-19T05:11:00.219 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/etc/ceph/ceph.conf 2024-09-19T05:11:00.238 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-19T05:11:00.238 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:11:00.296 INFO:tasks.cephadm:Adding host smithi178 to orchestrator... 2024-09-19T05:11:00.297 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph orch host add smithi178 2024-09-19T05:11:00.537 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:11:00.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.964+0000 7f49320fe640 1 -- 172.21.15.120:0/1349012221 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f492c100990 msgr2=0x7f492c100d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:00.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.964+0000 7f49320fe640 1 --2- 172.21.15.120:0/1349012221 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f492c100990 0x7f492c100d70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f491c009c20 tx=0x7f491c02aa90 comp rx=0 tx=0).stop 2024-09-19T05:11:00.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.965+0000 7f49320fe640 1 -- 172.21.15.120:0/1349012221 shutdown_connections 2024-09-19T05:11:00.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.965+0000 7f49320fe640 1 --2- 172.21.15.120:0/1349012221 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f492c100990 0x7f492c100d70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:00.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.965+0000 7f49320fe640 1 -- 172.21.15.120:0/1349012221 >> 172.21.15.120:0/1349012221 conn(0x7f492c076250 msgr2=0x7f492c076660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:00.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.965+0000 7f49320fe640 1 -- 172.21.15.120:0/1349012221 shutdown_connections 2024-09-19T05:11:00.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.965+0000 7f49320fe640 1 -- 172.21.15.120:0/1349012221 wait complete. 2024-09-19T05:11:00.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.965+0000 7f49320fe640 1 Processor -- start 2024-09-19T05:11:00.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.965+0000 7f49320fe640 1 -- start start 2024-09-19T05:11:00.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.966+0000 7f49320fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f492c100990 0x7f492c1970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:00.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.966+0000 7f49320fe640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f492c10aa40 con 0x7f492c100990 2024-09-19T05:11:00.970 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.966+0000 7f492b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f492c100990 0x7f492c1970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:00.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.966+0000 7f492b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f492c100990 0x7f492c1970b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45034/0 (socket says 172.21.15.120:45034) 2024-09-19T05:11:00.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.966+0000 7f492b7fe640 1 -- 172.21.15.120:0/2872665578 learned_addr learned my addr 172.21.15.120:0/2872665578 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:11:00.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.966+0000 7f492b7fe640 1 -- 172.21.15.120:0/2872665578 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492c1975f0 con 0x7f492c100990 2024-09-19T05:11:00.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.966+0000 7f492b7fe640 1 --2- 172.21.15.120:0/2872665578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f492c100990 0x7f492c1970b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f491c009d40 tx=0x7f491c030f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:00.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.966+0000 7f4928ff9640 1 -- 172.21.15.120:0/2872665578 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f491c047070 con 0x7f492c100990 2024-09-19T05:11:00.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.966+0000 7f49320fe640 1 -- 172.21.15.120:0/2872665578 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f492c197880 con 0x7f492c100990 2024-09-19T05:11:00.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.966+0000 7f4928ff9640 1 -- 172.21.15.120:0/2872665578 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f491c003e20 con 0x7f492c100990 2024-09-19T05:11:00.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.966+0000 7f4928ff9640 1 -- 172.21.15.120:0/2872665578 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f491c033050 con 0x7f492c100990 2024-09-19T05:11:00.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.966+0000 7f49320fe640 1 -- 172.21.15.120:0/2872665578 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f492c197ce0 con 0x7f492c100990 2024-09-19T05:11:00.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.967+0000 7f4928ff9640 1 -- 172.21.15.120:0/2872665578 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f491c04a070 con 0x7f492c100990 2024-09-19T05:11:00.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.967+0000 7f49320fe640 1 -- 172.21.15.120:0/2872665578 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f492c101c40 con 0x7f492c100990 2024-09-19T05:11:00.971 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.967+0000 7f4928ff9640 1 --2- 172.21.15.120:0/2872665578 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f49140392a0 0x7f491403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:00.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.967+0000 7f4928ff9640 1 -- 172.21.15.120:0/2872665578 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f491c03e030 con 0x7f492c100990 2024-09-19T05:11:00.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.968+0000 7f492affd640 1 --2- 172.21.15.120:0/2872665578 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f49140392a0 0x7f491403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:00.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.968+0000 7f492affd640 1 --2- 172.21.15.120:0/2872665578 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f49140392a0 0x7f491403b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f49200098c0 tx=0x7f4920006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:00.974 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:00.972+0000 7f4928ff9640 1 -- 172.21.15.120:0/2872665578 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f491c0492c0 con 0x7f492c100990 2024-09-19T05:11:01.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:01.146+0000 7f49320fe640 1 -- 172.21.15.120:0/2872665578 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi178", "target": ["mon-mgr", ""]}) -- 0x7f492c198470 con 0x7f49140392a0 2024-09-19T05:11:01.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:00 smithi120 ceph-mon[30956]: Updating smithi120:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:11:01.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:00 smithi120 ceph-mon[30956]: Updating smithi120:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:11:02.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:01 smithi120 ceph-mon[30956]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi178", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:11:03.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:03 smithi120 ceph-mon[30956]: Deploying cephadm binary to smithi178 2024-09-19T05:11:04.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:04.578+0000 7f4928ff9640 1 -- 172.21.15.120:0/2872665578 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f492c198470 con 0x7f49140392a0 2024-09-19T05:11:04.581 INFO:teuthology.orchestra.run.smithi120.stdout:Added host 'smithi178' with addr '172.21.15.178' 2024-09-19T05:11:04.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:04.581+0000 7f49320fe640 1 -- 172.21.15.120:0/2872665578 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f49140392a0 msgr2=0x7f491403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:04.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:04.581+0000 7f49320fe640 1 --2- 172.21.15.120:0/2872665578 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f49140392a0 0x7f491403b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f49200098c0 tx=0x7f4920006db0 comp rx=0 tx=0).stop 2024-09-19T05:11:04.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:04.581+0000 7f49320fe640 1 -- 172.21.15.120:0/2872665578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f492c100990 msgr2=0x7f492c1970b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:04.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:04.581+0000 7f49320fe640 1 --2- 172.21.15.120:0/2872665578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f492c100990 0x7f492c1970b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f491c009d40 tx=0x7f491c030f50 comp rx=0 tx=0).stop 2024-09-19T05:11:04.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:04.581+0000 7f49320fe640 1 -- 172.21.15.120:0/2872665578 shutdown_connections 2024-09-19T05:11:04.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:04.581+0000 7f49320fe640 1 --2- 172.21.15.120:0/2872665578 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f49140392a0 0x7f491403b760 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:04.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:04.581+0000 7f49320fe640 1 --2- 172.21.15.120:0/2872665578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f492c100990 0x7f492c1970b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:04.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:04.581+0000 7f49320fe640 1 -- 172.21.15.120:0/2872665578 >> 172.21.15.120:0/2872665578 conn(0x7f492c076250 msgr2=0x7f492c1042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:04.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:04.581+0000 7f49320fe640 1 -- 172.21.15.120:0/2872665578 shutdown_connections 2024-09-19T05:11:04.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:04.581+0000 7f49320fe640 1 -- 172.21.15.120:0/2872665578 wait complete. 2024-09-19T05:11:05.228 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T05:11:05.469 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:11:05.834 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:05 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:05.835 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:05 smithi120 ceph-mon[30956]: Added host smithi178 2024-09-19T05:11:05.835 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:05 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:11:05.835 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:05 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:05.835 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:05 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:05.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.912+0000 7f7438b93640 1 -- 172.21.15.120:0/1985490641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7434106590 msgr2=0x7f7434106970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:05.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.912+0000 7f7438b93640 1 --2- 172.21.15.120:0/1985490641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7434106590 0x7f7434106970 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7424009880 tx=0x7f742402a5d0 comp rx=0 tx=0).stop 2024-09-19T05:11:05.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.912+0000 7f7438b93640 1 -- 172.21.15.120:0/1985490641 shutdown_connections 2024-09-19T05:11:05.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.912+0000 7f7438b93640 1 --2- 172.21.15.120:0/1985490641 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7434106590 0x7f7434106970 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:05.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.912+0000 7f7438b93640 1 -- 172.21.15.120:0/1985490641 >> 172.21.15.120:0/1985490641 conn(0x7f74340fc1a0 msgr2=0x7f74340fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:05.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.912+0000 7f7438b93640 1 -- 172.21.15.120:0/1985490641 shutdown_connections 2024-09-19T05:11:05.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.912+0000 7f7438b93640 1 -- 172.21.15.120:0/1985490641 wait complete. 2024-09-19T05:11:05.927 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.913+0000 7f7438b93640 1 Processor -- start 2024-09-19T05:11:05.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.913+0000 7f7438b93640 1 -- start start 2024-09-19T05:11:05.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.913+0000 7f7438b93640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7434106590 0x7f7434195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:05.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.913+0000 7f7438b93640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f743410aa70 con 0x7f7434106590 2024-09-19T05:11:05.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.913+0000 7f743259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7434106590 0x7f7434195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:05.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.913+0000 7f743259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7434106590 0x7f7434195ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50778/0 (socket says 172.21.15.120:50778) 2024-09-19T05:11:05.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.913+0000 7f743259c640 1 -- 172.21.15.120:0/1109569640 learned_addr learned my addr 172.21.15.120:0/1109569640 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:11:05.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.914+0000 7f743259c640 1 -- 172.21.15.120:0/1109569640 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7434196420 con 0x7f7434106590 2024-09-19T05:11:05.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.914+0000 7f743259c640 1 --2- 172.21.15.120:0/1109569640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7434106590 0x7f7434195ee0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7424009230 tx=0x7f74240048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:05.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.914+0000 7f742b7fe640 1 -- 172.21.15.120:0/1109569640 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f742403f070 con 0x7f7434106590 2024-09-19T05:11:05.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.914+0000 7f742b7fe640 1 -- 172.21.15.120:0/1109569640 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7424004d10 con 0x7f7434106590 2024-09-19T05:11:05.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.914+0000 7f7438b93640 1 -- 172.21.15.120:0/1109569640 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74341966b0 con 0x7f7434106590 2024-09-19T05:11:05.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.914+0000 7f742b7fe640 1 -- 172.21.15.120:0/1109569640 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7424035030 con 0x7f7434106590 2024-09-19T05:11:05.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.914+0000 7f7438b93640 1 -- 172.21.15.120:0/1109569640 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f743419a7b0 con 0x7f7434106590 2024-09-19T05:11:05.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.915+0000 7f742b7fe640 1 -- 172.21.15.120:0/1109569640 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f7424042070 con 0x7f7434106590 2024-09-19T05:11:05.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.915+0000 7f7438b93640 1 -- 172.21.15.120:0/1109569640 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7434101c00 con 0x7f7434106590 2024-09-19T05:11:05.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.915+0000 7f742b7fe640 1 --2- 172.21.15.120:0/1109569640 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f74200392a0 0x7f742003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:05.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.915+0000 7f742b7fe640 1 -- 172.21.15.120:0/1109569640 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f742406d230 con 0x7f7434106590 2024-09-19T05:11:05.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.915+0000 7f7431d9b640 1 --2- 172.21.15.120:0/1109569640 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f74200392a0 0x7f742003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:05.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.916+0000 7f7431d9b640 1 --2- 172.21.15.120:0/1109569640 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f74200392a0 0x7f742003b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f741c0098c0 tx=0x7f741c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:05.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:05.920+0000 7f742b7fe640 1 -- 172.21.15.120:0/1109569640 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7424039350 con 0x7f7434106590 2024-09-19T05:11:06.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:06.096+0000 7f7438b93640 1 -- 172.21.15.120:0/1109569640 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7434197240 con 0x7f74200392a0 2024-09-19T05:11:06.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:06.097+0000 7f742b7fe640 1 -- 172.21.15.120:0/1109569640 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+161 (secure 0 0 0) 0x7f7434197240 con 0x7f74200392a0 2024-09-19T05:11:06.099 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:11:06.099 INFO:teuthology.orchestra.run.smithi120.stdout:[{"addr": "172.21.15.120", "hostname": "smithi120", "labels": [], "status": ""}, {"addr": "172.21.15.178", "hostname": "smithi178", "labels": [], "status": ""}] 2024-09-19T05:11:06.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:06.099+0000 7f7438b93640 1 -- 172.21.15.120:0/1109569640 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f74200392a0 msgr2=0x7f742003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:06.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:06.099+0000 7f7438b93640 1 --2- 172.21.15.120:0/1109569640 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f74200392a0 0x7f742003b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f741c0098c0 tx=0x7f741c006db0 comp rx=0 tx=0).stop 2024-09-19T05:11:06.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:06.099+0000 7f7438b93640 1 -- 172.21.15.120:0/1109569640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7434106590 msgr2=0x7f7434195ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:06.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:06.099+0000 7f7438b93640 1 --2- 172.21.15.120:0/1109569640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7434106590 0x7f7434195ee0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7424009230 tx=0x7f74240048f0 comp rx=0 tx=0).stop 2024-09-19T05:11:06.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:06.099+0000 7f7438b93640 1 -- 172.21.15.120:0/1109569640 shutdown_connections 2024-09-19T05:11:06.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:06.099+0000 7f7438b93640 1 --2- 172.21.15.120:0/1109569640 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f74200392a0 0x7f742003b760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:06.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:06.099+0000 7f7438b93640 1 --2- 172.21.15.120:0/1109569640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7434106590 0x7f7434195ee0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:06.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:06.099+0000 7f7438b93640 1 -- 172.21.15.120:0/1109569640 >> 172.21.15.120:0/1109569640 conn(0x7f74340fc1a0 msgr2=0x7f74340fc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:06.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:06.100+0000 7f7438b93640 1 -- 172.21.15.120:0/1109569640 shutdown_connections 2024-09-19T05:11:06.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:06.100+0000 7f7438b93640 1 -- 172.21.15.120:0/1109569640 wait complete. 2024-09-19T05:11:06.642 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi194 2024-09-19T05:11:06.643 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T05:11:06.643 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/etc/ceph/ceph.conf 2024-09-19T05:11:06.663 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T05:11:06.664 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:11:06.723 INFO:tasks.cephadm:Adding host smithi194 to orchestrator... 2024-09-19T05:11:06.723 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph orch host add smithi194 2024-09-19T05:11:06.963 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:11:07.081 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:06 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:07.082 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:06 smithi120 ceph-mon[30956]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:11:07.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.396+0000 7f23b0487640 1 -- 172.21.15.120:0/785395760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23a8106590 msgr2=0x7f23a8106970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:07.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.396+0000 7f23b0487640 1 --2- 172.21.15.120:0/785395760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23a8106590 0x7f23a8106970 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009880 tx=0x7f23a402a5d0 comp rx=0 tx=0).stop 2024-09-19T05:11:07.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.396+0000 7f23b0487640 1 -- 172.21.15.120:0/785395760 shutdown_connections 2024-09-19T05:11:07.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.396+0000 7f23b0487640 1 --2- 172.21.15.120:0/785395760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23a8106590 0x7f23a8106970 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:07.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.396+0000 7f23b0487640 1 -- 172.21.15.120:0/785395760 >> 172.21.15.120:0/785395760 conn(0x7f23a80fc1a0 msgr2=0x7f23a80fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:07.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.396+0000 7f23b0487640 1 -- 172.21.15.120:0/785395760 shutdown_connections 2024-09-19T05:11:07.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.396+0000 7f23b0487640 1 -- 172.21.15.120:0/785395760 wait complete. 2024-09-19T05:11:07.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.396+0000 7f23b0487640 1 Processor -- start 2024-09-19T05:11:07.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.396+0000 7f23b0487640 1 -- start start 2024-09-19T05:11:07.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.397+0000 7f23b0487640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23a8106590 0x7f23a8197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:07.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.397+0000 7f23b0487640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f23a810aa70 con 0x7f23a8106590 2024-09-19T05:11:07.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.397+0000 7f23ae223640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23a8106590 0x7f23a8197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:07.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.397+0000 7f23ae223640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23a8106590 0x7f23a8197080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50800/0 (socket says 172.21.15.120:50800) 2024-09-19T05:11:07.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.397+0000 7f23ae223640 1 -- 172.21.15.120:0/3188938251 learned_addr learned my addr 172.21.15.120:0/3188938251 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:11:07.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.397+0000 7f23ae223640 1 -- 172.21.15.120:0/3188938251 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a81975c0 con 0x7f23a8106590 2024-09-19T05:11:07.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.397+0000 7f23ae223640 1 --2- 172.21.15.120:0/3188938251 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23a8106590 0x7f23a8197080 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009230 tx=0x7f23a40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:07.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.397+0000 7f239f7fe640 1 -- 172.21.15.120:0/3188938251 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23a403f070 con 0x7f23a8106590 2024-09-19T05:11:07.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.397+0000 7f23b0487640 1 -- 172.21.15.120:0/3188938251 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a8197850 con 0x7f23a8106590 2024-09-19T05:11:07.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.397+0000 7f239f7fe640 1 -- 172.21.15.120:0/3188938251 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f23a4004d10 con 0x7f23a8106590 2024-09-19T05:11:07.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.397+0000 7f239f7fe640 1 -- 172.21.15.120:0/3188938251 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23a4035030 con 0x7f23a8106590 2024-09-19T05:11:07.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.397+0000 7f23b0487640 1 -- 172.21.15.120:0/3188938251 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a8197cb0 con 0x7f23a8106590 2024-09-19T05:11:07.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.398+0000 7f239f7fe640 1 -- 172.21.15.120:0/3188938251 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f23a4042070 con 0x7f23a8106590 2024-09-19T05:11:07.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.398+0000 7f23b0487640 1 -- 172.21.15.120:0/3188938251 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23a8101c00 con 0x7f23a8106590 2024-09-19T05:11:07.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.398+0000 7f239f7fe640 1 --2- 172.21.15.120:0/3188938251 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f23940392a0 0x7f239403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:07.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.398+0000 7f239f7fe640 1 -- 172.21.15.120:0/3188938251 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f23a406cfc0 con 0x7f23a8106590 2024-09-19T05:11:07.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.398+0000 7f23ada22640 1 --2- 172.21.15.120:0/3188938251 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f23940392a0 0x7f239403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:07.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.399+0000 7f23ada22640 1 --2- 172.21.15.120:0/3188938251 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f23940392a0 0x7f239403b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f23980098c0 tx=0x7f2398006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:07.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.403+0000 7f239f7fe640 1 -- 172.21.15.120:0/3188938251 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f23a4042360 con 0x7f23a8106590 2024-09-19T05:11:07.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:07.573+0000 7f23b0487640 1 -- 172.21.15.120:0/3188938251 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi194", "target": ["mon-mgr", ""]}) -- 0x7f23a8198450 con 0x7f23940392a0 2024-09-19T05:11:09.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:09 smithi120 ceph-mon[30956]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi194", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:11:09.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:09 smithi120 ceph-mon[30956]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:09.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:09 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:09.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:09 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:09.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:09 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:09.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:09 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:09.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:09 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi178", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:11:09.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:09 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:09.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:09 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:11:10.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:10 smithi120 ceph-mon[30956]: Updating smithi178:/etc/ceph/ceph.conf 2024-09-19T05:11:10.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:10 smithi120 ceph-mon[30956]: Deploying cephadm binary to smithi194 2024-09-19T05:11:10.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:10 smithi120 ceph-mon[30956]: Updating smithi178:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:11:10.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:10 smithi120 ceph-mon[30956]: Updating smithi178:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:11:10.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:10 smithi120 ceph-mon[30956]: Updating smithi178:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:11:10.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:10 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:10.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:10 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:10.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:10 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:10.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:10.961+0000 7f239f7fe640 1 -- 172.21.15.120:0/3188938251 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f23a8198450 con 0x7f23940392a0 2024-09-19T05:11:10.963 INFO:teuthology.orchestra.run.smithi120.stdout:Added host 'smithi194' with addr '172.21.15.194' 2024-09-19T05:11:10.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:10.963+0000 7f23b0487640 1 -- 172.21.15.120:0/3188938251 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f23940392a0 msgr2=0x7f239403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:10.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:10.963+0000 7f23b0487640 1 --2- 172.21.15.120:0/3188938251 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f23940392a0 0x7f239403b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f23980098c0 tx=0x7f2398006db0 comp rx=0 tx=0).stop 2024-09-19T05:11:10.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:10.963+0000 7f23b0487640 1 -- 172.21.15.120:0/3188938251 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23a8106590 msgr2=0x7f23a8197080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:10.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:10.963+0000 7f23b0487640 1 --2- 172.21.15.120:0/3188938251 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23a8106590 0x7f23a8197080 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009230 tx=0x7f23a40048f0 comp rx=0 tx=0).stop 2024-09-19T05:11:10.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:10.963+0000 7f23b0487640 1 -- 172.21.15.120:0/3188938251 shutdown_connections 2024-09-19T05:11:10.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:10.963+0000 7f23b0487640 1 --2- 172.21.15.120:0/3188938251 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f23940392a0 0x7f239403b760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:10.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:10.963+0000 7f23b0487640 1 --2- 172.21.15.120:0/3188938251 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23a8106590 0x7f23a8197080 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:10.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:10.963+0000 7f23b0487640 1 -- 172.21.15.120:0/3188938251 >> 172.21.15.120:0/3188938251 conn(0x7f23a80fc1a0 msgr2=0x7f23a80fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:10.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:10.963+0000 7f23b0487640 1 -- 172.21.15.120:0/3188938251 shutdown_connections 2024-09-19T05:11:10.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:10.963+0000 7f23b0487640 1 -- 172.21.15.120:0/3188938251 wait complete. 2024-09-19T05:11:11.261 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:11 smithi120 ceph-mon[30956]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:11.261 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:11 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:11.261 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:11 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:11:11.614 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T05:11:11.852 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:11:12.271 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:12 smithi120 ceph-mon[30956]: Added host smithi194 2024-09-19T05:11:12.271 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:12 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:12.271 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:12 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:12.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.269+0000 7f8ee201f640 1 -- 172.21.15.120:0/3226931118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8edc106590 msgr2=0x7f8edc106970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:12.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.269+0000 7f8ee201f640 1 --2- 172.21.15.120:0/3226931118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8edc106590 0x7f8edc106970 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc009880 tx=0x7f8ecc02a5d0 comp rx=0 tx=0).stop 2024-09-19T05:11:12.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.269+0000 7f8ee201f640 1 -- 172.21.15.120:0/3226931118 shutdown_connections 2024-09-19T05:11:12.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.269+0000 7f8ee201f640 1 --2- 172.21.15.120:0/3226931118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8edc106590 0x7f8edc106970 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:12.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.269+0000 7f8ee201f640 1 -- 172.21.15.120:0/3226931118 >> 172.21.15.120:0/3226931118 conn(0x7f8edc0fc1a0 msgr2=0x7f8edc0fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:12.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.269+0000 7f8ee201f640 1 -- 172.21.15.120:0/3226931118 shutdown_connections 2024-09-19T05:11:12.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.269+0000 7f8ee201f640 1 -- 172.21.15.120:0/3226931118 wait complete. 2024-09-19T05:11:12.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.269+0000 7f8ee201f640 1 Processor -- start 2024-09-19T05:11:12.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.270+0000 7f8ee201f640 1 -- start start 2024-09-19T05:11:12.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.270+0000 7f8ee201f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8edc106590 0x7f8edc1970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:12.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.270+0000 7f8ee201f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc10aa70 con 0x7f8edc106590 2024-09-19T05:11:12.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.270+0000 7f8edb7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8edc106590 0x7f8edc1970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:12.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.270+0000 7f8edb7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8edc106590 0x7f8edc1970b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50816/0 (socket says 172.21.15.120:50816) 2024-09-19T05:11:12.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.270+0000 7f8edb7fe640 1 -- 172.21.15.120:0/1205845493 learned_addr learned my addr 172.21.15.120:0/1205845493 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:11:12.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.270+0000 7f8edb7fe640 1 -- 172.21.15.120:0/1205845493 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8edc1975f0 con 0x7f8edc106590 2024-09-19T05:11:12.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.270+0000 7f8edb7fe640 1 --2- 172.21.15.120:0/1205845493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8edc106590 0x7f8edc1970b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc009230 tx=0x7f8ecc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:12.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.271+0000 7f8ed8ff9640 1 -- 172.21.15.120:0/1205845493 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ecc03f070 con 0x7f8edc106590 2024-09-19T05:11:12.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.271+0000 7f8ed8ff9640 1 -- 172.21.15.120:0/1205845493 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8ecc004d10 con 0x7f8edc106590 2024-09-19T05:11:12.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.271+0000 7f8ed8ff9640 1 -- 172.21.15.120:0/1205845493 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ecc035030 con 0x7f8edc106590 2024-09-19T05:11:12.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.271+0000 7f8ee201f640 1 -- 172.21.15.120:0/1205845493 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8edc197880 con 0x7f8edc106590 2024-09-19T05:11:12.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.271+0000 7f8ee201f640 1 -- 172.21.15.120:0/1205845493 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8edc197ce0 con 0x7f8edc106590 2024-09-19T05:11:12.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.272+0000 7f8ed8ff9640 1 -- 172.21.15.120:0/1205845493 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f8ecc042070 con 0x7f8edc106590 2024-09-19T05:11:12.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.272+0000 7f8ee201f640 1 -- 172.21.15.120:0/1205845493 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8edc101c00 con 0x7f8edc106590 2024-09-19T05:11:12.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.272+0000 7f8ed8ff9640 1 --2- 172.21.15.120:0/1205845493 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f8ec4039300 0x7f8ec403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:12.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.272+0000 7f8ed8ff9640 1 -- 172.21.15.120:0/1205845493 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8ecc06cfa0 con 0x7f8edc106590 2024-09-19T05:11:12.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.272+0000 7f8edaffd640 1 --2- 172.21.15.120:0/1205845493 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f8ec4039300 0x7f8ec403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:12.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.272+0000 7f8edaffd640 1 --2- 172.21.15.120:0/1205845493 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f8ec4039300 0x7f8ec403b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8ed00098c0 tx=0x7f8ed0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:12.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.277+0000 7f8ed8ff9640 1 -- 172.21.15.120:0/1205845493 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8ecc039350 con 0x7f8edc106590 2024-09-19T05:11:12.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.449+0000 7f8ee201f640 1 -- 172.21.15.120:0/1205845493 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8edc198470 con 0x7f8ec4039300 2024-09-19T05:11:12.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.450+0000 7f8ed8ff9640 1 -- 172.21.15.120:0/1205845493 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+241 (secure 0 0 0) 0x7f8edc198470 con 0x7f8ec4039300 2024-09-19T05:11:12.452 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:11:12.453 INFO:teuthology.orchestra.run.smithi120.stdout:[{"addr": "172.21.15.120", "hostname": "smithi120", "labels": [], "status": ""}, {"addr": "172.21.15.178", "hostname": "smithi178", "labels": [], "status": ""}, {"addr": "172.21.15.194", "hostname": "smithi194", "labels": [], "status": ""}] 2024-09-19T05:11:12.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.452+0000 7f8ee201f640 1 -- 172.21.15.120:0/1205845493 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f8ec4039300 msgr2=0x7f8ec403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:12.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.452+0000 7f8ee201f640 1 --2- 172.21.15.120:0/1205845493 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f8ec4039300 0x7f8ec403b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8ed00098c0 tx=0x7f8ed0006db0 comp rx=0 tx=0).stop 2024-09-19T05:11:12.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.453+0000 7f8ee201f640 1 -- 172.21.15.120:0/1205845493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8edc106590 msgr2=0x7f8edc1970b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:12.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.453+0000 7f8ee201f640 1 --2- 172.21.15.120:0/1205845493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8edc106590 0x7f8edc1970b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc009230 tx=0x7f8ecc0048f0 comp rx=0 tx=0).stop 2024-09-19T05:11:12.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.453+0000 7f8ee201f640 1 -- 172.21.15.120:0/1205845493 shutdown_connections 2024-09-19T05:11:12.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.453+0000 7f8ee201f640 1 --2- 172.21.15.120:0/1205845493 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f8ec4039300 0x7f8ec403b7c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:12.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.453+0000 7f8ee201f640 1 --2- 172.21.15.120:0/1205845493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8edc106590 0x7f8edc1970b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:12.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.453+0000 7f8ee201f640 1 -- 172.21.15.120:0/1205845493 >> 172.21.15.120:0/1205845493 conn(0x7f8edc0fc1a0 msgr2=0x7f8edc069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:12.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.453+0000 7f8ee201f640 1 -- 172.21.15.120:0/1205845493 shutdown_connections 2024-09-19T05:11:12.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:12.453+0000 7f8ee201f640 1 -- 172.21.15.120:0/1205845493 wait complete. 2024-09-19T05:11:13.013 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T05:11:13.014 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T05:11:13.250 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:11:13.370 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:13 smithi120 ceph-mon[30956]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:13.370 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:13 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:13.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.660+0000 7f47b7973640 1 -- 172.21.15.120:0/986353408 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47b0107660 msgr2=0x7f47b0107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:13.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.660+0000 7f47b7973640 1 --2- 172.21.15.120:0/986353408 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47b0107660 0x7f47b0107a40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f47ac009880 tx=0x7f47ac02a5d0 comp rx=0 tx=0).stop 2024-09-19T05:11:13.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.660+0000 7f47b7973640 1 -- 172.21.15.120:0/986353408 shutdown_connections 2024-09-19T05:11:13.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.660+0000 7f47b7973640 1 --2- 172.21.15.120:0/986353408 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47b0107660 0x7f47b0107a40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:13.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.660+0000 7f47b7973640 1 -- 172.21.15.120:0/986353408 >> 172.21.15.120:0/986353408 conn(0x7f47b00fd2b0 msgr2=0x7f47b00ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:13.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.660+0000 7f47b7973640 1 -- 172.21.15.120:0/986353408 shutdown_connections 2024-09-19T05:11:13.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.660+0000 7f47b7973640 1 -- 172.21.15.120:0/986353408 wait complete. 2024-09-19T05:11:13.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.661+0000 7f47b7973640 1 Processor -- start 2024-09-19T05:11:13.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.661+0000 7f47b7973640 1 -- start start 2024-09-19T05:11:13.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.661+0000 7f47b7973640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47b0107660 0x7f47b0196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:13.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.661+0000 7f47b7973640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f47b010bb20 con 0x7f47b0107660 2024-09-19T05:11:13.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.661+0000 7f47b570f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47b0107660 0x7f47b0196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:13.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.661+0000 7f47b570f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47b0107660 0x7f47b0196fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50832/0 (socket says 172.21.15.120:50832) 2024-09-19T05:11:13.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.661+0000 7f47b570f640 1 -- 172.21.15.120:0/2349252284 learned_addr learned my addr 172.21.15.120:0/2349252284 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:11:13.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.662+0000 7f47b570f640 1 -- 172.21.15.120:0/2349252284 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b0197500 con 0x7f47b0107660 2024-09-19T05:11:13.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.662+0000 7f47b570f640 1 --2- 172.21.15.120:0/2349252284 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47b0107660 0x7f47b0196fc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f47ac009230 tx=0x7f47ac0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:13.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.662+0000 7f47a67fc640 1 -- 172.21.15.120:0/2349252284 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47ac03f070 con 0x7f47b0107660 2024-09-19T05:11:13.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.662+0000 7f47a67fc640 1 -- 172.21.15.120:0/2349252284 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47ac004d10 con 0x7f47b0107660 2024-09-19T05:11:13.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.662+0000 7f47b7973640 1 -- 172.21.15.120:0/2349252284 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b01977f0 con 0x7f47b0107660 2024-09-19T05:11:13.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.662+0000 7f47a67fc640 1 -- 172.21.15.120:0/2349252284 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47ac035030 con 0x7f47b0107660 2024-09-19T05:11:13.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.662+0000 7f47b7973640 1 -- 172.21.15.120:0/2349252284 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b019b890 con 0x7f47b0107660 2024-09-19T05:11:13.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.663+0000 7f47a67fc640 1 -- 172.21.15.120:0/2349252284 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f47ac042070 con 0x7f47b0107660 2024-09-19T05:11:13.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.663+0000 7f47b7973640 1 -- 172.21.15.120:0/2349252284 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47b0102d10 con 0x7f47b0107660 2024-09-19T05:11:13.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.663+0000 7f47a67fc640 1 --2- 172.21.15.120:0/2349252284 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f479c039300 0x7f479c03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:13.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.663+0000 7f47a67fc640 1 -- 172.21.15.120:0/2349252284 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f47ac06cf00 con 0x7f47b0107660 2024-09-19T05:11:13.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.663+0000 7f47b4f0e640 1 --2- 172.21.15.120:0/2349252284 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f479c039300 0x7f479c03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:13.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.664+0000 7f47b4f0e640 1 --2- 172.21.15.120:0/2349252284 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f479c039300 0x7f479c03b7c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f47a00098c0 tx=0x7f47a0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:13.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.668+0000 7f47a67fc640 1 -- 172.21.15.120:0/2349252284 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f47ac042360 con 0x7f47b0107660 2024-09-19T05:11:13.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:13.837+0000 7f47b7973640 1 -- 172.21.15.120:0/2349252284 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f47b0198320 con 0x7f47b0107660 2024-09-19T05:11:14.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:14.040+0000 7f47a67fc640 1 -- 172.21.15.120:0/2349252284 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f47ac02fdc0 con 0x7f47b0107660 2024-09-19T05:11:14.042 INFO:teuthology.orchestra.run.smithi120.stderr:adjusted tunables profile to default 2024-09-19T05:11:14.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:14.042+0000 7f47b7973640 1 -- 172.21.15.120:0/2349252284 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f479c039300 msgr2=0x7f479c03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:14.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:14.042+0000 7f47b7973640 1 --2- 172.21.15.120:0/2349252284 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f479c039300 0x7f479c03b7c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f47a00098c0 tx=0x7f47a0006db0 comp rx=0 tx=0).stop 2024-09-19T05:11:14.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:14.042+0000 7f47b7973640 1 -- 172.21.15.120:0/2349252284 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47b0107660 msgr2=0x7f47b0196fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:14.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:14.042+0000 7f47b7973640 1 --2- 172.21.15.120:0/2349252284 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47b0107660 0x7f47b0196fc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f47ac009230 tx=0x7f47ac0048f0 comp rx=0 tx=0).stop 2024-09-19T05:11:14.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:14.042+0000 7f47b7973640 1 -- 172.21.15.120:0/2349252284 shutdown_connections 2024-09-19T05:11:14.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:14.042+0000 7f47b7973640 1 --2- 172.21.15.120:0/2349252284 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f479c039300 0x7f479c03b7c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:14.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:14.042+0000 7f47b7973640 1 --2- 172.21.15.120:0/2349252284 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47b0107660 0x7f47b0196fc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:14.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:14.042+0000 7f47b7973640 1 -- 172.21.15.120:0/2349252284 >> 172.21.15.120:0/2349252284 conn(0x7f47b00fd2b0 msgr2=0x7f47b00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:14.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:14.042+0000 7f47b7973640 1 -- 172.21.15.120:0/2349252284 shutdown_connections 2024-09-19T05:11:14.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:14.042+0000 7f47b7973640 1 -- 172.21.15.120:0/2349252284 wait complete. 2024-09-19T05:11:14.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:14 smithi120 ceph-mon[30956]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:11:14.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:14 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2349252284' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T05:11:14.657 INFO:tasks.cephadm:Adding mon.a on smithi120 2024-09-19T05:11:14.657 INFO:tasks.cephadm:Adding mon.b on smithi178 2024-09-19T05:11:14.657 INFO:tasks.cephadm:Adding mon.c on smithi194 2024-09-19T05:11:14.657 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi120:172.21.15.120=a;smithi178:172.21.15.178=b;smithi194:172.21.15.194=c' 2024-09-19T05:11:15.225 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T05:11:15.270 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T05:11:15.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:15 smithi120 ceph-mon[30956]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:15.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:15 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2349252284' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T05:11:15.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:15 smithi120 ceph-mon[30956]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:11:15.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.728+0000 7f2188d68640 1 -- 172.21.15.194:0/1743715250 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21840ffca0 msgr2=0x7f21841000a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:15.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.728+0000 7f2188d68640 1 --2- 172.21.15.194:0/1743715250 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21840ffca0 0x7f21841000a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2174009880 tx=0x7f217402a5d0 comp rx=0 tx=0).stop 2024-09-19T05:11:15.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.728+0000 7f2188d68640 1 -- 172.21.15.194:0/1743715250 shutdown_connections 2024-09-19T05:11:15.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.728+0000 7f2188d68640 1 --2- 172.21.15.194:0/1743715250 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21840ffca0 0x7f21841000a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:15.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.728+0000 7f2188d68640 1 -- 172.21.15.194:0/1743715250 >> 172.21.15.194:0/1743715250 conn(0x7f21840fb430 msgr2=0x7f21840fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:15.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.728+0000 7f2188d68640 1 -- 172.21.15.194:0/1743715250 shutdown_connections 2024-09-19T05:11:15.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.728+0000 7f2188d68640 1 -- 172.21.15.194:0/1743715250 wait complete. 2024-09-19T05:11:15.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.729+0000 7f2188d68640 1 Processor -- start 2024-09-19T05:11:15.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.729+0000 7f2188d68640 1 -- start start 2024-09-19T05:11:15.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.729+0000 7f2188d68640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21840ffca0 0x7f2184196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:15.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.729+0000 7f2188d68640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2184105c60 con 0x7f21840ffca0 2024-09-19T05:11:15.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.729+0000 7f218259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21840ffca0 0x7f2184196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:15.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.729+0000 7f218259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21840ffca0 0x7f2184196cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:49864/0 (socket says 172.21.15.194:49864) 2024-09-19T05:11:15.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.729+0000 7f218259c640 1 -- 172.21.15.194:0/1678113031 learned_addr learned my addr 172.21.15.194:0/1678113031 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T05:11:15.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.729+0000 7f218259c640 1 -- 172.21.15.194:0/1678113031 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2184197200 con 0x7f21840ffca0 2024-09-19T05:11:15.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.730+0000 7f218259c640 1 --2- 172.21.15.194:0/1678113031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21840ffca0 0x7f2184196cc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2174009230 tx=0x7f21740048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:15.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.730+0000 7f21737fe640 1 -- 172.21.15.194:0/1678113031 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f217403f070 con 0x7f21840ffca0 2024-09-19T05:11:15.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.730+0000 7f2188d68640 1 -- 172.21.15.194:0/1678113031 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2184197490 con 0x7f21840ffca0 2024-09-19T05:11:15.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.730+0000 7f21737fe640 1 -- 172.21.15.194:0/1678113031 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2174003aa0 con 0x7f21840ffca0 2024-09-19T05:11:15.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.730+0000 7f21737fe640 1 -- 172.21.15.194:0/1678113031 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2174035030 con 0x7f21840ffca0 2024-09-19T05:11:15.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.730+0000 7f2188d68640 1 -- 172.21.15.194:0/1678113031 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f218419a180 con 0x7f21840ffca0 2024-09-19T05:11:15.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.731+0000 7f21737fe640 1 -- 172.21.15.194:0/1678113031 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f2174042070 con 0x7f21840ffca0 2024-09-19T05:11:15.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.731+0000 7f2188d68640 1 -- 172.21.15.194:0/1678113031 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21841063e0 con 0x7f21840ffca0 2024-09-19T05:11:15.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.731+0000 7f21737fe640 1 --2- 172.21.15.194:0/1678113031 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f216c0392a0 0x7f216c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:15.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.731+0000 7f21737fe640 1 -- 172.21.15.194:0/1678113031 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f217406d1f0 con 0x7f21840ffca0 2024-09-19T05:11:15.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.731+0000 7f2181d9b640 1 --2- 172.21.15.194:0/1678113031 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f216c0392a0 0x7f216c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:15.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.732+0000 7f2181d9b640 1 --2- 172.21.15.194:0/1678113031 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f216c0392a0 0x7f216c03b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f21780098c0 tx=0x7f2178006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:15.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.736+0000 7f21737fe640 1 -- 172.21.15.194:0/1678113031 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f217402f300 con 0x7f21840ffca0 2024-09-19T05:11:15.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.927+0000 7f2188d68640 1 -- 172.21.15.194:0/1678113031 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi120:172.21.15.120=a;smithi178:172.21.15.178=b;smithi194:172.21.15.194=c", "target": ["mon-mgr", ""]}) -- 0x7f218402d8f0 con 0x7f216c0392a0 2024-09-19T05:11:15.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.933+0000 7f21737fe640 1 -- 172.21.15.194:0/1678113031 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f218402d8f0 con 0x7f216c0392a0 2024-09-19T05:11:15.934 INFO:teuthology.orchestra.run.smithi194.stdout:Scheduled mon update... 2024-09-19T05:11:15.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.935+0000 7f2188d68640 1 -- 172.21.15.194:0/1678113031 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f216c0392a0 msgr2=0x7f216c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:15.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.935+0000 7f2188d68640 1 --2- 172.21.15.194:0/1678113031 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f216c0392a0 0x7f216c03b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f21780098c0 tx=0x7f2178006db0 comp rx=0 tx=0).stop 2024-09-19T05:11:15.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.935+0000 7f2188d68640 1 -- 172.21.15.194:0/1678113031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21840ffca0 msgr2=0x7f2184196cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:15.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.935+0000 7f2188d68640 1 --2- 172.21.15.194:0/1678113031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21840ffca0 0x7f2184196cc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2174009230 tx=0x7f21740048f0 comp rx=0 tx=0).stop 2024-09-19T05:11:15.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.935+0000 7f2188d68640 1 -- 172.21.15.194:0/1678113031 shutdown_connections 2024-09-19T05:11:15.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.935+0000 7f2188d68640 1 --2- 172.21.15.194:0/1678113031 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f216c0392a0 0x7f216c03b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:15.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.935+0000 7f2188d68640 1 --2- 172.21.15.194:0/1678113031 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21840ffca0 0x7f2184196cc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:15.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.935+0000 7f2188d68640 1 -- 172.21.15.194:0/1678113031 >> 172.21.15.194:0/1678113031 conn(0x7f21840fb430 msgr2=0x7f218418d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:15.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.935+0000 7f2188d68640 1 -- 172.21.15.194:0/1678113031 shutdown_connections 2024-09-19T05:11:15.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:15.935+0000 7f2188d68640 1 -- 172.21.15.194:0/1678113031 wait complete. 2024-09-19T05:11:16.603 DEBUG:teuthology.orchestra.run.smithi178:mon.b> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T05:11:16.606 DEBUG:teuthology.orchestra.run.smithi194:mon.c> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T05:11:16.609 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T05:11:16.609 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T05:11:16.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:16 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:16.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:16 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:16 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:16 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:16 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:11:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:16 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:16 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:11:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:16 smithi120 ceph-mon[30956]: Updating smithi194:/etc/ceph/ceph.conf 2024-09-19T05:11:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:16 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:16 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:16 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:16.627 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:16 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:16.627 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:16 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:11:16.627 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:16 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:17.406 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:11:17.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:17 smithi120 ceph-mon[30956]: Updating smithi194:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:11:17.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:17 smithi120 ceph-mon[30956]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:11:17.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:17 smithi120 ceph-mon[30956]: Updating smithi194:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:11:17.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:17 smithi120 ceph-mon[30956]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi120:172.21.15.120=a;smithi178:172.21.15.178=b;smithi194:172.21.15.194=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:11:17.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:17 smithi120 ceph-mon[30956]: Saving service mon spec with placement smithi120:172.21.15.120=a;smithi178:172.21.15.178=b;smithi194:172.21.15.194=c;count:3 2024-09-19T05:11:17.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:17 smithi120 ceph-mon[30956]: Deploying daemon mon.c on smithi194 2024-09-19T05:11:17.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:17 smithi120 ceph-mon[30956]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:18.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.832+0000 7f7f03fa9640 1 -- 172.21.15.194:0/357339648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7efc106560 msgr2=0x7f7efc0696c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:18.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.832+0000 7f7f03fa9640 1 --2- 172.21.15.194:0/357339648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7efc106560 0x7f7efc0696c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009880 tx=0x7f7ef802a5d0 comp rx=0 tx=0).stop 2024-09-19T05:11:18.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.832+0000 7f7f03fa9640 1 -- 172.21.15.194:0/357339648 shutdown_connections 2024-09-19T05:11:18.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.832+0000 7f7f03fa9640 1 --2- 172.21.15.194:0/357339648 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7efc106560 0x7f7efc0696c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:18.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.832+0000 7f7f03fa9640 1 -- 172.21.15.194:0/357339648 >> 172.21.15.194:0/357339648 conn(0x7f7efc076250 msgr2=0x7f7efc076660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:18.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.832+0000 7f7f03fa9640 1 -- 172.21.15.194:0/357339648 shutdown_connections 2024-09-19T05:11:18.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.832+0000 7f7f03fa9640 1 -- 172.21.15.194:0/357339648 wait complete. 2024-09-19T05:11:18.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.833+0000 7f7f03fa9640 1 Processor -- start 2024-09-19T05:11:18.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.833+0000 7f7f03fa9640 1 -- start start 2024-09-19T05:11:18.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.833+0000 7f7f03fa9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7efc106560 0x7f7efc19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:18.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.833+0000 7f7f03fa9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc1120f0 con 0x7f7efc106560 2024-09-19T05:11:18.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.833+0000 7f7f01d45640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7efc106560 0x7f7efc19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:18.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.834+0000 7f7f01d45640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7efc106560 0x7f7efc19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.194:59762/0 (socket says 172.21.15.194:59762) 2024-09-19T05:11:18.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.834+0000 7f7f01d45640 1 -- 172.21.15.194:0/749233674 learned_addr learned my addr 172.21.15.194:0/749233674 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T05:11:18.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.834+0000 7f7f01d45640 1 -- 172.21.15.194:0/749233674 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7efc19db80 con 0x7f7efc106560 2024-09-19T05:11:18.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.834+0000 7f7f01d45640 1 --2- 172.21.15.194:0/749233674 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7efc106560 0x7f7efc19d640 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009230 tx=0x7f7ef80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:18.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.834+0000 7f7ef2ffd640 1 -- 172.21.15.194:0/749233674 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ef803f070 con 0x7f7efc106560 2024-09-19T05:11:18.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.834+0000 7f7ef2ffd640 1 -- 172.21.15.194:0/749233674 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7ef8003aa0 con 0x7f7efc106560 2024-09-19T05:11:18.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.834+0000 7f7f03fa9640 1 -- 172.21.15.194:0/749233674 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7efc19de70 con 0x7f7efc106560 2024-09-19T05:11:18.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.834+0000 7f7ef2ffd640 1 -- 172.21.15.194:0/749233674 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ef8035030 con 0x7f7efc106560 2024-09-19T05:11:18.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.834+0000 7f7f03fa9640 1 -- 172.21.15.194:0/749233674 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7efc1a1f10 con 0x7f7efc106560 2024-09-19T05:11:18.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.835+0000 7f7ef2ffd640 1 -- 172.21.15.194:0/749233674 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f7ef8042070 con 0x7f7efc106560 2024-09-19T05:11:18.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.835+0000 7f7f03fa9640 1 -- 172.21.15.194:0/749233674 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7efc100b50 con 0x7f7efc106560 2024-09-19T05:11:18.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.835+0000 7f7ef2ffd640 1 --2- 172.21.15.194:0/749233674 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f7ee80392a0 0x7f7ee803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:18.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.835+0000 7f7ef2ffd640 1 -- 172.21.15.194:0/749233674 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7ef806cfb0 con 0x7f7efc106560 2024-09-19T05:11:18.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.836+0000 7f7f01544640 1 --2- 172.21.15.194:0/749233674 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f7ee80392a0 0x7f7ee803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:18.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.836+0000 7f7f01544640 1 --2- 172.21.15.194:0/749233674 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f7ee80392a0 0x7f7ee803b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400ad30 tx=0x7f7ef40093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:18.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:18.841+0000 7f7ef2ffd640 1 -- 172.21.15.194:0/749233674 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7ef804a260 con 0x7f7efc106560 2024-09-19T05:11:19.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:19.076+0000 7f7f03fa9640 1 -- 172.21.15.194:0/749233674 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f7efc19e9a0 con 0x7f7efc106560 2024-09-19T05:11:19.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:19.076+0000 7f7ef2ffd640 1 -- 172.21.15.194:0/749233674 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+749 (secure 0 0 0) 0x7f7ef8031400 con 0x7f7efc106560 2024-09-19T05:11:19.078 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:11:19.079 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"4e6e3df4-7645-11ef-bceb-c7b262605968","modified":"2024-09-19T05:09:53.071491Z","created":"2024-09-19T05:09:53.071491Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:3300","nonce":0},{"type":"v1","addr":"172.21.15.120:6789","nonce":0}]},"addr":"172.21.15.120:6789/0","public_addr":"172.21.15.120:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T05:11:19.079 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-09-19T05:11:19.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:19.078+0000 7f7f03fa9640 1 -- 172.21.15.194:0/749233674 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f7ee80392a0 msgr2=0x7f7ee803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:19.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:19.078+0000 7f7f03fa9640 1 --2- 172.21.15.194:0/749233674 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f7ee80392a0 0x7f7ee803b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400ad30 tx=0x7f7ef40093f0 comp rx=0 tx=0).stop 2024-09-19T05:11:19.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:19.078+0000 7f7f03fa9640 1 -- 172.21.15.194:0/749233674 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7efc106560 msgr2=0x7f7efc19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:19.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:19.078+0000 7f7f03fa9640 1 --2- 172.21.15.194:0/749233674 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7efc106560 0x7f7efc19d640 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009230 tx=0x7f7ef80048f0 comp rx=0 tx=0).stop 2024-09-19T05:11:19.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:19.078+0000 7f7f03fa9640 1 -- 172.21.15.194:0/749233674 shutdown_connections 2024-09-19T05:11:19.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:19.078+0000 7f7f03fa9640 1 --2- 172.21.15.194:0/749233674 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f7ee80392a0 0x7f7ee803b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:19.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:19.078+0000 7f7f03fa9640 1 --2- 172.21.15.194:0/749233674 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7efc106560 0x7f7efc19d640 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:19.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:19.078+0000 7f7f03fa9640 1 -- 172.21.15.194:0/749233674 >> 172.21.15.194:0/749233674 conn(0x7f7efc076250 msgr2=0x7f7efc101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:19.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:19.078+0000 7f7f03fa9640 1 -- 172.21.15.194:0/749233674 shutdown_connections 2024-09-19T05:11:19.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:19.078+0000 7f7f03fa9640 1 -- 172.21.15.194:0/749233674 wait complete. 2024-09-19T05:11:19.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:19 smithi120 ceph-mon[30956]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:19.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:19 smithi120 ceph-mon[30956]: from='client.? 172.21.15.194:0/749233674' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:11:20.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 podman[35209]: 2024-09-19 05:11:20.500886965 +0000 UTC m=+0.016050037 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:11:21.083 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T05:11:21.083 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T05:11:21.108 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 podman[35209]: 2024-09-19 05:11:20.799641469 +0000 UTC m=+0.314804536 container init f72c2601b83fa5407126a88e77243e19291e2d1956b1ca2f0e24f37dee2c82fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T05:11:21.108 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 podman[35209]: 2024-09-19 05:11:20.802789708 +0000 UTC m=+0.317952763 container start f72c2601b83fa5407126a88e77243e19291e2d1956b1ca2f0e24f37dee2c82fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-c, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T05:11:21.108 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T05:11:21.108 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T05:11:21.108 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: pidfile_write: ignore empty --pid-file 2024-09-19T05:11:21.108 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: load: jerasure load: lrc 2024-09-19T05:11:21.108 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: RocksDB version: 7.9.2 2024-09-19T05:11:21.108 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Git sha 0 2024-09-19T05:11:21.109 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T05:11:21.109 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: DB SUMMARY 2024-09-19T05:11:21.109 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: DB Session ID: UHW9MBL8UWM32RMC72QV 2024-09-19T05:11:21.109 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: CURRENT file: CURRENT 2024-09-19T05:11:21.109 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T05:11:21.109 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T05:11:21.109 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-19T05:11:21.109 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-19T05:11:21.109 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.error_if_exists: 0 2024-09-19T05:11:21.109 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.create_if_missing: 0 2024-09-19T05:11:21.109 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.paranoid_checks: 1 2024-09-19T05:11:21.110 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T05:11:21.110 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T05:11:21.110 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T05:11:21.110 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.env: 0x55eb2ca75940 2024-09-19T05:11:21.110 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T05:11:21.110 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.info_log: 0x55eb2d9956e0 2024-09-19T05:11:21.110 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T05:11:21.112 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.statistics: (nil) 2024-09-19T05:11:21.112 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.use_fsync: 0 2024-09-19T05:11:21.112 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_log_file_size: 0 2024-09-19T05:11:21.112 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T05:11:21.112 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T05:11:21.112 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T05:11:21.112 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T05:11:21.113 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.allow_fallocate: 1 2024-09-19T05:11:21.113 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T05:11:21.113 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T05:11:21.113 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.use_direct_reads: 0 2024-09-19T05:11:21.113 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T05:11:21.113 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T05:11:21.113 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.db_log_dir: 2024-09-19T05:11:21.113 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.wal_dir: 2024-09-19T05:11:21.113 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T05:11:21.113 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T05:11:21.113 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T05:11:21.113 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T05:11:21.113 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T05:11:21.114 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T05:11:21.114 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T05:11:21.114 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T05:11:21.114 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.write_buffer_manager: 0x55eb2d9a4dc0 2024-09-19T05:11:21.114 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T05:11:21.114 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T05:11:21.114 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T05:11:21.114 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T05:11:21.114 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T05:11:21.114 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T05:11:21.114 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T05:11:21.114 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T05:11:21.114 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.unordered_write: 0 2024-09-19T05:11:21.114 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T05:11:21.115 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T05:11:21.115 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T05:11:21.115 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T05:11:21.115 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.row_cache: None 2024-09-19T05:11:21.115 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.wal_filter: None 2024-09-19T05:11:21.115 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T05:11:21.115 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T05:11:21.115 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.two_write_queues: 0 2024-09-19T05:11:21.115 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T05:11:21.115 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.wal_compression: 0 2024-09-19T05:11:21.115 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.atomic_flush: 0 2024-09-19T05:11:21.115 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T05:11:21.115 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T05:11:21.115 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T05:11:21.116 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.log_readahead_size: 0 2024-09-19T05:11:21.116 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T05:11:21.116 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T05:11:21.116 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T05:11:21.116 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T05:11:21.116 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T05:11:21.116 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T05:11:21.116 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T05:11:21.116 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_background_jobs: 2 2024-09-19T05:11:21.116 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_background_compactions: -1 2024-09-19T05:11:21.116 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_subcompactions: 1 2024-09-19T05:11:21.116 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T05:11:21.116 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T05:11:21.117 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T05:11:21.117 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T05:11:21.117 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T05:11:21.117 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T05:11:21.117 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T05:11:21.117 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T05:11:21.117 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_open_files: -1 2024-09-19T05:11:21.117 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T05:11:21.117 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T05:11:21.117 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T05:11:21.117 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T05:11:21.117 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_background_flushes: -1 2024-09-19T05:11:21.117 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Compression algorithms supported: 2024-09-19T05:11:21.118 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: kZSTD supported: 0 2024-09-19T05:11:21.118 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: kXpressCompression supported: 0 2024-09-19T05:11:21.118 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: kBZip2Compression supported: 0 2024-09-19T05:11:21.118 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T05:11:21.118 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: kLZ4Compression supported: 1 2024-09-19T05:11:21.118 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: kZlibCompression supported: 1 2024-09-19T05:11:21.118 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T05:11:21.118 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: kSnappyCompression supported: 1 2024-09-19T05:11:21.118 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T05:11:21.118 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T05:11:21.118 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-19T05:11:21.119 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T05:11:21.119 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T05:11:21.119 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.merge_operator: 2024-09-19T05:11:21.119 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.compaction_filter: None 2024-09-19T05:11:21.119 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T05:11:21.119 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T05:11:21.119 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T05:11:21.119 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T05:11:21.119 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55eb2d995320) 2024-09-19T05:11:21.119 INFO:journalctl@ceph.mon.c.smithi194.stdout: cache_index_and_filter_blocks: 1 2024-09-19T05:11:21.119 INFO:journalctl@ceph.mon.c.smithi194.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T05:11:21.119 INFO:journalctl@ceph.mon.c.smithi194.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T05:11:21.119 INFO:journalctl@ceph.mon.c.smithi194.stdout: pin_top_level_index_and_filter: 1 2024-09-19T05:11:21.119 INFO:journalctl@ceph.mon.c.smithi194.stdout: index_type: 0 2024-09-19T05:11:21.120 INFO:journalctl@ceph.mon.c.smithi194.stdout: data_block_index_type: 0 2024-09-19T05:11:21.120 INFO:journalctl@ceph.mon.c.smithi194.stdout: index_shortening: 1 2024-09-19T05:11:21.120 INFO:journalctl@ceph.mon.c.smithi194.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T05:11:21.120 INFO:journalctl@ceph.mon.c.smithi194.stdout: checksum: 4 2024-09-19T05:11:21.120 INFO:journalctl@ceph.mon.c.smithi194.stdout: no_block_cache: 0 2024-09-19T05:11:21.120 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_cache: 0x55eb2d9891f0 2024-09-19T05:11:21.120 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_cache_name: BinnedLRUCache 2024-09-19T05:11:21.120 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_cache_options: 2024-09-19T05:11:21.120 INFO:journalctl@ceph.mon.c.smithi194.stdout: capacity : 536870912 2024-09-19T05:11:21.120 INFO:journalctl@ceph.mon.c.smithi194.stdout: num_shard_bits : 4 2024-09-19T05:11:21.120 INFO:journalctl@ceph.mon.c.smithi194.stdout: strict_capacity_limit : 0 2024-09-19T05:11:21.120 INFO:journalctl@ceph.mon.c.smithi194.stdout: high_pri_pool_ratio: 0.000 2024-09-19T05:11:21.120 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_cache_compressed: (nil) 2024-09-19T05:11:21.120 INFO:journalctl@ceph.mon.c.smithi194.stdout: persistent_cache: (nil) 2024-09-19T05:11:21.121 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_size: 4096 2024-09-19T05:11:21.121 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_size_deviation: 10 2024-09-19T05:11:21.121 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_restart_interval: 16 2024-09-19T05:11:21.121 INFO:journalctl@ceph.mon.c.smithi194.stdout: index_block_restart_interval: 1 2024-09-19T05:11:21.121 INFO:journalctl@ceph.mon.c.smithi194.stdout: metadata_block_size: 4096 2024-09-19T05:11:21.121 INFO:journalctl@ceph.mon.c.smithi194.stdout: partition_filters: 0 2024-09-19T05:11:21.121 INFO:journalctl@ceph.mon.c.smithi194.stdout: use_delta_encoding: 1 2024-09-19T05:11:21.121 INFO:journalctl@ceph.mon.c.smithi194.stdout: filter_policy: bloomfilter 2024-09-19T05:11:21.121 INFO:journalctl@ceph.mon.c.smithi194.stdout: whole_key_filtering: 1 2024-09-19T05:11:21.121 INFO:journalctl@ceph.mon.c.smithi194.stdout: verify_compression: 0 2024-09-19T05:11:21.121 INFO:journalctl@ceph.mon.c.smithi194.stdout: read_amp_bytes_per_bit: 0 2024-09-19T05:11:21.121 INFO:journalctl@ceph.mon.c.smithi194.stdout: format_version: 5 2024-09-19T05:11:21.121 INFO:journalctl@ceph.mon.c.smithi194.stdout: enable_index_compression: 1 2024-09-19T05:11:21.122 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_align: 0 2024-09-19T05:11:21.122 INFO:journalctl@ceph.mon.c.smithi194.stdout: max_auto_readahead_size: 262144 2024-09-19T05:11:21.122 INFO:journalctl@ceph.mon.c.smithi194.stdout: prepopulate_block_cache: 0 2024-09-19T05:11:21.122 INFO:journalctl@ceph.mon.c.smithi194.stdout: initial_auto_readahead_size: 8192 2024-09-19T05:11:21.122 INFO:journalctl@ceph.mon.c.smithi194.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T05:11:21.122 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T05:11:21.122 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T05:11:21.122 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.compression: NoCompression 2024-09-19T05:11:21.122 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T05:11:21.122 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T05:11:21.122 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T05:11:21.122 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.num_levels: 7 2024-09-19T05:11:21.122 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T05:11:21.122 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T05:11:21.122 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T05:11:21.123 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T05:11:21.123 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T05:11:21.123 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T05:11:21.123 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T05:11:21.123 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T05:11:21.123 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T05:11:21.123 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T05:11:21.123 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T05:11:21.123 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T05:11:21.123 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T05:11:21.123 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T05:11:21.123 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T05:11:21.123 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T05:11:21.123 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T05:11:21.124 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T05:11:21.124 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T05:11:21.124 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T05:11:21.124 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T05:11:21.124 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T05:11:21.124 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T05:11:21.124 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T05:11:21.124 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T05:11:21.124 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T05:11:21.124 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T05:11:21.124 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T05:11:21.124 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T05:11:21.124 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T05:11:21.125 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T05:11:21.125 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T05:11:21.125 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T05:11:21.125 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T05:11:21.125 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T05:11:21.125 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T05:11:21.125 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T05:11:21.125 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T05:11:21.125 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T05:11:21.125 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T05:11:21.125 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T05:11:21.125 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T05:11:21.125 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T05:11:21.126 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T05:11:21.126 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T05:11:21.126 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T05:11:21.126 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T05:11:21.126 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T05:11:21.126 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T05:11:21.126 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T05:11:21.126 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T05:11:21.126 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T05:11:21.126 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T05:11:21.126 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T05:11:21.126 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.inplace_update_support: 0 2024-09-19T05:11:21.126 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T05:11:21.127 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T05:11:21.127 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T05:11:21.127 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T05:11:21.127 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.bloom_locality: 0 2024-09-19T05:11:21.127 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.max_successive_merges: 0 2024-09-19T05:11:21.127 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T05:11:21.127 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T05:11:21.127 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T05:11:21.127 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T05:11:21.127 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.ttl: 2592000 2024-09-19T05:11:21.127 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T05:11:21.127 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T05:11:21.127 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T05:11:21.127 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.enable_blob_files: false 2024-09-19T05:11:21.128 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.min_blob_size: 0 2024-09-19T05:11:21.128 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T05:11:21.128 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T05:11:21.128 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T05:11:21.128 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T05:11:21.128 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T05:11:21.128 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T05:11:21.128 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T05:11:21.128 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T05:11:21.128 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T05:11:21.128 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T05:11:21.128 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1f2e80f9-7e4f-44c8-9c4c-a49f503863fe 2024-09-19T05:11:21.128 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726722680829859, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T05:11:21.129 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T05:11:21.129 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726722680830268, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726722680, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1f2e80f9-7e4f-44c8-9c4c-a49f503863fe", "db_session_id": "UHW9MBL8UWM32RMC72QV", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T05:11:21.129 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726722680830365, "job": 1, "event": "recovery_finished"} 2024-09-19T05:11:21.129 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T05:11:21.129 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T05:11:21.129 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55eb2d9b6e00 2024-09-19T05:11:21.129 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: DB pointer 0x55eb2dab2000 2024-09-19T05:11:21.129 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T05:11:21.129 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T05:11:21.129 INFO:journalctl@ceph.mon.c.smithi194.stdout: ** DB Stats ** 2024-09-19T05:11:21.129 INFO:journalctl@ceph.mon.c.smithi194.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T05:11:21.129 INFO:journalctl@ceph.mon.c.smithi194.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T05:11:21.130 INFO:journalctl@ceph.mon.c.smithi194.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T05:11:21.130 INFO:journalctl@ceph.mon.c.smithi194.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T05:11:21.130 INFO:journalctl@ceph.mon.c.smithi194.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T05:11:21.130 INFO:journalctl@ceph.mon.c.smithi194.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T05:11:21.130 INFO:journalctl@ceph.mon.c.smithi194.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T05:11:21.130 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2024-09-19T05:11:21.130 INFO:journalctl@ceph.mon.c.smithi194.stdout: ** Compaction Stats [default] ** 2024-09-19T05:11:21.130 INFO:journalctl@ceph.mon.c.smithi194.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T05:11:21.130 INFO:journalctl@ceph.mon.c.smithi194.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T05:11:21.130 INFO:journalctl@ceph.mon.c.smithi194.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T05:11:21.130 INFO:journalctl@ceph.mon.c.smithi194.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T05:11:21.130 INFO:journalctl@ceph.mon.c.smithi194.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T05:11:21.131 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2024-09-19T05:11:21.131 INFO:journalctl@ceph.mon.c.smithi194.stdout: ** Compaction Stats [default] ** 2024-09-19T05:11:21.131 INFO:journalctl@ceph.mon.c.smithi194.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T05:11:21.131 INFO:journalctl@ceph.mon.c.smithi194.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T05:11:21.131 INFO:journalctl@ceph.mon.c.smithi194.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T05:11:21.131 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2024-09-19T05:11:21.131 INFO:journalctl@ceph.mon.c.smithi194.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T05:11:21.131 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2024-09-19T05:11:21.131 INFO:journalctl@ceph.mon.c.smithi194.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T05:11:21.131 INFO:journalctl@ceph.mon.c.smithi194.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T05:11:21.131 INFO:journalctl@ceph.mon.c.smithi194.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T05:11:21.131 INFO:journalctl@ceph.mon.c.smithi194.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T05:11:21.131 INFO:journalctl@ceph.mon.c.smithi194.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T05:11:21.131 INFO:journalctl@ceph.mon.c.smithi194.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T05:11:21.132 INFO:journalctl@ceph.mon.c.smithi194.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T05:11:21.132 INFO:journalctl@ceph.mon.c.smithi194.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T05:11:21.132 INFO:journalctl@ceph.mon.c.smithi194.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T05:11:21.132 INFO:journalctl@ceph.mon.c.smithi194.stdout: Block cache BinnedLRUCache@0x55eb2d9891f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-19T05:11:21.132 INFO:journalctl@ceph.mon.c.smithi194.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T05:11:21.132 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2024-09-19T05:11:21.132 INFO:journalctl@ceph.mon.c.smithi194.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T05:11:21.132 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-19T05:11:21.132 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: using public_addr v2:172.21.15.194:0/0 -> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-19T05:11:21.132 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: starting mon.c rank -1 at public addrs [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] at bind addrs [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:21.132 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: mon.c@-1(???) e0 preinit fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:21.132 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: mon.c@-1(synchronizing).mds e1 new map 2024-09-19T05:11:21.132 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-19T05:11:21.132 INFO:journalctl@ceph.mon.c.smithi194.stdout: e1 2024-09-19T05:11:21.133 INFO:journalctl@ceph.mon.c.smithi194.stdout: btime 2024-09-19T05:09:55:846992+0000 2024-09-19T05:11:21.133 INFO:journalctl@ceph.mon.c.smithi194.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T05:11:21.133 INFO:journalctl@ceph.mon.c.smithi194.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T05:11:21.133 INFO:journalctl@ceph.mon.c.smithi194.stdout: legacy client fscid: -1 2024-09-19T05:11:21.133 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2024-09-19T05:11:21.133 INFO:journalctl@ceph.mon.c.smithi194.stdout: No filesystems configured 2024-09-19T05:11:21.133 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T05:11:21.133 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T05:11:21.133 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T05:11:21.133 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T05:11:21.133 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T05:11:21.133 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T05:11:21.133 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T05:11:21.133 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:11:21.134 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:11:21.134 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:11:21.134 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: Added host smithi194 2024-09-19T05:11:21.134 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:21.134 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:21.134 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:21.134 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:21.134 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:11:21.134 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/2349252284' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T05:11:21.134 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:21.134 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/2349252284' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T05:11:21.134 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:11:21.134 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:21.134 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:21.135 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:21.135 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:21.135 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:11:21.135 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:21.135 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:11:21.135 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: Updating smithi194:/etc/ceph/ceph.conf 2024-09-19T05:11:21.135 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:21.135 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:21.135 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:21.135 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:21.135 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:11:21.135 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:21.135 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: Updating smithi194:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:11:21.136 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:11:21.136 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: Updating smithi194:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:11:21.136 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi120:172.21.15.120=a;smithi178:172.21.15.178=b;smithi194:172.21.15.194=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:11:21.136 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: Saving service mon spec with placement smithi120:172.21.15.120=a;smithi178:172.21.15.178=b;smithi194:172.21.15.194=c;count:3 2024-09-19T05:11:21.136 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: Deploying daemon mon.c on smithi194 2024-09-19T05:11:21.136 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:21.136 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:21.136 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: from='client.? 172.21.15.194:0/749233674' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:11:21.136 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 ceph-mon[35228]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T05:11:21.136 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 bash[35209]: f72c2601b83fa5407126a88e77243e19291e2d1956b1ca2f0e24f37dee2c82fc 2024-09-19T05:11:21.136 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:20 smithi194 systemd[1]: Started Ceph mon.c for 4e6e3df4-7645-11ef-bceb-c7b262605968. 2024-09-19T05:11:21.340 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:11:26.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.154+0000 7f73fd229640 1 -- 172.21.15.194:0/2635771933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73e0003530 msgr2=0x7f73e00059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:26.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.154+0000 7f73fd229640 1 --2- 172.21.15.194:0/2635771933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73e0003530 0x7f73e00059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f73f81016a0 tx=0x7f73e802c490 comp rx=0 tx=0).stop 2024-09-19T05:11:26.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.154+0000 7f73fd229640 1 -- 172.21.15.194:0/2635771933 shutdown_connections 2024-09-19T05:11:26.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.154+0000 7f73fd229640 1 --2- 172.21.15.194:0/2635771933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73e0003530 0x7f73e00059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:26.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.154+0000 7f73fd229640 1 -- 172.21.15.194:0/2635771933 >> 172.21.15.194:0/2635771933 conn(0x7f73f80fc220 msgr2=0x7f73f80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:26.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.154+0000 7f73fd229640 1 -- 172.21.15.194:0/2635771933 shutdown_connections 2024-09-19T05:11:26.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.154+0000 7f73fd229640 1 -- 172.21.15.194:0/2635771933 wait complete. 2024-09-19T05:11:26.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.155+0000 7f73fd229640 1 Processor -- start 2024-09-19T05:11:26.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.155+0000 7f73fd229640 1 -- start start 2024-09-19T05:11:26.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.156+0000 7f73fd229640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73e0003530 0x7f73f81993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:26.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.156+0000 7f73fd229640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73f8199910 0x7f73f819dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:26.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.156+0000 7f73fd229640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f73f8108520 con 0x7f73f8199910 2024-09-19T05:11:26.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.156+0000 7f73fd229640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f73f81083a0 con 0x7f73e0003530 2024-09-19T05:11:26.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.156+0000 7f73f6d9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73e0003530 0x7f73f81993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:26.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.156+0000 7f73f6d9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73e0003530 0x7f73f81993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:46602/0 (socket says 172.21.15.194:46602) 2024-09-19T05:11:26.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.156+0000 7f73f659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73f8199910 0x7f73f819dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:26.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.156+0000 7f73f6d9d640 1 -- 172.21.15.194:0/286600168 learned_addr learned my addr 172.21.15.194:0/286600168 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T05:11:26.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.156+0000 7f73f6d9d640 1 -- 172.21.15.194:0/286600168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73e0003530 msgr2=0x7f73f81993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T05:11:26.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.156+0000 7f73f6d9d640 1 -- 172.21.15.194:0/286600168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73e0003530 msgr2=0x7f73f81993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:11:26.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.156+0000 7f73f6d9d640 1 --2- 172.21.15.194:0/286600168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73e0003530 0x7f73f81993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:11:26.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.156+0000 7f73f6d9d640 1 --2- 172.21.15.194:0/286600168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73e0003530 0x7f73f81993d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:11:26.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.156+0000 7f73f659c640 1 -- 172.21.15.194:0/286600168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73e0003530 msgr2=0x7f73f81993d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:11:26.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.156+0000 7f73f659c640 1 --2- 172.21.15.194:0/286600168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73e0003530 0x7f73f81993d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:26.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.156+0000 7f73f659c640 1 -- 172.21.15.194:0/286600168 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73f8199f30 con 0x7f73f8199910 2024-09-19T05:11:26.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.156+0000 7f73f659c640 1 --2- 172.21.15.194:0/286600168 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73f8199910 0x7f73f819dca0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00b3d0 tx=0x7f73ec00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:26.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.157+0000 7f73dffff640 1 -- 172.21.15.194:0/286600168 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f73ec011630 con 0x7f73f8199910 2024-09-19T05:11:26.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.157+0000 7f73dffff640 1 -- 172.21.15.194:0/286600168 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f73ec011c80 con 0x7f73f8199910 2024-09-19T05:11:26.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.157+0000 7f73dffff640 1 -- 172.21.15.194:0/286600168 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f73ec010d80 con 0x7f73f8199910 2024-09-19T05:11:26.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.157+0000 7f73fd229640 1 -- 172.21.15.194:0/286600168 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73f819e1e0 con 0x7f73f8199910 2024-09-19T05:11:26.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.157+0000 7f73fd229640 1 -- 172.21.15.194:0/286600168 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73f819e7a0 con 0x7f73f8199910 2024-09-19T05:11:26.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.158+0000 7f73dffff640 1 -- 172.21.15.194:0/286600168 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f73ec018020 con 0x7f73f8199910 2024-09-19T05:11:26.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.158+0000 7f73fd229640 1 -- 172.21.15.194:0/286600168 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73f819eab0 con 0x7f73f8199910 2024-09-19T05:11:26.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.158+0000 7f73dffff640 1 --2- 172.21.15.194:0/286600168 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f73e4039090 0x7f73e403b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:26.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.158+0000 7f73dffff640 1 -- 172.21.15.194:0/286600168 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f73ec04bf70 con 0x7f73f8199910 2024-09-19T05:11:26.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.158+0000 7f73f6d9d640 1 --2- 172.21.15.194:0/286600168 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f73e4039090 0x7f73e403b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:26.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.159+0000 7f73f6d9d640 1 --2- 172.21.15.194:0/286600168 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f73e4039090 0x7f73e403b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f73e8012c10 tx=0x7f73e80323a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:26.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.163+0000 7f73dffff640 1 -- 172.21.15.194:0/286600168 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f73ec01f020 con 0x7f73f8199910 2024-09-19T05:11:26.204 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:11:26.204 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: mon.a calling monitor election 2024-09-19T05:11:26.205 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:11:26.205 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:11:26.205 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:26.205 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:11:26.205 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: mon.c calling monitor election 2024-09-19T05:11:26.205 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:11:26.205 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:26.205 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:11:26.205 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:11:26.206 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T05:11:26.206 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: monmap epoch 2 2024-09-19T05:11:26.206 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:26.206 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: last_changed 2024-09-19T05:11:20.855236+0000 2024-09-19T05:11:26.206 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: created 2024-09-19T05:09:53.071491+0000 2024-09-19T05:11:26.206 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: min_mon_release 19 (squid) 2024-09-19T05:11:26.206 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: election_strategy: 1 2024-09-19T05:11:26.206 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: 0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T05:11:26.206 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: 1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.c 2024-09-19T05:11:26.206 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: fsmap 2024-09-19T05:11:26.206 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:11:26.206 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: mgrmap e13: x(active, since 37s) 2024-09-19T05:11:26.207 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: overall HEALTH_OK 2024-09-19T05:11:26.207 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:26.207 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:26.207 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:26.207 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:11:26.207 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:25 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:26.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.398+0000 7f73fd229640 1 -- 172.21.15.194:0/286600168 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f73f819a790 con 0x7f73f8199910 2024-09-19T05:11:26.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.399+0000 7f73dffff640 1 -- 172.21.15.194:0/286600168 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f73ec014170 con 0x7f73f8199910 2024-09-19T05:11:26.401 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:11:26.401 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: mon.a calling monitor election 2024-09-19T05:11:26.401 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:11:26.401 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:11:26.401 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:26.401 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:11:26.402 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: mon.c calling monitor election 2024-09-19T05:11:26.402 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:11:26.402 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:26.402 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:11:26.402 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:11:26.402 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T05:11:26.402 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: monmap epoch 2 2024-09-19T05:11:26.402 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:26.402 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: last_changed 2024-09-19T05:11:20.855236+0000 2024-09-19T05:11:26.402 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: created 2024-09-19T05:09:53.071491+0000 2024-09-19T05:11:26.402 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: min_mon_release 19 (squid) 2024-09-19T05:11:26.402 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: election_strategy: 1 2024-09-19T05:11:26.402 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: 0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T05:11:26.402 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: 1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.c 2024-09-19T05:11:26.403 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: fsmap 2024-09-19T05:11:26.403 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:11:26.403 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: mgrmap e13: x(active, since 37s) 2024-09-19T05:11:26.403 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: overall HEALTH_OK 2024-09-19T05:11:26.403 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:26.403 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:26.403 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:26.403 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:11:26.403 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:25 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:26.403 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:11:26.403 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":2,"fsid":"4e6e3df4-7645-11ef-bceb-c7b262605968","modified":"2024-09-19T05:11:20.855236Z","created":"2024-09-19T05:09:53.071491Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:3300","nonce":0},{"type":"v1","addr":"172.21.15.120:6789","nonce":0}]},"addr":"172.21.15.120:6789/0","public_addr":"172.21.15.120:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T05:11:26.404 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 2 2024-09-19T05:11:26.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.401+0000 7f73fd229640 1 -- 172.21.15.194:0/286600168 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f73e4039090 msgr2=0x7f73e403b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:26.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.401+0000 7f73fd229640 1 --2- 172.21.15.194:0/286600168 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f73e4039090 0x7f73e403b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f73e8012c10 tx=0x7f73e80323a0 comp rx=0 tx=0).stop 2024-09-19T05:11:26.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.401+0000 7f73fd229640 1 -- 172.21.15.194:0/286600168 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73f8199910 msgr2=0x7f73f819dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:26.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.401+0000 7f73fd229640 1 --2- 172.21.15.194:0/286600168 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73f8199910 0x7f73f819dca0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00b3d0 tx=0x7f73ec00b890 comp rx=0 tx=0).stop 2024-09-19T05:11:26.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.401+0000 7f73fd229640 1 -- 172.21.15.194:0/286600168 shutdown_connections 2024-09-19T05:11:26.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.401+0000 7f73fd229640 1 --2- 172.21.15.194:0/286600168 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f73f8199910 0x7f73f819dca0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:26.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.401+0000 7f73fd229640 1 --2- 172.21.15.194:0/286600168 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f73e4039090 0x7f73e403b550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:26.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.401+0000 7f73fd229640 1 --2- 172.21.15.194:0/286600168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73e0003530 0x7f73f81993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:26.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.401+0000 7f73fd229640 1 -- 172.21.15.194:0/286600168 >> 172.21.15.194:0/286600168 conn(0x7f73f80fc220 msgr2=0x7f73f806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:26.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.401+0000 7f73fd229640 1 -- 172.21.15.194:0/286600168 shutdown_connections 2024-09-19T05:11:26.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:26.401+0000 7f73fd229640 1 -- 172.21.15.194:0/286600168 wait complete. 2024-09-19T05:11:26.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:26 smithi194 ceph-mon[35228]: Deploying daemon mon.b on smithi178 2024-09-19T05:11:26.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:26 smithi194 ceph-mon[35228]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:26.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:26 smithi194 ceph-mon[35228]: from='client.? 172.21.15.194:0/286600168' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:11:26.949 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:26 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:11:27.181 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:26 smithi120 ceph-mon[30956]: Deploying daemon mon.b on smithi178 2024-09-19T05:11:27.182 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:26 smithi120 ceph-mon[30956]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:27.182 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:26 smithi120 ceph-mon[30956]: from='client.? 172.21.15.194:0/286600168' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:11:27.182 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:26 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:11:27.977 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T05:11:27.977 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T05:11:28.232 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:11:28.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.662+0000 7f923ac6d640 1 -- 172.21.15.194:0/318614935 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9234106630 msgr2=0x7f9234106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:28.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.662+0000 7f923ac6d640 1 --2- 172.21.15.194:0/318614935 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9234106630 0x7f9234106a10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9228009880 tx=0x7f922802a5d0 comp rx=0 tx=0).stop 2024-09-19T05:11:28.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.662+0000 7f923ac6d640 1 -- 172.21.15.194:0/318614935 shutdown_connections 2024-09-19T05:11:28.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.662+0000 7f923ac6d640 1 --2- 172.21.15.194:0/318614935 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9234106630 0x7f9234106a10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:28.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.662+0000 7f923ac6d640 1 -- 172.21.15.194:0/318614935 >> 172.21.15.194:0/318614935 conn(0x7f92340fc220 msgr2=0x7f92340fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:28.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.662+0000 7f923ac6d640 1 -- 172.21.15.194:0/318614935 shutdown_connections 2024-09-19T05:11:28.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.662+0000 7f923ac6d640 1 -- 172.21.15.194:0/318614935 wait complete. 2024-09-19T05:11:28.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.663+0000 7f923ac6d640 1 Processor -- start 2024-09-19T05:11:28.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.663+0000 7f923ac6d640 1 -- start start 2024-09-19T05:11:28.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.663+0000 7f923ac6d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9234106630 0x7f9234197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:28.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.663+0000 7f923ac6d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9234197740 0x7f923419bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:28.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.663+0000 7f923ac6d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f923410ab10 con 0x7f9234106630 2024-09-19T05:11:28.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.663+0000 7f923ac6d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f923410a990 con 0x7f9234197740 2024-09-19T05:11:28.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.663+0000 7f9233fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9234197740 0x7f923419bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:28.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.663+0000 7f9233fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9234197740 0x7f923419bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58828/0 (socket says 172.21.15.194:58828) 2024-09-19T05:11:28.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.663+0000 7f9233fff640 1 -- 172.21.15.194:0/2374287834 learned_addr learned my addr 172.21.15.194:0/2374287834 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T05:11:28.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.663+0000 7f9238a09640 1 --2- 172.21.15.194:0/2374287834 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9234106630 0x7f9234197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:28.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.663+0000 7f9233fff640 1 -- 172.21.15.194:0/2374287834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9234197740 msgr2=0x7f923419bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T05:11:28.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.664+0000 7f9233fff640 1 -- 172.21.15.194:0/2374287834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9234197740 msgr2=0x7f923419bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:11:28.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.664+0000 7f9233fff640 1 --2- 172.21.15.194:0/2374287834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9234197740 0x7f923419bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:11:28.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.664+0000 7f9233fff640 1 --2- 172.21.15.194:0/2374287834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9234197740 0x7f923419bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:11:28.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.664+0000 7f9238a09640 1 -- 172.21.15.194:0/2374287834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9234197740 msgr2=0x7f923419bad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:11:28.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.664+0000 7f9238a09640 1 --2- 172.21.15.194:0/2374287834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9234197740 0x7f923419bad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:28.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.664+0000 7f9238a09640 1 -- 172.21.15.194:0/2374287834 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9234197d60 con 0x7f9234106630 2024-09-19T05:11:28.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.664+0000 7f9238a09640 1 --2- 172.21.15.194:0/2374287834 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9234106630 0x7f9234197200 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9228000c00 tx=0x7f9228004e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:28.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.664+0000 7f9231ffb640 1 -- 172.21.15.194:0/2374287834 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f9228035030 con 0x7f9234106630 2024-09-19T05:11:28.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.664+0000 7f923ac6d640 1 -- 172.21.15.194:0/2374287834 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f923419c010 con 0x7f9234106630 2024-09-19T05:11:28.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.664+0000 7f9231ffb640 1 -- 172.21.15.194:0/2374287834 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f92280053a0 con 0x7f9234106630 2024-09-19T05:11:28.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.664+0000 7f9231ffb640 1 -- 172.21.15.194:0/2374287834 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f9228031830 con 0x7f9234106630 2024-09-19T05:11:28.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.665+0000 7f923ac6d640 1 -- 172.21.15.194:0/2374287834 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f923419c570 con 0x7f9234106630 2024-09-19T05:11:28.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.665+0000 7f9231ffb640 1 -- 172.21.15.194:0/2374287834 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f9228042070 con 0x7f9234106630 2024-09-19T05:11:28.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.665+0000 7f923ac6d640 1 -- 172.21.15.194:0/2374287834 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9234101ca0 con 0x7f9234106630 2024-09-19T05:11:28.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.666+0000 7f9231ffb640 1 --2- 172.21.15.194:0/2374287834 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f9224039040 0x7f922403b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:28.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.666+0000 7f9231ffb640 1 -- 172.21.15.194:0/2374287834 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f922806cfb0 con 0x7f9234106630 2024-09-19T05:11:28.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.666+0000 7f9233fff640 1 --2- 172.21.15.194:0/2374287834 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f9224039040 0x7f922403b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:28.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.666+0000 7f9233fff640 1 --2- 172.21.15.194:0/2374287834 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f9224039040 0x7f922403b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9220009100 tx=0x7f9220008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:28.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.671+0000 7f9231ffb640 1 -- 172.21.15.194:0/2374287834 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9228005550 con 0x7f9234106630 2024-09-19T05:11:28.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.900+0000 7f923ac6d640 1 -- 172.21.15.194:0/2374287834 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f923419c820 con 0x7f9234106630 2024-09-19T05:11:28.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.901+0000 7f9231ffb640 1 -- 172.21.15.194:0/2374287834 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f92280372d0 con 0x7f9234106630 2024-09-19T05:11:28.903 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:11:28.903 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":2,"fsid":"4e6e3df4-7645-11ef-bceb-c7b262605968","modified":"2024-09-19T05:11:20.855236Z","created":"2024-09-19T05:09:53.071491Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:3300","nonce":0},{"type":"v1","addr":"172.21.15.120:6789","nonce":0}]},"addr":"172.21.15.120:6789/0","public_addr":"172.21.15.120:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T05:11:28.904 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 2 2024-09-19T05:11:28.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.903+0000 7f923ac6d640 1 -- 172.21.15.194:0/2374287834 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f9224039040 msgr2=0x7f922403b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:28.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.903+0000 7f923ac6d640 1 --2- 172.21.15.194:0/2374287834 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f9224039040 0x7f922403b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9220009100 tx=0x7f9220008040 comp rx=0 tx=0).stop 2024-09-19T05:11:28.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.903+0000 7f923ac6d640 1 -- 172.21.15.194:0/2374287834 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9234106630 msgr2=0x7f9234197200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:28.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.903+0000 7f923ac6d640 1 --2- 172.21.15.194:0/2374287834 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9234106630 0x7f9234197200 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9228000c00 tx=0x7f9228004e40 comp rx=0 tx=0).stop 2024-09-19T05:11:28.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.903+0000 7f923ac6d640 1 -- 172.21.15.194:0/2374287834 shutdown_connections 2024-09-19T05:11:28.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.903+0000 7f923ac6d640 1 --2- 172.21.15.194:0/2374287834 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f9224039040 0x7f922403b500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:28.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.903+0000 7f923ac6d640 1 --2- 172.21.15.194:0/2374287834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9234197740 0x7f923419bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:28.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.903+0000 7f923ac6d640 1 --2- 172.21.15.194:0/2374287834 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9234106630 0x7f9234197200 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:28.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.903+0000 7f923ac6d640 1 -- 172.21.15.194:0/2374287834 >> 172.21.15.194:0/2374287834 conn(0x7f92340fc220 msgr2=0x7f9234104130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:28.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.904+0000 7f923ac6d640 1 -- 172.21.15.194:0/2374287834 shutdown_connections 2024-09-19T05:11:28.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:28.904+0000 7f923ac6d640 1 -- 172.21.15.194:0/2374287834 wait complete. 2024-09-19T05:11:29.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:29 smithi194 ceph-mon[35228]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:29.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:29 smithi194 ceph-mon[35228]: from='client.? 172.21.15.194:0/2374287834' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:11:29.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:29 smithi120 ceph-mon[30956]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:29.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:29 smithi120 ceph-mon[30956]: from='client.? 172.21.15.194:0/2374287834' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:11:29.559 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 podman[34329]: 2024-09-19 05:11:29.536417291 +0000 UTC m=+0.342540121 container start 8be05c7017eae581395e604f28da969655ac5a87dedc0245c0fc1d8da3a3e774 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-b, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:11:29.559 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T05:11:29.559 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T05:11:29.559 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: pidfile_write: ignore empty --pid-file 2024-09-19T05:11:29.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: load: jerasure load: lrc 2024-09-19T05:11:29.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: RocksDB version: 7.9.2 2024-09-19T05:11:29.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Git sha 0 2024-09-19T05:11:29.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T05:11:29.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: DB SUMMARY 2024-09-19T05:11:29.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: DB Session ID: VDMSYUCBMNF1FNXVWTS3 2024-09-19T05:11:29.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: CURRENT file: CURRENT 2024-09-19T05:11:29.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T05:11:29.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T05:11:29.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-19T05:11:29.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-19T05:11:29.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.error_if_exists: 0 2024-09-19T05:11:29.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.create_if_missing: 0 2024-09-19T05:11:29.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.paranoid_checks: 1 2024-09-19T05:11:29.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T05:11:29.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T05:11:29.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T05:11:29.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.env: 0x56202af9f940 2024-09-19T05:11:29.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T05:11:29.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.info_log: 0x56202cd596e0 2024-09-19T05:11:29.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T05:11:29.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.statistics: (nil) 2024-09-19T05:11:29.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.use_fsync: 0 2024-09-19T05:11:29.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_log_file_size: 0 2024-09-19T05:11:29.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T05:11:29.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T05:11:29.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T05:11:29.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T05:11:29.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.allow_fallocate: 1 2024-09-19T05:11:29.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T05:11:29.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T05:11:29.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.use_direct_reads: 0 2024-09-19T05:11:29.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T05:11:29.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T05:11:29.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.db_log_dir: 2024-09-19T05:11:29.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.wal_dir: 2024-09-19T05:11:29.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T05:11:29.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T05:11:29.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T05:11:29.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T05:11:29.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T05:11:29.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T05:11:29.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T05:11:29.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T05:11:29.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.write_buffer_manager: 0x56202cd68dc0 2024-09-19T05:11:29.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T05:11:29.948 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T05:11:29.948 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T05:11:29.948 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T05:11:29.948 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T05:11:29.948 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T05:11:29.948 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T05:11:29.948 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T05:11:29.948 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.unordered_write: 0 2024-09-19T05:11:29.948 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T05:11:29.948 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T05:11:29.949 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T05:11:29.949 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T05:11:29.949 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.row_cache: None 2024-09-19T05:11:29.949 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.wal_filter: None 2024-09-19T05:11:29.949 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T05:11:29.949 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T05:11:29.949 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.two_write_queues: 0 2024-09-19T05:11:29.949 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T05:11:29.949 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.wal_compression: 0 2024-09-19T05:11:29.949 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.atomic_flush: 0 2024-09-19T05:11:29.949 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T05:11:29.950 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T05:11:29.950 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T05:11:29.950 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.log_readahead_size: 0 2024-09-19T05:11:29.950 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T05:11:29.950 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T05:11:29.950 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T05:11:29.950 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T05:11:29.950 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T05:11:29.950 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T05:11:29.950 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T05:11:29.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_background_jobs: 2 2024-09-19T05:11:29.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_background_compactions: -1 2024-09-19T05:11:29.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_subcompactions: 1 2024-09-19T05:11:29.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T05:11:29.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T05:11:29.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T05:11:29.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T05:11:29.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T05:11:29.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T05:11:29.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T05:11:29.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T05:11:29.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_open_files: -1 2024-09-19T05:11:29.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T05:11:29.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T05:11:29.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T05:11:29.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T05:11:29.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_background_flushes: -1 2024-09-19T05:11:29.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Compression algorithms supported: 2024-09-19T05:11:29.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: kZSTD supported: 0 2024-09-19T05:11:29.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: kXpressCompression supported: 0 2024-09-19T05:11:29.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: kBZip2Compression supported: 0 2024-09-19T05:11:29.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T05:11:29.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: kLZ4Compression supported: 1 2024-09-19T05:11:29.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: kZlibCompression supported: 1 2024-09-19T05:11:29.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T05:11:29.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: kSnappyCompression supported: 1 2024-09-19T05:11:29.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T05:11:29.953 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T05:11:29.953 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-19T05:11:29.953 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T05:11:29.953 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T05:11:29.953 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.merge_operator: 2024-09-19T05:11:29.953 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.compaction_filter: None 2024-09-19T05:11:29.953 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T05:11:29.953 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T05:11:29.953 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T05:11:29.953 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T05:11:29.953 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56202cd59320) 2024-09-19T05:11:29.953 INFO:journalctl@ceph.mon.b.smithi178.stdout: cache_index_and_filter_blocks: 1 2024-09-19T05:11:29.953 INFO:journalctl@ceph.mon.b.smithi178.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T05:11:29.953 INFO:journalctl@ceph.mon.b.smithi178.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T05:11:29.954 INFO:journalctl@ceph.mon.b.smithi178.stdout: pin_top_level_index_and_filter: 1 2024-09-19T05:11:29.954 INFO:journalctl@ceph.mon.b.smithi178.stdout: index_type: 0 2024-09-19T05:11:29.954 INFO:journalctl@ceph.mon.b.smithi178.stdout: data_block_index_type: 0 2024-09-19T05:11:29.954 INFO:journalctl@ceph.mon.b.smithi178.stdout: index_shortening: 1 2024-09-19T05:11:29.954 INFO:journalctl@ceph.mon.b.smithi178.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T05:11:29.954 INFO:journalctl@ceph.mon.b.smithi178.stdout: checksum: 4 2024-09-19T05:11:29.954 INFO:journalctl@ceph.mon.b.smithi178.stdout: no_block_cache: 0 2024-09-19T05:11:29.954 INFO:journalctl@ceph.mon.b.smithi178.stdout: block_cache: 0x56202cd4d1f0 2024-09-19T05:11:29.954 INFO:journalctl@ceph.mon.b.smithi178.stdout: block_cache_name: BinnedLRUCache 2024-09-19T05:11:29.954 INFO:journalctl@ceph.mon.b.smithi178.stdout: block_cache_options: 2024-09-19T05:11:29.954 INFO:journalctl@ceph.mon.b.smithi178.stdout: capacity : 536870912 2024-09-19T05:11:29.954 INFO:journalctl@ceph.mon.b.smithi178.stdout: num_shard_bits : 4 2024-09-19T05:11:29.954 INFO:journalctl@ceph.mon.b.smithi178.stdout: strict_capacity_limit : 0 2024-09-19T05:11:29.954 INFO:journalctl@ceph.mon.b.smithi178.stdout: high_pri_pool_ratio: 0.000 2024-09-19T05:11:29.955 INFO:journalctl@ceph.mon.b.smithi178.stdout: block_cache_compressed: (nil) 2024-09-19T05:11:29.955 INFO:journalctl@ceph.mon.b.smithi178.stdout: persistent_cache: (nil) 2024-09-19T05:11:29.955 INFO:journalctl@ceph.mon.b.smithi178.stdout: block_size: 4096 2024-09-19T05:11:29.955 INFO:journalctl@ceph.mon.b.smithi178.stdout: block_size_deviation: 10 2024-09-19T05:11:29.955 INFO:journalctl@ceph.mon.b.smithi178.stdout: block_restart_interval: 16 2024-09-19T05:11:29.955 INFO:journalctl@ceph.mon.b.smithi178.stdout: index_block_restart_interval: 1 2024-09-19T05:11:29.955 INFO:journalctl@ceph.mon.b.smithi178.stdout: metadata_block_size: 4096 2024-09-19T05:11:29.955 INFO:journalctl@ceph.mon.b.smithi178.stdout: partition_filters: 0 2024-09-19T05:11:29.955 INFO:journalctl@ceph.mon.b.smithi178.stdout: use_delta_encoding: 1 2024-09-19T05:11:29.955 INFO:journalctl@ceph.mon.b.smithi178.stdout: filter_policy: bloomfilter 2024-09-19T05:11:29.955 INFO:journalctl@ceph.mon.b.smithi178.stdout: whole_key_filtering: 1 2024-09-19T05:11:29.955 INFO:journalctl@ceph.mon.b.smithi178.stdout: verify_compression: 0 2024-09-19T05:11:29.955 INFO:journalctl@ceph.mon.b.smithi178.stdout: read_amp_bytes_per_bit: 0 2024-09-19T05:11:29.955 INFO:journalctl@ceph.mon.b.smithi178.stdout: format_version: 5 2024-09-19T05:11:29.956 INFO:journalctl@ceph.mon.b.smithi178.stdout: enable_index_compression: 1 2024-09-19T05:11:29.956 INFO:journalctl@ceph.mon.b.smithi178.stdout: block_align: 0 2024-09-19T05:11:29.956 INFO:journalctl@ceph.mon.b.smithi178.stdout: max_auto_readahead_size: 262144 2024-09-19T05:11:29.956 INFO:journalctl@ceph.mon.b.smithi178.stdout: prepopulate_block_cache: 0 2024-09-19T05:11:29.956 INFO:journalctl@ceph.mon.b.smithi178.stdout: initial_auto_readahead_size: 8192 2024-09-19T05:11:29.956 INFO:journalctl@ceph.mon.b.smithi178.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T05:11:29.956 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T05:11:29.956 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T05:11:29.956 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.compression: NoCompression 2024-09-19T05:11:29.956 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T05:11:29.957 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T05:11:29.957 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T05:11:29.957 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.num_levels: 7 2024-09-19T05:11:29.957 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T05:11:29.957 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T05:11:29.957 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T05:11:29.957 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T05:11:29.957 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T05:11:29.957 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T05:11:29.957 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T05:11:29.957 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T05:11:29.957 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T05:11:29.957 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T05:11:29.957 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T05:11:29.958 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T05:11:29.958 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T05:11:29.958 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T05:11:29.958 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T05:11:29.958 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T05:11:29.958 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T05:11:29.958 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T05:11:29.958 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T05:11:29.958 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T05:11:29.958 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T05:11:29.958 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T05:11:29.958 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T05:11:29.958 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T05:11:29.959 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T05:11:29.959 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T05:11:29.959 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T05:11:29.959 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T05:11:29.959 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T05:11:29.959 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T05:11:29.959 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T05:11:29.959 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T05:11:29.959 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T05:11:29.959 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T05:11:29.959 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T05:11:29.959 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T05:11:29.959 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T05:11:29.959 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T05:11:29.960 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T05:11:29.960 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T05:11:29.960 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T05:11:29.960 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T05:11:29.960 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T05:11:29.960 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T05:11:29.960 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T05:11:29.960 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T05:11:29.960 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T05:11:29.960 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T05:11:29.960 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T05:11:29.961 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T05:11:29.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T05:11:29.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T05:11:29.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T05:11:29.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T05:11:29.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.inplace_update_support: 0 2024-09-19T05:11:29.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T05:11:29.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T05:11:29.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T05:11:29.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T05:11:29.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.bloom_locality: 0 2024-09-19T05:11:29.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.max_successive_merges: 0 2024-09-19T05:11:29.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T05:11:29.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T05:11:29.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T05:11:29.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T05:11:29.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.ttl: 2592000 2024-09-19T05:11:29.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T05:11:29.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T05:11:29.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T05:11:29.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.enable_blob_files: false 2024-09-19T05:11:29.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.min_blob_size: 0 2024-09-19T05:11:29.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T05:11:29.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T05:11:29.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T05:11:29.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T05:11:29.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T05:11:29.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T05:11:29.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T05:11:29.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T05:11:29.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T05:11:29.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T05:11:29.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d37f6251-eae9-4bfc-8a1a-104485f32ab3 2024-09-19T05:11:29.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726722689563216, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T05:11:29.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T05:11:29.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726722689563608, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726722689, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d37f6251-eae9-4bfc-8a1a-104485f32ab3", "db_session_id": "VDMSYUCBMNF1FNXVWTS3", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T05:11:29.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726722689563700, "job": 1, "event": "recovery_finished"} 2024-09-19T05:11:29.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T05:11:29.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T05:11:29.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56202cd7ae00 2024-09-19T05:11:29.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: DB pointer 0x56202ce76000 2024-09-19T05:11:29.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T05:11:29.965 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T05:11:29.965 INFO:journalctl@ceph.mon.b.smithi178.stdout: ** DB Stats ** 2024-09-19T05:11:29.965 INFO:journalctl@ceph.mon.b.smithi178.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T05:11:29.965 INFO:journalctl@ceph.mon.b.smithi178.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T05:11:29.965 INFO:journalctl@ceph.mon.b.smithi178.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T05:11:29.965 INFO:journalctl@ceph.mon.b.smithi178.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T05:11:29.965 INFO:journalctl@ceph.mon.b.smithi178.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T05:11:29.965 INFO:journalctl@ceph.mon.b.smithi178.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T05:11:29.965 INFO:journalctl@ceph.mon.b.smithi178.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T05:11:29.965 INFO:journalctl@ceph.mon.b.smithi178.stdout: 2024-09-19T05:11:29.965 INFO:journalctl@ceph.mon.b.smithi178.stdout: ** Compaction Stats [default] ** 2024-09-19T05:11:29.965 INFO:journalctl@ceph.mon.b.smithi178.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T05:11:29.965 INFO:journalctl@ceph.mon.b.smithi178.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T05:11:29.965 INFO:journalctl@ceph.mon.b.smithi178.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T05:11:29.966 INFO:journalctl@ceph.mon.b.smithi178.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T05:11:29.966 INFO:journalctl@ceph.mon.b.smithi178.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T05:11:29.966 INFO:journalctl@ceph.mon.b.smithi178.stdout: 2024-09-19T05:11:29.966 INFO:journalctl@ceph.mon.b.smithi178.stdout: ** Compaction Stats [default] ** 2024-09-19T05:11:29.966 INFO:journalctl@ceph.mon.b.smithi178.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T05:11:29.966 INFO:journalctl@ceph.mon.b.smithi178.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T05:11:29.966 INFO:journalctl@ceph.mon.b.smithi178.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T05:11:29.966 INFO:journalctl@ceph.mon.b.smithi178.stdout: 2024-09-19T05:11:29.966 INFO:journalctl@ceph.mon.b.smithi178.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T05:11:29.966 INFO:journalctl@ceph.mon.b.smithi178.stdout: 2024-09-19T05:11:29.966 INFO:journalctl@ceph.mon.b.smithi178.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T05:11:29.966 INFO:journalctl@ceph.mon.b.smithi178.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T05:11:29.966 INFO:journalctl@ceph.mon.b.smithi178.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T05:11:29.966 INFO:journalctl@ceph.mon.b.smithi178.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T05:11:29.966 INFO:journalctl@ceph.mon.b.smithi178.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T05:11:29.967 INFO:journalctl@ceph.mon.b.smithi178.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T05:11:29.967 INFO:journalctl@ceph.mon.b.smithi178.stdout: Cumulative compaction: 0.00 GB write, 0.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T05:11:29.967 INFO:journalctl@ceph.mon.b.smithi178.stdout: Interval compaction: 0.00 GB write, 0.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T05:11:29.967 INFO:journalctl@ceph.mon.b.smithi178.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T05:11:29.967 INFO:journalctl@ceph.mon.b.smithi178.stdout: Block cache BinnedLRUCache@0x56202cd4d1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T05:11:29.967 INFO:journalctl@ceph.mon.b.smithi178.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T05:11:29.967 INFO:journalctl@ceph.mon.b.smithi178.stdout: 2024-09-19T05:11:29.967 INFO:journalctl@ceph.mon.b.smithi178.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T05:11:29.967 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-19T05:11:29.967 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: using public_addr v2:172.21.15.178:0/0 -> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-19T05:11:29.967 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: starting mon.b rank -1 at public addrs [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] at bind addrs [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:29.967 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: mon.b@-1(???) e0 preinit fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:29.967 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: mon.b@-1(synchronizing).mds e1 new map 2024-09-19T05:11:29.967 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-19T05:11:29.968 INFO:journalctl@ceph.mon.b.smithi178.stdout: e1 2024-09-19T05:11:29.968 INFO:journalctl@ceph.mon.b.smithi178.stdout: btime 2024-09-19T05:09:55:846992+0000 2024-09-19T05:11:29.968 INFO:journalctl@ceph.mon.b.smithi178.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T05:11:29.968 INFO:journalctl@ceph.mon.b.smithi178.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T05:11:29.968 INFO:journalctl@ceph.mon.b.smithi178.stdout: legacy client fscid: -1 2024-09-19T05:11:29.968 INFO:journalctl@ceph.mon.b.smithi178.stdout: 2024-09-19T05:11:29.968 INFO:journalctl@ceph.mon.b.smithi178.stdout: No filesystems configured 2024-09-19T05:11:29.968 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T05:11:29.968 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T05:11:29.968 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T05:11:29.968 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T05:11:29.968 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T05:11:29.968 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T05:11:29.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T05:11:29.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:11:29.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:11:29.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T05:11:29.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: Added host smithi194 2024-09-19T05:11:29.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:29.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:29.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:29.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:29.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:11:29.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/2349252284' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T05:11:29.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:29.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/2349252284' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T05:11:29.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:11:29.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:29.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:29.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:29.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:29.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:11:29.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:29.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:11:29.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: Updating smithi194:/etc/ceph/ceph.conf 2024-09-19T05:11:29.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:29.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:29.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:29.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:29.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:11:29.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:29.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: Updating smithi194:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:11:29.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:11:29.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: Updating smithi194:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:11:29.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi120:172.21.15.120=a;smithi178:172.21.15.178=b;smithi194:172.21.15.194=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:11:29.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: Saving service mon spec with placement smithi120:172.21.15.120=a;smithi178:172.21.15.178=b;smithi194:172.21.15.194=c;count:3 2024-09-19T05:11:29.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: Deploying daemon mon.c on smithi194 2024-09-19T05:11:29.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:29.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:29.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='client.? 172.21.15.194:0/749233674' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:11:29.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:11:29.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: mon.a calling monitor election 2024-09-19T05:11:29.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:11:29.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:11:29.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:29.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:11:29.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: mon.c calling monitor election 2024-09-19T05:11:29.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:11:29.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:29.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:11:29.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:11:29.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T05:11:29.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: monmap epoch 2 2024-09-19T05:11:29.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:29.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: last_changed 2024-09-19T05:11:20.855236+0000 2024-09-19T05:11:29.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: created 2024-09-19T05:09:53.071491+0000 2024-09-19T05:11:29.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: min_mon_release 19 (squid) 2024-09-19T05:11:29.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: election_strategy: 1 2024-09-19T05:11:29.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: 0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T05:11:29.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: 1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.c 2024-09-19T05:11:29.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: fsmap 2024-09-19T05:11:29.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:11:29.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: mgrmap e13: x(active, since 37s) 2024-09-19T05:11:29.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: overall HEALTH_OK 2024-09-19T05:11:29.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:29.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:29.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:29.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:11:29.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:29.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: Deploying daemon mon.b on smithi178 2024-09-19T05:11:29.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:29.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='client.? 172.21.15.194:0/286600168' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:11:29.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:11:29.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:29.974 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: from='client.? 172.21.15.194:0/2374287834' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:11:29.974 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 ceph-mon[34347]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T05:11:29.974 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 bash[34329]: 8be05c7017eae581395e604f28da969655ac5a87dedc0245c0fc1d8da3a3e774 2024-09-19T05:11:29.974 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:29 smithi178 systemd[1]: Started Ceph mon.b for 4e6e3df4-7645-11ef-bceb-c7b262605968. 2024-09-19T05:11:30.524 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T05:11:30.524 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T05:11:30.775 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:11:34.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.821+0000 7f33ae615640 1 -- 172.21.15.194:0/1148455347 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3394003530 msgr2=0x7f33940059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:34.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.821+0000 7f33ae615640 1 --2- 172.21.15.194:0/1148455347 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3394003530 0x7f33940059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f33a81016c0 tx=0x7f339802c3f0 comp rx=0 tx=0).stop 2024-09-19T05:11:34.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.821+0000 7f33ae615640 1 -- 172.21.15.194:0/1148455347 shutdown_connections 2024-09-19T05:11:34.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.821+0000 7f33ae615640 1 --2- 172.21.15.194:0/1148455347 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3394003530 0x7f33940059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:34.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.821+0000 7f33ae615640 1 -- 172.21.15.194:0/1148455347 >> 172.21.15.194:0/1148455347 conn(0x7f33a80fc280 msgr2=0x7f33a80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:34.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.821+0000 7f33ae615640 1 -- 172.21.15.194:0/1148455347 shutdown_connections 2024-09-19T05:11:34.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.822+0000 7f33ae615640 1 -- 172.21.15.194:0/1148455347 wait complete. 2024-09-19T05:11:34.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.822+0000 7f33ae615640 1 Processor -- start 2024-09-19T05:11:34.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.822+0000 7f33ae615640 1 -- start start 2024-09-19T05:11:34.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.822+0000 7f33ae615640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3394003530 0x7f33a81972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:34.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.822+0000 7f33ae615640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33a8197830 0x7f33a819bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:34.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.822+0000 7f33ae615640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33a819c100 0x7f33a819c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:34.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.823+0000 7f33ae615640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f33a8108540 con 0x7f33a819c100 2024-09-19T05:11:34.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.823+0000 7f33ae615640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f33a81083c0 con 0x7f3394003530 2024-09-19T05:11:34.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.823+0000 7f33ae615640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f33a81086c0 con 0x7f33a8197830 2024-09-19T05:11:34.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.823+0000 7f339ffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33a8197830 0x7f33a819bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:34.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.823+0000 7f339ffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33a8197830 0x7f33a819bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58844/0 (socket says 172.21.15.194:58844) 2024-09-19T05:11:34.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.823+0000 7f339ffff640 1 -- 172.21.15.194:0/397037825 learned_addr learned my addr 172.21.15.194:0/397037825 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T05:11:34.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.823+0000 7f33a7fff640 1 --2- 172.21.15.194:0/397037825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3394003530 0x7f33a81972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:34.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.823+0000 7f339ffff640 1 -- 172.21.15.194:0/397037825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33a8197830 msgr2=0x7f33a819bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T05:11:34.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.823+0000 7f339ffff640 1 -- 172.21.15.194:0/397037825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33a8197830 msgr2=0x7f33a819bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:11:34.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.823+0000 7f339ffff640 1 --2- 172.21.15.194:0/397037825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33a8197830 0x7f33a819bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:11:34.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.823+0000 7f33acbb2640 1 --2- 172.21.15.194:0/397037825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33a819c100 0x7f33a819c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:34.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.823+0000 7f339ffff640 1 --2- 172.21.15.194:0/397037825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33a8197830 0x7f33a819bbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:11:34.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.823+0000 7f33a7fff640 1 -- 172.21.15.194:0/397037825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3394003530 msgr2=0x7f33a81972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T05:11:34.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.823+0000 7f33a7fff640 1 -- 172.21.15.194:0/397037825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3394003530 msgr2=0x7f33a81972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T05:11:34.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.823+0000 7f33a7fff640 1 --2- 172.21.15.194:0/397037825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3394003530 0x7f33a81972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T05:11:34.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.823+0000 7f33a7fff640 1 --2- 172.21.15.194:0/397037825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3394003530 0x7f33a81972f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:11:34.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.823+0000 7f33acbb2640 1 -- 172.21.15.194:0/397037825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33a8197830 msgr2=0x7f33a819bbc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:11:34.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.823+0000 7f33acbb2640 1 --2- 172.21.15.194:0/397037825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33a8197830 0x7f33a819bbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:34.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.823+0000 7f33acbb2640 1 -- 172.21.15.194:0/397037825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3394003530 msgr2=0x7f33a81972f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:11:34.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.823+0000 7f33acbb2640 1 --2- 172.21.15.194:0/397037825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3394003530 0x7f33a81972f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:34.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.823+0000 7f33acbb2640 1 -- 172.21.15.194:0/397037825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a8102140 con 0x7f33a819c100 2024-09-19T05:11:34.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.823+0000 7f33acbb2640 1 --2- 172.21.15.194:0/397037825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33a819c100 0x7f33a819c5b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f33a000bd50 tx=0x7f33a000be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:34.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.824+0000 7f33a5ffb640 1 -- 172.21.15.194:0/397037825 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a0019070 con 0x7f33a819c100 2024-09-19T05:11:34.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.824+0000 7f33a5ffb640 1 -- 172.21.15.194:0/397037825 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f33a00148f0 con 0x7f33a819c100 2024-09-19T05:11:34.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.824+0000 7f33a5ffb640 1 -- 172.21.15.194:0/397037825 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a0012910 con 0x7f33a819c100 2024-09-19T05:11:34.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.824+0000 7f33ae615640 1 -- 172.21.15.194:0/397037825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a8102430 con 0x7f33a819c100 2024-09-19T05:11:34.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.824+0000 7f33ae615640 1 -- 172.21.15.194:0/397037825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a8102920 con 0x7f33a819c100 2024-09-19T05:11:34.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.824+0000 7f33a5ffb640 1 -- 172.21.15.194:0/397037825 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f33a001c070 con 0x7f33a819c100 2024-09-19T05:11:34.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.825+0000 7f33a5ffb640 1 --2- 172.21.15.194:0/397037825 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3388039730 0x7f338803bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:34.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.825+0000 7f33a5ffb640 1 -- 172.21.15.194:0/397037825 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f33a004c140 con 0x7f33a819c100 2024-09-19T05:11:34.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.825+0000 7f33a7fff640 1 --2- 172.21.15.194:0/397037825 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3388039730 0x7f338803bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:34.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.825+0000 7f33ae615640 1 -- 172.21.15.194:0/397037825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33a81095f0 con 0x7f33a819c100 2024-09-19T05:11:34.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.825+0000 7f33a7fff640 1 --2- 172.21.15.194:0/397037825 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3388039730 0x7f338803bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3398014040 tx=0x7f3398014930 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:34.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:34.830+0000 7f33a5ffb640 1 -- 172.21.15.194:0/397037825 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f33a0013c30 con 0x7f33a819c100 2024-09-19T05:11:34.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:11:34.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: mon.a calling monitor election 2024-09-19T05:11:34.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: mon.c calling monitor election 2024-09-19T05:11:34.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:11:34.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:11:34.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:34.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:11:34.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:11:34.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:34.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:11:34.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:11:34.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:34.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:11:34.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T05:11:34.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: monmap epoch 3 2024-09-19T05:11:34.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:34.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: last_changed 2024-09-19T05:11:29.586812+0000 2024-09-19T05:11:34.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: created 2024-09-19T05:09:53.071491+0000 2024-09-19T05:11:34.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: min_mon_release 19 (squid) 2024-09-19T05:11:34.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: election_strategy: 1 2024-09-19T05:11:34.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: 0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T05:11:34.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: 1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.c 2024-09-19T05:11:34.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: 2: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-19T05:11:34.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: fsmap 2024-09-19T05:11:34.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:11:34.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: mgrmap e13: x(active, since 46s) 2024-09-19T05:11:34.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: overall HEALTH_OK 2024-09-19T05:11:34.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:34.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:34.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:34.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:35.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:35.070+0000 7f33ae615640 1 -- 172.21.15.194:0/397037825 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f33a8062df0 con 0x7f33a819c100 2024-09-19T05:11:35.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:35.071+0000 7f33a5ffb640 1 -- 172.21.15.194:0/397037825 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1287 (secure 0 0 0) 0x7f33a001d730 con 0x7f33a819c100 2024-09-19T05:11:35.073 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:11:35.073 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":3,"fsid":"4e6e3df4-7645-11ef-bceb-c7b262605968","modified":"2024-09-19T05:11:29.586812Z","created":"2024-09-19T05:09:53.071491Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:3300","nonce":0},{"type":"v1","addr":"172.21.15.120:6789","nonce":0}]},"addr":"172.21.15.120:6789/0","public_addr":"172.21.15.120:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:3300","nonce":0},{"type":"v1","addr":"172.21.15.178:6789","nonce":0}]},"addr":"172.21.15.178:6789/0","public_addr":"172.21.15.178:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T05:11:35.074 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 3 2024-09-19T05:11:35.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:35.073+0000 7f33ae615640 1 -- 172.21.15.194:0/397037825 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3388039730 msgr2=0x7f338803bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:35.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:35.073+0000 7f33ae615640 1 --2- 172.21.15.194:0/397037825 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3388039730 0x7f338803bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3398014040 tx=0x7f3398014930 comp rx=0 tx=0).stop 2024-09-19T05:11:35.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:35.073+0000 7f33ae615640 1 -- 172.21.15.194:0/397037825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33a819c100 msgr2=0x7f33a819c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:35.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:35.073+0000 7f33ae615640 1 --2- 172.21.15.194:0/397037825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33a819c100 0x7f33a819c5b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f33a000bd50 tx=0x7f33a000be40 comp rx=0 tx=0).stop 2024-09-19T05:11:35.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:35.073+0000 7f33ae615640 1 -- 172.21.15.194:0/397037825 shutdown_connections 2024-09-19T05:11:35.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:35.073+0000 7f33ae615640 1 --2- 172.21.15.194:0/397037825 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33a819c100 0x7f33a819c5b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:35.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:35.073+0000 7f33ae615640 1 --2- 172.21.15.194:0/397037825 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3388039730 0x7f338803bbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:35.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:35.073+0000 7f33ae615640 1 --2- 172.21.15.194:0/397037825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33a8197830 0x7f33a819bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:35.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:35.073+0000 7f33ae615640 1 --2- 172.21.15.194:0/397037825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3394003530 0x7f33a81972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:35.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:35.073+0000 7f33ae615640 1 -- 172.21.15.194:0/397037825 >> 172.21.15.194:0/397037825 conn(0x7f33a80fc280 msgr2=0x7f33a81059f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:35.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:35.073+0000 7f33ae615640 1 -- 172.21.15.194:0/397037825 shutdown_connections 2024-09-19T05:11:35.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:35.073+0000 7f33ae615640 1 -- 172.21.15.194:0/397037825 wait complete. 2024-09-19T05:11:35.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:11:35.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: mon.a calling monitor election 2024-09-19T05:11:35.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: mon.c calling monitor election 2024-09-19T05:11:35.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:11:35.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:11:35.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:35.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:11:35.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:11:35.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:35.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:11:35.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:11:35.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:35.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:11:35.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T05:11:35.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: monmap epoch 3 2024-09-19T05:11:35.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:35.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: last_changed 2024-09-19T05:11:29.586812+0000 2024-09-19T05:11:35.127 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: created 2024-09-19T05:09:53.071491+0000 2024-09-19T05:11:35.127 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: min_mon_release 19 (squid) 2024-09-19T05:11:35.127 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: election_strategy: 1 2024-09-19T05:11:35.127 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: 0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T05:11:35.127 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: 1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.c 2024-09-19T05:11:35.127 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: 2: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-19T05:11:35.127 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: fsmap 2024-09-19T05:11:35.127 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:11:35.127 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: mgrmap e13: x(active, since 46s) 2024-09-19T05:11:35.127 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: overall HEALTH_OK 2024-09-19T05:11:35.127 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:35.127 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:35.127 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:35.127 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:35.628 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T05:11:35.629 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T05:11:35.854 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:35 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:11:35.854 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:35 smithi194 ceph-mon[35228]: from='client.? 172.21.15.194:0/397037825' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:11:35.854 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:35 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:11:35.885 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:11:36.006 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:35 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:11:36.006 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:35 smithi120 ceph-mon[30956]: from='client.? 172.21.15.194:0/397037825' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:11:36.006 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:35 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:11:36.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.343+0000 7fa87f7c2640 1 -- 172.21.15.120:0/471652289 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa878107690 msgr2=0x7fa878107a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:36.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.343+0000 7fa87f7c2640 1 --2- 172.21.15.120:0/471652289 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa878107690 0x7fa878107a70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa874009880 tx=0x7fa87402a5d0 comp rx=0 tx=0).stop 2024-09-19T05:11:36.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.343+0000 7fa87f7c2640 1 -- 172.21.15.120:0/471652289 shutdown_connections 2024-09-19T05:11:36.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.343+0000 7fa87f7c2640 1 --2- 172.21.15.120:0/471652289 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa878107690 0x7fa878107a70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:36.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.343+0000 7fa87f7c2640 1 -- 172.21.15.120:0/471652289 >> 172.21.15.120:0/471652289 conn(0x7fa878076250 msgr2=0x7fa878076660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:36.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.344+0000 7fa87f7c2640 1 -- 172.21.15.120:0/471652289 shutdown_connections 2024-09-19T05:11:36.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.344+0000 7fa87f7c2640 1 -- 172.21.15.120:0/471652289 wait complete. 2024-09-19T05:11:36.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.344+0000 7fa87f7c2640 1 Processor -- start 2024-09-19T05:11:36.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.344+0000 7fa87f7c2640 1 -- start start 2024-09-19T05:11:36.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.344+0000 7fa87f7c2640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa878107690 0x7fa878100800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:36.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.344+0000 7fa87f7c2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa878100d40 0x7fa8781011a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:36.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.345+0000 7fa87f7c2640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8781a34c0 0x7fa8781a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:36.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.345+0000 7fa87f7c2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa87810bb40 con 0x7fa878100d40 2024-09-19T05:11:36.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.345+0000 7fa87f7c2640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa87810b9c0 con 0x7fa878107690 2024-09-19T05:11:36.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.345+0000 7fa87f7c2640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa87810bcc0 con 0x7fa8781a34c0 2024-09-19T05:11:36.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.345+0000 7fa87cd5d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa878100d40 0x7fa8781011a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:36.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.345+0000 7fa87cd5d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa878100d40 0x7fa8781011a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52602/0 (socket says 172.21.15.120:52602) 2024-09-19T05:11:36.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.345+0000 7fa87cd5d640 1 -- 172.21.15.120:0/2706340495 learned_addr learned my addr 172.21.15.120:0/2706340495 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:11:36.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.345+0000 7fa87dd5f640 1 --2- 172.21.15.120:0/2706340495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8781a34c0 0x7fa8781a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:36.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.345+0000 7fa87d55e640 1 --2- 172.21.15.120:0/2706340495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa878107690 0x7fa878100800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:36.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.345+0000 7fa87cd5d640 1 -- 172.21.15.120:0/2706340495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8781a34c0 msgr2=0x7fa8781a58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:36.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.345+0000 7fa87cd5d640 1 --2- 172.21.15.120:0/2706340495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8781a34c0 0x7fa8781a58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:36.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.345+0000 7fa87cd5d640 1 -- 172.21.15.120:0/2706340495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa878107690 msgr2=0x7fa878100800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:36.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.345+0000 7fa87cd5d640 1 --2- 172.21.15.120:0/2706340495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa878107690 0x7fa878100800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:36.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.345+0000 7fa87cd5d640 1 -- 172.21.15.120:0/2706340495 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8781a5f80 con 0x7fa878100d40 2024-09-19T05:11:36.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.345+0000 7fa87d55e640 1 --2- 172.21.15.120:0/2706340495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa878107690 0x7fa878100800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:11:36.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.345+0000 7fa87cd5d640 1 --2- 172.21.15.120:0/2706340495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa878100d40 0x7fa8781011a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa86800b520 tx=0x7fa86800b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:36.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.345+0000 7fa86e7fc640 1 -- 172.21.15.120:0/2706340495 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa868004230 con 0x7fa878100d40 2024-09-19T05:11:36.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.345+0000 7fa87f7c2640 1 -- 172.21.15.120:0/2706340495 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8781a6270 con 0x7fa878100d40 2024-09-19T05:11:36.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.345+0000 7fa86e7fc640 1 -- 172.21.15.120:0/2706340495 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa8680043d0 con 0x7fa878100d40 2024-09-19T05:11:36.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.345+0000 7fa86e7fc640 1 -- 172.21.15.120:0/2706340495 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa868003cf0 con 0x7fa878100d40 2024-09-19T05:11:36.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.345+0000 7fa87f7c2640 1 -- 172.21.15.120:0/2706340495 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8781a67b0 con 0x7fa878100d40 2024-09-19T05:11:36.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.346+0000 7fa86e7fc640 1 -- 172.21.15.120:0/2706340495 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7fa86800e070 con 0x7fa878100d40 2024-09-19T05:11:36.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.346+0000 7fa86e7fc640 1 --2- 172.21.15.120:0/2706340495 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa864039730 0x7fa86403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:36.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.346+0000 7fa86e7fc640 1 -- 172.21.15.120:0/2706340495 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa86804cda0 con 0x7fa878100d40 2024-09-19T05:11:36.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.347+0000 7fa87d55e640 1 --2- 172.21.15.120:0/2706340495 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa864039730 0x7fa86403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:36.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.347+0000 7fa87f7c2640 1 -- 172.21.15.120:0/2706340495 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa878107af0 con 0x7fa878100d40 2024-09-19T05:11:36.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.347+0000 7fa87d55e640 1 --2- 172.21.15.120:0/2706340495 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa864039730 0x7fa86403bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa874006010 tx=0x7fa874005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:36.366 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.351+0000 7fa86e7fc640 1 -- 172.21.15.120:0/2706340495 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa868014020 con 0x7fa878100d40 2024-09-19T05:11:36.535 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.534+0000 7fa87f7c2640 1 -- 172.21.15.120:0/2706340495 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fa8781a6a70 con 0x7fa878100d40 2024-09-19T05:11:36.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.534+0000 7fa86e7fc640 1 -- 172.21.15.120:0/2706340495 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+277 (secure 0 0 0) 0x7fa868020350 con 0x7fa878100d40 2024-09-19T05:11:36.536 INFO:teuthology.orchestra.run.smithi120.stdout:# minimal ceph.conf for 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:36.537 INFO:teuthology.orchestra.run.smithi120.stdout:[global] 2024-09-19T05:11:36.537 INFO:teuthology.orchestra.run.smithi120.stdout: fsid = 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:36.537 INFO:teuthology.orchestra.run.smithi120.stdout: mon_host = [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-09-19T05:11:36.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.536+0000 7fa87f7c2640 1 -- 172.21.15.120:0/2706340495 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa864039730 msgr2=0x7fa86403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:36.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.536+0000 7fa87f7c2640 1 --2- 172.21.15.120:0/2706340495 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa864039730 0x7fa86403bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa874006010 tx=0x7fa874005a20 comp rx=0 tx=0).stop 2024-09-19T05:11:36.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.536+0000 7fa87f7c2640 1 -- 172.21.15.120:0/2706340495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa878100d40 msgr2=0x7fa8781011a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:36.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.536+0000 7fa87f7c2640 1 --2- 172.21.15.120:0/2706340495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa878100d40 0x7fa8781011a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa86800b520 tx=0x7fa86800b9e0 comp rx=0 tx=0).stop 2024-09-19T05:11:36.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.536+0000 7fa87f7c2640 1 -- 172.21.15.120:0/2706340495 shutdown_connections 2024-09-19T05:11:36.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.536+0000 7fa87f7c2640 1 --2- 172.21.15.120:0/2706340495 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa864039730 0x7fa86403bbf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:36.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.536+0000 7fa87f7c2640 1 --2- 172.21.15.120:0/2706340495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8781a34c0 0x7fa8781a58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:36.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.536+0000 7fa87f7c2640 1 --2- 172.21.15.120:0/2706340495 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa878100d40 0x7fa8781011a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:36.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.536+0000 7fa87f7c2640 1 --2- 172.21.15.120:0/2706340495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa878107690 0x7fa878100800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:36.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.536+0000 7fa87f7c2640 1 -- 172.21.15.120:0/2706340495 >> 172.21.15.120:0/2706340495 conn(0x7fa878076250 msgr2=0x7fa8780fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:36.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.537+0000 7fa87f7c2640 1 -- 172.21.15.120:0/2706340495 shutdown_connections 2024-09-19T05:11:36.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:36.537+0000 7fa87f7c2640 1 -- 172.21.15.120:0/2706340495 wait complete. 2024-09-19T05:11:36.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:11:36.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: mon.a calling monitor election 2024-09-19T05:11:36.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: mon.c calling monitor election 2024-09-19T05:11:36.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:11:36.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:11:36.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:36.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:11:36.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:11:36.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:36.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:11:36.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:11:36.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:36.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:11:36.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T05:11:36.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: monmap epoch 3 2024-09-19T05:11:36.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:36.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: last_changed 2024-09-19T05:11:29.586812+0000 2024-09-19T05:11:36.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: created 2024-09-19T05:09:53.071491+0000 2024-09-19T05:11:36.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: min_mon_release 19 (squid) 2024-09-19T05:11:36.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: election_strategy: 1 2024-09-19T05:11:36.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: 0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T05:11:36.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: 1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.c 2024-09-19T05:11:36.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: 2: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-19T05:11:36.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: fsmap 2024-09-19T05:11:36.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:11:36.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: mgrmap e13: x(active, since 46s) 2024-09-19T05:11:36.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: overall HEALTH_OK 2024-09-19T05:11:36.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:36.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:36.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:36.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:36.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:11:36.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: from='client.? 172.21.15.194:0/397037825' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T05:11:36.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:36 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:11:37.188 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T05:11:37.189 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T05:11:37.189 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T05:11:37.217 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T05:11:37.217 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:11:37.280 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: mon.b calling monitor election 2024-09-19T05:11:37.280 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: Updating smithi120:/etc/ceph/ceph.conf 2024-09-19T05:11:37.280 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: Updating smithi178:/etc/ceph/ceph.conf 2024-09-19T05:11:37.280 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: Updating smithi194:/etc/ceph/ceph.conf 2024-09-19T05:11:37.280 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: Updating smithi194:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:11:37.280 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: Updating smithi178:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:11:37.280 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: Updating smithi120:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:11:37.280 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: mon.b calling monitor election 2024-09-19T05:11:37.281 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: mon.c calling monitor election 2024-09-19T05:11:37.281 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: mon.a calling monitor election 2024-09-19T05:11:37.281 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T05:11:37.281 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: monmap epoch 3 2024-09-19T05:11:37.281 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:37.281 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: last_changed 2024-09-19T05:11:29.586812+0000 2024-09-19T05:11:37.281 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: created 2024-09-19T05:09:53.071491+0000 2024-09-19T05:11:37.281 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: min_mon_release 19 (squid) 2024-09-19T05:11:37.281 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: election_strategy: 1 2024-09-19T05:11:37.281 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: 0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T05:11:37.281 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: 1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.c 2024-09-19T05:11:37.281 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: 2: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-19T05:11:37.281 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: fsmap 2024-09-19T05:11:37.281 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:11:37.282 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: mgrmap e13: x(active, since 48s) 2024-09-19T05:11:37.282 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: overall HEALTH_OK 2024-09-19T05:11:37.282 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.282 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.282 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.282 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.282 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.282 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.282 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.282 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.282 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.282 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.283 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.283 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T05:11:37.283 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:11:37.283 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:11:37.283 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:37.283 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:37 smithi120 ceph-mon[30956]: Reconfiguring daemon mon.a on smithi120 2024-09-19T05:11:37.284 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-19T05:11:37.284 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T05:11:37.312 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-19T05:11:37.312 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:11:37.378 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T05:11:37.378 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T05:11:37.406 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T05:11:37.406 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:11:37.472 INFO:tasks.cephadm:Adding mgr.x on smithi120 2024-09-19T05:11:37.473 INFO:tasks.cephadm:Adding mgr.y on smithi178 2024-09-19T05:11:37.473 INFO:tasks.cephadm:Adding mgr.z on smithi194 2024-09-19T05:11:37.473 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi120=x;smithi178=y;smithi194=z' 2024-09-19T05:11:37.534 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: mon.b calling monitor election 2024-09-19T05:11:37.534 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: Updating smithi120:/etc/ceph/ceph.conf 2024-09-19T05:11:37.535 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: Updating smithi178:/etc/ceph/ceph.conf 2024-09-19T05:11:37.535 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: Updating smithi194:/etc/ceph/ceph.conf 2024-09-19T05:11:37.535 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: Updating smithi194:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:11:37.535 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: Updating smithi178:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:11:37.535 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: Updating smithi120:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:11:37.535 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: mon.b calling monitor election 2024-09-19T05:11:37.535 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: mon.c calling monitor election 2024-09-19T05:11:37.535 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: mon.a calling monitor election 2024-09-19T05:11:37.535 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T05:11:37.535 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: monmap epoch 3 2024-09-19T05:11:37.535 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:37.535 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: last_changed 2024-09-19T05:11:29.586812+0000 2024-09-19T05:11:37.535 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: created 2024-09-19T05:09:53.071491+0000 2024-09-19T05:11:37.536 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: min_mon_release 19 (squid) 2024-09-19T05:11:37.536 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: election_strategy: 1 2024-09-19T05:11:37.536 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: 0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T05:11:37.536 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: 1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.c 2024-09-19T05:11:37.536 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: 2: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-19T05:11:37.536 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: fsmap 2024-09-19T05:11:37.536 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:11:37.536 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: mgrmap e13: x(active, since 48s) 2024-09-19T05:11:37.536 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: overall HEALTH_OK 2024-09-19T05:11:37.536 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.536 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.536 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.536 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.536 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.537 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.537 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.537 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.537 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.537 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.537 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.537 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T05:11:37.537 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:11:37.537 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:11:37.537 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:37.537 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:37 smithi194 ceph-mon[35228]: Reconfiguring daemon mon.a on smithi120 2024-09-19T05:11:37.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: mon.b calling monitor election 2024-09-19T05:11:37.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: Updating smithi120:/etc/ceph/ceph.conf 2024-09-19T05:11:37.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: Updating smithi178:/etc/ceph/ceph.conf 2024-09-19T05:11:37.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: Updating smithi194:/etc/ceph/ceph.conf 2024-09-19T05:11:37.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: Updating smithi194:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:11:37.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: Updating smithi178:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:11:37.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: Updating smithi120:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:11:37.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: mon.b calling monitor election 2024-09-19T05:11:37.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: mon.c calling monitor election 2024-09-19T05:11:37.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: mon.a calling monitor election 2024-09-19T05:11:37.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T05:11:37.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: monmap epoch 3 2024-09-19T05:11:37.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:11:37.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: last_changed 2024-09-19T05:11:29.586812+0000 2024-09-19T05:11:37.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: created 2024-09-19T05:09:53.071491+0000 2024-09-19T05:11:37.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: min_mon_release 19 (squid) 2024-09-19T05:11:37.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: election_strategy: 1 2024-09-19T05:11:37.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: 0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2024-09-19T05:11:37.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: 1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.c 2024-09-19T05:11:37.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: 2: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-19T05:11:37.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: fsmap 2024-09-19T05:11:37.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T05:11:37.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: mgrmap e13: x(active, since 48s) 2024-09-19T05:11:37.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: overall HEALTH_OK 2024-09-19T05:11:37.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:37.695 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T05:11:37.695 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:11:37.695 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:11:37.695 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:37.695 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:37 smithi178 ceph-mon[34347]: Reconfiguring daemon mon.a on smithi120 2024-09-19T05:11:37.747 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:11:38.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.163+0000 7f96a1fd7640 1 -- 172.21.15.194:0/3942168233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f969c1005f0 msgr2=0x7f969c1009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:38.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.163+0000 7f96a1fd7640 1 --2- 172.21.15.194:0/3942168233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f969c1005f0 0x7f969c1009f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f968c009880 tx=0x7f968c02a5d0 comp rx=0 tx=0).stop 2024-09-19T05:11:38.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.163+0000 7f96a1fd7640 1 -- 172.21.15.194:0/3942168233 shutdown_connections 2024-09-19T05:11:38.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.163+0000 7f96a1fd7640 1 --2- 172.21.15.194:0/3942168233 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f969c1005f0 0x7f969c1009f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:38.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.163+0000 7f96a1fd7640 1 -- 172.21.15.194:0/3942168233 >> 172.21.15.194:0/3942168233 conn(0x7f969c0fbda0 msgr2=0x7f969c0fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:38.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.163+0000 7f96a1fd7640 1 -- 172.21.15.194:0/3942168233 shutdown_connections 2024-09-19T05:11:38.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.163+0000 7f96a1fd7640 1 -- 172.21.15.194:0/3942168233 wait complete. 2024-09-19T05:11:38.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.164+0000 7f96a1fd7640 1 Processor -- start 2024-09-19T05:11:38.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.164+0000 7f96a1fd7640 1 -- start start 2024-09-19T05:11:38.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.164+0000 7f96a1fd7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f969c1005f0 0x7f969c0fdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:38.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.164+0000 7f96a1fd7640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f969c0fc340 0x7f969c0fc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:38.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.164+0000 7f96a1fd7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f969c0fcd00 0x7f969c1a0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:38.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.164+0000 7f96a1fd7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f969c1065b0 con 0x7f969c1005f0 2024-09-19T05:11:38.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.164+0000 7f96a1fd7640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f969c106430 con 0x7f969c0fc340 2024-09-19T05:11:38.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.164+0000 7f96a1fd7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f969c106730 con 0x7f969c0fcd00 2024-09-19T05:11:38.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.164+0000 7f969bfff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f969c0fcd00 0x7f969c1a0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:38.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.164+0000 7f969bfff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f969c0fcd00 0x7f969c1a0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:43162/0 (socket says 172.21.15.194:43162) 2024-09-19T05:11:38.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.164+0000 7f969bfff640 1 -- 172.21.15.194:0/1617709457 learned_addr learned my addr 172.21.15.194:0/1617709457 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T05:11:38.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.164+0000 7f969b7fe640 1 --2- 172.21.15.194:0/1617709457 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f969c1005f0 0x7f969c0fdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:38.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.164+0000 7f9693fff640 1 --2- 172.21.15.194:0/1617709457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f969c0fc340 0x7f969c0fc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:38.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.165+0000 7f969bfff640 1 -- 172.21.15.194:0/1617709457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f969c0fc340 msgr2=0x7f969c0fc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:38.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.165+0000 7f969bfff640 1 --2- 172.21.15.194:0/1617709457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f969c0fc340 0x7f969c0fc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:38.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.165+0000 7f969bfff640 1 -- 172.21.15.194:0/1617709457 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f969c1005f0 msgr2=0x7f969c0fdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:38.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.165+0000 7f969bfff640 1 --2- 172.21.15.194:0/1617709457 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f969c1005f0 0x7f969c0fdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:38.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.165+0000 7f969bfff640 1 -- 172.21.15.194:0/1617709457 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f969c1a14f0 con 0x7f969c0fcd00 2024-09-19T05:11:38.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.165+0000 7f969bfff640 1 --2- 172.21.15.194:0/1617709457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f969c0fcd00 0x7f969c1a0f60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f969400ba50 tx=0x7f969400bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:38.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.165+0000 7f96997fa640 1 -- 172.21.15.194:0/1617709457 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9694019070 con 0x7f969c0fcd00 2024-09-19T05:11:38.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.165+0000 7f96997fa640 1 -- 172.21.15.194:0/1617709457 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f969400cbe0 con 0x7f969c0fcd00 2024-09-19T05:11:38.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.165+0000 7f96a1fd7640 1 -- 172.21.15.194:0/1617709457 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f969c1a17e0 con 0x7f969c0fcd00 2024-09-19T05:11:38.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.165+0000 7f96997fa640 1 -- 172.21.15.194:0/1617709457 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96940075d0 con 0x7f969c0fcd00 2024-09-19T05:11:38.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.165+0000 7f96a1fd7640 1 -- 172.21.15.194:0/1617709457 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f969c1a1d50 con 0x7f969c0fcd00 2024-09-19T05:11:38.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.166+0000 7f96997fa640 1 -- 172.21.15.194:0/1617709457 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7f969401c070 con 0x7f969c0fcd00 2024-09-19T05:11:38.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.166+0000 7f96a1fd7640 1 -- 172.21.15.194:0/1617709457 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f969c1a1fb0 con 0x7f969c0fcd00 2024-09-19T05:11:38.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.166+0000 7f96997fa640 1 --2- 172.21.15.194:0/1617709457 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f9688039730 0x7f968803bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:38.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.166+0000 7f96997fa640 1 -- 172.21.15.194:0/1617709457 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f969404bdd0 con 0x7f969c0fcd00 2024-09-19T05:11:38.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.166+0000 7f969b7fe640 1 --2- 172.21.15.194:0/1617709457 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f9688039730 0x7f968803bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:38.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.167+0000 7f969b7fe640 1 --2- 172.21.15.194:0/1617709457 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f9688039730 0x7f968803bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f968c000c00 tx=0x7f968c0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:38.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.171+0000 7f96997fa640 1 -- 172.21.15.194:0/1617709457 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f96940112a0 con 0x7f969c0fcd00 2024-09-19T05:11:38.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.349+0000 7f96a1fd7640 1 -- 172.21.15.194:0/1617709457 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi120=x;smithi178=y;smithi194=z", "target": ["mon-mgr", ""]}) -- 0x7f969c062630 con 0x7f9688039730 2024-09-19T05:11:38.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.354+0000 7f96997fa640 1 -- 172.21.15.194:0/1617709457 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f969c062630 con 0x7f9688039730 2024-09-19T05:11:38.356 INFO:teuthology.orchestra.run.smithi194.stdout:Scheduled mgr update... 2024-09-19T05:11:38.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.356+0000 7f96a1fd7640 1 -- 172.21.15.194:0/1617709457 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f9688039730 msgr2=0x7f968803bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:38.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.356+0000 7f96a1fd7640 1 --2- 172.21.15.194:0/1617709457 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f9688039730 0x7f968803bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f968c000c00 tx=0x7f968c0314a0 comp rx=0 tx=0).stop 2024-09-19T05:11:38.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.356+0000 7f96a1fd7640 1 -- 172.21.15.194:0/1617709457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f969c0fcd00 msgr2=0x7f969c1a0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:38.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.356+0000 7f96a1fd7640 1 --2- 172.21.15.194:0/1617709457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f969c0fcd00 0x7f969c1a0f60 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f969400ba50 tx=0x7f969400bf10 comp rx=0 tx=0).stop 2024-09-19T05:11:38.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.356+0000 7f96a1fd7640 1 -- 172.21.15.194:0/1617709457 shutdown_connections 2024-09-19T05:11:38.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.356+0000 7f96a1fd7640 1 --2- 172.21.15.194:0/1617709457 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f9688039730 0x7f968803bbf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:38.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.356+0000 7f96a1fd7640 1 --2- 172.21.15.194:0/1617709457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f969c0fcd00 0x7f969c1a0f60 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:38.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.356+0000 7f96a1fd7640 1 --2- 172.21.15.194:0/1617709457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f969c0fc340 0x7f969c0fc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:38.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.356+0000 7f96a1fd7640 1 --2- 172.21.15.194:0/1617709457 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f969c1005f0 0x7f969c0fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:38.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.356+0000 7f96a1fd7640 1 -- 172.21.15.194:0/1617709457 >> 172.21.15.194:0/1617709457 conn(0x7f969c0fbda0 msgr2=0x7f969c06acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:38.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.357+0000 7f96a1fd7640 1 -- 172.21.15.194:0/1617709457 shutdown_connections 2024-09-19T05:11:38.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:11:38.357+0000 7f96a1fd7640 1 -- 172.21.15.194:0/1617709457 wait complete. 2024-09-19T05:11:38.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:38 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:11:38.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:38 smithi120 ceph-mon[30956]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:38.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:38 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:38.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:38 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:11:38.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:38 smithi194 ceph-mon[35228]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:38.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:38 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:38.663 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:38 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:11:38.663 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:38 smithi178 ceph-mon[34347]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:38.663 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:38 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:38.914 DEBUG:teuthology.orchestra.run.smithi178:mgr.y> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T05:11:38.916 DEBUG:teuthology.orchestra.run.smithi194:mgr.z> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T05:11:38.956 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T05:11:38.956 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T05:11:38.956 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T05:11:38.973 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T05:11:38.973 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_1 2024-09-19T05:11:39.029 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T05:11:39.030 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:11:39.030 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T05:11:39.030 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:11:39.030 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:11:39.030 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-19 05:10:58.571002466 +0000 2024-09-19T05:11:39.030 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-19 05:07:06.288197885 +0000 2024-09-19T05:11:39.030 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-19 05:07:06.288197885 +0000 2024-09-19T05:11:39.030 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-09-19 05:07:06.288197885 +0000 2024-09-19T05:11:39.030 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T05:11:39.095 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-19T05:11:39.095 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-19T05:11:39.095 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000265652 s, 1.9 MB/s 2024-09-19T05:11:39.096 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T05:11:39.153 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_2 2024-09-19T05:11:39.209 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T05:11:39.209 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:11:39.209 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-19T05:11:39.209 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:11:39.209 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:11:39.209 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-19 05:10:58.597001884 +0000 2024-09-19T05:11:39.209 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-19 05:07:06.618190466 +0000 2024-09-19T05:11:39.210 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-19 05:07:06.618190466 +0000 2024-09-19T05:11:39.210 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-09-19 05:07:06.618190466 +0000 2024-09-19T05:11:39.210 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T05:11:39.273 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-19T05:11:39.273 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-19T05:11:39.273 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000213589 s, 2.4 MB/s 2024-09-19T05:11:39.274 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T05:11:39.331 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_3 2024-09-19T05:11:39.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:39 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:39.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:39 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:39.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:39 smithi120 ceph-mon[30956]: Reconfiguring mon.b (monmap changed)... 2024-09-19T05:11:39.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:39 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:11:39.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:39 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:11:39.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:39 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:39.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:39 smithi120 ceph-mon[30956]: Reconfiguring daemon mon.b on smithi178 2024-09-19T05:11:39.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:39 smithi120 ceph-mon[30956]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi120=x;smithi178=y;smithi194=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:11:39.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:39 smithi120 ceph-mon[30956]: Saving service mgr spec with placement smithi120=x;smithi178=y;smithi194=z;count:3 2024-09-19T05:11:39.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:39 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:39.385 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T05:11:39.385 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:11:39.385 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T05:11:39.385 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:11:39.385 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:11:39.386 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-19 05:10:58.622001324 +0000 2024-09-19T05:11:39.386 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-19 05:07:06.956182868 +0000 2024-09-19T05:11:39.386 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-19 05:07:06.956182868 +0000 2024-09-19T05:11:39.386 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-09-19 05:07:06.956182868 +0000 2024-09-19T05:11:39.386 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T05:11:39.448 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-19T05:11:39.448 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-19T05:11:39.449 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000191491 s, 2.7 MB/s 2024-09-19T05:11:39.450 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T05:11:39.505 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_4 2024-09-19T05:11:39.561 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T05:11:39.561 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:11:39.561 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-19T05:11:39.561 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:11:39.562 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:11:39.562 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-19 05:10:58.647000764 +0000 2024-09-19T05:11:39.562 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-19 05:07:07.275175700 +0000 2024-09-19T05:11:39.562 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-19 05:07:07.275175700 +0000 2024-09-19T05:11:39.562 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2024-09-19 05:07:07.275175700 +0000 2024-09-19T05:11:39.562 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T05:11:39.624 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-19T05:11:39.624 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-19T05:11:39.625 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000236791 s, 2.2 MB/s 2024-09-19T05:11:39.626 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T05:11:39.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:39 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:39.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:39 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:39.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:39 smithi194 ceph-mon[35228]: Reconfiguring mon.b (monmap changed)... 2024-09-19T05:11:39.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:39 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:11:39.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:39 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:11:39.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:39 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:39.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:39 smithi194 ceph-mon[35228]: Reconfiguring daemon mon.b on smithi178 2024-09-19T05:11:39.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:39 smithi194 ceph-mon[35228]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi120=x;smithi178=y;smithi194=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:11:39.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:39 smithi194 ceph-mon[35228]: Saving service mgr spec with placement smithi120=x;smithi178=y;smithi194=z;count:3 2024-09-19T05:11:39.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:39 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:39.681 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-19T05:11:39.681 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T05:11:39.684 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:39 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:39.684 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:39 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:39.684 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:39 smithi178 ceph-mon[34347]: Reconfiguring mon.b (monmap changed)... 2024-09-19T05:11:39.684 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:39 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:11:39.684 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:39 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:11:39.685 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:39 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:39.685 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:39 smithi178 ceph-mon[34347]: Reconfiguring daemon mon.b on smithi178 2024-09-19T05:11:39.685 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:39 smithi178 ceph-mon[34347]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi120=x;smithi178=y;smithi194=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:11:39.685 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:39 smithi178 ceph-mon[34347]: Saving service mgr spec with placement smithi120=x;smithi178=y;smithi194=z;count:3 2024-09-19T05:11:39.685 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:39 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:39.697 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T05:11:39.697 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_1 2024-09-19T05:11:39.753 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T05:11:39.754 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:11:39.754 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-19T05:11:39.754 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:11:39.754 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:11:39.754 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-09-19 05:11:29.016941948 +0000 2024-09-19T05:11:39.754 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-09-19 05:07:05.817924583 +0000 2024-09-19T05:11:39.754 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-09-19 05:07:05.817924583 +0000 2024-09-19T05:11:39.754 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-09-19 05:07:05.817924583 +0000 2024-09-19T05:11:39.754 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T05:11:39.818 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-09-19T05:11:39.818 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-09-19T05:11:39.818 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000131245 s, 3.9 MB/s 2024-09-19T05:11:39.819 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T05:11:39.876 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_2 2024-09-19T05:11:39.931 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T05:11:39.932 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:11:39.932 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-19T05:11:39.932 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:11:39.932 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:11:39.932 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-09-19 05:11:29.016941948 +0000 2024-09-19T05:11:39.932 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-09-19 05:07:06.140918568 +0000 2024-09-19T05:11:39.932 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-09-19 05:07:06.140918568 +0000 2024-09-19T05:11:39.932 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-09-19 05:07:06.140918568 +0000 2024-09-19T05:11:39.932 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T05:11:39.995 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-09-19T05:11:39.995 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-09-19T05:11:39.995 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 9.1422e-05 s, 5.6 MB/s 2024-09-19T05:11:39.996 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T05:11:40.052 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_3 2024-09-19T05:11:40.107 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T05:11:40.107 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:11:40.107 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T05:11:40.107 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:11:40.107 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:11:40.108 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-09-19 05:11:29.017941929 +0000 2024-09-19T05:11:40.108 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-09-19 05:07:06.459912628 +0000 2024-09-19T05:11:40.108 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-09-19 05:07:06.459912628 +0000 2024-09-19T05:11:40.108 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-09-19 05:07:06.459912628 +0000 2024-09-19T05:11:40.108 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T05:11:40.170 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-09-19T05:11:40.170 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-09-19T05:11:40.170 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.00011632 s, 4.4 MB/s 2024-09-19T05:11:40.171 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T05:11:40.227 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_4 2024-09-19T05:11:40.282 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T05:11:40.282 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:11:40.282 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-19T05:11:40.282 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:11:40.282 INFO:teuthology.orchestra.run.smithi178.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:11:40.282 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-09-19 05:11:29.017941929 +0000 2024-09-19T05:11:40.283 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-09-19 05:07:06.771906818 +0000 2024-09-19T05:11:40.283 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-09-19 05:07:06.771906818 +0000 2024-09-19T05:11:40.283 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-09-19 05:07:06.771906818 +0000 2024-09-19T05:11:40.283 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T05:11:40.345 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-09-19T05:11:40.345 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-09-19T05:11:40.345 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000104835 s, 4.9 MB/s 2024-09-19T05:11:40.346 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T05:11:40.403 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-19T05:11:40.403 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T05:11:40.419 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T05:11:40.419 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_1 2024-09-19T05:11:40.474 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T05:11:40.475 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:11:40.475 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T05:11:40.475 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:11:40.475 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:11:40.475 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-19 05:11:20.311089622 +0000 2024-09-19T05:11:40.475 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-19 05:07:10.025003106 +0000 2024-09-19T05:11:40.475 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-19 05:07:10.025003106 +0000 2024-09-19T05:11:40.475 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-19 05:07:10.025003106 +0000 2024-09-19T05:11:40.475 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T05:11:40.540 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-19T05:11:40.540 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-19T05:11:40.540 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.00026944 s, 1.9 MB/s 2024-09-19T05:11:40.541 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T05:11:40.597 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_2 2024-09-19T05:11:40.652 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T05:11:40.652 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:11:40.653 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-19T05:11:40.653 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:11:40.653 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:11:40.653 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-19 05:11:20.311089622 +0000 2024-09-19T05:11:40.653 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-19 05:07:10.347996483 +0000 2024-09-19T05:11:40.653 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-19 05:07:10.347996483 +0000 2024-09-19T05:11:40.653 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-19 05:07:10.347996483 +0000 2024-09-19T05:11:40.653 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T05:11:40.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:40 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:40.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:40 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:40.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:40 smithi178 ceph-mon[34347]: Reconfiguring mon.c (monmap changed)... 2024-09-19T05:11:40.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:40 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:11:40.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:40 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:11:40.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:40 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:40.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:40 smithi178 ceph-mon[34347]: Reconfiguring daemon mon.c on smithi194 2024-09-19T05:11:40.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:40 smithi178 ceph-mon[34347]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:40.715 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-19T05:11:40.715 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-19T05:11:40.715 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000176176 s, 2.9 MB/s 2024-09-19T05:11:40.717 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T05:11:40.770 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:40 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:40.770 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:40 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:40.770 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:40 smithi194 ceph-mon[35228]: Reconfiguring mon.c (monmap changed)... 2024-09-19T05:11:40.771 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:40 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:11:40.771 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:40 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:11:40.771 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:40 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:40.771 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:40 smithi194 ceph-mon[35228]: Reconfiguring daemon mon.c on smithi194 2024-09-19T05:11:40.771 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:40 smithi194 ceph-mon[35228]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:40.773 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_3 2024-09-19T05:11:40.830 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T05:11:40.830 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:11:40.830 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T05:11:40.830 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:11:40.830 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:11:40.830 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-19 05:11:20.311089622 +0000 2024-09-19T05:11:40.831 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-19 05:07:10.678989696 +0000 2024-09-19T05:11:40.831 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-19 05:07:10.678989696 +0000 2024-09-19T05:11:40.831 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-19 05:07:10.678989696 +0000 2024-09-19T05:11:40.831 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T05:11:40.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:40 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:40.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:40 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:40.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:40 smithi120 ceph-mon[30956]: Reconfiguring mon.c (monmap changed)... 2024-09-19T05:11:40.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:40 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T05:11:40.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:40 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T05:11:40.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:40 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:40.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:40 smithi120 ceph-mon[30956]: Reconfiguring daemon mon.c on smithi194 2024-09-19T05:11:40.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:40 smithi120 ceph-mon[30956]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:40.894 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-19T05:11:40.894 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-19T05:11:40.894 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000201696 s, 2.5 MB/s 2024-09-19T05:11:40.895 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T05:11:40.952 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_4 2024-09-19T05:11:41.008 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T05:11:41.008 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T05:11:41.008 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T05:11:41.008 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:11:41.008 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T05:11:41.008 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-19 05:11:20.312089602 +0000 2024-09-19T05:11:41.008 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-19 05:07:11.023982622 +0000 2024-09-19T05:11:41.008 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-19 05:07:11.023982622 +0000 2024-09-19T05:11:41.008 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-19 05:07:11.023982622 +0000 2024-09-19T05:11:41.009 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T05:11:41.073 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-19T05:11:41.073 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-19T05:11:41.073 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000197044 s, 2.6 MB/s 2024-09-19T05:11:41.074 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T05:11:41.130 INFO:tasks.cephadm:Deploying osd.0 on smithi120 with /dev/vg_nvme/lv_4... 2024-09-19T05:11:41.131 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T05:11:41.379 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:11:42.082 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:41 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:42.083 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:41 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:42.083 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:41 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:11:42.083 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:41 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:42.083 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:41 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:11:42.083 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:41 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:42.083 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:41 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:11:42.083 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:41 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T05:11:42.083 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:41 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:11:42.083 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:41 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:42.083 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:41 smithi194 ceph-mon[35228]: Deploying daemon mgr.z on smithi194 2024-09-19T05:11:42.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:41 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:42.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:41 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:42.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:41 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:11:42.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:41 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:42.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:41 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:11:42.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:41 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:42.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:41 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:11:42.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:41 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T05:11:42.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:41 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:11:42.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:41 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:42.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:41 smithi120 ceph-mon[30956]: Deploying daemon mgr.z on smithi194 2024-09-19T05:11:42.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:41 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:42.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:41 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:42.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:41 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:11:42.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:41 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:42.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:41 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:11:42.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:41 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:42.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:41 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:11:42.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:41 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T05:11:42.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:41 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:11:42.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:41 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:42.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:41 smithi178 ceph-mon[34347]: Deploying daemon mgr.z on smithi194 2024-09-19T05:11:42.656 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:42 smithi194 systemd[1]: Starting Ceph mgr.z for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:11:43.051 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:42 smithi120 ceph-mon[30956]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:43.078 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:42 smithi194 ceph-mon[35228]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:43.079 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:42 smithi194 podman[37022]: 2024-09-19 05:11:42.733460134 +0000 UTC m=+0.103322177 container create 8c600a6ee54e77435f468277515926c2fe63b03bc30df090c977c8b1a53fd25b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-19T05:11:43.079 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:42 smithi194 podman[37022]: 2024-09-19 05:11:42.6459248 +0000 UTC m=+0.015786856 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:11:43.079 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:43 smithi194 podman[37022]: 2024-09-19 05:11:43.077662158 +0000 UTC m=+0.447524205 container init 8c600a6ee54e77435f468277515926c2fe63b03bc30df090c977c8b1a53fd25b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T05:11:43.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:42 smithi178 ceph-mon[34347]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:43.412 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:43 smithi194 podman[37022]: 2024-09-19 05:11:43.080630943 +0000 UTC m=+0.450492997 container start 8c600a6ee54e77435f468277515926c2fe63b03bc30df090c977c8b1a53fd25b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T05:11:43.413 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:43 smithi194 ceph-mgr[37041]: -- 172.21.15.194:0/3515873531 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f828d090e0 con 0x55f828ce7400 2024-09-19T05:11:43.413 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:43 smithi194 bash[37022]: 8c600a6ee54e77435f468277515926c2fe63b03bc30df090c977c8b1a53fd25b 2024-09-19T05:11:43.413 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:43 smithi194 systemd[1]: Started Ceph mgr.z for 4e6e3df4-7645-11ef-bceb-c7b262605968. 2024-09-19T05:11:43.413 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:43 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:11:43.202+0000 7fb952926040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T05:11:43.413 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:43 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:11:43.265+0000 7fb952926040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:11:43.725 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:11:43.752 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi120:vg_nvme/lv_4 2024-09-19T05:11:43.794 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:43 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:11:43.419+0000 7fb952926040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:11:43.795 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:43 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:11:43.489+0000 7fb952926040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:11:43.795 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:43 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:11:43.645+0000 7fb952926040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:11:43.795 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:43 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:11:43.792+0000 7fb952926040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:11:43.995 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:11:44.373 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:44 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:11:44.118+0000 7fb952926040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:11:44.374 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:44 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:11:44.181+0000 7fb952926040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:11:44.374 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:44 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:44.374 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:44 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:44.374 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:44 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:44.374 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:44 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:11:44.374 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:44 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T05:11:44.374 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:44 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:11:44.374 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:44 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:44.375 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:44 smithi194 ceph-mon[35228]: Deploying daemon mgr.y on smithi178 2024-09-19T05:11:44.375 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:44 smithi194 ceph-mon[35228]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:44.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:44 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:44.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:44 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:44.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:44 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:44.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:44 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:11:44.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:44 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T05:11:44.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:44 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:11:44.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:44 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:44.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:44 smithi120 ceph-mon[30956]: Deploying daemon mgr.y on smithi178 2024-09-19T05:11:44.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:44 smithi120 ceph-mon[30956]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:44.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.432+0000 7fac924c6640 1 -- 172.21.15.120:0/3756077235 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac8c104f90 msgr2=0x7fac8c107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.432+0000 7fac924c6640 1 --2- 172.21.15.120:0/3756077235 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac8c104f90 0x7fac8c107380 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fac74009900 tx=0x7fac7402a410 comp rx=0 tx=0).stop 2024-09-19T05:11:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.432+0000 7fac924c6640 1 -- 172.21.15.120:0/3756077235 shutdown_connections 2024-09-19T05:11:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.432+0000 7fac924c6640 1 --2- 172.21.15.120:0/3756077235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac8c1078c0 0x7fac8c109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.432+0000 7fac924c6640 1 --2- 172.21.15.120:0/3756077235 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac8c104f90 0x7fac8c107380 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.432+0000 7fac924c6640 1 --2- 172.21.15.120:0/3756077235 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac8c102660 0x7fac8c104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.432+0000 7fac924c6640 1 -- 172.21.15.120:0/3756077235 >> 172.21.15.120:0/3756077235 conn(0x7fac8c0fc280 msgr2=0x7fac8c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:11:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.432+0000 7fac924c6640 1 -- 172.21.15.120:0/3756077235 shutdown_connections 2024-09-19T05:11:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.432+0000 7fac924c6640 1 -- 172.21.15.120:0/3756077235 wait complete. 2024-09-19T05:11:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.432+0000 7fac924c6640 1 Processor -- start 2024-09-19T05:11:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.432+0000 7fac924c6640 1 -- start start 2024-09-19T05:11:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.433+0000 7fac924c6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac8c102660 0x7fac8c197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.433+0000 7fac924c6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac8c104f90 0x7fac8c1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.433+0000 7fac924c6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac8c1078c0 0x7fac8c19f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.433+0000 7fac924c6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c10d710 con 0x7fac8c102660 2024-09-19T05:11:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.433+0000 7fac924c6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c10d590 con 0x7fac8c1078c0 2024-09-19T05:11:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.433+0000 7fac924c6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c10d890 con 0x7fac8c104f90 2024-09-19T05:11:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.433+0000 7fac8bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac8c102660 0x7fac8c197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.433+0000 7fac8bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac8c102660 0x7fac8c197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52610/0 (socket says 172.21.15.120:52610) 2024-09-19T05:11:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.433+0000 7fac8bfff640 1 -- 172.21.15.120:0/64308538 learned_addr learned my addr 172.21.15.120:0/64308538 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:11:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.433+0000 7fac83fff640 1 --2- 172.21.15.120:0/64308538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac8c104f90 0x7fac8c1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.433+0000 7fac90a63640 1 --2- 172.21.15.120:0/64308538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac8c1078c0 0x7fac8c19f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.433+0000 7fac8bfff640 1 -- 172.21.15.120:0/64308538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac8c104f90 msgr2=0x7fac8c1983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.433+0000 7fac8bfff640 1 --2- 172.21.15.120:0/64308538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac8c104f90 0x7fac8c1983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.433+0000 7fac8bfff640 1 -- 172.21.15.120:0/64308538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac8c1078c0 msgr2=0x7fac8c19f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:11:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.433+0000 7fac8bfff640 1 --2- 172.21.15.120:0/64308538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac8c1078c0 0x7fac8c19f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:11:44.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.433+0000 7fac8bfff640 1 -- 172.21.15.120:0/64308538 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac8c19fa90 con 0x7fac8c102660 2024-09-19T05:11:44.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.433+0000 7fac8bfff640 1 --2- 172.21.15.120:0/64308538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac8c102660 0x7fac8c197e60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00c890 tx=0x7fac7c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:44.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.433+0000 7fac89ffb640 1 -- 172.21.15.120:0/64308538 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c004220 con 0x7fac8c102660 2024-09-19T05:11:44.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.433+0000 7fac89ffb640 1 -- 172.21.15.120:0/64308538 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac7c0043c0 con 0x7fac8c102660 2024-09-19T05:11:44.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.433+0000 7fac924c6640 1 -- 172.21.15.120:0/64308538 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac8c19fd80 con 0x7fac8c102660 2024-09-19T05:11:44.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.433+0000 7fac89ffb640 1 -- 172.21.15.120:0/64308538 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c004a00 con 0x7fac8c102660 2024-09-19T05:11:44.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.433+0000 7fac924c6640 1 -- 172.21.15.120:0/64308538 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac8c1a0230 con 0x7fac8c102660 2024-09-19T05:11:44.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.434+0000 7fac89ffb640 1 -- 172.21.15.120:0/64308538 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 13) ==== 46518+0+0 (secure 0 0 0) 0x7fac7c004ba0 con 0x7fac8c102660 2024-09-19T05:11:44.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.434+0000 7fac89ffb640 1 --2- 172.21.15.120:0/64308538 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fac78039500 0x7fac7803b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:11:44.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.434+0000 7fac924c6640 1 -- 172.21.15.120:0/64308538 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac8c0fdd70 con 0x7fac8c102660 2024-09-19T05:11:44.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.435+0000 7fac89ffb640 1 -- 172.21.15.120:0/64308538 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fac7c04c460 con 0x7fac8c102660 2024-09-19T05:11:44.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.435+0000 7fac83fff640 1 --2- 172.21.15.120:0/64308538 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fac78039500 0x7fac7803b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:11:44.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.435+0000 7fac83fff640 1 --2- 172.21.15.120:0/64308538 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fac78039500 0x7fac7803b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fac74004770 tx=0x7fac74000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:11:44.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.439+0000 7fac89ffb640 1 -- 172.21.15.120:0/64308538 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fac7c014030 con 0x7fac8c102660 2024-09-19T05:11:44.527 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:44 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:44.527 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:44 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:44.527 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:44 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:44.527 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:44 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:11:44.527 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:44 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T05:11:44.527 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:44 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:11:44.528 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:44 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:44.528 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:44 smithi178 ceph-mon[34347]: Deploying daemon mgr.y on smithi178 2024-09-19T05:11:44.528 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:44 smithi178 ceph-mon[34347]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:44.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:44.613+0000 7fac924c6640 1 -- 172.21.15.120:0/64308538 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fac8c062630 con 0x7fac78039500 2024-09-19T05:11:44.656 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:44 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:11:44.372+0000 7fb952926040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:11:45.192 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:45 smithi178 podman[35698]: 2024-09-19 05:11:44.9964534 +0000 UTC m=+0.015772571 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:11:45.494 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:45 smithi178 ceph-mon[34347]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:11:45.494 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:45 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:11:45.494 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:45 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:11:45.494 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:45 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:45.494 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:45 smithi178 podman[35698]: 2024-09-19 05:11:45.298696877 +0000 UTC m=+0.318016045 container init 6a555ecaf92ffe39ecddba851e002b6ef71648baa6c8702fb05b2702c79e93e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T05:11:45.494 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:45 smithi178 podman[35698]: 2024-09-19 05:11:45.301549979 +0000 UTC m=+0.320869145 container start 6a555ecaf92ffe39ecddba851e002b6ef71648baa6c8702fb05b2702c79e93e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:11:45.495 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:45 smithi178 ceph-mgr[35718]: -- 172.21.15.178:0/4269157782 <== mon.2 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5596f6aab0e0 con 0x5596f6a89000 2024-09-19T05:11:45.495 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:45 smithi178 bash[35698]: 6a555ecaf92ffe39ecddba851e002b6ef71648baa6c8702fb05b2702c79e93e0 2024-09-19T05:11:45.495 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:45 smithi178 systemd[1]: Started Ceph mgr.y for 4e6e3df4-7645-11ef-bceb-c7b262605968. 2024-09-19T05:11:45.495 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:45 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:11:45.428+0000 7fe6b1e67040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T05:11:45.495 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:45 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:11:45.489+0000 7fe6b1e67040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:11:45.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:45 smithi120 ceph-mon[30956]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:11:45.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:45 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:11:45.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:45 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:11:45.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:45 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:45.655 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:45 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:11:45.248+0000 7fb952926040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:11:45.655 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:45 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:11:45.316+0000 7fb952926040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:11:45.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:45 smithi194 ceph-mon[35228]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:11:45.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:45 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:11:45.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:45 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:11:45.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:45 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:45.877 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:45 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:11:45.645+0000 7fe6b1e67040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:11:45.877 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:45 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:11:45.714+0000 7fe6b1e67040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:11:45.877 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:45 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:11:45.875+0000 7fe6b1e67040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:11:46.146 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:46 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:11:46.025+0000 7fe6b1e67040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:11:46.339 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:46 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:11:46.066+0000 7fb952926040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T05:11:46.339 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:46 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:11:46.190+0000 7fb952926040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:11:46.340 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:46 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:11:46.337+0000 7fb952926040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:11:46.415 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:46 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:11:46.352+0000 7fe6b1e67040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:11:46.415 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:46 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:11:46.414+0000 7fe6b1e67040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:11:46.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:46 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:46.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:46 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:46.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:46 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:46.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:46 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:46.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:46 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:11:46.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:46 smithi120 ceph-mon[30956]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:46.628 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:46 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:11:46.399+0000 7fb952926040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:11:46.628 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:46 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:11:46.557+0000 7fb952926040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T05:11:46.629 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:46 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:11:46.626+0000 7fb952926040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:11:46.629 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:46 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:46.629 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:46 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:46.629 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:46 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:46.629 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:46 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:46.630 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:46 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:11:46.630 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:46 smithi194 ceph-mon[35228]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:46.692 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:46 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:11:46.619+0000 7fe6b1e67040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:11:46.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:46 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:46.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:46 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:46.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:46 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:46.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:46 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:46.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:46 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:11:46.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:46 smithi178 ceph-mon[34347]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:46.905 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:46 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:11:46.686+0000 7fb952926040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:11:46.906 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:46 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:11:46.847+0000 7fb952926040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:11:47.177 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:46 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:11:46.911+0000 7fb952926040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:11:47.177 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:46 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:11:46.976+0000 7fb952926040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:11:47.177 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:47 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:11:47.058+0000 7fb952926040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:11:47.177 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:47 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:11:47.116+0000 7fb952926040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:11:47.178 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:47 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:11:47.175+0000 7fb952926040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:11:47.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:47 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:47.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:47 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:47.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:47 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:47.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:47 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:47.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:47 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:47.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:47 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:11:47.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:47 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:47.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:47 smithi120 ceph-mon[30956]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T05:11:47.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:47 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:11:47.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:47 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:11:47.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:47 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:47.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:47 smithi120 ceph-mon[30956]: Reconfiguring daemon mgr.x on smithi120 2024-09-19T05:11:47.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:47 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1784933557' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "18907a03-1f43-419a-acb6-9fa4cf5020d5"}]: dispatch 2024-09-19T05:11:47.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:47 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1784933557' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "18907a03-1f43-419a-acb6-9fa4cf5020d5"}]': finished 2024-09-19T05:11:47.627 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:47 smithi120 ceph-mon[30956]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T05:11:47.627 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:47 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:11:47.627 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:47 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1896663302' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:11:47.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:47 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:47.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:47 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:47.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:47 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:47.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:47 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:47.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:47 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:47.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:47 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:11:47.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:47 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:47.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:47 smithi194 ceph-mon[35228]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T05:11:47.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:47 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:11:47.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:47 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:11:47.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:47 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:47.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:47 smithi194 ceph-mon[35228]: Reconfiguring daemon mgr.x on smithi120 2024-09-19T05:11:47.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:47 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1784933557' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "18907a03-1f43-419a-acb6-9fa4cf5020d5"}]: dispatch 2024-09-19T05:11:47.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:47 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1784933557' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "18907a03-1f43-419a-acb6-9fa4cf5020d5"}]': finished 2024-09-19T05:11:47.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:47 smithi194 ceph-mon[35228]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T05:11:47.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:47 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:11:47.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:47 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1896663302' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:11:47.942 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:47 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:11:47.503+0000 7fe6b1e67040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:11:47.942 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:47 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:11:47.572+0000 7fe6b1e67040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:11:47.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:47 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:47.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:47 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:47.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:47 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:47.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:47 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:47.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:47 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:47.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:47 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:11:47.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:47 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:47.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:47 smithi178 ceph-mon[34347]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T05:11:47.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:47 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T05:11:47.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:47 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T05:11:47.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:47 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:47.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:47 smithi178 ceph-mon[34347]: Reconfiguring daemon mgr.x on smithi120 2024-09-19T05:11:47.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:47 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1784933557' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "18907a03-1f43-419a-acb6-9fa4cf5020d5"}]: dispatch 2024-09-19T05:11:47.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:47 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1784933557' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "18907a03-1f43-419a-acb6-9fa4cf5020d5"}]': finished 2024-09-19T05:11:47.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:47 smithi178 ceph-mon[34347]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T05:11:47.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:47 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:11:47.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:47 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1896663302' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:11:48.405 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:11:47 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:11:47.959+0000 7fb952926040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:11:48.543 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:48 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:11:48.287+0000 7fe6b1e67040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T05:11:48.543 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:48 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:11:48.402+0000 7fe6b1e67040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:11:48.543 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:48 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:11:48.542+0000 7fe6b1e67040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:11:48.561 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:48.558+0000 7fac89ffb640 1 -- 172.21.15.120:0/64308538 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mgrmap(e 14) ==== 92409+0+0 (secure 0 0 0) 0x7fac7c00f450 con 0x7fac8c102660 2024-09-19T05:11:48.823 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:48 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:11:48.606+0000 7fe6b1e67040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:11:48.823 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:48 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:11:48.753+0000 7fe6b1e67040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T05:11:48.823 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:48 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:11:48.821+0000 7fe6b1e67040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:11:48.823 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:48 smithi178 ceph-mon[34347]: Standby manager daemon z started 2024-09-19T05:11:48.824 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:48 smithi178 ceph-mon[34347]: from='mgr.? 172.21.15.194:0/4078086241' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T05:11:48.824 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:48 smithi178 ceph-mon[34347]: from='mgr.? 172.21.15.194:0/4078086241' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:11:48.824 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:48 smithi178 ceph-mon[34347]: from='mgr.? 172.21.15.194:0/4078086241' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T05:11:48.824 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:48 smithi178 ceph-mon[34347]: from='mgr.? 172.21.15.194:0/4078086241' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:11:48.824 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:48 smithi178 ceph-mon[34347]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:48.824 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:48 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:48.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:48 smithi120 ceph-mon[30956]: Standby manager daemon z started 2024-09-19T05:11:48.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:48 smithi120 ceph-mon[30956]: from='mgr.? 172.21.15.194:0/4078086241' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T05:11:48.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:48 smithi120 ceph-mon[30956]: from='mgr.? 172.21.15.194:0/4078086241' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:11:48.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:48 smithi120 ceph-mon[30956]: from='mgr.? 172.21.15.194:0/4078086241' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T05:11:48.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:48 smithi120 ceph-mon[30956]: from='mgr.? 172.21.15.194:0/4078086241' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:11:48.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:48 smithi120 ceph-mon[30956]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:48.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:48.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:48 smithi194 ceph-mon[35228]: Standby manager daemon z started 2024-09-19T05:11:48.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:48 smithi194 ceph-mon[35228]: from='mgr.? 172.21.15.194:0/4078086241' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T05:11:48.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:48 smithi194 ceph-mon[35228]: from='mgr.? 172.21.15.194:0/4078086241' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:11:48.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:48 smithi194 ceph-mon[35228]: from='mgr.? 172.21.15.194:0/4078086241' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T05:11:48.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:48 smithi194 ceph-mon[35228]: from='mgr.? 172.21.15.194:0/4078086241' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:11:48.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:48 smithi194 ceph-mon[35228]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:48.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:48 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:49.105 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:48 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:11:48.881+0000 7fe6b1e67040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:11:49.106 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:49 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:11:49.038+0000 7fe6b1e67040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:11:49.106 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:49 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:11:49.103+0000 7fe6b1e67040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:11:49.369 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:49 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:11:49.169+0000 7fe6b1e67040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:11:49.369 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:49 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:11:49.251+0000 7fe6b1e67040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:11:49.369 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:49 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:11:49.309+0000 7fe6b1e67040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:11:49.369 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:49 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:11:49.367+0000 7fe6b1e67040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:11:49.691 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:49 smithi178 ceph-mon[34347]: mgrmap e14: x(active, since 60s), standbys: z 2024-09-19T05:11:49.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:49 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T05:11:49.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:49 smithi120 ceph-mon[30956]: mgrmap e14: x(active, since 60s), standbys: z 2024-09-19T05:11:49.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:49 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T05:11:49.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:49 smithi194 ceph-mon[35228]: mgrmap e14: x(active, since 60s), standbys: z 2024-09-19T05:11:49.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:49 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T05:11:50.442 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:11:50 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:11:50.151+0000 7fe6b1e67040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:11:50.569 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:11:50.567+0000 7fac89ffb640 1 -- 172.21.15.120:0/64308538 <== mon.0 v2:172.21.15.120:3300/0 8 ==== mgrmap(e 15) ==== 138300+0+0 (secure 0 0 0) 0x7fac7c05e2c0 con 0x7fac8c102660 2024-09-19T05:11:50.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:50 smithi120 ceph-mon[30956]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:50.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:50 smithi120 ceph-mon[30956]: Standby manager daemon y started 2024-09-19T05:11:50.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:50 smithi120 ceph-mon[30956]: from='mgr.? 172.21.15.178:0/220605536' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T05:11:50.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:50 smithi120 ceph-mon[30956]: from='mgr.? 172.21.15.178:0/220605536' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:11:50.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:50 smithi120 ceph-mon[30956]: from='mgr.? 172.21.15.178:0/220605536' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T05:11:50.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:50 smithi120 ceph-mon[30956]: from='mgr.? 172.21.15.178:0/220605536' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:11:50.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:50 smithi194 ceph-mon[35228]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:50.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:50 smithi194 ceph-mon[35228]: Standby manager daemon y started 2024-09-19T05:11:50.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:50 smithi194 ceph-mon[35228]: from='mgr.? 172.21.15.178:0/220605536' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T05:11:50.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:50 smithi194 ceph-mon[35228]: from='mgr.? 172.21.15.178:0/220605536' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:11:50.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:50 smithi194 ceph-mon[35228]: from='mgr.? 172.21.15.178:0/220605536' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T05:11:50.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:50 smithi194 ceph-mon[35228]: from='mgr.? 172.21.15.178:0/220605536' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:11:50.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:50 smithi178 ceph-mon[34347]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:50.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:50 smithi178 ceph-mon[34347]: Standby manager daemon y started 2024-09-19T05:11:50.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:50 smithi178 ceph-mon[34347]: from='mgr.? 172.21.15.178:0/220605536' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T05:11:50.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:50 smithi178 ceph-mon[34347]: from='mgr.? 172.21.15.178:0/220605536' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:11:50.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:50 smithi178 ceph-mon[34347]: from='mgr.? 172.21.15.178:0/220605536' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T05:11:50.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:50 smithi178 ceph-mon[34347]: from='mgr.? 172.21.15.178:0/220605536' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:11:51.857 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:51 smithi120 ceph-mon[30956]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-09-19T05:11:51.857 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:51 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T05:11:51.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:51 smithi194 ceph-mon[35228]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-09-19T05:11:51.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:51 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T05:11:51.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:51 smithi178 ceph-mon[34347]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-09-19T05:11:51.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:51 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T05:11:52.760 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:52 smithi120 ceph-mon[30956]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:52.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:52 smithi194 ceph-mon[35228]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:52.941 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:52 smithi178 ceph-mon[34347]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:55.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:54 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:55.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:54 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:55.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:54 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:11:55.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:54 smithi120 ceph-mon[30956]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:55.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:54 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:55.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:54 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:11:55.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:54 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:55.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:54 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:55.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:54 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:55.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:54 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:11:55.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:54 smithi194 ceph-mon[35228]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:55.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:54 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:55.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:54 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:11:55.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:54 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:55.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:54 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:55.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:54 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:55.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:54 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:11:55.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:54 smithi178 ceph-mon[34347]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:55.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:54 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:55.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:54 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:11:55.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:54 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:11:56.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:55 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T05:11:56.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:55 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:56.363 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:55 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T05:11:56.363 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:55 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:56.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:55 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T05:11:56.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:55 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:11:57.319 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:56 smithi178 ceph-mon[34347]: Deploying daemon osd.0 on smithi120 2024-09-19T05:11:57.319 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:56 smithi178 ceph-mon[34347]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:57.351 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:56 smithi120 ceph-mon[30956]: Deploying daemon osd.0 on smithi120 2024-09-19T05:11:57.351 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:56 smithi120 ceph-mon[30956]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:57.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:56 smithi194 ceph-mon[35228]: Deploying daemon osd.0 on smithi120 2024-09-19T05:11:57.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:56 smithi194 ceph-mon[35228]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:59.224 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:11:59 smithi120 ceph-mon[30956]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:59.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:11:59 smithi194 ceph-mon[35228]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:11:59.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:11:59 smithi178 ceph-mon[34347]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:01.255 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:01 smithi120 ceph-mon[30956]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:01.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:01 smithi194 ceph-mon[35228]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:01.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:01 smithi178 ceph-mon[34347]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:02.395 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:02 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:12:02.395 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:02 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:02.395 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:02 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:02.415 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:02 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:12:02.415 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:02 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:02.415 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:02 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:02.644 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:02 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:12:02.645 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:02 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:02.645 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:02 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:03.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:03 smithi120 ceph-mon[30956]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:03.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:03 smithi194 ceph-mon[35228]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:03.446 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:03 smithi178 ceph-mon[34347]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:05.620 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:05 smithi120 ceph-mon[30956]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:05.620 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:05 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:05.620 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:05 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:05.620 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:05 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:05.620 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:05 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:12:05.620 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:05 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:05.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:05 smithi194 ceph-mon[35228]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:05.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:05 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:05.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:05 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:05.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:05 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:05.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:05 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:12:05.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:05 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:05.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:05 smithi178 ceph-mon[34347]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:05.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:05 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:05.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:05 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:05.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:05 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:05.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:05 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:12:05.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:05 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:06.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:06.197+0000 7fac89ffb640 1 -- 172.21.15.120:0/64308538 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fac8c062630 con 0x7fac78039500 2024-09-19T05:12:06.199 INFO:teuthology.orchestra.run.smithi120.stdout:Created osd(s) 0 on host 'smithi120' 2024-09-19T05:12:06.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:06.199+0000 7fac924c6640 1 -- 172.21.15.120:0/64308538 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fac78039500 msgr2=0x7fac7803b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:06.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:06.199+0000 7fac924c6640 1 --2- 172.21.15.120:0/64308538 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fac78039500 0x7fac7803b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fac74004770 tx=0x7fac74000bc0 comp rx=0 tx=0).stop 2024-09-19T05:12:06.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:06.199+0000 7fac924c6640 1 -- 172.21.15.120:0/64308538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac8c102660 msgr2=0x7fac8c197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:06.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:06.199+0000 7fac924c6640 1 --2- 172.21.15.120:0/64308538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac8c102660 0x7fac8c197e60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00c890 tx=0x7fac7c00cd50 comp rx=0 tx=0).stop 2024-09-19T05:12:06.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:06.199+0000 7fac924c6640 1 -- 172.21.15.120:0/64308538 shutdown_connections 2024-09-19T05:12:06.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:06.199+0000 7fac924c6640 1 --2- 172.21.15.120:0/64308538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac8c1078c0 0x7fac8c19f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:06.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:06.199+0000 7fac924c6640 1 --2- 172.21.15.120:0/64308538 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fac78039500 0x7fac7803b9c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:06.201 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:06.199+0000 7fac924c6640 1 --2- 172.21.15.120:0/64308538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac8c104f90 0x7fac8c1983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:06.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:06.199+0000 7fac924c6640 1 --2- 172.21.15.120:0/64308538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac8c102660 0x7fac8c197e60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:06.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:06.199+0000 7fac924c6640 1 -- 172.21.15.120:0/64308538 >> 172.21.15.120:0/64308538 conn(0x7fac8c0fc280 msgr2=0x7fac8c1030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:06.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:06.199+0000 7fac924c6640 1 -- 172.21.15.120:0/64308538 shutdown_connections 2024-09-19T05:12:06.202 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:06.199+0000 7fac924c6640 1 -- 172.21.15.120:0/64308538 wait complete. 2024-09-19T05:12:06.557 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:06 smithi120 ceph-mon[30956]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:06.557 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:06 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:12:06.557 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:06 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:06.557 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:06 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:06.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:06 smithi194 ceph-mon[35228]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:06.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:06 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:12:06.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:06 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:06.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:06 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:06.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:06 smithi178 ceph-mon[34347]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:06.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:06 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:12:06.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:06 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:06.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:06 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:06.859 DEBUG:teuthology.orchestra.run.smithi120:osd.0> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T05:12:06.861 INFO:tasks.cephadm:Deploying osd.1 on smithi178 with /dev/vg_nvme/lv_4... 2024-09-19T05:12:06.861 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T05:12:07.111 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:12:08.625 INFO:journalctl@ceph.osd.0.smithi120.stdout:Sep 19 05:12:08 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-0[44696]: 2024-09-19T05:12:08.396+0000 7fcb438d1640 -1 osd.0 0 log_to_monitors true 2024-09-19T05:12:09.347 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:09 smithi120 ceph-mon[30956]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:09.347 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:09 smithi120 ceph-mon[30956]: from='osd.0 [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T05:12:09.369 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:09 smithi178 ceph-mon[34347]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:09.369 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:09 smithi178 ceph-mon[34347]: from='osd.0 [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T05:12:09.369 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-19T05:12:09.394 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi178:vg_nvme/lv_4 2024-09-19T05:12:09.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:09 smithi194 ceph-mon[35228]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:09.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:09 smithi194 ceph-mon[35228]: from='osd.0 [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T05:12:09.642 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:12:10.105 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.103+0000 7f0f8b8e2640 1 -- 172.21.15.178:0/1558576033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f84102660 msgr2=0x7f0f84104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:10.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.103+0000 7f0f8b8e2640 1 --2- 172.21.15.178:0/1558576033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f84102660 0x7f0f84104a50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0f80009900 tx=0x7f0f8002a410 comp rx=0 tx=0).stop 2024-09-19T05:12:10.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.104+0000 7f0f8b8e2640 1 -- 172.21.15.178:0/1558576033 shutdown_connections 2024-09-19T05:12:10.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.104+0000 7f0f8b8e2640 1 --2- 172.21.15.178:0/1558576033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f841078c0 0x7f0f84109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:10.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.104+0000 7f0f8b8e2640 1 --2- 172.21.15.178:0/1558576033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f84104f90 0x7f0f84107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:10.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.104+0000 7f0f8b8e2640 1 --2- 172.21.15.178:0/1558576033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f84102660 0x7f0f84104a50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:10.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.104+0000 7f0f8b8e2640 1 -- 172.21.15.178:0/1558576033 >> 172.21.15.178:0/1558576033 conn(0x7f0f840fc280 msgr2=0x7f0f840fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:10.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.104+0000 7f0f8b8e2640 1 -- 172.21.15.178:0/1558576033 shutdown_connections 2024-09-19T05:12:10.106 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.104+0000 7f0f8b8e2640 1 -- 172.21.15.178:0/1558576033 wait complete. 2024-09-19T05:12:10.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.104+0000 7f0f8b8e2640 1 Processor -- start 2024-09-19T05:12:10.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.104+0000 7f0f8b8e2640 1 -- start start 2024-09-19T05:12:10.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.105+0000 7f0f8b8e2640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f84102660 0x7f0f84197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:10.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.105+0000 7f0f8b8e2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f84104f90 0x7f0f84198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:10.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.105+0000 7f0f8b8e2640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f841078c0 0x7f0f8419f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:10.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.105+0000 7f0f8b8e2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8410d720 con 0x7f0f84104f90 2024-09-19T05:12:10.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.105+0000 7f0f8b8e2640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8410d5a0 con 0x7f0f841078c0 2024-09-19T05:12:10.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.105+0000 7f0f8b8e2640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0f8410d8a0 con 0x7f0f84102660 2024-09-19T05:12:10.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.105+0000 7f0f88e7d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f84104f90 0x7f0f84198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:10.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.105+0000 7f0f8967e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f84102660 0x7f0f84197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:10.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.105+0000 7f0f88e7d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f84104f90 0x7f0f84198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.178:46026/0 (socket says 172.21.15.178:46026) 2024-09-19T05:12:10.108 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.105+0000 7f0f8967e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f84102660 0x7f0f84197e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.178:33416/0 (socket says 172.21.15.178:33416) 2024-09-19T05:12:10.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.105+0000 7f0f89e7f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f841078c0 0x7f0f8419f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:10.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.105+0000 7f0f88e7d640 1 -- 172.21.15.178:0/2724648225 learned_addr learned my addr 172.21.15.178:0/2724648225 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-19T05:12:10.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.105+0000 7f0f88e7d640 1 -- 172.21.15.178:0/2724648225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f84102660 msgr2=0x7f0f84197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:10.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.105+0000 7f0f88e7d640 1 --2- 172.21.15.178:0/2724648225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f84102660 0x7f0f84197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:10.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.105+0000 7f0f88e7d640 1 -- 172.21.15.178:0/2724648225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f841078c0 msgr2=0x7f0f8419f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:10.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.105+0000 7f0f88e7d640 1 --2- 172.21.15.178:0/2724648225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f841078c0 0x7f0f8419f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:10.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.105+0000 7f0f88e7d640 1 -- 172.21.15.178:0/2724648225 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f8419fa70 con 0x7f0f84104f90 2024-09-19T05:12:10.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.105+0000 7f0f8967e640 1 --2- 172.21.15.178:0/2724648225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f84102660 0x7f0f84197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:12:10.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.105+0000 7f0f89e7f640 1 --2- 172.21.15.178:0/2724648225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f841078c0 0x7f0f8419f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:12:10.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.106+0000 7f0f88e7d640 1 --2- 172.21.15.178:0/2724648225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f84104f90 0x7f0f84198380 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0f7400d770 tx=0x7f0f7400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:10.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.130+0000 7f0f7a7fc640 1 -- 172.21.15.178:0/2724648225 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f74017070 con 0x7f0f84104f90 2024-09-19T05:12:10.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.130+0000 7f0f7a7fc640 1 -- 172.21.15.178:0/2724648225 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f74009c30 con 0x7f0f84104f90 2024-09-19T05:12:10.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.130+0000 7f0f8b8e2640 1 -- 172.21.15.178:0/2724648225 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f841004b0 con 0x7f0f84104f90 2024-09-19T05:12:10.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.130+0000 7f0f7a7fc640 1 -- 172.21.15.178:0/2724648225 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7400f620 con 0x7f0f84104f90 2024-09-19T05:12:10.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.130+0000 7f0f8b8e2640 1 -- 172.21.15.178:0/2724648225 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f84100a40 con 0x7f0f84104f90 2024-09-19T05:12:10.133 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.131+0000 7f0f8b8e2640 1 -- 172.21.15.178:0/2724648225 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f840fdd70 con 0x7f0f84104f90 2024-09-19T05:12:10.134 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.133+0000 7f0f7a7fc640 1 -- 172.21.15.178:0/2724648225 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 15) ==== 138300+0+0 (secure 0 0 0) 0x7f0f7401a070 con 0x7f0f84104f90 2024-09-19T05:12:10.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.134+0000 7f0f7a7fc640 1 --2- 172.21.15.178:0/2724648225 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0f700a3260 0x7f0f700a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:10.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.134+0000 7f0f7a7fc640 1 -- 172.21.15.178:0/2724648225 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f0f740cd790 con 0x7f0f84104f90 2024-09-19T05:12:10.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.134+0000 7f0f8967e640 1 --2- 172.21.15.178:0/2724648225 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0f700a3260 0x7f0f700a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:10.135 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.134+0000 7f0f8967e640 1 --2- 172.21.15.178:0/2724648225 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0f700a3260 0x7f0f700a5720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0f80006010 tx=0x7f0f80000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:10.139 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.138+0000 7f0f7a7fc640 1 -- 172.21.15.178:0/2724648225 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0f7409b950 con 0x7f0f84104f90 2024-09-19T05:12:10.321 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:10.319+0000 7f0f8b8e2640 1 -- 172.21.15.178:0/2724648225 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f0f84101e90 con 0x7f0f700a3260 2024-09-19T05:12:10.321 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:10 smithi178 ceph-mon[34347]: from='osd.0 [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T05:12:10.321 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:10 smithi178 ceph-mon[34347]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T05:12:10.321 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:10 smithi178 ceph-mon[34347]: from='osd.0 [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-09-19T05:12:10.321 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:10 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:12:10.322 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:10 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:10.322 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:10 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:10.322 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:10 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:12:10.322 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:10 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:10.322 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:10 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:10.322 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:10 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:12:10.322 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:10 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:10.322 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:10 smithi178 ceph-mon[34347]: from='osd.0 [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-09-19T05:12:10.322 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:10 smithi178 ceph-mon[34347]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T05:12:10.322 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:10 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:12:10.359 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:10 smithi120 ceph-mon[30956]: from='osd.0 [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T05:12:10.359 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:10 smithi120 ceph-mon[30956]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T05:12:10.359 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:10 smithi120 ceph-mon[30956]: from='osd.0 [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-09-19T05:12:10.359 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:10 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:12:10.359 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:10 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:10.359 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:10 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:10.359 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:10 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:12:10.360 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:10 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:10.360 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:10 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:10.360 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:10 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:12:10.360 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:10 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:10.360 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:10 smithi120 ceph-mon[30956]: from='osd.0 [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-09-19T05:12:10.360 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:10 smithi120 ceph-mon[30956]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T05:12:10.360 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:10 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:12:10.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:10 smithi194 ceph-mon[35228]: from='osd.0 [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T05:12:10.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:10 smithi194 ceph-mon[35228]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T05:12:10.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:10 smithi194 ceph-mon[35228]: from='osd.0 [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-09-19T05:12:10.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:10 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:12:10.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:10 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:10.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:10 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:10.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:10 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:12:10.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:10 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:10.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:10 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:10.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:10 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:12:10.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:10 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:10.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:10 smithi194 ceph-mon[35228]: from='osd.0 [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-09-19T05:12:10.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:10 smithi194 ceph-mon[35228]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T05:12:10.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:10 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:12:11.375 INFO:journalctl@ceph.osd.0.smithi120.stdout:Sep 19 05:12:10 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-0[44696]: 2024-09-19T05:12:10.904+0000 7fcb3f031640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T05:12:11.375 INFO:journalctl@ceph.osd.0.smithi120.stdout:Sep 19 05:12:10 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-0[44696]: 2024-09-19T05:12:10.910+0000 7fcb37663640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:12:11.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:11 smithi120 ceph-mon[30956]: Detected new or changed devices on smithi120 2024-09-19T05:12:11.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:11 smithi120 ceph-mon[30956]: Adjusting osd_memory_target on smithi120 to 17088M 2024-09-19T05:12:11.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:11 smithi120 ceph-mon[30956]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:11.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:11 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:12:11.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:11 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:12:11.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:11 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:12:11.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:11 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:11.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:11 smithi120 ceph-mon[30956]: from='osd.0 [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326]' entity='osd.0' 2024-09-19T05:12:11.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:11 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:12:11.408 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:11 smithi194 ceph-mon[35228]: Detected new or changed devices on smithi120 2024-09-19T05:12:11.408 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:11 smithi194 ceph-mon[35228]: Adjusting osd_memory_target on smithi120 to 17088M 2024-09-19T05:12:11.408 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:11 smithi194 ceph-mon[35228]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:11.408 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:11 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:12:11.409 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:11 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:12:11.409 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:11 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:12:11.409 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:11 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:11.409 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:11 smithi194 ceph-mon[35228]: from='osd.0 [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326]' entity='osd.0' 2024-09-19T05:12:11.409 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:11 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:12:11.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:11 smithi178 ceph-mon[34347]: Detected new or changed devices on smithi120 2024-09-19T05:12:11.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:11 smithi178 ceph-mon[34347]: Adjusting osd_memory_target on smithi120 to 17088M 2024-09-19T05:12:11.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:11 smithi178 ceph-mon[34347]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:11.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:11 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:12:11.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:11 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:12:11.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:11 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:12:11.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:11 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:11.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:11 smithi178 ceph-mon[34347]: from='osd.0 [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326]' entity='osd.0' 2024-09-19T05:12:11.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:11 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:12:12.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:12 smithi120 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T05:12:12.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:12 smithi120 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T05:12:12.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:12 smithi120 ceph-mon[30956]: from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:12:12.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:12 smithi120 ceph-mon[30956]: osd.0 [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326] boot 2024-09-19T05:12:12.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:12 smithi120 ceph-mon[30956]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T05:12:12.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:12 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:12:12.381 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:12 smithi178 ceph-mon[34347]: purged_snaps scrub starts 2024-09-19T05:12:12.381 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:12 smithi178 ceph-mon[34347]: purged_snaps scrub ok 2024-09-19T05:12:12.381 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:12 smithi178 ceph-mon[34347]: from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:12:12.381 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:12 smithi178 ceph-mon[34347]: osd.0 [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326] boot 2024-09-19T05:12:12.381 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:12 smithi178 ceph-mon[34347]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T05:12:12.381 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:12 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:12:12.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:12 smithi194 ceph-mon[35228]: purged_snaps scrub starts 2024-09-19T05:12:12.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:12 smithi194 ceph-mon[35228]: purged_snaps scrub ok 2024-09-19T05:12:12.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:12 smithi194 ceph-mon[35228]: from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:12:12.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:12 smithi194 ceph-mon[35228]: osd.0 [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326] boot 2024-09-19T05:12:12.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:12 smithi194 ceph-mon[35228]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T05:12:12.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:12 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:12:13.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:13 smithi178 ceph-mon[34347]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:13.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:13 smithi178 ceph-mon[34347]: from='client.? 172.21.15.178:0/1759031903' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d21e029b-8a60-43f9-9ba7-30cdba19ba57"}]: dispatch 2024-09-19T05:12:13.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:13 smithi178 ceph-mon[34347]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d21e029b-8a60-43f9-9ba7-30cdba19ba57"}]: dispatch 2024-09-19T05:12:13.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:13 smithi178 ceph-mon[34347]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d21e029b-8a60-43f9-9ba7-30cdba19ba57"}]': finished 2024-09-19T05:12:13.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:13 smithi178 ceph-mon[34347]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T05:12:13.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:13 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:12:13.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:13 smithi120 ceph-mon[30956]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:13.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:13 smithi120 ceph-mon[30956]: from='client.? 172.21.15.178:0/1759031903' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d21e029b-8a60-43f9-9ba7-30cdba19ba57"}]: dispatch 2024-09-19T05:12:13.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:13 smithi120 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d21e029b-8a60-43f9-9ba7-30cdba19ba57"}]: dispatch 2024-09-19T05:12:13.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:13 smithi120 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d21e029b-8a60-43f9-9ba7-30cdba19ba57"}]': finished 2024-09-19T05:12:13.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:13 smithi120 ceph-mon[30956]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T05:12:13.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:13 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:12:13.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:13 smithi194 ceph-mon[35228]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T05:12:13.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:13 smithi194 ceph-mon[35228]: from='client.? 172.21.15.178:0/1759031903' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d21e029b-8a60-43f9-9ba7-30cdba19ba57"}]: dispatch 2024-09-19T05:12:13.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:13 smithi194 ceph-mon[35228]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d21e029b-8a60-43f9-9ba7-30cdba19ba57"}]: dispatch 2024-09-19T05:12:13.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:13 smithi194 ceph-mon[35228]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d21e029b-8a60-43f9-9ba7-30cdba19ba57"}]': finished 2024-09-19T05:12:13.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:13 smithi194 ceph-mon[35228]: osdmap e9: 2 total, 1 up, 2 in 2024-09-19T05:12:13.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:13 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:12:14.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:14 smithi120 ceph-mon[30956]: from='client.? 172.21.15.178:0/3028793961' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:12:14.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:14 smithi194 ceph-mon[35228]: from='client.? 172.21.15.178:0/3028793961' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:12:14.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:14 smithi178 ceph-mon[34347]: from='client.? 172.21.15.178:0/3028793961' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:12:15.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:15 smithi120 ceph-mon[30956]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:15.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:15 smithi194 ceph-mon[35228]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:15.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:15 smithi178 ceph-mon[34347]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:17.323 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:17 smithi178 ceph-mon[34347]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:17.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:17 smithi120 ceph-mon[30956]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:17.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:17 smithi194 ceph-mon[35228]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:19.364 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:19 smithi178 ceph-mon[34347]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:19.381 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:19 smithi120 ceph-mon[30956]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:19.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:19 smithi194 ceph-mon[35228]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:21.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:21 smithi194 ceph-mon[35228]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:21.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:21 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T05:12:21.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:21 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:21.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:21 smithi178 ceph-mon[34347]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:21.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:21 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T05:12:21.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:21 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:21.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:21 smithi120 ceph-mon[30956]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:21.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:21 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T05:12:21.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:21 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:22.258 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:22 smithi178 ceph-mon[34347]: Deploying daemon osd.1 on smithi178 2024-09-19T05:12:22.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:22 smithi194 ceph-mon[35228]: Deploying daemon osd.1 on smithi178 2024-09-19T05:12:22.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:22 smithi120 ceph-mon[30956]: Deploying daemon osd.1 on smithi178 2024-09-19T05:12:23.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:23 smithi194 ceph-mon[35228]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:23.406 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:23 smithi178 ceph-mon[34347]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:23.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:23 smithi120 ceph-mon[30956]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:25.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:25 smithi194 ceph-mon[35228]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:25.427 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:25 smithi120 ceph-mon[30956]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:25.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:25 smithi178 ceph-mon[34347]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:27.337 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:27 smithi178 ceph-mon[34347]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:27.337 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:27 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:12:27.337 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:27 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:27.337 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:27 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:27.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:27 smithi194 ceph-mon[35228]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:27.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:27 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:12:27.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:27 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:27.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:27 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:27.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:27 smithi120 ceph-mon[30956]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:27.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:27 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:12:27.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:27 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:27.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:27 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:29.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:29 smithi194 ceph-mon[35228]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:29.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:29 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:29.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:29 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:29.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:29 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:29.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:29 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:12:29.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:29 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:29.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:29 smithi178 ceph-mon[34347]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:29.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:29.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:29.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:29.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:12:29.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:29.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:29 smithi120 ceph-mon[30956]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:29.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:29 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:29.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:29 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:29.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:29 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:29.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:29 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:12:29.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:29 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:30.535 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:30.532+0000 7f0f7a7fc640 1 -- 172.21.15.178:0/2724648225 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0f84101e90 con 0x7f0f700a3260 2024-09-19T05:12:30.536 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 1 on host 'smithi178' 2024-09-19T05:12:30.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:30.534+0000 7f0f8b8e2640 1 -- 172.21.15.178:0/2724648225 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0f700a3260 msgr2=0x7f0f700a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:30.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:30.534+0000 7f0f8b8e2640 1 --2- 172.21.15.178:0/2724648225 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0f700a3260 0x7f0f700a5720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0f80006010 tx=0x7f0f80000bc0 comp rx=0 tx=0).stop 2024-09-19T05:12:30.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:30.534+0000 7f0f8b8e2640 1 -- 172.21.15.178:0/2724648225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f84104f90 msgr2=0x7f0f84198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:30.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:30.534+0000 7f0f8b8e2640 1 --2- 172.21.15.178:0/2724648225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f84104f90 0x7f0f84198380 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0f7400d770 tx=0x7f0f7400dc30 comp rx=0 tx=0).stop 2024-09-19T05:12:30.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:30.534+0000 7f0f8b8e2640 1 -- 172.21.15.178:0/2724648225 shutdown_connections 2024-09-19T05:12:30.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:30.534+0000 7f0f8b8e2640 1 --2- 172.21.15.178:0/2724648225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f841078c0 0x7f0f8419f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:30.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:30.534+0000 7f0f8b8e2640 1 --2- 172.21.15.178:0/2724648225 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f84104f90 0x7f0f84198380 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:30.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:30.534+0000 7f0f8b8e2640 1 --2- 172.21.15.178:0/2724648225 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0f700a3260 0x7f0f700a5720 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:30.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:30.534+0000 7f0f8b8e2640 1 --2- 172.21.15.178:0/2724648225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f84102660 0x7f0f84197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:30.537 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:30.534+0000 7f0f8b8e2640 1 -- 172.21.15.178:0/2724648225 >> 172.21.15.178:0/2724648225 conn(0x7f0f840fc280 msgr2=0x7f0f841030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:30.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:30.534+0000 7f0f8b8e2640 1 -- 172.21.15.178:0/2724648225 shutdown_connections 2024-09-19T05:12:30.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:12:30.534+0000 7f0f8b8e2640 1 -- 172.21.15.178:0/2724648225 wait complete. 2024-09-19T05:12:31.132 DEBUG:teuthology.orchestra.run.smithi178:osd.1> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T05:12:31.135 INFO:tasks.cephadm:Deploying osd.2 on smithi194 with /dev/vg_nvme/lv_4... 2024-09-19T05:12:31.135 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T05:12:31.370 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:31 smithi178 ceph-mon[34347]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:31.370 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:31 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:12:31.370 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:31 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:31.371 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:31 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:31.390 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:12:31.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:31 smithi194 ceph-mon[35228]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:31.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:31 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:12:31.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:31 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:31.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:31 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:31.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:31 smithi120 ceph-mon[30956]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:31.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:31 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:12:31.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:31 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:31.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:31 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:32.943 INFO:journalctl@ceph.osd.1.smithi178.stdout:Sep 19 05:12:32 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-1[38821]: 2024-09-19T05:12:32.686+0000 7f38e0d44640 -1 osd.1 0 log_to_monitors true 2024-09-19T05:12:33.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:33 smithi194 ceph-mon[35228]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:33.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:33 smithi194 ceph-mon[35228]: from='osd.1 [v2:172.21.15.178:6800/1195511218,v1:172.21.15.178:6801/1195511218]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T05:12:33.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:33 smithi194 ceph-mon[35228]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T05:12:33.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:33 smithi178 ceph-mon[34347]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:33.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:33 smithi178 ceph-mon[34347]: from='osd.1 [v2:172.21.15.178:6800/1195511218,v1:172.21.15.178:6801/1195511218]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T05:12:33.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:33 smithi178 ceph-mon[34347]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T05:12:33.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:33 smithi120 ceph-mon[30956]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:33.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:33 smithi120 ceph-mon[30956]: from='osd.1 [v2:172.21.15.178:6800/1195511218,v1:172.21.15.178:6801/1195511218]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T05:12:33.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:33 smithi120 ceph-mon[30956]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T05:12:33.727 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:12:33.760 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi194:vg_nvme/lv_4 2024-09-19T05:12:34.009 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:12:34.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:34 smithi194 ceph-mon[35228]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T05:12:34.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:34 smithi194 ceph-mon[35228]: from='osd.1 [v2:172.21.15.178:6800/1195511218,v1:172.21.15.178:6801/1195511218]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-09-19T05:12:34.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:34 smithi194 ceph-mon[35228]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T05:12:34.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:12:34.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:34 smithi194 ceph-mon[35228]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-09-19T05:12:34.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:34.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:34.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:12:34.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:34.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:34.394 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:12:34.395 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:34.395 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:34 smithi194 ceph-mon[35228]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-09-19T05:12:34.442 INFO:journalctl@ceph.osd.1.smithi178.stdout:Sep 19 05:12:34 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-1[38821]: 2024-09-19T05:12:34.154+0000 7f38dc4a4640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T05:12:34.442 INFO:journalctl@ceph.osd.1.smithi178.stdout:Sep 19 05:12:34 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-1[38821]: 2024-09-19T05:12:34.160+0000 7f38d8ade640 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:12:34.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:34 smithi178 ceph-mon[34347]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T05:12:34.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:34 smithi178 ceph-mon[34347]: from='osd.1 [v2:172.21.15.178:6800/1195511218,v1:172.21.15.178:6801/1195511218]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-09-19T05:12:34.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:34 smithi178 ceph-mon[34347]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T05:12:34.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:34 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:12:34.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:34 smithi178 ceph-mon[34347]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-09-19T05:12:34.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:34 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:34.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:34 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:34.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:34 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:12:34.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:34 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:34.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:34 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:34.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:34 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:12:34.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:34 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:34.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:34 smithi178 ceph-mon[34347]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-09-19T05:12:34.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.485+0000 7f611124d640 1 -- 172.21.15.194:0/1642829758 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f610c1026d0 msgr2=0x7f610c108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:34.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.485+0000 7f611124d640 1 --2- 172.21.15.194:0/1642829758 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f610c1026d0 0x7f610c108f60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6104009ca0 tx=0x7f610402a8e0 comp rx=0 tx=0).stop 2024-09-19T05:12:34.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.485+0000 7f611124d640 1 -- 172.21.15.194:0/1642829758 shutdown_connections 2024-09-19T05:12:34.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.485+0000 7f611124d640 1 --2- 172.21.15.194:0/1642829758 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f610c1026d0 0x7f610c108f60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:34.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.485+0000 7f611124d640 1 --2- 172.21.15.194:0/1642829758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f610c101d10 0x7f610c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:34.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.485+0000 7f611124d640 1 --2- 172.21.15.194:0/1642829758 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f610c100b10 0x7f610c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:34.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.485+0000 7f611124d640 1 -- 172.21.15.194:0/1642829758 >> 172.21.15.194:0/1642829758 conn(0x7f610c0fc2a0 msgr2=0x7f610c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:34.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.485+0000 7f611124d640 1 -- 172.21.15.194:0/1642829758 shutdown_connections 2024-09-19T05:12:34.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.485+0000 7f611124d640 1 -- 172.21.15.194:0/1642829758 wait complete. 2024-09-19T05:12:34.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.486+0000 7f611124d640 1 Processor -- start 2024-09-19T05:12:34.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.486+0000 7f611124d640 1 -- start start 2024-09-19T05:12:34.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.487+0000 7f611124d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f610c100b10 0x7f610c104aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:34.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.487+0000 7f611124d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f610c101d10 0x7f610c1030f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:34.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.487+0000 7f611124d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f610c1026d0 0x7f610c103630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:34.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.487+0000 7f611124d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f610c10c790 con 0x7f610c1026d0 2024-09-19T05:12:34.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.487+0000 7f611124d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f610c10c610 con 0x7f610c101d10 2024-09-19T05:12:34.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.487+0000 7f611124d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f610c10c910 con 0x7f610c100b10 2024-09-19T05:12:34.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.487+0000 7f610ad9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f610c100b10 0x7f610c104aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:34.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.487+0000 7f610ad9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f610c100b10 0x7f610c104aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:39952/0 (socket says 172.21.15.194:39952) 2024-09-19T05:12:34.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.487+0000 7f610ad9d640 1 -- 172.21.15.194:0/3686486284 learned_addr learned my addr 172.21.15.194:0/3686486284 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T05:12:34.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.487+0000 7f610a59c640 1 --2- 172.21.15.194:0/3686486284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f610c101d10 0x7f610c1030f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:34.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.487+0000 7f610ad9d640 1 -- 172.21.15.194:0/3686486284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f610c101d10 msgr2=0x7f610c1030f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:34.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.487+0000 7f610ad9d640 1 --2- 172.21.15.194:0/3686486284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f610c101d10 0x7f610c1030f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:34.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.487+0000 7f610ad9d640 1 -- 172.21.15.194:0/3686486284 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f610c1026d0 msgr2=0x7f610c103630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:34.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.487+0000 7f610ad9d640 1 --2- 172.21.15.194:0/3686486284 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f610c1026d0 0x7f610c103630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:34.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.487+0000 7f610ad9d640 1 -- 172.21.15.194:0/3686486284 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610c103ef0 con 0x7f610c100b10 2024-09-19T05:12:34.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.487+0000 7f610a59c640 1 --2- 172.21.15.194:0/3686486284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f610c101d10 0x7f610c1030f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:12:34.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.487+0000 7f610ad9d640 1 --2- 172.21.15.194:0/3686486284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f610c100b10 0x7f610c104aa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f60fc00b470 tx=0x7f60fc00b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:34.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.487+0000 7f60f3fff640 1 -- 172.21.15.194:0/3686486284 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60fc015020 con 0x7f610c100b10 2024-09-19T05:12:34.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.487+0000 7f611124d640 1 -- 172.21.15.194:0/3686486284 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f610c1a2130 con 0x7f610c100b10 2024-09-19T05:12:34.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.487+0000 7f60f3fff640 1 -- 172.21.15.194:0/3686486284 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f60fc011d40 con 0x7f610c100b10 2024-09-19T05:12:34.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.487+0000 7f60f3fff640 1 -- 172.21.15.194:0/3686486284 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60fc00f340 con 0x7f610c100b10 2024-09-19T05:12:34.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.487+0000 7f611124d640 1 -- 172.21.15.194:0/3686486284 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f610c1a26c0 con 0x7f610c100b10 2024-09-19T05:12:34.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.489+0000 7f611124d640 1 -- 172.21.15.194:0/3686486284 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f610c1a2950 con 0x7f610c100b10 2024-09-19T05:12:34.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.490+0000 7f60f3fff640 1 -- 172.21.15.194:0/3686486284 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 15) ==== 138300+0+0 (secure 0 0 0) 0x7f60fc018020 con 0x7f610c100b10 2024-09-19T05:12:34.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.490+0000 7f60f3fff640 1 --2- 172.21.15.194:0/3686486284 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f60f40a31b0 0x7f60f40a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:34.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.491+0000 7f60f3fff640 1 -- 172.21.15.194:0/3686486284 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2029+0+0 (secure 0 0 0) 0x7f60fc0cdad0 con 0x7f610c100b10 2024-09-19T05:12:34.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.491+0000 7f610a59c640 1 --2- 172.21.15.194:0/3686486284 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f60f40a31b0 0x7f60f40a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:34.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.491+0000 7f610a59c640 1 --2- 172.21.15.194:0/3686486284 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f60f40a31b0 0x7f60f40a5670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6100006fd0 tx=0x7f6100008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:34.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.495+0000 7f60f3fff640 1 -- 172.21.15.194:0/3686486284 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f60fc01f020 con 0x7f610c100b10 2024-09-19T05:12:34.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:34 smithi120 ceph-mon[30956]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T05:12:34.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:34 smithi120 ceph-mon[30956]: from='osd.1 [v2:172.21.15.178:6800/1195511218,v1:172.21.15.178:6801/1195511218]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-09-19T05:12:34.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:34 smithi120 ceph-mon[30956]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T05:12:34.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:12:34.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:34 smithi120 ceph-mon[30956]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-09-19T05:12:34.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:34.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:34.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:12:34.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:34.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:34.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:12:34.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:34.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:34 smithi120 ceph-mon[30956]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-09-19T05:12:34.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:34.671+0000 7f611124d640 1 -- 172.21.15.194:0/3686486284 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f610c1a2b20 con 0x7f60f40a31b0 2024-09-19T05:12:35.347 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:35 smithi194 ceph-mon[35228]: Detected new or changed devices on smithi178 2024-09-19T05:12:35.347 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:35 smithi194 ceph-mon[35228]: Adjusting osd_memory_target on smithi178 to 17088M 2024-09-19T05:12:35.347 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:35 smithi194 ceph-mon[35228]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:35.347 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:35 smithi194 ceph-mon[35228]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T05:12:35.347 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:35 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:12:35.347 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:35 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:12:35.348 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:35 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:12:35.348 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:35 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:12:35.348 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:35 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:35.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:35 smithi178 ceph-mon[34347]: Detected new or changed devices on smithi178 2024-09-19T05:12:35.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:35 smithi178 ceph-mon[34347]: Adjusting osd_memory_target on smithi178 to 17088M 2024-09-19T05:12:35.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:35 smithi178 ceph-mon[34347]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:35.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:35 smithi178 ceph-mon[34347]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T05:12:35.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:35 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:12:35.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:35 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:12:35.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:35 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:12:35.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:35 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:12:35.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:35 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:35.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:35 smithi120 ceph-mon[30956]: Detected new or changed devices on smithi178 2024-09-19T05:12:35.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:35 smithi120 ceph-mon[30956]: Adjusting osd_memory_target on smithi178 to 17088M 2024-09-19T05:12:35.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:35 smithi120 ceph-mon[30956]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:35.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:35 smithi120 ceph-mon[30956]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T05:12:35.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:35 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:12:35.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:35 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:12:35.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:35 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:12:35.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:35 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:12:35.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:35 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:36.188 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:36 smithi194 ceph-mon[35228]: purged_snaps scrub starts 2024-09-19T05:12:36.189 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:36 smithi194 ceph-mon[35228]: purged_snaps scrub ok 2024-09-19T05:12:36.189 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:36 smithi194 ceph-mon[35228]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:12:36.189 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:36 smithi194 ceph-mon[35228]: osd.1 [v2:172.21.15.178:6800/1195511218,v1:172.21.15.178:6801/1195511218] boot 2024-09-19T05:12:36.189 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:36 smithi194 ceph-mon[35228]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T05:12:36.189 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:36 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:12:36.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:36 smithi178 ceph-mon[34347]: purged_snaps scrub starts 2024-09-19T05:12:36.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:36 smithi178 ceph-mon[34347]: purged_snaps scrub ok 2024-09-19T05:12:36.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:36 smithi178 ceph-mon[34347]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:12:36.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:36 smithi178 ceph-mon[34347]: osd.1 [v2:172.21.15.178:6800/1195511218,v1:172.21.15.178:6801/1195511218] boot 2024-09-19T05:12:36.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:36 smithi178 ceph-mon[34347]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T05:12:36.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:36 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:12:36.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:36 smithi120 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T05:12:36.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:36 smithi120 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T05:12:36.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:36 smithi120 ceph-mon[30956]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:12:36.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:36 smithi120 ceph-mon[30956]: osd.1 [v2:172.21.15.178:6800/1195511218,v1:172.21.15.178:6801/1195511218] boot 2024-09-19T05:12:36.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:36 smithi120 ceph-mon[30956]: osdmap e12: 2 total, 2 up, 2 in 2024-09-19T05:12:36.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:36 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:12:37.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:37 smithi194 ceph-mon[35228]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:37.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:37 smithi194 ceph-mon[35228]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T05:12:37.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:37 smithi194 ceph-mon[35228]: from='client.? 172.21.15.194:0/2832008727' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26ad9c8d-dbaa-46c2-a346-19717d81cc60"}]: dispatch 2024-09-19T05:12:37.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:37 smithi194 ceph-mon[35228]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26ad9c8d-dbaa-46c2-a346-19717d81cc60"}]: dispatch 2024-09-19T05:12:37.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:37 smithi194 ceph-mon[35228]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "26ad9c8d-dbaa-46c2-a346-19717d81cc60"}]': finished 2024-09-19T05:12:37.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:37 smithi194 ceph-mon[35228]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T05:12:37.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:37 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:12:37.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:37 smithi178 ceph-mon[34347]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:37.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:37 smithi178 ceph-mon[34347]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T05:12:37.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:37 smithi178 ceph-mon[34347]: from='client.? 172.21.15.194:0/2832008727' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26ad9c8d-dbaa-46c2-a346-19717d81cc60"}]: dispatch 2024-09-19T05:12:37.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:37 smithi178 ceph-mon[34347]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26ad9c8d-dbaa-46c2-a346-19717d81cc60"}]: dispatch 2024-09-19T05:12:37.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:37 smithi178 ceph-mon[34347]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "26ad9c8d-dbaa-46c2-a346-19717d81cc60"}]': finished 2024-09-19T05:12:37.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:37 smithi178 ceph-mon[34347]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T05:12:37.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:37 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:12:37.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:37 smithi120 ceph-mon[30956]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-19T05:12:37.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:37 smithi120 ceph-mon[30956]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T05:12:37.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:37 smithi120 ceph-mon[30956]: from='client.? 172.21.15.194:0/2832008727' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26ad9c8d-dbaa-46c2-a346-19717d81cc60"}]: dispatch 2024-09-19T05:12:37.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:37 smithi120 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26ad9c8d-dbaa-46c2-a346-19717d81cc60"}]: dispatch 2024-09-19T05:12:37.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:37 smithi120 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "26ad9c8d-dbaa-46c2-a346-19717d81cc60"}]': finished 2024-09-19T05:12:37.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:37 smithi120 ceph-mon[30956]: osdmap e14: 3 total, 2 up, 3 in 2024-09-19T05:12:37.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:37 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:12:38.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:38 smithi178 ceph-mon[34347]: from='client.? 172.21.15.194:0/1720003543' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:12:38.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:38 smithi120 ceph-mon[30956]: from='client.? 172.21.15.194:0/1720003543' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:12:38.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:38 smithi194 ceph-mon[35228]: from='client.? 172.21.15.194:0/1720003543' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:12:39.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:39 smithi178 ceph-mon[34347]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:39.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:39 smithi120 ceph-mon[30956]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:39.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:39 smithi194 ceph-mon[35228]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:41.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:41 smithi178 ceph-mon[34347]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:41.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:41 smithi120 ceph-mon[30956]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:41.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:41 smithi194 ceph-mon[35228]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:43.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:43 smithi178 ceph-mon[34347]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:43.477 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:43 smithi194 ceph-mon[35228]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:43.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:43 smithi120 ceph-mon[30956]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:45.244 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:45 smithi194 ceph-mon[35228]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:45.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:45 smithi178 ceph-mon[34347]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:45.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:45 smithi120 ceph-mon[30956]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:46.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:46 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T05:12:46.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:46 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:46.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:46 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T05:12:46.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:46 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:46.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:46 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T05:12:46.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:46 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:47.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:47 smithi194 ceph-mon[35228]: Deploying daemon osd.2 on smithi194 2024-09-19T05:12:47.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:47 smithi194 ceph-mon[35228]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:47.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:47 smithi120 ceph-mon[30956]: Deploying daemon osd.2 on smithi194 2024-09-19T05:12:47.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:47 smithi120 ceph-mon[30956]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:47.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:47 smithi178 ceph-mon[34347]: Deploying daemon osd.2 on smithi194 2024-09-19T05:12:47.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:47 smithi178 ceph-mon[34347]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:49.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:49 smithi120 ceph-mon[30956]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:49.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:49 smithi194 ceph-mon[35228]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:49.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:49 smithi178 ceph-mon[34347]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:51.351 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:51 smithi194 ceph-mon[35228]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:51.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:51 smithi120 ceph-mon[30956]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:51.691 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:51 smithi178 ceph-mon[34347]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:52.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:52 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:12:52.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:52 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:52.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:52 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:52.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:52 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:12:52.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:52 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:52.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:52 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:52.691 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:52 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:12:52.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:52 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:52.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:52 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:53.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:53 smithi194 ceph-mon[35228]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:53.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:53 smithi120 ceph-mon[30956]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:53.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:53 smithi178 ceph-mon[34347]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:55.233 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:54 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:55.234 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:54 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:55.234 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:54 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:55.234 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:54 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:12:55.234 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:54 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:55.234 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:54 smithi194 ceph-mon[35228]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:55.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:55.274+0000 7f60f3fff640 1 -- 172.21.15.194:0/3686486284 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f610c1a2b20 con 0x7f60f40a31b0 2024-09-19T05:12:55.276 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 2 on host 'smithi194' 2024-09-19T05:12:55.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:55.276+0000 7f611124d640 1 -- 172.21.15.194:0/3686486284 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f60f40a31b0 msgr2=0x7f60f40a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:55.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:55.276+0000 7f611124d640 1 --2- 172.21.15.194:0/3686486284 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f60f40a31b0 0x7f60f40a5670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6100006fd0 tx=0x7f6100008040 comp rx=0 tx=0).stop 2024-09-19T05:12:55.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:55.277+0000 7f611124d640 1 -- 172.21.15.194:0/3686486284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f610c100b10 msgr2=0x7f610c104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:55.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:55.277+0000 7f611124d640 1 --2- 172.21.15.194:0/3686486284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f610c100b10 0x7f610c104aa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f60fc00b470 tx=0x7f60fc00b930 comp rx=0 tx=0).stop 2024-09-19T05:12:55.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:55.277+0000 7f611124d640 1 -- 172.21.15.194:0/3686486284 shutdown_connections 2024-09-19T05:12:55.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:55.277+0000 7f611124d640 1 --2- 172.21.15.194:0/3686486284 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f610c1026d0 0x7f610c103630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:55.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:55.277+0000 7f611124d640 1 --2- 172.21.15.194:0/3686486284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f610c101d10 0x7f610c1030f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:55.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:55.277+0000 7f611124d640 1 --2- 172.21.15.194:0/3686486284 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f60f40a31b0 0x7f60f40a5670 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:55.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:55.277+0000 7f611124d640 1 --2- 172.21.15.194:0/3686486284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f610c100b10 0x7f610c104aa0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:55.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:55.277+0000 7f611124d640 1 -- 172.21.15.194:0/3686486284 >> 172.21.15.194:0/3686486284 conn(0x7f610c0fc2a0 msgr2=0x7f610c06a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:55.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:55.277+0000 7f611124d640 1 -- 172.21.15.194:0/3686486284 shutdown_connections 2024-09-19T05:12:55.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:12:55.277+0000 7f611124d640 1 -- 172.21.15.194:0/3686486284 wait complete. 2024-09-19T05:12:55.377 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:54 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:55.377 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:54 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:55.377 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:54 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:55.378 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:54 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:12:55.378 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:54 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:55.378 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:54 smithi120 ceph-mon[30956]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:55.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:54 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:55.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:54 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:55.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:54 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:55.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:54 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:12:55.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:54 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:55.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:54 smithi178 ceph-mon[34347]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:55.851 DEBUG:teuthology.orchestra.run.smithi194:osd.2> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T05:12:55.854 INFO:tasks.cephadm:Deploying osd.3 on smithi120 with /dev/vg_nvme/lv_3... 2024-09-19T05:12:55.854 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T05:12:56.095 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:12:56.117 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:55 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:12:56.117 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:55 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:56.117 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:55 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:56.212 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:55 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:12:56.212 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:55 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:56.213 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:55 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:56.344 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:55 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:12:56.344 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:55 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:56.344 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:55 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:57.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:56 smithi194 ceph-mon[35228]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:57.251 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:56 smithi120 ceph-mon[30956]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:57.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:56 smithi178 ceph-mon[34347]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:58.138 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:58 smithi120 ceph-mon[30956]: from='osd.2 [v2:172.21.15.194:6800/3752826560,v1:172.21.15.194:6801/3752826560]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T05:12:58.139 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:58 smithi120 ceph-mon[30956]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T05:12:58.157 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:58 smithi194 ceph-mon[35228]: from='osd.2 [v2:172.21.15.194:6800/3752826560,v1:172.21.15.194:6801/3752826560]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T05:12:58.158 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:58 smithi194 ceph-mon[35228]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T05:12:58.158 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 19 05:12:57 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-2[40189]: 2024-09-19T05:12:57.832+0000 7f5c331b7640 -1 osd.2 0 log_to_monitors true 2024-09-19T05:12:58.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:58 smithi178 ceph-mon[34347]: from='osd.2 [v2:172.21.15.194:6800/3752826560,v1:172.21.15.194:6801/3752826560]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T05:12:58.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:58 smithi178 ceph-mon[34347]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T05:12:58.462 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:12:58.490 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi120:vg_nvme/lv_3 2024-09-19T05:12:58.745 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:12:59.097 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:59 smithi120 ceph-mon[30956]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T05:12:59.097 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:59 smithi120 ceph-mon[30956]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T05:12:59.097 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:59 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:12:59.098 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:59 smithi120 ceph-mon[30956]: from='osd.2 [v2:172.21.15.194:6800/3752826560,v1:172.21.15.194:6801/3752826560]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-19T05:12:59.098 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:59 smithi120 ceph-mon[30956]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-19T05:12:59.098 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:59 smithi120 ceph-mon[30956]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:59.098 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:59 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:59.098 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:59 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:59.098 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:59 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:12:59.098 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:59 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:59.098 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:59 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:59.098 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:59 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:12:59.098 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:12:59 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:59.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.179+0000 7f5225a82640 1 -- 172.21.15.120:0/4173086672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5220100ad0 msgr2=0x7f5220100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:59.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.179+0000 7f5225a82640 1 --2- 172.21.15.120:0/4173086672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5220100ad0 0x7f5220100ed0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5210009900 tx=0x7f521002a410 comp rx=0 tx=0).stop 2024-09-19T05:12:59.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.179+0000 7f5225a82640 1 -- 172.21.15.120:0/4173086672 shutdown_connections 2024-09-19T05:12:59.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.179+0000 7f5225a82640 1 --2- 172.21.15.120:0/4173086672 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5220102690 0x7f5220108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:59.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.179+0000 7f5225a82640 1 --2- 172.21.15.120:0/4173086672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5220101cd0 0x7f5220102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:59.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.179+0000 7f5225a82640 1 --2- 172.21.15.120:0/4173086672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5220100ad0 0x7f5220100ed0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:59.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.179+0000 7f5225a82640 1 -- 172.21.15.120:0/4173086672 >> 172.21.15.120:0/4173086672 conn(0x7f52200fc280 msgr2=0x7f52200fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:12:59.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.179+0000 7f5225a82640 1 -- 172.21.15.120:0/4173086672 shutdown_connections 2024-09-19T05:12:59.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.179+0000 7f5225a82640 1 -- 172.21.15.120:0/4173086672 wait complete. 2024-09-19T05:12:59.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.180+0000 7f5225a82640 1 Processor -- start 2024-09-19T05:12:59.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.180+0000 7f5225a82640 1 -- start start 2024-09-19T05:12:59.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.180+0000 7f5225a82640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5220100ad0 0x7f5220104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:59.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.180+0000 7f5225a82640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5220101cd0 0x7f52201030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:59.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.180+0000 7f5225a82640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5220102690 0x7f52201035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:59.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.180+0000 7f5225a82640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f522010c660 con 0x7f5220102690 2024-09-19T05:12:59.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.180+0000 7f5225a82640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f522010c4e0 con 0x7f5220101cd0 2024-09-19T05:12:59.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.180+0000 7f5225a82640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f522010c7e0 con 0x7f5220100ad0 2024-09-19T05:12:59.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.180+0000 7f521ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5220102690 0x7f52201035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:59.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.180+0000 7f521f7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5220100ad0 0x7f5220104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:59.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.180+0000 7f521f7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5220100ad0 0x7f5220104a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:47222/0 (socket says 172.21.15.120:47222) 2024-09-19T05:12:59.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.180+0000 7f521ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5220102690 0x7f52201035f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54914/0 (socket says 172.21.15.120:54914) 2024-09-19T05:12:59.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.180+0000 7f521f7fe640 1 -- 172.21.15.120:0/3807259379 learned_addr learned my addr 172.21.15.120:0/3807259379 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:12:59.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.180+0000 7f521effd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5220101cd0 0x7f52201030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:59.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.181+0000 7f521ffff640 1 -- 172.21.15.120:0/3807259379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5220100ad0 msgr2=0x7f5220104a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:59.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.181+0000 7f521ffff640 1 --2- 172.21.15.120:0/3807259379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5220100ad0 0x7f5220104a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:59.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.181+0000 7f521ffff640 1 -- 172.21.15.120:0/3807259379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5220101cd0 msgr2=0x7f52201030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:12:59.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.181+0000 7f521ffff640 1 --2- 172.21.15.120:0/3807259379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5220101cd0 0x7f52201030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:12:59.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.181+0000 7f521ffff640 1 -- 172.21.15.120:0/3807259379 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5220103eb0 con 0x7f5220102690 2024-09-19T05:12:59.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.181+0000 7f521ffff640 1 --2- 172.21.15.120:0/3807259379 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5220102690 0x7f52201035f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f521800e940 tx=0x7f521800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:59.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.181+0000 7f521cff9640 1 -- 172.21.15.120:0/3807259379 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5218004d20 con 0x7f5220102690 2024-09-19T05:12:59.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.181+0000 7f521cff9640 1 -- 172.21.15.120:0/3807259379 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5218005020 con 0x7f5220102690 2024-09-19T05:12:59.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.181+0000 7f5225a82640 1 -- 172.21.15.120:0/3807259379 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52201a20e0 con 0x7f5220102690 2024-09-19T05:12:59.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.181+0000 7f521cff9640 1 -- 172.21.15.120:0/3807259379 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52180116d0 con 0x7f5220102690 2024-09-19T05:12:59.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.181+0000 7f5225a82640 1 -- 172.21.15.120:0/3807259379 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52201a2620 con 0x7f5220102690 2024-09-19T05:12:59.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.182+0000 7f5225a82640 1 -- 172.21.15.120:0/3807259379 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52201a28b0 con 0x7f5220102690 2024-09-19T05:12:59.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.183+0000 7f521cff9640 1 -- 172.21.15.120:0/3807259379 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 15) ==== 138300+0+0 (secure 0 0 0) 0x7f521800ca60 con 0x7f5220102690 2024-09-19T05:12:59.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.184+0000 7f521cff9640 1 --2- 172.21.15.120:0/3807259379 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f52080a31b0 0x7f52080a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:12:59.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.184+0000 7f521f7fe640 1 --2- 172.21.15.120:0/3807259379 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f52080a31b0 0x7f52080a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:12:59.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.184+0000 7f521cff9640 1 -- 172.21.15.120:0/3807259379 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7f52180ce540 con 0x7f5220102690 2024-09-19T05:12:59.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.185+0000 7f521f7fe640 1 --2- 172.21.15.120:0/3807259379 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f52080a31b0 0x7f52080a5670 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f52100096c0 tx=0x7f5210031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:12:59.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.188+0000 7f521cff9640 1 -- 172.21.15.120:0/3807259379 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5218016030 con 0x7f5220102690 2024-09-19T05:12:59.372 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:12:59.370+0000 7f5225a82640 1 -- 172.21.15.120:0/3807259379 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f52201a2a80 con 0x7f52080a31b0 2024-09-19T05:12:59.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:59 smithi194 ceph-mon[35228]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T05:12:59.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:59 smithi194 ceph-mon[35228]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T05:12:59.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:59 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:12:59.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:59 smithi194 ceph-mon[35228]: from='osd.2 [v2:172.21.15.194:6800/3752826560,v1:172.21.15.194:6801/3752826560]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-19T05:12:59.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:59 smithi194 ceph-mon[35228]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-19T05:12:59.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:59 smithi194 ceph-mon[35228]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:59.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:59 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:59.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:59 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:59.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:59 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:12:59.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:59 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:59.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:59 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:59.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:59 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:12:59.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:12:59 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:59.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:59 smithi178 ceph-mon[34347]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T05:12:59.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:59 smithi178 ceph-mon[34347]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T05:12:59.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:59 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:12:59.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:59 smithi178 ceph-mon[34347]: from='osd.2 [v2:172.21.15.194:6800/3752826560,v1:172.21.15.194:6801/3752826560]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-19T05:12:59.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:59 smithi178 ceph-mon[34347]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-19T05:12:59.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:59 smithi178 ceph-mon[34347]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:12:59.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:59 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:59.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:59 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:59.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:59 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:12:59.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:59 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:12:59.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:59 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:12:59.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:59 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:12:59.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:12:59 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:00.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:00 smithi120 ceph-mon[30956]: Detected new or changed devices on smithi194 2024-09-19T05:13:00.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:00 smithi120 ceph-mon[30956]: Adjusting osd_memory_target on smithi194 to 17088M 2024-09-19T05:13:00.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:00 smithi120 ceph-mon[30956]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-19T05:13:00.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:00 smithi120 ceph-mon[30956]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T05:13:00.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:00 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:13:00.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:00 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:13:00.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:00 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:13:00.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:00 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:13:00.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:00 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:00.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:00 smithi120 ceph-mon[30956]: from='osd.2 ' entity='osd.2' 2024-09-19T05:13:00.405 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 19 05:12:59 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-2[40189]: 2024-09-19T05:12:59.909+0000 7f5c2e917640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T05:13:00.405 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 19 05:12:59 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-2[40189]: 2024-09-19T05:12:59.918+0000 7f5c26f49640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:13:00.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:00 smithi194 ceph-mon[35228]: Detected new or changed devices on smithi194 2024-09-19T05:13:00.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:00 smithi194 ceph-mon[35228]: Adjusting osd_memory_target on smithi194 to 17088M 2024-09-19T05:13:00.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:00 smithi194 ceph-mon[35228]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-19T05:13:00.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:00 smithi194 ceph-mon[35228]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T05:13:00.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:00 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:13:00.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:00 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:13:00.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:00 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:13:00.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:00 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:13:00.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:00 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:00.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:00 smithi194 ceph-mon[35228]: from='osd.2 ' entity='osd.2' 2024-09-19T05:13:00.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:00 smithi178 ceph-mon[34347]: Detected new or changed devices on smithi194 2024-09-19T05:13:00.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:00 smithi178 ceph-mon[34347]: Adjusting osd_memory_target on smithi194 to 17088M 2024-09-19T05:13:00.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:00 smithi178 ceph-mon[34347]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-19T05:13:00.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:00 smithi178 ceph-mon[34347]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T05:13:00.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:00 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:13:00.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:00 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:13:00.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:00 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:13:00.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:00 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:13:00.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:00 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:00.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:00 smithi178 ceph-mon[34347]: from='osd.2 ' entity='osd.2' 2024-09-19T05:13:01.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:01 smithi120 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T05:13:01.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:01 smithi120 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T05:13:01.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:01 smithi120 ceph-mon[30956]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:13:01.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:01 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:13:01.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:01 smithi120 ceph-mon[30956]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:13:01.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:01 smithi120 ceph-mon[30956]: osd.2 [v2:172.21.15.194:6800/3752826560,v1:172.21.15.194:6801/3752826560] boot 2024-09-19T05:13:01.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:01 smithi120 ceph-mon[30956]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T05:13:01.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:01 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:13:01.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:01 smithi194 ceph-mon[35228]: purged_snaps scrub starts 2024-09-19T05:13:01.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:01 smithi194 ceph-mon[35228]: purged_snaps scrub ok 2024-09-19T05:13:01.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:01 smithi194 ceph-mon[35228]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:13:01.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:01 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:13:01.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:01 smithi194 ceph-mon[35228]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:13:01.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:01 smithi194 ceph-mon[35228]: osd.2 [v2:172.21.15.194:6800/3752826560,v1:172.21.15.194:6801/3752826560] boot 2024-09-19T05:13:01.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:01 smithi194 ceph-mon[35228]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T05:13:01.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:01 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:13:01.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:01 smithi178 ceph-mon[34347]: purged_snaps scrub starts 2024-09-19T05:13:01.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:01 smithi178 ceph-mon[34347]: purged_snaps scrub ok 2024-09-19T05:13:01.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:01 smithi178 ceph-mon[34347]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:13:01.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:01 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:13:01.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:01 smithi178 ceph-mon[34347]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-19T05:13:01.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:01 smithi178 ceph-mon[34347]: osd.2 [v2:172.21.15.194:6800/3752826560,v1:172.21.15.194:6801/3752826560] boot 2024-09-19T05:13:01.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:01 smithi178 ceph-mon[34347]: osdmap e17: 3 total, 3 up, 3 in 2024-09-19T05:13:01.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:01 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:13:02.229 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:02 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/4138598242' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7e266576-8a98-40a8-9532-4b6f4611a908"}]: dispatch 2024-09-19T05:13:02.230 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:02 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/4138598242' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7e266576-8a98-40a8-9532-4b6f4611a908"}]': finished 2024-09-19T05:13:02.230 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:02 smithi120 ceph-mon[30956]: osdmap e18: 4 total, 3 up, 4 in 2024-09-19T05:13:02.230 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:02 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:02.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:02 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/4138598242' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7e266576-8a98-40a8-9532-4b6f4611a908"}]: dispatch 2024-09-19T05:13:02.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:02 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/4138598242' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7e266576-8a98-40a8-9532-4b6f4611a908"}]': finished 2024-09-19T05:13:02.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:02 smithi194 ceph-mon[35228]: osdmap e18: 4 total, 3 up, 4 in 2024-09-19T05:13:02.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:02 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:02.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:02 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/4138598242' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7e266576-8a98-40a8-9532-4b6f4611a908"}]: dispatch 2024-09-19T05:13:02.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:02 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/4138598242' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7e266576-8a98-40a8-9532-4b6f4611a908"}]': finished 2024-09-19T05:13:02.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:02 smithi178 ceph-mon[34347]: osdmap e18: 4 total, 3 up, 4 in 2024-09-19T05:13:02.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:02 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:03.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:03 smithi120 ceph-mon[30956]: pgmap v75: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:13:03.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T05:13:03.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:03 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/885249651' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:13:03.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T05:13:03.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:03 smithi120 ceph-mon[30956]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T05:13:03.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:03.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T05:13:03.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:03 smithi194 ceph-mon[35228]: pgmap v75: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:13:03.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T05:13:03.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:03 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/885249651' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:13:03.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T05:13:03.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:03 smithi194 ceph-mon[35228]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T05:13:03.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:03.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T05:13:03.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:03 smithi178 ceph-mon[34347]: pgmap v75: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:13:03.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T05:13:03.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:03 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/885249651' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:13:03.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T05:13:03.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:03 smithi178 ceph-mon[34347]: osdmap e19: 4 total, 3 up, 4 in 2024-09-19T05:13:03.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:03.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T05:13:04.316 INFO:journalctl@ceph.osd.0.smithi120.stdout:Sep 19 05:13:04 smithi120 sudo[49569]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T05:13:04.316 INFO:journalctl@ceph.osd.0.smithi120.stdout:Sep 19 05:13:04 smithi120 sudo[49569]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:13:04.317 INFO:journalctl@ceph.osd.0.smithi120.stdout:Sep 19 05:13:04 smithi120 sudo[49569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:13:04.317 INFO:journalctl@ceph.osd.0.smithi120.stdout:Sep 19 05:13:04 smithi120 sudo[49569]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:13:04.625 INFO:journalctl@ceph.osd.0.smithi120.stdout:Sep 19 05:13:04 smithi120 sudo[49573]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T05:13:04.625 INFO:journalctl@ceph.osd.0.smithi120.stdout:Sep 19 05:13:04 smithi120 sudo[49573]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:13:04.625 INFO:journalctl@ceph.osd.0.smithi120.stdout:Sep 19 05:13:04 smithi120 sudo[49573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:13:04.625 INFO:journalctl@ceph.osd.0.smithi120.stdout:Sep 19 05:13:04 smithi120 sudo[49573]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:13:04.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:13:04.702+0000 7f521cff9640 1 -- 172.21.15.120:0/3807259379 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f5218098920 con 0x7f5220102690 2024-09-19T05:13:04.844 INFO:journalctl@ceph.osd.1.smithi178.stdout:Sep 19 05:13:04 smithi178 sudo[42819]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T05:13:04.844 INFO:journalctl@ceph.osd.1.smithi178.stdout:Sep 19 05:13:04 smithi178 sudo[42819]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:13:04.844 INFO:journalctl@ceph.osd.1.smithi178.stdout:Sep 19 05:13:04 smithi178 sudo[42819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:13:04.845 INFO:journalctl@ceph.osd.1.smithi178.stdout:Sep 19 05:13:04 smithi178 sudo[42819]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:13:04.845 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:04 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T05:13:04.845 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:04 smithi178 ceph-mon[34347]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T05:13:04.845 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:04 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:04.845 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:04 smithi178 ceph-mon[34347]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:13:04.845 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:04 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:05.114 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:04 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T05:13:05.114 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:04 smithi194 ceph-mon[35228]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T05:13:05.114 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:04 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:05.114 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:04 smithi194 ceph-mon[35228]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:13:05.114 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:04 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:05.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:04 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T05:13:05.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:04 smithi120 ceph-mon[30956]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T05:13:05.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:04 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:05.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:04 smithi120 ceph-mon[30956]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:13:05.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:04 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:05.192 INFO:journalctl@ceph.osd.1.smithi178.stdout:Sep 19 05:13:04 smithi178 sudo[42822]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T05:13:05.192 INFO:journalctl@ceph.osd.1.smithi178.stdout:Sep 19 05:13:04 smithi178 sudo[42822]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:13:05.192 INFO:journalctl@ceph.osd.1.smithi178.stdout:Sep 19 05:13:04 smithi178 sudo[42822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:13:05.192 INFO:journalctl@ceph.osd.1.smithi178.stdout:Sep 19 05:13:04 smithi178 sudo[42822]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:13:05.368 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 19 05:13:05 smithi194 sudo[44254]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T05:13:05.368 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 19 05:13:05 smithi194 sudo[44254]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:13:05.368 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 19 05:13:05 smithi194 sudo[44254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:13:05.368 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 19 05:13:05 smithi194 sudo[44254]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:13:05.655 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 19 05:13:05 smithi194 sudo[44257]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T05:13:05.656 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 19 05:13:05 smithi194 sudo[44257]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:13:05.656 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 19 05:13:05 smithi194 sudo[44257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:13:05.656 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 19 05:13:05 smithi194 sudo[44257]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:13:05.892 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:05 smithi120 sudo[49952]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T05:13:05.892 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:05 smithi120 sudo[49952]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:13:05.892 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:05 smithi120 sudo[49952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:13:05.892 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:05 smithi120 sudo[49952]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:13:06.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:05 smithi194 ceph-mon[35228]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T05:13:06.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:05 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:06.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:05 smithi194 ceph-mon[35228]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T05:13:06.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:05 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:06.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:05 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:06.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:05 smithi194 ceph-mon[35228]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:13:06.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:06 smithi194 sudo[44260]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T05:13:06.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:06 smithi194 sudo[44260]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:13:06.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:06 smithi194 sudo[44260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:13:06.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:05 smithi178 ceph-mon[34347]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T05:13:06.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:05 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:06.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:05 smithi178 ceph-mon[34347]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T05:13:06.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:05 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:06.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:05 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:06.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:05 smithi178 ceph-mon[34347]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:13:06.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:05 smithi120 sudo[49958]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T05:13:06.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:05 smithi120 sudo[49958]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:13:06.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:05 smithi120 sudo[49958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:13:06.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:05 smithi120 sudo[49958]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:13:06.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:05 smithi120 ceph-mon[30956]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T05:13:06.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:05 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:06.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:05 smithi120 ceph-mon[30956]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T05:13:06.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:05 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:06.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:05 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:06.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:05 smithi120 ceph-mon[30956]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:13:06.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:06 smithi194 sudo[44260]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:13:06.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:06 smithi194 sudo[44263]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T05:13:06.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:06 smithi194 sudo[44263]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:13:06.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:06 smithi194 sudo[44263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:13:06.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:06 smithi194 sudo[44263]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:13:06.884 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:06 smithi178 sudo[42825]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T05:13:06.884 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:06 smithi178 sudo[42825]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:13:06.884 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:06 smithi178 sudo[42825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:13:06.884 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:06 smithi178 sudo[42825]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:13:07.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:06 smithi120 ceph-mon[30956]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:13:07.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:06 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:13:07.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:06 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:13:07.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:06 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:13:07.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:06 smithi120 ceph-mon[30956]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:13:07.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:06 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:13:07.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:06 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:13:07.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:06 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:13:07.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:06 smithi120 ceph-mon[30956]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 93 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:13:07.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:06 smithi120 ceph-mon[30956]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:13:07.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:06 smithi120 ceph-mon[30956]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:13:07.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:06 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:13:07.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:06 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:13:07.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:06 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:13:07.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:06 smithi120 ceph-mon[30956]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:13:07.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:06 smithi194 ceph-mon[35228]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:13:07.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:06 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:13:07.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:06 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:13:07.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:06 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:13:07.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:06 smithi194 ceph-mon[35228]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:13:07.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:06 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:13:07.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:06 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:13:07.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:06 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:13:07.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:06 smithi194 ceph-mon[35228]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 93 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:13:07.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:06 smithi194 ceph-mon[35228]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:13:07.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:06 smithi194 ceph-mon[35228]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:13:07.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:06 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:13:07.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:06 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:13:07.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:06 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:13:07.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:06 smithi194 ceph-mon[35228]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:13:07.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:06 smithi178 sudo[42828]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T05:13:07.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:06 smithi178 sudo[42828]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T05:13:07.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:06 smithi178 sudo[42828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T05:13:07.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:06 smithi178 sudo[42828]: pam_unix(sudo:session): session closed for user root 2024-09-19T05:13:07.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:06 smithi178 ceph-mon[34347]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:13:07.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:06 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:13:07.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:06 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:13:07.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:06 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:13:07.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:06 smithi178 ceph-mon[34347]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:13:07.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:06 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:13:07.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:06 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:13:07.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:06 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:13:07.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:06 smithi178 ceph-mon[34347]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 93 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:13:07.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:06 smithi178 ceph-mon[34347]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:13:07.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:06 smithi178 ceph-mon[34347]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T05:13:07.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:06 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:13:07.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:06 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:13:07.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:06 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:13:07.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:06 smithi178 ceph-mon[34347]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T05:13:09.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:09 smithi120 ceph-mon[30956]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:13:09.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:09 smithi194 ceph-mon[35228]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:13:09.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:09 smithi178 ceph-mon[34347]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:13:11.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:11 smithi120 ceph-mon[30956]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:13:11.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:11 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T05:13:11.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:11 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:11.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:11 smithi194 ceph-mon[35228]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:13:11.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:11 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T05:13:11.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:11 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:11.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:11 smithi178 ceph-mon[34347]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:13:11.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:11 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T05:13:11.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:11 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:12.225 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:12 smithi120 ceph-mon[30956]: Deploying daemon osd.3 on smithi120 2024-09-19T05:13:12.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:12 smithi194 ceph-mon[35228]: Deploying daemon osd.3 on smithi120 2024-09-19T05:13:12.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:12 smithi178 ceph-mon[34347]: Deploying daemon osd.3 on smithi120 2024-09-19T05:13:13.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:13 smithi120 ceph-mon[30956]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-19T05:13:13.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:13 smithi194 ceph-mon[35228]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-19T05:13:13.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:13 smithi178 ceph-mon[34347]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-19T05:13:15.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:15 smithi120 ceph-mon[30956]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T05:13:15.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:15 smithi194 ceph-mon[35228]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T05:13:15.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:15 smithi178 ceph-mon[34347]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-19T05:13:17.233 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:17 smithi120 ceph-mon[30956]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T05:13:17.233 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:17 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:17.234 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:17 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:17.234 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:17 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:17.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:17 smithi194 ceph-mon[35228]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T05:13:17.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:17 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:17.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:17 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:17.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:17 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:17.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:17 smithi178 ceph-mon[34347]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-19T05:13:17.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:17 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:17.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:17 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:17.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:17 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:19.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:19 smithi120 ceph-mon[30956]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T05:13:19.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:19 smithi194 ceph-mon[35228]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T05:13:19.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:19 smithi178 ceph-mon[34347]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-19T05:13:20.473 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:20 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:20.474 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:20 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:20.474 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:20 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:20.474 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:20 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:20.474 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:20 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:20.474 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:20 smithi120 ceph-mon[30956]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T05:13:20.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:13:20.508+0000 7f521cff9640 1 -- 172.21.15.120:0/3807259379 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f52201a2a80 con 0x7f52080a31b0 2024-09-19T05:13:20.512 INFO:teuthology.orchestra.run.smithi120.stdout:Created osd(s) 3 on host 'smithi120' 2024-09-19T05:13:20.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:13:20.510+0000 7f5225a82640 1 -- 172.21.15.120:0/3807259379 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f52080a31b0 msgr2=0x7f52080a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:20.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:13:20.510+0000 7f5225a82640 1 --2- 172.21.15.120:0/3807259379 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f52080a31b0 0x7f52080a5670 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f52100096c0 tx=0x7f5210031400 comp rx=0 tx=0).stop 2024-09-19T05:13:20.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:13:20.510+0000 7f5225a82640 1 -- 172.21.15.120:0/3807259379 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5220102690 msgr2=0x7f52201035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:20.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:13:20.510+0000 7f5225a82640 1 --2- 172.21.15.120:0/3807259379 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5220102690 0x7f52201035f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f521800e940 tx=0x7f521800ed40 comp rx=0 tx=0).stop 2024-09-19T05:13:20.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:13:20.511+0000 7f5225a82640 1 -- 172.21.15.120:0/3807259379 shutdown_connections 2024-09-19T05:13:20.513 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:13:20.511+0000 7f5225a82640 1 --2- 172.21.15.120:0/3807259379 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5220102690 0x7f52201035f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:20.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:13:20.511+0000 7f5225a82640 1 --2- 172.21.15.120:0/3807259379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5220101cd0 0x7f52201030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:20.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:13:20.511+0000 7f5225a82640 1 --2- 172.21.15.120:0/3807259379 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f52080a31b0 0x7f52080a5670 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:20.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:13:20.511+0000 7f5225a82640 1 --2- 172.21.15.120:0/3807259379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5220100ad0 0x7f5220104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:20.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:13:20.511+0000 7f5225a82640 1 -- 172.21.15.120:0/3807259379 >> 172.21.15.120:0/3807259379 conn(0x7f52200fc280 msgr2=0x7f522006a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:13:20.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:13:20.511+0000 7f5225a82640 1 -- 172.21.15.120:0/3807259379 shutdown_connections 2024-09-19T05:13:20.514 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:13:20.511+0000 7f5225a82640 1 -- 172.21.15.120:0/3807259379 wait complete. 2024-09-19T05:13:20.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:20.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:20.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:20.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:20.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:20.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:20 smithi194 ceph-mon[35228]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T05:13:20.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:20 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:20.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:20 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:20.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:20 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:20.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:20 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:20.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:20 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:20.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:20 smithi178 ceph-mon[34347]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T05:13:21.130 DEBUG:teuthology.orchestra.run.smithi120:osd.3> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T05:13:21.133 INFO:tasks.cephadm:Deploying osd.4 on smithi178 with /dev/vg_nvme/lv_3... 2024-09-19T05:13:21.133 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T05:13:21.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:21 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:21.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:21 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:21.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:21 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:21.386 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:13:21.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:21 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:21.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:21 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:21.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:21 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:21.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:21 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:21.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:21 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:21.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:21 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:22.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:22 smithi178 ceph-mon[34347]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T05:13:22.596 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:22 smithi120 ceph-mon[30956]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T05:13:22.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:22 smithi194 ceph-mon[35228]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-19T05:13:22.875 INFO:journalctl@ceph.osd.3.smithi120.stdout:Sep 19 05:13:22 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-3[51165]: 2024-09-19T05:13:22.602+0000 7f83bb27a640 -1 osd.3 0 log_to_monitors true 2024-09-19T05:13:23.418 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:23 smithi178 ceph-mon[34347]: from='osd.3 [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T05:13:23.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:23 smithi120 ceph-mon[30956]: from='osd.3 [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T05:13:23.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:23 smithi194 ceph-mon[35228]: from='osd.3 [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T05:13:24.093 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-19T05:13:24.120 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi178:vg_nvme/lv_3 2024-09-19T05:13:24.375 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:13:24.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:24 smithi178 ceph-mon[34347]: from='osd.3 [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T05:13:24.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:24 smithi178 ceph-mon[34347]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T05:13:24.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:24 smithi178 ceph-mon[34347]: from='osd.3 [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-09-19T05:13:24.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:24 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:24.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:24 smithi178 ceph-mon[34347]: Detected new or changed devices on smithi120 2024-09-19T05:13:24.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:24 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:24.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:24 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:24.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:24 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:13:24.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:24 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:13:24.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:24 smithi178 ceph-mon[34347]: Adjusting osd_memory_target on smithi120 to 8544M 2024-09-19T05:13:24.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:24 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:24.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:24 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:24.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:24 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:24.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:24 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:24.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:24 smithi178 ceph-mon[34347]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:13:24.622 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:24 smithi194 ceph-mon[35228]: from='osd.3 [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T05:13:24.623 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:24 smithi194 ceph-mon[35228]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T05:13:24.623 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:24 smithi194 ceph-mon[35228]: from='osd.3 [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-09-19T05:13:24.623 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:24 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:24.623 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:24 smithi194 ceph-mon[35228]: Detected new or changed devices on smithi120 2024-09-19T05:13:24.623 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:24 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:24.623 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:24 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:24.623 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:24 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:13:24.623 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:24 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:13:24.623 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:24 smithi194 ceph-mon[35228]: Adjusting osd_memory_target on smithi120 to 8544M 2024-09-19T05:13:24.623 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:24 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:24.623 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:24 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:24.624 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:24 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:24.624 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:24 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:24.624 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:24 smithi194 ceph-mon[35228]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:13:24.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:24 smithi120 ceph-mon[30956]: from='osd.3 [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T05:13:24.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:24 smithi120 ceph-mon[30956]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T05:13:24.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:24 smithi120 ceph-mon[30956]: from='osd.3 [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-09-19T05:13:24.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:24 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:24.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:24 smithi120 ceph-mon[30956]: Detected new or changed devices on smithi120 2024-09-19T05:13:24.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:24 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:24.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:24 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:24.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:24 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:13:24.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:24 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:13:24.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:24 smithi120 ceph-mon[30956]: Adjusting osd_memory_target on smithi120 to 8544M 2024-09-19T05:13:24.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:24 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:24.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:24 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:24.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:24 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:24.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:24 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:24.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:24 smithi120 ceph-mon[30956]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:13:24.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.818+0000 7f2539e61640 1 -- 172.21.15.178:0/2640882838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2534101cf0 msgr2=0x7f2534102170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:24.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.818+0000 7f2539e61640 1 --2- 172.21.15.178:0/2640882838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2534101cf0 0x7f2534102170 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2528009900 tx=0x7f252802a410 comp rx=0 tx=0).stop 2024-09-19T05:13:24.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.818+0000 7f2539e61640 1 -- 172.21.15.178:0/2640882838 shutdown_connections 2024-09-19T05:13:24.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.818+0000 7f2539e61640 1 --2- 172.21.15.178:0/2640882838 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25341026b0 0x7f2534108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:24.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.818+0000 7f2539e61640 1 --2- 172.21.15.178:0/2640882838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2534101cf0 0x7f2534102170 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:24.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.818+0000 7f2539e61640 1 --2- 172.21.15.178:0/2640882838 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2534100af0 0x7f2534100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:24.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.818+0000 7f2539e61640 1 -- 172.21.15.178:0/2640882838 >> 172.21.15.178:0/2640882838 conn(0x7f25340fc280 msgr2=0x7f25340fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:13:24.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.818+0000 7f2539e61640 1 -- 172.21.15.178:0/2640882838 shutdown_connections 2024-09-19T05:13:24.823 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.818+0000 7f2539e61640 1 -- 172.21.15.178:0/2640882838 wait complete. 2024-09-19T05:13:24.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.819+0000 7f2539e61640 1 Processor -- start 2024-09-19T05:13:24.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.819+0000 7f2539e61640 1 -- start start 2024-09-19T05:13:24.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.819+0000 7f2539e61640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2534100af0 0x7f2534196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:24.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.819+0000 7f2539e61640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2534101cf0 0x7f2534197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:24.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.819+0000 7f2539e61640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25341026b0 0x7f253419e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:24.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.819+0000 7f2539e61640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f253410c620 con 0x7f2534101cf0 2024-09-19T05:13:24.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.819+0000 7f25337fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2534100af0 0x7f2534196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:24.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.819+0000 7f2539e61640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f253410c4a0 con 0x7f2534100af0 2024-09-19T05:13:24.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.819+0000 7f2539e61640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f253410c7a0 con 0x7f25341026b0 2024-09-19T05:13:24.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.819+0000 7f25337fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2534100af0 0x7f2534196d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:43096/0 (socket says 172.21.15.178:43096) 2024-09-19T05:13:24.824 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.819+0000 7f25337fe640 1 -- 172.21.15.178:0/1425719668 learned_addr learned my addr 172.21.15.178:0/1425719668 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-19T05:13:24.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.819+0000 7f2532ffd640 1 --2- 172.21.15.178:0/1425719668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2534101cf0 0x7f2534197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:24.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.820+0000 7f2533fff640 1 --2- 172.21.15.178:0/1425719668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25341026b0 0x7f253419e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:24.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.820+0000 7f25337fe640 1 -- 172.21.15.178:0/1425719668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25341026b0 msgr2=0x7f253419e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:24.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.820+0000 7f25337fe640 1 --2- 172.21.15.178:0/1425719668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25341026b0 0x7f253419e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:24.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.820+0000 7f25337fe640 1 -- 172.21.15.178:0/1425719668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2534101cf0 msgr2=0x7f2534197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:24.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.820+0000 7f25337fe640 1 --2- 172.21.15.178:0/1425719668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2534101cf0 0x7f2534197260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:24.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.820+0000 7f25337fe640 1 -- 172.21.15.178:0/1425719668 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253419e940 con 0x7f2534100af0 2024-09-19T05:13:24.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.820+0000 7f2533fff640 1 --2- 172.21.15.178:0/1425719668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25341026b0 0x7f253419e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:13:24.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.820+0000 7f2532ffd640 1 --2- 172.21.15.178:0/1425719668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2534101cf0 0x7f2534197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:13:24.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.820+0000 7f25337fe640 1 --2- 172.21.15.178:0/1425719668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2534100af0 0x7f2534196d20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f252400e9c0 tx=0x7f252400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:13:24.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.820+0000 7f2530ff9640 1 -- 172.21.15.178:0/1425719668 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252400cd80 con 0x7f2534100af0 2024-09-19T05:13:24.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.820+0000 7f2530ff9640 1 -- 172.21.15.178:0/1425719668 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f25240035f0 con 0x7f2534100af0 2024-09-19T05:13:24.825 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.820+0000 7f2539e61640 1 -- 172.21.15.178:0/1425719668 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f253419ec30 con 0x7f2534100af0 2024-09-19T05:13:24.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.820+0000 7f2530ff9640 1 -- 172.21.15.178:0/1425719668 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2524010690 con 0x7f2534100af0 2024-09-19T05:13:24.826 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.820+0000 7f2539e61640 1 -- 172.21.15.178:0/1425719668 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f253419f1c0 con 0x7f2534100af0 2024-09-19T05:13:24.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.822+0000 7f2539e61640 1 -- 172.21.15.178:0/1425719668 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2534107f90 con 0x7f2534100af0 2024-09-19T05:13:24.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.822+0000 7f2530ff9640 1 -- 172.21.15.178:0/1425719668 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f25240037a0 con 0x7f2534100af0 2024-09-19T05:13:24.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.823+0000 7f2530ff9640 1 --2- 172.21.15.178:0/1425719668 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f251c0a32c0 0x7f251c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:24.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.823+0000 7f2532ffd640 1 --2- 172.21.15.178:0/1425719668 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f251c0a32c0 0x7f251c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:24.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.823+0000 7f2530ff9640 1 -- 172.21.15.178:0/1425719668 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3389+0+0 (secure 0 0 0) 0x7f25240cea10 con 0x7f2534100af0 2024-09-19T05:13:24.827 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.824+0000 7f2532ffd640 1 --2- 172.21.15.178:0/1425719668 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f251c0a32c0 0x7f251c0a5780 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2528006010 tx=0x7f2528000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:13:24.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:24.827+0000 7f2530ff9640 1 -- 172.21.15.178:0/1425719668 <== mon.2 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f252409c9d0 con 0x7f2534100af0 2024-09-19T05:13:25.013 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:25.010+0000 7f2539e61640 1 -- 172.21.15.178:0/1425719668 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f2534062630 con 0x7f251c0a32c0 2024-09-19T05:13:25.375 INFO:journalctl@ceph.osd.3.smithi120.stdout:Sep 19 05:13:25 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-3[51165]: 2024-09-19T05:13:25.079+0000 7f83b69da640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T05:13:25.375 INFO:journalctl@ceph.osd.3.smithi120.stdout:Sep 19 05:13:25 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-3[51165]: 2024-09-19T05:13:25.087+0000 7f83af00c640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:13:25.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:25 smithi120 ceph-mon[30956]: from='osd.3 [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-09-19T05:13:25.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:25 smithi120 ceph-mon[30956]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T05:13:25.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:25 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:25.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:25 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:25.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:25 smithi120 ceph-mon[30956]: from='client.24191 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:13:25.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:25 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:13:25.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:25 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:13:25.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:25 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:25.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:25 smithi120 ceph-mon[30956]: from='osd.3 [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783]' entity='osd.3' 2024-09-19T05:13:25.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:25 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:25.579 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:25 smithi178 ceph-mon[34347]: from='osd.3 [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-09-19T05:13:25.579 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:25 smithi178 ceph-mon[34347]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T05:13:25.579 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:25 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:25.579 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:25 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:25.579 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:25 smithi178 ceph-mon[34347]: from='client.24191 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:13:25.579 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:25 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:13:25.579 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:25 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:13:25.580 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:25 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:25.580 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:25 smithi178 ceph-mon[34347]: from='osd.3 [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783]' entity='osd.3' 2024-09-19T05:13:25.580 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:25 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:25.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:25 smithi194 ceph-mon[35228]: from='osd.3 [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-09-19T05:13:25.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:25 smithi194 ceph-mon[35228]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T05:13:25.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:25 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:25.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:25 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:25.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:25 smithi194 ceph-mon[35228]: from='client.24191 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:13:25.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:25 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:13:25.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:25 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:13:25.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:25 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:25.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:25 smithi194 ceph-mon[35228]: from='osd.3 [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783]' entity='osd.3' 2024-09-19T05:13:25.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:25 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:26.489 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:26 smithi178 ceph-mon[34347]: purged_snaps scrub starts 2024-09-19T05:13:26.490 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:26 smithi178 ceph-mon[34347]: purged_snaps scrub ok 2024-09-19T05:13:26.490 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:26 smithi178 ceph-mon[34347]: osd.3 [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783] boot 2024-09-19T05:13:26.490 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:26 smithi178 ceph-mon[34347]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T05:13:26.490 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:26 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:26.490 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:26 smithi178 ceph-mon[34347]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T05:13:26.490 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:26 smithi178 ceph-mon[34347]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:13:26.592 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:26 smithi120 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T05:13:26.592 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:26 smithi120 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T05:13:26.593 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:26 smithi120 ceph-mon[30956]: osd.3 [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783] boot 2024-09-19T05:13:26.593 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:26 smithi120 ceph-mon[30956]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T05:13:26.593 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:26 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:26.593 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:26 smithi120 ceph-mon[30956]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T05:13:26.593 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:26 smithi120 ceph-mon[30956]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:13:26.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:26 smithi194 ceph-mon[35228]: purged_snaps scrub starts 2024-09-19T05:13:26.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:26 smithi194 ceph-mon[35228]: purged_snaps scrub ok 2024-09-19T05:13:26.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:26 smithi194 ceph-mon[35228]: osd.3 [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783] boot 2024-09-19T05:13:26.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:26 smithi194 ceph-mon[35228]: osdmap e24: 4 total, 4 up, 4 in 2024-09-19T05:13:26.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:26 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:13:26.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:26 smithi194 ceph-mon[35228]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T05:13:26.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:26 smithi194 ceph-mon[35228]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-19T05:13:28.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:27 smithi178 ceph-mon[34347]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T05:13:28.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:27 smithi178 ceph-mon[34347]: from='client.? 172.21.15.178:0/1851451626' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c77d05c5-3b8f-4f7b-91f9-833735221684"}]: dispatch 2024-09-19T05:13:28.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:27 smithi178 ceph-mon[34347]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c77d05c5-3b8f-4f7b-91f9-833735221684"}]: dispatch 2024-09-19T05:13:28.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:27 smithi178 ceph-mon[34347]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c77d05c5-3b8f-4f7b-91f9-833735221684"}]': finished 2024-09-19T05:13:28.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:27 smithi178 ceph-mon[34347]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T05:13:28.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:27 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:13:28.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:27 smithi178 ceph-mon[34347]: from='client.? 172.21.15.178:0/1019034329' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:13:28.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:27 smithi120 ceph-mon[30956]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T05:13:28.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:27 smithi120 ceph-mon[30956]: from='client.? 172.21.15.178:0/1851451626' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c77d05c5-3b8f-4f7b-91f9-833735221684"}]: dispatch 2024-09-19T05:13:28.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:27 smithi120 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c77d05c5-3b8f-4f7b-91f9-833735221684"}]: dispatch 2024-09-19T05:13:28.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:27 smithi120 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c77d05c5-3b8f-4f7b-91f9-833735221684"}]': finished 2024-09-19T05:13:28.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:27 smithi120 ceph-mon[30956]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T05:13:28.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:27 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:13:28.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:27 smithi120 ceph-mon[30956]: from='client.? 172.21.15.178:0/1019034329' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:13:28.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:27 smithi194 ceph-mon[35228]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T05:13:29.020 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:27 smithi194 ceph-mon[35228]: from='client.? 172.21.15.178:0/1851451626' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c77d05c5-3b8f-4f7b-91f9-833735221684"}]: dispatch 2024-09-19T05:13:29.020 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:27 smithi194 ceph-mon[35228]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c77d05c5-3b8f-4f7b-91f9-833735221684"}]: dispatch 2024-09-19T05:13:29.020 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:27 smithi194 ceph-mon[35228]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c77d05c5-3b8f-4f7b-91f9-833735221684"}]': finished 2024-09-19T05:13:29.020 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:27 smithi194 ceph-mon[35228]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T05:13:29.020 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:27 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:13:29.021 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:27 smithi194 ceph-mon[35228]: from='client.? 172.21.15.178:0/1019034329' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:13:29.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:29 smithi120 ceph-mon[30956]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:13:29.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:29 smithi120 ceph-mon[30956]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T05:13:29.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:29 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:13:29.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:29 smithi194 ceph-mon[35228]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:13:29.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:29 smithi194 ceph-mon[35228]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T05:13:29.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:29 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:13:29.691 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:29 smithi178 ceph-mon[34347]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:13:29.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:29 smithi178 ceph-mon[34347]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T05:13:29.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:13:30.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:30 smithi120 ceph-mon[30956]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T05:13:30.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:30 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:13:30.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:30 smithi194 ceph-mon[35228]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T05:13:30.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:30 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:13:30.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:30 smithi178 ceph-mon[34347]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T05:13:30.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:30 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:13:31.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:31 smithi120 ceph-mon[30956]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:13:31.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:31 smithi194 ceph-mon[35228]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:13:31.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:31 smithi178 ceph-mon[34347]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:13:33.502 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:33 smithi178 ceph-mon[34347]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-09-19T05:13:33.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:33 smithi120 ceph-mon[30956]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-09-19T05:13:33.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:33 smithi194 ceph-mon[35228]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-09-19T05:13:35.403 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:35 smithi178 ceph-mon[34347]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-19T05:13:35.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:35 smithi120 ceph-mon[30956]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-19T05:13:35.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:35 smithi194 ceph-mon[35228]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-19T05:13:36.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:36 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T05:13:36.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:36 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:36.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:36 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T05:13:36.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:36 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:36.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:36 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T05:13:36.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:36 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:37.286 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:37 smithi178 ceph-mon[34347]: Deploying daemon osd.4 on smithi178 2024-09-19T05:13:37.286 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:37 smithi178 ceph-mon[34347]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T05:13:37.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:37 smithi120 ceph-mon[30956]: Deploying daemon osd.4 on smithi178 2024-09-19T05:13:37.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:37 smithi120 ceph-mon[30956]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T05:13:37.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:37 smithi194 ceph-mon[35228]: Deploying daemon osd.4 on smithi178 2024-09-19T05:13:37.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:37 smithi194 ceph-mon[35228]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T05:13:39.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:39 smithi120 ceph-mon[30956]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T05:13:39.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:39 smithi194 ceph-mon[35228]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T05:13:39.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:39 smithi178 ceph-mon[34347]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T05:13:41.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:41 smithi120 ceph-mon[30956]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-19T05:13:41.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:41 smithi194 ceph-mon[35228]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-19T05:13:41.691 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:41 smithi178 ceph-mon[34347]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-19T05:13:42.556 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:42 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:42.557 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:42 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:42.557 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:42 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:42.566 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:42 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:42.566 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:42 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:42.566 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:42 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:42.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:42 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:42.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:42 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:42.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:42 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:43.388 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:43 smithi178 ceph-mon[34347]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T05:13:43.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:43 smithi120 ceph-mon[30956]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T05:13:43.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:43 smithi194 ceph-mon[35228]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T05:13:45.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:45 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:45.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:45 smithi178 ceph-mon[34347]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:13:45.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:45 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:45.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:45 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:45.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:45 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:45.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:45 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:45.218 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:45.216+0000 7f2530ff9640 1 -- 172.21.15.178:0/1425719668 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2534062630 con 0x7f251c0a32c0 2024-09-19T05:13:45.218 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 4 on host 'smithi178' 2024-09-19T05:13:45.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:45.218+0000 7f2539e61640 1 -- 172.21.15.178:0/1425719668 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f251c0a32c0 msgr2=0x7f251c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:45.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:45.218+0000 7f2539e61640 1 --2- 172.21.15.178:0/1425719668 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f251c0a32c0 0x7f251c0a5780 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2528006010 tx=0x7f2528000bc0 comp rx=0 tx=0).stop 2024-09-19T05:13:45.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:45.218+0000 7f2539e61640 1 -- 172.21.15.178:0/1425719668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2534100af0 msgr2=0x7f2534196d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:45.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:45.218+0000 7f2539e61640 1 --2- 172.21.15.178:0/1425719668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2534100af0 0x7f2534196d20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f252400e9c0 tx=0x7f252400ee80 comp rx=0 tx=0).stop 2024-09-19T05:13:45.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:45.218+0000 7f2539e61640 1 -- 172.21.15.178:0/1425719668 shutdown_connections 2024-09-19T05:13:45.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:45.218+0000 7f2539e61640 1 --2- 172.21.15.178:0/1425719668 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f251c0a32c0 0x7f251c0a5780 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:45.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:45.218+0000 7f2539e61640 1 --2- 172.21.15.178:0/1425719668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25341026b0 0x7f253419e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:45.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:45.218+0000 7f2539e61640 1 --2- 172.21.15.178:0/1425719668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2534101cf0 0x7f2534197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:45.220 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:45.218+0000 7f2539e61640 1 --2- 172.21.15.178:0/1425719668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2534100af0 0x7f2534196d20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:45.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:45.219+0000 7f2539e61640 1 -- 172.21.15.178:0/1425719668 >> 172.21.15.178:0/1425719668 conn(0x7f25340fc280 msgr2=0x7f2534105160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:13:45.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:45.219+0000 7f2539e61640 1 -- 172.21.15.178:0/1425719668 shutdown_connections 2024-09-19T05:13:45.221 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:13:45.219+0000 7f2539e61640 1 -- 172.21.15.178:0/1425719668 wait complete. 2024-09-19T05:13:45.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:45 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:45.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:45 smithi120 ceph-mon[30956]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:13:45.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:45 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:45.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:45 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:45.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:45 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:45.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:45 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:45.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:45 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:45.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:45 smithi194 ceph-mon[35228]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:13:45.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:45 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:45.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:45 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:45.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:45 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:45.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:45 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:45.848 DEBUG:teuthology.orchestra.run.smithi178:osd.4> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T05:13:45.851 INFO:tasks.cephadm:Deploying osd.5 on smithi194 with /dev/vg_nvme/lv_3... 2024-09-19T05:13:45.851 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T05:13:46.105 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:13:46.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:46 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:46.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:46 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:46.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:46 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:46.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:46 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:46.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:46 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:46.174 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:46 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:46.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:46 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:13:46.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:46 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:46.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:46 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:47.272 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:47 smithi178 ceph-mon[34347]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:13:47.334 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:47 smithi194 ceph-mon[35228]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:13:47.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:47 smithi120 ceph-mon[30956]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:13:47.692 INFO:journalctl@ceph.osd.4.smithi178.stdout:Sep 19 05:13:47 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-4[45618]: 2024-09-19T05:13:47.506+0000 7fadc026a640 -1 osd.4 0 log_to_monitors true 2024-09-19T05:13:48.342 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:48 smithi178 ceph-mon[34347]: from='osd.4 [v2:172.21.15.178:6808/541165323,v1:172.21.15.178:6809/541165323]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T05:13:48.342 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:48 smithi178 ceph-mon[34347]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T05:13:48.363 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:13:48.390 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi194:vg_nvme/lv_3 2024-09-19T05:13:48.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:48 smithi120 ceph-mon[30956]: from='osd.4 [v2:172.21.15.178:6808/541165323,v1:172.21.15.178:6809/541165323]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T05:13:48.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:48 smithi120 ceph-mon[30956]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T05:13:48.633 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:13:48.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:48 smithi194 ceph-mon[35228]: from='osd.4 [v2:172.21.15.178:6808/541165323,v1:172.21.15.178:6809/541165323]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T05:13:48.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:48 smithi194 ceph-mon[35228]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T05:13:49.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.196+0000 7f74543cd640 1 -- 172.21.15.194:0/2316551283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f744c101cd0 msgr2=0x7f744c102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:49.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.196+0000 7f74543cd640 1 --2- 172.21.15.194:0/2316551283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f744c101cd0 0x7f744c102150 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f743c009900 tx=0x7f743c02a410 comp rx=0 tx=0).stop 2024-09-19T05:13:49.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.196+0000 7f74543cd640 1 -- 172.21.15.194:0/2316551283 shutdown_connections 2024-09-19T05:13:49.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.196+0000 7f74543cd640 1 --2- 172.21.15.194:0/2316551283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f744c102690 0x7f744c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:49.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.196+0000 7f74543cd640 1 --2- 172.21.15.194:0/2316551283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f744c101cd0 0x7f744c102150 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:49.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.196+0000 7f74543cd640 1 --2- 172.21.15.194:0/2316551283 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f744c100ad0 0x7f744c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:49.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.196+0000 7f74543cd640 1 -- 172.21.15.194:0/2316551283 >> 172.21.15.194:0/2316551283 conn(0x7f744c0fc280 msgr2=0x7f744c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:13:49.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.196+0000 7f74543cd640 1 -- 172.21.15.194:0/2316551283 shutdown_connections 2024-09-19T05:13:49.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.196+0000 7f74543cd640 1 -- 172.21.15.194:0/2316551283 wait complete. 2024-09-19T05:13:49.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.197+0000 7f74543cd640 1 Processor -- start 2024-09-19T05:13:49.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.197+0000 7f74543cd640 1 -- start start 2024-09-19T05:13:49.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.197+0000 7f74543cd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f744c100ad0 0x7f744c197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:49.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.197+0000 7f74543cd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f744c101cd0 0x7f744c198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:49.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.197+0000 7f74543cd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f744c102690 0x7f744c19f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:49.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.197+0000 7f74543cd640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f744c10d790 con 0x7f744c102690 2024-09-19T05:13:49.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.197+0000 7f74543cd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f744c10d610 con 0x7f744c101cd0 2024-09-19T05:13:49.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.197+0000 7f74543cd640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f744c10d910 con 0x7f744c100ad0 2024-09-19T05:13:49.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.197+0000 7f7452169640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f744c100ad0 0x7f744c197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:49.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.197+0000 7f7452169640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f744c100ad0 0x7f744c197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51190/0 (socket says 172.21.15.194:51190) 2024-09-19T05:13:49.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.197+0000 7f7452169640 1 -- 172.21.15.194:0/2279171552 learned_addr learned my addr 172.21.15.194:0/2279171552 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T05:13:49.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.197+0000 7f745296a640 1 --2- 172.21.15.194:0/2279171552 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f744c102690 0x7f744c19f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:49.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.197+0000 7f7451968640 1 --2- 172.21.15.194:0/2279171552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f744c101cd0 0x7f744c198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:49.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.197+0000 7f7452169640 1 -- 172.21.15.194:0/2279171552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f744c101cd0 msgr2=0x7f744c198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:49.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.197+0000 7f7452169640 1 --2- 172.21.15.194:0/2279171552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f744c101cd0 0x7f744c198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:49.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.197+0000 7f7452169640 1 -- 172.21.15.194:0/2279171552 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f744c102690 msgr2=0x7f744c19f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:13:49.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.197+0000 7f7452169640 1 --2- 172.21.15.194:0/2279171552 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f744c102690 0x7f744c19f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:13:49.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.197+0000 7f7452169640 1 -- 172.21.15.194:0/2279171552 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f744c19fa40 con 0x7f744c100ad0 2024-09-19T05:13:49.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.198+0000 7f7452169640 1 --2- 172.21.15.194:0/2279171552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f744c100ad0 0x7f744c197e10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f744800d770 tx=0x7f744800dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:13:49.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.198+0000 7f74437fe640 1 -- 172.21.15.194:0/2279171552 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7448017070 con 0x7f744c100ad0 2024-09-19T05:13:49.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.198+0000 7f74437fe640 1 -- 172.21.15.194:0/2279171552 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7448009c30 con 0x7f744c100ad0 2024-09-19T05:13:49.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.198+0000 7f74543cd640 1 -- 172.21.15.194:0/2279171552 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f744c19fd30 con 0x7f744c100ad0 2024-09-19T05:13:49.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.198+0000 7f74437fe640 1 -- 172.21.15.194:0/2279171552 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7448003d00 con 0x7f744c100ad0 2024-09-19T05:13:49.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.198+0000 7f74543cd640 1 -- 172.21.15.194:0/2279171552 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f744c1a0190 con 0x7f744c100ad0 2024-09-19T05:13:49.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.199+0000 7f74543cd640 1 -- 172.21.15.194:0/2279171552 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f744c107f70 con 0x7f744c100ad0 2024-09-19T05:13:49.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.200+0000 7f74437fe640 1 -- 172.21.15.194:0/2279171552 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f7448003ea0 con 0x7f744c100ad0 2024-09-19T05:13:49.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.200+0000 7f74437fe640 1 --2- 172.21.15.194:0/2279171552 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f74380a3270 0x7f74380a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:13:49.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.201+0000 7f74437fe640 1 -- 172.21.15.194:0/2279171552 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3805+0+0 (secure 0 0 0) 0x7f74480ce0d0 con 0x7f744c100ad0 2024-09-19T05:13:49.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.201+0000 7f7451968640 1 --2- 172.21.15.194:0/2279171552 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f74380a3270 0x7f74380a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:13:49.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.201+0000 7f7451968640 1 --2- 172.21.15.194:0/2279171552 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f74380a3270 0x7f74380a5730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f743c000c00 tx=0x7f743c0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:13:49.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.205+0000 7f74437fe640 1 -- 172.21.15.194:0/2279171552 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f744809bf90 con 0x7f744c100ad0 2024-09-19T05:13:49.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:13:49.381+0000 7f74543cd640 1 -- 172.21.15.194:0/2279171552 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f744c062630 con 0x7f74380a3270 2024-09-19T05:13:49.383 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:49 smithi194 ceph-mon[35228]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:13:49.383 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:49 smithi194 ceph-mon[35228]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T05:13:49.383 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:49 smithi194 ceph-mon[35228]: from='osd.4 [v2:172.21.15.178:6808/541165323,v1:172.21.15.178:6809/541165323]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-09-19T05:13:49.383 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:49 smithi194 ceph-mon[35228]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T05:13:49.383 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:49 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:13:49.383 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:49 smithi194 ceph-mon[35228]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-09-19T05:13:49.384 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:49 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:49.384 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:49 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:49.384 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:49 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:13:49.384 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:49 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:13:49.384 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:49 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:49.384 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:49 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:49.384 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:49 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:49.384 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:49 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:49.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:49 smithi120 ceph-mon[30956]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:13:49.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:49 smithi120 ceph-mon[30956]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T05:13:49.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:49 smithi120 ceph-mon[30956]: from='osd.4 [v2:172.21.15.178:6808/541165323,v1:172.21.15.178:6809/541165323]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-09-19T05:13:49.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:49 smithi120 ceph-mon[30956]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T05:13:49.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:49 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:13:49.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:49 smithi120 ceph-mon[30956]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-09-19T05:13:49.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:49 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:49.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:49 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:49.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:49 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:13:49.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:49 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:13:49.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:49 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:49.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:49 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:49.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:49 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:49.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:49 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:49.692 INFO:journalctl@ceph.osd.4.smithi178.stdout:Sep 19 05:13:49 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-4[45618]: 2024-09-19T05:13:49.237+0000 7fadbb9ca640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T05:13:49.692 INFO:journalctl@ceph.osd.4.smithi178.stdout:Sep 19 05:13:49 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-4[45618]: 2024-09-19T05:13:49.249+0000 7fadb8004640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:13:49.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:49 smithi178 ceph-mon[34347]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:13:49.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:49 smithi178 ceph-mon[34347]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T05:13:49.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:49 smithi178 ceph-mon[34347]: from='osd.4 [v2:172.21.15.178:6808/541165323,v1:172.21.15.178:6809/541165323]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-09-19T05:13:49.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:49 smithi178 ceph-mon[34347]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T05:13:49.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:49 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:13:49.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:49 smithi178 ceph-mon[34347]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-09-19T05:13:49.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:49 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:49.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:49 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:49.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:49 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:13:49.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:49 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:13:49.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:49 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:49.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:49 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:49.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:49 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:13:49.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:49 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:13:50.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:50 smithi194 ceph-mon[35228]: Detected new or changed devices on smithi178 2024-09-19T05:13:50.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:50 smithi194 ceph-mon[35228]: Adjusting osd_memory_target on smithi178 to 8544M 2024-09-19T05:13:50.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:50 smithi194 ceph-mon[35228]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-09-19T05:13:50.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:50 smithi194 ceph-mon[35228]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T05:13:50.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:50 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:13:50.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:50 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:13:50.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:50 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:13:50.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:50 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:13:50.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:50 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:50.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:50 smithi120 ceph-mon[30956]: Detected new or changed devices on smithi178 2024-09-19T05:13:50.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:50 smithi120 ceph-mon[30956]: Adjusting osd_memory_target on smithi178 to 8544M 2024-09-19T05:13:50.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:50 smithi120 ceph-mon[30956]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-09-19T05:13:50.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:50 smithi120 ceph-mon[30956]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T05:13:50.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:50 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:13:50.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:50 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:13:50.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:50 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:13:50.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:50 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:13:50.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:50 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:50.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:50 smithi178 ceph-mon[34347]: Detected new or changed devices on smithi178 2024-09-19T05:13:50.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:50 smithi178 ceph-mon[34347]: Adjusting osd_memory_target on smithi178 to 8544M 2024-09-19T05:13:50.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:50 smithi178 ceph-mon[34347]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-09-19T05:13:50.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:50 smithi178 ceph-mon[34347]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T05:13:50.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:50 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:13:50.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:50 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:13:50.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:50 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:13:50.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:50 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:13:50.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:50 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:13:51.356 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:51 smithi194 ceph-mon[35228]: purged_snaps scrub starts 2024-09-19T05:13:51.356 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:51 smithi194 ceph-mon[35228]: purged_snaps scrub ok 2024-09-19T05:13:51.356 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:51 smithi194 ceph-mon[35228]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:13:51.356 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:51 smithi194 ceph-mon[35228]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:13:51.356 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:51 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:13:51.356 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:51 smithi194 ceph-mon[35228]: osd.4 [v2:172.21.15.178:6808/541165323,v1:172.21.15.178:6809/541165323] boot 2024-09-19T05:13:51.356 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:51 smithi194 ceph-mon[35228]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T05:13:51.356 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:51 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:13:51.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:51 smithi120 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T05:13:51.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:51 smithi120 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T05:13:51.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:51 smithi120 ceph-mon[30956]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:13:51.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:51 smithi120 ceph-mon[30956]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:13:51.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:51 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:13:51.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:51 smithi120 ceph-mon[30956]: osd.4 [v2:172.21.15.178:6808/541165323,v1:172.21.15.178:6809/541165323] boot 2024-09-19T05:13:51.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:51 smithi120 ceph-mon[30956]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T05:13:51.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:51 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:13:51.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:51 smithi178 ceph-mon[34347]: purged_snaps scrub starts 2024-09-19T05:13:51.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:51 smithi178 ceph-mon[34347]: purged_snaps scrub ok 2024-09-19T05:13:51.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:51 smithi178 ceph-mon[34347]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:13:51.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:51 smithi178 ceph-mon[34347]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-09-19T05:13:51.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:51 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:13:51.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:51 smithi178 ceph-mon[34347]: osd.4 [v2:172.21.15.178:6808/541165323,v1:172.21.15.178:6809/541165323] boot 2024-09-19T05:13:51.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:51 smithi178 ceph-mon[34347]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T05:13:51.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:51 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:13:52.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:52 smithi120 ceph-mon[30956]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T05:13:52.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:52 smithi120 ceph-mon[30956]: from='client.? 172.21.15.194:0/3362567837' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f1c394b-e510-411f-969a-2db2b68cf41a"}]: dispatch 2024-09-19T05:13:52.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:52 smithi120 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f1c394b-e510-411f-969a-2db2b68cf41a"}]: dispatch 2024-09-19T05:13:52.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:52 smithi120 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f1c394b-e510-411f-969a-2db2b68cf41a"}]': finished 2024-09-19T05:13:52.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:52 smithi120 ceph-mon[30956]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T05:13:52.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:52 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:13:52.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:52 smithi120 ceph-mon[30956]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:13:52.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:52 smithi120 ceph-mon[30956]: from='client.? 172.21.15.194:0/3473925478' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:13:52.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:52 smithi194 ceph-mon[35228]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T05:13:52.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:52 smithi194 ceph-mon[35228]: from='client.? 172.21.15.194:0/3362567837' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f1c394b-e510-411f-969a-2db2b68cf41a"}]: dispatch 2024-09-19T05:13:52.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:52 smithi194 ceph-mon[35228]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f1c394b-e510-411f-969a-2db2b68cf41a"}]: dispatch 2024-09-19T05:13:52.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:52 smithi194 ceph-mon[35228]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f1c394b-e510-411f-969a-2db2b68cf41a"}]': finished 2024-09-19T05:13:52.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:52 smithi194 ceph-mon[35228]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T05:13:52.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:52 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:13:52.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:52 smithi194 ceph-mon[35228]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:13:52.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:52 smithi194 ceph-mon[35228]: from='client.? 172.21.15.194:0/3473925478' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:13:52.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:52 smithi178 ceph-mon[34347]: osdmap e33: 5 total, 5 up, 5 in 2024-09-19T05:13:52.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:52 smithi178 ceph-mon[34347]: from='client.? 172.21.15.194:0/3362567837' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f1c394b-e510-411f-969a-2db2b68cf41a"}]: dispatch 2024-09-19T05:13:52.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:52 smithi178 ceph-mon[34347]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f1c394b-e510-411f-969a-2db2b68cf41a"}]: dispatch 2024-09-19T05:13:52.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:52 smithi178 ceph-mon[34347]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f1c394b-e510-411f-969a-2db2b68cf41a"}]': finished 2024-09-19T05:13:52.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:52 smithi178 ceph-mon[34347]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T05:13:52.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:52 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:13:52.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:52 smithi178 ceph-mon[34347]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:13:52.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:52 smithi178 ceph-mon[34347]: from='client.? 172.21.15.194:0/3473925478' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:13:55.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:55 smithi120 ceph-mon[30956]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:13:55.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:55 smithi194 ceph-mon[35228]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:13:55.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:55 smithi178 ceph-mon[34347]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:13:57.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:57 smithi120 ceph-mon[30956]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:13:57.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:57 smithi194 ceph-mon[35228]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:13:57.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:57 smithi178 ceph-mon[34347]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:13:59.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:13:59 smithi120 ceph-mon[30956]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:13:59.388 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:13:59 smithi194 ceph-mon[35228]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:13:59.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:13:59 smithi178 ceph-mon[34347]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:14:00.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:00 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T05:14:00.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:00 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:00.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:00 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T05:14:00.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:00 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:00.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:00 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T05:14:00.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:00 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:01.387 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:01 smithi194 ceph-mon[35228]: Deploying daemon osd.5 on smithi194 2024-09-19T05:14:01.387 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:01 smithi194 ceph-mon[35228]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:14:01.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:01 smithi178 ceph-mon[34347]: Deploying daemon osd.5 on smithi194 2024-09-19T05:14:01.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:01 smithi178 ceph-mon[34347]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:14:01.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:01 smithi120 ceph-mon[30956]: Deploying daemon osd.5 on smithi194 2024-09-19T05:14:01.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:01 smithi120 ceph-mon[30956]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:14:03.401 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:03 smithi194 ceph-mon[35228]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:14:03.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:03 smithi178 ceph-mon[34347]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:14:03.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:03 smithi120 ceph-mon[30956]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:14:05.226 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:05 smithi194 ceph-mon[35228]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:14:05.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:05 smithi178 ceph-mon[34347]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:14:05.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:05 smithi120 ceph-mon[30956]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:14:07.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:07 smithi194 ceph-mon[35228]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:14:07.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:07 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:07.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:07 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:07.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:07 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:07.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:07 smithi178 ceph-mon[34347]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:14:07.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:07 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:07.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:07 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:07.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:07 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:07.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:07 smithi120 ceph-mon[30956]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:14:07.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:07 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:07.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:07 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:07.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:07 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:09.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:09 smithi194 ceph-mon[35228]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:14:09.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:09 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:09.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:09 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:09.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:09 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:09.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:09 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:09.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:09 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:09.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:09 smithi178 ceph-mon[34347]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:14:09.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:09 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:09.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:09 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:09.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:09 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:09.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:09 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:09.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:09 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:09.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:09 smithi120 ceph-mon[30956]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:14:09.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:09 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:09.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:09 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:09.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:09 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:09.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:09 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:09.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:09 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:09.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:14:09.932+0000 7f74437fe640 1 -- 172.21.15.194:0/2279171552 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f744c062630 con 0x7f74380a3270 2024-09-19T05:14:09.934 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 5 on host 'smithi194' 2024-09-19T05:14:09.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:14:09.935+0000 7f74543cd640 1 -- 172.21.15.194:0/2279171552 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f74380a3270 msgr2=0x7f74380a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:14:09.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:14:09.935+0000 7f74543cd640 1 --2- 172.21.15.194:0/2279171552 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f74380a3270 0x7f74380a5730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f743c000c00 tx=0x7f743c0314a0 comp rx=0 tx=0).stop 2024-09-19T05:14:09.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:14:09.935+0000 7f74543cd640 1 -- 172.21.15.194:0/2279171552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f744c100ad0 msgr2=0x7f744c197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:14:09.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:14:09.935+0000 7f74543cd640 1 --2- 172.21.15.194:0/2279171552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f744c100ad0 0x7f744c197e10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f744800d770 tx=0x7f744800dc30 comp rx=0 tx=0).stop 2024-09-19T05:14:09.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:14:09.935+0000 7f74543cd640 1 -- 172.21.15.194:0/2279171552 shutdown_connections 2024-09-19T05:14:09.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:14:09.935+0000 7f74543cd640 1 --2- 172.21.15.194:0/2279171552 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f744c102690 0x7f744c19f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:09.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:14:09.935+0000 7f74543cd640 1 --2- 172.21.15.194:0/2279171552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f744c101cd0 0x7f744c198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:09.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:14:09.935+0000 7f74543cd640 1 --2- 172.21.15.194:0/2279171552 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f74380a3270 0x7f74380a5730 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:09.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:14:09.935+0000 7f74543cd640 1 --2- 172.21.15.194:0/2279171552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f744c100ad0 0x7f744c197e10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:09.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:14:09.935+0000 7f74543cd640 1 -- 172.21.15.194:0/2279171552 >> 172.21.15.194:0/2279171552 conn(0x7f744c0fc280 msgr2=0x7f744c105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:14:09.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:14:09.935+0000 7f74543cd640 1 -- 172.21.15.194:0/2279171552 shutdown_connections 2024-09-19T05:14:09.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:14:09.935+0000 7f74543cd640 1 -- 172.21.15.194:0/2279171552 wait complete. 2024-09-19T05:14:10.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:10 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:10.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:10 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:10.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:10 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:10.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:10 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:10.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:10 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:10.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:10 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:10.513 DEBUG:teuthology.orchestra.run.smithi194:osd.5> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T05:14:10.515 INFO:tasks.cephadm:Deploying osd.6 on smithi120 with /dev/vg_nvme/lv_2... 2024-09-19T05:14:10.515 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T05:14:10.543 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:10 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:10.544 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:10 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:10.544 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:10 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:10.769 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:14:11.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:11 smithi194 ceph-mon[35228]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:14:11.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:11 smithi178 ceph-mon[34347]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:14:11.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:11 smithi120 ceph-mon[30956]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:14:12.705 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:14:12 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:14:12.471+0000 7f6561429640 -1 osd.5 0 log_to_monitors true 2024-09-19T05:14:13.231 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:13 smithi120 ceph-mon[30956]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:14:13.231 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:13 smithi120 ceph-mon[30956]: from='osd.5 [v2:172.21.15.194:6808/2631415468,v1:172.21.15.194:6809/2631415468]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T05:14:13.231 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:13 smithi120 ceph-mon[30956]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T05:14:13.232 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:13 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:13.232 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:13 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:13.232 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:13 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:14:13.232 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:13 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:14:13.232 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:13 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:13.232 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:13 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:13.232 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:13 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:13.232 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:13 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:13.234 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:14:13.259 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi120:vg_nvme/lv_2 2024-09-19T05:14:13.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:13 smithi194 ceph-mon[35228]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:14:13.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:13 smithi194 ceph-mon[35228]: from='osd.5 [v2:172.21.15.194:6808/2631415468,v1:172.21.15.194:6809/2631415468]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T05:14:13.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:13 smithi194 ceph-mon[35228]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T05:14:13.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:13 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:13.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:13 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:13.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:13 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:14:13.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:13 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:14:13.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:13 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:13.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:13 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:13.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:13 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:13.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:13 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:13.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:13 smithi178 ceph-mon[34347]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:14:13.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:13 smithi178 ceph-mon[34347]: from='osd.5 [v2:172.21.15.194:6808/2631415468,v1:172.21.15.194:6809/2631415468]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T05:14:13.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:13 smithi178 ceph-mon[34347]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T05:14:13.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:13 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:13.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:13 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:13.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:13 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:14:13.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:13 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:14:13.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:13 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:13.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:13 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:13.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:13 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:13.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:13 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:13.555 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:14:14.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.068+0000 7f7f84684640 1 -- 172.21.15.120:0/2093229744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f7c100ad0 msgr2=0x7f7f7c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:14:14.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.068+0000 7f7f84684640 1 --2- 172.21.15.120:0/2093229744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f7c100ad0 0x7f7f7c100ed0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7f78009900 tx=0x7f7f7802a410 comp rx=0 tx=0).stop 2024-09-19T05:14:14.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.068+0000 7f7f84684640 1 -- 172.21.15.120:0/2093229744 shutdown_connections 2024-09-19T05:14:14.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.068+0000 7f7f84684640 1 --2- 172.21.15.120:0/2093229744 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f7c102690 0x7f7f7c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:14.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.068+0000 7f7f84684640 1 --2- 172.21.15.120:0/2093229744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f7c101cd0 0x7f7f7c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:14.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.068+0000 7f7f84684640 1 --2- 172.21.15.120:0/2093229744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f7c100ad0 0x7f7f7c100ed0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:14.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.068+0000 7f7f84684640 1 -- 172.21.15.120:0/2093229744 >> 172.21.15.120:0/2093229744 conn(0x7f7f7c0fc280 msgr2=0x7f7f7c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:14:14.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.068+0000 7f7f84684640 1 -- 172.21.15.120:0/2093229744 shutdown_connections 2024-09-19T05:14:14.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.068+0000 7f7f84684640 1 -- 172.21.15.120:0/2093229744 wait complete. 2024-09-19T05:14:14.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.069+0000 7f7f84684640 1 Processor -- start 2024-09-19T05:14:14.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.069+0000 7f7f84684640 1 -- start start 2024-09-19T05:14:14.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.069+0000 7f7f84684640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f7c100ad0 0x7f7f7c196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:14:14.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.069+0000 7f7f84684640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f7c101cd0 0x7f7f7c1973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:14:14.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.069+0000 7f7f84684640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f7c102690 0x7f7f7c19e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:14:14.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.069+0000 7f7f84684640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c10c6e0 con 0x7f7f7c100ad0 2024-09-19T05:14:14.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.069+0000 7f7f84684640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c10c560 con 0x7f7f7c101cd0 2024-09-19T05:14:14.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.069+0000 7f7f84684640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7f7c10c860 con 0x7f7f7c102690 2024-09-19T05:14:14.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.069+0000 7f7f82420640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f7c100ad0 0x7f7f7c196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:14:14.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.069+0000 7f7f82420640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f7c100ad0 0x7f7f7c196e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49722/0 (socket says 172.21.15.120:49722) 2024-09-19T05:14:14.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.069+0000 7f7f82420640 1 -- 172.21.15.120:0/1309352970 learned_addr learned my addr 172.21.15.120:0/1309352970 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:14:14.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.070+0000 7f7f82c21640 1 --2- 172.21.15.120:0/1309352970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f7c102690 0x7f7f7c19e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:14:14.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.070+0000 7f7f81c1f640 1 --2- 172.21.15.120:0/1309352970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f7c101cd0 0x7f7f7c1973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:14:14.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.070+0000 7f7f82420640 1 -- 172.21.15.120:0/1309352970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f7c102690 msgr2=0x7f7f7c19e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:14:14.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.070+0000 7f7f82420640 1 --2- 172.21.15.120:0/1309352970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f7c102690 0x7f7f7c19e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:14.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.070+0000 7f7f82420640 1 -- 172.21.15.120:0/1309352970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f7c101cd0 msgr2=0x7f7f7c1973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:14:14.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.070+0000 7f7f82420640 1 --2- 172.21.15.120:0/1309352970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f7c101cd0 0x7f7f7c1973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:14.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.070+0000 7f7f82420640 1 -- 172.21.15.120:0/1309352970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f7c19eaa0 con 0x7f7f7c100ad0 2024-09-19T05:14:14.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.070+0000 7f7f81c1f640 1 --2- 172.21.15.120:0/1309352970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f7c101cd0 0x7f7f7c1973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:14:14.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.070+0000 7f7f82420640 1 --2- 172.21.15.120:0/1309352970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f7c100ad0 0x7f7f7c196e70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7f78009230 tx=0x7f7f78004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:14:14.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.070+0000 7f7f737fe640 1 -- 172.21.15.120:0/1309352970 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7803f030 con 0x7f7f7c100ad0 2024-09-19T05:14:14.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.070+0000 7f7f84684640 1 -- 172.21.15.120:0/1309352970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f7c19ed30 con 0x7f7f7c100ad0 2024-09-19T05:14:14.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.070+0000 7f7f737fe640 1 -- 172.21.15.120:0/1309352970 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7f78003cb0 con 0x7f7f7c100ad0 2024-09-19T05:14:14.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.070+0000 7f7f737fe640 1 -- 172.21.15.120:0/1309352970 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f78035070 con 0x7f7f7c100ad0 2024-09-19T05:14:14.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.070+0000 7f7f84684640 1 -- 172.21.15.120:0/1309352970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f7c19f1c0 con 0x7f7f7c100ad0 2024-09-19T05:14:14.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.071+0000 7f7f84684640 1 -- 172.21.15.120:0/1309352970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f7c108010 con 0x7f7f7c100ad0 2024-09-19T05:14:14.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.072+0000 7f7f737fe640 1 -- 172.21.15.120:0/1309352970 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f7f78042030 con 0x7f7f7c100ad0 2024-09-19T05:14:14.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.073+0000 7f7f737fe640 1 --2- 172.21.15.120:0/1309352970 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f7f680a3270 0x7f7f680a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:14:14.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.073+0000 7f7f81c1f640 1 --2- 172.21.15.120:0/1309352970 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f7f680a3270 0x7f7f680a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:14:14.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.073+0000 7f7f737fe640 1 -- 172.21.15.120:0/1309352970 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4237+0+0 (secure 0 0 0) 0x7f7f780ef100 con 0x7f7f7c100ad0 2024-09-19T05:14:14.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.074+0000 7f7f81c1f640 1 --2- 172.21.15.120:0/1309352970 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f7f680a3270 0x7f7f680a5730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c198390 tx=0x7f7f6c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:14:14.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.077+0000 7f7f737fe640 1 -- 172.21.15.120:0/1309352970 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7f780bcd70 con 0x7f7f7c100ad0 2024-09-19T05:14:14.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:14.262+0000 7f7f84684640 1 -- 172.21.15.120:0/1309352970 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f7f7c062630 con 0x7f7f680a3270 2024-09-19T05:14:14.372 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:14 smithi120 ceph-mon[30956]: Detected new or changed devices on smithi194 2024-09-19T05:14:14.372 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:14 smithi120 ceph-mon[30956]: Adjusting osd_memory_target on smithi194 to 8544M 2024-09-19T05:14:14.372 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:14 smithi120 ceph-mon[30956]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T05:14:14.372 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:14 smithi120 ceph-mon[30956]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T05:14:14.372 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:14 smithi120 ceph-mon[30956]: from='osd.5 [v2:172.21.15.194:6808/2631415468,v1:172.21.15.194:6809/2631415468]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-19T05:14:14.372 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:14 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:14:14.372 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:14 smithi120 ceph-mon[30956]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-19T05:14:14.372 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:14 smithi120 ceph-mon[30956]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-19T05:14:14.373 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:14 smithi120 ceph-mon[30956]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T05:14:14.373 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:14 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:14:14.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:14 smithi194 ceph-mon[35228]: Detected new or changed devices on smithi194 2024-09-19T05:14:14.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:14 smithi194 ceph-mon[35228]: Adjusting osd_memory_target on smithi194 to 8544M 2024-09-19T05:14:14.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:14 smithi194 ceph-mon[35228]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T05:14:14.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:14 smithi194 ceph-mon[35228]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T05:14:14.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:14 smithi194 ceph-mon[35228]: from='osd.5 [v2:172.21.15.194:6808/2631415468,v1:172.21.15.194:6809/2631415468]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-19T05:14:14.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:14 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:14:14.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:14 smithi194 ceph-mon[35228]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-19T05:14:14.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:14 smithi194 ceph-mon[35228]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-19T05:14:14.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:14 smithi194 ceph-mon[35228]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T05:14:14.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:14 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:14:14.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:14 smithi178 ceph-mon[34347]: Detected new or changed devices on smithi194 2024-09-19T05:14:14.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:14 smithi178 ceph-mon[34347]: Adjusting osd_memory_target on smithi194 to 8544M 2024-09-19T05:14:14.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:14 smithi178 ceph-mon[34347]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T05:14:14.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:14 smithi178 ceph-mon[34347]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T05:14:14.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:14 smithi178 ceph-mon[34347]: from='osd.5 [v2:172.21.15.194:6808/2631415468,v1:172.21.15.194:6809/2631415468]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-19T05:14:14.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:14 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:14:14.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:14 smithi178 ceph-mon[34347]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-19T05:14:14.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:14 smithi178 ceph-mon[34347]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-19T05:14:14.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:14 smithi178 ceph-mon[34347]: osdmap e36: 6 total, 5 up, 6 in 2024-09-19T05:14:14.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:14 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:14:15.350 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:15 smithi120 ceph-mon[30956]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:14:15.527 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:15 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:14:15.527 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:15 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:14:15.527 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:15 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:14:15.527 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:15 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:15.527 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:15 smithi120 ceph-mon[30956]: from='osd.5 ' entity='osd.5' 2024-09-19T05:14:15.528 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:15 smithi120 ceph-mon[30956]: osd.5 [v2:172.21.15.194:6808/2631415468,v1:172.21.15.194:6809/2631415468] boot 2024-09-19T05:14:15.528 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:15 smithi120 ceph-mon[30956]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T05:14:15.528 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:15 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:14:15.529 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:15 smithi178 ceph-mon[34347]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:14:15.529 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:15 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:14:15.529 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:15 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:14:15.529 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:15 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:14:15.529 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:15 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:15.529 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:15 smithi178 ceph-mon[34347]: from='osd.5 ' entity='osd.5' 2024-09-19T05:14:15.529 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:15 smithi178 ceph-mon[34347]: osd.5 [v2:172.21.15.194:6808/2631415468,v1:172.21.15.194:6809/2631415468] boot 2024-09-19T05:14:15.529 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:15 smithi178 ceph-mon[34347]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T05:14:15.529 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:15 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:14:15.529 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:14:14 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:14:14.909+0000 7f655dbc0640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T05:14:15.529 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:14:14 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:14:14.918+0000 7f65551bb640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:14:15.530 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:15 smithi194 ceph-mon[35228]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-19T05:14:15.530 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:15 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:14:15.530 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:15 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:14:15.530 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:15 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:14:15.530 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:15 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:15.530 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:15 smithi194 ceph-mon[35228]: from='osd.5 ' entity='osd.5' 2024-09-19T05:14:15.530 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:15 smithi194 ceph-mon[35228]: osd.5 [v2:172.21.15.194:6808/2631415468,v1:172.21.15.194:6809/2631415468] boot 2024-09-19T05:14:15.530 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:15 smithi194 ceph-mon[35228]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T05:14:15.530 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:15 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:14:16.293 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:16 smithi120 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T05:14:16.293 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:16 smithi120 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T05:14:16.293 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:16 smithi120 ceph-mon[30956]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:14:16.293 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:16 smithi120 ceph-mon[30956]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T05:14:16.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:16 smithi194 ceph-mon[35228]: purged_snaps scrub starts 2024-09-19T05:14:16.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:16 smithi194 ceph-mon[35228]: purged_snaps scrub ok 2024-09-19T05:14:16.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:16 smithi194 ceph-mon[35228]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:14:16.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:16 smithi194 ceph-mon[35228]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T05:14:16.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:16 smithi178 ceph-mon[34347]: purged_snaps scrub starts 2024-09-19T05:14:16.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:16 smithi178 ceph-mon[34347]: purged_snaps scrub ok 2024-09-19T05:14:16.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:16 smithi178 ceph-mon[34347]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:14:16.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:16 smithi178 ceph-mon[34347]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T05:14:17.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:17 smithi178 ceph-mon[34347]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 538 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:14:17.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:17 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/2376093989' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "990af639-099e-49df-a083-05626cee3c3b"}]: dispatch 2024-09-19T05:14:17.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:17 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/2376093989' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "990af639-099e-49df-a083-05626cee3c3b"}]': finished 2024-09-19T05:14:17.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:17 smithi178 ceph-mon[34347]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T05:14:17.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:17 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:14:17.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:17 smithi120 ceph-mon[30956]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 538 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:14:17.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:17 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2376093989' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "990af639-099e-49df-a083-05626cee3c3b"}]: dispatch 2024-09-19T05:14:17.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:17 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2376093989' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "990af639-099e-49df-a083-05626cee3c3b"}]': finished 2024-09-19T05:14:17.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:17 smithi120 ceph-mon[30956]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T05:14:17.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:17 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:14:17.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:17 smithi194 ceph-mon[35228]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 538 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:14:17.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:17 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/2376093989' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "990af639-099e-49df-a083-05626cee3c3b"}]: dispatch 2024-09-19T05:14:17.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:17 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/2376093989' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "990af639-099e-49df-a083-05626cee3c3b"}]': finished 2024-09-19T05:14:17.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:17 smithi194 ceph-mon[35228]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T05:14:17.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:17 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:14:18.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:18 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/2964290410' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:14:18.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:18 smithi178 ceph-mon[34347]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T05:14:18.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:18 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:14:18.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:18 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2964290410' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:14:18.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:18 smithi120 ceph-mon[30956]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T05:14:18.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:18 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:14:18.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:18 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/2964290410' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:14:18.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:18 smithi194 ceph-mon[35228]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T05:14:18.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:18 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:14:19.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:19 smithi178 ceph-mon[34347]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 538 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:14:19.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:19 smithi178 ceph-mon[34347]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T05:14:19.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:19 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:14:19.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:19 smithi120 ceph-mon[30956]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 538 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:14:19.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:19 smithi120 ceph-mon[30956]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T05:14:19.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:19 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:14:19.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:19 smithi194 ceph-mon[35228]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 538 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:14:19.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:19 smithi194 ceph-mon[35228]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T05:14:19.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:19 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:14:21.421 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:21 smithi120 ceph-mon[30956]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 538 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:14:21.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:21 smithi178 ceph-mon[34347]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 538 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:14:21.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:21 smithi194 ceph-mon[35228]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 538 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:14:23.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:23 smithi178 ceph-mon[34347]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T05:14:23.582 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:23 smithi120 ceph-mon[30956]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T05:14:23.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:23 smithi194 ceph-mon[35228]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T05:14:25.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:25 smithi120 ceph-mon[30956]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-19T05:14:25.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:25 smithi178 ceph-mon[34347]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-19T05:14:25.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:25 smithi194 ceph-mon[35228]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-19T05:14:26.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:26 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T05:14:26.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:26 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:26.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:26 smithi178 ceph-mon[34347]: Deploying daemon osd.6 on smithi120 2024-09-19T05:14:26.557 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:26 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T05:14:26.557 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:26 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:26.557 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:26 smithi120 ceph-mon[30956]: Deploying daemon osd.6 on smithi120 2024-09-19T05:14:26.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:26 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T05:14:26.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:26 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:26.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:26 smithi194 ceph-mon[35228]: Deploying daemon osd.6 on smithi120 2024-09-19T05:14:27.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:27 smithi120 ceph-mon[30956]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T05:14:27.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:27 smithi178 ceph-mon[34347]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T05:14:27.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:27 smithi194 ceph-mon[35228]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-19T05:14:29.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:29 smithi178 ceph-mon[34347]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T05:14:29.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:29 smithi120 ceph-mon[30956]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T05:14:29.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:29 smithi194 ceph-mon[35228]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T05:14:31.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:31 smithi178 ceph-mon[34347]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T05:14:31.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:31 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:31.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:31 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:31.599 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:31 smithi120 ceph-mon[30956]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T05:14:31.600 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:31 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:31.600 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:31 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:31.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:31 smithi194 ceph-mon[35228]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-19T05:14:31.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:31 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:31.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:31 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:32.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:32 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:32.455 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:32 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:32.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:32 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:33.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:33 smithi120 ceph-mon[30956]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T05:14:33.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:33 smithi178 ceph-mon[34347]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T05:14:33.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:33 smithi194 ceph-mon[35228]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T05:14:34.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:34.698+0000 7f7f737fe640 1 -- 172.21.15.120:0/1309352970 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7f7c062630 con 0x7f7f680a3270 2024-09-19T05:14:34.700 INFO:teuthology.orchestra.run.smithi120.stdout:Created osd(s) 6 on host 'smithi120' 2024-09-19T05:14:34.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:34.700+0000 7f7f84684640 1 -- 172.21.15.120:0/1309352970 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f7f680a3270 msgr2=0x7f7f680a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:14:34.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:34.700+0000 7f7f84684640 1 --2- 172.21.15.120:0/1309352970 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f7f680a3270 0x7f7f680a5730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c198390 tx=0x7f7f6c008040 comp rx=0 tx=0).stop 2024-09-19T05:14:34.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:34.700+0000 7f7f84684640 1 -- 172.21.15.120:0/1309352970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f7c100ad0 msgr2=0x7f7f7c196e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:14:34.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:34.700+0000 7f7f84684640 1 --2- 172.21.15.120:0/1309352970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f7c100ad0 0x7f7f7c196e70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7f78009230 tx=0x7f7f78004340 comp rx=0 tx=0).stop 2024-09-19T05:14:34.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:34.700+0000 7f7f84684640 1 -- 172.21.15.120:0/1309352970 shutdown_connections 2024-09-19T05:14:34.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:34.700+0000 7f7f84684640 1 --2- 172.21.15.120:0/1309352970 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f7f680a3270 0x7f7f680a5730 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:34.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:34.700+0000 7f7f84684640 1 --2- 172.21.15.120:0/1309352970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7f7c102690 0x7f7f7c19e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:34.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:34.700+0000 7f7f84684640 1 --2- 172.21.15.120:0/1309352970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f7c101cd0 0x7f7f7c1973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:34.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:34.700+0000 7f7f84684640 1 --2- 172.21.15.120:0/1309352970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7f7c100ad0 0x7f7f7c196e70 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:34.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:34.700+0000 7f7f84684640 1 -- 172.21.15.120:0/1309352970 >> 172.21.15.120:0/1309352970 conn(0x7f7f7c0fc280 msgr2=0x7f7f7c1051e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:14:34.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:34.700+0000 7f7f84684640 1 -- 172.21.15.120:0/1309352970 shutdown_connections 2024-09-19T05:14:34.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:14:34.700+0000 7f7f84684640 1 -- 172.21.15.120:0/1309352970 wait complete. 2024-09-19T05:14:35.067 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:35.067 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:35.067 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:35.067 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:35.068 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:35.068 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:34 smithi120 ceph-mon[30956]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:14:35.068 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:35.068 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:35.068 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:35.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:35.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:35.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:35.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:35.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:35.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:34 smithi194 ceph-mon[35228]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:14:35.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:35.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:35.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:35.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:34 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:35.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:34 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:35.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:34 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:35.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:34 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:35.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:34 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:35.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:34 smithi178 ceph-mon[34347]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:14:35.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:34 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:35.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:34 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:35.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:34 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:35.387 DEBUG:teuthology.orchestra.run.smithi120:osd.6> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T05:14:35.390 INFO:tasks.cephadm:Deploying osd.7 on smithi178 with /dev/vg_nvme/lv_2... 2024-09-19T05:14:35.390 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T05:14:35.643 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:14:37.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:37 smithi178 ceph-mon[34347]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:14:37.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:37 smithi120 ceph-mon[30956]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:14:37.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:37 smithi194 ceph-mon[35228]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:14:37.863 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:14:37 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:14:37.520+0000 7f0a19ce0640 -1 osd.6 0 log_to_monitors true 2024-09-19T05:14:38.113 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-19T05:14:38.144 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi178:vg_nvme/lv_2 2024-09-19T05:14:38.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:38 smithi120 ceph-mon[30956]: from='osd.6 [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T05:14:38.394 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:14:38.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:38 smithi194 ceph-mon[35228]: from='osd.6 [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T05:14:38.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:38 smithi178 ceph-mon[34347]: from='osd.6 [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T05:14:38.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.869+0000 7f2159def640 1 -- 172.21.15.178:0/3403404916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21541037c0 msgr2=0x7f215410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:14:38.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.869+0000 7f2159def640 1 --2- 172.21.15.178:0/3403404916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21541037c0 0x7f215410a050 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f214c009ca0 tx=0x7f214c02a8c0 comp rx=0 tx=0).stop 2024-09-19T05:14:38.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.869+0000 7f2159def640 1 -- 172.21.15.178:0/3403404916 shutdown_connections 2024-09-19T05:14:38.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.869+0000 7f2159def640 1 --2- 172.21.15.178:0/3403404916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21541037c0 0x7f215410a050 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:38.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.869+0000 7f2159def640 1 --2- 172.21.15.178:0/3403404916 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2154102e00 0x7f2154103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:38.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.869+0000 7f2159def640 1 --2- 172.21.15.178:0/3403404916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2154101c00 0x7f2154102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:38.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.869+0000 7f2159def640 1 -- 172.21.15.178:0/3403404916 >> 172.21.15.178:0/3403404916 conn(0x7f21540fd390 msgr2=0x7f21540ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:14:38.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.869+0000 7f2159def640 1 -- 172.21.15.178:0/3403404916 shutdown_connections 2024-09-19T05:14:38.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.869+0000 7f2159def640 1 -- 172.21.15.178:0/3403404916 wait complete. 2024-09-19T05:14:38.873 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.870+0000 7f2159def640 1 Processor -- start 2024-09-19T05:14:38.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.870+0000 7f2159def640 1 -- start start 2024-09-19T05:14:38.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.870+0000 7f2159def640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2154101c00 0x7f2154197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:14:38.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.870+0000 7f2159def640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2154102e00 0x7f2154198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:14:38.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.870+0000 7f2159def640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21541037c0 0x7f215419f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:14:38.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.870+0000 7f2159def640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f215410d790 con 0x7f2154102e00 2024-09-19T05:14:38.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.870+0000 7f2159def640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f215410d610 con 0x7f21541037c0 2024-09-19T05:14:38.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.870+0000 7f2159def640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f215410d910 con 0x7f2154101c00 2024-09-19T05:14:38.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.870+0000 7f2153fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21541037c0 0x7f215419f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:14:38.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.871+0000 7f2153fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21541037c0 0x7f215419f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:46186/0 (socket says 172.21.15.178:46186) 2024-09-19T05:14:38.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.871+0000 7f2153fff640 1 -- 172.21.15.178:0/3967527657 learned_addr learned my addr 172.21.15.178:0/3967527657 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-19T05:14:38.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.871+0000 7f2152ffd640 1 --2- 172.21.15.178:0/3967527657 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2154102e00 0x7f2154198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:14:38.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.871+0000 7f21537fe640 1 --2- 172.21.15.178:0/3967527657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2154101c00 0x7f2154197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:14:38.874 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.871+0000 7f2153fff640 1 -- 172.21.15.178:0/3967527657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2154101c00 msgr2=0x7f2154197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:14:38.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.871+0000 7f2153fff640 1 --2- 172.21.15.178:0/3967527657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2154101c00 0x7f2154197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:38.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.871+0000 7f2153fff640 1 -- 172.21.15.178:0/3967527657 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2154102e00 msgr2=0x7f2154198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:14:38.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.871+0000 7f2153fff640 1 --2- 172.21.15.178:0/3967527657 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2154102e00 0x7f2154198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:38.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.871+0000 7f2153fff640 1 -- 172.21.15.178:0/3967527657 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215419fa10 con 0x7f21541037c0 2024-09-19T05:14:38.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.871+0000 7f2153fff640 1 --2- 172.21.15.178:0/3967527657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21541037c0 0x7f215419f3a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f214c009dc0 tx=0x7f214c003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:14:38.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.871+0000 7f2150ff9640 1 -- 172.21.15.178:0/3967527657 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c004040 con 0x7f21541037c0 2024-09-19T05:14:38.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.871+0000 7f2150ff9640 1 -- 172.21.15.178:0/3967527657 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f214c004690 con 0x7f21541037c0 2024-09-19T05:14:38.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.871+0000 7f2150ff9640 1 -- 172.21.15.178:0/3967527657 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c02f4c0 con 0x7f21541037c0 2024-09-19T05:14:38.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.871+0000 7f2159def640 1 -- 172.21.15.178:0/3967527657 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215419fca0 con 0x7f21541037c0 2024-09-19T05:14:38.875 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.871+0000 7f2159def640 1 -- 172.21.15.178:0/3967527657 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21541a0190 con 0x7f21541037c0 2024-09-19T05:14:38.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.872+0000 7f2159def640 1 -- 172.21.15.178:0/3967527657 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2154108fd0 con 0x7f21541037c0 2024-09-19T05:14:38.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.873+0000 7f2150ff9640 1 -- 172.21.15.178:0/3967527657 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f214c0305c0 con 0x7f21541037c0 2024-09-19T05:14:38.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.874+0000 7f2150ff9640 1 --2- 172.21.15.178:0/3967527657 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f213c0a3270 0x7f213c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:14:38.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.874+0000 7f2150ff9640 1 -- 172.21.15.178:0/3967527657 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4669+0+0 (secure 0 0 0) 0x7f214c0f0380 con 0x7f21541037c0 2024-09-19T05:14:38.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.874+0000 7f21537fe640 1 --2- 172.21.15.178:0/3967527657 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f213c0a3270 0x7f213c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:14:38.876 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.875+0000 7f21537fe640 1 --2- 172.21.15.178:0/3967527657 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f213c0a3270 0x7f213c0a5730 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2154102c60 tx=0x7f2144005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:14:38.879 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:38.878+0000 7f2150ff9640 1 -- 172.21.15.178:0/3967527657 <== mon.2 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f214c0bdee0 con 0x7f21541037c0 2024-09-19T05:14:39.053 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:39.052+0000 7f2159def640 1 -- 172.21.15.178:0/3967527657 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f2154062630 con 0x7f213c0a3270 2024-09-19T05:14:39.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:39 smithi194 ceph-mon[35228]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:14:39.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:39 smithi194 ceph-mon[35228]: from='osd.6 [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T05:14:39.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:39 smithi194 ceph-mon[35228]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T05:14:39.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:39 smithi194 ceph-mon[35228]: from='osd.6 [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-09-19T05:14:39.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:39 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:14:39.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:39 smithi194 ceph-mon[35228]: Detected new or changed devices on smithi120 2024-09-19T05:14:39.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:39 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:39.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:39 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:39.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:39 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:14:39.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:39 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:14:39.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:39 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:14:39.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:39 smithi194 ceph-mon[35228]: Adjusting osd_memory_target on smithi120 to 5696M 2024-09-19T05:14:39.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:39 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:39.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:39 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:39.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:39 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:39.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:39 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:39.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:39 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:14:39.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:39 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:14:39.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:39 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:39.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:39 smithi178 ceph-mon[34347]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:14:39.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:39 smithi178 ceph-mon[34347]: from='osd.6 [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T05:14:39.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:39 smithi178 ceph-mon[34347]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T05:14:39.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:39 smithi178 ceph-mon[34347]: from='osd.6 [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-09-19T05:14:39.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:39 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:14:39.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:39 smithi178 ceph-mon[34347]: Detected new or changed devices on smithi120 2024-09-19T05:14:39.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:39 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:39.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:39 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:39.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:39 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:14:39.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:39 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:14:39.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:39 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:14:39.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:39 smithi178 ceph-mon[34347]: Adjusting osd_memory_target on smithi120 to 5696M 2024-09-19T05:14:39.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:39 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:39.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:39 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:39.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:39 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:39.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:39 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:39.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:39 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:14:39.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:39 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:14:39.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:39 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:39.628 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:39 smithi120 ceph-mon[30956]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:14:39.628 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:39 smithi120 ceph-mon[30956]: from='osd.6 [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T05:14:39.628 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:39 smithi120 ceph-mon[30956]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T05:14:39.628 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:39 smithi120 ceph-mon[30956]: from='osd.6 [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-09-19T05:14:39.628 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:39 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:14:39.628 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:39 smithi120 ceph-mon[30956]: Detected new or changed devices on smithi120 2024-09-19T05:14:39.628 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:39 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:39.629 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:39 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:39.629 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:39 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:14:39.629 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:39 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:14:39.629 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:39 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:14:39.629 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:39 smithi120 ceph-mon[30956]: Adjusting osd_memory_target on smithi120 to 5696M 2024-09-19T05:14:39.629 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:39 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:39.629 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:39 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:39.629 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:39 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:39.629 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:39 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:39.629 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:39 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:14:39.629 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:39 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:14:39.629 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:39 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:40.125 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:14:39 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:14:39.870+0000 7f0a16477640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T05:14:40.125 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:14:39 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:14:39.881+0000 7f0a0da72640 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:14:40.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:40 smithi194 ceph-mon[35228]: from='client.24242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:14:40.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:40 smithi194 ceph-mon[35228]: from='osd.6 [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-09-19T05:14:40.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:40 smithi194 ceph-mon[35228]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T05:14:40.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:40 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:14:40.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:40 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:14:40.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:40 smithi194 ceph-mon[35228]: from='osd.6 [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976]' entity='osd.6' 2024-09-19T05:14:40.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:40 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:14:40.429 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:40 smithi178 ceph-mon[34347]: from='client.24242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:14:40.429 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:40 smithi178 ceph-mon[34347]: from='osd.6 [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-09-19T05:14:40.429 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:40 smithi178 ceph-mon[34347]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T05:14:40.429 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:40 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:14:40.429 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:40 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:14:40.429 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:40 smithi178 ceph-mon[34347]: from='osd.6 [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976]' entity='osd.6' 2024-09-19T05:14:40.429 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:40 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:14:40.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:40 smithi120 ceph-mon[30956]: from='client.24242 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:14:40.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:40 smithi120 ceph-mon[30956]: from='osd.6 [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-09-19T05:14:40.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:40 smithi120 ceph-mon[30956]: osdmap e43: 7 total, 6 up, 7 in 2024-09-19T05:14:40.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:40 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:14:40.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:40 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:14:40.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:40 smithi120 ceph-mon[30956]: from='osd.6 [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976]' entity='osd.6' 2024-09-19T05:14:40.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:40 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:14:41.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:41 smithi194 ceph-mon[35228]: purged_snaps scrub starts 2024-09-19T05:14:41.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:41 smithi194 ceph-mon[35228]: purged_snaps scrub ok 2024-09-19T05:14:41.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:41 smithi194 ceph-mon[35228]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:14:41.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:41 smithi194 ceph-mon[35228]: osd.6 [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976] boot 2024-09-19T05:14:41.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:41 smithi194 ceph-mon[35228]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T05:14:41.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:41 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:14:41.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:41 smithi178 ceph-mon[34347]: purged_snaps scrub starts 2024-09-19T05:14:41.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:41 smithi178 ceph-mon[34347]: purged_snaps scrub ok 2024-09-19T05:14:41.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:41 smithi178 ceph-mon[34347]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:14:41.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:41 smithi178 ceph-mon[34347]: osd.6 [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976] boot 2024-09-19T05:14:41.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:41 smithi178 ceph-mon[34347]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T05:14:41.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:41 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:14:41.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:41 smithi120 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T05:14:41.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:41 smithi120 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T05:14:41.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:41 smithi120 ceph-mon[30956]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-19T05:14:41.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:41 smithi120 ceph-mon[30956]: osd.6 [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976] boot 2024-09-19T05:14:41.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:41 smithi120 ceph-mon[30956]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T05:14:41.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:41 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:14:42.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:42 smithi178 ceph-mon[34347]: from='client.? 172.21.15.178:0/1041809216' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f4aa6ab-b5f4-4c06-9f14-9a51bc195ca9"}]: dispatch 2024-09-19T05:14:42.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:42 smithi178 ceph-mon[34347]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f4aa6ab-b5f4-4c06-9f14-9a51bc195ca9"}]: dispatch 2024-09-19T05:14:42.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:42 smithi178 ceph-mon[34347]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f4aa6ab-b5f4-4c06-9f14-9a51bc195ca9"}]': finished 2024-09-19T05:14:42.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:42 smithi178 ceph-mon[34347]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T05:14:42.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:42 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:14:42.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:42 smithi178 ceph-mon[34347]: from='client.? 172.21.15.178:0/903466327' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:14:42.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:42 smithi194 ceph-mon[35228]: from='client.? 172.21.15.178:0/1041809216' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f4aa6ab-b5f4-4c06-9f14-9a51bc195ca9"}]: dispatch 2024-09-19T05:14:42.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:42 smithi194 ceph-mon[35228]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f4aa6ab-b5f4-4c06-9f14-9a51bc195ca9"}]: dispatch 2024-09-19T05:14:42.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:42 smithi194 ceph-mon[35228]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f4aa6ab-b5f4-4c06-9f14-9a51bc195ca9"}]': finished 2024-09-19T05:14:42.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:42 smithi194 ceph-mon[35228]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T05:14:42.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:42 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:14:42.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:42 smithi194 ceph-mon[35228]: from='client.? 172.21.15.178:0/903466327' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:14:42.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:42 smithi120 ceph-mon[30956]: from='client.? 172.21.15.178:0/1041809216' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f4aa6ab-b5f4-4c06-9f14-9a51bc195ca9"}]: dispatch 2024-09-19T05:14:42.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:42 smithi120 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f4aa6ab-b5f4-4c06-9f14-9a51bc195ca9"}]: dispatch 2024-09-19T05:14:42.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:42 smithi120 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f4aa6ab-b5f4-4c06-9f14-9a51bc195ca9"}]': finished 2024-09-19T05:14:42.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:42 smithi120 ceph-mon[30956]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T05:14:42.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:42 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:14:42.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:42 smithi120 ceph-mon[30956]: from='client.? 172.21.15.178:0/903466327' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:14:43.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:43 smithi194 ceph-mon[35228]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:43.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:43 smithi194 ceph-mon[35228]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T05:14:43.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:43 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:14:43.447 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:43 smithi178 ceph-mon[34347]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:43.447 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:43 smithi178 ceph-mon[34347]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T05:14:43.447 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:43 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:14:43.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:43 smithi120 ceph-mon[30956]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:43.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:43 smithi120 ceph-mon[30956]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T05:14:43.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:43 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:14:45.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:45 smithi194 ceph-mon[35228]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:45.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:45 smithi178 ceph-mon[34347]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:45.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:45 smithi120 ceph-mon[30956]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:47.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:47 smithi194 ceph-mon[35228]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:47.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:47 smithi178 ceph-mon[34347]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:47.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:47 smithi120 ceph-mon[30956]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:49.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:49 smithi178 ceph-mon[34347]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:49.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:49 smithi120 ceph-mon[30956]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:49.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:49 smithi194 ceph-mon[35228]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:50.435 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:50 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T05:14:50.436 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:50 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:50.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:50 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T05:14:50.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:50 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:50.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:50 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T05:14:50.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:50 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:51.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:51 smithi178 ceph-mon[34347]: Deploying daemon osd.7 on smithi178 2024-09-19T05:14:51.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:51 smithi178 ceph-mon[34347]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:51.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:51 smithi120 ceph-mon[30956]: Deploying daemon osd.7 on smithi178 2024-09-19T05:14:51.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:51 smithi120 ceph-mon[30956]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:51.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:51 smithi194 ceph-mon[35228]: Deploying daemon osd.7 on smithi178 2024-09-19T05:14:51.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:51 smithi194 ceph-mon[35228]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:53.432 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:53 smithi178 ceph-mon[34347]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:53.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:53 smithi120 ceph-mon[30956]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:53.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:53 smithi194 ceph-mon[35228]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:55.427 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:55 smithi120 ceph-mon[30956]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:55.431 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:55 smithi178 ceph-mon[34347]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:55.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:55 smithi194 ceph-mon[35228]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:56.352 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:56 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:56.352 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:56 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:56.352 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:56 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:56.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:56 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:56.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:56 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:56.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:56 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:56.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:56 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:56.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:56 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:56.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:56 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:57.284 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:57 smithi178 ceph-mon[34347]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:57.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:57 smithi120 ceph-mon[30956]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:57.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:57 smithi194 ceph-mon[35228]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:58.907 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:58.904+0000 7f2150ff9640 1 -- 172.21.15.178:0/3967527657 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2154062630 con 0x7f213c0a3270 2024-09-19T05:14:58.907 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 7 on host 'smithi178' 2024-09-19T05:14:58.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:58.907+0000 7f2159def640 1 -- 172.21.15.178:0/3967527657 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f213c0a3270 msgr2=0x7f213c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:14:58.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:58.907+0000 7f2159def640 1 --2- 172.21.15.178:0/3967527657 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f213c0a3270 0x7f213c0a5730 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2154102c60 tx=0x7f2144005f90 comp rx=0 tx=0).stop 2024-09-19T05:14:58.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:58.907+0000 7f2159def640 1 -- 172.21.15.178:0/3967527657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21541037c0 msgr2=0x7f215419f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:14:58.909 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:58.907+0000 7f2159def640 1 --2- 172.21.15.178:0/3967527657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21541037c0 0x7f215419f3a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f214c009dc0 tx=0x7f214c003ba0 comp rx=0 tx=0).stop 2024-09-19T05:14:58.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:58.907+0000 7f2159def640 1 -- 172.21.15.178:0/3967527657 shutdown_connections 2024-09-19T05:14:58.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:58.907+0000 7f2159def640 1 --2- 172.21.15.178:0/3967527657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21541037c0 0x7f215419f3a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:58.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:58.907+0000 7f2159def640 1 --2- 172.21.15.178:0/3967527657 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2154102e00 0x7f2154198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:58.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:58.907+0000 7f2159def640 1 --2- 172.21.15.178:0/3967527657 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f213c0a3270 0x7f213c0a5730 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:58.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:58.907+0000 7f2159def640 1 --2- 172.21.15.178:0/3967527657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2154101c00 0x7f2154197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:14:58.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:58.907+0000 7f2159def640 1 -- 172.21.15.178:0/3967527657 >> 172.21.15.178:0/3967527657 conn(0x7f21540fd390 msgr2=0x7f21541061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:14:58.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:58.907+0000 7f2159def640 1 -- 172.21.15.178:0/3967527657 shutdown_connections 2024-09-19T05:14:58.910 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:14:58.907+0000 7f2159def640 1 -- 172.21.15.178:0/3967527657 wait complete. 2024-09-19T05:14:59.503 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:59 smithi178 ceph-mon[34347]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:59.503 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:59 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:59.503 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:59 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:59.503 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:59 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:59.503 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:59 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:59.503 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:59 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:59.503 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:59 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:59.503 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:59 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:59.503 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:14:59 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:59.534 DEBUG:teuthology.orchestra.run.smithi178:osd.7> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T05:14:59.537 INFO:tasks.cephadm:Deploying osd.8 on smithi194 with /dev/vg_nvme/lv_2... 2024-09-19T05:14:59.537 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T05:14:59.565 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:59 smithi194 ceph-mon[35228]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:59.565 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:59 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:59.565 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:59 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:59.565 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:59 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:59.565 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:59 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:59.565 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:59 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:59.565 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:59 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:59.565 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:59 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:59.566 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:14:59 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:59.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:59 smithi120 ceph-mon[30956]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:14:59.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:59 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:59.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:59 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:59.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:59 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:14:59.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:59 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:14:59.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:59 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:59.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:59 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:14:59.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:59 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:59.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:14:59 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:14:59.791 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:15:01.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:01 smithi194 ceph-mon[35228]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:15:01.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:01 smithi120 ceph-mon[30956]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:15:01.678 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:01 smithi178 ceph-mon[34347]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:15:01.942 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:15:01 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:15:01.674+0000 7f0616bae640 -1 osd.7 0 log_to_monitors true 2024-09-19T05:15:02.174 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:15:02.198 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi194:vg_nvme/lv_2 2024-09-19T05:15:02.350 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:02 smithi178 ceph-mon[34347]: from='osd.7 [v2:172.21.15.178:6816/1912109177,v1:172.21.15.178:6817/1912109177]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T05:15:02.350 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:02 smithi178 ceph-mon[34347]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T05:15:02.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:02 smithi194 ceph-mon[35228]: from='osd.7 [v2:172.21.15.178:6816/1912109177,v1:172.21.15.178:6817/1912109177]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T05:15:02.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:02 smithi194 ceph-mon[35228]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T05:15:02.495 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:15:02.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:02 smithi120 ceph-mon[30956]: from='osd.7 [v2:172.21.15.178:6816/1912109177,v1:172.21.15.178:6817/1912109177]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T05:15:02.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:02 smithi120 ceph-mon[30956]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T05:15:02.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.933+0000 7fac985bf640 1 -- 172.21.15.194:0/1863220770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac90100ad0 msgr2=0x7fac90100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:15:02.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.933+0000 7fac985bf640 1 --2- 172.21.15.194:0/1863220770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac90100ad0 0x7fac90100ed0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fac88009900 tx=0x7fac8802a410 comp rx=0 tx=0).stop 2024-09-19T05:15:02.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.933+0000 7fac985bf640 1 -- 172.21.15.194:0/1863220770 shutdown_connections 2024-09-19T05:15:02.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.933+0000 7fac985bf640 1 --2- 172.21.15.194:0/1863220770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac90102690 0x7fac90108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:02.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.933+0000 7fac985bf640 1 --2- 172.21.15.194:0/1863220770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac90101cd0 0x7fac90102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:02.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.933+0000 7fac985bf640 1 --2- 172.21.15.194:0/1863220770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac90100ad0 0x7fac90100ed0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:02.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.933+0000 7fac985bf640 1 -- 172.21.15.194:0/1863220770 >> 172.21.15.194:0/1863220770 conn(0x7fac900fc280 msgr2=0x7fac900fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:15:02.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.933+0000 7fac985bf640 1 -- 172.21.15.194:0/1863220770 shutdown_connections 2024-09-19T05:15:02.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.933+0000 7fac985bf640 1 -- 172.21.15.194:0/1863220770 wait complete. 2024-09-19T05:15:02.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.933+0000 7fac985bf640 1 Processor -- start 2024-09-19T05:15:02.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.933+0000 7fac985bf640 1 -- start start 2024-09-19T05:15:02.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.934+0000 7fac985bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac90100ad0 0x7fac90197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:15:02.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.934+0000 7fac985bf640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac90101cd0 0x7fac901983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:15:02.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.934+0000 7fac985bf640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac90102690 0x7fac9019f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:15:02.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.934+0000 7fac985bf640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fac9010c660 con 0x7fac90100ad0 2024-09-19T05:15:02.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.934+0000 7fac985bf640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fac9010c4e0 con 0x7fac90102690 2024-09-19T05:15:02.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.934+0000 7fac985bf640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fac9010c7e0 con 0x7fac90101cd0 2024-09-19T05:15:02.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.934+0000 7fac95b5a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac90101cd0 0x7fac901983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:15:02.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.934+0000 7fac95b5a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac90101cd0 0x7fac901983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51024/0 (socket says 172.21.15.194:51024) 2024-09-19T05:15:02.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.934+0000 7fac95b5a640 1 -- 172.21.15.194:0/1460878759 learned_addr learned my addr 172.21.15.194:0/1460878759 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T05:15:02.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.934+0000 7fac96b5c640 1 --2- 172.21.15.194:0/1460878759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac90102690 0x7fac9019f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:15:02.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.934+0000 7fac9635b640 1 --2- 172.21.15.194:0/1460878759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac90100ad0 0x7fac90197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:15:02.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.934+0000 7fac95b5a640 1 -- 172.21.15.194:0/1460878759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac90102690 msgr2=0x7fac9019f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:15:02.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.934+0000 7fac95b5a640 1 --2- 172.21.15.194:0/1460878759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac90102690 0x7fac9019f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:02.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.934+0000 7fac95b5a640 1 -- 172.21.15.194:0/1460878759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac90100ad0 msgr2=0x7fac90197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:15:02.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.934+0000 7fac95b5a640 1 --2- 172.21.15.194:0/1460878759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac90100ad0 0x7fac90197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:02.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.934+0000 7fac95b5a640 1 -- 172.21.15.194:0/1460878759 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac9019fad0 con 0x7fac90101cd0 2024-09-19T05:15:02.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.934+0000 7fac95b5a640 1 --2- 172.21.15.194:0/1460878759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac90101cd0 0x7fac901983e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fac8400d950 tx=0x7fac8400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:15:02.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.934+0000 7fac8f7fe640 1 -- 172.21.15.194:0/1460878759 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac84017070 con 0x7fac90101cd0 2024-09-19T05:15:02.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.934+0000 7fac8f7fe640 1 -- 172.21.15.194:0/1460878759 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fac84009c30 con 0x7fac90101cd0 2024-09-19T05:15:02.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.934+0000 7fac985bf640 1 -- 172.21.15.194:0/1460878759 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac9019fdc0 con 0x7fac90101cd0 2024-09-19T05:15:02.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.934+0000 7fac8f7fe640 1 -- 172.21.15.194:0/1460878759 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8400f620 con 0x7fac90101cd0 2024-09-19T05:15:02.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.934+0000 7fac985bf640 1 -- 172.21.15.194:0/1460878759 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac901a02f0 con 0x7fac90101cd0 2024-09-19T05:15:02.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.935+0000 7fac985bf640 1 -- 172.21.15.194:0/1460878759 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac901a0520 con 0x7fac90101cd0 2024-09-19T05:15:02.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.937+0000 7fac8f7fe640 1 -- 172.21.15.194:0/1460878759 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fac840109a0 con 0x7fac90101cd0 2024-09-19T05:15:02.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.937+0000 7fac8f7fe640 1 --2- 172.21.15.194:0/1460878759 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fac780a3270 0x7fac780a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:15:02.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.937+0000 7fac8f7fe640 1 -- 172.21.15.194:0/1460878759 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5101+0+0 (secure 0 0 0) 0x7fac840ce7a0 con 0x7fac90101cd0 2024-09-19T05:15:02.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.938+0000 7fac9635b640 1 --2- 172.21.15.194:0/1460878759 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fac780a3270 0x7fac780a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:15:02.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.938+0000 7fac9635b640 1 --2- 172.21.15.194:0/1460878759 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fac780a3270 0x7fac780a5730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fac88004770 tx=0x7fac88000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:15:02.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:02.941+0000 7fac8f7fe640 1 -- 172.21.15.194:0/1460878759 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fac84009de0 con 0x7fac90101cd0 2024-09-19T05:15:03.125 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:03.123+0000 7fac985bf640 1 -- 172.21.15.194:0/1460878759 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fac9006a6f0 con 0x7fac780a3270 2024-09-19T05:15:03.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:03 smithi194 ceph-mon[35228]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:15:03.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:03 smithi194 ceph-mon[35228]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T05:15:03.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:03 smithi194 ceph-mon[35228]: from='osd.7 [v2:172.21.15.178:6816/1912109177,v1:172.21.15.178:6817/1912109177]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-09-19T05:15:03.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:03 smithi194 ceph-mon[35228]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T05:15:03.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:15:03.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:03 smithi194 ceph-mon[35228]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-09-19T05:15:03.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:03.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:03.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:03.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:03.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:03.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:03.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:03.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:03.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:03.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:15:03.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:15:03.408 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:03.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:03 smithi120 ceph-mon[30956]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:15:03.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:03 smithi120 ceph-mon[30956]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T05:15:03.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:03 smithi120 ceph-mon[30956]: from='osd.7 [v2:172.21.15.178:6816/1912109177,v1:172.21.15.178:6817/1912109177]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-09-19T05:15:03.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:03 smithi120 ceph-mon[30956]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T05:15:03.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:15:03.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:03 smithi120 ceph-mon[30956]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-09-19T05:15:03.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:03.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:03.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:03.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:03.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:03.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:03.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:03.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:03.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:03.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:15:03.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:15:03.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:03.692 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:15:03 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:15:03.268+0000 7f061230e640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T05:15:03.692 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:15:03 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:15:03.281+0000 7f060e948640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:15:03.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:03 smithi178 ceph-mon[34347]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:15:03.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:03 smithi178 ceph-mon[34347]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T05:15:03.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:03 smithi178 ceph-mon[34347]: from='osd.7 [v2:172.21.15.178:6816/1912109177,v1:172.21.15.178:6817/1912109177]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-09-19T05:15:03.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:03 smithi178 ceph-mon[34347]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T05:15:03.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:15:03.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:03 smithi178 ceph-mon[34347]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-09-19T05:15:03.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:03.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:03.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:03.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:03.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:03.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:03.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:03.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:03.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:03.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:15:03.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:15:03.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:04.561 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:04 smithi194 ceph-mon[35228]: Detected new or changed devices on smithi178 2024-09-19T05:15:04.561 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:04 smithi194 ceph-mon[35228]: Adjusting osd_memory_target on smithi178 to 5696M 2024-09-19T05:15:04.561 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:04 smithi194 ceph-mon[35228]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:15:04.561 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:04 smithi194 ceph-mon[35228]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-09-19T05:15:04.561 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:04 smithi194 ceph-mon[35228]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T05:15:04.562 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:04 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:15:04.562 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:04 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:15:04.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:04 smithi120 ceph-mon[30956]: Detected new or changed devices on smithi178 2024-09-19T05:15:04.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:04 smithi120 ceph-mon[30956]: Adjusting osd_memory_target on smithi178 to 5696M 2024-09-19T05:15:04.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:04 smithi120 ceph-mon[30956]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:15:04.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:04 smithi120 ceph-mon[30956]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-09-19T05:15:04.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:04 smithi120 ceph-mon[30956]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T05:15:04.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:04 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:15:04.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:04 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:15:04.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:04 smithi178 ceph-mon[34347]: Detected new or changed devices on smithi178 2024-09-19T05:15:04.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:04 smithi178 ceph-mon[34347]: Adjusting osd_memory_target on smithi178 to 5696M 2024-09-19T05:15:04.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:04 smithi178 ceph-mon[34347]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:15:04.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:04 smithi178 ceph-mon[34347]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-09-19T05:15:04.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:04 smithi178 ceph-mon[34347]: osdmap e48: 8 total, 7 up, 8 in 2024-09-19T05:15:04.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:04 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:15:04.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:04 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:15:05.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:05 smithi194 ceph-mon[35228]: purged_snaps scrub starts 2024-09-19T05:15:05.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:05 smithi194 ceph-mon[35228]: purged_snaps scrub ok 2024-09-19T05:15:05.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:05 smithi194 ceph-mon[35228]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:15:05.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:05 smithi194 ceph-mon[35228]: osd.7 [v2:172.21.15.178:6816/1912109177,v1:172.21.15.178:6817/1912109177] boot 2024-09-19T05:15:05.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:05 smithi194 ceph-mon[35228]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T05:15:05.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:05 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:15:05.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:05 smithi194 ceph-mon[35228]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T05:15:05.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:05 smithi120 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T05:15:05.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:05 smithi120 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T05:15:05.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:05 smithi120 ceph-mon[30956]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:15:05.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:05 smithi120 ceph-mon[30956]: osd.7 [v2:172.21.15.178:6816/1912109177,v1:172.21.15.178:6817/1912109177] boot 2024-09-19T05:15:05.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:05 smithi120 ceph-mon[30956]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T05:15:05.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:05 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:15:05.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:05 smithi120 ceph-mon[30956]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T05:15:05.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:05 smithi178 ceph-mon[34347]: purged_snaps scrub starts 2024-09-19T05:15:05.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:05 smithi178 ceph-mon[34347]: purged_snaps scrub ok 2024-09-19T05:15:05.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:05 smithi178 ceph-mon[34347]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-19T05:15:05.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:05 smithi178 ceph-mon[34347]: osd.7 [v2:172.21.15.178:6816/1912109177,v1:172.21.15.178:6817/1912109177] boot 2024-09-19T05:15:05.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:05 smithi178 ceph-mon[34347]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T05:15:05.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:05 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:15:05.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:05 smithi178 ceph-mon[34347]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T05:15:06.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:06 smithi120 ceph-mon[30956]: from='client.? 172.21.15.194:0/410565802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "707739c9-732a-405c-847a-ce6a06e611b3"}]: dispatch 2024-09-19T05:15:06.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:06 smithi120 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "707739c9-732a-405c-847a-ce6a06e611b3"}]: dispatch 2024-09-19T05:15:06.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:06 smithi120 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "707739c9-732a-405c-847a-ce6a06e611b3"}]': finished 2024-09-19T05:15:06.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:06 smithi120 ceph-mon[30956]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T05:15:06.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:06 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:15:06.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:06 smithi120 ceph-mon[30956]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T05:15:06.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:06 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:15:06.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:06 smithi120 ceph-mon[30956]: from='client.? 172.21.15.194:0/1135334495' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:15:06.627 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:06 smithi120 ceph-mon[30956]: pgmap v171: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:06.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:06 smithi194 ceph-mon[35228]: from='client.? 172.21.15.194:0/410565802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "707739c9-732a-405c-847a-ce6a06e611b3"}]: dispatch 2024-09-19T05:15:06.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:06 smithi194 ceph-mon[35228]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "707739c9-732a-405c-847a-ce6a06e611b3"}]: dispatch 2024-09-19T05:15:06.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:06 smithi194 ceph-mon[35228]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "707739c9-732a-405c-847a-ce6a06e611b3"}]': finished 2024-09-19T05:15:06.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:06 smithi194 ceph-mon[35228]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T05:15:06.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:06 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:15:06.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:06 smithi194 ceph-mon[35228]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T05:15:06.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:06 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:15:06.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:06 smithi194 ceph-mon[35228]: from='client.? 172.21.15.194:0/1135334495' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:15:06.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:06 smithi194 ceph-mon[35228]: pgmap v171: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:06.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:06 smithi178 ceph-mon[34347]: from='client.? 172.21.15.194:0/410565802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "707739c9-732a-405c-847a-ce6a06e611b3"}]: dispatch 2024-09-19T05:15:06.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:06 smithi178 ceph-mon[34347]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "707739c9-732a-405c-847a-ce6a06e611b3"}]: dispatch 2024-09-19T05:15:06.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:06 smithi178 ceph-mon[34347]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "707739c9-732a-405c-847a-ce6a06e611b3"}]': finished 2024-09-19T05:15:06.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:06 smithi178 ceph-mon[34347]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T05:15:06.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:06 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:15:06.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:06 smithi178 ceph-mon[34347]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T05:15:06.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:06 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:15:06.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:06 smithi178 ceph-mon[34347]: from='client.? 172.21.15.194:0/1135334495' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:15:06.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:06 smithi178 ceph-mon[34347]: pgmap v171: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:08.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:07 smithi178 ceph-mon[34347]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T05:15:08.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:07 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:15:08.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:07 smithi120 ceph-mon[30956]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T05:15:08.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:07 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:15:08.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:07 smithi194 ceph-mon[35228]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T05:15:08.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:07 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:15:09.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:08 smithi178 ceph-mon[34347]: pgmap v173: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:09.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:08 smithi120 ceph-mon[30956]: pgmap v173: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:09.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:08 smithi194 ceph-mon[35228]: pgmap v173: 1 pgs: 1 remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:11.389 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:11 smithi194 ceph-mon[35228]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:11.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:11 smithi178 ceph-mon[34347]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:11.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:11 smithi120 ceph-mon[30956]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:13.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:13 smithi194 ceph-mon[35228]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:13.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:13 smithi178 ceph-mon[34347]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:13.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:13 smithi120 ceph-mon[30956]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:14.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:14 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T05:15:14.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:14 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:14.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:14 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T05:15:14.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:14 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:14.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:14 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T05:15:14.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:14 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:15.266 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:15 smithi194 ceph-mon[35228]: Deploying daemon osd.8 on smithi194 2024-09-19T05:15:15.267 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:15 smithi194 ceph-mon[35228]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:15.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:15 smithi178 ceph-mon[34347]: Deploying daemon osd.8 on smithi194 2024-09-19T05:15:15.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:15 smithi178 ceph-mon[34347]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:15.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:15 smithi120 ceph-mon[30956]: Deploying daemon osd.8 on smithi194 2024-09-19T05:15:15.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:15 smithi120 ceph-mon[30956]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:17.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:17 smithi194 ceph-mon[35228]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:17.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:17 smithi178 ceph-mon[34347]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:17.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:17 smithi120 ceph-mon[30956]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:19.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:19 smithi194 ceph-mon[35228]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:19.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:19 smithi178 ceph-mon[34347]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:19.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:19 smithi120 ceph-mon[30956]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:20.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:20.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:20.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:20.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:20 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:20.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:20 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:20.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:20 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:20.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:20 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:20.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:20 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:20.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:20 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:21.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:21 smithi194 ceph-mon[35228]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:21.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:21 smithi178 ceph-mon[34347]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:21.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:21 smithi120 ceph-mon[30956]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:23.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:23.144+0000 7fac8f7fe640 1 -- 172.21.15.194:0/1460878759 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fac9006a6f0 con 0x7fac780a3270 2024-09-19T05:15:23.146 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 8 on host 'smithi194' 2024-09-19T05:15:23.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:23.147+0000 7fac985bf640 1 -- 172.21.15.194:0/1460878759 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fac780a3270 msgr2=0x7fac780a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:15:23.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:23.147+0000 7fac985bf640 1 --2- 172.21.15.194:0/1460878759 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fac780a3270 0x7fac780a5730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fac88004770 tx=0x7fac88000bc0 comp rx=0 tx=0).stop 2024-09-19T05:15:23.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:23.147+0000 7fac985bf640 1 -- 172.21.15.194:0/1460878759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac90101cd0 msgr2=0x7fac901983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:15:23.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:23.147+0000 7fac985bf640 1 --2- 172.21.15.194:0/1460878759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac90101cd0 0x7fac901983e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fac8400d950 tx=0x7fac8400de10 comp rx=0 tx=0).stop 2024-09-19T05:15:23.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:23.147+0000 7fac985bf640 1 -- 172.21.15.194:0/1460878759 shutdown_connections 2024-09-19T05:15:23.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:23.147+0000 7fac985bf640 1 --2- 172.21.15.194:0/1460878759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac90102690 0x7fac9019f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:23.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:23.147+0000 7fac985bf640 1 --2- 172.21.15.194:0/1460878759 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fac780a3270 0x7fac780a5730 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:23.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:23.147+0000 7fac985bf640 1 --2- 172.21.15.194:0/1460878759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac90101cd0 0x7fac901983e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:23.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:23.147+0000 7fac985bf640 1 --2- 172.21.15.194:0/1460878759 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fac90100ad0 0x7fac90197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:23.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:23.147+0000 7fac985bf640 1 -- 172.21.15.194:0/1460878759 >> 172.21.15.194:0/1460878759 conn(0x7fac900fc280 msgr2=0x7fac90069fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:15:23.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:23.147+0000 7fac985bf640 1 -- 172.21.15.194:0/1460878759 shutdown_connections 2024-09-19T05:15:23.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:15:23.147+0000 7fac985bf640 1 -- 172.21.15.194:0/1460878759 wait complete. 2024-09-19T05:15:23.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:23 smithi194 ceph-mon[35228]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:23.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:23 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:23.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:23 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:23.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:23 smithi178 ceph-mon[34347]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:23.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:23 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:23.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:23 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:23.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:23 smithi120 ceph-mon[30956]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:23.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:23 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:23.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:23 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:23.739 DEBUG:teuthology.orchestra.run.smithi194:osd.8> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T05:15:23.741 INFO:tasks.cephadm:Deploying osd.9 on smithi120 with /dev/vg_nvme/lv_1... 2024-09-19T05:15:23.742 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T05:15:24.011 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:15:25.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:24 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:25.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:24 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:25.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:24 smithi120 ceph-mon[30956]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:25.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:24 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:25.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:24 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:25.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:24 smithi194 ceph-mon[35228]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:25.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:24 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:25.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:24 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:25.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:24 smithi178 ceph-mon[34347]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:26.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:26 smithi194 ceph-mon[35228]: from='osd.8 [v2:172.21.15.194:6816/596878172,v1:172.21.15.194:6817/596878172]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T05:15:26.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:26 smithi194 ceph-mon[35228]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T05:15:26.406 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:15:26 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:15:26.075+0000 7fb857805640 -1 osd.8 0 log_to_monitors true 2024-09-19T05:15:26.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:26 smithi178 ceph-mon[34347]: from='osd.8 [v2:172.21.15.194:6816/596878172,v1:172.21.15.194:6817/596878172]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T05:15:26.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:26 smithi178 ceph-mon[34347]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T05:15:26.624 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:26 smithi120 ceph-mon[30956]: from='osd.8 [v2:172.21.15.194:6816/596878172,v1:172.21.15.194:6817/596878172]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T05:15:26.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:26 smithi120 ceph-mon[30956]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T05:15:26.627 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:15:26.658 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi120:vg_nvme/lv_1 2024-09-19T05:15:26.919 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:15:27.227 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:27 smithi120 ceph-mon[30956]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:27.227 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:27 smithi120 ceph-mon[30956]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T05:15:27.227 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:27 smithi120 ceph-mon[30956]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T05:15:27.228 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:27 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:15:27.228 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:27 smithi120 ceph-mon[30956]: from='osd.8 [v2:172.21.15.194:6816/596878172,v1:172.21.15.194:6817/596878172]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-19T05:15:27.228 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:27 smithi120 ceph-mon[30956]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-19T05:15:27.228 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:27 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:27.228 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:27 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:27.228 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:27 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:27.228 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:27 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:27.228 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:27 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:27.228 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:27 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:27.228 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:27 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:27.228 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:27 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:27.228 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:27 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:27.229 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:27 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:27.229 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:27 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:27.229 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:27 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:27.229 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:27 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:27.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:27 smithi194 ceph-mon[35228]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:27.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:27 smithi194 ceph-mon[35228]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T05:15:27.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:27 smithi194 ceph-mon[35228]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T05:15:27.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:27 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:15:27.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:27 smithi194 ceph-mon[35228]: from='osd.8 [v2:172.21.15.194:6816/596878172,v1:172.21.15.194:6817/596878172]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-19T05:15:27.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:27 smithi194 ceph-mon[35228]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-19T05:15:27.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:27 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:27.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:27 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:27.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:27 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:27.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:27 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:27.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:27 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:27.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:27 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:27.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:27 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:27.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:27 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:27.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:27 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:27.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:27 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:27.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:27 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:27.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:27 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:27.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:27 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:27.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.436+0000 7f80c268c640 1 -- 172.21.15.120:0/3378020467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80bc102690 msgr2=0x7f80bc108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:15:27.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.436+0000 7f80c268c640 1 --2- 172.21.15.120:0/3378020467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80bc102690 0x7f80bc108f20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009ca0 tx=0x7f80b402a8c0 comp rx=0 tx=0).stop 2024-09-19T05:15:27.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.436+0000 7f80c268c640 1 -- 172.21.15.120:0/3378020467 shutdown_connections 2024-09-19T05:15:27.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.436+0000 7f80c268c640 1 --2- 172.21.15.120:0/3378020467 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80bc102690 0x7f80bc108f20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:27.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.436+0000 7f80c268c640 1 --2- 172.21.15.120:0/3378020467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80bc101cd0 0x7f80bc102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:27.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.436+0000 7f80c268c640 1 --2- 172.21.15.120:0/3378020467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80bc100ad0 0x7f80bc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:27.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.436+0000 7f80c268c640 1 -- 172.21.15.120:0/3378020467 >> 172.21.15.120:0/3378020467 conn(0x7f80bc0fc280 msgr2=0x7f80bc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:15:27.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.436+0000 7f80c268c640 1 -- 172.21.15.120:0/3378020467 shutdown_connections 2024-09-19T05:15:27.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.436+0000 7f80c268c640 1 -- 172.21.15.120:0/3378020467 wait complete. 2024-09-19T05:15:27.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.437+0000 7f80c268c640 1 Processor -- start 2024-09-19T05:15:27.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.437+0000 7f80c268c640 1 -- start start 2024-09-19T05:15:27.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.437+0000 7f80c268c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80bc100ad0 0x7f80bc104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:15:27.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.437+0000 7f80c268c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80bc101cd0 0x7f80bc1030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:15:27.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.437+0000 7f80c268c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80bc102690 0x7f80bc1035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:15:27.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.437+0000 7f80c268c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc10c600 con 0x7f80bc102690 2024-09-19T05:15:27.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.437+0000 7f80c268c640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc10c480 con 0x7f80bc100ad0 2024-09-19T05:15:27.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.437+0000 7f80c268c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc10c780 con 0x7f80bc101cd0 2024-09-19T05:15:27.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.437+0000 7f80bbfff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80bc100ad0 0x7f80bc104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:15:27.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.437+0000 7f80bb7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80bc101cd0 0x7f80bc1030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:15:27.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.437+0000 7f80bbfff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80bc100ad0 0x7f80bc104a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:46064/0 (socket says 172.21.15.120:46064) 2024-09-19T05:15:27.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.437+0000 7f80bbfff640 1 -- 172.21.15.120:0/701218533 learned_addr learned my addr 172.21.15.120:0/701218533 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:15:27.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.438+0000 7f80c0c29640 1 --2- 172.21.15.120:0/701218533 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80bc102690 0x7f80bc1035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:15:27.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.438+0000 7f80bbfff640 1 -- 172.21.15.120:0/701218533 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80bc101cd0 msgr2=0x7f80bc1030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:15:27.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.438+0000 7f80bbfff640 1 --2- 172.21.15.120:0/701218533 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80bc101cd0 0x7f80bc1030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:27.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.438+0000 7f80bbfff640 1 -- 172.21.15.120:0/701218533 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80bc102690 msgr2=0x7f80bc1035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:15:27.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.438+0000 7f80bbfff640 1 --2- 172.21.15.120:0/701218533 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80bc102690 0x7f80bc1035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:27.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.438+0000 7f80bbfff640 1 -- 172.21.15.120:0/701218533 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80bc103eb0 con 0x7f80bc100ad0 2024-09-19T05:15:27.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.438+0000 7f80bbfff640 1 --2- 172.21.15.120:0/701218533 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80bc100ad0 0x7f80bc104a60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00d950 tx=0x7f80ac00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:15:27.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.438+0000 7f80b97fa640 1 -- 172.21.15.120:0/701218533 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac017020 con 0x7f80bc100ad0 2024-09-19T05:15:27.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.438+0000 7f80b97fa640 1 -- 172.21.15.120:0/701218533 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f80ac009c30 con 0x7f80bc100ad0 2024-09-19T05:15:27.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.438+0000 7f80c268c640 1 -- 172.21.15.120:0/701218533 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80bc1a1f70 con 0x7f80bc100ad0 2024-09-19T05:15:27.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.438+0000 7f80b97fa640 1 -- 172.21.15.120:0/701218533 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac00f6b0 con 0x7f80bc100ad0 2024-09-19T05:15:27.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.438+0000 7f80c268c640 1 -- 172.21.15.120:0/701218533 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80bc1a2360 con 0x7f80bc100ad0 2024-09-19T05:15:27.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:27 smithi178 ceph-mon[34347]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:27.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:27 smithi178 ceph-mon[34347]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T05:15:27.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:27 smithi178 ceph-mon[34347]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T05:15:27.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:27 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:15:27.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:27 smithi178 ceph-mon[34347]: from='osd.8 [v2:172.21.15.194:6816/596878172,v1:172.21.15.194:6817/596878172]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-19T05:15:27.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:27 smithi178 ceph-mon[34347]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-19T05:15:27.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:27 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:27.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:27 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:27.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:27 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:27.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:27 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:27.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:27 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:27.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:27 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:27.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:27 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:27.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:27 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:27.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:27 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:27.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:27 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:27.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:27 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:27.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:27 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:27.445 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:27 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:27.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.439+0000 7f80c268c640 1 -- 172.21.15.120:0/701218533 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80bc1a2620 con 0x7f80bc100ad0 2024-09-19T05:15:27.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.441+0000 7f80b97fa640 1 -- 172.21.15.120:0/701218533 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f80ac01a020 con 0x7f80bc100ad0 2024-09-19T05:15:27.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.442+0000 7f80b97fa640 1 --2- 172.21.15.120:0/701218533 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f80a40a3240 0x7f80a40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:15:27.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.442+0000 7f80bb7fe640 1 --2- 172.21.15.120:0/701218533 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f80a40a3240 0x7f80a40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:15:27.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.442+0000 7f80b97fa640 1 -- 172.21.15.120:0/701218533 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5549+0+0 (secure 0 0 0) 0x7f80ac0cedb0 con 0x7f80bc100ad0 2024-09-19T05:15:27.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.442+0000 7f80bb7fe640 1 --2- 172.21.15.120:0/701218533 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f80a40a3240 0x7f80a40a5700 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f80bc1047e0 tx=0x7f80b000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:15:27.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.445+0000 7f80b97fa640 1 -- 172.21.15.120:0/701218533 <== mon.2 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f80ac009de0 con 0x7f80bc100ad0 2024-09-19T05:15:27.629 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:27.627+0000 7f80c268c640 1 -- 172.21.15.120:0/701218533 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f80bc1a27f0 con 0x7f80a40a3240 2024-09-19T05:15:28.192 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:28 smithi120 ceph-mon[30956]: Detected new or changed devices on smithi194 2024-09-19T05:15:28.193 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:28 smithi120 ceph-mon[30956]: Adjusting osd_memory_target on smithi194 to 5696M 2024-09-19T05:15:28.193 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:28 smithi120 ceph-mon[30956]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-19T05:15:28.193 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:28 smithi120 ceph-mon[30956]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T05:15:28.193 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:28 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:15:28.193 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:28 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:15:28.193 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:28 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:15:28.193 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:28 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:15:28.193 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:28 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:28.193 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:28 smithi120 ceph-mon[30956]: from='osd.8 ' entity='osd.8' 2024-09-19T05:15:28.405 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:15:27 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:15:27.945+0000 7fb852f65640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T05:15:28.405 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:15:27 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:15:27.957+0000 7fb84b597640 -1 osd.8 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:15:28.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:28 smithi194 ceph-mon[35228]: Detected new or changed devices on smithi194 2024-09-19T05:15:28.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:28 smithi194 ceph-mon[35228]: Adjusting osd_memory_target on smithi194 to 5696M 2024-09-19T05:15:28.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:28 smithi194 ceph-mon[35228]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-19T05:15:28.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:28 smithi194 ceph-mon[35228]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T05:15:28.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:28 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:15:28.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:28 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:15:28.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:28 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:15:28.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:28 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:15:28.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:28 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:28.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:28 smithi194 ceph-mon[35228]: from='osd.8 ' entity='osd.8' 2024-09-19T05:15:28.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:28 smithi178 ceph-mon[34347]: Detected new or changed devices on smithi194 2024-09-19T05:15:28.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:28 smithi178 ceph-mon[34347]: Adjusting osd_memory_target on smithi194 to 5696M 2024-09-19T05:15:28.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:28 smithi178 ceph-mon[34347]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-19T05:15:28.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:28 smithi178 ceph-mon[34347]: osdmap e55: 9 total, 8 up, 9 in 2024-09-19T05:15:28.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:28 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:15:28.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:28 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:15:28.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:28 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:15:28.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:28 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:15:28.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:28 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:28.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:28 smithi178 ceph-mon[34347]: from='osd.8 ' entity='osd.8' 2024-09-19T05:15:29.233 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:29 smithi120 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T05:15:29.233 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:29 smithi120 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T05:15:29.233 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:29 smithi120 ceph-mon[30956]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:15:29.233 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:29 smithi120 ceph-mon[30956]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:29.233 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:29 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:15:29.233 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:29 smithi120 ceph-mon[30956]: osd.8 [v2:172.21.15.194:6816/596878172,v1:172.21.15.194:6817/596878172] boot 2024-09-19T05:15:29.233 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:29 smithi120 ceph-mon[30956]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T05:15:29.234 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:29 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:15:29.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:29 smithi194 ceph-mon[35228]: purged_snaps scrub starts 2024-09-19T05:15:29.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:29 smithi194 ceph-mon[35228]: purged_snaps scrub ok 2024-09-19T05:15:29.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:29 smithi194 ceph-mon[35228]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:15:29.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:29 smithi194 ceph-mon[35228]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:29.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:29 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:15:29.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:29 smithi194 ceph-mon[35228]: osd.8 [v2:172.21.15.194:6816/596878172,v1:172.21.15.194:6817/596878172] boot 2024-09-19T05:15:29.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:29 smithi194 ceph-mon[35228]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T05:15:29.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:29 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:15:29.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:29 smithi178 ceph-mon[34347]: purged_snaps scrub starts 2024-09-19T05:15:29.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:29 smithi178 ceph-mon[34347]: purged_snaps scrub ok 2024-09-19T05:15:29.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:29 smithi178 ceph-mon[34347]: from='client.24290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi120:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:15:29.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:29 smithi178 ceph-mon[34347]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-19T05:15:29.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:15:29.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:29 smithi178 ceph-mon[34347]: osd.8 [v2:172.21.15.194:6816/596878172,v1:172.21.15.194:6817/596878172] boot 2024-09-19T05:15:29.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:29 smithi178 ceph-mon[34347]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T05:15:29.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:15:30.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:30 smithi194 ceph-mon[35228]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T05:15:30.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:30 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1101922770' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9393b018-c924-4d75-99e5-25433d276567"}]: dispatch 2024-09-19T05:15:30.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:30 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1101922770' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9393b018-c924-4d75-99e5-25433d276567"}]': finished 2024-09-19T05:15:30.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:30 smithi194 ceph-mon[35228]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T05:15:30.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:30 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:15:30.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:30 smithi178 ceph-mon[34347]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T05:15:30.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:30 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1101922770' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9393b018-c924-4d75-99e5-25433d276567"}]: dispatch 2024-09-19T05:15:30.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:30 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1101922770' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9393b018-c924-4d75-99e5-25433d276567"}]': finished 2024-09-19T05:15:30.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:30 smithi178 ceph-mon[34347]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T05:15:30.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:30 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:15:30.483 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:30 smithi120 ceph-mon[30956]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T05:15:30.484 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:30 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1101922770' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9393b018-c924-4d75-99e5-25433d276567"}]: dispatch 2024-09-19T05:15:30.484 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:30 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1101922770' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9393b018-c924-4d75-99e5-25433d276567"}]': finished 2024-09-19T05:15:30.484 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:30 smithi120 ceph-mon[30956]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T05:15:30.484 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:30 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:15:31.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:31 smithi178 ceph-mon[34347]: pgmap v189: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:15:31.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:31 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/440508589' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:15:31.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:31 smithi178 ceph-mon[34347]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T05:15:31.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:31 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:15:31.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:31 smithi120 ceph-mon[30956]: pgmap v189: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:15:31.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:31 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/440508589' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:15:31.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:31 smithi120 ceph-mon[30956]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T05:15:31.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:31 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:15:31.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:31 smithi194 ceph-mon[35228]: pgmap v189: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:15:31.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:31 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/440508589' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:15:31.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:31 smithi194 ceph-mon[35228]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T05:15:31.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:31 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:15:33.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:32 smithi120 ceph-mon[30956]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T05:15:33.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:32 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:15:33.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:32 smithi120 ceph-mon[30956]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:15:33.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:32 smithi194 ceph-mon[35228]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T05:15:33.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:32 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:15:33.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:32 smithi194 ceph-mon[35228]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:15:33.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:32 smithi178 ceph-mon[34347]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T05:15:33.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:32 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:15:33.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:32 smithi178 ceph-mon[34347]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:15:35.350 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:35 smithi120 ceph-mon[30956]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:15:35.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:35 smithi194 ceph-mon[35228]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:15:35.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:35 smithi178 ceph-mon[34347]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:15:37.334 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:37 smithi120 ceph-mon[30956]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-19T05:15:37.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:37 smithi194 ceph-mon[35228]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-19T05:15:37.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:37 smithi178 ceph-mon[34347]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 94 KiB/s, 0 objects/s recovering 2024-09-19T05:15:39.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:39 smithi120 ceph-mon[30956]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T05:15:39.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:39 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T05:15:39.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:39 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:39.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:39 smithi194 ceph-mon[35228]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T05:15:39.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:39 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T05:15:39.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:39 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:39.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:39 smithi178 ceph-mon[34347]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T05:15:39.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:39 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T05:15:39.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:39 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:40.342 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:40 smithi120 ceph-mon[30956]: Deploying daemon osd.9 on smithi120 2024-09-19T05:15:40.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:40 smithi194 ceph-mon[35228]: Deploying daemon osd.9 on smithi120 2024-09-19T05:15:40.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:40 smithi178 ceph-mon[34347]: Deploying daemon osd.9 on smithi120 2024-09-19T05:15:41.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:41 smithi194 ceph-mon[35228]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-19T05:15:41.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:41 smithi178 ceph-mon[34347]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-19T05:15:41.497 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:41 smithi120 ceph-mon[30956]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-19T05:15:43.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:43 smithi194 ceph-mon[35228]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-19T05:15:43.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:43 smithi178 ceph-mon[34347]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-19T05:15:43.519 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:43 smithi120 ceph-mon[30956]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-19T05:15:44.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:44 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:44.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:44 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:44.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:44 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:44.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:44 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:44.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:44 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:44.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:44 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:44.477 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:44 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:44.477 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:44 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:44.477 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:44 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:45.437 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:45 smithi194 ceph-mon[35228]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T05:15:45.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:45 smithi178 ceph-mon[34347]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T05:15:45.454 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:45 smithi120 ceph-mon[30956]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T05:15:47.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:47 smithi178 ceph-mon[34347]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T05:15:47.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:47 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:47.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:47 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:47.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:47 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:47.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:47 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:47.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:47 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:47.446 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:47 smithi120 ceph-mon[30956]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T05:15:47.446 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:47 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:47.446 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:47 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:47.446 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:47 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:47.446 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:47 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:47.446 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:47 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:47.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:47.444+0000 7f80b97fa640 1 -- 172.21.15.120:0/701218533 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f80bc1a27f0 con 0x7f80a40a3240 2024-09-19T05:15:47.447 INFO:teuthology.orchestra.run.smithi120.stdout:Created osd(s) 9 on host 'smithi120' 2024-09-19T05:15:47.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:47.447+0000 7f80c268c640 1 -- 172.21.15.120:0/701218533 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f80a40a3240 msgr2=0x7f80a40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:15:47.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:47.447+0000 7f80c268c640 1 --2- 172.21.15.120:0/701218533 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f80a40a3240 0x7f80a40a5700 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f80bc1047e0 tx=0x7f80b000b390 comp rx=0 tx=0).stop 2024-09-19T05:15:47.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:47.447+0000 7f80c268c640 1 -- 172.21.15.120:0/701218533 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80bc100ad0 msgr2=0x7f80bc104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:15:47.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:47.447+0000 7f80c268c640 1 --2- 172.21.15.120:0/701218533 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80bc100ad0 0x7f80bc104a60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00d950 tx=0x7f80ac00de10 comp rx=0 tx=0).stop 2024-09-19T05:15:47.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:47.447+0000 7f80c268c640 1 -- 172.21.15.120:0/701218533 shutdown_connections 2024-09-19T05:15:47.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:47.447+0000 7f80c268c640 1 --2- 172.21.15.120:0/701218533 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80bc102690 0x7f80bc1035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:47.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:47.447+0000 7f80c268c640 1 --2- 172.21.15.120:0/701218533 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f80a40a3240 0x7f80a40a5700 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:47.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:47.447+0000 7f80c268c640 1 --2- 172.21.15.120:0/701218533 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80bc101cd0 0x7f80bc1030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:47.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:47.447+0000 7f80c268c640 1 --2- 172.21.15.120:0/701218533 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80bc100ad0 0x7f80bc104a60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:47.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:47.447+0000 7f80c268c640 1 -- 172.21.15.120:0/701218533 >> 172.21.15.120:0/701218533 conn(0x7f80bc0fc280 msgr2=0x7f80bc069fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:15:47.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:47.447+0000 7f80c268c640 1 -- 172.21.15.120:0/701218533 shutdown_connections 2024-09-19T05:15:47.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:15:47.447+0000 7f80c268c640 1 -- 172.21.15.120:0/701218533 wait complete. 2024-09-19T05:15:47.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:47 smithi194 ceph-mon[35228]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T05:15:47.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:47 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:47.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:47 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:47.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:47 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:47.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:47 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:47.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:47 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:48.053 DEBUG:teuthology.orchestra.run.smithi120:osd.9> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T05:15:48.056 INFO:tasks.cephadm:Deploying osd.10 on smithi178 with /dev/vg_nvme/lv_1... 2024-09-19T05:15:48.056 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T05:15:48.277 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:48.278 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:48.278 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:48.317 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:15:48.438 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:48 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:48.438 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:48 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:48.438 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:48 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:48.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:48 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:15:48.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:48 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:48.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:48 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:49.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:49 smithi178 ceph-mon[34347]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:15:49.492 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:49 smithi120 ceph-mon[30956]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:15:49.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:49 smithi194 ceph-mon[35228]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:15:50.125 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:15:49 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:15:49.914+0000 7efc09952640 -1 osd.9 0 log_to_monitors true 2024-09-19T05:15:50.378 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:50 smithi178 ceph-mon[34347]: from='osd.9 [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T05:15:50.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:50 smithi120 ceph-mon[30956]: from='osd.9 [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T05:15:50.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:50 smithi194 ceph-mon[35228]: from='osd.9 [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T05:15:50.730 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-19T05:15:50.762 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi178:vg_nvme/lv_1 2024-09-19T05:15:51.015 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:15:51.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:51 smithi120 ceph-mon[30956]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:15:51.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:51 smithi120 ceph-mon[30956]: from='osd.9 [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T05:15:51.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:51 smithi120 ceph-mon[30956]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T05:15:51.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:51 smithi120 ceph-mon[30956]: from='osd.9 [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-09-19T05:15:51.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:51 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:15:51.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:51 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:51.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:51 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:51.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:51 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:51.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:51 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:51.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:51 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:51.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:51 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:51.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:51 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:51.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:51 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:51.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:51 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:51.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:51 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:51.390 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:51 smithi178 ceph-mon[34347]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:15:51.390 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:51 smithi178 ceph-mon[34347]: from='osd.9 [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T05:15:51.391 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:51 smithi178 ceph-mon[34347]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T05:15:51.391 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:51 smithi178 ceph-mon[34347]: from='osd.9 [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-09-19T05:15:51.391 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:51 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:15:51.391 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:51 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:51.391 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:51 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:51.391 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:51 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:51.391 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:51 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:51.391 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:51 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:51.391 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:51 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:51.391 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:51 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:51.391 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:51 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:51.391 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:51 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:51.391 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:51 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:51.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.543+0000 7f3ec54b8640 1 -- 172.21.15.178:0/302309878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ec01079c0 msgr2=0x7f3ec0109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:15:51.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.543+0000 7f3ec54b8640 1 --2- 172.21.15.178:0/302309878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ec01079c0 0x7f3ec0109db0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0009900 tx=0x7f3eb002a410 comp rx=0 tx=0).stop 2024-09-19T05:15:51.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.543+0000 7f3ec54b8640 1 -- 172.21.15.178:0/302309878 shutdown_connections 2024-09-19T05:15:51.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.543+0000 7f3ec54b8640 1 --2- 172.21.15.178:0/302309878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ec01079c0 0x7f3ec0109db0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:51.548 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.543+0000 7f3ec54b8640 1 --2- 172.21.15.178:0/302309878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ec0105090 0x7f3ec0107480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:51.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.543+0000 7f3ec54b8640 1 --2- 172.21.15.178:0/302309878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ec0102760 0x7f3ec0104b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:51.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.543+0000 7f3ec54b8640 1 -- 172.21.15.178:0/302309878 >> 172.21.15.178:0/302309878 conn(0x7f3ec00fc2a0 msgr2=0x7f3ec00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:15:51.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.543+0000 7f3ec54b8640 1 -- 172.21.15.178:0/302309878 shutdown_connections 2024-09-19T05:15:51.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.543+0000 7f3ec54b8640 1 -- 172.21.15.178:0/302309878 wait complete. 2024-09-19T05:15:51.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.544+0000 7f3ec54b8640 1 Processor -- start 2024-09-19T05:15:51.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.544+0000 7f3ec54b8640 1 -- start start 2024-09-19T05:15:51.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.544+0000 7f3ec54b8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ec0102760 0x7f3ec0197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:15:51.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.544+0000 7f3ec54b8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ec0105090 0x7f3ec0198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:15:51.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.544+0000 7f3ec54b8640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ec01079c0 0x7f3ec019f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:15:51.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.544+0000 7f3ec54b8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec010d780 con 0x7f3ec0102760 2024-09-19T05:15:51.549 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.544+0000 7f3ec54b8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec010d600 con 0x7f3ec0105090 2024-09-19T05:15:51.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.544+0000 7f3ec54b8640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec010d900 con 0x7f3ec01079c0 2024-09-19T05:15:51.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.544+0000 7f3ebe7fc640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ec0105090 0x7f3ec0198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:15:51.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.545+0000 7f3ebe7fc640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ec0105090 0x7f3ec0198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:37010/0 (socket says 172.21.15.178:37010) 2024-09-19T05:15:51.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.545+0000 7f3ebe7fc640 1 -- 172.21.15.178:0/457151950 learned_addr learned my addr 172.21.15.178:0/457151950 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-19T05:15:51.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.545+0000 7f3ebeffd640 1 --2- 172.21.15.178:0/457151950 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ec0102760 0x7f3ec0197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:15:51.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.545+0000 7f3ebf7fe640 1 --2- 172.21.15.178:0/457151950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ec01079c0 0x7f3ec019f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:15:51.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.545+0000 7f3ebe7fc640 1 -- 172.21.15.178:0/457151950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ec01079c0 msgr2=0x7f3ec019f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:15:51.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.545+0000 7f3ebe7fc640 1 --2- 172.21.15.178:0/457151950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ec01079c0 0x7f3ec019f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:51.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.545+0000 7f3ebe7fc640 1 -- 172.21.15.178:0/457151950 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ec0102760 msgr2=0x7f3ec0197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:15:51.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.545+0000 7f3ebe7fc640 1 --2- 172.21.15.178:0/457151950 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ec0102760 0x7f3ec0197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:15:51.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.545+0000 7f3ebe7fc640 1 -- 172.21.15.178:0/457151950 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec019fa60 con 0x7f3ec0105090 2024-09-19T05:15:51.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.545+0000 7f3ebe7fc640 1 --2- 172.21.15.178:0/457151950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ec0105090 0x7f3ec0198370 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3ea800c970 tx=0x7f3ea800ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:15:51.550 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.545+0000 7f3eb7fff640 1 -- 172.21.15.178:0/457151950 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea8007bb0 con 0x7f3ec0105090 2024-09-19T05:15:51.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.545+0000 7f3eb7fff640 1 -- 172.21.15.178:0/457151950 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3ea8007d50 con 0x7f3ec0105090 2024-09-19T05:15:51.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.545+0000 7f3ec54b8640 1 -- 172.21.15.178:0/457151950 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec019fd50 con 0x7f3ec0105090 2024-09-19T05:15:51.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.545+0000 7f3eb7fff640 1 -- 172.21.15.178:0/457151950 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ea8018730 con 0x7f3ec0105090 2024-09-19T05:15:51.551 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.545+0000 7f3ec54b8640 1 -- 172.21.15.178:0/457151950 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec01a0230 con 0x7f3ec0105090 2024-09-19T05:15:51.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.546+0000 7f3ec54b8640 1 -- 172.21.15.178:0/457151950 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec00fdd90 con 0x7f3ec0105090 2024-09-19T05:15:51.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.547+0000 7f3eb7fff640 1 -- 172.21.15.178:0/457151950 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f3ea800f450 con 0x7f3ec0105090 2024-09-19T05:15:51.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.548+0000 7f3eb7fff640 1 --2- 172.21.15.178:0/457151950 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3eac0a32f0 0x7f3eac0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:15:51.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.548+0000 7f3eb7fff640 1 -- 172.21.15.178:0/457151950 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5981+0+0 (secure 0 0 0) 0x7f3ea80cf3b0 con 0x7f3ec0105090 2024-09-19T05:15:51.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.548+0000 7f3ebeffd640 1 --2- 172.21.15.178:0/457151950 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3eac0a32f0 0x7f3eac0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:15:51.552 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.549+0000 7f3ebeffd640 1 --2- 172.21.15.178:0/457151950 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3eac0a32f0 0x7f3eac0a57b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8005fd0 tx=0x7f3eb8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:15:51.554 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.551+0000 7f3eb7fff640 1 -- 172.21.15.178:0/457151950 <== mon.2 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3ea8014030 con 0x7f3ec0105090 2024-09-19T05:15:51.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:51 smithi194 ceph-mon[35228]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:15:51.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:51 smithi194 ceph-mon[35228]: from='osd.9 [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T05:15:51.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:51 smithi194 ceph-mon[35228]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T05:15:51.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:51 smithi194 ceph-mon[35228]: from='osd.9 [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]: dispatch 2024-09-19T05:15:51.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:51 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:15:51.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:51 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:51.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:51 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:51.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:51 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:51.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:51 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:51.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:51 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:51.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:51 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:15:51.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:51 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:51.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:51 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:51.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:51 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:15:51.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:51 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:15:51.729 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:15:51.726+0000 7f3ec54b8640 1 -- 172.21.15.178:0/457151950 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f3ec0062630 con 0x7f3eac0a32f0 2024-09-19T05:15:52.375 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:15:52 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:15:52.009+0000 7efc050b2640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T05:15:52.375 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:15:52 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:15:52.027+0000 7efbfd6e4640 -1 osd.9 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:15:52.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:52 smithi120 ceph-mon[30956]: Detected new or changed devices on smithi120 2024-09-19T05:15:52.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:52 smithi120 ceph-mon[30956]: Adjusting osd_memory_target on smithi120 to 4272M 2024-09-19T05:15:52.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:52 smithi120 ceph-mon[30956]: from='osd.9 [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-09-19T05:15:52.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:52 smithi120 ceph-mon[30956]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T05:15:52.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:52 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:15:52.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:52 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:15:52.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:52 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:15:52.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:52 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:15:52.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:52 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:52.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:52 smithi120 ceph-mon[30956]: from='osd.9 [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801]' entity='osd.9' 2024-09-19T05:15:52.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:52 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:15:52.433 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:52 smithi178 ceph-mon[34347]: Detected new or changed devices on smithi120 2024-09-19T05:15:52.433 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:52 smithi178 ceph-mon[34347]: Adjusting osd_memory_target on smithi120 to 4272M 2024-09-19T05:15:52.433 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:52 smithi178 ceph-mon[34347]: from='osd.9 [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-09-19T05:15:52.434 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:52 smithi178 ceph-mon[34347]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T05:15:52.434 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:52 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:15:52.434 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:52 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:15:52.434 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:52 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:15:52.434 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:52 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:15:52.434 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:52 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:52.434 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:52 smithi178 ceph-mon[34347]: from='osd.9 [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801]' entity='osd.9' 2024-09-19T05:15:52.434 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:52 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:15:52.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:52 smithi194 ceph-mon[35228]: Detected new or changed devices on smithi120 2024-09-19T05:15:52.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:52 smithi194 ceph-mon[35228]: Adjusting osd_memory_target on smithi120 to 4272M 2024-09-19T05:15:52.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:52 smithi194 ceph-mon[35228]: from='osd.9 [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi120", "root=default"]}]': finished 2024-09-19T05:15:52.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:52 smithi194 ceph-mon[35228]: osdmap e62: 10 total, 9 up, 10 in 2024-09-19T05:15:52.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:52 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:15:52.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:52 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:15:52.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:52 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:15:52.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:52 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:15:52.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:52 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:15:52.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:52 smithi194 ceph-mon[35228]: from='osd.9 [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801]' entity='osd.9' 2024-09-19T05:15:52.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:52 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:15:53.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:53 smithi178 ceph-mon[34347]: purged_snaps scrub starts 2024-09-19T05:15:53.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:53 smithi178 ceph-mon[34347]: purged_snaps scrub ok 2024-09-19T05:15:53.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:53 smithi178 ceph-mon[34347]: from='client.24308 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:15:53.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:53 smithi178 ceph-mon[34347]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:15:53.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:53 smithi178 ceph-mon[34347]: osd.9 [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801] boot 2024-09-19T05:15:53.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:53 smithi178 ceph-mon[34347]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T05:15:53.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:53 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:15:53.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:53 smithi120 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T05:15:53.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:53 smithi120 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T05:15:53.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:53 smithi120 ceph-mon[30956]: from='client.24308 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:15:53.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:53 smithi120 ceph-mon[30956]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:15:53.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:53 smithi120 ceph-mon[30956]: osd.9 [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801] boot 2024-09-19T05:15:53.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:53 smithi120 ceph-mon[30956]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T05:15:53.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:53 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:15:53.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:53 smithi194 ceph-mon[35228]: purged_snaps scrub starts 2024-09-19T05:15:53.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:53 smithi194 ceph-mon[35228]: purged_snaps scrub ok 2024-09-19T05:15:53.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:53 smithi194 ceph-mon[35228]: from='client.24308 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi178:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:15:53.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:53 smithi194 ceph-mon[35228]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T05:15:53.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:53 smithi194 ceph-mon[35228]: osd.9 [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801] boot 2024-09-19T05:15:53.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:53 smithi194 ceph-mon[35228]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T05:15:53.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:53 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:15:54.605 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:54 smithi178 ceph-mon[34347]: from='client.? 172.21.15.178:0/2612297767' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45db7f62-87a6-4b2b-a3dc-012e2de505e2"}]: dispatch 2024-09-19T05:15:54.605 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:54 smithi178 ceph-mon[34347]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45db7f62-87a6-4b2b-a3dc-012e2de505e2"}]: dispatch 2024-09-19T05:15:54.605 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:54 smithi178 ceph-mon[34347]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "45db7f62-87a6-4b2b-a3dc-012e2de505e2"}]': finished 2024-09-19T05:15:54.605 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:54 smithi178 ceph-mon[34347]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T05:15:54.605 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:54 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:15:54.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:54 smithi120 ceph-mon[30956]: from='client.? 172.21.15.178:0/2612297767' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45db7f62-87a6-4b2b-a3dc-012e2de505e2"}]: dispatch 2024-09-19T05:15:54.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:54 smithi120 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45db7f62-87a6-4b2b-a3dc-012e2de505e2"}]: dispatch 2024-09-19T05:15:54.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:54 smithi120 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "45db7f62-87a6-4b2b-a3dc-012e2de505e2"}]': finished 2024-09-19T05:15:54.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:54 smithi120 ceph-mon[30956]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T05:15:54.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:54 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:15:54.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:54 smithi194 ceph-mon[35228]: from='client.? 172.21.15.178:0/2612297767' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45db7f62-87a6-4b2b-a3dc-012e2de505e2"}]: dispatch 2024-09-19T05:15:54.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:54 smithi194 ceph-mon[35228]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45db7f62-87a6-4b2b-a3dc-012e2de505e2"}]: dispatch 2024-09-19T05:15:54.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:54 smithi194 ceph-mon[35228]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "45db7f62-87a6-4b2b-a3dc-012e2de505e2"}]': finished 2024-09-19T05:15:54.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:54 smithi194 ceph-mon[35228]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T05:15:54.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:54 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:15:55.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:55 smithi194 ceph-mon[35228]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:15:55.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:55 smithi194 ceph-mon[35228]: from='client.? 172.21.15.178:0/3809676916' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:15:55.526 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:55 smithi120 ceph-mon[30956]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:15:55.526 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:55 smithi120 ceph-mon[30956]: from='client.? 172.21.15.178:0/3809676916' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:15:55.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:55 smithi178 ceph-mon[34347]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:15:55.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:55 smithi178 ceph-mon[34347]: from='client.? 172.21.15.178:0/3809676916' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:15:57.496 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:57 smithi178 ceph-mon[34347]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:15:57.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:57 smithi120 ceph-mon[30956]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:15:57.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:57 smithi194 ceph-mon[35228]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:15:59.495 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:15:59 smithi178 ceph-mon[34347]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:15:59.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:15:59 smithi120 ceph-mon[30956]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:15:59.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:15:59 smithi194 ceph-mon[35228]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:01.430 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:01 smithi178 ceph-mon[34347]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:01.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:01 smithi120 ceph-mon[30956]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:01.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:01 smithi194 ceph-mon[35228]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:03.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:03 smithi178 ceph-mon[34347]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:03.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T05:16:03.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:03.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:03 smithi120 ceph-mon[30956]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:03.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T05:16:03.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:03.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:03 smithi194 ceph-mon[35228]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:03.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T05:16:03.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:04.322 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:04 smithi178 ceph-mon[34347]: Deploying daemon osd.10 on smithi178 2024-09-19T05:16:04.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:04 smithi120 ceph-mon[30956]: Deploying daemon osd.10 on smithi178 2024-09-19T05:16:04.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:04 smithi194 ceph-mon[35228]: Deploying daemon osd.10 on smithi178 2024-09-19T05:16:05.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:05 smithi178 ceph-mon[34347]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:05.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:05 smithi120 ceph-mon[30956]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:05.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:05 smithi194 ceph-mon[35228]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:07.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:07 smithi178 ceph-mon[34347]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:07.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:07 smithi120 ceph-mon[30956]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:07.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:07 smithi194 ceph-mon[35228]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:08.536 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:08 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:08.536 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:08 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:08.536 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:08 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:08.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:08 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:08.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:08 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:08.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:08 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:08.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:08 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:08.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:08 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:08.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:08 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:09.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:09 smithi120 ceph-mon[30956]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:09.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:09 smithi194 ceph-mon[35228]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:09.685 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:09 smithi178 ceph-mon[34347]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:11.371 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:11 smithi178 ceph-mon[34347]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:11.409 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:16:11.407+0000 7f3eb7fff640 1 -- 172.21.15.178:0/457151950 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f3ec0062630 con 0x7f3eac0a32f0 2024-09-19T05:16:11.409 INFO:teuthology.orchestra.run.smithi178.stdout:Created osd(s) 10 on host 'smithi178' 2024-09-19T05:16:11.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:16:11.409+0000 7f3ec54b8640 1 -- 172.21.15.178:0/457151950 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3eac0a32f0 msgr2=0x7f3eac0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:11.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:16:11.409+0000 7f3ec54b8640 1 --2- 172.21.15.178:0/457151950 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3eac0a32f0 0x7f3eac0a57b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8005fd0 tx=0x7f3eb8009500 comp rx=0 tx=0).stop 2024-09-19T05:16:11.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:16:11.409+0000 7f3ec54b8640 1 -- 172.21.15.178:0/457151950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ec0105090 msgr2=0x7f3ec0198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:11.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:16:11.409+0000 7f3ec54b8640 1 --2- 172.21.15.178:0/457151950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ec0105090 0x7f3ec0198370 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3ea800c970 tx=0x7f3ea800ce30 comp rx=0 tx=0).stop 2024-09-19T05:16:11.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:16:11.409+0000 7f3ec54b8640 1 -- 172.21.15.178:0/457151950 shutdown_connections 2024-09-19T05:16:11.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:16:11.409+0000 7f3ec54b8640 1 --2- 172.21.15.178:0/457151950 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3eac0a32f0 0x7f3eac0a57b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:11.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:16:11.409+0000 7f3ec54b8640 1 --2- 172.21.15.178:0/457151950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ec01079c0 0x7f3ec019f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:11.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:16:11.409+0000 7f3ec54b8640 1 --2- 172.21.15.178:0/457151950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ec0105090 0x7f3ec0198370 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:11.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:16:11.409+0000 7f3ec54b8640 1 --2- 172.21.15.178:0/457151950 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ec0102760 0x7f3ec0197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:11.411 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:16:11.409+0000 7f3ec54b8640 1 -- 172.21.15.178:0/457151950 >> 172.21.15.178:0/457151950 conn(0x7f3ec00fc2a0 msgr2=0x7f3ec0103200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:11.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:16:11.409+0000 7f3ec54b8640 1 -- 172.21.15.178:0/457151950 shutdown_connections 2024-09-19T05:16:11.412 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-19T05:16:11.409+0000 7f3ec54b8640 1 -- 172.21.15.178:0/457151950 wait complete. 2024-09-19T05:16:11.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:11 smithi120 ceph-mon[30956]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:11.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:11 smithi194 ceph-mon[35228]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:12.045 DEBUG:teuthology.orchestra.run.smithi178:osd.10> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T05:16:12.048 INFO:tasks.cephadm:Deploying osd.11 on smithi194 with /dev/vg_nvme/lv_1... 2024-09-19T05:16:12.048 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T05:16:12.303 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:16:12.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:12 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:12.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:12 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:12.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:12 smithi194 ceph-mon[35228]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:12.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:12 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:12.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:12 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:12.691 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:12 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:12.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:12 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:12.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:12 smithi178 ceph-mon[34347]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:12.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:12 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:12.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:12 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:12.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:12 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:12.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:12 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:12.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:12 smithi120 ceph-mon[30956]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:12.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:12 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:12.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:12 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:14.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:16:14 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:16:14.379+0000 7f4148595640 -1 osd.10 0 log_to_monitors true 2024-09-19T05:16:14.996 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-19T05:16:15.022 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi194:vg_nvme/lv_1 2024-09-19T05:16:15.276 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:16:15.398 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:15 smithi194 ceph-mon[35228]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:15.398 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:15 smithi194 ceph-mon[35228]: from='osd.10 [v2:172.21.15.178:6824/3067822030,v1:172.21.15.178:6825/3067822030]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T05:16:15.398 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:15 smithi194 ceph-mon[35228]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T05:16:15.398 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:15 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:15.398 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:15 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:15.398 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:15 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:15.398 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:15 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:15.398 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:15 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:15.398 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:15 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:15.398 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:15 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:15.398 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:15 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:15.398 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:15 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:15.399 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:15 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:15.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:15 smithi178 ceph-mon[34347]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:15.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:15 smithi178 ceph-mon[34347]: from='osd.10 [v2:172.21.15.178:6824/3067822030,v1:172.21.15.178:6825/3067822030]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T05:16:15.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:15 smithi178 ceph-mon[34347]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T05:16:15.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:15 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:15.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:15 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:15.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:15 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:15.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:15 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:15.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:15 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:15.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:15 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:15.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:15 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:15.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:15 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:15.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:15 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:15.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:15 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:15.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:15 smithi120 ceph-mon[30956]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:15.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:15 smithi120 ceph-mon[30956]: from='osd.10 [v2:172.21.15.178:6824/3067822030,v1:172.21.15.178:6825/3067822030]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T05:16:15.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:15 smithi120 ceph-mon[30956]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T05:16:15.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:15 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:15.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:15 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:15.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:15 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:15.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:15 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:15.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:15 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:15.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:15 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:15.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:15 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:15.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:15 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:15.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:15 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:15.627 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:15 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:15.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.781+0000 7f41e19a4640 1 -- 172.21.15.194:0/1236639020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41dc1037c0 msgr2=0x7f41dc10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:15.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.781+0000 7f41e19a4640 1 --2- 172.21.15.194:0/1236639020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41dc1037c0 0x7f41dc10a050 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009ca0 tx=0x7f41d402a8c0 comp rx=0 tx=0).stop 2024-09-19T05:16:15.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.781+0000 7f41e19a4640 1 -- 172.21.15.194:0/1236639020 shutdown_connections 2024-09-19T05:16:15.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.781+0000 7f41e19a4640 1 --2- 172.21.15.194:0/1236639020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41dc1037c0 0x7f41dc10a050 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:15.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.781+0000 7f41e19a4640 1 --2- 172.21.15.194:0/1236639020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41dc102e00 0x7f41dc103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:15.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.781+0000 7f41e19a4640 1 --2- 172.21.15.194:0/1236639020 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41dc101c00 0x7f41dc102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:15.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.781+0000 7f41e19a4640 1 -- 172.21.15.194:0/1236639020 >> 172.21.15.194:0/1236639020 conn(0x7f41dc0fd390 msgr2=0x7f41dc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:15.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.781+0000 7f41e19a4640 1 -- 172.21.15.194:0/1236639020 shutdown_connections 2024-09-19T05:16:15.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.781+0000 7f41e19a4640 1 -- 172.21.15.194:0/1236639020 wait complete. 2024-09-19T05:16:15.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.781+0000 7f41e19a4640 1 Processor -- start 2024-09-19T05:16:15.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.782+0000 7f41e19a4640 1 -- start start 2024-09-19T05:16:15.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.782+0000 7f41e19a4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41dc101c00 0x7f41dc075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:15.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.782+0000 7f41e19a4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41dc102e00 0x7f41dc0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:15.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.782+0000 7f41e19a4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41dc1037c0 0x7f41dc074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:15.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.782+0000 7f41e19a4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc10d790 con 0x7f41dc1037c0 2024-09-19T05:16:15.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.782+0000 7f41e19a4640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc10d610 con 0x7f41dc101c00 2024-09-19T05:16:15.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.782+0000 7f41e19a4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc10d910 con 0x7f41dc102e00 2024-09-19T05:16:15.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.782+0000 7f41da7fc640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41dc102e00 0x7f41dc0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:15.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.782+0000 7f41da7fc640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41dc102e00 0x7f41dc0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:35148/0 (socket says 172.21.15.194:35148) 2024-09-19T05:16:15.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.782+0000 7f41da7fc640 1 -- 172.21.15.194:0/2985957514 learned_addr learned my addr 172.21.15.194:0/2985957514 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T05:16:15.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.782+0000 7f41daffd640 1 --2- 172.21.15.194:0/2985957514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41dc101c00 0x7f41dc075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:15.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.782+0000 7f41db7fe640 1 --2- 172.21.15.194:0/2985957514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41dc1037c0 0x7f41dc074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:15.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.782+0000 7f41da7fc640 1 -- 172.21.15.194:0/2985957514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41dc101c00 msgr2=0x7f41dc075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:15.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.782+0000 7f41da7fc640 1 --2- 172.21.15.194:0/2985957514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41dc101c00 0x7f41dc075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:15.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.782+0000 7f41da7fc640 1 -- 172.21.15.194:0/2985957514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41dc1037c0 msgr2=0x7f41dc074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:15.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.782+0000 7f41da7fc640 1 --2- 172.21.15.194:0/2985957514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41dc1037c0 0x7f41dc074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:15.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.782+0000 7f41da7fc640 1 -- 172.21.15.194:0/2985957514 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41dc0753e0 con 0x7f41dc102e00 2024-09-19T05:16:15.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.782+0000 7f41daffd640 1 --2- 172.21.15.194:0/2985957514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41dc101c00 0x7f41dc075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:16:15.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.782+0000 7f41db7fe640 1 --2- 172.21.15.194:0/2985957514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41dc1037c0 0x7f41dc074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:16:15.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.782+0000 7f41da7fc640 1 --2- 172.21.15.194:0/2985957514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41dc102e00 0x7f41dc0745e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f41d000b4a0 tx=0x7f41d000b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:15.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.783+0000 7f41e09a2640 1 -- 172.21.15.194:0/2985957514 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d0014070 con 0x7f41dc102e00 2024-09-19T05:16:15.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.783+0000 7f41e09a2640 1 -- 172.21.15.194:0/2985957514 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f41d0010ac0 con 0x7f41dc102e00 2024-09-19T05:16:15.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.783+0000 7f41e19a4640 1 -- 172.21.15.194:0/2985957514 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41dc1a1f50 con 0x7f41dc102e00 2024-09-19T05:16:15.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.783+0000 7f41e09a2640 1 -- 172.21.15.194:0/2985957514 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d0017c30 con 0x7f41dc102e00 2024-09-19T05:16:15.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.783+0000 7f41e19a4640 1 -- 172.21.15.194:0/2985957514 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41dc1a2400 con 0x7f41dc102e00 2024-09-19T05:16:15.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.784+0000 7f41e19a4640 1 -- 172.21.15.194:0/2985957514 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41dc109000 con 0x7f41dc102e00 2024-09-19T05:16:15.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.785+0000 7f41e09a2640 1 -- 172.21.15.194:0/2985957514 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f41d0017070 con 0x7f41dc102e00 2024-09-19T05:16:15.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.785+0000 7f41e09a2640 1 --2- 172.21.15.194:0/2985957514 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f41c40a32c0 0x7f41c40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:15.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.786+0000 7f41e09a2640 1 -- 172.21.15.194:0/2985957514 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6398+0+0 (secure 0 0 0) 0x7f41d00ce870 con 0x7f41dc102e00 2024-09-19T05:16:15.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.786+0000 7f41daffd640 1 --2- 172.21.15.194:0/2985957514 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f41c40a32c0 0x7f41c40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:15.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.786+0000 7f41daffd640 1 --2- 172.21.15.194:0/2985957514 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f41c40a32c0 0x7f41c40a5780 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f41dc102c60 tx=0x7f41cc00a5e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:15.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.790+0000 7f41e09a2640 1 -- 172.21.15.194:0/2985957514 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f41d009bd10 con 0x7f41dc102e00 2024-09-19T05:16:15.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:15.965+0000 7f41e19a4640 1 -- 172.21.15.194:0/2985957514 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f41dc062630 con 0x7f41c40a32c0 2024-09-19T05:16:16.375 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:16 smithi194 ceph-mon[35228]: Detected new or changed devices on smithi178 2024-09-19T05:16:16.375 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:16 smithi194 ceph-mon[35228]: Adjusting osd_memory_target on smithi178 to 4272M 2024-09-19T05:16:16.375 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:16 smithi194 ceph-mon[35228]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T05:16:16.376 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:16 smithi194 ceph-mon[35228]: from='osd.10 [v2:172.21.15.178:6824/3067822030,v1:172.21.15.178:6825/3067822030]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-09-19T05:16:16.376 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:16 smithi194 ceph-mon[35228]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T05:16:16.376 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:16 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:16:16.376 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:16 smithi194 ceph-mon[35228]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-09-19T05:16:16.376 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:16 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:16.376 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:16 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:16.376 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:16 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:16.376 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:16 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:16.376 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:16 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:16:16.376 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:16 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:16:16.376 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:16 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:16.376 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:16 smithi194 ceph-mon[35228]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-09-19T05:16:16.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:16 smithi178 ceph-mon[34347]: Detected new or changed devices on smithi178 2024-09-19T05:16:16.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:16 smithi178 ceph-mon[34347]: Adjusting osd_memory_target on smithi178 to 4272M 2024-09-19T05:16:16.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:16 smithi178 ceph-mon[34347]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T05:16:16.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:16 smithi178 ceph-mon[34347]: from='osd.10 [v2:172.21.15.178:6824/3067822030,v1:172.21.15.178:6825/3067822030]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-09-19T05:16:16.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:16 smithi178 ceph-mon[34347]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T05:16:16.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:16 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:16:16.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:16 smithi178 ceph-mon[34347]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-09-19T05:16:16.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:16 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:16.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:16 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:16.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:16 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:16.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:16 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:16.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:16 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:16:16.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:16 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:16:16.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:16 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:16.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:16 smithi178 ceph-mon[34347]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-09-19T05:16:16.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:16 smithi120 ceph-mon[30956]: Detected new or changed devices on smithi178 2024-09-19T05:16:16.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:16 smithi120 ceph-mon[30956]: Adjusting osd_memory_target on smithi178 to 4272M 2024-09-19T05:16:16.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:16 smithi120 ceph-mon[30956]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T05:16:16.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:16 smithi120 ceph-mon[30956]: from='osd.10 [v2:172.21.15.178:6824/3067822030,v1:172.21.15.178:6825/3067822030]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-09-19T05:16:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:16 smithi120 ceph-mon[30956]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T05:16:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:16 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:16:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:16 smithi120 ceph-mon[30956]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]: dispatch 2024-09-19T05:16:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:16 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:16 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:16 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:16 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:16 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T05:16:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:16 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T05:16:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:16 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:16 smithi120 ceph-mon[30956]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi178", "root=default"]}]': finished 2024-09-19T05:16:17.163 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:16:16 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:16:16.791+0000 7f4143cf5640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T05:16:17.163 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:16:16 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:16:16.802+0000 7f413c327640 -1 osd.10 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:16:17.372 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:17 smithi194 ceph-mon[35228]: from='client.24334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:16:17.373 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:17 smithi194 ceph-mon[35228]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:17.373 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:17 smithi194 ceph-mon[35228]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T05:16:17.373 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:17 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:16:17.373 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:17 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:16:17.373 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:17 smithi194 ceph-mon[35228]: from='osd.10 ' entity='osd.10' 2024-09-19T05:16:17.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:17 smithi178 ceph-mon[34347]: from='client.24334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:16:17.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:17 smithi178 ceph-mon[34347]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:17.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:17 smithi178 ceph-mon[34347]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T05:16:17.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:17 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:16:17.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:17 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:16:17.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:17 smithi178 ceph-mon[34347]: from='osd.10 ' entity='osd.10' 2024-09-19T05:16:17.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:17 smithi120 ceph-mon[30956]: from='client.24334 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:16:17.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:17 smithi120 ceph-mon[30956]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:17.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:17 smithi120 ceph-mon[30956]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T05:16:17.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:17 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:16:17.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:17 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:16:17.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:17 smithi120 ceph-mon[30956]: from='osd.10 ' entity='osd.10' 2024-09-19T05:16:18.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:18 smithi194 ceph-mon[35228]: purged_snaps scrub starts 2024-09-19T05:16:18.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:18 smithi194 ceph-mon[35228]: purged_snaps scrub ok 2024-09-19T05:16:18.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:18 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:16:18.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:18 smithi194 ceph-mon[35228]: osd.10 [v2:172.21.15.178:6824/3067822030,v1:172.21.15.178:6825/3067822030] boot 2024-09-19T05:16:18.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:18 smithi194 ceph-mon[35228]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T05:16:18.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:18 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:16:18.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:18 smithi178 ceph-mon[34347]: purged_snaps scrub starts 2024-09-19T05:16:18.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:18 smithi178 ceph-mon[34347]: purged_snaps scrub ok 2024-09-19T05:16:18.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:18 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:16:18.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:18 smithi178 ceph-mon[34347]: osd.10 [v2:172.21.15.178:6824/3067822030,v1:172.21.15.178:6825/3067822030] boot 2024-09-19T05:16:18.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:18 smithi178 ceph-mon[34347]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T05:16:18.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:18 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:16:18.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:18 smithi120 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T05:16:18.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:18 smithi120 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T05:16:18.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:18 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:16:18.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:18 smithi120 ceph-mon[30956]: osd.10 [v2:172.21.15.178:6824/3067822030,v1:172.21.15.178:6825/3067822030] boot 2024-09-19T05:16:18.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:18 smithi120 ceph-mon[30956]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T05:16:18.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:18 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:16:19.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:19 smithi178 ceph-mon[34347]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:19.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:19 smithi178 ceph-mon[34347]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T05:16:19.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:19 smithi178 ceph-mon[34347]: from='client.? 172.21.15.194:0/425944822' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85ea248c-9a36-41cb-a200-87138fb31602"}]: dispatch 2024-09-19T05:16:19.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:19 smithi178 ceph-mon[34347]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85ea248c-9a36-41cb-a200-87138fb31602"}]: dispatch 2024-09-19T05:16:19.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:19 smithi178 ceph-mon[34347]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85ea248c-9a36-41cb-a200-87138fb31602"}]': finished 2024-09-19T05:16:19.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:19 smithi178 ceph-mon[34347]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T05:16:19.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:19 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:16:19.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:19 smithi178 ceph-mon[34347]: from='client.? 172.21.15.194:0/130863757' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:16:19.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:19 smithi120 ceph-mon[30956]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:19.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:19 smithi120 ceph-mon[30956]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T05:16:19.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:19 smithi120 ceph-mon[30956]: from='client.? 172.21.15.194:0/425944822' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85ea248c-9a36-41cb-a200-87138fb31602"}]: dispatch 2024-09-19T05:16:19.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:19 smithi120 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85ea248c-9a36-41cb-a200-87138fb31602"}]: dispatch 2024-09-19T05:16:19.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:19 smithi120 ceph-mon[30956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85ea248c-9a36-41cb-a200-87138fb31602"}]': finished 2024-09-19T05:16:19.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:19 smithi120 ceph-mon[30956]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T05:16:19.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:19 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:16:19.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:19 smithi120 ceph-mon[30956]: from='client.? 172.21.15.194:0/130863757' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:16:19.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:19 smithi194 ceph-mon[35228]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-19T05:16:19.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:19 smithi194 ceph-mon[35228]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T05:16:19.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:19 smithi194 ceph-mon[35228]: from='client.? 172.21.15.194:0/425944822' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85ea248c-9a36-41cb-a200-87138fb31602"}]: dispatch 2024-09-19T05:16:19.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:19 smithi194 ceph-mon[35228]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85ea248c-9a36-41cb-a200-87138fb31602"}]: dispatch 2024-09-19T05:16:19.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:19 smithi194 ceph-mon[35228]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85ea248c-9a36-41cb-a200-87138fb31602"}]': finished 2024-09-19T05:16:19.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:19 smithi194 ceph-mon[35228]: osdmap e69: 12 total, 11 up, 12 in 2024-09-19T05:16:19.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:19 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:16:19.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:19 smithi194 ceph-mon[35228]: from='client.? 172.21.15.194:0/130863757' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T05:16:20.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:20 smithi120 ceph-mon[30956]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T05:16:20.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:20 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:16:20.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:20 smithi120 ceph-mon[30956]: pgmap v226: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-19T05:16:20.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:20 smithi194 ceph-mon[35228]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T05:16:20.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:16:20.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:20 smithi194 ceph-mon[35228]: pgmap v226: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-19T05:16:20.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:20 smithi178 ceph-mon[34347]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T05:16:20.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:20 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:16:20.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:20 smithi178 ceph-mon[34347]: pgmap v226: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-19T05:16:21.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:21 smithi120 ceph-mon[30956]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T05:16:21.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:21 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:16:21.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:21 smithi194 ceph-mon[35228]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T05:16:21.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:21 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:16:21.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:21 smithi178 ceph-mon[34347]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T05:16:21.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:21 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:16:22.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:22 smithi120 ceph-mon[30956]: pgmap v228: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T05:16:22.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:22 smithi194 ceph-mon[35228]: pgmap v228: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T05:16:22.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:22 smithi178 ceph-mon[34347]: pgmap v228: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-19T05:16:25.271 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:25 smithi194 ceph-mon[35228]: pgmap v229: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T05:16:25.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:25 smithi178 ceph-mon[34347]: pgmap v229: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T05:16:25.596 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:25 smithi120 ceph-mon[30956]: pgmap v229: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-19T05:16:27.345 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:27 smithi194 ceph-mon[35228]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T05:16:27.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:27 smithi178 ceph-mon[34347]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T05:16:27.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:27 smithi120 ceph-mon[30956]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 340 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-09-19T05:16:28.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:28 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T05:16:28.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:28 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:28.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:28 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T05:16:28.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:28 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:28.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:28 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T05:16:28.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:28 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:29.421 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:29 smithi194 ceph-mon[35228]: Deploying daemon osd.11 on smithi194 2024-09-19T05:16:29.422 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:29 smithi194 ceph-mon[35228]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:16:29.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:29 smithi178 ceph-mon[34347]: Deploying daemon osd.11 on smithi194 2024-09-19T05:16:29.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:29 smithi178 ceph-mon[34347]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:16:29.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:29 smithi120 ceph-mon[30956]: Deploying daemon osd.11 on smithi194 2024-09-19T05:16:29.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:29 smithi120 ceph-mon[30956]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:16:31.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:31 smithi194 ceph-mon[35228]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:16:31.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:31 smithi178 ceph-mon[34347]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:16:31.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:31 smithi120 ceph-mon[30956]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:16:33.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:33 smithi194 ceph-mon[35228]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:16:33.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:33 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:33.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:33 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:33.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:33 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:33.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:33 smithi178 ceph-mon[34347]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:16:33.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:33 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:33.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:33 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:33.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:33 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:33.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:33 smithi120 ceph-mon[30956]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:16:33.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:33 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:33.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:33 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:33.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:33 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:35.403 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:35 smithi194 ceph-mon[35228]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:16:35.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:35 smithi178 ceph-mon[34347]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:16:35.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:35 smithi120 ceph-mon[30956]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:16:36.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:36.517+0000 7f41e09a2640 1 -- 172.21.15.194:0/2985957514 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f41dc062630 con 0x7f41c40a32c0 2024-09-19T05:16:36.519 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 11 on host 'smithi194' 2024-09-19T05:16:36.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:36.520+0000 7f41e19a4640 1 -- 172.21.15.194:0/2985957514 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f41c40a32c0 msgr2=0x7f41c40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:36.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:36.520+0000 7f41e19a4640 1 --2- 172.21.15.194:0/2985957514 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f41c40a32c0 0x7f41c40a5780 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f41dc102c60 tx=0x7f41cc00a5e0 comp rx=0 tx=0).stop 2024-09-19T05:16:36.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:36.520+0000 7f41e19a4640 1 -- 172.21.15.194:0/2985957514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41dc102e00 msgr2=0x7f41dc0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:36.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:36.520+0000 7f41e19a4640 1 --2- 172.21.15.194:0/2985957514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41dc102e00 0x7f41dc0745e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f41d000b4a0 tx=0x7f41d000b960 comp rx=0 tx=0).stop 2024-09-19T05:16:36.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:36.520+0000 7f41e19a4640 1 -- 172.21.15.194:0/2985957514 shutdown_connections 2024-09-19T05:16:36.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:36.520+0000 7f41e19a4640 1 --2- 172.21.15.194:0/2985957514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f41dc1037c0 0x7f41dc074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:36.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:36.520+0000 7f41e19a4640 1 --2- 172.21.15.194:0/2985957514 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f41c40a32c0 0x7f41c40a5780 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:36.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:36.520+0000 7f41e19a4640 1 --2- 172.21.15.194:0/2985957514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41dc102e00 0x7f41dc0745e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:36.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:36.520+0000 7f41e19a4640 1 --2- 172.21.15.194:0/2985957514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41dc101c00 0x7f41dc075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:36.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:36.520+0000 7f41e19a4640 1 -- 172.21.15.194:0/2985957514 >> 172.21.15.194:0/2985957514 conn(0x7f41dc0fd390 msgr2=0x7f41dc1061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:36.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:36.520+0000 7f41e19a4640 1 -- 172.21.15.194:0/2985957514 shutdown_connections 2024-09-19T05:16:36.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:36.520+0000 7f41e19a4640 1 -- 172.21.15.194:0/2985957514 wait complete. 2024-09-19T05:16:36.830 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:36 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:36.830 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:36 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:36.830 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:36 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:36.831 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:36 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:36.831 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:36 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:36.831 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:36 smithi194 ceph-mon[35228]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:16:36.831 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:36 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:36.831 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:36 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:36.831 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:36 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:36.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:36 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:36.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:36 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:36.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:36 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:36.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:36 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:36.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:36 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:36.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:36 smithi120 ceph-mon[30956]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:16:36.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:36 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:36.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:36 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:36.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:36 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:36.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:36 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:36.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:36 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:36.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:36 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:36.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:36 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:36.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:36 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:36.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:36 smithi178 ceph-mon[34347]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:16:36.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:36 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:36.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:36 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:36.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:36 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:37.141 DEBUG:teuthology.orchestra.run.smithi194:osd.11> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T05:16:37.144 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T05:16:37.144 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T05:16:37.402 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:16:37.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.809+0000 7f3428525640 1 -- 172.21.15.120:0/3740242280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3420103860 msgr2=0x7f342010a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:37.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.809+0000 7f3428525640 1 --2- 172.21.15.120:0/3740242280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3420103860 0x7f342010a0f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3418009930 tx=0x7f341802a420 comp rx=0 tx=0).stop 2024-09-19T05:16:37.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.810+0000 7f3428525640 1 -- 172.21.15.120:0/3740242280 shutdown_connections 2024-09-19T05:16:37.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.810+0000 7f3428525640 1 --2- 172.21.15.120:0/3740242280 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3420103860 0x7f342010a0f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:37.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.810+0000 7f3428525640 1 --2- 172.21.15.120:0/3740242280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3420102ea0 0x7f3420103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:37.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.810+0000 7f3428525640 1 --2- 172.21.15.120:0/3740242280 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34200ffec0 0x7f34201002c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:37.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.810+0000 7f3428525640 1 -- 172.21.15.120:0/3740242280 >> 172.21.15.120:0/3740242280 conn(0x7f34200fba10 msgr2=0x7f34200fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:37.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.810+0000 7f3428525640 1 -- 172.21.15.120:0/3740242280 shutdown_connections 2024-09-19T05:16:37.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.810+0000 7f3428525640 1 -- 172.21.15.120:0/3740242280 wait complete. 2024-09-19T05:16:37.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.810+0000 7f3428525640 1 Processor -- start 2024-09-19T05:16:37.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.810+0000 7f3428525640 1 -- start start 2024-09-19T05:16:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.810+0000 7f3428525640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34200ffec0 0x7f3420197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.810+0000 7f3428525640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3420102ea0 0x7f3420198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.810+0000 7f3428525640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3420103860 0x7f342019f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.810+0000 7f3428525640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f342010d7f0 con 0x7f34200ffec0 2024-09-19T05:16:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.810+0000 7f3428525640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f342010d670 con 0x7f3420102ea0 2024-09-19T05:16:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.810+0000 7f3428525640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f342010d970 con 0x7f3420103860 2024-09-19T05:16:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.810+0000 7f34262c1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34200ffec0 0x7f3420197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.811+0000 7f34262c1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34200ffec0 0x7f3420197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36726/0 (socket says 172.21.15.120:36726) 2024-09-19T05:16:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.811+0000 7f34262c1640 1 -- 172.21.15.120:0/1048855009 learned_addr learned my addr 172.21.15.120:0/1048855009 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:16:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.811+0000 7f3426ac2640 1 --2- 172.21.15.120:0/1048855009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3420103860 0x7f342019f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.811+0000 7f3425ac0640 1 --2- 172.21.15.120:0/1048855009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3420102ea0 0x7f3420198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.811+0000 7f34262c1640 1 -- 172.21.15.120:0/1048855009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3420103860 msgr2=0x7f342019f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:37.817 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.811+0000 7f34262c1640 1 --2- 172.21.15.120:0/1048855009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3420103860 0x7f342019f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.811+0000 7f34262c1640 1 -- 172.21.15.120:0/1048855009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3420102ea0 msgr2=0x7f3420198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.811+0000 7f34262c1640 1 --2- 172.21.15.120:0/1048855009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3420102ea0 0x7f3420198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.811+0000 7f34262c1640 1 -- 172.21.15.120:0/1048855009 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f342019fb60 con 0x7f34200ffec0 2024-09-19T05:16:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.811+0000 7f34262c1640 1 --2- 172.21.15.120:0/1048855009 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34200ffec0 0x7f3420197f30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f341c00b9c0 tx=0x7f341c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.811+0000 7f34177fe640 1 -- 172.21.15.120:0/1048855009 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341c019070 con 0x7f34200ffec0 2024-09-19T05:16:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.811+0000 7f34177fe640 1 -- 172.21.15.120:0/1048855009 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f341c00cba0 con 0x7f34200ffec0 2024-09-19T05:16:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.811+0000 7f3428525640 1 -- 172.21.15.120:0/1048855009 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f342019fe50 con 0x7f34200ffec0 2024-09-19T05:16:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.812+0000 7f34177fe640 1 -- 172.21.15.120:0/1048855009 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341c0125a0 con 0x7f34200ffec0 2024-09-19T05:16:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.812+0000 7f3428525640 1 -- 172.21.15.120:0/1048855009 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34201a0380 con 0x7f34200ffec0 2024-09-19T05:16:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.813+0000 7f3428525640 1 -- 172.21.15.120:0/1048855009 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34201091e0 con 0x7f34200ffec0 2024-09-19T05:16:37.818 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.814+0000 7f34177fe640 1 -- 172.21.15.120:0/1048855009 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f341c01c070 con 0x7f34200ffec0 2024-09-19T05:16:37.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.814+0000 7f34177fe640 1 --2- 172.21.15.120:0/1048855009 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f340c0a32f0 0x7f340c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:37.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.815+0000 7f3425ac0640 1 --2- 172.21.15.120:0/1048855009 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f340c0a32f0 0x7f340c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:37.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.815+0000 7f34177fe640 1 -- 172.21.15.120:0/1048855009 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6809+0+0 (secure 0 0 0) 0x7f341c0ce7e0 con 0x7f34200ffec0 2024-09-19T05:16:37.819 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.815+0000 7f3425ac0640 1 --2- 172.21.15.120:0/1048855009 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f340c0a32f0 0x7f340c0a57b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3410005fd0 tx=0x7f3410005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:37.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.819+0000 7f34177fe640 1 -- 172.21.15.120:0/1048855009 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f341c09b490 con 0x7f34200ffec0 2024-09-19T05:16:37.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.984+0000 7f3428525640 1 -- 172.21.15.120:0/1048855009 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f342002d970 con 0x7f34200ffec0 2024-09-19T05:16:37.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.985+0000 7f34177fe640 1 -- 172.21.15.120:0/1048855009 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7f341c09f790 con 0x7f34200ffec0 2024-09-19T05:16:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:16:37.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.986+0000 7f3428525640 1 -- 172.21.15.120:0/1048855009 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f340c0a32f0 msgr2=0x7f340c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:37.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.986+0000 7f3428525640 1 --2- 172.21.15.120:0/1048855009 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f340c0a32f0 0x7f340c0a57b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3410005fd0 tx=0x7f3410005850 comp rx=0 tx=0).stop 2024-09-19T05:16:37.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.987+0000 7f3428525640 1 -- 172.21.15.120:0/1048855009 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34200ffec0 msgr2=0x7f3420197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:37.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.987+0000 7f3428525640 1 --2- 172.21.15.120:0/1048855009 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34200ffec0 0x7f3420197f30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f341c00b9c0 tx=0x7f341c00be80 comp rx=0 tx=0).stop 2024-09-19T05:16:37.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.987+0000 7f3428525640 1 -- 172.21.15.120:0/1048855009 shutdown_connections 2024-09-19T05:16:37.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.987+0000 7f3428525640 1 --2- 172.21.15.120:0/1048855009 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f340c0a32f0 0x7f340c0a57b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:37.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.987+0000 7f3428525640 1 --2- 172.21.15.120:0/1048855009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3420103860 0x7f342019f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:37.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.987+0000 7f3428525640 1 --2- 172.21.15.120:0/1048855009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3420102ea0 0x7f3420198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:37.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.987+0000 7f3428525640 1 --2- 172.21.15.120:0/1048855009 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34200ffec0 0x7f3420197f30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:37.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.987+0000 7f3428525640 1 -- 172.21.15.120:0/1048855009 >> 172.21.15.120:0/1048855009 conn(0x7f34200fba10 msgr2=0x7f34201063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:37.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.987+0000 7f3428525640 1 -- 172.21.15.120:0/1048855009 shutdown_connections 2024-09-19T05:16:37.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:37.987+0000 7f3428525640 1 -- 172.21.15.120:0/1048855009 wait complete. 2024-09-19T05:16:38.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:38 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1048855009' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T05:16:38.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:38 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1048855009' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T05:16:38.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:38 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1048855009' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T05:16:38.672 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1726722977,"num_in_osds":12,"osd_in_since":1726722978,"num_remapped_pgs":0} 2024-09-19T05:16:39.331 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:39 smithi194 ceph-mon[35228]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:16:39.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:39 smithi120 ceph-mon[30956]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:16:39.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:39 smithi178 ceph-mon[34347]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:16:39.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:16:39 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:16:39.429+0000 7f8a3c230640 -1 osd.11 0 log_to_monitors true 2024-09-19T05:16:39.677 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T05:16:39.935 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:16:40.361 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:40 smithi120 ceph-mon[30956]: from='osd.11 [v2:172.21.15.194:6824/2713146974,v1:172.21.15.194:6825/2713146974]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T05:16:40.361 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:40 smithi120 ceph-mon[30956]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T05:16:40.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.359+0000 7f298bf03640 1 -- 172.21.15.120:0/4047343445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2984100ad0 msgr2=0x7f2984100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:40.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.359+0000 7f298bf03640 1 --2- 172.21.15.120:0/4047343445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2984100ad0 0x7f2984100ed0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2980009900 tx=0x7f298002a410 comp rx=0 tx=0).stop 2024-09-19T05:16:40.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.359+0000 7f298bf03640 1 -- 172.21.15.120:0/4047343445 shutdown_connections 2024-09-19T05:16:40.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.359+0000 7f298bf03640 1 --2- 172.21.15.120:0/4047343445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2984102690 0x7f2984108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:40.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.359+0000 7f298bf03640 1 --2- 172.21.15.120:0/4047343445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2984101cd0 0x7f2984102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:40.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.359+0000 7f298bf03640 1 --2- 172.21.15.120:0/4047343445 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2984100ad0 0x7f2984100ed0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:40.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.359+0000 7f298bf03640 1 -- 172.21.15.120:0/4047343445 >> 172.21.15.120:0/4047343445 conn(0x7f29840fc280 msgr2=0x7f29840fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:40.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.359+0000 7f298bf03640 1 -- 172.21.15.120:0/4047343445 shutdown_connections 2024-09-19T05:16:40.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.359+0000 7f298bf03640 1 -- 172.21.15.120:0/4047343445 wait complete. 2024-09-19T05:16:40.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.359+0000 7f298bf03640 1 Processor -- start 2024-09-19T05:16:40.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.359+0000 7f298bf03640 1 -- start start 2024-09-19T05:16:40.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.360+0000 7f298bf03640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2984100ad0 0x7f2984104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:40.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.360+0000 7f298bf03640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2984101cd0 0x7f29841030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:40.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.360+0000 7f298bf03640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2984102690 0x7f29841035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:40.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.360+0000 7f298bf03640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f298410c600 con 0x7f2984101cd0 2024-09-19T05:16:40.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.360+0000 7f298bf03640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f298410c480 con 0x7f2984100ad0 2024-09-19T05:16:40.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.360+0000 7f298bf03640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f298410c780 con 0x7f2984102690 2024-09-19T05:16:40.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.360+0000 7f298949e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2984101cd0 0x7f29841030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:40.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.360+0000 7f298949e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2984101cd0 0x7f29841030b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36738/0 (socket says 172.21.15.120:36738) 2024-09-19T05:16:40.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.360+0000 7f298949e640 1 -- 172.21.15.120:0/3706378285 learned_addr learned my addr 172.21.15.120:0/3706378285 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:16:40.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.360+0000 7f298a4a0640 1 --2- 172.21.15.120:0/3706378285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2984102690 0x7f29841035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:40.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.360+0000 7f2989c9f640 1 --2- 172.21.15.120:0/3706378285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2984100ad0 0x7f2984104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:40.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.360+0000 7f298949e640 1 -- 172.21.15.120:0/3706378285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2984102690 msgr2=0x7f29841035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:40.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.360+0000 7f298949e640 1 --2- 172.21.15.120:0/3706378285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2984102690 0x7f29841035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:40.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.360+0000 7f298949e640 1 -- 172.21.15.120:0/3706378285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2984100ad0 msgr2=0x7f2984104a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:40.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.360+0000 7f298949e640 1 --2- 172.21.15.120:0/3706378285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2984100ad0 0x7f2984104a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:40.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.360+0000 7f298949e640 1 -- 172.21.15.120:0/3706378285 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2984103eb0 con 0x7f2984101cd0 2024-09-19T05:16:40.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.360+0000 7f298a4a0640 1 --2- 172.21.15.120:0/3706378285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2984102690 0x7f29841035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:16:40.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.360+0000 7f298949e640 1 --2- 172.21.15.120:0/3706378285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2984101cd0 0x7f29841030b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f297400d770 tx=0x7f297400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:40.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.360+0000 7f297affd640 1 -- 172.21.15.120:0/3706378285 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974017070 con 0x7f2984101cd0 2024-09-19T05:16:40.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.360+0000 7f297affd640 1 -- 172.21.15.120:0/3706378285 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f29740054d0 con 0x7f2984101cd0 2024-09-19T05:16:40.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.360+0000 7f298bf03640 1 -- 172.21.15.120:0/3706378285 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29841a1f60 con 0x7f2984101cd0 2024-09-19T05:16:40.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.360+0000 7f297affd640 1 -- 172.21.15.120:0/3706378285 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2974004cf0 con 0x7f2984101cd0 2024-09-19T05:16:40.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.360+0000 7f298bf03640 1 -- 172.21.15.120:0/3706378285 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29841a23c0 con 0x7f2984101cd0 2024-09-19T05:16:40.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.361+0000 7f298bf03640 1 -- 172.21.15.120:0/3706378285 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29841a25f0 con 0x7f2984101cd0 2024-09-19T05:16:40.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.362+0000 7f297affd640 1 -- 172.21.15.120:0/3706378285 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f2974004e90 con 0x7f2984101cd0 2024-09-19T05:16:40.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.363+0000 7f297affd640 1 --2- 172.21.15.120:0/3706378285 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f29700a3240 0x7f29700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:40.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.363+0000 7f297affd640 1 -- 172.21.15.120:0/3706378285 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6831+0+0 (secure 0 0 0) 0x7f29740cee60 con 0x7f2984101cd0 2024-09-19T05:16:40.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.363+0000 7f2989c9f640 1 --2- 172.21.15.120:0/3706378285 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f29700a3240 0x7f29700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:40.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.364+0000 7f2989c9f640 1 --2- 172.21.15.120:0/3706378285 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f29700a3240 0x7f29700a5700 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2980000c00 tx=0x7f29800314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:40.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.367+0000 7f297affd640 1 -- 172.21.15.120:0/3706378285 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f297409c150 con 0x7f2984101cd0 2024-09-19T05:16:40.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:40 smithi194 ceph-mon[35228]: from='osd.11 [v2:172.21.15.194:6824/2713146974,v1:172.21.15.194:6825/2713146974]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T05:16:40.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:40 smithi194 ceph-mon[35228]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T05:16:40.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:40 smithi178 ceph-mon[34347]: from='osd.11 [v2:172.21.15.194:6824/2713146974,v1:172.21.15.194:6825/2713146974]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T05:16:40.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:40 smithi178 ceph-mon[34347]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T05:16:40.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.534+0000 7f298bf03640 1 -- 172.21.15.120:0/3706378285 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f29841a28e0 con 0x7f2984101cd0 2024-09-19T05:16:40.536 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.534+0000 7f297affd640 1 -- 172.21.15.120:0/3706378285 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7f297409ba50 con 0x7f2984101cd0 2024-09-19T05:16:40.536 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:16:40.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.536+0000 7f298bf03640 1 -- 172.21.15.120:0/3706378285 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f29700a3240 msgr2=0x7f29700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:40.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.536+0000 7f298bf03640 1 --2- 172.21.15.120:0/3706378285 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f29700a3240 0x7f29700a5700 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2980000c00 tx=0x7f29800314a0 comp rx=0 tx=0).stop 2024-09-19T05:16:40.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.536+0000 7f298bf03640 1 -- 172.21.15.120:0/3706378285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2984101cd0 msgr2=0x7f29841030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:40.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.536+0000 7f298bf03640 1 --2- 172.21.15.120:0/3706378285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2984101cd0 0x7f29841030b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f297400d770 tx=0x7f297400dc30 comp rx=0 tx=0).stop 2024-09-19T05:16:40.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.536+0000 7f298bf03640 1 -- 172.21.15.120:0/3706378285 shutdown_connections 2024-09-19T05:16:40.538 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.536+0000 7f298bf03640 1 --2- 172.21.15.120:0/3706378285 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f29700a3240 0x7f29700a5700 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:40.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.536+0000 7f298bf03640 1 --2- 172.21.15.120:0/3706378285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2984102690 0x7f29841035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:40.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.536+0000 7f298bf03640 1 --2- 172.21.15.120:0/3706378285 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2984101cd0 0x7f29841030b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:40.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.536+0000 7f298bf03640 1 --2- 172.21.15.120:0/3706378285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2984100ad0 0x7f2984104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:40.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.536+0000 7f298bf03640 1 -- 172.21.15.120:0/3706378285 >> 172.21.15.120:0/3706378285 conn(0x7f29840fc280 msgr2=0x7f2984069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:40.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.536+0000 7f298bf03640 1 -- 172.21.15.120:0/3706378285 shutdown_connections 2024-09-19T05:16:40.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:40.536+0000 7f298bf03640 1 -- 172.21.15.120:0/3706378285 wait complete. 2024-09-19T05:16:41.113 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:41 smithi120 ceph-mon[30956]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T05:16:41.113 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:41 smithi120 ceph-mon[30956]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T05:16:41.113 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:41 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:16:41.113 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:41 smithi120 ceph-mon[30956]: from='osd.11 [v2:172.21.15.194:6824/2713146974,v1:172.21.15.194:6825/2713146974]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-19T05:16:41.113 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:41 smithi120 ceph-mon[30956]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-19T05:16:41.113 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:41 smithi120 ceph-mon[30956]: Detected new or changed devices on smithi194 2024-09-19T05:16:41.113 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:41 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:41.114 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:41 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:41.114 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:41 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:41.114 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:41 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:41.114 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:41 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:41.114 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:41 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:41.114 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:41 smithi120 ceph-mon[30956]: Adjusting osd_memory_target on smithi194 to 4272M 2024-09-19T05:16:41.114 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:41 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:41.114 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:41 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:41.114 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:41 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:41.114 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:41 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:41.114 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:41 smithi120 ceph-mon[30956]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:16:41.114 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:41 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/3706378285' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T05:16:41.115 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1726722977,"num_in_osds":12,"osd_in_since":1726722978,"num_remapped_pgs":0} 2024-09-19T05:16:41.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:41 smithi194 ceph-mon[35228]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T05:16:41.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:41 smithi194 ceph-mon[35228]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T05:16:41.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:41 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:16:41.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:41 smithi194 ceph-mon[35228]: from='osd.11 [v2:172.21.15.194:6824/2713146974,v1:172.21.15.194:6825/2713146974]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-19T05:16:41.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:41 smithi194 ceph-mon[35228]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-19T05:16:41.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:41 smithi194 ceph-mon[35228]: Detected new or changed devices on smithi194 2024-09-19T05:16:41.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:41 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:41.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:41 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:41.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:41 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:41.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:41 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:41.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:41 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:41.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:41 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:41.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:41 smithi194 ceph-mon[35228]: Adjusting osd_memory_target on smithi194 to 4272M 2024-09-19T05:16:41.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:41 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:41.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:41 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:41.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:41 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:41.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:41 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:41.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:41 smithi194 ceph-mon[35228]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:16:41.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:41 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/3706378285' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T05:16:41.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:41 smithi178 ceph-mon[34347]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T05:16:41.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:41 smithi178 ceph-mon[34347]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T05:16:41.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:41 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:16:41.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:41 smithi178 ceph-mon[34347]: from='osd.11 [v2:172.21.15.194:6824/2713146974,v1:172.21.15.194:6825/2713146974]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-19T05:16:41.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:41 smithi178 ceph-mon[34347]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-09-19T05:16:41.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:41 smithi178 ceph-mon[34347]: Detected new or changed devices on smithi194 2024-09-19T05:16:41.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:41 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:41.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:41 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:41.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:41 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:41.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:41 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:41.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:41 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:41.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:41 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:16:41.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:41 smithi178 ceph-mon[34347]: Adjusting osd_memory_target on smithi194 to 4272M 2024-09-19T05:16:41.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:41 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:41.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:41 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:41.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:41 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:41.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:41 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:41.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:41 smithi178 ceph-mon[34347]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:16:41.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:41 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/3706378285' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T05:16:42.061 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:16:41 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:16:41.804+0000 7f8a37990640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T05:16:42.061 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:16:41 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:16:41.821+0000 7f8a2ffc2640 -1 osd.11 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T05:16:42.116 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T05:16:42.369 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:16:42.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:42 smithi120 ceph-mon[30956]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-19T05:16:42.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:42 smithi120 ceph-mon[30956]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T05:16:42.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:42 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:16:42.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:42 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:16:42.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:42 smithi120 ceph-mon[30956]: from='osd.11 ' entity='osd.11' 2024-09-19T05:16:42.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:42 smithi194 ceph-mon[35228]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-19T05:16:42.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:42 smithi194 ceph-mon[35228]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T05:16:42.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:42 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:16:42.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:42 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:16:42.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:42 smithi194 ceph-mon[35228]: from='osd.11 ' entity='osd.11' 2024-09-19T05:16:42.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:42 smithi178 ceph-mon[34347]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-09-19T05:16:42.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:42 smithi178 ceph-mon[34347]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T05:16:42.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:42 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:16:42.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:42 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:16:42.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:42 smithi178 ceph-mon[34347]: from='osd.11 ' entity='osd.11' 2024-09-19T05:16:42.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.882+0000 7fa2386cd640 1 -- 172.21.15.120:0/495031129 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa230101c00 msgr2=0x7fa230102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:42.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.882+0000 7fa2386cd640 1 --2- 172.21.15.120:0/495031129 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa230101c00 0x7fa230102000 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa22c009900 tx=0x7fa22c02a410 comp rx=0 tx=0).stop 2024-09-19T05:16:42.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.882+0000 7fa2386cd640 1 -- 172.21.15.120:0/495031129 shutdown_connections 2024-09-19T05:16:42.904 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.882+0000 7fa2386cd640 1 --2- 172.21.15.120:0/495031129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2301037c0 0x7fa23010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:42.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.882+0000 7fa2386cd640 1 --2- 172.21.15.120:0/495031129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa230102e00 0x7fa230103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:42.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.882+0000 7fa2386cd640 1 --2- 172.21.15.120:0/495031129 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa230101c00 0x7fa230102000 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:42.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.882+0000 7fa2386cd640 1 -- 172.21.15.120:0/495031129 >> 172.21.15.120:0/495031129 conn(0x7fa2300fd390 msgr2=0x7fa2300ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:42.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.882+0000 7fa2386cd640 1 -- 172.21.15.120:0/495031129 shutdown_connections 2024-09-19T05:16:42.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.882+0000 7fa2386cd640 1 -- 172.21.15.120:0/495031129 wait complete. 2024-09-19T05:16:42.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.882+0000 7fa2386cd640 1 Processor -- start 2024-09-19T05:16:42.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.882+0000 7fa2386cd640 1 -- start start 2024-09-19T05:16:42.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.883+0000 7fa2386cd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa230101c00 0x7fa230075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:42.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.883+0000 7fa2386cd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa230102e00 0x7fa2300745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:42.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.883+0000 7fa2386cd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2301037c0 0x7fa230074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:42.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.883+0000 7fa2386cd640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa23010d790 con 0x7fa230102e00 2024-09-19T05:16:42.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.883+0000 7fa2386cd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa23010d610 con 0x7fa230101c00 2024-09-19T05:16:42.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.883+0000 7fa2386cd640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa23010d910 con 0x7fa2301037c0 2024-09-19T05:16:42.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.883+0000 7fa235c68640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa230102e00 0x7fa2300745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:42.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.883+0000 7fa235c68640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa230102e00 0x7fa2300745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36750/0 (socket says 172.21.15.120:36750) 2024-09-19T05:16:42.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.883+0000 7fa235c68640 1 -- 172.21.15.120:0/824503899 learned_addr learned my addr 172.21.15.120:0/824503899 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:16:42.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.883+0000 7fa236c6a640 1 --2- 172.21.15.120:0/824503899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2301037c0 0x7fa230074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:42.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.883+0000 7fa236469640 1 --2- 172.21.15.120:0/824503899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa230101c00 0x7fa230075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:42.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.883+0000 7fa235c68640 1 -- 172.21.15.120:0/824503899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2301037c0 msgr2=0x7fa230074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:42.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.883+0000 7fa235c68640 1 --2- 172.21.15.120:0/824503899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2301037c0 0x7fa230074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:42.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.883+0000 7fa235c68640 1 -- 172.21.15.120:0/824503899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa230101c00 msgr2=0x7fa230075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:42.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.883+0000 7fa235c68640 1 --2- 172.21.15.120:0/824503899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa230101c00 0x7fa230075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:42.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.883+0000 7fa235c68640 1 -- 172.21.15.120:0/824503899 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2300753e0 con 0x7fa230102e00 2024-09-19T05:16:42.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.883+0000 7fa235c68640 1 --2- 172.21.15.120:0/824503899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa230102e00 0x7fa2300745e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa22000c920 tx=0x7fa22000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:42.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.883+0000 7fa2277fe640 1 -- 172.21.15.120:0/824503899 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa220007c70 con 0x7fa230102e00 2024-09-19T05:16:42.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.883+0000 7fa2277fe640 1 -- 172.21.15.120:0/824503899 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa220007e10 con 0x7fa230102e00 2024-09-19T05:16:42.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.883+0000 7fa2386cd640 1 -- 172.21.15.120:0/824503899 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2301a1fb0 con 0x7fa230102e00 2024-09-19T05:16:42.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.883+0000 7fa2277fe640 1 -- 172.21.15.120:0/824503899 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa220018820 con 0x7fa230102e00 2024-09-19T05:16:42.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.883+0000 7fa2386cd640 1 -- 172.21.15.120:0/824503899 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2301a24e0 con 0x7fa230102e00 2024-09-19T05:16:42.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.884+0000 7fa2386cd640 1 -- 172.21.15.120:0/824503899 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa230109050 con 0x7fa230102e00 2024-09-19T05:16:42.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.885+0000 7fa2277fe640 1 -- 172.21.15.120:0/824503899 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fa2200189c0 con 0x7fa230102e00 2024-09-19T05:16:42.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.886+0000 7fa2277fe640 1 --2- 172.21.15.120:0/824503899 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa21c0a32c0 0x7fa21c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:42.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.886+0000 7fa236469640 1 --2- 172.21.15.120:0/824503899 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa21c0a32c0 0x7fa21c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:42.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.887+0000 7fa2277fe640 1 -- 172.21.15.120:0/824503899 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fa2200cf5f0 con 0x7fa230102e00 2024-09-19T05:16:42.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.887+0000 7fa236469640 1 --2- 172.21.15.120:0/824503899 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa21c0a32c0 0x7fa21c0a5780 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa22c02a930 tx=0x7fa22c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:42.907 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:42.891+0000 7fa2277fe640 1 -- 172.21.15.120:0/824503899 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa220014030 con 0x7fa230102e00 2024-09-19T05:16:43.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:43.058+0000 7fa2386cd640 1 -- 172.21.15.120:0/824503899 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fa23002da30 con 0x7fa230102e00 2024-09-19T05:16:43.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:43.058+0000 7fa2277fe640 1 -- 172.21.15.120:0/824503899 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7fa22000de20 con 0x7fa230102e00 2024-09-19T05:16:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:16:43.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:43.061+0000 7fa2386cd640 1 -- 172.21.15.120:0/824503899 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa21c0a32c0 msgr2=0x7fa21c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:43.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:43.061+0000 7fa2386cd640 1 --2- 172.21.15.120:0/824503899 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa21c0a32c0 0x7fa21c0a5780 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa22c02a930 tx=0x7fa22c000bc0 comp rx=0 tx=0).stop 2024-09-19T05:16:43.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:43.061+0000 7fa2386cd640 1 -- 172.21.15.120:0/824503899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa230102e00 msgr2=0x7fa2300745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:43.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:43.061+0000 7fa2386cd640 1 --2- 172.21.15.120:0/824503899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa230102e00 0x7fa2300745e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa22000c920 tx=0x7fa22000cde0 comp rx=0 tx=0).stop 2024-09-19T05:16:43.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:43.061+0000 7fa2386cd640 1 -- 172.21.15.120:0/824503899 shutdown_connections 2024-09-19T05:16:43.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:43.061+0000 7fa2386cd640 1 --2- 172.21.15.120:0/824503899 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa21c0a32c0 0x7fa21c0a5780 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:43.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:43.061+0000 7fa2386cd640 1 --2- 172.21.15.120:0/824503899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2301037c0 0x7fa230074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:43.063 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:43.061+0000 7fa2386cd640 1 --2- 172.21.15.120:0/824503899 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa230102e00 0x7fa2300745e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:43.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:43.061+0000 7fa2386cd640 1 --2- 172.21.15.120:0/824503899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa230101c00 0x7fa230075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:43.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:43.061+0000 7fa2386cd640 1 -- 172.21.15.120:0/824503899 >> 172.21.15.120:0/824503899 conn(0x7fa2300fd390 msgr2=0x7fa230106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:43.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:43.061+0000 7fa2386cd640 1 -- 172.21.15.120:0/824503899 shutdown_connections 2024-09-19T05:16:43.064 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:43.061+0000 7fa2386cd640 1 -- 172.21.15.120:0/824503899 wait complete. 2024-09-19T05:16:43.374 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:43 smithi120 ceph-mon[30956]: purged_snaps scrub starts 2024-09-19T05:16:43.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:43 smithi120 ceph-mon[30956]: purged_snaps scrub ok 2024-09-19T05:16:43.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:43 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:16:43.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:43 smithi120 ceph-mon[30956]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:16:43.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:43 smithi120 ceph-mon[30956]: osd.11 [v2:172.21.15.194:6824/2713146974,v1:172.21.15.194:6825/2713146974] boot 2024-09-19T05:16:43.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:43 smithi120 ceph-mon[30956]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T05:16:43.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:43 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:16:43.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:43 smithi194 ceph-mon[35228]: purged_snaps scrub starts 2024-09-19T05:16:43.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:43 smithi194 ceph-mon[35228]: purged_snaps scrub ok 2024-09-19T05:16:43.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:43 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:16:43.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:43 smithi194 ceph-mon[35228]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:16:43.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:43 smithi194 ceph-mon[35228]: osd.11 [v2:172.21.15.194:6824/2713146974,v1:172.21.15.194:6825/2713146974] boot 2024-09-19T05:16:43.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:43 smithi194 ceph-mon[35228]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T05:16:43.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:43 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:16:43.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:43 smithi178 ceph-mon[34347]: purged_snaps scrub starts 2024-09-19T05:16:43.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:43 smithi178 ceph-mon[34347]: purged_snaps scrub ok 2024-09-19T05:16:43.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:43 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:16:43.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:43 smithi178 ceph-mon[34347]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-19T05:16:43.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:43 smithi178 ceph-mon[34347]: osd.11 [v2:172.21.15.194:6824/2713146974,v1:172.21.15.194:6825/2713146974] boot 2024-09-19T05:16:43.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:43 smithi178 ceph-mon[34347]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T05:16:43.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:43 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:16:43.798 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":74,"num_osds":12,"num_up_osds":12,"osd_up_since":1726723002,"num_in_osds":12,"osd_in_since":1726722978,"num_remapped_pgs":0} 2024-09-19T05:16:43.799 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T05:16:44.045 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:16:44.322 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:44 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/824503899' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T05:16:44.323 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:44 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/824503899' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T05:16:44.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:44 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/824503899' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T05:16:44.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.497+0000 7fb3eb667640 1 -- 172.21.15.120:0/3975663397 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3e4074f40 msgr2=0x7fb3e410de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:44.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.497+0000 7fb3eb667640 1 --2- 172.21.15.120:0/3975663397 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3e4074f40 0x7fb3e410de90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8009900 tx=0x7fb3d802a480 comp rx=0 tx=0).stop 2024-09-19T05:16:44.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.497+0000 7fb3eb667640 1 -- 172.21.15.120:0/3975663397 shutdown_connections 2024-09-19T05:16:44.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.497+0000 7fb3eb667640 1 --2- 172.21.15.120:0/3975663397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e410e3d0 0x7fb3e4110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:44.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.497+0000 7fb3eb667640 1 --2- 172.21.15.120:0/3975663397 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3e4074f40 0x7fb3e410de90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:44.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.497+0000 7fb3eb667640 1 --2- 172.21.15.120:0/3975663397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3e4074620 0x7fb3e4074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:44.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.497+0000 7fb3eb667640 1 -- 172.21.15.120:0/3975663397 >> 172.21.15.120:0/3975663397 conn(0x7fb3e40fd8f0 msgr2=0x7fb3e40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:44.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.497+0000 7fb3eb667640 1 -- 172.21.15.120:0/3975663397 shutdown_connections 2024-09-19T05:16:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.497+0000 7fb3eb667640 1 -- 172.21.15.120:0/3975663397 wait complete. 2024-09-19T05:16:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.497+0000 7fb3eb667640 1 Processor -- start 2024-09-19T05:16:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.498+0000 7fb3eb667640 1 -- start start 2024-09-19T05:16:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.498+0000 7fb3eb667640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3e4074620 0x7fb3e419a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.498+0000 7fb3eb667640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e4074f40 0x7fb3e419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.498+0000 7fb3eb667640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3e410e3d0 0x7fb3e419ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.498+0000 7fb3eb667640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e4114020 con 0x7fb3e410e3d0 2024-09-19T05:16:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.498+0000 7fb3eb667640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e4113ea0 con 0x7fb3e4074f40 2024-09-19T05:16:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.498+0000 7fb3eb667640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e41141a0 con 0x7fb3e4074620 2024-09-19T05:16:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.498+0000 7fb3e9c04640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3e410e3d0 0x7fb3e419ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.498+0000 7fb3e9c04640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3e410e3d0 0x7fb3e419ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36758/0 (socket says 172.21.15.120:36758) 2024-09-19T05:16:44.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.498+0000 7fb3e9c04640 1 -- 172.21.15.120:0/3784659322 learned_addr learned my addr 172.21.15.120:0/3784659322 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:16:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.498+0000 7fb3e9403640 1 --2- 172.21.15.120:0/3784659322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3e4074620 0x7fb3e419a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.498+0000 7fb3e8c02640 1 --2- 172.21.15.120:0/3784659322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e4074f40 0x7fb3e419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.498+0000 7fb3e9c04640 1 -- 172.21.15.120:0/3784659322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3e4074620 msgr2=0x7fb3e419a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.498+0000 7fb3e9c04640 1 --2- 172.21.15.120:0/3784659322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3e4074620 0x7fb3e419a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.498+0000 7fb3e9c04640 1 -- 172.21.15.120:0/3784659322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e4074f40 msgr2=0x7fb3e419aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.498+0000 7fb3e9c04640 1 --2- 172.21.15.120:0/3784659322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e4074f40 0x7fb3e419aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.498+0000 7fb3e9c04640 1 -- 172.21.15.120:0/3784659322 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e419f560 con 0x7fb3e410e3d0 2024-09-19T05:16:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.498+0000 7fb3e8c02640 1 --2- 172.21.15.120:0/3784659322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e4074f40 0x7fb3e419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:16:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.498+0000 7fb3e9c04640 1 --2- 172.21.15.120:0/3784659322 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3e410e3d0 0x7fb3e419ee80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc00d750 tx=0x7fb3dc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.498+0000 7fb3e27fc640 1 -- 172.21.15.120:0/3784659322 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc017070 con 0x7fb3e410e3d0 2024-09-19T05:16:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.499+0000 7fb3eb667640 1 -- 172.21.15.120:0/3784659322 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3e419f850 con 0x7fb3e410e3d0 2024-09-19T05:16:44.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.499+0000 7fb3e27fc640 1 -- 172.21.15.120:0/3784659322 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb3dc0054d0 con 0x7fb3e410e3d0 2024-09-19T05:16:44.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.499+0000 7fb3e27fc640 1 -- 172.21.15.120:0/3784659322 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc004c60 con 0x7fb3e410e3d0 2024-09-19T05:16:44.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.499+0000 7fb3eb667640 1 -- 172.21.15.120:0/3784659322 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3e41a7130 con 0x7fb3e410e3d0 2024-09-19T05:16:44.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.500+0000 7fb3eb667640 1 -- 172.21.15.120:0/3784659322 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3e4074a00 con 0x7fb3e410e3d0 2024-09-19T05:16:44.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.501+0000 7fb3e27fc640 1 -- 172.21.15.120:0/3784659322 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fb3dc004e00 con 0x7fb3e410e3d0 2024-09-19T05:16:44.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.501+0000 7fb3e27fc640 1 --2- 172.21.15.120:0/3784659322 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fb3cc0a3240 0x7fb3cc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:44.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.501+0000 7fb3e9403640 1 --2- 172.21.15.120:0/3784659322 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fb3cc0a3240 0x7fb3cc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:44.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.501+0000 7fb3e27fc640 1 -- 172.21.15.120:0/3784659322 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fb3dc0cedb0 con 0x7fb3e410e3d0 2024-09-19T05:16:44.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.502+0000 7fb3e9403640 1 --2- 172.21.15.120:0/3784659322 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fb3cc0a3240 0x7fb3cc0a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4005fd0 tx=0x7fb3d4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:44.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.505+0000 7fb3e27fc640 1 -- 172.21.15.120:0/3784659322 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb3dc09bf70 con 0x7fb3e410e3d0 2024-09-19T05:16:44.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.672+0000 7fb3eb667640 1 -- 172.21.15.120:0/3784659322 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb3e4109580 con 0x7fb3e410e3d0 2024-09-19T05:16:44.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.673+0000 7fb3e27fc640 1 -- 172.21.15.120:0/3784659322 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+18523 (secure 0 0 0) 0x7fb3dc09b870 con 0x7fb3e410e3d0 2024-09-19T05:16:44.675 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:16:44.675 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":75,"fsid":"4e6e3df4-7645-11ef-bceb-c7b262605968","created":"2024-09-19T05:09:55.847220+0000","modified":"2024-09-19T05:16:44.066919+0000","last_up_change":"2024-09-19T05:16:42.808178+0000","last_in_change":"2024-09-19T05:16:18.315940+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:13:02.340027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"18907a03-1f43-419a-acb6-9fa4cf5020d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6803","nonce":3421474326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6805","nonce":3421474326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6809","nonce":3421474326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6807","nonce":3421474326}]},"public_addr":"172.21.15.120:6803/3421474326","cluster_addr":"172.21.15.120:6805/3421474326","heartbeat_back_addr":"172.21.15.120:6809/3421474326","heartbeat_front_addr":"172.21.15.120:6807/3421474326","state":["exists","up"]},{"osd":1,"uuid":"d21e029b-8a60-43f9-9ba7-30cdba19ba57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6801","nonce":1195511218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6803","nonce":1195511218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6807","nonce":1195511218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6805","nonce":1195511218}]},"public_addr":"172.21.15.178:6801/1195511218","cluster_addr":"172.21.15.178:6803/1195511218","heartbeat_back_addr":"172.21.15.178:6807/1195511218","heartbeat_front_addr":"172.21.15.178:6805/1195511218","state":["exists","up"]},{"osd":2,"uuid":"26ad9c8d-dbaa-46c2-a346-19717d81cc60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6801","nonce":3752826560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6803","nonce":3752826560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6807","nonce":3752826560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6805","nonce":3752826560}]},"public_addr":"172.21.15.194:6801/3752826560","cluster_addr":"172.21.15.194:6803/3752826560","heartbeat_back_addr":"172.21.15.194:6807/3752826560","heartbeat_front_addr":"172.21.15.194:6805/3752826560","state":["exists","up"]},{"osd":3,"uuid":"7e266576-8a98-40a8-9532-4b6f4611a908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6811","nonce":803566783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6813","nonce":803566783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6817","nonce":803566783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6815","nonce":803566783}]},"public_addr":"172.21.15.120:6811/803566783","cluster_addr":"172.21.15.120:6813/803566783","heartbeat_back_addr":"172.21.15.120:6817/803566783","heartbeat_front_addr":"172.21.15.120:6815/803566783","state":["exists","up"]},{"osd":4,"uuid":"c77d05c5-3b8f-4f7b-91f9-833735221684","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6809","nonce":541165323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6811","nonce":541165323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6815","nonce":541165323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6813","nonce":541165323}]},"public_addr":"172.21.15.178:6809/541165323","cluster_addr":"172.21.15.178:6811/541165323","heartbeat_back_addr":"172.21.15.178:6815/541165323","heartbeat_front_addr":"172.21.15.178:6813/541165323","state":["exists","up"]},{"osd":5,"uuid":"5f1c394b-e510-411f-969a-2db2b68cf41a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6809","nonce":2631415468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6811","nonce":2631415468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6815","nonce":2631415468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6813","nonce":2631415468}]},"public_addr":"172.21.15.194:6809/2631415468","cluster_addr":"172.21.15.194:6811/2631415468","heartbeat_back_addr":"172.21.15.194:6815/2631415468","heartbeat_front_addr":"172.21.15.194:6813/2631415468","state":["exists","up"]},{"osd":6,"uuid":"990af639-099e-49df-a083-05626cee3c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6819","nonce":388238976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6821","nonce":388238976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6825","nonce":388238976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6823","nonce":388238976}]},"public_addr":"172.21.15.120:6819/388238976","cluster_addr":"172.21.15.120:6821/388238976","heartbeat_back_addr":"172.21.15.120:6825/388238976","heartbeat_front_addr":"172.21.15.120:6823/388238976","state":["exists","up"]},{"osd":7,"uuid":"6f4aa6ab-b5f4-4c06-9f14-9a51bc195ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6817","nonce":1912109177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6819","nonce":1912109177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6823","nonce":1912109177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6821","nonce":1912109177}]},"public_addr":"172.21.15.178:6817/1912109177","cluster_addr":"172.21.15.178:6819/1912109177","heartbeat_back_addr":"172.21.15.178:6823/1912109177","heartbeat_front_addr":"172.21.15.178:6821/1912109177","state":["exists","up"]},{"osd":8,"uuid":"707739c9-732a-405c-847a-ce6a06e611b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6817","nonce":596878172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6819","nonce":596878172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6823","nonce":596878172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6821","nonce":596878172}]},"public_addr":"172.21.15.194:6817/596878172","cluster_addr":"172.21.15.194:6819/596878172","heartbeat_back_addr":"172.21.15.194:6823/596878172","heartbeat_front_addr":"172.21.15.194:6821/596878172","state":["exists","up"]},{"osd":9,"uuid":"9393b018-c924-4d75-99e5-25433d276567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6827","nonce":3257373801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6829","nonce":3257373801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6833","nonce":3257373801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6831","nonce":3257373801}]},"public_addr":"172.21.15.120:6827/3257373801","cluster_addr":"172.21.15.120:6829/3257373801","heartbeat_back_addr":"172.21.15.120:6833/3257373801","heartbeat_front_addr":"172.21.15.120:6831/3257373801","state":["exists","up"]},{"osd":10,"uuid":"45db7f62-87a6-4b2b-a3dc-012e2de505e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6825","nonce":3067822030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6827","nonce":3067822030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6831","nonce":3067822030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6829","nonce":3067822030}]},"public_addr":"172.21.15.178:6825/3067822030","cluster_addr":"172.21.15.178:6827/3067822030","heartbeat_back_addr":"172.21.15.178:6831/3067822030","heartbeat_front_addr":"172.21.15.178:6829/3067822030","state":["exists","up"]},{"osd":11,"uuid":"85ea248c-9a36-41cb-a200-87138fb31602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6825","nonce":2713146974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6827","nonce":2713146974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6831","nonce":2713146974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6829","nonce":2713146974}]},"public_addr":"172.21.15.194:6825/2713146974","cluster_addr":"172.21.15.194:6827/2713146974","heartbeat_back_addr":"172.21.15.194:6831/2713146974","heartbeat_front_addr":"172.21.15.194:6829/2713146974","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:09.395371+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:33.648930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:58.805048+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:23.621459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:48.553860+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:13.506636+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:38.520376+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:02.695124+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:27.084956+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:50.924128+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:15.396694+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:40.440416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:0/3419110398":"2024-09-20T05:10:48.027892+0000","172.21.15.120:6801/50152720":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/4177074351":"2024-09-20T05:10:48.027892+0000","172.21.15.120:6800/50152720":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/329623296":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/2867300720":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/3592867428":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/4255533863":"2024-09-20T05:10:23.348128+0000","172.21.15.120:6801/3412493069":"2024-09-20T05:10:23.348128+0000","172.21.15.120:6800/3412493069":"2024-09-20T05:10:23.348128+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:16:44.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.675+0000 7fb3eb667640 1 -- 172.21.15.120:0/3784659322 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fb3cc0a3240 msgr2=0x7fb3cc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:44.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.675+0000 7fb3eb667640 1 --2- 172.21.15.120:0/3784659322 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fb3cc0a3240 0x7fb3cc0a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4005fd0 tx=0x7fb3d4009500 comp rx=0 tx=0).stop 2024-09-19T05:16:44.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.675+0000 7fb3eb667640 1 -- 172.21.15.120:0/3784659322 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3e410e3d0 msgr2=0x7fb3e419ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:44.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.675+0000 7fb3eb667640 1 --2- 172.21.15.120:0/3784659322 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3e410e3d0 0x7fb3e419ee80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc00d750 tx=0x7fb3dc00dc10 comp rx=0 tx=0).stop 2024-09-19T05:16:44.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.675+0000 7fb3eb667640 1 -- 172.21.15.120:0/3784659322 shutdown_connections 2024-09-19T05:16:44.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.675+0000 7fb3eb667640 1 --2- 172.21.15.120:0/3784659322 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3e410e3d0 0x7fb3e419ee80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:44.677 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.675+0000 7fb3eb667640 1 --2- 172.21.15.120:0/3784659322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e4074f40 0x7fb3e419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:44.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.675+0000 7fb3eb667640 1 --2- 172.21.15.120:0/3784659322 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fb3cc0a3240 0x7fb3cc0a5700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:44.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.675+0000 7fb3eb667640 1 --2- 172.21.15.120:0/3784659322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3e4074620 0x7fb3e419a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:44.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.675+0000 7fb3eb667640 1 -- 172.21.15.120:0/3784659322 >> 172.21.15.120:0/3784659322 conn(0x7fb3e40fd8f0 msgr2=0x7fb3e40ff1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:44.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.675+0000 7fb3eb667640 1 -- 172.21.15.120:0/3784659322 shutdown_connections 2024-09-19T05:16:44.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:44.675+0000 7fb3eb667640 1 -- 172.21.15.120:0/3784659322 wait complete. 2024-09-19T05:16:45.349 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:45 smithi120 ceph-mon[30956]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T05:16:45.349 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:45 smithi120 ceph-mon[30956]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:16:45.349 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:45 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/3784659322' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:16:45.381 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T05:13:02.340027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T05:16:45.382 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T05:16:45.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:45 smithi194 ceph-mon[35228]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T05:16:45.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:45 smithi194 ceph-mon[35228]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:16:45.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:45 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/3784659322' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:16:45.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:45 smithi178 ceph-mon[34347]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T05:16:45.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:45 smithi178 ceph-mon[34347]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:16:45.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:45 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/3784659322' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:16:45.627 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:16:46.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.014+0000 7f753315e640 1 -- 172.21.15.120:0/2027449316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f752c106a80 msgr2=0x7f752c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:46.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.014+0000 7f753315e640 1 --2- 172.21.15.120:0/2027449316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f752c106a80 0x7f752c106e60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f751c009930 tx=0x7f751c02a420 comp rx=0 tx=0).stop 2024-09-19T05:16:46.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.014+0000 7f753315e640 1 -- 172.21.15.120:0/2027449316 shutdown_connections 2024-09-19T05:16:46.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.014+0000 7f753315e640 1 --2- 172.21.15.120:0/2027449316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f752c101420 0x7f752c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:46.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.014+0000 7f753315e640 1 --2- 172.21.15.120:0/2027449316 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f752c100a80 0x7f752c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:46.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.014+0000 7f753315e640 1 --2- 172.21.15.120:0/2027449316 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f752c106a80 0x7f752c106e60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:46.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.014+0000 7f753315e640 1 -- 172.21.15.120:0/2027449316 >> 172.21.15.120:0/2027449316 conn(0x7f752c0fc7a0 msgr2=0x7f752c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:46.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.015+0000 7f753315e640 1 -- 172.21.15.120:0/2027449316 shutdown_connections 2024-09-19T05:16:46.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.015+0000 7f753315e640 1 -- 172.21.15.120:0/2027449316 wait complete. 2024-09-19T05:16:46.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.015+0000 7f753315e640 1 Processor -- start 2024-09-19T05:16:46.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.015+0000 7f753315e640 1 -- start start 2024-09-19T05:16:46.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.016+0000 7f753315e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f752c100a80 0x7f752c102ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:46.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.016+0000 7f753315e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f752c101420 0x7f752c103000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:46.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.016+0000 7f753315e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f752c106a80 0x7f752c103540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:46.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.016+0000 7f753315e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f752c110d30 con 0x7f752c100a80 2024-09-19T05:16:46.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.016+0000 7f753315e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f752c110bb0 con 0x7f752c101420 2024-09-19T05:16:46.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.016+0000 7f753315e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f752c110eb0 con 0x7f752c106a80 2024-09-19T05:16:46.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.016+0000 7f7530efa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f752c100a80 0x7f752c102ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:46.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.016+0000 7f7530efa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f752c100a80 0x7f752c102ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59768/0 (socket says 172.21.15.120:59768) 2024-09-19T05:16:46.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.016+0000 7f7530efa640 1 -- 172.21.15.120:0/2922816479 learned_addr learned my addr 172.21.15.120:0/2922816479 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:16:46.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.016+0000 7f752bfff640 1 --2- 172.21.15.120:0/2922816479 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f752c101420 0x7f752c103000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:46.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.016+0000 7f75316fb640 1 --2- 172.21.15.120:0/2922816479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f752c106a80 0x7f752c103540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:46.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.016+0000 7f7530efa640 1 -- 172.21.15.120:0/2922816479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f752c106a80 msgr2=0x7f752c103540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:46.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.016+0000 7f7530efa640 1 --2- 172.21.15.120:0/2922816479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f752c106a80 0x7f752c103540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:46.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.016+0000 7f7530efa640 1 -- 172.21.15.120:0/2922816479 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f752c101420 msgr2=0x7f752c103000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:46.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.016+0000 7f7530efa640 1 --2- 172.21.15.120:0/2922816479 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f752c101420 0x7f752c103000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:46.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.016+0000 7f7530efa640 1 -- 172.21.15.120:0/2922816479 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f752c1a6800 con 0x7f752c100a80 2024-09-19T05:16:46.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.016+0000 7f7530efa640 1 --2- 172.21.15.120:0/2922816479 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f752c100a80 0x7f752c102ac0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f751c004770 tx=0x7f751c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:46.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.017+0000 7f7529ffb640 1 -- 172.21.15.120:0/2922816479 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751c03f070 con 0x7f752c100a80 2024-09-19T05:16:46.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.017+0000 7f753315e640 1 -- 172.21.15.120:0/2922816479 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f752c1a6a90 con 0x7f752c100a80 2024-09-19T05:16:46.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.017+0000 7f7529ffb640 1 -- 172.21.15.120:0/2922816479 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f751c03b460 con 0x7f752c100a80 2024-09-19T05:16:46.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.017+0000 7f7529ffb640 1 -- 172.21.15.120:0/2922816479 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751c035070 con 0x7f752c100a80 2024-09-19T05:16:46.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.017+0000 7f753315e640 1 -- 172.21.15.120:0/2922816479 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f752c1a6fc0 con 0x7f752c100a80 2024-09-19T05:16:46.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.018+0000 7f753315e640 1 -- 172.21.15.120:0/2922816479 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f752c100ee0 con 0x7f752c100a80 2024-09-19T05:16:46.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.019+0000 7f7529ffb640 1 -- 172.21.15.120:0/2922816479 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f751c03b610 con 0x7f752c100a80 2024-09-19T05:16:46.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.020+0000 7f7529ffb640 1 --2- 172.21.15.120:0/2922816479 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f75140a32c0 0x7f75140a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:46.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.020+0000 7f752bfff640 1 --2- 172.21.15.120:0/2922816479 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f75140a32c0 0x7f75140a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:46.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.020+0000 7f7529ffb640 1 -- 172.21.15.120:0/2922816479 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f751c0efb40 con 0x7f752c100a80 2024-09-19T05:16:46.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.020+0000 7f752bfff640 1 --2- 172.21.15.120:0/2922816479 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f75140a32c0 0x7f75140a5780 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7520005fd0 tx=0x7f7520005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:46.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.023+0000 7f7529ffb640 1 -- 172.21.15.120:0/2922816479 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f751c0bcd00 con 0x7f752c100a80 2024-09-19T05:16:46.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.193+0000 7f753315e640 1 -- 172.21.15.120:0/2922816479 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f752c1a7250 con 0x7f752c100a80 2024-09-19T05:16:46.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.193+0000 7f7529ffb640 1 -- 172.21.15.120:0/2922816479 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f751c0bc600 con 0x7f752c100a80 2024-09-19T05:16:46.195 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-09-19T05:16:46.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.195+0000 7f753315e640 1 -- 172.21.15.120:0/2922816479 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f75140a32c0 msgr2=0x7f75140a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:46.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.195+0000 7f753315e640 1 --2- 172.21.15.120:0/2922816479 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f75140a32c0 0x7f75140a5780 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7520005fd0 tx=0x7f7520005850 comp rx=0 tx=0).stop 2024-09-19T05:16:46.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.195+0000 7f753315e640 1 -- 172.21.15.120:0/2922816479 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f752c100a80 msgr2=0x7f752c102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:46.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.195+0000 7f753315e640 1 --2- 172.21.15.120:0/2922816479 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f752c100a80 0x7f752c102ac0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f751c004770 tx=0x7f751c0042f0 comp rx=0 tx=0).stop 2024-09-19T05:16:46.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.195+0000 7f753315e640 1 -- 172.21.15.120:0/2922816479 shutdown_connections 2024-09-19T05:16:46.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.195+0000 7f753315e640 1 --2- 172.21.15.120:0/2922816479 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f75140a32c0 0x7f75140a5780 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:46.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.195+0000 7f753315e640 1 --2- 172.21.15.120:0/2922816479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f752c106a80 0x7f752c103540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:46.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.195+0000 7f753315e640 1 --2- 172.21.15.120:0/2922816479 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f752c101420 0x7f752c103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:46.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.195+0000 7f753315e640 1 --2- 172.21.15.120:0/2922816479 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f752c100a80 0x7f752c102ac0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:46.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.195+0000 7f753315e640 1 -- 172.21.15.120:0/2922816479 >> 172.21.15.120:0/2922816479 conn(0x7f752c0fc7a0 msgr2=0x7f752c104de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:46.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.195+0000 7f753315e640 1 -- 172.21.15.120:0/2922816479 shutdown_connections 2024-09-19T05:16:46.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:46.195+0000 7f753315e640 1 -- 172.21.15.120:0/2922816479 wait complete. 2024-09-19T05:16:46.867 INFO:tasks.cephadm:Adding mds.a on smithi120 2024-09-19T05:16:46.867 INFO:tasks.cephadm:Adding mds.d on smithi120 2024-09-19T05:16:46.867 INFO:tasks.cephadm:Adding mds.g on smithi120 2024-09-19T05:16:46.867 INFO:tasks.cephadm:Adding mds.j on smithi120 2024-09-19T05:16:46.868 INFO:tasks.cephadm:Adding mds.b on smithi178 2024-09-19T05:16:46.868 INFO:tasks.cephadm:Adding mds.e on smithi178 2024-09-19T05:16:46.868 INFO:tasks.cephadm:Adding mds.h on smithi178 2024-09-19T05:16:46.868 INFO:tasks.cephadm:Adding mds.k on smithi178 2024-09-19T05:16:46.868 INFO:tasks.cephadm:Adding mds.c on smithi194 2024-09-19T05:16:46.868 INFO:tasks.cephadm:Adding mds.f on smithi194 2024-09-19T05:16:46.868 INFO:tasks.cephadm:Adding mds.i on smithi194 2024-09-19T05:16:46.868 INFO:tasks.cephadm:Adding mds.l on smithi194 2024-09-19T05:16:46.868 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi120=a;smithi120=d;smithi120=g;smithi120=j;smithi178=b;smithi178=e;smithi178=h;smithi178=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l' 2024-09-19T05:16:47.129 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:16:47.426 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:47 smithi194 ceph-mon[35228]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:16:47.426 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:47 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/2922816479' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T05:16:47.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:47 smithi178 ceph-mon[34347]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:16:47.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:47 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/2922816479' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T05:16:47.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.604+0000 7f0b95422640 1 -- 172.21.15.194:0/3873331145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b90100e10 msgr2=0x7f0b90101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:47.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.604+0000 7f0b95422640 1 --2- 172.21.15.194:0/3873331145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b90100e10 0x7f0b90101270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0b78009900 tx=0x7f0b7802a410 comp rx=0 tx=0).stop 2024-09-19T05:16:47.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.605+0000 7f0b95422640 1 -- 172.21.15.194:0/3873331145 shutdown_connections 2024-09-19T05:16:47.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.605+0000 7f0b95422640 1 --2- 172.21.15.194:0/3873331145 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b901017b0 0x7f0b90101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:47.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.605+0000 7f0b95422640 1 --2- 172.21.15.194:0/3873331145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b90100e10 0x7f0b90101270 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:47.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.605+0000 7f0b95422640 1 --2- 172.21.15.194:0/3873331145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b901004d0 0x7f0b901008d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:47.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.605+0000 7f0b95422640 1 -- 172.21.15.194:0/3873331145 >> 172.21.15.194:0/3873331145 conn(0x7f0b900fc280 msgr2=0x7f0b900fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:47.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.605+0000 7f0b95422640 1 -- 172.21.15.194:0/3873331145 shutdown_connections 2024-09-19T05:16:47.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.605+0000 7f0b95422640 1 -- 172.21.15.194:0/3873331145 wait complete. 2024-09-19T05:16:47.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.605+0000 7f0b95422640 1 Processor -- start 2024-09-19T05:16:47.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.605+0000 7f0b95422640 1 -- start start 2024-09-19T05:16:47.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.605+0000 7f0b95422640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b901004d0 0x7f0b90199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:47.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.605+0000 7f0b95422640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b90100e10 0x7f0b9019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:47.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.605+0000 7f0b95422640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b901017b0 0x7f0b901a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:47.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.606+0000 7f0b95422640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9010f8d0 con 0x7f0b90100e10 2024-09-19T05:16:47.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.606+0000 7f0b95422640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9010f750 con 0x7f0b901004d0 2024-09-19T05:16:47.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.606+0000 7f0b95422640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9010fa50 con 0x7f0b901017b0 2024-09-19T05:16:47.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.606+0000 7f0b8f7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b901017b0 0x7f0b901a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:47.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.606+0000 7f0b8f7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b901017b0 0x7f0b901a1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:46012/0 (socket says 172.21.15.194:46012) 2024-09-19T05:16:47.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.606+0000 7f0b8f7fe640 1 -- 172.21.15.194:0/3117506591 learned_addr learned my addr 172.21.15.194:0/3117506591 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-19T05:16:47.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.606+0000 7f0b8e7fc640 1 --2- 172.21.15.194:0/3117506591 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b90100e10 0x7f0b9019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:47.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.606+0000 7f0b8effd640 1 --2- 172.21.15.194:0/3117506591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b901004d0 0x7f0b90199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:47.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.606+0000 7f0b8f7fe640 1 -- 172.21.15.194:0/3117506591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b901004d0 msgr2=0x7f0b90199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:47.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.606+0000 7f0b8f7fe640 1 --2- 172.21.15.194:0/3117506591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b901004d0 0x7f0b90199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:47.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.606+0000 7f0b8f7fe640 1 -- 172.21.15.194:0/3117506591 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b90100e10 msgr2=0x7f0b9019a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:47.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.606+0000 7f0b8f7fe640 1 --2- 172.21.15.194:0/3117506591 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b90100e10 0x7f0b9019a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:47.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.606+0000 7f0b8f7fe640 1 -- 172.21.15.194:0/3117506591 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b901a1bc0 con 0x7f0b901017b0 2024-09-19T05:16:47.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.606+0000 7f0b8f7fe640 1 --2- 172.21.15.194:0/3117506591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b901017b0 0x7f0b901a1550 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800c970 tx=0x7f0b8800ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:47.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.606+0000 7f0b87fff640 1 -- 172.21.15.194:0/3117506591 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b88007bb0 con 0x7f0b901017b0 2024-09-19T05:16:47.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.606+0000 7f0b95422640 1 -- 172.21.15.194:0/3117506591 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b901a1eb0 con 0x7f0b901017b0 2024-09-19T05:16:47.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.606+0000 7f0b87fff640 1 -- 172.21.15.194:0/3117506591 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0b88007d50 con 0x7f0b901017b0 2024-09-19T05:16:47.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.606+0000 7f0b87fff640 1 -- 172.21.15.194:0/3117506591 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b88018700 con 0x7f0b901017b0 2024-09-19T05:16:47.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.606+0000 7f0b95422640 1 -- 172.21.15.194:0/3117506591 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b901a2310 con 0x7f0b901017b0 2024-09-19T05:16:47.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.607+0000 7f0b95422640 1 -- 172.21.15.194:0/3117506591 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b9010b220 con 0x7f0b901017b0 2024-09-19T05:16:47.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.608+0000 7f0b87fff640 1 -- 172.21.15.194:0/3117506591 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f0b8800fa20 con 0x7f0b901017b0 2024-09-19T05:16:47.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.609+0000 7f0b87fff640 1 --2- 172.21.15.194:0/3117506591 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0b7c0a3270 0x7f0b7c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:47.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.609+0000 7f0b87fff640 1 -- 172.21.15.194:0/3117506591 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f0b880cf460 con 0x7f0b901017b0 2024-09-19T05:16:47.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.609+0000 7f0b8effd640 1 --2- 172.21.15.194:0/3117506591 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0b7c0a3270 0x7f0b7c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:47.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.610+0000 7f0b8effd640 1 --2- 172.21.15.194:0/3117506591 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0b7c0a3270 0x7f0b7c0a5730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0b80005fd0 tx=0x7f0b80009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:47.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.613+0000 7f0b87fff640 1 -- 172.21.15.194:0/3117506591 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0b88014030 con 0x7f0b901017b0 2024-09-19T05:16:47.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:47 smithi120 ceph-mon[30956]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:16:47.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:47 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2922816479' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T05:16:47.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.787+0000 7f0b95422640 1 -- 172.21.15.194:0/3117506591 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi120=a;smithi120=d;smithi120=g;smithi120=j;smithi178=b;smithi178=e;smithi178=h;smithi178=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l", "target": ["mon-mgr", ""]}) -- 0x7f0b90062730 con 0x7f0b7c0a3270 2024-09-19T05:16:47.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.795+0000 7f0b87fff640 1 -- 172.21.15.194:0/3117506591 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f0b90062730 con 0x7f0b7c0a3270 2024-09-19T05:16:47.797 INFO:teuthology.orchestra.run.smithi194.stdout:Scheduled mds.all update... 2024-09-19T05:16:47.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.797+0000 7f0b95422640 1 -- 172.21.15.194:0/3117506591 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0b7c0a3270 msgr2=0x7f0b7c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:47.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.797+0000 7f0b95422640 1 --2- 172.21.15.194:0/3117506591 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0b7c0a3270 0x7f0b7c0a5730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0b80005fd0 tx=0x7f0b80009500 comp rx=0 tx=0).stop 2024-09-19T05:16:47.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.797+0000 7f0b95422640 1 -- 172.21.15.194:0/3117506591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b901017b0 msgr2=0x7f0b901a1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:47.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.797+0000 7f0b95422640 1 --2- 172.21.15.194:0/3117506591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b901017b0 0x7f0b901a1550 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800c970 tx=0x7f0b8800ce30 comp rx=0 tx=0).stop 2024-09-19T05:16:47.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.797+0000 7f0b95422640 1 -- 172.21.15.194:0/3117506591 shutdown_connections 2024-09-19T05:16:47.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.797+0000 7f0b95422640 1 --2- 172.21.15.194:0/3117506591 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0b7c0a3270 0x7f0b7c0a5730 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:47.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.797+0000 7f0b95422640 1 --2- 172.21.15.194:0/3117506591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b901017b0 0x7f0b901a1550 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:47.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.797+0000 7f0b95422640 1 --2- 172.21.15.194:0/3117506591 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0b90100e10 0x7f0b9019a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:47.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.797+0000 7f0b95422640 1 --2- 172.21.15.194:0/3117506591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b901004d0 0x7f0b90199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:47.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.797+0000 7f0b95422640 1 -- 172.21.15.194:0/3117506591 >> 172.21.15.194:0/3117506591 conn(0x7f0b900fc280 msgr2=0x7f0b900fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:47.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.798+0000 7f0b95422640 1 -- 172.21.15.194:0/3117506591 shutdown_connections 2024-09-19T05:16:47.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-19T05:16:47.798+0000 7f0b95422640 1 -- 172.21.15.194:0/3117506591 wait complete. 2024-09-19T05:16:48.511 DEBUG:teuthology.orchestra.run.smithi120:mds.a> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T05:16:48.514 DEBUG:teuthology.orchestra.run.smithi120:mds.d> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T05:16:48.557 DEBUG:teuthology.orchestra.run.smithi120:mds.g> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T05:16:48.601 DEBUG:teuthology.orchestra.run.smithi120:mds.j> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T05:16:48.643 DEBUG:teuthology.orchestra.run.smithi178:mds.b> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T05:16:48.646 DEBUG:teuthology.orchestra.run.smithi178:mds.e> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T05:16:48.692 DEBUG:teuthology.orchestra.run.smithi178:mds.h> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T05:16:48.735 DEBUG:teuthology.orchestra.run.smithi178:mds.k> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T05:16:48.778 DEBUG:teuthology.orchestra.run.smithi194:mds.c> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T05:16:48.781 DEBUG:teuthology.orchestra.run.smithi194:mds.f> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T05:16:48.823 DEBUG:teuthology.orchestra.run.smithi194:mds.i> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T05:16:48.866 DEBUG:teuthology.orchestra.run.smithi194:mds.l> sudo journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T05:16:48.909 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T05:16:48.910 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:16:48.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:48 smithi178 ceph-mon[34347]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi120=a;smithi120=d;smithi120=g;smithi120=j;smithi178=b;smithi178=e;smithi178=h;smithi178=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:16:48.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:48 smithi178 ceph-mon[34347]: Saving service mds.all spec with placement smithi120=a;smithi120=d;smithi120=g;smithi120=j;smithi178=b;smithi178=e;smithi178=h;smithi178=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l;count:12 2024-09-19T05:16:48.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:48 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:48.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:48 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:48.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:48 smithi178 ceph-mon[34347]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:16:48.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:48 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:48.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:48 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:48.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:48 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:48.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:48 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:16:48.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:48 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:16:48.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:48 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:48.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:48 smithi178 ceph-mon[34347]: Deploying daemon mds.l on smithi194 2024-09-19T05:16:49.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:48 smithi194 ceph-mon[35228]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi120=a;smithi120=d;smithi120=g;smithi120=j;smithi178=b;smithi178=e;smithi178=h;smithi178=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:16:49.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:48 smithi194 ceph-mon[35228]: Saving service mds.all spec with placement smithi120=a;smithi120=d;smithi120=g;smithi120=j;smithi178=b;smithi178=e;smithi178=h;smithi178=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l;count:12 2024-09-19T05:16:49.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:48 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:49.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:48 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:49.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:48 smithi194 ceph-mon[35228]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:16:49.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:48 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:49.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:48 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:49.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:48 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:49.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:48 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:16:49.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:48 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:16:49.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:48 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:49.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:48 smithi194 ceph-mon[35228]: Deploying daemon mds.l on smithi194 2024-09-19T05:16:49.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:48 smithi120 ceph-mon[30956]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi120=a;smithi120=d;smithi120=g;smithi120=j;smithi178=b;smithi178=e;smithi178=h;smithi178=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:16:49.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:48 smithi120 ceph-mon[30956]: Saving service mds.all spec with placement smithi120=a;smithi120=d;smithi120=g;smithi120=j;smithi178=b;smithi178=e;smithi178=h;smithi178=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l;count:12 2024-09-19T05:16:49.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:49.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:16:49.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:48 smithi120 ceph-mon[30956]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:16:49.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:49.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:16:49.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:49.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:16:49.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:16:49.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:49.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:48 smithi120 ceph-mon[30956]: Deploying daemon mds.l on smithi194 2024-09-19T05:16:49.153 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:16:49.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.569+0000 7f19ac08a640 1 -- 172.21.15.120:0/2484504644 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19a4102570 msgr2=0x7f19a41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:49.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.569+0000 7f19ac08a640 1 --2- 172.21.15.120:0/2484504644 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19a4102570 0x7f19a41029b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1994009900 tx=0x7f199402a480 comp rx=0 tx=0).stop 2024-09-19T05:16:49.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.569+0000 7f19ac08a640 1 -- 172.21.15.120:0/2484504644 shutdown_connections 2024-09-19T05:16:49.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.569+0000 7f19ac08a640 1 --2- 172.21.15.120:0/2484504644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19a4102ef0 0x7f19a410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:49.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.569+0000 7f19ac08a640 1 --2- 172.21.15.120:0/2484504644 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19a4102570 0x7f19a41029b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:49.573 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.569+0000 7f19ac08a640 1 --2- 172.21.15.120:0/2484504644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19a4100e20 0x7f19a4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:49.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.569+0000 7f19ac08a640 1 -- 172.21.15.120:0/2484504644 >> 172.21.15.120:0/2484504644 conn(0x7f19a40fc7d0 msgr2=0x7f19a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:49.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.569+0000 7f19ac08a640 1 -- 172.21.15.120:0/2484504644 shutdown_connections 2024-09-19T05:16:49.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.569+0000 7f19ac08a640 1 -- 172.21.15.120:0/2484504644 wait complete. 2024-09-19T05:16:49.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.569+0000 7f19ac08a640 1 Processor -- start 2024-09-19T05:16:49.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.569+0000 7f19ac08a640 1 -- start start 2024-09-19T05:16:49.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.570+0000 7f19ac08a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19a4100e20 0x7f19a4198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:49.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.570+0000 7f19ac08a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19a4102570 0x7f19a4198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:49.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.570+0000 7f19ac08a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19a4102ef0 0x7f19a419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:49.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.570+0000 7f19ac08a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f19a4110ed0 con 0x7f19a4102570 2024-09-19T05:16:49.574 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.570+0000 7f19ac08a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f19a4110d50 con 0x7f19a4102ef0 2024-09-19T05:16:49.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.570+0000 7f19ac08a640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f19a4111050 con 0x7f19a4100e20 2024-09-19T05:16:49.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.570+0000 7f19a9625640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19a4102570 0x7f19a4198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:49.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.570+0000 7f19a9625640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19a4102570 0x7f19a4198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59778/0 (socket says 172.21.15.120:59778) 2024-09-19T05:16:49.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.570+0000 7f19a9625640 1 -- 172.21.15.120:0/3285814080 learned_addr learned my addr 172.21.15.120:0/3285814080 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:16:49.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.570+0000 7f19a9e26640 1 --2- 172.21.15.120:0/3285814080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19a4100e20 0x7f19a4198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:49.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.570+0000 7f19aa627640 1 --2- 172.21.15.120:0/3285814080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19a4102ef0 0x7f19a419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:49.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.570+0000 7f19a9625640 1 -- 172.21.15.120:0/3285814080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19a4100e20 msgr2=0x7f19a4198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:49.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.570+0000 7f19a9625640 1 --2- 172.21.15.120:0/3285814080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19a4100e20 0x7f19a4198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:49.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.570+0000 7f19a9625640 1 -- 172.21.15.120:0/3285814080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19a4102ef0 msgr2=0x7f19a419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:49.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.570+0000 7f19a9625640 1 --2- 172.21.15.120:0/3285814080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19a4102ef0 0x7f19a419cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:49.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.570+0000 7f19a9625640 1 -- 172.21.15.120:0/3285814080 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a419d480 con 0x7f19a4102570 2024-09-19T05:16:49.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.570+0000 7f19aa627640 1 --2- 172.21.15.120:0/3285814080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19a4102ef0 0x7f19a419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:16:49.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.570+0000 7f19a9625640 1 --2- 172.21.15.120:0/3285814080 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19a4102570 0x7f19a4198ab0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1994006010 tx=0x7f19940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:49.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.570+0000 7f199affd640 1 -- 172.21.15.120:0/3285814080 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199403f070 con 0x7f19a4102570 2024-09-19T05:16:49.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.570+0000 7f199affd640 1 -- 172.21.15.120:0/3285814080 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1994003aa0 con 0x7f19a4102570 2024-09-19T05:16:49.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.570+0000 7f19ac08a640 1 -- 172.21.15.120:0/3285814080 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19a419d710 con 0x7f19a4102570 2024-09-19T05:16:49.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.570+0000 7f199affd640 1 -- 172.21.15.120:0/3285814080 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1994035030 con 0x7f19a4102570 2024-09-19T05:16:49.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.571+0000 7f19ac08a640 1 -- 172.21.15.120:0/3285814080 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19a41a5050 con 0x7f19a4102570 2024-09-19T05:16:49.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.571+0000 7f19ac08a640 1 -- 172.21.15.120:0/3285814080 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19a4101200 con 0x7f19a4102570 2024-09-19T05:16:49.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.573+0000 7f199affd640 1 -- 172.21.15.120:0/3285814080 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f1994042070 con 0x7f19a4102570 2024-09-19T05:16:49.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.573+0000 7f199affd640 1 --2- 172.21.15.120:0/3285814080 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f19900a3240 0x7f19900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:49.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.573+0000 7f19a9e26640 1 --2- 172.21.15.120:0/3285814080 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f19900a3240 0x7f19900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:49.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.573+0000 7f199affd640 1 -- 172.21.15.120:0/3285814080 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f19940f0490 con 0x7f19a4102570 2024-09-19T05:16:49.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.574+0000 7f19a9e26640 1 --2- 172.21.15.120:0/3285814080 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f19900a3240 0x7f19900a5700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009990 tx=0x7f19a0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:49.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.576+0000 7f199affd640 1 -- 172.21.15.120:0/3285814080 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f19940bd650 con 0x7f19a4102570 2024-09-19T05:16:49.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.778+0000 7f19ac08a640 1 -- 172.21.15.120:0/3285814080 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19a41a5220 con 0x7f19a4102570 2024-09-19T05:16:49.780 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.779+0000 7f199affd640 1 -- 172.21.15.120:0/3285814080 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f19940bcf50 con 0x7f19a4102570 2024-09-19T05:16:49.781 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:16:49.781 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"btime":"2024-09-19T05:09:55:846992+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T05:16:49.781 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 1 2024-09-19T05:16:49.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.780+0000 7f19ac08a640 1 -- 172.21.15.120:0/3285814080 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f19900a3240 msgr2=0x7f19900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:49.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.780+0000 7f19ac08a640 1 --2- 172.21.15.120:0/3285814080 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f19900a3240 0x7f19900a5700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009990 tx=0x7f19a0009110 comp rx=0 tx=0).stop 2024-09-19T05:16:49.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.781+0000 7f19ac08a640 1 -- 172.21.15.120:0/3285814080 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19a4102570 msgr2=0x7f19a4198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:49.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.781+0000 7f19ac08a640 1 --2- 172.21.15.120:0/3285814080 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19a4102570 0x7f19a4198ab0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1994006010 tx=0x7f19940042f0 comp rx=0 tx=0).stop 2024-09-19T05:16:49.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.781+0000 7f19ac08a640 1 -- 172.21.15.120:0/3285814080 shutdown_connections 2024-09-19T05:16:49.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.781+0000 7f19ac08a640 1 --2- 172.21.15.120:0/3285814080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19a4102ef0 0x7f19a419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:49.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.781+0000 7f19ac08a640 1 --2- 172.21.15.120:0/3285814080 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19a4102570 0x7f19a4198ab0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:49.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.781+0000 7f19ac08a640 1 --2- 172.21.15.120:0/3285814080 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f19900a3240 0x7f19900a5700 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:49.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.781+0000 7f19ac08a640 1 --2- 172.21.15.120:0/3285814080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19a4100e20 0x7f19a4198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:49.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.781+0000 7f19ac08a640 1 -- 172.21.15.120:0/3285814080 >> 172.21.15.120:0/3285814080 conn(0x7f19a40fc7d0 msgr2=0x7f19a4069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:49.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.781+0000 7f19ac08a640 1 -- 172.21.15.120:0/3285814080 shutdown_connections 2024-09-19T05:16:49.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:49.781+0000 7f19ac08a640 1 -- 172.21.15.120:0/3285814080 wait complete. 2024-09-19T05:16:49.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:49 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/3285814080' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:16:49.892 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:49 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/3285814080' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:16:50.155 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 19 05:16:50 smithi194 systemd[1]: Starting Ceph mds.l for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:16:50.191 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:49 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/3285814080' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:16:50.586 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 19 05:16:50 smithi194 podman[64703]: 2024-09-19 05:16:50.184698942 +0000 UTC m=+0.016022977 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:16:50.587 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 19 05:16:50 smithi194 podman[64703]: 2024-09-19 05:16:50.291808834 +0000 UTC m=+0.123132938 container create 43f3dcfea02e2abd89b2708c0ff778f9a0ba35098f8f6da63bf48cffdd5371d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-l, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:16:50.587 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 19 05:16:50 smithi194 podman[64703]: 2024-09-19 05:16:50.502429073 +0000 UTC m=+0.333753109 container init 43f3dcfea02e2abd89b2708c0ff778f9a0ba35098f8f6da63bf48cffdd5371d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-l, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:16:50.587 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 19 05:16:50 smithi194 podman[64703]: 2024-09-19 05:16:50.505236828 +0000 UTC m=+0.336560871 container start 43f3dcfea02e2abd89b2708c0ff778f9a0ba35098f8f6da63bf48cffdd5371d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-l, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T05:16:50.587 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 19 05:16:50 smithi194 ceph-mds[64722]: -- 172.21.15.194:0/1740183267 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564e78def860 con 0x564e78dcd000 2024-09-19T05:16:50.587 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 19 05:16:50 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-l[64718]: starting mds.l at 2024-09-19T05:16:50.587 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 19 05:16:50 smithi194 bash[64703]: 43f3dcfea02e2abd89b2708c0ff778f9a0ba35098f8f6da63bf48cffdd5371d3 2024-09-19T05:16:50.905 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 19 05:16:50 smithi194 systemd[1]: Started Ceph mds.l for 4e6e3df4-7645-11ef-bceb-c7b262605968. 2024-09-19T05:16:50.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:50 smithi194 ceph-mon[35228]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:16:50.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:50 smithi194 ceph-mon[35228]: mds.? [v2:172.21.15.194:6832/1778722040,v1:172.21.15.194:6833/1778722040] up:boot 2024-09-19T05:16:50.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:50 smithi194 ceph-mon[35228]: fsmap 1 up:standby 2024-09-19T05:16:50.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:50 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T05:16:50.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:50 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:50.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:50 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:50.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:50 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:50.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:50 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:16:50.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:50 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:16:50.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:50 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:51.062 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:50 smithi178 ceph-mon[34347]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:16:51.062 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:50 smithi178 ceph-mon[34347]: mds.? [v2:172.21.15.194:6832/1778722040,v1:172.21.15.194:6833/1778722040] up:boot 2024-09-19T05:16:51.062 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:50 smithi178 ceph-mon[34347]: fsmap 1 up:standby 2024-09-19T05:16:51.063 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:50 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T05:16:51.063 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:50 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:51.063 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:50 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:51.063 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:50 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:51.063 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:50 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:16:51.063 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:50 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:16:51.063 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:50 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:51.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:50 smithi120 ceph-mon[30956]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:16:51.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:50 smithi120 ceph-mon[30956]: mds.? [v2:172.21.15.194:6832/1778722040,v1:172.21.15.194:6833/1778722040] up:boot 2024-09-19T05:16:51.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:50 smithi120 ceph-mon[30956]: fsmap 1 up:standby 2024-09-19T05:16:51.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:50 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T05:16:51.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:50 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:51.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:50 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:51.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:50 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:51.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:50 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:16:51.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:50 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:16:51.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:50 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:52.065 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:51 smithi178 ceph-mon[34347]: Deploying daemon mds.k on smithi178 2024-09-19T05:16:52.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:51 smithi120 ceph-mon[30956]: Deploying daemon mds.k on smithi178 2024-09-19T05:16:52.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:51 smithi194 ceph-mon[35228]: Deploying daemon mds.k on smithi178 2024-09-19T05:16:52.449 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:16:52.692 INFO:journalctl@ceph.mds.k.smithi178.stdout:Sep 19 05:16:52 smithi178 systemd[1]: Starting Ceph mds.k for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:16:52.701 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:16:53.057 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:52 smithi178 ceph-mon[34347]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:16:53.058 INFO:journalctl@ceph.mds.k.smithi178.stdout:Sep 19 05:16:52 smithi178 podman[63350]: 2024-09-19 05:16:52.692802983 +0000 UTC m=+0.016034644 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:16:53.058 INFO:journalctl@ceph.mds.k.smithi178.stdout:Sep 19 05:16:52 smithi178 podman[63350]: 2024-09-19 05:16:52.811400448 +0000 UTC m=+0.134632106 container create dd4e17833d8b595208c09a51249cc1dea7f069f1313ec54878d2ba94f851ff73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-k, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T05:16:53.058 INFO:journalctl@ceph.mds.k.smithi178.stdout:Sep 19 05:16:53 smithi178 podman[63350]: 2024-09-19 05:16:53.030626233 +0000 UTC m=+0.353857895 container init dd4e17833d8b595208c09a51249cc1dea7f069f1313ec54878d2ba94f851ff73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-k, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T05:16:53.058 INFO:journalctl@ceph.mds.k.smithi178.stdout:Sep 19 05:16:53 smithi178 podman[63350]: 2024-09-19 05:16:53.033383968 +0000 UTC m=+0.356615631 container start dd4e17833d8b595208c09a51249cc1dea7f069f1313ec54878d2ba94f851ff73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-k, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T05:16:53.107 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:52 smithi120 ceph-mon[30956]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:16:53.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.109+0000 7f4392334640 1 -- 172.21.15.120:0/770585152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f438c1036e0 msgr2=0x7f438c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:53.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.109+0000 7f4392334640 1 --2- 172.21.15.120:0/770585152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f438c1036e0 0x7f438c107b90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4380009930 tx=0x7f438002a420 comp rx=0 tx=0).stop 2024-09-19T05:16:53.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.109+0000 7f4392334640 1 -- 172.21.15.120:0/770585152 shutdown_connections 2024-09-19T05:16:53.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.109+0000 7f4392334640 1 --2- 172.21.15.120:0/770585152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f438c1082a0 0x7f438c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:53.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.109+0000 7f4392334640 1 --2- 172.21.15.120:0/770585152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f438c1036e0 0x7f438c107b90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:53.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.109+0000 7f4392334640 1 --2- 172.21.15.120:0/770585152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f438c102d30 0x7f438c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:53.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.109+0000 7f4392334640 1 -- 172.21.15.120:0/770585152 >> 172.21.15.120:0/770585152 conn(0x7f438c0fc7d0 msgr2=0x7f438c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:53.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.109+0000 7f4392334640 1 -- 172.21.15.120:0/770585152 shutdown_connections 2024-09-19T05:16:53.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.109+0000 7f4392334640 1 -- 172.21.15.120:0/770585152 wait complete. 2024-09-19T05:16:53.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.110+0000 7f4392334640 1 Processor -- start 2024-09-19T05:16:53.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.110+0000 7f4392334640 1 -- start start 2024-09-19T05:16:53.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.110+0000 7f4392334640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f438c102d30 0x7f438c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:53.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.110+0000 7f4392334640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f438c1036e0 0x7f438c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:53.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.110+0000 7f4392334640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f438c1082a0 0x7f438c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:53.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.110+0000 7f4392334640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f438c111f70 con 0x7f438c1082a0 2024-09-19T05:16:53.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.110+0000 7f4392334640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f438c111df0 con 0x7f438c1036e0 2024-09-19T05:16:53.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.110+0000 7f4392334640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f438c1120f0 con 0x7f438c102d30 2024-09-19T05:16:53.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.110+0000 7f43908d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f438c1082a0 0x7f438c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:53.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.110+0000 7f43908d1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f438c1082a0 0x7f438c19ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:59788/0 (socket says 172.21.15.120:59788) 2024-09-19T05:16:53.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.110+0000 7f43908d1640 1 -- 172.21.15.120:0/1072915975 learned_addr learned my addr 172.21.15.120:0/1072915975 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:16:53.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.110+0000 7f438b7fe640 1 --2- 172.21.15.120:0/1072915975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f438c1036e0 0x7f438c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:53.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.111+0000 7f438bfff640 1 --2- 172.21.15.120:0/1072915975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f438c102d30 0x7f438c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:53.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.111+0000 7f43908d1640 1 -- 172.21.15.120:0/1072915975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f438c102d30 msgr2=0x7f438c198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:53.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.111+0000 7f43908d1640 1 --2- 172.21.15.120:0/1072915975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f438c102d30 0x7f438c198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:53.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.111+0000 7f43908d1640 1 -- 172.21.15.120:0/1072915975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f438c1036e0 msgr2=0x7f438c198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:53.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.111+0000 7f43908d1640 1 --2- 172.21.15.120:0/1072915975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f438c1036e0 0x7f438c198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:53.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.111+0000 7f43908d1640 1 -- 172.21.15.120:0/1072915975 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f438c19d4e0 con 0x7f438c1082a0 2024-09-19T05:16:53.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.111+0000 7f438b7fe640 1 --2- 172.21.15.120:0/1072915975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f438c1036e0 0x7f438c198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:16:53.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.111+0000 7f43908d1640 1 --2- 172.21.15.120:0/1072915975 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f438c1082a0 0x7f438c19ce00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f438400b970 tx=0x7f438400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:53.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.111+0000 7f43897fa640 1 -- 172.21.15.120:0/1072915975 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4384019070 con 0x7f438c1082a0 2024-09-19T05:16:53.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.111+0000 7f4392334640 1 -- 172.21.15.120:0/1072915975 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f438c19d7d0 con 0x7f438c1082a0 2024-09-19T05:16:53.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.111+0000 7f43897fa640 1 -- 172.21.15.120:0/1072915975 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4384014440 con 0x7f438c1082a0 2024-09-19T05:16:53.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.111+0000 7f43897fa640 1 -- 172.21.15.120:0/1072915975 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43840075d0 con 0x7f438c1082a0 2024-09-19T05:16:53.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.111+0000 7f4392334640 1 -- 172.21.15.120:0/1072915975 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f438c1a50b0 con 0x7f438c1082a0 2024-09-19T05:16:53.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.112+0000 7f4392334640 1 -- 172.21.15.120:0/1072915975 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f438c103110 con 0x7f438c1082a0 2024-09-19T05:16:53.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.113+0000 7f43897fa640 1 -- 172.21.15.120:0/1072915975 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f438401c070 con 0x7f438c1082a0 2024-09-19T05:16:53.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.114+0000 7f43897fa640 1 --2- 172.21.15.120:0/1072915975 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f43740a3240 0x7f43740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:53.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.114+0000 7f438bfff640 1 --2- 172.21.15.120:0/1072915975 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f43740a3240 0x7f43740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:53.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.114+0000 7f43897fa640 1 -- 172.21.15.120:0/1072915975 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f43840cea40 con 0x7f438c1082a0 2024-09-19T05:16:53.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.114+0000 7f438bfff640 1 --2- 172.21.15.120:0/1072915975 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f43740a3240 0x7f43740a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f437c005fd0 tx=0x7f437c00b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:53.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.118+0000 7f43897fa640 1 -- 172.21.15.120:0/1072915975 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f438409b5b0 con 0x7f438c1082a0 2024-09-19T05:16:53.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:52 smithi194 ceph-mon[35228]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:16:53.345 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.343+0000 7f4392334640 1 -- 172.21.15.120:0/1072915975 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f438c10a2b0 con 0x7f438c1082a0 2024-09-19T05:16:53.346 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.344+0000 7f43897fa640 1 -- 172.21.15.120:0/1072915975 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f438409f8b0 con 0x7f438c1082a0 2024-09-19T05:16:53.346 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:16:53.346 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":2,"btime":"2024-09-19T05:16:50:533194+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1778722040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1778722040},{"type":"v1","addr":"172.21.15.194:6833","nonce":1778722040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T05:16:53.346 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 2 2024-09-19T05:16:53.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.346+0000 7f4392334640 1 -- 172.21.15.120:0/1072915975 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f43740a3240 msgr2=0x7f43740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:53.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.346+0000 7f4392334640 1 --2- 172.21.15.120:0/1072915975 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f43740a3240 0x7f43740a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f437c005fd0 tx=0x7f437c00b590 comp rx=0 tx=0).stop 2024-09-19T05:16:53.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.346+0000 7f4392334640 1 -- 172.21.15.120:0/1072915975 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f438c1082a0 msgr2=0x7f438c19ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:53.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.346+0000 7f4392334640 1 --2- 172.21.15.120:0/1072915975 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f438c1082a0 0x7f438c19ce00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f438400b970 tx=0x7f438400be30 comp rx=0 tx=0).stop 2024-09-19T05:16:53.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.346+0000 7f4392334640 1 -- 172.21.15.120:0/1072915975 shutdown_connections 2024-09-19T05:16:53.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.346+0000 7f4392334640 1 --2- 172.21.15.120:0/1072915975 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f438c1082a0 0x7f438c19ce00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:53.348 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.346+0000 7f4392334640 1 --2- 172.21.15.120:0/1072915975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f438c1036e0 0x7f438c198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:53.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.346+0000 7f4392334640 1 --2- 172.21.15.120:0/1072915975 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f43740a3240 0x7f43740a5700 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:53.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.346+0000 7f4392334640 1 --2- 172.21.15.120:0/1072915975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f438c102d30 0x7f438c198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:53.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.346+0000 7f4392334640 1 -- 172.21.15.120:0/1072915975 >> 172.21.15.120:0/1072915975 conn(0x7f438c0fc7d0 msgr2=0x7f438c105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:53.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.346+0000 7f4392334640 1 -- 172.21.15.120:0/1072915975 shutdown_connections 2024-09-19T05:16:53.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:53.346+0000 7f4392334640 1 -- 172.21.15.120:0/1072915975 wait complete. 2024-09-19T05:16:53.442 INFO:journalctl@ceph.mds.k.smithi178.stdout:Sep 19 05:16:53 smithi178 ceph-mds[63369]: -- 172.21.15.178:0/3328623979 <== mon.2 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e323a9b860 con 0x55e323a78800 2024-09-19T05:16:53.442 INFO:journalctl@ceph.mds.k.smithi178.stdout:Sep 19 05:16:53 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-k[63365]: starting mds.k at 2024-09-19T05:16:53.442 INFO:journalctl@ceph.mds.k.smithi178.stdout:Sep 19 05:16:53 smithi178 bash[63350]: dd4e17833d8b595208c09a51249cc1dea7f069f1313ec54878d2ba94f851ff73 2024-09-19T05:16:53.442 INFO:journalctl@ceph.mds.k.smithi178.stdout:Sep 19 05:16:53 smithi178 systemd[1]: Started Ceph mds.k for 4e6e3df4-7645-11ef-bceb-c7b262605968. 2024-09-19T05:16:54.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:54 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:54.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:54 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:54.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:54 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:54.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:54 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:16:54.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:54 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:16:54.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:54 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:54.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:54 smithi178 ceph-mon[34347]: Deploying daemon mds.j on smithi120 2024-09-19T05:16:54.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:54 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1072915975' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:16:54.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:54 smithi178 ceph-mon[34347]: mds.? [v2:172.21.15.178:6832/61682954,v1:172.21.15.178:6833/61682954] up:boot 2024-09-19T05:16:54.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:54 smithi178 ceph-mon[34347]: fsmap 2 up:standby 2024-09-19T05:16:54.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:54 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T05:16:54.506 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:54 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:54.506 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:54 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:54.506 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:54 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:54.507 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:54 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:16:54.507 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:54 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:16:54.507 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:54 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:54.507 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:54 smithi120 ceph-mon[30956]: Deploying daemon mds.j on smithi120 2024-09-19T05:16:54.507 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:54 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1072915975' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:16:54.507 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:54 smithi120 ceph-mon[30956]: mds.? [v2:172.21.15.178:6832/61682954,v1:172.21.15.178:6833/61682954] up:boot 2024-09-19T05:16:54.507 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:54 smithi120 ceph-mon[30956]: fsmap 2 up:standby 2024-09-19T05:16:54.507 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:54 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T05:16:54.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:54 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:54.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:54 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:54.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:54 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:54.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:54 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:16:54.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:54 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:16:54.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:54 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:54.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:54 smithi194 ceph-mon[35228]: Deploying daemon mds.j on smithi120 2024-09-19T05:16:54.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:54 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1072915975' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:16:54.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:54 smithi194 ceph-mon[35228]: mds.? [v2:172.21.15.178:6832/61682954,v1:172.21.15.178:6833/61682954] up:boot 2024-09-19T05:16:54.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:54 smithi194 ceph-mon[35228]: fsmap 2 up:standby 2024-09-19T05:16:54.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:54 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T05:16:55.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:55 smithi178 ceph-mon[34347]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:16:55.538 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:55 smithi120 ceph-mon[30956]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:16:55.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:55 smithi194 ceph-mon[35228]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:16:55.875 INFO:journalctl@ceph.mds.j.smithi120.stdout:Sep 19 05:16:55 smithi120 systemd[1]: Starting Ceph mds.j for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:16:56.097 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:16:56.182 INFO:journalctl@ceph.mds.j.smithi120.stdout:Sep 19 05:16:55 smithi120 podman[70109]: 2024-09-19 05:16:55.824001152 +0000 UTC m=+0.015936544 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:16:56.182 INFO:journalctl@ceph.mds.j.smithi120.stdout:Sep 19 05:16:55 smithi120 podman[70109]: 2024-09-19 05:16:55.970895428 +0000 UTC m=+0.162830875 container create 47518e55f38851355a3ae45710225a2e0200d2f804ee57e75c987e1032551170 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-j, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:16:56.183 INFO:journalctl@ceph.mds.j.smithi120.stdout:Sep 19 05:16:56 smithi120 podman[70109]: 2024-09-19 05:16:56.181635552 +0000 UTC m=+0.373570951 container init 47518e55f38851355a3ae45710225a2e0200d2f804ee57e75c987e1032551170 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T05:16:56.356 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:16:56.478 INFO:journalctl@ceph.mds.j.smithi120.stdout:Sep 19 05:16:56 smithi120 podman[70109]: 2024-09-19 05:16:56.185580611 +0000 UTC m=+0.377516017 container start 47518e55f38851355a3ae45710225a2e0200d2f804ee57e75c987e1032551170 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-j, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T05:16:56.478 INFO:journalctl@ceph.mds.j.smithi120.stdout:Sep 19 05:16:56 smithi120 ceph-mds[70147]: -- 172.21.15.120:0/1582128560 <== mon.0 v2:172.21.15.120:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5650a6913860 con 0x5650a68f1000 2024-09-19T05:16:56.478 INFO:journalctl@ceph.mds.j.smithi120.stdout:Sep 19 05:16:56 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-j[70125]: starting mds.j at 2024-09-19T05:16:56.478 INFO:journalctl@ceph.mds.j.smithi120.stdout:Sep 19 05:16:56 smithi120 bash[70109]: 47518e55f38851355a3ae45710225a2e0200d2f804ee57e75c987e1032551170 2024-09-19T05:16:56.478 INFO:journalctl@ceph.mds.j.smithi120.stdout:Sep 19 05:16:56 smithi120 systemd[1]: Started Ceph mds.j for 4e6e3df4-7645-11ef-bceb-c7b262605968. 2024-09-19T05:16:56.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.772+0000 7f171c126640 1 -- 172.21.15.120:0/3580934137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1714100e20 msgr2=0x7f1714101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:56.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.772+0000 7f171c126640 1 --2- 172.21.15.120:0/3580934137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1714100e20 0x7f1714101200 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1710009900 tx=0x7f171002a480 comp rx=0 tx=0).stop 2024-09-19T05:16:56.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.772+0000 7f171c126640 1 -- 172.21.15.120:0/3580934137 shutdown_connections 2024-09-19T05:16:56.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.772+0000 7f171c126640 1 --2- 172.21.15.120:0/3580934137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1714102ef0 0x7f171410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:56.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.772+0000 7f171c126640 1 --2- 172.21.15.120:0/3580934137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1714102570 0x7f17141029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:56.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.772+0000 7f171c126640 1 --2- 172.21.15.120:0/3580934137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1714100e20 0x7f1714101200 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:56.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.772+0000 7f171c126640 1 -- 172.21.15.120:0/3580934137 >> 172.21.15.120:0/3580934137 conn(0x7f17140fc7d0 msgr2=0x7f17140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:56.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.772+0000 7f171c126640 1 -- 172.21.15.120:0/3580934137 shutdown_connections 2024-09-19T05:16:56.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.772+0000 7f171c126640 1 -- 172.21.15.120:0/3580934137 wait complete. 2024-09-19T05:16:56.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.773+0000 7f171c126640 1 Processor -- start 2024-09-19T05:16:56.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.773+0000 7f171c126640 1 -- start start 2024-09-19T05:16:56.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.773+0000 7f171c126640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1714100e20 0x7f17141972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:56.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.773+0000 7f171c126640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1714102570 0x7f1714197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:56.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.773+0000 7f171c126640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1714102ef0 0x7f171419bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:56.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.773+0000 7f171c126640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1714110e30 con 0x7f1714102570 2024-09-19T05:16:56.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.773+0000 7f171c126640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1714110cb0 con 0x7f1714100e20 2024-09-19T05:16:56.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.773+0000 7f171c126640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1714110fb0 con 0x7f1714102ef0 2024-09-19T05:16:56.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.773+0000 7f17196c1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1714102570 0x7f1714197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:56.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.773+0000 7f17196c1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1714102570 0x7f1714197830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58512/0 (socket says 172.21.15.120:58512) 2024-09-19T05:16:56.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.773+0000 7f17196c1640 1 -- 172.21.15.120:0/2992199256 learned_addr learned my addr 172.21.15.120:0/2992199256 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:16:56.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.773+0000 7f1719ec2640 1 --2- 172.21.15.120:0/2992199256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1714100e20 0x7f17141972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:56.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.773+0000 7f171a6c3640 1 --2- 172.21.15.120:0/2992199256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1714102ef0 0x7f171419bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:56.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.773+0000 7f17196c1640 1 -- 172.21.15.120:0/2992199256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1714102ef0 msgr2=0x7f171419bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:56.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.773+0000 7f17196c1640 1 --2- 172.21.15.120:0/2992199256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1714102ef0 0x7f171419bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:56.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.773+0000 7f17196c1640 1 -- 172.21.15.120:0/2992199256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1714100e20 msgr2=0x7f17141972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:56.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.773+0000 7f17196c1640 1 --2- 172.21.15.120:0/2992199256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1714100e20 0x7f17141972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:56.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.773+0000 7f17196c1640 1 -- 172.21.15.120:0/2992199256 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f171419c2a0 con 0x7f1714102570 2024-09-19T05:16:56.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.773+0000 7f17196c1640 1 --2- 172.21.15.120:0/2992199256 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1714102570 0x7f1714197830 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f170400d950 tx=0x7f170400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:56.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.774+0000 7f170affd640 1 -- 172.21.15.120:0/2992199256 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1704017070 con 0x7f1714102570 2024-09-19T05:16:56.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.774+0000 7f170affd640 1 -- 172.21.15.120:0/2992199256 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1704009c30 con 0x7f1714102570 2024-09-19T05:16:56.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.774+0000 7f171c126640 1 -- 172.21.15.120:0/2992199256 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f171419c590 con 0x7f1714102570 2024-09-19T05:16:56.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.774+0000 7f170affd640 1 -- 172.21.15.120:0/2992199256 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170400f620 con 0x7f1714102570 2024-09-19T05:16:56.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.774+0000 7f171c126640 1 -- 172.21.15.120:0/2992199256 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17141a3e70 con 0x7f1714102570 2024-09-19T05:16:56.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.775+0000 7f171c126640 1 -- 172.21.15.120:0/2992199256 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1714101200 con 0x7f1714102570 2024-09-19T05:16:56.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.776+0000 7f170affd640 1 -- 172.21.15.120:0/2992199256 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f17040109a0 con 0x7f1714102570 2024-09-19T05:16:56.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.776+0000 7f170affd640 1 --2- 172.21.15.120:0/2992199256 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f17000a3240 0x7f17000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:16:56.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.777+0000 7f1719ec2640 1 --2- 172.21.15.120:0/2992199256 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f17000a3240 0x7f17000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:16:56.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.777+0000 7f170affd640 1 -- 172.21.15.120:0/2992199256 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f17040cf0c0 con 0x7f1714102570 2024-09-19T05:16:56.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.777+0000 7f1719ec2640 1 --2- 172.21.15.120:0/2992199256 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f17000a3240 0x7f17000a5700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1710009230 tx=0x7f17100058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:16:56.782 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.781+0000 7f170affd640 1 -- 172.21.15.120:0/2992199256 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1704009de0 con 0x7f1714102570 2024-09-19T05:16:56.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.992+0000 7f171c126640 1 -- 172.21.15.120:0/2992199256 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1714109090 con 0x7f1714102570 2024-09-19T05:16:56.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.992+0000 7f170affd640 1 -- 172.21.15.120:0/2992199256 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2260 (secure 0 0 0) 0x7f170409c280 con 0x7f1714102570 2024-09-19T05:16:56.994 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:16:56.994 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":3,"btime":"2024-09-19T05:16:53:813221+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/61682954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":61682954},{"type":"v1","addr":"172.21.15.178:6833","nonce":61682954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1778722040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1778722040},{"type":"v1","addr":"172.21.15.194:6833","nonce":1778722040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T05:16:56.995 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 3 2024-09-19T05:16:56.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.994+0000 7f171c126640 1 -- 172.21.15.120:0/2992199256 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f17000a3240 msgr2=0x7f17000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:56.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.994+0000 7f171c126640 1 --2- 172.21.15.120:0/2992199256 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f17000a3240 0x7f17000a5700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1710009230 tx=0x7f17100058d0 comp rx=0 tx=0).stop 2024-09-19T05:16:56.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.994+0000 7f171c126640 1 -- 172.21.15.120:0/2992199256 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1714102570 msgr2=0x7f1714197830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:16:56.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.994+0000 7f171c126640 1 --2- 172.21.15.120:0/2992199256 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1714102570 0x7f1714197830 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f170400d950 tx=0x7f170400de10 comp rx=0 tx=0).stop 2024-09-19T05:16:56.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.994+0000 7f171c126640 1 -- 172.21.15.120:0/2992199256 shutdown_connections 2024-09-19T05:16:56.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.994+0000 7f171c126640 1 --2- 172.21.15.120:0/2992199256 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f17000a3240 0x7f17000a5700 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:56.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.994+0000 7f171c126640 1 --2- 172.21.15.120:0/2992199256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1714102ef0 0x7f171419bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:56.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.994+0000 7f171c126640 1 --2- 172.21.15.120:0/2992199256 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1714102570 0x7f1714197830 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:56.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.994+0000 7f171c126640 1 --2- 172.21.15.120:0/2992199256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1714100e20 0x7f17141972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:16:56.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.994+0000 7f171c126640 1 -- 172.21.15.120:0/2992199256 >> 172.21.15.120:0/2992199256 conn(0x7f17140fc7d0 msgr2=0x7f17140fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:16:56.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.995+0000 7f171c126640 1 -- 172.21.15.120:0/2992199256 shutdown_connections 2024-09-19T05:16:56.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:16:56.995+0000 7f171c126640 1 -- 172.21.15.120:0/2992199256 wait complete. 2024-09-19T05:16:57.286 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:57 smithi120 ceph-mon[30956]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:16:57.286 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:57 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:57.286 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:57 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:57.286 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:57 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:57.286 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:57 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:16:57.286 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:57 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:16:57.286 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:57 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:57.286 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:57 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2992199256' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:16:57.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:57 smithi178 ceph-mon[34347]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:16:57.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:57 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:57.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:57 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:57.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:57 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:57.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:57 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:16:57.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:57 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:16:57.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:57 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:57.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:57 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/2992199256' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:16:57.478 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:57 smithi194 ceph-mon[35228]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:16:57.478 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:57 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:57.478 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:57 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:57.478 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:57 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:16:57.478 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:57 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:16:57.479 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:57 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:16:57.479 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:57 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:16:57.479 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:57 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/2992199256' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:16:58.268 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:58 smithi120 ceph-mon[30956]: Deploying daemon mds.d on smithi120 2024-09-19T05:16:58.268 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:58 smithi120 ceph-mon[30956]: mds.? [v2:172.21.15.120:6834/93472898,v1:172.21.15.120:6835/93472898] up:boot 2024-09-19T05:16:58.268 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:58 smithi120 ceph-mon[30956]: fsmap 3 up:standby 2024-09-19T05:16:58.268 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:58 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T05:16:58.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:58 smithi194 ceph-mon[35228]: Deploying daemon mds.d on smithi120 2024-09-19T05:16:58.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:58 smithi194 ceph-mon[35228]: mds.? [v2:172.21.15.120:6834/93472898,v1:172.21.15.120:6835/93472898] up:boot 2024-09-19T05:16:58.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:58 smithi194 ceph-mon[35228]: fsmap 3 up:standby 2024-09-19T05:16:58.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:58 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T05:16:58.691 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:58 smithi178 ceph-mon[34347]: Deploying daemon mds.d on smithi120 2024-09-19T05:16:58.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:58 smithi178 ceph-mon[34347]: mds.? [v2:172.21.15.120:6834/93472898,v1:172.21.15.120:6835/93472898] up:boot 2024-09-19T05:16:58.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:58 smithi178 ceph-mon[34347]: fsmap 3 up:standby 2024-09-19T05:16:58.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:58 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T05:16:59.196 INFO:journalctl@ceph.mds.d.smithi120.stdout:Sep 19 05:16:59 smithi120 systemd[1]: Starting Ceph mds.d for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:16:59.491 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:16:59 smithi120 ceph-mon[30956]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:16:59.492 INFO:journalctl@ceph.mds.d.smithi120.stdout:Sep 19 05:16:59 smithi120 podman[70535]: 2024-09-19 05:16:59.263488411 +0000 UTC m=+0.015642425 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:16:59.492 INFO:journalctl@ceph.mds.d.smithi120.stdout:Sep 19 05:16:59 smithi120 podman[70535]: 2024-09-19 05:16:59.389571492 +0000 UTC m=+0.141725493 container create d255bfc1aa022d3e1587702646cecab972d9ae742c2cf47dc89f6eeb93cb822b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-d, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T05:16:59.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:16:59 smithi194 ceph-mon[35228]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:16:59.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:16:59 smithi178 ceph-mon[34347]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:16:59.770 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:16:59.875 INFO:journalctl@ceph.mds.d.smithi120.stdout:Sep 19 05:16:59 smithi120 podman[70535]: 2024-09-19 05:16:59.583769473 +0000 UTC m=+0.335923482 container init d255bfc1aa022d3e1587702646cecab972d9ae742c2cf47dc89f6eeb93cb822b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-d, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:16:59.876 INFO:journalctl@ceph.mds.d.smithi120.stdout:Sep 19 05:16:59 smithi120 podman[70535]: 2024-09-19 05:16:59.586651258 +0000 UTC m=+0.338805260 container start d255bfc1aa022d3e1587702646cecab972d9ae742c2cf47dc89f6eeb93cb822b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-d, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-19T05:16:59.876 INFO:journalctl@ceph.mds.d.smithi120.stdout:Sep 19 05:16:59 smithi120 ceph-mds[70554]: -- 172.21.15.120:0/866240631 <== mon.0 v2:172.21.15.120:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560bb6add860 con 0x560bb6abb000 2024-09-19T05:16:59.876 INFO:journalctl@ceph.mds.d.smithi120.stdout:Sep 19 05:16:59 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-d[70550]: starting mds.d at 2024-09-19T05:16:59.876 INFO:journalctl@ceph.mds.d.smithi120.stdout:Sep 19 05:16:59 smithi120 bash[70535]: d255bfc1aa022d3e1587702646cecab972d9ae742c2cf47dc89f6eeb93cb822b 2024-09-19T05:16:59.876 INFO:journalctl@ceph.mds.d.smithi120.stdout:Sep 19 05:16:59 smithi120 systemd[1]: Started Ceph mds.d for 4e6e3df4-7645-11ef-bceb-c7b262605968. 2024-09-19T05:17:00.020 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:00.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.491+0000 7fb13fca5640 1 -- 172.21.15.120:0/2151586519 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb138102da0 msgr2=0x7fb138103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:00.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.491+0000 7fb13fca5640 1 --2- 172.21.15.120:0/2151586519 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb138102da0 0x7fb138103180 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb134009900 tx=0x7fb13402a480 comp rx=0 tx=0).stop 2024-09-19T05:17:00.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.492+0000 7fb13fca5640 1 -- 172.21.15.120:0/2151586519 shutdown_connections 2024-09-19T05:17:00.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.492+0000 7fb13fca5640 1 --2- 172.21.15.120:0/2151586519 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb13810c180 0x7fb13810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:00.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.492+0000 7fb13fca5640 1 --2- 172.21.15.120:0/2151586519 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1381036c0 0x7fb13810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:00.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.492+0000 7fb13fca5640 1 --2- 172.21.15.120:0/2151586519 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb138102da0 0x7fb138103180 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:00.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.492+0000 7fb13fca5640 1 -- 172.21.15.120:0/2151586519 >> 172.21.15.120:0/2151586519 conn(0x7fb1380fc7a0 msgr2=0x7fb1380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:00.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.492+0000 7fb13fca5640 1 -- 172.21.15.120:0/2151586519 shutdown_connections 2024-09-19T05:17:00.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.492+0000 7fb13fca5640 1 -- 172.21.15.120:0/2151586519 wait complete. 2024-09-19T05:17:00.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.492+0000 7fb13fca5640 1 Processor -- start 2024-09-19T05:17:00.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.492+0000 7fb13fca5640 1 -- start start 2024-09-19T05:17:00.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.492+0000 7fb13fca5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb138102da0 0x7fb138100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:00.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.492+0000 7fb13fca5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1381036c0 0x7fb138100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:00.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.492+0000 7fb13fca5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb13810c180 0x7fb138101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:00.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.492+0000 7fb13fca5640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb138111e60 con 0x7fb1381036c0 2024-09-19T05:17:00.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.492+0000 7fb13fca5640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb138111ce0 con 0x7fb138102da0 2024-09-19T05:17:00.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.492+0000 7fb13fca5640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb138111fe0 con 0x7fb13810c180 2024-09-19T05:17:00.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.493+0000 7fb13d240640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1381036c0 0x7fb138100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:00.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.493+0000 7fb13da41640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb138102da0 0x7fb138100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:00.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.493+0000 7fb13d240640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1381036c0 0x7fb138100f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58544/0 (socket says 172.21.15.120:58544) 2024-09-19T05:17:00.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.493+0000 7fb13da41640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb138102da0 0x7fb138100a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:53358/0 (socket says 172.21.15.120:53358) 2024-09-19T05:17:00.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.493+0000 7fb13d240640 1 -- 172.21.15.120:0/3024246118 learned_addr learned my addr 172.21.15.120:0/3024246118 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:00.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.493+0000 7fb13e242640 1 --2- 172.21.15.120:0/3024246118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb13810c180 0x7fb138101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:00.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.493+0000 7fb13d240640 1 -- 172.21.15.120:0/3024246118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb13810c180 msgr2=0x7fb138101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:00.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.493+0000 7fb13d240640 1 --2- 172.21.15.120:0/3024246118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb13810c180 0x7fb138101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:00.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.493+0000 7fb13d240640 1 -- 172.21.15.120:0/3024246118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb138102da0 msgr2=0x7fb138100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:00.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.493+0000 7fb13d240640 1 --2- 172.21.15.120:0/3024246118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb138102da0 0x7fb138100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:00.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.493+0000 7fb13d240640 1 -- 172.21.15.120:0/3024246118 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1381a6860 con 0x7fb1381036c0 2024-09-19T05:17:00.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.493+0000 7fb13e242640 1 --2- 172.21.15.120:0/3024246118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb13810c180 0x7fb138101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:17:00.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.493+0000 7fb13d240640 1 --2- 172.21.15.120:0/3024246118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1381036c0 0x7fb138100f40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb12800d770 tx=0x7fb12800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:00.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.493+0000 7fb12effd640 1 -- 172.21.15.120:0/3024246118 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb128017070 con 0x7fb1381036c0 2024-09-19T05:17:00.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.493+0000 7fb12effd640 1 -- 172.21.15.120:0/3024246118 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb1280054d0 con 0x7fb1381036c0 2024-09-19T05:17:00.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.493+0000 7fb13fca5640 1 -- 172.21.15.120:0/3024246118 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1381a6b50 con 0x7fb1381036c0 2024-09-19T05:17:00.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.493+0000 7fb12effd640 1 -- 172.21.15.120:0/3024246118 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb128004cf0 con 0x7fb1381036c0 2024-09-19T05:17:00.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.493+0000 7fb13fca5640 1 -- 172.21.15.120:0/3024246118 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1381a7090 con 0x7fb1381036c0 2024-09-19T05:17:00.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.494+0000 7fb13fca5640 1 -- 172.21.15.120:0/3024246118 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb138103180 con 0x7fb1381036c0 2024-09-19T05:17:00.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.495+0000 7fb12effd640 1 -- 172.21.15.120:0/3024246118 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fb128004e90 con 0x7fb1381036c0 2024-09-19T05:17:00.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.496+0000 7fb12effd640 1 --2- 172.21.15.120:0/3024246118 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fb1240a32c0 0x7fb1240a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:00.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.496+0000 7fb13da41640 1 --2- 172.21.15.120:0/3024246118 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fb1240a32c0 0x7fb1240a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:00.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.496+0000 7fb12effd640 1 -- 172.21.15.120:0/3024246118 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fb1280cee60 con 0x7fb1381036c0 2024-09-19T05:17:00.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.496+0000 7fb13da41640 1 --2- 172.21.15.120:0/3024246118 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fb1240a32c0 0x7fb1240a5780 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb134005ab0 tx=0x7fb134005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:00.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.500+0000 7fb12effd640 1 -- 172.21.15.120:0/3024246118 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb12809c020 con 0x7fb1381036c0 2024-09-19T05:17:00.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.701+0000 7fb13fca5640 1 -- 172.21.15.120:0/3024246118 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb138106c90 con 0x7fb1381036c0 2024-09-19T05:17:00.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.701+0000 7fb12effd640 1 -- 172.21.15.120:0/3024246118 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3910 (secure 0 0 0) 0x7fb12809b920 con 0x7fb1381036c0 2024-09-19T05:17:00.703 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:17:00.704 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":5,"btime":"2024-09-19T05:17:00:195390+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/93472898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":93472898},{"type":"v1","addr":"172.21.15.120:6835","nonce":93472898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1976835398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1976835398},{"type":"v1","addr":"172.21.15.120:6837","nonce":1976835398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/61682954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":61682954},{"type":"v1","addr":"172.21.15.178:6833","nonce":61682954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1778722040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1778722040},{"type":"v1","addr":"172.21.15.194:6833","nonce":1778722040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T05:17:00.704 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 5 2024-09-19T05:17:00.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.704+0000 7fb13fca5640 1 -- 172.21.15.120:0/3024246118 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fb1240a32c0 msgr2=0x7fb1240a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:00.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.704+0000 7fb13fca5640 1 --2- 172.21.15.120:0/3024246118 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fb1240a32c0 0x7fb1240a5780 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb134005ab0 tx=0x7fb134005a20 comp rx=0 tx=0).stop 2024-09-19T05:17:00.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.704+0000 7fb13fca5640 1 -- 172.21.15.120:0/3024246118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1381036c0 msgr2=0x7fb138100f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:00.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.704+0000 7fb13fca5640 1 --2- 172.21.15.120:0/3024246118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1381036c0 0x7fb138100f40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb12800d770 tx=0x7fb12800dc30 comp rx=0 tx=0).stop 2024-09-19T05:17:00.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.704+0000 7fb13fca5640 1 -- 172.21.15.120:0/3024246118 shutdown_connections 2024-09-19T05:17:00.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.704+0000 7fb13fca5640 1 --2- 172.21.15.120:0/3024246118 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fb1240a32c0 0x7fb1240a5780 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:00.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.704+0000 7fb13fca5640 1 --2- 172.21.15.120:0/3024246118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb13810c180 0x7fb138101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:00.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.704+0000 7fb13fca5640 1 --2- 172.21.15.120:0/3024246118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1381036c0 0x7fb138100f40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:00.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.704+0000 7fb13fca5640 1 --2- 172.21.15.120:0/3024246118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb138102da0 0x7fb138100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:00.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.704+0000 7fb13fca5640 1 -- 172.21.15.120:0/3024246118 >> 172.21.15.120:0/3024246118 conn(0x7fb1380fc7a0 msgr2=0x7fb1380fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:00.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.704+0000 7fb13fca5640 1 -- 172.21.15.120:0/3024246118 shutdown_connections 2024-09-19T05:17:00.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:00.704+0000 7fb13fca5640 1 -- 172.21.15.120:0/3024246118 wait complete. 2024-09-19T05:17:00.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:00 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:00.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:00 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:00.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:00 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:00.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:00 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:17:00.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:00 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:17:00.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:00 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:00.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:00 smithi178 ceph-mon[34347]: Deploying daemon mds.e on smithi178 2024-09-19T05:17:00.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:00 smithi178 ceph-mon[34347]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:00.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:00 smithi178 ceph-mon[34347]: mds.? [v2:172.21.15.120:6836/1976835398,v1:172.21.15.120:6837/1976835398] up:boot 2024-09-19T05:17:00.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:00 smithi178 ceph-mon[34347]: fsmap 4 up:standby 2024-09-19T05:17:00.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:00 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T05:17:00.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:00 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/3024246118' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:17:01.034 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:00 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:01.034 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:00 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:01.034 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:00 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:01.034 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:00 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:17:01.034 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:00 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:17:01.034 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:00 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:01.034 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:00 smithi120 ceph-mon[30956]: Deploying daemon mds.e on smithi178 2024-09-19T05:17:01.034 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:00 smithi120 ceph-mon[30956]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:01.035 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:00 smithi120 ceph-mon[30956]: mds.? [v2:172.21.15.120:6836/1976835398,v1:172.21.15.120:6837/1976835398] up:boot 2024-09-19T05:17:01.035 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:00 smithi120 ceph-mon[30956]: fsmap 4 up:standby 2024-09-19T05:17:01.035 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:00 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T05:17:01.035 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:00 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/3024246118' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:17:01.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:00 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:01.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:00 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:01.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:00 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:01.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:00 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:17:01.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:00 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:17:01.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:00 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:01.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:00 smithi194 ceph-mon[35228]: Deploying daemon mds.e on smithi178 2024-09-19T05:17:01.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:00 smithi194 ceph-mon[35228]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:01.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:00 smithi194 ceph-mon[35228]: mds.? [v2:172.21.15.120:6836/1976835398,v1:172.21.15.120:6837/1976835398] up:boot 2024-09-19T05:17:01.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:00 smithi194 ceph-mon[35228]: fsmap 4 up:standby 2024-09-19T05:17:01.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:00 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T05:17:01.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:00 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/3024246118' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:17:01.692 INFO:journalctl@ceph.mds.e.smithi178.stdout:Sep 19 05:17:01 smithi178 systemd[1]: Starting Ceph mds.e for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:17:02.095 INFO:journalctl@ceph.mds.e.smithi178.stdout:Sep 19 05:17:01 smithi178 podman[63666]: 2024-09-19 05:17:01.723738891 +0000 UTC m=+0.016117678 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:17:02.095 INFO:journalctl@ceph.mds.e.smithi178.stdout:Sep 19 05:17:01 smithi178 podman[63666]: 2024-09-19 05:17:01.848427981 +0000 UTC m=+0.140806801 container create 55528f7ef26f7c08f6bf883f69bfe89c428f3f7e42d178eedb47abd6eb1cec59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-e, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T05:17:02.095 INFO:journalctl@ceph.mds.e.smithi178.stdout:Sep 19 05:17:02 smithi178 podman[63666]: 2024-09-19 05:17:02.067435241 +0000 UTC m=+0.359814021 container init 55528f7ef26f7c08f6bf883f69bfe89c428f3f7e42d178eedb47abd6eb1cec59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-e, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True) 2024-09-19T05:17:02.096 INFO:journalctl@ceph.mds.e.smithi178.stdout:Sep 19 05:17:02 smithi178 podman[63666]: 2024-09-19 05:17:02.070248068 +0000 UTC m=+0.362626845 container start 55528f7ef26f7c08f6bf883f69bfe89c428f3f7e42d178eedb47abd6eb1cec59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-e, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T05:17:02.096 INFO:journalctl@ceph.mds.e.smithi178.stdout:Sep 19 05:17:02 smithi178 ceph-mds[63685]: -- 172.21.15.178:0/204402744 <== mon.2 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56527948f860 con 0x56527946d000 2024-09-19T05:17:02.442 INFO:journalctl@ceph.mds.e.smithi178.stdout:Sep 19 05:17:02 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-e[63681]: starting mds.e at 2024-09-19T05:17:02.442 INFO:journalctl@ceph.mds.e.smithi178.stdout:Sep 19 05:17:02 smithi178 bash[63666]: 55528f7ef26f7c08f6bf883f69bfe89c428f3f7e42d178eedb47abd6eb1cec59 2024-09-19T05:17:02.442 INFO:journalctl@ceph.mds.e.smithi178.stdout:Sep 19 05:17:02 smithi178 systemd[1]: Started Ceph mds.e for 4e6e3df4-7645-11ef-bceb-c7b262605968. 2024-09-19T05:17:03.333 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:03 smithi194 ceph-mon[35228]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:03.333 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:03 smithi194 ceph-mon[35228]: mds.? [v2:172.21.15.178:6834/890775592,v1:172.21.15.178:6835/890775592] up:boot 2024-09-19T05:17:03.333 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:03 smithi194 ceph-mon[35228]: fsmap 5 up:standby 2024-09-19T05:17:03.333 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T05:17:03.333 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:03.334 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:03.334 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:03.334 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:17:03.334 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:17:03.334 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:03 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:03.334 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:03 smithi194 ceph-mon[35228]: Deploying daemon mds.f on smithi194 2024-09-19T05:17:03.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:03 smithi178 ceph-mon[34347]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:03.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:03 smithi178 ceph-mon[34347]: mds.? [v2:172.21.15.178:6834/890775592,v1:172.21.15.178:6835/890775592] up:boot 2024-09-19T05:17:03.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:03 smithi178 ceph-mon[34347]: fsmap 5 up:standby 2024-09-19T05:17:03.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T05:17:03.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:03.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:03.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:03.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:17:03.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:17:03.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:03 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:03.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:03 smithi178 ceph-mon[34347]: Deploying daemon mds.f on smithi194 2024-09-19T05:17:03.458 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:17:03.487 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:03 smithi120 ceph-mon[30956]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:03.487 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:03 smithi120 ceph-mon[30956]: mds.? [v2:172.21.15.178:6834/890775592,v1:172.21.15.178:6835/890775592] up:boot 2024-09-19T05:17:03.487 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:03 smithi120 ceph-mon[30956]: fsmap 5 up:standby 2024-09-19T05:17:03.487 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T05:17:03.487 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:03.487 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:03.487 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:03.487 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:17:03.487 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:17:03.487 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:03 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:03.488 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:03 smithi120 ceph-mon[30956]: Deploying daemon mds.f on smithi194 2024-09-19T05:17:03.719 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:04.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.281+0000 7f39766ac640 1 -- 172.21.15.120:0/2001781395 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3970102570 msgr2=0x7f39701029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:04.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.281+0000 7f39766ac640 1 --2- 172.21.15.120:0/2001781395 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3970102570 0x7f39701029b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3958009900 tx=0x7f395802a480 comp rx=0 tx=0).stop 2024-09-19T05:17:04.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.282+0000 7f39766ac640 1 -- 172.21.15.120:0/2001781395 shutdown_connections 2024-09-19T05:17:04.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.282+0000 7f39766ac640 1 --2- 172.21.15.120:0/2001781395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3970102ef0 0x7f397010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:04.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.282+0000 7f39766ac640 1 --2- 172.21.15.120:0/2001781395 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3970102570 0x7f39701029b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:04.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.282+0000 7f39766ac640 1 --2- 172.21.15.120:0/2001781395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3970100e20 0x7f3970101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:04.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.282+0000 7f39766ac640 1 -- 172.21.15.120:0/2001781395 >> 172.21.15.120:0/2001781395 conn(0x7f39700fc7d0 msgr2=0x7f39700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:04.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.282+0000 7f39766ac640 1 -- 172.21.15.120:0/2001781395 shutdown_connections 2024-09-19T05:17:04.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.282+0000 7f39766ac640 1 -- 172.21.15.120:0/2001781395 wait complete. 2024-09-19T05:17:04.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.282+0000 7f39766ac640 1 Processor -- start 2024-09-19T05:17:04.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.282+0000 7f39766ac640 1 -- start start 2024-09-19T05:17:04.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.282+0000 7f39766ac640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3970100e20 0x7f39700fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:04.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.282+0000 7f39766ac640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3970102570 0x7f39700fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:04.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.282+0000 7f39766ac640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3970102ef0 0x7f39700fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:04.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.282+0000 7f39766ac640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3970110e50 con 0x7f3970102570 2024-09-19T05:17:04.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.282+0000 7f39766ac640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3970110cd0 con 0x7f3970100e20 2024-09-19T05:17:04.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.282+0000 7f39766ac640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3970110fd0 con 0x7f3970102ef0 2024-09-19T05:17:04.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.282+0000 7f3967fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3970102570 0x7f39700fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:04.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.282+0000 7f3967fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3970102570 0x7f39700fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58552/0 (socket says 172.21.15.120:58552) 2024-09-19T05:17:04.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.283+0000 7f3967fff640 1 -- 172.21.15.120:0/3433650786 learned_addr learned my addr 172.21.15.120:0/3433650786 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:04.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.283+0000 7f3974c49640 1 --2- 172.21.15.120:0/3433650786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3970102ef0 0x7f39700fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:04.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.283+0000 7f396ffff640 1 --2- 172.21.15.120:0/3433650786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3970100e20 0x7f39700fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:04.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.283+0000 7f3967fff640 1 -- 172.21.15.120:0/3433650786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3970102ef0 msgr2=0x7f39700fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:04.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.283+0000 7f3967fff640 1 --2- 172.21.15.120:0/3433650786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3970102ef0 0x7f39700fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:04.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.283+0000 7f3967fff640 1 -- 172.21.15.120:0/3433650786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3970100e20 msgr2=0x7f39700fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:04.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.283+0000 7f3967fff640 1 --2- 172.21.15.120:0/3433650786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3970100e20 0x7f39700fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:04.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.283+0000 7f3967fff640 1 -- 172.21.15.120:0/3433650786 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39701a68d0 con 0x7f3970102570 2024-09-19T05:17:04.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.283+0000 7f3967fff640 1 --2- 172.21.15.120:0/3433650786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3970102570 0x7f39700fd1c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3958006010 tx=0x7f39580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:04.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.283+0000 7f396dffb640 1 -- 172.21.15.120:0/3433650786 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395803f070 con 0x7f3970102570 2024-09-19T05:17:04.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.283+0000 7f396dffb640 1 -- 172.21.15.120:0/3433650786 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3958003aa0 con 0x7f3970102570 2024-09-19T05:17:04.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.283+0000 7f39766ac640 1 -- 172.21.15.120:0/3433650786 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39701a6b60 con 0x7f3970102570 2024-09-19T05:17:04.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.283+0000 7f396dffb640 1 -- 172.21.15.120:0/3433650786 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3958035030 con 0x7f3970102570 2024-09-19T05:17:04.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.283+0000 7f39766ac640 1 -- 172.21.15.120:0/3433650786 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39701a7040 con 0x7f3970102570 2024-09-19T05:17:04.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.284+0000 7f39766ac640 1 -- 172.21.15.120:0/3433650786 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3970101200 con 0x7f3970102570 2024-09-19T05:17:04.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.285+0000 7f396dffb640 1 -- 172.21.15.120:0/3433650786 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f3958042070 con 0x7f3970102570 2024-09-19T05:17:04.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.286+0000 7f396dffb640 1 --2- 172.21.15.120:0/3433650786 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f395c0a3240 0x7f395c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:04.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.286+0000 7f396ffff640 1 --2- 172.21.15.120:0/3433650786 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f395c0a3240 0x7f395c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:04.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.286+0000 7f396dffb640 1 -- 172.21.15.120:0/3433650786 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f39580efcd0 con 0x7f3970102570 2024-09-19T05:17:04.291 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.286+0000 7f396ffff640 1 --2- 172.21.15.120:0/3433650786 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f395c0a3240 0x7f395c0a5700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f396000abe0 tx=0x7f396000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:04.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.290+0000 7f396dffb640 1 -- 172.21.15.120:0/3433650786 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f39580bce90 con 0x7f3970102570 2024-09-19T05:17:04.295 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 19 05:17:04 smithi194 systemd[1]: Starting Ceph mds.f for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:17:04.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.489+0000 7f39766ac640 1 -- 172.21.15.120:0/3433650786 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f397010a0a0 con 0x7f3970102570 2024-09-19T05:17:04.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.490+0000 7f396dffb640 1 -- 172.21.15.120:0/3433650786 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4735 (secure 0 0 0) 0x7f39580bc790 con 0x7f3970102570 2024-09-19T05:17:04.492 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:17:04.492 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":6,"btime":"2024-09-19T05:17:02:149095+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/93472898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":93472898},{"type":"v1","addr":"172.21.15.120:6835","nonce":93472898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1976835398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1976835398},{"type":"v1","addr":"172.21.15.120:6837","nonce":1976835398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/61682954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":61682954},{"type":"v1","addr":"172.21.15.178:6833","nonce":61682954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1778722040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1778722040},{"type":"v1","addr":"172.21.15.194:6833","nonce":1778722040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24401,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/890775592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":890775592},{"type":"v1","addr":"172.21.15.178:6835","nonce":890775592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-19T05:17:04.492 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 6 2024-09-19T05:17:04.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.492+0000 7f39766ac640 1 -- 172.21.15.120:0/3433650786 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f395c0a3240 msgr2=0x7f395c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:04.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.492+0000 7f39766ac640 1 --2- 172.21.15.120:0/3433650786 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f395c0a3240 0x7f395c0a5700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f396000abe0 tx=0x7f396000a2d0 comp rx=0 tx=0).stop 2024-09-19T05:17:04.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.492+0000 7f39766ac640 1 -- 172.21.15.120:0/3433650786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3970102570 msgr2=0x7f39700fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:04.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.492+0000 7f39766ac640 1 --2- 172.21.15.120:0/3433650786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3970102570 0x7f39700fd1c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3958006010 tx=0x7f39580042f0 comp rx=0 tx=0).stop 2024-09-19T05:17:04.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.492+0000 7f39766ac640 1 -- 172.21.15.120:0/3433650786 shutdown_connections 2024-09-19T05:17:04.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.492+0000 7f39766ac640 1 --2- 172.21.15.120:0/3433650786 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f395c0a3240 0x7f395c0a5700 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:04.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.492+0000 7f39766ac640 1 --2- 172.21.15.120:0/3433650786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3970102ef0 0x7f39700fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:04.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.492+0000 7f39766ac640 1 --2- 172.21.15.120:0/3433650786 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3970102570 0x7f39700fd1c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:04.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.492+0000 7f39766ac640 1 --2- 172.21.15.120:0/3433650786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3970100e20 0x7f39700fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:04.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.492+0000 7f39766ac640 1 -- 172.21.15.120:0/3433650786 >> 172.21.15.120:0/3433650786 conn(0x7f39700fc7d0 msgr2=0x7f397006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:04.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.492+0000 7f39766ac640 1 -- 172.21.15.120:0/3433650786 shutdown_connections 2024-09-19T05:17:04.495 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:04.492+0000 7f39766ac640 1 -- 172.21.15.120:0/3433650786 wait complete. 2024-09-19T05:17:04.547 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 19 05:17:04 smithi194 podman[65004]: 2024-09-19 05:17:04.293452979 +0000 UTC m=+0.100031014 container create 364681e2b771e5c340072d322ddc6d92aa14d6c91dcebd7f8310d2cc0a8594d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-f, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:17:04.547 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 19 05:17:04 smithi194 podman[65004]: 2024-09-19 05:17:04.209110273 +0000 UTC m=+0.015688321 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:17:04.547 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 19 05:17:04 smithi194 podman[65004]: 2024-09-19 05:17:04.520754365 +0000 UTC m=+0.327332407 container init 364681e2b771e5c340072d322ddc6d92aa14d6c91dcebd7f8310d2cc0a8594d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-f, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T05:17:04.548 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 19 05:17:04 smithi194 podman[65004]: 2024-09-19 05:17:04.523550202 +0000 UTC m=+0.330128238 container start 364681e2b771e5c340072d322ddc6d92aa14d6c91dcebd7f8310d2cc0a8594d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-f, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T05:17:04.905 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 19 05:17:04 smithi194 ceph-mds[65022]: -- 172.21.15.194:0/609280170 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5555fbd71860 con 0x5555fbd4f000 2024-09-19T05:17:04.905 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 19 05:17:04 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-f[65018]: starting mds.f at 2024-09-19T05:17:04.906 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 19 05:17:04 smithi194 bash[65004]: 364681e2b771e5c340072d322ddc6d92aa14d6c91dcebd7f8310d2cc0a8594d9 2024-09-19T05:17:04.906 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 19 05:17:04 smithi194 systemd[1]: Started Ceph mds.f for 4e6e3df4-7645-11ef-bceb-c7b262605968. 2024-09-19T05:17:05.383 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:05 smithi194 ceph-mon[35228]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:05.383 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:05 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/3433650786' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:17:05.383 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:05 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:05.383 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:05 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:05.384 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:05 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:05.384 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:05 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:17:05.384 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:05 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:17:05.384 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:05 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:05.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:05 smithi178 ceph-mon[34347]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:05.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:05 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/3433650786' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:17:05.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:05 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:05.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:05 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:05.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:05 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:05.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:05 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:17:05.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:05 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:17:05.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:05 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:05.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:05 smithi120 ceph-mon[30956]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:05.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:05 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/3433650786' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:17:05.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:05 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:05.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:05 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:05.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:05 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:05.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:05 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:17:05.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:05 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:17:05.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:05 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:06.338 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:06 smithi194 ceph-mon[35228]: Deploying daemon mds.c on smithi194 2024-09-19T05:17:06.338 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:06 smithi194 ceph-mon[35228]: mds.? [v2:172.21.15.194:6834/3268846994,v1:172.21.15.194:6835/3268846994] up:boot 2024-09-19T05:17:06.339 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:06 smithi194 ceph-mon[35228]: fsmap 6 up:standby 2024-09-19T05:17:06.339 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:06 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T05:17:06.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:06 smithi178 ceph-mon[34347]: Deploying daemon mds.c on smithi194 2024-09-19T05:17:06.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:06 smithi178 ceph-mon[34347]: mds.? [v2:172.21.15.194:6834/3268846994,v1:172.21.15.194:6835/3268846994] up:boot 2024-09-19T05:17:06.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:06 smithi178 ceph-mon[34347]: fsmap 6 up:standby 2024-09-19T05:17:06.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:06 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T05:17:06.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:06 smithi120 ceph-mon[30956]: Deploying daemon mds.c on smithi194 2024-09-19T05:17:06.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:06 smithi120 ceph-mon[30956]: mds.? [v2:172.21.15.194:6834/3268846994,v1:172.21.15.194:6835/3268846994] up:boot 2024-09-19T05:17:06.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:06 smithi120 ceph-mon[30956]: fsmap 6 up:standby 2024-09-19T05:17:06.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:06 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T05:17:06.655 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:17:06 smithi194 systemd[1]: Starting Ceph mds.c for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:17:07.000 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:17:06 smithi194 podman[65304]: 2024-09-19 05:17:06.636548744 +0000 UTC m=+0.015749686 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:17:07.000 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:17:06 smithi194 podman[65304]: 2024-09-19 05:17:06.762904795 +0000 UTC m=+0.142105724 container create c2b87ad7e1676f6108b9033a221018bb9a35de8afea30cbe32b63260949978f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T05:17:07.000 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:17:06 smithi194 podman[65304]: 2024-09-19 05:17:06.998644333 +0000 UTC m=+0.377845265 container init c2b87ad7e1676f6108b9033a221018bb9a35de8afea30cbe32b63260949978f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-19T05:17:07.194 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:17:07.405 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:17:07 smithi194 podman[65304]: 2024-09-19 05:17:07.001760238 +0000 UTC m=+0.380961173 container start c2b87ad7e1676f6108b9033a221018bb9a35de8afea30cbe32b63260949978f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T05:17:07.406 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:17:07 smithi194 ceph-mds[65323]: -- 172.21.15.194:0/3769145158 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561d2b32f860 con 0x561d2b30d400 2024-09-19T05:17:07.406 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:17:07 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: starting mds.c at 2024-09-19T05:17:07.406 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:17:07 smithi194 bash[65304]: c2b87ad7e1676f6108b9033a221018bb9a35de8afea30cbe32b63260949978f4 2024-09-19T05:17:07.406 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:17:07 smithi194 systemd[1]: Started Ceph mds.c for 4e6e3df4-7645-11ef-bceb-c7b262605968. 2024-09-19T05:17:07.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:07 smithi194 ceph-mon[35228]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:07.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:07 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:07.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:07 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:07.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:07 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:07.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:07 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:17:07.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:07 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:17:07.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:07 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:07.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:07 smithi178 ceph-mon[34347]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:07.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:07 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:07.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:07 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:07.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:07 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:07.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:07 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:17:07.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:07 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:17:07.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:07 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:07.448 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:07.569 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:07 smithi120 ceph-mon[30956]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:07.570 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:07 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:07.570 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:07 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:07.570 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:07 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:07.570 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:07 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:17:07.570 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:07 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:17:07.570 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:07 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:07.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.947+0000 7f302359e640 1 -- 172.21.15.120:0/501141643 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f301c1008c0 msgr2=0x7f301c100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:07.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.947+0000 7f302359e640 1 --2- 172.21.15.120:0/501141643 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f301c1008c0 0x7f301c100ca0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f300c009900 tx=0x7f300c02a410 comp rx=0 tx=0).stop 2024-09-19T05:17:07.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.947+0000 7f302359e640 1 -- 172.21.15.120:0/501141643 shutdown_connections 2024-09-19T05:17:07.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.947+0000 7f302359e640 1 --2- 172.21.15.120:0/501141643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f301c105ec0 0x7f301c106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:07.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.947+0000 7f302359e640 1 --2- 172.21.15.120:0/501141643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f301c1011e0 0x7f301c105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:07.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.947+0000 7f302359e640 1 --2- 172.21.15.120:0/501141643 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f301c1008c0 0x7f301c100ca0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:07.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.947+0000 7f302359e640 1 -- 172.21.15.120:0/501141643 >> 172.21.15.120:0/501141643 conn(0x7f301c0fc7d0 msgr2=0x7f301c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:07.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.947+0000 7f302359e640 1 -- 172.21.15.120:0/501141643 shutdown_connections 2024-09-19T05:17:07.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.947+0000 7f302359e640 1 -- 172.21.15.120:0/501141643 wait complete. 2024-09-19T05:17:07.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.947+0000 7f302359e640 1 Processor -- start 2024-09-19T05:17:07.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.947+0000 7f302359e640 1 -- start start 2024-09-19T05:17:07.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.948+0000 7f302359e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f301c1008c0 0x7f301c1a4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:07.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.948+0000 7f302359e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f301c1011e0 0x7f301c1a4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:07.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.948+0000 7f302359e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f301c105ec0 0x7f301c19e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:07.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.948+0000 7f302359e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f301c1184e0 con 0x7f301c1008c0 2024-09-19T05:17:07.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.948+0000 7f302359e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f301c118360 con 0x7f301c105ec0 2024-09-19T05:17:07.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.948+0000 7f302359e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f301c118660 con 0x7f301c1011e0 2024-09-19T05:17:07.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.948+0000 7f302133a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f301c1008c0 0x7f301c1a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:07.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.948+0000 7f302133a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f301c1008c0 0x7f301c1a4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33366/0 (socket says 172.21.15.120:33366) 2024-09-19T05:17:07.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.948+0000 7f302133a640 1 -- 172.21.15.120:0/2294178468 learned_addr learned my addr 172.21.15.120:0/2294178468 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:07.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.948+0000 7f3020b39640 1 --2- 172.21.15.120:0/2294178468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f301c1011e0 0x7f301c1a4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:07.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.948+0000 7f3021b3b640 1 --2- 172.21.15.120:0/2294178468 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f301c105ec0 0x7f301c19e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:07.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.948+0000 7f302133a640 1 -- 172.21.15.120:0/2294178468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f301c1011e0 msgr2=0x7f301c1a4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:07.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.948+0000 7f302133a640 1 --2- 172.21.15.120:0/2294178468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f301c1011e0 0x7f301c1a4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:07.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.948+0000 7f302133a640 1 -- 172.21.15.120:0/2294178468 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f301c105ec0 msgr2=0x7f301c19e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:07.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.948+0000 7f302133a640 1 --2- 172.21.15.120:0/2294178468 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f301c105ec0 0x7f301c19e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:07.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.948+0000 7f302133a640 1 -- 172.21.15.120:0/2294178468 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f301c19f060 con 0x7f301c1008c0 2024-09-19T05:17:07.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.948+0000 7f3021b3b640 1 --2- 172.21.15.120:0/2294178468 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f301c105ec0 0x7f301c19e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:17:07.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.948+0000 7f302133a640 1 --2- 172.21.15.120:0/2294178468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f301c1008c0 0x7f301c1a4770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f300c006010 tx=0x7f300c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:07.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.948+0000 7f301a7fc640 1 -- 172.21.15.120:0/2294178468 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c03f030 con 0x7f301c1008c0 2024-09-19T05:17:07.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.948+0000 7f301a7fc640 1 -- 172.21.15.120:0/2294178468 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f300c003aa0 con 0x7f301c1008c0 2024-09-19T05:17:07.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.949+0000 7f301a7fc640 1 -- 172.21.15.120:0/2294178468 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c035070 con 0x7f301c1008c0 2024-09-19T05:17:07.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.949+0000 7f302359e640 1 -- 172.21.15.120:0/2294178468 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f301c19f2f0 con 0x7f301c1008c0 2024-09-19T05:17:07.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.949+0000 7f302359e640 1 -- 172.21.15.120:0/2294178468 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f301c1ab640 con 0x7f301c1008c0 2024-09-19T05:17:07.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.949+0000 7f302359e640 1 -- 172.21.15.120:0/2294178468 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f301c06a850 con 0x7f301c1008c0 2024-09-19T05:17:07.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.951+0000 7f301a7fc640 1 -- 172.21.15.120:0/2294178468 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f300c042030 con 0x7f301c1008c0 2024-09-19T05:17:07.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.951+0000 7f301a7fc640 1 --2- 172.21.15.120:0/2294178468 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f30040a3240 0x7f30040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:07.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.951+0000 7f3020b39640 1 --2- 172.21.15.120:0/2294178468 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f30040a3240 0x7f30040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:07.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.951+0000 7f301a7fc640 1 -- 172.21.15.120:0/2294178468 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f300c0efd10 con 0x7f301c1008c0 2024-09-19T05:17:07.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.952+0000 7f3020b39640 1 --2- 172.21.15.120:0/2294178468 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f30040a3240 0x7f30040a5700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f301c0ffce0 tx=0x7f301000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:07.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:07.955+0000 7f301a7fc640 1 -- 172.21.15.120:0/2294178468 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f300c0bced0 con 0x7f301c1008c0 2024-09-19T05:17:08.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:08.157+0000 7f302359e640 1 -- 172.21.15.120:0/2294178468 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f301c105980 con 0x7f301c1008c0 2024-09-19T05:17:08.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:08.157+0000 7f301a7fc640 1 -- 172.21.15.120:0/2294178468 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6388 (secure 0 0 0) 0x7f301c105980 con 0x7f301c1008c0 2024-09-19T05:17:08.159 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:17:08.159 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":8,"btime":"2024-09-19T05:17:07:167678+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/93472898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":93472898},{"type":"v1","addr":"172.21.15.120:6835","nonce":93472898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1976835398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1976835398},{"type":"v1","addr":"172.21.15.120:6837","nonce":1976835398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/61682954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":61682954},{"type":"v1","addr":"172.21.15.178:6833","nonce":61682954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1778722040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1778722040},{"type":"v1","addr":"172.21.15.194:6833","nonce":1778722040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24401,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/890775592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":890775592},{"type":"v1","addr":"172.21.15.178:6835","nonce":890775592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/3268846994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3268846994},{"type":"v1","addr":"172.21.15.194:6835","nonce":3268846994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/378729335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":378729335},{"type":"v1","addr":"172.21.15.194:6837","nonce":378729335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T05:17:08.160 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 8 2024-09-19T05:17:08.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:08.159+0000 7f302359e640 1 -- 172.21.15.120:0/2294178468 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f30040a3240 msgr2=0x7f30040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:08.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:08.159+0000 7f302359e640 1 --2- 172.21.15.120:0/2294178468 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f30040a3240 0x7f30040a5700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f301c0ffce0 tx=0x7f301000b390 comp rx=0 tx=0).stop 2024-09-19T05:17:08.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:08.159+0000 7f302359e640 1 -- 172.21.15.120:0/2294178468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f301c1008c0 msgr2=0x7f301c1a4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:08.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:08.159+0000 7f302359e640 1 --2- 172.21.15.120:0/2294178468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f301c1008c0 0x7f301c1a4770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f300c006010 tx=0x7f300c004270 comp rx=0 tx=0).stop 2024-09-19T05:17:08.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:08.159+0000 7f302359e640 1 -- 172.21.15.120:0/2294178468 shutdown_connections 2024-09-19T05:17:08.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:08.159+0000 7f302359e640 1 --2- 172.21.15.120:0/2294178468 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f301c105ec0 0x7f301c19e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:08.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:08.159+0000 7f302359e640 1 --2- 172.21.15.120:0/2294178468 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f30040a3240 0x7f30040a5700 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:08.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:08.159+0000 7f302359e640 1 --2- 172.21.15.120:0/2294178468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f301c1011e0 0x7f301c1a4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:08.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:08.159+0000 7f302359e640 1 --2- 172.21.15.120:0/2294178468 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f301c1008c0 0x7f301c1a4770 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:08.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:08.159+0000 7f302359e640 1 -- 172.21.15.120:0/2294178468 >> 172.21.15.120:0/2294178468 conn(0x7f301c0fc7d0 msgr2=0x7f301c0fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:08.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:08.159+0000 7f302359e640 1 -- 172.21.15.120:0/2294178468 shutdown_connections 2024-09-19T05:17:08.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:08.159+0000 7f302359e640 1 -- 172.21.15.120:0/2294178468 wait complete. 2024-09-19T05:17:08.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:08 smithi178 ceph-mon[34347]: Deploying daemon mds.h on smithi178 2024-09-19T05:17:08.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:08 smithi178 ceph-mon[34347]: mds.? [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] up:boot 2024-09-19T05:17:08.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:08 smithi178 ceph-mon[34347]: fsmap 7 up:standby 2024-09-19T05:17:08.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:08 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T05:17:08.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:08 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/2294178468' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:17:08.613 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:08 smithi120 ceph-mon[30956]: Deploying daemon mds.h on smithi178 2024-09-19T05:17:08.613 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:08 smithi120 ceph-mon[30956]: mds.? [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] up:boot 2024-09-19T05:17:08.613 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:08 smithi120 ceph-mon[30956]: fsmap 7 up:standby 2024-09-19T05:17:08.613 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:08 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T05:17:08.613 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:08 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2294178468' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:17:08.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:08 smithi194 ceph-mon[35228]: Deploying daemon mds.h on smithi178 2024-09-19T05:17:08.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:08 smithi194 ceph-mon[35228]: mds.? [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] up:boot 2024-09-19T05:17:08.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:08 smithi194 ceph-mon[35228]: fsmap 7 up:standby 2024-09-19T05:17:08.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:08 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T05:17:08.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:08 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/2294178468' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:17:09.181 INFO:journalctl@ceph.mds.h.smithi178.stdout:Sep 19 05:17:09 smithi178 systemd[1]: Starting Ceph mds.h for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:17:09.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:09 smithi178 ceph-mon[34347]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:09.442 INFO:journalctl@ceph.mds.h.smithi178.stdout:Sep 19 05:17:09 smithi178 podman[63966]: 2024-09-19 05:17:09.173651217 +0000 UTC m=+0.015876532 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:17:09.442 INFO:journalctl@ceph.mds.h.smithi178.stdout:Sep 19 05:17:09 smithi178 podman[63966]: 2024-09-19 05:17:09.276051572 +0000 UTC m=+0.118276877 container create 068f7e61a423aa661b0312bb13213049a013dd36548ed685fec30fcec551b0b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-h, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T05:17:09.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:09 smithi120 ceph-mon[30956]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:09.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:09 smithi194 ceph-mon[35228]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:09.942 INFO:journalctl@ceph.mds.h.smithi178.stdout:Sep 19 05:17:09 smithi178 podman[63966]: 2024-09-19 05:17:09.487494844 +0000 UTC m=+0.329720151 container init 068f7e61a423aa661b0312bb13213049a013dd36548ed685fec30fcec551b0b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-h, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T05:17:09.942 INFO:journalctl@ceph.mds.h.smithi178.stdout:Sep 19 05:17:09 smithi178 podman[63966]: 2024-09-19 05:17:09.490260624 +0000 UTC m=+0.332485927 container start 068f7e61a423aa661b0312bb13213049a013dd36548ed685fec30fcec551b0b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-h, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:17:09.942 INFO:journalctl@ceph.mds.h.smithi178.stdout:Sep 19 05:17:09 smithi178 ceph-mds[63985]: -- 172.21.15.178:0/1627215458 <== mon.2 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5621a52c3860 con 0x5621a52a1400 2024-09-19T05:17:09.942 INFO:journalctl@ceph.mds.h.smithi178.stdout:Sep 19 05:17:09 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-h[63981]: starting mds.h at 2024-09-19T05:17:09.942 INFO:journalctl@ceph.mds.h.smithi178.stdout:Sep 19 05:17:09 smithi178 bash[63966]: 068f7e61a423aa661b0312bb13213049a013dd36548ed685fec30fcec551b0b0 2024-09-19T05:17:09.942 INFO:journalctl@ceph.mds.h.smithi178.stdout:Sep 19 05:17:09 smithi178 systemd[1]: Started Ceph mds.h for 4e6e3df4-7645-11ef-bceb-c7b262605968. 2024-09-19T05:17:10.885 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:17:10.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:10 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:10.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:10 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:10.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:10 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:10.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:10 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:17:10.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:10 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:17:10.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:10 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:10.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:10 smithi194 ceph-mon[35228]: Deploying daemon mds.i on smithi194 2024-09-19T05:17:10.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:10 smithi194 ceph-mon[35228]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:10.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:10 smithi194 ceph-mon[35228]: mds.? [v2:172.21.15.178:6836/3960720164,v1:172.21.15.178:6837/3960720164] up:boot 2024-09-19T05:17:10.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:10 smithi194 ceph-mon[35228]: fsmap 8 up:standby 2024-09-19T05:17:10.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:10 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T05:17:10.914 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:10 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:10.914 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:10 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:10.914 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:10 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:10.914 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:10 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:17:10.914 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:10 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:17:10.914 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:10 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:10.914 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:10 smithi120 ceph-mon[30956]: Deploying daemon mds.i on smithi194 2024-09-19T05:17:10.914 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:10 smithi120 ceph-mon[30956]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:10.914 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:10 smithi120 ceph-mon[30956]: mds.? [v2:172.21.15.178:6836/3960720164,v1:172.21.15.178:6837/3960720164] up:boot 2024-09-19T05:17:10.915 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:10 smithi120 ceph-mon[30956]: fsmap 8 up:standby 2024-09-19T05:17:10.915 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:10 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T05:17:10.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:10 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:10.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:10 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:10.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:10 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:10.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:10 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:17:10.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:10 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:17:10.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:10 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:10.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:10 smithi178 ceph-mon[34347]: Deploying daemon mds.i on smithi194 2024-09-19T05:17:10.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:10 smithi178 ceph-mon[34347]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:10.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:10 smithi178 ceph-mon[34347]: mds.? [v2:172.21.15.178:6836/3960720164,v1:172.21.15.178:6837/3960720164] up:boot 2024-09-19T05:17:10.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:10 smithi178 ceph-mon[34347]: fsmap 8 up:standby 2024-09-19T05:17:10.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:10 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T05:17:11.143 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:11.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.604+0000 7f397268d640 1 -- 172.21.15.120:0/3424427824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f396c101430 msgr2=0x7f396c10d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:11.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.604+0000 7f397268d640 1 --2- 172.21.15.120:0/3424427824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f396c101430 0x7f396c10d960 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3964009cd0 tx=0x7f396402a8e0 comp rx=0 tx=0).stop 2024-09-19T05:17:11.609 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.604+0000 7f397268d640 1 -- 172.21.15.120:0/3424427824 shutdown_connections 2024-09-19T05:17:11.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.604+0000 7f397268d640 1 --2- 172.21.15.120:0/3424427824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f396c101430 0x7f396c10d960 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:11.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.604+0000 7f397268d640 1 --2- 172.21.15.120:0/3424427824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f396c100a90 0x7f396c100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:11.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.604+0000 7f397268d640 1 --2- 172.21.15.120:0/3424427824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f396c106a90 0x7f396c106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:11.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.604+0000 7f397268d640 1 -- 172.21.15.120:0/3424427824 >> 172.21.15.120:0/3424427824 conn(0x7f396c0fc7d0 msgr2=0x7f396c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:11.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.604+0000 7f397268d640 1 -- 172.21.15.120:0/3424427824 shutdown_connections 2024-09-19T05:17:11.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.604+0000 7f397268d640 1 -- 172.21.15.120:0/3424427824 wait complete. 2024-09-19T05:17:11.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.605+0000 7f397268d640 1 Processor -- start 2024-09-19T05:17:11.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.605+0000 7f397268d640 1 -- start start 2024-09-19T05:17:11.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.605+0000 7f397268d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f396c100a90 0x7f396c197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:11.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.605+0000 7f397268d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f396c101430 0x7f396c197650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:11.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.605+0000 7f397268d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f396c106a90 0x7f396c19b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:11.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.605+0000 7f397268d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f396c110d40 con 0x7f396c101430 2024-09-19T05:17:11.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.605+0000 7f397268d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f396c110bc0 con 0x7f396c100a90 2024-09-19T05:17:11.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.605+0000 7f397268d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f396c110ec0 con 0x7f396c106a90 2024-09-19T05:17:11.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.605+0000 7f3963fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f396c101430 0x7f396c197650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:11.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.605+0000 7f3963fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f396c101430 0x7f396c197650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33396/0 (socket says 172.21.15.120:33396) 2024-09-19T05:17:11.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.605+0000 7f3963fff640 1 -- 172.21.15.120:0/1570032430 learned_addr learned my addr 172.21.15.120:0/1570032430 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:11.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.605+0000 7f3970c2a640 1 --2- 172.21.15.120:0/1570032430 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f396c106a90 0x7f396c19b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:11.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.605+0000 7f396bfff640 1 --2- 172.21.15.120:0/1570032430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f396c100a90 0x7f396c197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:11.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.605+0000 7f3963fff640 1 -- 172.21.15.120:0/1570032430 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f396c106a90 msgr2=0x7f396c19b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:11.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.605+0000 7f3963fff640 1 --2- 172.21.15.120:0/1570032430 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f396c106a90 0x7f396c19b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:11.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.605+0000 7f3963fff640 1 -- 172.21.15.120:0/1570032430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f396c100a90 msgr2=0x7f396c197110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:11.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.605+0000 7f3963fff640 1 --2- 172.21.15.120:0/1570032430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f396c100a90 0x7f396c197110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:11.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.605+0000 7f3963fff640 1 -- 172.21.15.120:0/1570032430 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396c19c0c0 con 0x7f396c101430 2024-09-19T05:17:11.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.605+0000 7f396bfff640 1 --2- 172.21.15.120:0/1570032430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f396c100a90 0x7f396c197110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:17:11.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.606+0000 7f3963fff640 1 --2- 172.21.15.120:0/1570032430 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f396c101430 0x7f396c197650 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f395400c920 tx=0x7f395400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:11.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.606+0000 7f3969ffb640 1 -- 172.21.15.120:0/1570032430 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954007c70 con 0x7f396c101430 2024-09-19T05:17:11.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.606+0000 7f3969ffb640 1 -- 172.21.15.120:0/1570032430 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3954007e10 con 0x7f396c101430 2024-09-19T05:17:11.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.606+0000 7f397268d640 1 -- 172.21.15.120:0/1570032430 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f396c19c3b0 con 0x7f396c101430 2024-09-19T05:17:11.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.606+0000 7f3969ffb640 1 -- 172.21.15.120:0/1570032430 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954018820 con 0x7f396c101430 2024-09-19T05:17:11.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.606+0000 7f397268d640 1 -- 172.21.15.120:0/1570032430 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f396c1a3c90 con 0x7f396c101430 2024-09-19T05:17:11.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.607+0000 7f397268d640 1 -- 172.21.15.120:0/1570032430 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f396c100ef0 con 0x7f396c101430 2024-09-19T05:17:11.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.608+0000 7f3969ffb640 1 -- 172.21.15.120:0/1570032430 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f39540189c0 con 0x7f396c101430 2024-09-19T05:17:11.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.609+0000 7f3969ffb640 1 --2- 172.21.15.120:0/1570032430 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f39580a3240 0x7f39580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:11.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.609+0000 7f396bfff640 1 --2- 172.21.15.120:0/1570032430 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f39580a3240 0x7f39580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:11.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.609+0000 7f3969ffb640 1 -- 172.21.15.120:0/1570032430 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f39540cf5a0 con 0x7f396c101430 2024-09-19T05:17:11.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.609+0000 7f396bfff640 1 --2- 172.21.15.120:0/1570032430 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f39580a3240 0x7f39580a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f395c005e10 tx=0x7f395c005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:11.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.613+0000 7f3969ffb640 1 -- 172.21.15.120:0/1570032430 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3954014030 con 0x7f396c101430 2024-09-19T05:17:11.656 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 19 05:17:11 smithi194 systemd[1]: Starting Ceph mds.i for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:17:11.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.811+0000 7f397268d640 1 -- 172.21.15.120:0/1570032430 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f396c198470 con 0x7f396c101430 2024-09-19T05:17:11.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.811+0000 7f3969ffb640 1 -- 172.21.15.120:0/1570032430 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7216 (secure 0 0 0) 0x7f395409c760 con 0x7f396c101430 2024-09-19T05:17:11.813 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:17:11.813 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":9,"btime":"2024-09-19T05:17:10:178926+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/93472898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":93472898},{"type":"v1","addr":"172.21.15.120:6835","nonce":93472898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1976835398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1976835398},{"type":"v1","addr":"172.21.15.120:6837","nonce":1976835398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/61682954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":61682954},{"type":"v1","addr":"172.21.15.178:6833","nonce":61682954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1778722040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1778722040},{"type":"v1","addr":"172.21.15.194:6833","nonce":1778722040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24401,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/890775592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":890775592},{"type":"v1","addr":"172.21.15.178:6835","nonce":890775592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24419,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3960720164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3960720164},{"type":"v1","addr":"172.21.15.178:6837","nonce":3960720164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/3268846994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3268846994},{"type":"v1","addr":"172.21.15.194:6835","nonce":3268846994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/378729335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":378729335},{"type":"v1","addr":"172.21.15.194:6837","nonce":378729335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T05:17:11.814 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 9 2024-09-19T05:17:11.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.814+0000 7f397268d640 1 -- 172.21.15.120:0/1570032430 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f39580a3240 msgr2=0x7f39580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:11.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.814+0000 7f397268d640 1 --2- 172.21.15.120:0/1570032430 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f39580a3240 0x7f39580a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f395c005e10 tx=0x7f395c005da0 comp rx=0 tx=0).stop 2024-09-19T05:17:11.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.814+0000 7f397268d640 1 -- 172.21.15.120:0/1570032430 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f396c101430 msgr2=0x7f396c197650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:11.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.814+0000 7f397268d640 1 --2- 172.21.15.120:0/1570032430 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f396c101430 0x7f396c197650 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f395400c920 tx=0x7f395400cde0 comp rx=0 tx=0).stop 2024-09-19T05:17:11.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.814+0000 7f397268d640 1 -- 172.21.15.120:0/1570032430 shutdown_connections 2024-09-19T05:17:11.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.814+0000 7f397268d640 1 --2- 172.21.15.120:0/1570032430 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f39580a3240 0x7f39580a5700 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:11.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.814+0000 7f397268d640 1 --2- 172.21.15.120:0/1570032430 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f396c106a90 0x7f396c19b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:11.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.814+0000 7f397268d640 1 --2- 172.21.15.120:0/1570032430 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f396c101430 0x7f396c197650 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:11.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.814+0000 7f397268d640 1 --2- 172.21.15.120:0/1570032430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f396c100a90 0x7f396c197110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:11.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.814+0000 7f397268d640 1 -- 172.21.15.120:0/1570032430 >> 172.21.15.120:0/1570032430 conn(0x7f396c0fc7d0 msgr2=0x7f396c0fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:11.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.814+0000 7f397268d640 1 -- 172.21.15.120:0/1570032430 shutdown_connections 2024-09-19T05:17:11.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:11.814+0000 7f397268d640 1 -- 172.21.15.120:0/1570032430 wait complete. 2024-09-19T05:17:11.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:11 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1570032430' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:17:11.947 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 19 05:17:11 smithi194 podman[65609]: 2024-09-19 05:17:11.599042549 +0000 UTC m=+0.016421065 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:17:11.947 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 19 05:17:11 smithi194 podman[65609]: 2024-09-19 05:17:11.69867763 +0000 UTC m=+0.116056186 container create c87510e3837ecc49942cde4005fb08e6df469575ebaadd4ac61704e27d59df7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-i, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:17:11.947 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 19 05:17:11 smithi194 podman[65609]: 2024-09-19 05:17:11.918486168 +0000 UTC m=+0.335864693 container init c87510e3837ecc49942cde4005fb08e6df469575ebaadd4ac61704e27d59df7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T05:17:11.947 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 19 05:17:11 smithi194 podman[65609]: 2024-09-19 05:17:11.921848921 +0000 UTC m=+0.339227432 container start c87510e3837ecc49942cde4005fb08e6df469575ebaadd4ac61704e27d59df7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-i, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T05:17:11.947 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 19 05:17:11 smithi194 ceph-mds[65628]: -- 172.21.15.194:0/260970309 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fcbb7b9860 con 0x55fcbb797000 2024-09-19T05:17:12.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:11 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1570032430' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:17:12.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:11 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1570032430' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:17:12.408 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 19 05:17:11 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-i[65624]: starting mds.i at 2024-09-19T05:17:12.408 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 19 05:17:12 smithi194 bash[65609]: c87510e3837ecc49942cde4005fb08e6df469575ebaadd4ac61704e27d59df7c 2024-09-19T05:17:12.408 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 19 05:17:12 smithi194 systemd[1]: Started Ceph mds.i for 4e6e3df4-7645-11ef-bceb-c7b262605968. 2024-09-19T05:17:13.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:13 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:13.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:13 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:13.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:13 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:13.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:13 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:17:13.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:13 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:17:13.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:13 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:13.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:13 smithi120 ceph-mon[30956]: Deploying daemon mds.g on smithi120 2024-09-19T05:17:13.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:13 smithi120 ceph-mon[30956]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:13.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:13 smithi120 ceph-mon[30956]: mds.? [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] up:boot 2024-09-19T05:17:13.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:13 smithi120 ceph-mon[30956]: fsmap 9 up:standby 2024-09-19T05:17:13.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:13 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T05:17:13.307 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:13 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:13.307 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:13 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:13.307 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:13 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:13.307 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:13 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:17:13.307 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:13 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:17:13.307 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:13 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:13.307 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:13 smithi194 ceph-mon[35228]: Deploying daemon mds.g on smithi120 2024-09-19T05:17:13.308 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:13 smithi194 ceph-mon[35228]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:13.308 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:13 smithi194 ceph-mon[35228]: mds.? [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] up:boot 2024-09-19T05:17:13.308 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:13 smithi194 ceph-mon[35228]: fsmap 9 up:standby 2024-09-19T05:17:13.308 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:13 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T05:17:13.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:13 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:13.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:13 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:13.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:13 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:13.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:13 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:17:13.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:13 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:17:13.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:13 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:13.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:13 smithi178 ceph-mon[34347]: Deploying daemon mds.g on smithi120 2024-09-19T05:17:13.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:13 smithi178 ceph-mon[34347]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:13.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:13 smithi178 ceph-mon[34347]: mds.? [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] up:boot 2024-09-19T05:17:13.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:13 smithi178 ceph-mon[34347]: fsmap 9 up:standby 2024-09-19T05:17:13.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:13 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T05:17:14.375 INFO:journalctl@ceph.mds.g.smithi120.stdout:Sep 19 05:17:14 smithi120 systemd[1]: Starting Ceph mds.g for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:17:14.594 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:17:14.665 INFO:journalctl@ceph.mds.g.smithi120.stdout:Sep 19 05:17:14 smithi120 podman[71295]: 2024-09-19 05:17:14.293997235 +0000 UTC m=+0.015810726 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:17:14.665 INFO:journalctl@ceph.mds.g.smithi120.stdout:Sep 19 05:17:14 smithi120 podman[71295]: 2024-09-19 05:17:14.400698806 +0000 UTC m=+0.122512285 container create 7ef4a9e45083483e8a57a3bc66819875e1319a6fc407871d20e9951536744520 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T05:17:14.665 INFO:journalctl@ceph.mds.g.smithi120.stdout:Sep 19 05:17:14 smithi120 podman[71295]: 2024-09-19 05:17:14.636890988 +0000 UTC m=+0.358704482 container init 7ef4a9e45083483e8a57a3bc66819875e1319a6fc407871d20e9951536744520 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-g, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:17:14.665 INFO:journalctl@ceph.mds.g.smithi120.stdout:Sep 19 05:17:14 smithi120 podman[71295]: 2024-09-19 05:17:14.640376123 +0000 UTC m=+0.362189611 container start 7ef4a9e45083483e8a57a3bc66819875e1319a6fc407871d20e9951536744520 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-g, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T05:17:14.854 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:14.973 INFO:journalctl@ceph.mds.g.smithi120.stdout:Sep 19 05:17:14 smithi120 ceph-mds[71333]: -- 172.21.15.120:0/1861549211 <== mon.0 v2:172.21.15.120:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c740551c20 con 0x55c74052f000 2024-09-19T05:17:14.973 INFO:journalctl@ceph.mds.g.smithi120.stdout:Sep 19 05:17:14 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-g[71311]: starting mds.g at 2024-09-19T05:17:14.973 INFO:journalctl@ceph.mds.g.smithi120.stdout:Sep 19 05:17:14 smithi120 bash[71295]: 7ef4a9e45083483e8a57a3bc66819875e1319a6fc407871d20e9951536744520 2024-09-19T05:17:14.973 INFO:journalctl@ceph.mds.g.smithi120.stdout:Sep 19 05:17:14 smithi120 systemd[1]: Started Ceph mds.g for 4e6e3df4-7645-11ef-bceb-c7b262605968. 2024-09-19T05:17:15.299 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:15 smithi120 ceph-mon[30956]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:15.299 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:15 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:15.299 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:15 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:15.299 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:15 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:15.299 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:15 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:17:15.299 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:15 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:17:15.299 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:15 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:15.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.296+0000 7fd6901bf640 1 -- 172.21.15.120:0/4175503513 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd688106a80 msgr2=0x7fd688106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:15.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.296+0000 7fd6901bf640 1 --2- 172.21.15.120:0/4175503513 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd688106a80 0x7fd688106e60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd684009930 tx=0x7fd68402a420 comp rx=0 tx=0).stop 2024-09-19T05:17:15.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.296+0000 7fd6901bf640 1 -- 172.21.15.120:0/4175503513 shutdown_connections 2024-09-19T05:17:15.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.296+0000 7fd6901bf640 1 --2- 172.21.15.120:0/4175503513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd688101420 0x7fd68810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:15.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.296+0000 7fd6901bf640 1 --2- 172.21.15.120:0/4175503513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd688100a80 0x7fd688100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:15.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.296+0000 7fd6901bf640 1 --2- 172.21.15.120:0/4175503513 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd688106a80 0x7fd688106e60 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:15.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.296+0000 7fd6901bf640 1 -- 172.21.15.120:0/4175503513 >> 172.21.15.120:0/4175503513 conn(0x7fd6880fc7a0 msgr2=0x7fd6880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:15.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.297+0000 7fd6901bf640 1 -- 172.21.15.120:0/4175503513 shutdown_connections 2024-09-19T05:17:15.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.297+0000 7fd6901bf640 1 -- 172.21.15.120:0/4175503513 wait complete. 2024-09-19T05:17:15.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.297+0000 7fd6901bf640 1 Processor -- start 2024-09-19T05:17:15.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.297+0000 7fd6901bf640 1 -- start start 2024-09-19T05:17:15.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.297+0000 7fd6901bf640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd688100a80 0x7fd6881a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:15.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.297+0000 7fd6901bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd688101420 0x7fd6881a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:15.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.297+0000 7fd6901bf640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd688106a80 0x7fd68819eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:15.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.297+0000 7fd6901bf640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd688110dd0 con 0x7fd688101420 2024-09-19T05:17:15.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.297+0000 7fd6901bf640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd688110c50 con 0x7fd688106a80 2024-09-19T05:17:15.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.297+0000 7fd6901bf640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd688110f50 con 0x7fd688100a80 2024-09-19T05:17:15.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.298+0000 7fd68d75a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd688101420 0x7fd6881a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:15.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.298+0000 7fd68d75a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd688101420 0x7fd6881a4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46588/0 (socket says 172.21.15.120:46588) 2024-09-19T05:17:15.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.298+0000 7fd68d75a640 1 -- 172.21.15.120:0/1936046298 learned_addr learned my addr 172.21.15.120:0/1936046298 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:15.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.298+0000 7fd68df5b640 1 --2- 172.21.15.120:0/1936046298 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd688100a80 0x7fd6881a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:15.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.298+0000 7fd68e75c640 1 --2- 172.21.15.120:0/1936046298 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd688106a80 0x7fd68819eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:15.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.298+0000 7fd68d75a640 1 -- 172.21.15.120:0/1936046298 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd688100a80 msgr2=0x7fd6881a4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:15.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.298+0000 7fd68d75a640 1 --2- 172.21.15.120:0/1936046298 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd688100a80 0x7fd6881a4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:15.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.298+0000 7fd68d75a640 1 -- 172.21.15.120:0/1936046298 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd688106a80 msgr2=0x7fd68819eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:15.319 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.298+0000 7fd68d75a640 1 --2- 172.21.15.120:0/1936046298 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd688106a80 0x7fd68819eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:15.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.298+0000 7fd68d75a640 1 -- 172.21.15.120:0/1936046298 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68819f1e0 con 0x7fd688101420 2024-09-19T05:17:15.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.298+0000 7fd68e75c640 1 --2- 172.21.15.120:0/1936046298 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd688106a80 0x7fd68819eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:17:15.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.298+0000 7fd68d75a640 1 --2- 172.21.15.120:0/1936046298 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd688101420 0x7fd6881a4ca0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd67800b4a0 tx=0x7fd67800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:15.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.298+0000 7fd67effd640 1 -- 172.21.15.120:0/1936046298 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd678014070 con 0x7fd688101420 2024-09-19T05:17:15.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.298+0000 7fd6901bf640 1 -- 172.21.15.120:0/1936046298 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd68819f4d0 con 0x7fd688101420 2024-09-19T05:17:15.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.298+0000 7fd67effd640 1 -- 172.21.15.120:0/1936046298 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd678010ac0 con 0x7fd688101420 2024-09-19T05:17:15.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.298+0000 7fd67effd640 1 -- 172.21.15.120:0/1936046298 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd678017c30 con 0x7fd688101420 2024-09-19T05:17:15.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.298+0000 7fd6901bf640 1 -- 172.21.15.120:0/1936046298 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6881ab630 con 0x7fd688101420 2024-09-19T05:17:15.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.299+0000 7fd6901bf640 1 -- 172.21.15.120:0/1936046298 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd688100f60 con 0x7fd688101420 2024-09-19T05:17:15.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.300+0000 7fd67effd640 1 -- 172.21.15.120:0/1936046298 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fd678017070 con 0x7fd688101420 2024-09-19T05:17:15.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.301+0000 7fd67effd640 1 --2- 172.21.15.120:0/1936046298 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd6740a3240 0x7fd6740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:15.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.301+0000 7fd68df5b640 1 --2- 172.21.15.120:0/1936046298 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd6740a3240 0x7fd6740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:15.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.301+0000 7fd67effd640 1 -- 172.21.15.120:0/1936046298 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fd6780ceba0 con 0x7fd688101420 2024-09-19T05:17:15.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.302+0000 7fd68df5b640 1 --2- 172.21.15.120:0/1936046298 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd6740a3240 0x7fd6740a5700 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd684009900 tx=0x7fd684000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:15.321 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.304+0000 7fd67effd640 1 -- 172.21.15.120:0/1936046298 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd67809bd60 con 0x7fd688101420 2024-09-19T05:17:15.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:15 smithi178 ceph-mon[34347]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:15.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:15 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:15.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:15 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:15.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:15 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:15.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:15 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:17:15.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:15 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:17:15.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:15 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:15.521 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.520+0000 7fd6901bf640 1 -- 172.21.15.120:0/1936046298 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd68819fe50 con 0x7fd688101420 2024-09-19T05:17:15.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.520+0000 7fd67effd640 1 -- 172.21.15.120:0/1936046298 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8875 (secure 0 0 0) 0x7fd68819fe50 con 0x7fd688101420 2024-09-19T05:17:15.522 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:17:15.522 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":11,"btime":"2024-09-19T05:17:15:180255+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/93472898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":93472898},{"type":"v1","addr":"172.21.15.120:6835","nonce":93472898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1976835398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1976835398},{"type":"v1","addr":"172.21.15.120:6837","nonce":1976835398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6839/2975851469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":2975851469},{"type":"v1","addr":"172.21.15.120:6839","nonce":2975851469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/61682954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":61682954},{"type":"v1","addr":"172.21.15.178:6833","nonce":61682954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1778722040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1778722040},{"type":"v1","addr":"172.21.15.194:6833","nonce":1778722040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24401,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/890775592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":890775592},{"type":"v1","addr":"172.21.15.178:6835","nonce":890775592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24419,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3960720164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3960720164},{"type":"v1","addr":"172.21.15.178:6837","nonce":3960720164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/3268846994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3268846994},{"type":"v1","addr":"172.21.15.194:6835","nonce":3268846994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/378729335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":378729335},{"type":"v1","addr":"172.21.15.194:6837","nonce":378729335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24445,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/3817420679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3817420679},{"type":"v1","addr":"172.21.15.194:6839","nonce":3817420679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T05:17:15.522 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 11 2024-09-19T05:17:15.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.522+0000 7fd6901bf640 1 -- 172.21.15.120:0/1936046298 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd6740a3240 msgr2=0x7fd6740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:15.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.522+0000 7fd6901bf640 1 --2- 172.21.15.120:0/1936046298 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd6740a3240 0x7fd6740a5700 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd684009900 tx=0x7fd684000bc0 comp rx=0 tx=0).stop 2024-09-19T05:17:15.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.522+0000 7fd6901bf640 1 -- 172.21.15.120:0/1936046298 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd688101420 msgr2=0x7fd6881a4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:15.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.522+0000 7fd6901bf640 1 --2- 172.21.15.120:0/1936046298 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd688101420 0x7fd6881a4ca0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd67800b4a0 tx=0x7fd67800b960 comp rx=0 tx=0).stop 2024-09-19T05:17:15.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.522+0000 7fd6901bf640 1 -- 172.21.15.120:0/1936046298 shutdown_connections 2024-09-19T05:17:15.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.522+0000 7fd6901bf640 1 --2- 172.21.15.120:0/1936046298 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd688106a80 0x7fd68819eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:15.524 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.522+0000 7fd6901bf640 1 --2- 172.21.15.120:0/1936046298 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd688101420 0x7fd6881a4ca0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:15.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.522+0000 7fd6901bf640 1 --2- 172.21.15.120:0/1936046298 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd6740a3240 0x7fd6740a5700 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:15.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.522+0000 7fd6901bf640 1 --2- 172.21.15.120:0/1936046298 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd688100a80 0x7fd6881a4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:15.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.522+0000 7fd6901bf640 1 -- 172.21.15.120:0/1936046298 >> 172.21.15.120:0/1936046298 conn(0x7fd6880fc7a0 msgr2=0x7fd68806a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:15.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.522+0000 7fd6901bf640 1 -- 172.21.15.120:0/1936046298 shutdown_connections 2024-09-19T05:17:15.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:15.522+0000 7fd6901bf640 1 -- 172.21.15.120:0/1936046298 wait complete. 2024-09-19T05:17:15.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:15 smithi194 ceph-mon[35228]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:15.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:15 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:15.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:15 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:15.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:15 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:15.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:15 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:17:15.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:15 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:17:15.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:15 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:16.491 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:16 smithi120 ceph-mon[30956]: Deploying daemon mds.a on smithi120 2024-09-19T05:17:16.491 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:16 smithi120 ceph-mon[30956]: mds.? [v2:172.21.15.120:6838/2975851469,v1:172.21.15.120:6839/2975851469] up:boot 2024-09-19T05:17:16.492 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:16 smithi120 ceph-mon[30956]: fsmap 10 up:standby 2024-09-19T05:17:16.492 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:16 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T05:17:16.492 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:16 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1936046298' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:17:16.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:16 smithi194 ceph-mon[35228]: Deploying daemon mds.a on smithi120 2024-09-19T05:17:16.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:16 smithi194 ceph-mon[35228]: mds.? [v2:172.21.15.120:6838/2975851469,v1:172.21.15.120:6839/2975851469] up:boot 2024-09-19T05:17:16.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:16 smithi194 ceph-mon[35228]: fsmap 10 up:standby 2024-09-19T05:17:16.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:16 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T05:17:16.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:16 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1936046298' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:17:16.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:16 smithi178 ceph-mon[34347]: Deploying daemon mds.a on smithi120 2024-09-19T05:17:16.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:16 smithi178 ceph-mon[34347]: mds.? [v2:172.21.15.120:6838/2975851469,v1:172.21.15.120:6839/2975851469] up:boot 2024-09-19T05:17:16.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:16 smithi178 ceph-mon[34347]: fsmap 10 up:standby 2024-09-19T05:17:16.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:16 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T05:17:16.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:16 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1936046298' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:17:17.262 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:17 smithi120 ceph-mon[30956]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:17.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:17 smithi194 ceph-mon[35228]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:17.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:17 smithi178 ceph-mon[34347]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:17.875 INFO:journalctl@ceph.mds.a.smithi120.stdout:Sep 19 05:17:17 smithi120 systemd[1]: Starting Ceph mds.a for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:17:18.220 INFO:journalctl@ceph.mds.a.smithi120.stdout:Sep 19 05:17:17 smithi120 podman[71712]: 2024-09-19 05:17:17.852642606 +0000 UTC m=+0.016101204 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:17:18.220 INFO:journalctl@ceph.mds.a.smithi120.stdout:Sep 19 05:17:17 smithi120 podman[71712]: 2024-09-19 05:17:17.964611175 +0000 UTC m=+0.128069766 container create e341cc103103c7a94cfa6dd8fc5b344f98524d949b493d95f4b3baca9f3dd9d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T05:17:18.220 INFO:journalctl@ceph.mds.a.smithi120.stdout:Sep 19 05:17:18 smithi120 podman[71712]: 2024-09-19 05:17:18.192258361 +0000 UTC m=+0.355716974 container init e341cc103103c7a94cfa6dd8fc5b344f98524d949b493d95f4b3baca9f3dd9d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-a, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T05:17:18.220 INFO:journalctl@ceph.mds.a.smithi120.stdout:Sep 19 05:17:18 smithi120 podman[71712]: 2024-09-19 05:17:18.195400102 +0000 UTC m=+0.358858693 container start e341cc103103c7a94cfa6dd8fc5b344f98524d949b493d95f4b3baca9f3dd9d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T05:17:18.294 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:17:18.557 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:18.625 INFO:journalctl@ceph.mds.a.smithi120.stdout:Sep 19 05:17:18 smithi120 ceph-mds[71734]: -- 172.21.15.120:0/3739854921 <== mon.0 v2:172.21.15.120:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5612c385b860 con 0x5612c3839000 2024-09-19T05:17:18.625 INFO:journalctl@ceph.mds.a.smithi120.stdout:Sep 19 05:17:18 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-a[71730]: starting mds.a at 2024-09-19T05:17:18.625 INFO:journalctl@ceph.mds.a.smithi120.stdout:Sep 19 05:17:18 smithi120 bash[71712]: e341cc103103c7a94cfa6dd8fc5b344f98524d949b493d95f4b3baca9f3dd9d2 2024-09-19T05:17:18.625 INFO:journalctl@ceph.mds.a.smithi120.stdout:Sep 19 05:17:18 smithi120 systemd[1]: Started Ceph mds.a for 4e6e3df4-7645-11ef-bceb-c7b262605968. 2024-09-19T05:17:19.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.022+0000 7efc88071640 1 -- 172.21.15.120:0/3747796746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc80105220 msgr2=0x7efc80105600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:19.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.022+0000 7efc88071640 1 --2- 172.21.15.120:0/3747796746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc80105220 0x7efc80105600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009900 tx=0x7efc7c02a410 comp rx=0 tx=0).stop 2024-09-19T05:17:19.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.022+0000 7efc88071640 1 -- 172.21.15.120:0/3747796746 shutdown_connections 2024-09-19T05:17:19.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.022+0000 7efc88071640 1 --2- 172.21.15.120:0/3747796746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc80101020 0x7efc8010d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:19.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.022+0000 7efc88071640 1 --2- 172.21.15.120:0/3747796746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc80100680 0x7efc80100ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:19.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.022+0000 7efc88071640 1 --2- 172.21.15.120:0/3747796746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc80105220 0x7efc80105600 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:19.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.022+0000 7efc88071640 1 -- 172.21.15.120:0/3747796746 >> 172.21.15.120:0/3747796746 conn(0x7efc80077210 msgr2=0x7efc80077620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:19.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.022+0000 7efc88071640 1 -- 172.21.15.120:0/3747796746 shutdown_connections 2024-09-19T05:17:19.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.022+0000 7efc88071640 1 -- 172.21.15.120:0/3747796746 wait complete. 2024-09-19T05:17:19.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.022+0000 7efc88071640 1 Processor -- start 2024-09-19T05:17:19.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.022+0000 7efc88071640 1 -- start start 2024-09-19T05:17:19.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.022+0000 7efc88071640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc80100680 0x7efc80101f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:19.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.022+0000 7efc88071640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc80101020 0x7efc80102480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:19.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.023+0000 7efc88071640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc80105220 0x7efc801029c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:19.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.023+0000 7efc88071640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efc80110580 con 0x7efc80100680 2024-09-19T05:17:19.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.023+0000 7efc88071640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7efc80110400 con 0x7efc80101020 2024-09-19T05:17:19.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.023+0000 7efc88071640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7efc80110700 con 0x7efc80105220 2024-09-19T05:17:19.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.023+0000 7efc85e0d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc80100680 0x7efc80101f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:19.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.023+0000 7efc85e0d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc80100680 0x7efc80101f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46642/0 (socket says 172.21.15.120:46642) 2024-09-19T05:17:19.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.023+0000 7efc85e0d640 1 -- 172.21.15.120:0/3684144017 learned_addr learned my addr 172.21.15.120:0/3684144017 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:19.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.023+0000 7efc8560c640 1 --2- 172.21.15.120:0/3684144017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc80101020 0x7efc80102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:19.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.023+0000 7efc8660e640 1 --2- 172.21.15.120:0/3684144017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc80105220 0x7efc801029c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:19.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.023+0000 7efc85e0d640 1 -- 172.21.15.120:0/3684144017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc80105220 msgr2=0x7efc801029c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:19.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.023+0000 7efc85e0d640 1 --2- 172.21.15.120:0/3684144017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc80105220 0x7efc801029c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:19.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.023+0000 7efc85e0d640 1 -- 172.21.15.120:0/3684144017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc80101020 msgr2=0x7efc80102480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:19.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.023+0000 7efc85e0d640 1 --2- 172.21.15.120:0/3684144017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc80101020 0x7efc80102480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:19.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.023+0000 7efc85e0d640 1 -- 172.21.15.120:0/3684144017 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc801a6930 con 0x7efc80100680 2024-09-19T05:17:19.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.023+0000 7efc8660e640 1 --2- 172.21.15.120:0/3684144017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc80105220 0x7efc801029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:17:19.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.023+0000 7efc85e0d640 1 --2- 172.21.15.120:0/3684144017 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc80100680 0x7efc80101f40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efc7c006010 tx=0x7efc7c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:19.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.023+0000 7efc76ffd640 1 -- 172.21.15.120:0/3684144017 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7c03f030 con 0x7efc80100680 2024-09-19T05:17:19.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.023+0000 7efc88071640 1 -- 172.21.15.120:0/3684144017 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc801a6bc0 con 0x7efc80100680 2024-09-19T05:17:19.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.023+0000 7efc76ffd640 1 -- 172.21.15.120:0/3684144017 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efc7c003cb0 con 0x7efc80100680 2024-09-19T05:17:19.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.023+0000 7efc76ffd640 1 -- 172.21.15.120:0/3684144017 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7c035070 con 0x7efc80100680 2024-09-19T05:17:19.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.023+0000 7efc88071640 1 -- 172.21.15.120:0/3684144017 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc801a70a0 con 0x7efc80100680 2024-09-19T05:17:19.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.024+0000 7efc88071640 1 -- 172.21.15.120:0/3684144017 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc80100ae0 con 0x7efc80100680 2024-09-19T05:17:19.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.026+0000 7efc76ffd640 1 -- 172.21.15.120:0/3684144017 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7efc7c042030 con 0x7efc80100680 2024-09-19T05:17:19.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.026+0000 7efc76ffd640 1 --2- 172.21.15.120:0/3684144017 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7efc6c0a3240 0x7efc6c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:19.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.026+0000 7efc8560c640 1 --2- 172.21.15.120:0/3684144017 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7efc6c0a3240 0x7efc6c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:19.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.026+0000 7efc76ffd640 1 -- 172.21.15.120:0/3684144017 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7efc7c0efbb0 con 0x7efc80100680 2024-09-19T05:17:19.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.027+0000 7efc8560c640 1 --2- 172.21.15.120:0/3684144017 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7efc6c0a3240 0x7efc6c0a5700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efc801039d0 tx=0x7efc7000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:19.059 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.029+0000 7efc76ffd640 1 -- 172.21.15.120:0/3684144017 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efc7c0bcd70 con 0x7efc80100680 2024-09-19T05:17:19.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.237+0000 7efc88071640 1 -- 172.21.15.120:0/3684144017 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc80109e80 con 0x7efc80100680 2024-09-19T05:17:19.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.238+0000 7efc76ffd640 1 -- 172.21.15.120:0/3684144017 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9704 (secure 0 0 0) 0x7efc7c0bc670 con 0x7efc80100680 2024-09-19T05:17:19.240 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:17:19.240 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":12,"btime":"2024-09-19T05:17:19:199406+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/93472898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":93472898},{"type":"v1","addr":"172.21.15.120:6835","nonce":93472898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1976835398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1976835398},{"type":"v1","addr":"172.21.15.120:6837","nonce":1976835398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6839/2975851469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":2975851469},{"type":"v1","addr":"172.21.15.120:6839","nonce":2975851469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6841/2837552754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":2837552754},{"type":"v1","addr":"172.21.15.120:6841","nonce":2837552754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/61682954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":61682954},{"type":"v1","addr":"172.21.15.178:6833","nonce":61682954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1778722040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1778722040},{"type":"v1","addr":"172.21.15.194:6833","nonce":1778722040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24401,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/890775592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":890775592},{"type":"v1","addr":"172.21.15.178:6835","nonce":890775592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24419,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3960720164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3960720164},{"type":"v1","addr":"172.21.15.178:6837","nonce":3960720164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/3268846994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3268846994},{"type":"v1","addr":"172.21.15.194:6835","nonce":3268846994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/378729335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":378729335},{"type":"v1","addr":"172.21.15.194:6837","nonce":378729335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24445,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/3817420679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3817420679},{"type":"v1","addr":"172.21.15.194:6839","nonce":3817420679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T05:17:19.240 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 12 2024-09-19T05:17:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.240+0000 7efc88071640 1 -- 172.21.15.120:0/3684144017 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7efc6c0a3240 msgr2=0x7efc6c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.240+0000 7efc88071640 1 --2- 172.21.15.120:0/3684144017 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7efc6c0a3240 0x7efc6c0a5700 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efc801039d0 tx=0x7efc7000b390 comp rx=0 tx=0).stop 2024-09-19T05:17:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.240+0000 7efc88071640 1 -- 172.21.15.120:0/3684144017 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc80100680 msgr2=0x7efc80101f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.240+0000 7efc88071640 1 --2- 172.21.15.120:0/3684144017 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc80100680 0x7efc80101f40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efc7c006010 tx=0x7efc7c0042f0 comp rx=0 tx=0).stop 2024-09-19T05:17:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.240+0000 7efc88071640 1 -- 172.21.15.120:0/3684144017 shutdown_connections 2024-09-19T05:17:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.240+0000 7efc88071640 1 --2- 172.21.15.120:0/3684144017 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7efc6c0a3240 0x7efc6c0a5700 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.240+0000 7efc88071640 1 --2- 172.21.15.120:0/3684144017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc80105220 0x7efc801029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.240+0000 7efc88071640 1 --2- 172.21.15.120:0/3684144017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc80101020 0x7efc80102480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.240+0000 7efc88071640 1 --2- 172.21.15.120:0/3684144017 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efc80100680 0x7efc80101f40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.240+0000 7efc88071640 1 -- 172.21.15.120:0/3684144017 >> 172.21.15.120:0/3684144017 conn(0x7efc80077210 msgr2=0x7efc80107020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:19.242 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.240+0000 7efc88071640 1 -- 172.21.15.120:0/3684144017 shutdown_connections 2024-09-19T05:17:19.243 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:19.240+0000 7efc88071640 1 -- 172.21.15.120:0/3684144017 wait complete. 2024-09-19T05:17:19.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:19 smithi178 ceph-mon[34347]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:19.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:19 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:19.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:19 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:19.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:19 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:19.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:19 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:17:19.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:19 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:17:19.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:19 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:19.592 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:19 smithi120 ceph-mon[30956]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:19.592 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:19 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:19.592 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:19 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:19.593 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:19 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:19.593 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:19 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:17:19.593 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:19 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:17:19.593 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:19 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:19.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:19 smithi194 ceph-mon[35228]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:19.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:19 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:19.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:19 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:19.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:19 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:19.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:19 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T05:17:19.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:19 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T05:17:19.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:19 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:20.442 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:17:20 smithi178 systemd[1]: Starting Ceph mds.b for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:17:20.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:20 smithi178 ceph-mon[34347]: Deploying daemon mds.b on smithi178 2024-09-19T05:17:20.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:20 smithi178 ceph-mon[34347]: mds.? [v2:172.21.15.120:6840/2837552754,v1:172.21.15.120:6841/2837552754] up:boot 2024-09-19T05:17:20.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:20 smithi178 ceph-mon[34347]: fsmap 11 up:standby 2024-09-19T05:17:20.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:20 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T05:17:20.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:20 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/3684144017' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:17:20.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:20 smithi120 ceph-mon[30956]: Deploying daemon mds.b on smithi178 2024-09-19T05:17:20.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:20 smithi120 ceph-mon[30956]: mds.? [v2:172.21.15.120:6840/2837552754,v1:172.21.15.120:6841/2837552754] up:boot 2024-09-19T05:17:20.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:20 smithi120 ceph-mon[30956]: fsmap 11 up:standby 2024-09-19T05:17:20.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:20 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T05:17:20.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:20 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/3684144017' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:17:20.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:20 smithi194 ceph-mon[35228]: Deploying daemon mds.b on smithi178 2024-09-19T05:17:20.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:20 smithi194 ceph-mon[35228]: mds.? [v2:172.21.15.120:6840/2837552754,v1:172.21.15.120:6841/2837552754] up:boot 2024-09-19T05:17:20.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:20 smithi194 ceph-mon[35228]: fsmap 11 up:standby 2024-09-19T05:17:20.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:20 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T05:17:20.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:20 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/3684144017' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:17:20.833 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:17:20 smithi178 podman[64268]: 2024-09-19 05:17:20.418944259 +0000 UTC m=+0.015988275 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:17:20.833 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:17:20 smithi178 podman[64268]: 2024-09-19 05:17:20.52127043 +0000 UTC m=+0.118314438 container create 7e1e4df1a12dc1bd9d03e3980beb58b4152c125e65266365b9e8bbf325ca4a05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:17:20.833 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:17:20 smithi178 podman[64268]: 2024-09-19 05:17:20.731949196 +0000 UTC m=+0.328993203 container init 7e1e4df1a12dc1bd9d03e3980beb58b4152c125e65266365b9e8bbf325ca4a05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T05:17:20.833 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:17:20 smithi178 podman[64268]: 2024-09-19 05:17:20.734792656 +0000 UTC m=+0.331836672 container start 7e1e4df1a12dc1bd9d03e3980beb58b4152c125e65266365b9e8bbf325ca4a05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T05:17:20.833 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:17:20 smithi178 ceph-mds[64287]: -- 172.21.15.178:0/2842746823 <== mon.2 v2:172.21.15.178:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f17a61b860 con 0x55f17a5f9000 2024-09-19T05:17:20.833 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:17:20 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: starting mds.b at 2024-09-19T05:17:20.833 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:17:20 smithi178 bash[64268]: 7e1e4df1a12dc1bd9d03e3980beb58b4152c125e65266365b9e8bbf325ca4a05 2024-09-19T05:17:21.192 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:17:20 smithi178 systemd[1]: Started Ceph mds.b for 4e6e3df4-7645-11ef-bceb-c7b262605968. 2024-09-19T05:17:21.601 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:21 smithi194 ceph-mon[35228]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:21.601 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:21 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:21.601 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:21 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:21.601 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:21 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:21.601 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:21 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:21.601 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:21 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:21.601 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:21 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:17:21.614 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:21 smithi178 ceph-mon[34347]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:21.614 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:21 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:21.614 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:21 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:21.614 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:21 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:21.614 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:21 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:21.614 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:21 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:21.614 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:21 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:17:21.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:21 smithi120 ceph-mon[30956]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:21.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:21 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:21.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:21 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:21.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:21 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:21.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:21 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:21.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:21 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:21.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:21 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:17:21.959 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:17:22.219 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:22.232 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:22 smithi120 ceph-mon[30956]: mds.? [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] up:boot 2024-09-19T05:17:22.233 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:22 smithi120 ceph-mon[30956]: fsmap 12 up:standby 2024-09-19T05:17:22.233 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:22 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T05:17:22.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:22 smithi194 ceph-mon[35228]: mds.? [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] up:boot 2024-09-19T05:17:22.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:22 smithi194 ceph-mon[35228]: fsmap 12 up:standby 2024-09-19T05:17:22.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:22 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T05:17:22.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:22 smithi178 ceph-mon[34347]: mds.? [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] up:boot 2024-09-19T05:17:22.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:22 smithi178 ceph-mon[34347]: fsmap 12 up:standby 2024-09-19T05:17:22.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:22 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T05:17:22.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.713+0000 7ffa9d075640 1 -- 172.21.15.120:0/2249531650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa98102ef0 msgr2=0x7ffa9810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:22.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.713+0000 7ffa9d075640 1 --2- 172.21.15.120:0/2249531650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa98102ef0 0x7ffa9810da40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ffa90009ca0 tx=0x7ffa9002a950 comp rx=0 tx=0).stop 2024-09-19T05:17:22.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.713+0000 7ffa9d075640 1 -- 172.21.15.120:0/2249531650 shutdown_connections 2024-09-19T05:17:22.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.713+0000 7ffa9d075640 1 --2- 172.21.15.120:0/2249531650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa98102ef0 0x7ffa9810da40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:22.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.713+0000 7ffa9d075640 1 --2- 172.21.15.120:0/2249531650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa98102570 0x7ffa981029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:22.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.713+0000 7ffa9d075640 1 --2- 172.21.15.120:0/2249531650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa98100e20 0x7ffa98101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:22.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.713+0000 7ffa9d075640 1 -- 172.21.15.120:0/2249531650 >> 172.21.15.120:0/2249531650 conn(0x7ffa980fc7d0 msgr2=0x7ffa980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:22.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.713+0000 7ffa9d075640 1 -- 172.21.15.120:0/2249531650 shutdown_connections 2024-09-19T05:17:22.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.713+0000 7ffa9d075640 1 -- 172.21.15.120:0/2249531650 wait complete. 2024-09-19T05:17:22.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.714+0000 7ffa9d075640 1 Processor -- start 2024-09-19T05:17:22.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.714+0000 7ffa9d075640 1 -- start start 2024-09-19T05:17:22.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.714+0000 7ffa9d075640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa98100e20 0x7ffa981984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:22.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.714+0000 7ffa9d075640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa98102570 0x7ffa981989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:22.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.714+0000 7ffa9d075640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa98102ef0 0x7ffa9819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:22.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.714+0000 7ffa9d075640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ffa98110e70 con 0x7ffa98102ef0 2024-09-19T05:17:22.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.714+0000 7ffa9d075640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ffa98110cf0 con 0x7ffa98102570 2024-09-19T05:17:22.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.714+0000 7ffa9d075640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffa98110ff0 con 0x7ffa98100e20 2024-09-19T05:17:22.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.714+0000 7ffa9759e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa98102ef0 0x7ffa9819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:22.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.714+0000 7ffa96d9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa98100e20 0x7ffa981984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:22.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.714+0000 7ffa9659c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa98102570 0x7ffa981989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:22.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.714+0000 7ffa9759e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa98102ef0 0x7ffa9819cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46666/0 (socket says 172.21.15.120:46666) 2024-09-19T05:17:22.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.714+0000 7ffa9759e640 1 -- 172.21.15.120:0/1926158538 learned_addr learned my addr 172.21.15.120:0/1926158538 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:22.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.715+0000 7ffa9659c640 1 -- 172.21.15.120:0/1926158538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa98100e20 msgr2=0x7ffa981984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:22.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.715+0000 7ffa9659c640 1 --2- 172.21.15.120:0/1926158538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa98100e20 0x7ffa981984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:22.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.715+0000 7ffa9659c640 1 -- 172.21.15.120:0/1926158538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa98102ef0 msgr2=0x7ffa9819cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:22.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.715+0000 7ffa9659c640 1 --2- 172.21.15.120:0/1926158538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa98102ef0 0x7ffa9819cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:22.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.715+0000 7ffa9659c640 1 -- 172.21.15.120:0/1926158538 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa9819d450 con 0x7ffa98102570 2024-09-19T05:17:22.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.715+0000 7ffa96d9d640 1 --2- 172.21.15.120:0/1926158538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa98100e20 0x7ffa981984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:17:22.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.715+0000 7ffa9759e640 1 --2- 172.21.15.120:0/1926158538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa98102ef0 0x7ffa9819cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:17:22.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.715+0000 7ffa9659c640 1 --2- 172.21.15.120:0/1926158538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa98102570 0x7ffa981989e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00d720 tx=0x7ffa8c00db20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:22.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.715+0000 7ffa7ffff640 1 -- 172.21.15.120:0/1926158538 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c017070 con 0x7ffa98102570 2024-09-19T05:17:22.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.715+0000 7ffa7ffff640 1 -- 172.21.15.120:0/1926158538 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffa8c0054d0 con 0x7ffa98102570 2024-09-19T05:17:22.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.715+0000 7ffa9d075640 1 -- 172.21.15.120:0/1926158538 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa9819d740 con 0x7ffa98102570 2024-09-19T05:17:22.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.715+0000 7ffa7ffff640 1 -- 172.21.15.120:0/1926158538 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c009e50 con 0x7ffa98102570 2024-09-19T05:17:22.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.715+0000 7ffa9d075640 1 -- 172.21.15.120:0/1926158538 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa981a5020 con 0x7ffa98102570 2024-09-19T05:17:22.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.716+0000 7ffa9d075640 1 -- 172.21.15.120:0/1926158538 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa98101200 con 0x7ffa98102570 2024-09-19T05:17:22.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.717+0000 7ffa7ffff640 1 -- 172.21.15.120:0/1926158538 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7ffa8c005020 con 0x7ffa98102570 2024-09-19T05:17:22.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.718+0000 7ffa7ffff640 1 --2- 172.21.15.120:0/1926158538 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7ffa800a33e0 0x7ffa800a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:22.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.718+0000 7ffa96d9d640 1 --2- 172.21.15.120:0/1926158538 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7ffa800a33e0 0x7ffa800a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:22.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.718+0000 7ffa7ffff640 1 -- 172.21.15.120:0/1926158538 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7ffa8c0cf110 con 0x7ffa98102570 2024-09-19T05:17:22.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.718+0000 7ffa96d9d640 1 --2- 172.21.15.120:0/1926158538 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7ffa800a33e0 0x7ffa800a58a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009d60 tx=0x7ffa88009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:22.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.722+0000 7ffa7ffff640 1 -- 172.21.15.120:0/1926158538 <== mon.2 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffa8c020020 con 0x7ffa98102570 2024-09-19T05:17:22.948 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.946+0000 7ffa9d075640 1 -- 172.21.15.120:0/1926158538 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa9810a0a0 con 0x7ffa98102570 2024-09-19T05:17:22.949 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.947+0000 7ffa7ffff640 1 -- 172.21.15.120:0/1926158538 <== mon.2 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10533 (secure 0 0 0) 0x7ffa8c09c270 con 0x7ffa98102570 2024-09-19T05:17:22.949 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:17:22.950 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":13,"btime":"2024-09-19T05:17:21:211434+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/93472898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":93472898},{"type":"v1","addr":"172.21.15.120:6835","nonce":93472898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1976835398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1976835398},{"type":"v1","addr":"172.21.15.120:6837","nonce":1976835398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6839/2975851469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":2975851469},{"type":"v1","addr":"172.21.15.120:6839","nonce":2975851469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6841/2837552754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":2837552754},{"type":"v1","addr":"172.21.15.120:6841","nonce":2837552754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/61682954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":61682954},{"type":"v1","addr":"172.21.15.178:6833","nonce":61682954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1778722040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1778722040},{"type":"v1","addr":"172.21.15.194:6833","nonce":1778722040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24401,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/890775592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":890775592},{"type":"v1","addr":"172.21.15.178:6835","nonce":890775592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24419,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3960720164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3960720164},{"type":"v1","addr":"172.21.15.178:6837","nonce":3960720164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24424,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/3268846994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3268846994},{"type":"v1","addr":"172.21.15.194:6835","nonce":3268846994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24430,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/378729335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":378729335},{"type":"v1","addr":"172.21.15.194:6837","nonce":378729335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24443,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6839/3389137566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3389137566},{"type":"v1","addr":"172.21.15.178:6839","nonce":3389137566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24445,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/3817420679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3817420679},{"type":"v1","addr":"172.21.15.194:6839","nonce":3817420679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T05:17:22.950 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 13 2024-09-19T05:17:22.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.949+0000 7ffa9d075640 1 -- 172.21.15.120:0/1926158538 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7ffa800a33e0 msgr2=0x7ffa800a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:22.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.949+0000 7ffa9d075640 1 --2- 172.21.15.120:0/1926158538 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7ffa800a33e0 0x7ffa800a58a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009d60 tx=0x7ffa88009110 comp rx=0 tx=0).stop 2024-09-19T05:17:22.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.949+0000 7ffa9d075640 1 -- 172.21.15.120:0/1926158538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa98102570 msgr2=0x7ffa981989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:22.952 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.949+0000 7ffa9d075640 1 --2- 172.21.15.120:0/1926158538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa98102570 0x7ffa981989e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00d720 tx=0x7ffa8c00db20 comp rx=0 tx=0).stop 2024-09-19T05:17:22.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.949+0000 7ffa9d075640 1 -- 172.21.15.120:0/1926158538 shutdown_connections 2024-09-19T05:17:22.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.949+0000 7ffa9d075640 1 --2- 172.21.15.120:0/1926158538 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa98102ef0 0x7ffa9819cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:22.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.949+0000 7ffa9d075640 1 --2- 172.21.15.120:0/1926158538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa98102570 0x7ffa981989e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:22.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.949+0000 7ffa9d075640 1 --2- 172.21.15.120:0/1926158538 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7ffa800a33e0 0x7ffa800a58a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:22.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.949+0000 7ffa9d075640 1 --2- 172.21.15.120:0/1926158538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa98100e20 0x7ffa981984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:22.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.949+0000 7ffa9d075640 1 -- 172.21.15.120:0/1926158538 >> 172.21.15.120:0/1926158538 conn(0x7ffa980fc7d0 msgr2=0x7ffa9806a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:22.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.949+0000 7ffa9d075640 1 -- 172.21.15.120:0/1926158538 shutdown_connections 2024-09-19T05:17:22.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:22.950+0000 7ffa9d075640 1 -- 172.21.15.120:0/1926158538 wait complete. 2024-09-19T05:17:23.556 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:23 smithi120 ceph-mon[30956]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:23.556 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:23 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:23.556 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:23 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:23.556 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:23 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:23.557 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:23 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:23.557 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:23 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1926158538' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:17:23.557 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:23 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:23.587 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T05:17:23.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:23 smithi194 ceph-mon[35228]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:23.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:23 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:23.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:23 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:23.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:23 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:23.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:23 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:23.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:23 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1926158538' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:17:23.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:23 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:23.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:23 smithi178 ceph-mon[34347]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:23.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:23 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:23.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:23 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:23.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:23 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:23.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:23 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:23.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:23 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1926158538' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:17:23.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:23 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:23.854 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:24.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.319+0000 7f0ec94f3640 1 -- 172.21.15.120:0/4037711102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ec41036e0 msgr2=0x7f0ec4107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:24.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.319+0000 7f0ec94f3640 1 --2- 172.21.15.120:0/4037711102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ec41036e0 0x7f0ec4107b90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009cd0 tx=0x7f0eb802a8e0 comp rx=0 tx=0).stop 2024-09-19T05:17:24.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.320+0000 7f0ec94f3640 1 -- 172.21.15.120:0/4037711102 shutdown_connections 2024-09-19T05:17:24.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.320+0000 7f0ec94f3640 1 --2- 172.21.15.120:0/4037711102 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ec41082a0 0x7f0ec410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:24.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.320+0000 7f0ec94f3640 1 --2- 172.21.15.120:0/4037711102 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ec41036e0 0x7f0ec4107b90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:24.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.320+0000 7f0ec94f3640 1 --2- 172.21.15.120:0/4037711102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ec4102d30 0x7f0ec4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:24.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.320+0000 7f0ec94f3640 1 -- 172.21.15.120:0/4037711102 >> 172.21.15.120:0/4037711102 conn(0x7f0ec40fc7d0 msgr2=0x7f0ec40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:24.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.320+0000 7f0ec94f3640 1 -- 172.21.15.120:0/4037711102 shutdown_connections 2024-09-19T05:17:24.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.320+0000 7f0ec94f3640 1 -- 172.21.15.120:0/4037711102 wait complete. 2024-09-19T05:17:24.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.320+0000 7f0ec94f3640 1 Processor -- start 2024-09-19T05:17:24.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.320+0000 7f0ec94f3640 1 -- start start 2024-09-19T05:17:24.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.320+0000 7f0ec94f3640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ec4102d30 0x7f0ec4198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:24.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.321+0000 7f0ec94f3640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ec41036e0 0x7f0ec4198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:24.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.321+0000 7f0ec94f3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ec41082a0 0x7f0ec419cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:24.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.321+0000 7f0ec94f3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec4111ff0 con 0x7f0ec41082a0 2024-09-19T05:17:24.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.321+0000 7f0ec94f3640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec4111e70 con 0x7f0ec41036e0 2024-09-19T05:17:24.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.321+0000 7f0ec94f3640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec4112170 con 0x7f0ec4102d30 2024-09-19T05:17:24.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.321+0000 7f0ec37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ec41082a0 0x7f0ec419cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:24.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.321+0000 7f0ec37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ec41082a0 0x7f0ec419cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46676/0 (socket says 172.21.15.120:46676) 2024-09-19T05:17:24.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.321+0000 7f0ec37fe640 1 -- 172.21.15.120:0/144928350 learned_addr learned my addr 172.21.15.120:0/144928350 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:24.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.321+0000 7f0ec2ffd640 1 --2- 172.21.15.120:0/144928350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ec4102d30 0x7f0ec4198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:24.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.321+0000 7f0ec27fc640 1 --2- 172.21.15.120:0/144928350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ec41036e0 0x7f0ec4198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:24.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.321+0000 7f0ec37fe640 1 -- 172.21.15.120:0/144928350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ec4102d30 msgr2=0x7f0ec4198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:24.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.321+0000 7f0ec37fe640 1 --2- 172.21.15.120:0/144928350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ec4102d30 0x7f0ec4198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:24.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.321+0000 7f0ec37fe640 1 -- 172.21.15.120:0/144928350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ec41036e0 msgr2=0x7f0ec4198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:24.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.321+0000 7f0ec37fe640 1 --2- 172.21.15.120:0/144928350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ec41036e0 0x7f0ec4198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:24.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.321+0000 7f0ec37fe640 1 -- 172.21.15.120:0/144928350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec419d610 con 0x7f0ec41082a0 2024-09-19T05:17:24.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.321+0000 7f0ec27fc640 1 --2- 172.21.15.120:0/144928350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ec41036e0 0x7f0ec4198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:17:24.353 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.321+0000 7f0ec37fe640 1 --2- 172.21.15.120:0/144928350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ec41082a0 0x7f0ec419cf30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009fd0 tx=0x7f0eb400b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:24.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.321+0000 7f0eabfff640 1 -- 172.21.15.120:0/144928350 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4015020 con 0x7f0ec41082a0 2024-09-19T05:17:24.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.321+0000 7f0ec94f3640 1 -- 172.21.15.120:0/144928350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ec419d900 con 0x7f0ec41082a0 2024-09-19T05:17:24.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.321+0000 7f0eabfff640 1 -- 172.21.15.120:0/144928350 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0eb4011ce0 con 0x7f0ec41082a0 2024-09-19T05:17:24.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.321+0000 7f0eabfff640 1 -- 172.21.15.120:0/144928350 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4010d70 con 0x7f0ec41082a0 2024-09-19T05:17:24.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.321+0000 7f0ec94f3640 1 -- 172.21.15.120:0/144928350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ec41a51e0 con 0x7f0ec41082a0 2024-09-19T05:17:24.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.322+0000 7f0ec94f3640 1 -- 172.21.15.120:0/144928350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ec4103190 con 0x7f0ec41082a0 2024-09-19T05:17:24.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.323+0000 7f0eabfff640 1 -- 172.21.15.120:0/144928350 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f0eb4018020 con 0x7f0ec41082a0 2024-09-19T05:17:24.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.324+0000 7f0eabfff640 1 --2- 172.21.15.120:0/144928350 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0eac0a3240 0x7f0eac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:24.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.324+0000 7f0ec2ffd640 1 --2- 172.21.15.120:0/144928350 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0eac0a3240 0x7f0eac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:24.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.324+0000 7f0eabfff640 1 -- 172.21.15.120:0/144928350 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f0eb40ced30 con 0x7f0ec41082a0 2024-09-19T05:17:24.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.324+0000 7f0ec2ffd640 1 --2- 172.21.15.120:0/144928350 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0eac0a3240 0x7f0eac0a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc009990 tx=0x7f0ebc009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:24.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.328+0000 7f0eabfff640 1 -- 172.21.15.120:0/144928350 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0eb401f020 con 0x7f0ec41082a0 2024-09-19T05:17:24.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.514+0000 7f0ec94f3640 1 -- 172.21.15.120:0/144928350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f0ec410a2b0 con 0x7f0ec41082a0 2024-09-19T05:17:24.516 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.514+0000 7f0eabfff640 1 -- 172.21.15.120:0/144928350 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) ==== 84+0+65 (secure 0 0 0) 0x7f0eb409bef0 con 0x7f0ec41082a0 2024-09-19T05:17:24.516 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:17:24.517 INFO:teuthology.orchestra.run.smithi120.stdout:[ 2024-09-19T05:17:24.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:17:24.517 INFO:teuthology.orchestra.run.smithi120.stdout: "poolnum": 1, 2024-09-19T05:17:24.517 INFO:teuthology.orchestra.run.smithi120.stdout: "poolname": ".mgr" 2024-09-19T05:17:24.517 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:17:24.517 INFO:teuthology.orchestra.run.smithi120.stdout:] 2024-09-19T05:17:24.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.517+0000 7f0ec94f3640 1 -- 172.21.15.120:0/144928350 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0eac0a3240 msgr2=0x7f0eac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:24.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.517+0000 7f0ec94f3640 1 --2- 172.21.15.120:0/144928350 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0eac0a3240 0x7f0eac0a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc009990 tx=0x7f0ebc009110 comp rx=0 tx=0).stop 2024-09-19T05:17:24.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.517+0000 7f0ec94f3640 1 -- 172.21.15.120:0/144928350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ec41082a0 msgr2=0x7f0ec419cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:24.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.517+0000 7f0ec94f3640 1 --2- 172.21.15.120:0/144928350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ec41082a0 0x7f0ec419cf30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009fd0 tx=0x7f0eb400b820 comp rx=0 tx=0).stop 2024-09-19T05:17:24.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.517+0000 7f0ec94f3640 1 -- 172.21.15.120:0/144928350 shutdown_connections 2024-09-19T05:17:24.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.517+0000 7f0ec94f3640 1 --2- 172.21.15.120:0/144928350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0ec41082a0 0x7f0ec419cf30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:24.519 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.517+0000 7f0ec94f3640 1 --2- 172.21.15.120:0/144928350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ec41036e0 0x7f0ec4198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:24.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.517+0000 7f0ec94f3640 1 --2- 172.21.15.120:0/144928350 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0eac0a3240 0x7f0eac0a5700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:24.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.517+0000 7f0ec94f3640 1 --2- 172.21.15.120:0/144928350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ec4102d30 0x7f0ec4198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:24.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.517+0000 7f0ec94f3640 1 -- 172.21.15.120:0/144928350 >> 172.21.15.120:0/144928350 conn(0x7f0ec40fc7d0 msgr2=0x7f0ec4105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:24.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.517+0000 7f0ec94f3640 1 -- 172.21.15.120:0/144928350 shutdown_connections 2024-09-19T05:17:24.520 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:24.517+0000 7f0ec94f3640 1 -- 172.21.15.120:0/144928350 wait complete. 2024-09-19T05:17:24.858 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:24 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:24.858 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:24 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:24.858 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:24 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:24.858 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:24 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:17:24.858 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:24 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:24.859 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:24 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:17:24.859 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:24 smithi120 ceph-mon[30956]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:24.859 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:24 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/144928350' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T05:17:24.909 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:24 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:24.909 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:24 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:24.910 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:24 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:24.910 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:24 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:17:24.910 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:24 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:24.910 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:24 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:17:24.910 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:24 smithi194 ceph-mon[35228]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:24.911 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:24 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/144928350' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T05:17:24.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:24 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:24.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:24 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:24.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:24 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:24.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:24 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:17:24.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:24 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:24.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:24 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:17:24.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:24 smithi178 ceph-mon[34347]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:24.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:24 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/144928350' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T05:17:25.477 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T05:17:25.477 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T05:17:25.922 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:26.339 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:26 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:26.340 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:26 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:26.340 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:26 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:26.340 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:26 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:26.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.424+0000 7fd7cb467640 1 -- 172.21.15.120:0/4114650587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7c410e430 msgr2=0x7fd7c4110820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:26.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.424+0000 7fd7cb467640 1 --2- 172.21.15.120:0/4114650587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7c410e430 0x7fd7c4110820 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc009ca0 tx=0x7fd7bc02a950 comp rx=0 tx=0).stop 2024-09-19T05:17:26.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.424+0000 7fd7cb467640 1 -- 172.21.15.120:0/4114650587 shutdown_connections 2024-09-19T05:17:26.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.424+0000 7fd7cb467640 1 --2- 172.21.15.120:0/4114650587 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7c410e430 0x7fd7c4110820 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:26.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.424+0000 7fd7cb467640 1 --2- 172.21.15.120:0/4114650587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7c4074ee0 0x7fd7c410def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:26.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.424+0000 7fd7cb467640 1 --2- 172.21.15.120:0/4114650587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7c40745c0 0x7fd7c40749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:26.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.424+0000 7fd7cb467640 1 -- 172.21.15.120:0/4114650587 >> 172.21.15.120:0/4114650587 conn(0x7fd7c40fd8f0 msgr2=0x7fd7c40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:26.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.425+0000 7fd7cb467640 1 -- 172.21.15.120:0/4114650587 shutdown_connections 2024-09-19T05:17:26.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.425+0000 7fd7cb467640 1 -- 172.21.15.120:0/4114650587 wait complete. 2024-09-19T05:17:26.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.425+0000 7fd7cb467640 1 Processor -- start 2024-09-19T05:17:26.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.425+0000 7fd7cb467640 1 -- start start 2024-09-19T05:17:26.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.425+0000 7fd7cb467640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7c40745c0 0x7fd7c419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:26.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.425+0000 7fd7cb467640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7c4074ee0 0x7fd7c419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:26.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.425+0000 7fd7cb467640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7c410e430 0x7fd7c419eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:26.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.425+0000 7fd7cb467640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c4114010 con 0x7fd7c40745c0 2024-09-19T05:17:26.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.425+0000 7fd7cb467640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c4113e90 con 0x7fd7c410e430 2024-09-19T05:17:26.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.425+0000 7fd7cb467640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c4114190 con 0x7fd7c4074ee0 2024-09-19T05:17:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.426+0000 7fd7c9203640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7c40745c0 0x7fd7c419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.426+0000 7fd7c9203640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7c40745c0 0x7fd7c419a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60220/0 (socket says 172.21.15.120:60220) 2024-09-19T05:17:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.426+0000 7fd7c9203640 1 -- 172.21.15.120:0/3194803505 learned_addr learned my addr 172.21.15.120:0/3194803505 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.426+0000 7fd7c8a02640 1 --2- 172.21.15.120:0/3194803505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7c4074ee0 0x7fd7c419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.426+0000 7fd7c9a04640 1 --2- 172.21.15.120:0/3194803505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7c410e430 0x7fd7c419eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.426+0000 7fd7c9203640 1 -- 172.21.15.120:0/3194803505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7c4074ee0 msgr2=0x7fd7c419ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.426+0000 7fd7c9203640 1 --2- 172.21.15.120:0/3194803505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7c4074ee0 0x7fd7c419ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.426+0000 7fd7c9203640 1 -- 172.21.15.120:0/3194803505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7c410e430 msgr2=0x7fd7c419eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.426+0000 7fd7c9203640 1 --2- 172.21.15.120:0/3194803505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7c410e430 0x7fd7c419eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.426+0000 7fd7c9203640 1 -- 172.21.15.120:0/3194803505 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c419f580 con 0x7fd7c40745c0 2024-09-19T05:17:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.426+0000 7fd7c9a04640 1 --2- 172.21.15.120:0/3194803505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7c410e430 0x7fd7c419eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:17:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.426+0000 7fd7c9203640 1 --2- 172.21.15.120:0/3194803505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7c40745c0 0x7fd7c419a5d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400d950 tx=0x7fd7b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.426+0000 7fd7ba7fc640 1 -- 172.21.15.120:0/3194803505 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b4017030 con 0x7fd7c40745c0 2024-09-19T05:17:26.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.426+0000 7fd7cb467640 1 -- 172.21.15.120:0/3194803505 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c419f870 con 0x7fd7c40745c0 2024-09-19T05:17:26.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.426+0000 7fd7ba7fc640 1 -- 172.21.15.120:0/3194803505 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd7b4004020 con 0x7fd7c40745c0 2024-09-19T05:17:26.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.426+0000 7fd7ba7fc640 1 -- 172.21.15.120:0/3194803505 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b40047a0 con 0x7fd7c40745c0 2024-09-19T05:17:26.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.426+0000 7fd7cb467640 1 -- 172.21.15.120:0/3194803505 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c41a7150 con 0x7fd7c40745c0 2024-09-19T05:17:26.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.428+0000 7fd7cb467640 1 -- 172.21.15.120:0/3194803505 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7c40749a0 con 0x7fd7c40745c0 2024-09-19T05:17:26.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.428+0000 7fd7ba7fc640 1 -- 172.21.15.120:0/3194803505 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fd7b40041d0 con 0x7fd7c40745c0 2024-09-19T05:17:26.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.429+0000 7fd7ba7fc640 1 --2- 172.21.15.120:0/3194803505 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd7b00a3240 0x7fd7b00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:26.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.429+0000 7fd7c8a02640 1 --2- 172.21.15.120:0/3194803505 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd7b00a3240 0x7fd7b00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:26.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.429+0000 7fd7ba7fc640 1 -- 172.21.15.120:0/3194803505 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fd7b40ce970 con 0x7fd7c40745c0 2024-09-19T05:17:26.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.430+0000 7fd7c8a02640 1 --2- 172.21.15.120:0/3194803505 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd7b00a3240 0x7fd7b00a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd7c410f8c0 tx=0x7fd7c0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:26.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.433+0000 7fd7ba7fc640 1 -- 172.21.15.120:0/3194803505 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd7b409bb30 con 0x7fd7c40745c0 2024-09-19T05:17:26.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:26 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:26.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:26 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:26.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:26 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:26.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:26 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:26.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:26 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:26.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:26 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:26.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:26 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:26.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:26 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:26.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:26.671+0000 7fd7cb467640 1 -- 172.21.15.120:0/3194803505 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd7c41095b0 con 0x7fd7c40745c0 2024-09-19T05:17:27.166 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:27.163+0000 7fd7ba7fc640 1 -- 172.21.15.120:0/3194803505 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) ==== 138+0+0 (secure 0 0 0) 0x7fd7b409b430 con 0x7fd7c40745c0 2024-09-19T05:17:27.166 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_metadata' created 2024-09-19T05:17:27.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:27.166+0000 7fd7cb467640 1 -- 172.21.15.120:0/3194803505 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd7b00a3240 msgr2=0x7fd7b00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:27.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:27.166+0000 7fd7cb467640 1 --2- 172.21.15.120:0/3194803505 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd7b00a3240 0x7fd7b00a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd7c410f8c0 tx=0x7fd7c0005f90 comp rx=0 tx=0).stop 2024-09-19T05:17:27.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:27.166+0000 7fd7cb467640 1 -- 172.21.15.120:0/3194803505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7c40745c0 msgr2=0x7fd7c419a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:27.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:27.166+0000 7fd7cb467640 1 --2- 172.21.15.120:0/3194803505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7c40745c0 0x7fd7c419a5d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400d950 tx=0x7fd7b400de10 comp rx=0 tx=0).stop 2024-09-19T05:17:27.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:27.166+0000 7fd7cb467640 1 -- 172.21.15.120:0/3194803505 shutdown_connections 2024-09-19T05:17:27.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:27.166+0000 7fd7cb467640 1 --2- 172.21.15.120:0/3194803505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7c410e430 0x7fd7c419eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:27.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:27.166+0000 7fd7cb467640 1 --2- 172.21.15.120:0/3194803505 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd7b00a3240 0x7fd7b00a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:27.168 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:27.166+0000 7fd7cb467640 1 --2- 172.21.15.120:0/3194803505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7c4074ee0 0x7fd7c419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:27.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:27.166+0000 7fd7cb467640 1 --2- 172.21.15.120:0/3194803505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd7c40745c0 0x7fd7c419a5d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:27.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:27.166+0000 7fd7cb467640 1 -- 172.21.15.120:0/3194803505 >> 172.21.15.120:0/3194803505 conn(0x7fd7c40fd8f0 msgr2=0x7fd7c40fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:27.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:27.166+0000 7fd7cb467640 1 -- 172.21.15.120:0/3194803505 shutdown_connections 2024-09-19T05:17:27.169 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:27.166+0000 7fd7cb467640 1 -- 172.21.15.120:0/3194803505 wait complete. 2024-09-19T05:17:27.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:27 smithi178 ceph-mon[34347]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:27.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:27 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/3194803505' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T05:17:27.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:27 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:27.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:27 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:27.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:27 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:27.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:27 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:17:27.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:27 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:27.476 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:27 smithi120 ceph-mon[30956]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:27.476 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:27 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/3194803505' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T05:17:27.476 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:27 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:27.476 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:27 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:27.476 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:27 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:27.476 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:27 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:17:27.476 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:27 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:27.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:27 smithi194 ceph-mon[35228]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:27.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:27 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/3194803505' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T05:17:27.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:27 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:27.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:27 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:27.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:27 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:17:27.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:27 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:17:27.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:27 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:17:27.956 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T05:17:28.212 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:28.332 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:28 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/3194803505' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T05:17:28.333 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:28 smithi120 ceph-mon[30956]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T05:17:28.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:28 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/3194803505' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T05:17:28.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:28 smithi178 ceph-mon[34347]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T05:17:28.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:28 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/3194803505' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T05:17:28.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:28 smithi194 ceph-mon[35228]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T05:17:28.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.701+0000 7ff849190640 1 -- 172.21.15.120:0/3590154052 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff844100e20 msgr2=0x7ff844101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:28.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.701+0000 7ff849190640 1 --2- 172.21.15.120:0/3590154052 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff844100e20 0x7ff844101200 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff834009900 tx=0x7ff83402a480 comp rx=0 tx=0).stop 2024-09-19T05:17:28.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.701+0000 7ff849190640 1 -- 172.21.15.120:0/3590154052 shutdown_connections 2024-09-19T05:17:28.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.701+0000 7ff849190640 1 --2- 172.21.15.120:0/3590154052 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff844102ef0 0x7ff84410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:28.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.701+0000 7ff849190640 1 --2- 172.21.15.120:0/3590154052 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff844102570 0x7ff8441029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:28.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.701+0000 7ff849190640 1 --2- 172.21.15.120:0/3590154052 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff844100e20 0x7ff844101200 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:28.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.701+0000 7ff849190640 1 -- 172.21.15.120:0/3590154052 >> 172.21.15.120:0/3590154052 conn(0x7ff8440fc7d0 msgr2=0x7ff8440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:28.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.701+0000 7ff849190640 1 -- 172.21.15.120:0/3590154052 shutdown_connections 2024-09-19T05:17:28.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.701+0000 7ff849190640 1 -- 172.21.15.120:0/3590154052 wait complete. 2024-09-19T05:17:28.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.701+0000 7ff849190640 1 Processor -- start 2024-09-19T05:17:28.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.702+0000 7ff849190640 1 -- start start 2024-09-19T05:17:28.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.702+0000 7ff849190640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff844100e20 0x7ff8441972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:28.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.702+0000 7ff849190640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff844102570 0x7ff844197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:28.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.702+0000 7ff849190640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff844102ef0 0x7ff84419bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:28.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.702+0000 7ff849190640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff844110e30 con 0x7ff844100e20 2024-09-19T05:17:28.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.702+0000 7ff849190640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff844110cb0 con 0x7ff844102570 2024-09-19T05:17:28.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.702+0000 7ff849190640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff844110fb0 con 0x7ff844102ef0 2024-09-19T05:17:28.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.702+0000 7ff842d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff844100e20 0x7ff8441972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:28.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.702+0000 7ff842d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff844100e20 0x7ff8441972d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60244/0 (socket says 172.21.15.120:60244) 2024-09-19T05:17:28.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.702+0000 7ff842d9d640 1 -- 172.21.15.120:0/314437784 learned_addr learned my addr 172.21.15.120:0/314437784 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:28.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.702+0000 7ff84259c640 1 --2- 172.21.15.120:0/314437784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff844102570 0x7ff844197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:28.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.702+0000 7ff84359e640 1 --2- 172.21.15.120:0/314437784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff844102ef0 0x7ff84419bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:28.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.702+0000 7ff842d9d640 1 -- 172.21.15.120:0/314437784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff844102ef0 msgr2=0x7ff84419bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:28.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.702+0000 7ff842d9d640 1 --2- 172.21.15.120:0/314437784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff844102ef0 0x7ff84419bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:28.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.702+0000 7ff842d9d640 1 -- 172.21.15.120:0/314437784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff844102570 msgr2=0x7ff844197810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:28.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.702+0000 7ff842d9d640 1 --2- 172.21.15.120:0/314437784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff844102570 0x7ff844197810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:28.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.702+0000 7ff842d9d640 1 -- 172.21.15.120:0/314437784 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84419c280 con 0x7ff844100e20 2024-09-19T05:17:28.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.703+0000 7ff842d9d640 1 --2- 172.21.15.120:0/314437784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff844100e20 0x7ff8441972d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff834006010 tx=0x7ff8340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:28.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.703+0000 7ff82bfff640 1 -- 172.21.15.120:0/314437784 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83403f030 con 0x7ff844100e20 2024-09-19T05:17:28.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.703+0000 7ff849190640 1 -- 172.21.15.120:0/314437784 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff84419c510 con 0x7ff844100e20 2024-09-19T05:17:28.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.703+0000 7ff82bfff640 1 -- 172.21.15.120:0/314437784 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff834003cb0 con 0x7ff844100e20 2024-09-19T05:17:28.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.703+0000 7ff82bfff640 1 -- 172.21.15.120:0/314437784 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff834035070 con 0x7ff844100e20 2024-09-19T05:17:28.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.703+0000 7ff849190640 1 -- 172.21.15.120:0/314437784 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8441a3e50 con 0x7ff844100e20 2024-09-19T05:17:28.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.704+0000 7ff849190640 1 -- 172.21.15.120:0/314437784 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8441021b0 con 0x7ff844100e20 2024-09-19T05:17:28.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.705+0000 7ff82bfff640 1 -- 172.21.15.120:0/314437784 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7ff834042030 con 0x7ff844100e20 2024-09-19T05:17:28.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.706+0000 7ff82bfff640 1 --2- 172.21.15.120:0/314437784 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7ff82c0a3240 0x7ff82c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:28.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.706+0000 7ff82bfff640 1 -- 172.21.15.120:0/314437784 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7497+0+0 (secure 0 0 0) 0x7ff8340efc80 con 0x7ff844100e20 2024-09-19T05:17:28.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.706+0000 7ff84259c640 1 --2- 172.21.15.120:0/314437784 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7ff82c0a3240 0x7ff82c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:28.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.706+0000 7ff84259c640 1 --2- 172.21.15.120:0/314437784 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7ff82c0a3240 0x7ff82c0a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff8440ffe50 tx=0x7ff83800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:28.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.709+0000 7ff82bfff640 1 -- 172.21.15.120:0/314437784 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff8340bc680 con 0x7ff844100e20 2024-09-19T05:17:28.879 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:28.877+0000 7ff849190640 1 -- 172.21.15.120:0/314437784 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff844101200 con 0x7ff844100e20 2024-09-19T05:17:29.181 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:29.179+0000 7ff82bfff640 1 -- 172.21.15.120:0/314437784 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v78) ==== 170+0+0 (secure 0 0 0) 0x7ff844101200 con 0x7ff844100e20 2024-09-19T05:17:29.181 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_data' created 2024-09-19T05:17:29.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:29.181+0000 7ff849190640 1 -- 172.21.15.120:0/314437784 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7ff82c0a3240 msgr2=0x7ff82c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:29.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:29.181+0000 7ff849190640 1 --2- 172.21.15.120:0/314437784 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7ff82c0a3240 0x7ff82c0a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff8440ffe50 tx=0x7ff83800b390 comp rx=0 tx=0).stop 2024-09-19T05:17:29.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:29.181+0000 7ff849190640 1 -- 172.21.15.120:0/314437784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff844100e20 msgr2=0x7ff8441972d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:29.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:29.181+0000 7ff849190640 1 --2- 172.21.15.120:0/314437784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff844100e20 0x7ff8441972d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff834006010 tx=0x7ff8340042f0 comp rx=0 tx=0).stop 2024-09-19T05:17:29.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:29.182+0000 7ff849190640 1 -- 172.21.15.120:0/314437784 shutdown_connections 2024-09-19T05:17:29.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:29.182+0000 7ff849190640 1 --2- 172.21.15.120:0/314437784 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7ff82c0a3240 0x7ff82c0a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:29.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:29.182+0000 7ff849190640 1 --2- 172.21.15.120:0/314437784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff844102ef0 0x7ff84419bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:29.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:29.182+0000 7ff849190640 1 --2- 172.21.15.120:0/314437784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff844102570 0x7ff844197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:29.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:29.182+0000 7ff849190640 1 --2- 172.21.15.120:0/314437784 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff844100e20 0x7ff8441972d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:29.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:29.182+0000 7ff849190640 1 -- 172.21.15.120:0/314437784 >> 172.21.15.120:0/314437784 conn(0x7ff8440fc7d0 msgr2=0x7ff8440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:29.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:29.182+0000 7ff849190640 1 -- 172.21.15.120:0/314437784 shutdown_connections 2024-09-19T05:17:29.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:29.183+0000 7ff849190640 1 -- 172.21.15.120:0/314437784 wait complete. 2024-09-19T05:17:29.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:29 smithi178 ceph-mon[34347]: pgmap v266: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:29.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:29 smithi178 ceph-mon[34347]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T05:17:29.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:29 smithi178 ceph-mon[34347]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T05:17:29.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:29 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/314437784' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T05:17:29.493 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:29 smithi120 ceph-mon[30956]: pgmap v266: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:29.493 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:29 smithi120 ceph-mon[30956]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T05:17:29.493 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:29 smithi120 ceph-mon[30956]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T05:17:29.493 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:29 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/314437784' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T05:17:29.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:29 smithi194 ceph-mon[35228]: pgmap v266: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:29.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:29 smithi194 ceph-mon[35228]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T05:17:29.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:29 smithi194 ceph-mon[35228]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T05:17:29.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:29 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/314437784' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T05:17:29.838 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T05:17:30.085 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:30.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:30 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/314437784' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T05:17:30.445 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:30 smithi178 ceph-mon[34347]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T05:17:30.505 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:30 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/314437784' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T05:17:30.506 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:30 smithi120 ceph-mon[30956]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T05:17:30.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.586+0000 7fa29ffca640 1 -- 172.21.15.120:0/4173269141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa298102790 msgr2=0x7fa2981067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:30.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.586+0000 7fa29ffca640 1 --2- 172.21.15.120:0/4173269141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa298102790 0x7fa2981067e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa288009900 tx=0x7fa28802a410 comp rx=0 tx=0).stop 2024-09-19T05:17:30.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.586+0000 7fa29ffca640 1 -- 172.21.15.120:0/4173269141 shutdown_connections 2024-09-19T05:17:30.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.586+0000 7fa29ffca640 1 --2- 172.21.15.120:0/4173269141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa298106f10 0x7fa29810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:30.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.586+0000 7fa29ffca640 1 --2- 172.21.15.120:0/4173269141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa298102790 0x7fa2981067e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:30.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.586+0000 7fa29ffca640 1 --2- 172.21.15.120:0/4173269141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa298101de0 0x7fa2981021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:30.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.586+0000 7fa29ffca640 1 -- 172.21.15.120:0/4173269141 >> 172.21.15.120:0/4173269141 conn(0x7fa2980fd8c0 msgr2=0x7fa2980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:30.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.586+0000 7fa29ffca640 1 -- 172.21.15.120:0/4173269141 shutdown_connections 2024-09-19T05:17:30.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.586+0000 7fa29ffca640 1 -- 172.21.15.120:0/4173269141 wait complete. 2024-09-19T05:17:30.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.587+0000 7fa29ffca640 1 Processor -- start 2024-09-19T05:17:30.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.587+0000 7fa29ffca640 1 -- start start 2024-09-19T05:17:30.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.587+0000 7fa29ffca640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa298101de0 0x7fa298198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:30.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.587+0000 7fa29ffca640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa298102790 0x7fa298198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:30.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.587+0000 7fa29ffca640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa298106f10 0x7fa29819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:30.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.587+0000 7fa29ffca640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa298111e40 con 0x7fa298106f10 2024-09-19T05:17:30.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.587+0000 7fa29ffca640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa298111cc0 con 0x7fa298101de0 2024-09-19T05:17:30.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.587+0000 7fa29ffca640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa298111fc0 con 0x7fa298102790 2024-09-19T05:17:30.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.587+0000 7fa29e567640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa298106f10 0x7fa29819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:30.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.587+0000 7fa29e567640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa298106f10 0x7fa29819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60252/0 (socket says 172.21.15.120:60252) 2024-09-19T05:17:30.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.587+0000 7fa29e567640 1 -- 172.21.15.120:0/3966513915 learned_addr learned my addr 172.21.15.120:0/3966513915 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:30.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.587+0000 7fa29d565640 1 --2- 172.21.15.120:0/3966513915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa298102790 0x7fa298198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:30.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.587+0000 7fa29dd66640 1 --2- 172.21.15.120:0/3966513915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa298101de0 0x7fa298198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:30.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.587+0000 7fa29e567640 1 -- 172.21.15.120:0/3966513915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa298102790 msgr2=0x7fa298198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:30.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.587+0000 7fa29e567640 1 --2- 172.21.15.120:0/3966513915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa298102790 0x7fa298198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:30.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.587+0000 7fa29e567640 1 -- 172.21.15.120:0/3966513915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa298101de0 msgr2=0x7fa298198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:30.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.587+0000 7fa29e567640 1 --2- 172.21.15.120:0/3966513915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa298101de0 0x7fa298198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:30.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.587+0000 7fa29e567640 1 -- 172.21.15.120:0/3966513915 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa29819d3f0 con 0x7fa298106f10 2024-09-19T05:17:30.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.588+0000 7fa29e567640 1 --2- 172.21.15.120:0/3966513915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa298106f10 0x7fa29819cd10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa29000cad0 tx=0x7fa29000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:30.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.588+0000 7fa28effd640 1 -- 172.21.15.120:0/3966513915 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29000ad60 con 0x7fa298106f10 2024-09-19T05:17:30.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.588+0000 7fa28effd640 1 -- 172.21.15.120:0/3966513915 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa290005020 con 0x7fa298106f10 2024-09-19T05:17:30.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.588+0000 7fa28effd640 1 -- 172.21.15.120:0/3966513915 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29000f6b0 con 0x7fa298106f10 2024-09-19T05:17:30.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.588+0000 7fa29ffca640 1 -- 172.21.15.120:0/3966513915 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa29819d6e0 con 0x7fa298106f10 2024-09-19T05:17:30.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.588+0000 7fa29ffca640 1 -- 172.21.15.120:0/3966513915 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2981a4fc0 con 0x7fa298106f10 2024-09-19T05:17:30.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.589+0000 7fa29ffca640 1 -- 172.21.15.120:0/3966513915 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2981021c0 con 0x7fa298106f10 2024-09-19T05:17:30.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.590+0000 7fa28effd640 1 -- 172.21.15.120:0/3966513915 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fa2900051d0 con 0x7fa298106f10 2024-09-19T05:17:30.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.591+0000 7fa28effd640 1 --2- 172.21.15.120:0/3966513915 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa2840a3240 0x7fa2840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:30.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.591+0000 7fa29dd66640 1 --2- 172.21.15.120:0/3966513915 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa2840a3240 0x7fa2840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:30.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.591+0000 7fa28effd640 1 -- 172.21.15.120:0/3966513915 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7879+0+0 (secure 0 0 0) 0x7fa2900cfa90 con 0x7fa298106f10 2024-09-19T05:17:30.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.591+0000 7fa29dd66640 1 --2- 172.21.15.120:0/3966513915 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa2840a3240 0x7fa2840a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa294009990 tx=0x7fa294009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:30.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.594+0000 7fa28effd640 1 -- 172.21.15.120:0/3966513915 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa290014030 con 0x7fa298106f10 2024-09-19T05:17:30.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:30 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/314437784' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T05:17:30.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:30 smithi194 ceph-mon[35228]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T05:17:30.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:30.794+0000 7fa29ffca640 1 -- 172.21.15.120:0/3966513915 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa2981997a0 con 0x7fa298106f10 2024-09-19T05:17:31.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:31.186+0000 7fa28effd640 1 -- 172.21.15.120:0/3966513915 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fa2981997a0 con 0x7fa298106f10 2024-09-19T05:17:31.188 INFO:teuthology.orchestra.run.smithi120.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T05:17:31.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:31.188+0000 7fa29ffca640 1 -- 172.21.15.120:0/3966513915 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa2840a3240 msgr2=0x7fa2840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:31.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:31.188+0000 7fa29ffca640 1 --2- 172.21.15.120:0/3966513915 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa2840a3240 0x7fa2840a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa294009990 tx=0x7fa294009110 comp rx=0 tx=0).stop 2024-09-19T05:17:31.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:31.188+0000 7fa29ffca640 1 -- 172.21.15.120:0/3966513915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa298106f10 msgr2=0x7fa29819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:31.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:31.188+0000 7fa29ffca640 1 --2- 172.21.15.120:0/3966513915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa298106f10 0x7fa29819cd10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa29000cad0 tx=0x7fa29000ced0 comp rx=0 tx=0).stop 2024-09-19T05:17:31.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:31.189+0000 7fa29ffca640 1 -- 172.21.15.120:0/3966513915 shutdown_connections 2024-09-19T05:17:31.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:31.189+0000 7fa29ffca640 1 --2- 172.21.15.120:0/3966513915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa298106f10 0x7fa29819cd10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:31.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:31.189+0000 7fa29ffca640 1 --2- 172.21.15.120:0/3966513915 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa2840a3240 0x7fa2840a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:31.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:31.189+0000 7fa29ffca640 1 --2- 172.21.15.120:0/3966513915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa298102790 0x7fa298198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:31.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:31.189+0000 7fa29ffca640 1 --2- 172.21.15.120:0/3966513915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa298101de0 0x7fa298198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:31.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:31.189+0000 7fa29ffca640 1 -- 172.21.15.120:0/3966513915 >> 172.21.15.120:0/3966513915 conn(0x7fa2980fd8c0 msgr2=0x7fa2980fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:31.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:31.189+0000 7fa29ffca640 1 -- 172.21.15.120:0/3966513915 shutdown_connections 2024-09-19T05:17:31.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:31.189+0000 7fa29ffca640 1 -- 172.21.15.120:0/3966513915 wait complete. 2024-09-19T05:17:31.543 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:31 smithi120 ceph-mon[30956]: pgmap v269: 97 pgs: 11 creating+peering, 1 creating+activating, 73 unknown, 12 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:31.543 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:31 smithi120 ceph-mon[30956]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T05:17:31.543 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:31 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/3966513915' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T05:17:31.543 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:31 smithi120 ceph-mon[30956]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-19T05:17:31.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:31 smithi194 ceph-mon[35228]: pgmap v269: 97 pgs: 11 creating+peering, 1 creating+activating, 73 unknown, 12 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:31.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:31 smithi194 ceph-mon[35228]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T05:17:31.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:31 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/3966513915' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T05:17:31.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:31 smithi194 ceph-mon[35228]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-19T05:17:31.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:31 smithi178 ceph-mon[34347]: pgmap v269: 97 pgs: 11 creating+peering, 1 creating+activating, 73 unknown, 12 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:17:31.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:31 smithi178 ceph-mon[34347]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T05:17:31.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:31 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/3966513915' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T05:17:31.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:31 smithi178 ceph-mon[34347]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-19T05:17:31.897 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T05:17:32.143 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:32.506 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:32 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/3966513915' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T05:17:32.506 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:32 smithi120 ceph-mon[30956]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T05:17:32.507 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:32 smithi120 ceph-mon[30956]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-19T05:17:32.507 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:32 smithi120 ceph-mon[30956]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-19T05:17:32.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.584+0000 7f86f14e2640 1 -- 172.21.15.120:0/3922351143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86ec102570 msgr2=0x7f86ec1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:32.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.584+0000 7f86f14e2640 1 --2- 172.21.15.120:0/3922351143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86ec102570 0x7f86ec1029b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f86e0009900 tx=0x7f86e002a480 comp rx=0 tx=0).stop 2024-09-19T05:17:32.589 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.584+0000 7f86f14e2640 1 -- 172.21.15.120:0/3922351143 shutdown_connections 2024-09-19T05:17:32.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.584+0000 7f86f14e2640 1 --2- 172.21.15.120:0/3922351143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86ec102ef0 0x7f86ec10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:32.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.584+0000 7f86f14e2640 1 --2- 172.21.15.120:0/3922351143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86ec102570 0x7f86ec1029b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:32.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.584+0000 7f86f14e2640 1 --2- 172.21.15.120:0/3922351143 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86ec100e20 0x7f86ec101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:32.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.584+0000 7f86f14e2640 1 -- 172.21.15.120:0/3922351143 >> 172.21.15.120:0/3922351143 conn(0x7f86ec0fc7d0 msgr2=0x7f86ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:32.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.584+0000 7f86f14e2640 1 -- 172.21.15.120:0/3922351143 shutdown_connections 2024-09-19T05:17:32.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.584+0000 7f86f14e2640 1 -- 172.21.15.120:0/3922351143 wait complete. 2024-09-19T05:17:32.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.585+0000 7f86f14e2640 1 Processor -- start 2024-09-19T05:17:32.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.585+0000 7f86f14e2640 1 -- start start 2024-09-19T05:17:32.590 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.585+0000 7f86f14e2640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86ec100e20 0x7f86ec199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:32.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.585+0000 7f86f14e2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86ec102570 0x7f86ec1997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:32.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.585+0000 7f86f14e2640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86ec102ef0 0x7f86ec1a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:32.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.585+0000 7f86f14e2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec110e30 con 0x7f86ec102570 2024-09-19T05:17:32.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.585+0000 7f86f14e2640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec110cb0 con 0x7f86ec100e20 2024-09-19T05:17:32.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.585+0000 7f86f14e2640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec110fb0 con 0x7f86ec102ef0 2024-09-19T05:17:32.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.585+0000 7f86ea7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86ec102570 0x7f86ec1997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:32.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.586+0000 7f86ea7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86ec102570 0x7f86ec1997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60268/0 (socket says 172.21.15.120:60268) 2024-09-19T05:17:32.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.586+0000 7f86ea7fc640 1 -- 172.21.15.120:0/169407884 learned_addr learned my addr 172.21.15.120:0/169407884 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:32.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.586+0000 7f86eaffd640 1 --2- 172.21.15.120:0/169407884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86ec100e20 0x7f86ec199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:32.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.586+0000 7f86eb7fe640 1 --2- 172.21.15.120:0/169407884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86ec102ef0 0x7f86ec1a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:32.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.586+0000 7f86ea7fc640 1 -- 172.21.15.120:0/169407884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86ec102ef0 msgr2=0x7f86ec1a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:32.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.586+0000 7f86ea7fc640 1 --2- 172.21.15.120:0/169407884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86ec102ef0 0x7f86ec1a4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:32.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.586+0000 7f86ea7fc640 1 -- 172.21.15.120:0/169407884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86ec100e20 msgr2=0x7f86ec199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:32.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.586+0000 7f86ea7fc640 1 --2- 172.21.15.120:0/169407884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86ec100e20 0x7f86ec199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:32.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.586+0000 7f86ea7fc640 1 -- 172.21.15.120:0/169407884 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86ec1a4840 con 0x7f86ec102570 2024-09-19T05:17:32.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.586+0000 7f86eb7fe640 1 --2- 172.21.15.120:0/169407884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86ec102ef0 0x7f86ec1a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:17:32.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.586+0000 7f86eaffd640 1 --2- 172.21.15.120:0/169407884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86ec100e20 0x7f86ec199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:17:32.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.586+0000 7f86ea7fc640 1 --2- 172.21.15.120:0/169407884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86ec102570 0x7f86ec1997c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f86e0006010 tx=0x7f86e00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:32.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.586+0000 7f86d3fff640 1 -- 172.21.15.120:0/169407884 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e003f030 con 0x7f86ec102570 2024-09-19T05:17:32.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.586+0000 7f86d3fff640 1 -- 172.21.15.120:0/169407884 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f86e0003cb0 con 0x7f86ec102570 2024-09-19T05:17:32.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.586+0000 7f86f14e2640 1 -- 172.21.15.120:0/169407884 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86ec1a4a10 con 0x7f86ec102570 2024-09-19T05:17:32.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.586+0000 7f86d3fff640 1 -- 172.21.15.120:0/169407884 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e0035070 con 0x7f86ec102570 2024-09-19T05:17:32.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.586+0000 7f86f14e2640 1 -- 172.21.15.120:0/169407884 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86ec1a4e60 con 0x7f86ec102570 2024-09-19T05:17:32.593 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.587+0000 7f86f14e2640 1 -- 172.21.15.120:0/169407884 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86ec101200 con 0x7f86ec102570 2024-09-19T05:17:32.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.588+0000 7f86d3fff640 1 -- 172.21.15.120:0/169407884 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f86e0042030 con 0x7f86ec102570 2024-09-19T05:17:32.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.589+0000 7f86d3fff640 1 --2- 172.21.15.120:0/169407884 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f86d40a3240 0x7f86d40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:32.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.589+0000 7f86eaffd640 1 --2- 172.21.15.120:0/169407884 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f86d40a3240 0x7f86d40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:32.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.589+0000 7f86d3fff640 1 -- 172.21.15.120:0/169407884 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f86e00f0040 con 0x7f86ec102570 2024-09-19T05:17:32.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.589+0000 7f86eaffd640 1 --2- 172.21.15.120:0/169407884 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f86d40a3240 0x7f86d40a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f86dc005fd0 tx=0x7f86dc009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:32.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.592+0000 7f86d3fff640 1 -- 172.21.15.120:0/169407884 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f86e00bceb0 con 0x7f86ec102570 2024-09-19T05:17:32.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:32 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/3966513915' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T05:17:32.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:32 smithi194 ceph-mon[35228]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T05:17:32.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:32 smithi194 ceph-mon[35228]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-19T05:17:32.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:32 smithi194 ceph-mon[35228]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-19T05:17:32.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:32 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/3966513915' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T05:17:32.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:32 smithi178 ceph-mon[34347]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T05:17:32.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:32 smithi178 ceph-mon[34347]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-19T05:17:32.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:32 smithi178 ceph-mon[34347]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-19T05:17:32.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.759+0000 7f86f14e2640 1 -- 172.21.15.120:0/169407884 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f86ec1090c0 con 0x7f86ec102570 2024-09-19T05:17:32.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.761+0000 7f86d3fff640 1 -- 172.21.15.120:0/169407884 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22334 (secure 0 0 0) 0x7f86e00bc7b0 con 0x7f86ec102570 2024-09-19T05:17:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:17:32.763 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":80,"fsid":"4e6e3df4-7645-11ef-bceb-c7b262605968","created":"2024-09-19T05:09:55.847220+0000","modified":"2024-09-19T05:17:30.795992+0000","last_up_change":"2024-09-19T05:16:42.808178+0000","last_in_change":"2024-09-19T05:16:18.315940+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:13:02.340027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:17:26.914416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:17:29.112997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"18907a03-1f43-419a-acb6-9fa4cf5020d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6803","nonce":3421474326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6805","nonce":3421474326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6809","nonce":3421474326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6807","nonce":3421474326}]},"public_addr":"172.21.15.120:6803/3421474326","cluster_addr":"172.21.15.120:6805/3421474326","heartbeat_back_addr":"172.21.15.120:6809/3421474326","heartbeat_front_addr":"172.21.15.120:6807/3421474326","state":["exists","up"]},{"osd":1,"uuid":"d21e029b-8a60-43f9-9ba7-30cdba19ba57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6801","nonce":1195511218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6803","nonce":1195511218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6807","nonce":1195511218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6805","nonce":1195511218}]},"public_addr":"172.21.15.178:6801/1195511218","cluster_addr":"172.21.15.178:6803/1195511218","heartbeat_back_addr":"172.21.15.178:6807/1195511218","heartbeat_front_addr":"172.21.15.178:6805/1195511218","state":["exists","up"]},{"osd":2,"uuid":"26ad9c8d-dbaa-46c2-a346-19717d81cc60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6801","nonce":3752826560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6803","nonce":3752826560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6807","nonce":3752826560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6805","nonce":3752826560}]},"public_addr":"172.21.15.194:6801/3752826560","cluster_addr":"172.21.15.194:6803/3752826560","heartbeat_back_addr":"172.21.15.194:6807/3752826560","heartbeat_front_addr":"172.21.15.194:6805/3752826560","state":["exists","up"]},{"osd":3,"uuid":"7e266576-8a98-40a8-9532-4b6f4611a908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6811","nonce":803566783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6813","nonce":803566783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6817","nonce":803566783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6815","nonce":803566783}]},"public_addr":"172.21.15.120:6811/803566783","cluster_addr":"172.21.15.120:6813/803566783","heartbeat_back_addr":"172.21.15.120:6817/803566783","heartbeat_front_addr":"172.21.15.120:6815/803566783","state":["exists","up"]},{"osd":4,"uuid":"c77d05c5-3b8f-4f7b-91f9-833735221684","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6809","nonce":541165323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6811","nonce":541165323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6815","nonce":541165323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6813","nonce":541165323}]},"public_addr":"172.21.15.178:6809/541165323","cluster_addr":"172.21.15.178:6811/541165323","heartbeat_back_addr":"172.21.15.178:6815/541165323","heartbeat_front_addr":"172.21.15.178:6813/541165323","state":["exists","up"]},{"osd":5,"uuid":"5f1c394b-e510-411f-969a-2db2b68cf41a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6809","nonce":2631415468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6811","nonce":2631415468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6815","nonce":2631415468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6813","nonce":2631415468}]},"public_addr":"172.21.15.194:6809/2631415468","cluster_addr":"172.21.15.194:6811/2631415468","heartbeat_back_addr":"172.21.15.194:6815/2631415468","heartbeat_front_addr":"172.21.15.194:6813/2631415468","state":["exists","up"]},{"osd":6,"uuid":"990af639-099e-49df-a083-05626cee3c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6819","nonce":388238976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6821","nonce":388238976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6825","nonce":388238976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6823","nonce":388238976}]},"public_addr":"172.21.15.120:6819/388238976","cluster_addr":"172.21.15.120:6821/388238976","heartbeat_back_addr":"172.21.15.120:6825/388238976","heartbeat_front_addr":"172.21.15.120:6823/388238976","state":["exists","up"]},{"osd":7,"uuid":"6f4aa6ab-b5f4-4c06-9f14-9a51bc195ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6817","nonce":1912109177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6819","nonce":1912109177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6823","nonce":1912109177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6821","nonce":1912109177}]},"public_addr":"172.21.15.178:6817/1912109177","cluster_addr":"172.21.15.178:6819/1912109177","heartbeat_back_addr":"172.21.15.178:6823/1912109177","heartbeat_front_addr":"172.21.15.178:6821/1912109177","state":["exists","up"]},{"osd":8,"uuid":"707739c9-732a-405c-847a-ce6a06e611b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6817","nonce":596878172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6819","nonce":596878172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6823","nonce":596878172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6821","nonce":596878172}]},"public_addr":"172.21.15.194:6817/596878172","cluster_addr":"172.21.15.194:6819/596878172","heartbeat_back_addr":"172.21.15.194:6823/596878172","heartbeat_front_addr":"172.21.15.194:6821/596878172","state":["exists","up"]},{"osd":9,"uuid":"9393b018-c924-4d75-99e5-25433d276567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6827","nonce":3257373801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6829","nonce":3257373801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6833","nonce":3257373801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6831","nonce":3257373801}]},"public_addr":"172.21.15.120:6827/3257373801","cluster_addr":"172.21.15.120:6829/3257373801","heartbeat_back_addr":"172.21.15.120:6833/3257373801","heartbeat_front_addr":"172.21.15.120:6831/3257373801","state":["exists","up"]},{"osd":10,"uuid":"45db7f62-87a6-4b2b-a3dc-012e2de505e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6825","nonce":3067822030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6827","nonce":3067822030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6831","nonce":3067822030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6829","nonce":3067822030}]},"public_addr":"172.21.15.178:6825/3067822030","cluster_addr":"172.21.15.178:6827/3067822030","heartbeat_back_addr":"172.21.15.178:6831/3067822030","heartbeat_front_addr":"172.21.15.178:6829/3067822030","state":["exists","up"]},{"osd":11,"uuid":"85ea248c-9a36-41cb-a200-87138fb31602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6825","nonce":2713146974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6827","nonce":2713146974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6831","nonce":2713146974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6829","nonce":2713146974}]},"public_addr":"172.21.15.194:6825/2713146974","cluster_addr":"172.21.15.194:6827/2713146974","heartbeat_back_addr":"172.21.15.194:6831/2713146974","heartbeat_front_addr":"172.21.15.194:6829/2713146974","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:09.395371+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:33.648930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:58.805048+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:23.621459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:48.553860+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:13.506636+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:38.520376+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:02.695124+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:27.084956+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:50.924128+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:15.396694+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:40.440416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:0/3419110398":"2024-09-20T05:10:48.027892+0000","172.21.15.120:6801/50152720":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/4177074351":"2024-09-20T05:10:48.027892+0000","172.21.15.120:6800/50152720":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/329623296":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/2867300720":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/3592867428":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/4255533863":"2024-09-20T05:10:23.348128+0000","172.21.15.120:6801/3412493069":"2024-09-20T05:10:23.348128+0000","172.21.15.120:6800/3412493069":"2024-09-20T05:10:23.348128+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:17:32.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.763+0000 7f86f14e2640 1 -- 172.21.15.120:0/169407884 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f86d40a3240 msgr2=0x7f86d40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:32.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.763+0000 7f86f14e2640 1 --2- 172.21.15.120:0/169407884 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f86d40a3240 0x7f86d40a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f86dc005fd0 tx=0x7f86dc009520 comp rx=0 tx=0).stop 2024-09-19T05:17:32.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.763+0000 7f86f14e2640 1 -- 172.21.15.120:0/169407884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86ec102570 msgr2=0x7f86ec1997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:32.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.763+0000 7f86f14e2640 1 --2- 172.21.15.120:0/169407884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86ec102570 0x7f86ec1997c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f86e0006010 tx=0x7f86e00042f0 comp rx=0 tx=0).stop 2024-09-19T05:17:32.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.763+0000 7f86f14e2640 1 -- 172.21.15.120:0/169407884 shutdown_connections 2024-09-19T05:17:32.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.763+0000 7f86f14e2640 1 --2- 172.21.15.120:0/169407884 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f86d40a3240 0x7f86d40a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:32.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.763+0000 7f86f14e2640 1 --2- 172.21.15.120:0/169407884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86ec102ef0 0x7f86ec1a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:32.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.763+0000 7f86f14e2640 1 --2- 172.21.15.120:0/169407884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86ec102570 0x7f86ec1997c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:32.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.763+0000 7f86f14e2640 1 --2- 172.21.15.120:0/169407884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86ec100e20 0x7f86ec199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:32.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.763+0000 7f86f14e2640 1 -- 172.21.15.120:0/169407884 >> 172.21.15.120:0/169407884 conn(0x7f86ec0fc7d0 msgr2=0x7f86ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:32.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.764+0000 7f86f14e2640 1 -- 172.21.15.120:0/169407884 shutdown_connections 2024-09-19T05:17:32.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:32.764+0000 7f86f14e2640 1 -- 172.21.15.120:0/169407884 wait complete. 2024-09-19T05:17:33.155 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 19 05:17:32 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-i[65624]: 2024-09-19T05:17:32.873+0000 7f1b8f5c4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T05:17:33.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:33 smithi120 ceph-mon[30956]: pgmap v272: 97 pgs: 16 creating+peering, 1 creating+activating, 17 unknown, 63 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-19T05:17:33.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:33 smithi120 ceph-mon[30956]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T05:17:33.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:33 smithi120 ceph-mon[30956]: Cluster is now healthy 2024-09-19T05:17:33.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:33 smithi120 ceph-mon[30956]: mds.? [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] up:active 2024-09-19T05:17:33.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:33 smithi120 ceph-mon[30956]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:17:33.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:33 smithi120 ceph-mon[30956]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:17:33.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:33 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/169407884' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:17:33.496 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T05:17:33.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:33 smithi194 ceph-mon[35228]: pgmap v272: 97 pgs: 16 creating+peering, 1 creating+activating, 17 unknown, 63 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-19T05:17:33.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:33 smithi194 ceph-mon[35228]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T05:17:33.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:33 smithi194 ceph-mon[35228]: Cluster is now healthy 2024-09-19T05:17:33.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:33 smithi194 ceph-mon[35228]: mds.? [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] up:active 2024-09-19T05:17:33.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:33 smithi194 ceph-mon[35228]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:17:33.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:33 smithi194 ceph-mon[35228]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:17:33.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:33 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/169407884' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:17:33.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:33 smithi178 ceph-mon[34347]: pgmap v272: 97 pgs: 16 creating+peering, 1 creating+activating, 17 unknown, 63 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-19T05:17:33.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:33 smithi178 ceph-mon[34347]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T05:17:33.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:33 smithi178 ceph-mon[34347]: Cluster is now healthy 2024-09-19T05:17:33.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:33 smithi178 ceph-mon[34347]: mds.? [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] up:active 2024-09-19T05:17:33.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:33 smithi178 ceph-mon[34347]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:17:33.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:33 smithi178 ceph-mon[34347]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:17:33.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:33 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/169407884' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:17:33.742 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:34.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.167+0000 7f40e96b3640 1 -- 172.21.15.120:0/3361456628 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40e4101420 msgr2=0x7f40e410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:34.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.167+0000 7f40e96b3640 1 --2- 172.21.15.120:0/3361456628 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40e4101420 0x7f40e410d950 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f40dc009930 tx=0x7f40dc02a420 comp rx=0 tx=0).stop 2024-09-19T05:17:34.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.167+0000 7f40e96b3640 1 -- 172.21.15.120:0/3361456628 shutdown_connections 2024-09-19T05:17:34.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.167+0000 7f40e96b3640 1 --2- 172.21.15.120:0/3361456628 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40e4101420 0x7f40e410d950 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:34.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.167+0000 7f40e96b3640 1 --2- 172.21.15.120:0/3361456628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40e4100a80 0x7f40e4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:34.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.167+0000 7f40e96b3640 1 --2- 172.21.15.120:0/3361456628 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40e4106a80 0x7f40e4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:34.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.167+0000 7f40e96b3640 1 -- 172.21.15.120:0/3361456628 >> 172.21.15.120:0/3361456628 conn(0x7f40e40fc7a0 msgr2=0x7f40e40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:34.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.167+0000 7f40e96b3640 1 -- 172.21.15.120:0/3361456628 shutdown_connections 2024-09-19T05:17:34.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.167+0000 7f40e96b3640 1 -- 172.21.15.120:0/3361456628 wait complete. 2024-09-19T05:17:34.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.168+0000 7f40e96b3640 1 Processor -- start 2024-09-19T05:17:34.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.168+0000 7f40e96b3640 1 -- start start 2024-09-19T05:17:34.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.168+0000 7f40e96b3640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40e4100a80 0x7f40e410e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:34.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.168+0000 7f40e96b3640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40e4101420 0x7f40e410e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:34.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.168+0000 7f40e96b3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40e4106a80 0x7f40e410ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:34.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.168+0000 7f40e96b3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f40e4111e50 con 0x7f40e4106a80 2024-09-19T05:17:34.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.168+0000 7f40e96b3640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f40e4111cd0 con 0x7f40e4100a80 2024-09-19T05:17:34.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.168+0000 7f40e96b3640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f40e4111fd0 con 0x7f40e4101420 2024-09-19T05:17:34.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.168+0000 7f40e37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40e4106a80 0x7f40e410ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:34.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.168+0000 7f40e37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40e4106a80 0x7f40e410ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60284/0 (socket says 172.21.15.120:60284) 2024-09-19T05:17:34.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.168+0000 7f40e37fe640 1 -- 172.21.15.120:0/2982591156 learned_addr learned my addr 172.21.15.120:0/2982591156 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:34.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.169+0000 7f40e2ffd640 1 --2- 172.21.15.120:0/2982591156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40e4100a80 0x7f40e410e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:34.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.169+0000 7f40e27fc640 1 --2- 172.21.15.120:0/2982591156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40e4101420 0x7f40e410e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:34.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.169+0000 7f40e37fe640 1 -- 172.21.15.120:0/2982591156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40e4101420 msgr2=0x7f40e410e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:34.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.169+0000 7f40e37fe640 1 --2- 172.21.15.120:0/2982591156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40e4101420 0x7f40e410e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:34.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.169+0000 7f40e37fe640 1 -- 172.21.15.120:0/2982591156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40e4100a80 msgr2=0x7f40e410e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:34.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.169+0000 7f40e37fe640 1 --2- 172.21.15.120:0/2982591156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40e4100a80 0x7f40e410e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:34.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.169+0000 7f40e37fe640 1 -- 172.21.15.120:0/2982591156 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e41a6830 con 0x7f40e4106a80 2024-09-19T05:17:34.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.169+0000 7f40e2ffd640 1 --2- 172.21.15.120:0/2982591156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40e4100a80 0x7f40e410e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:17:34.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.169+0000 7f40e37fe640 1 --2- 172.21.15.120:0/2982591156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40e4106a80 0x7f40e410ee60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f40dc009900 tx=0x7f40dc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:34.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.169+0000 7f40cbfff640 1 -- 172.21.15.120:0/2982591156 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc03f030 con 0x7f40e4106a80 2024-09-19T05:17:34.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.169+0000 7f40e96b3640 1 -- 172.21.15.120:0/2982591156 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e41a6ac0 con 0x7f40e4106a80 2024-09-19T05:17:34.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.169+0000 7f40cbfff640 1 -- 172.21.15.120:0/2982591156 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f40dc0035f0 con 0x7f40e4106a80 2024-09-19T05:17:34.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.169+0000 7f40cbfff640 1 -- 172.21.15.120:0/2982591156 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc035070 con 0x7f40e4106a80 2024-09-19T05:17:34.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.169+0000 7f40e96b3640 1 -- 172.21.15.120:0/2982591156 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e41a6fa0 con 0x7f40e4106a80 2024-09-19T05:17:34.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.170+0000 7f40e96b3640 1 -- 172.21.15.120:0/2982591156 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40e4100ee0 con 0x7f40e4106a80 2024-09-19T05:17:34.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.171+0000 7f40cbfff640 1 -- 172.21.15.120:0/2982591156 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f40dc003b30 con 0x7f40e4106a80 2024-09-19T05:17:34.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.172+0000 7f40cbfff640 1 --2- 172.21.15.120:0/2982591156 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f40cc0a3240 0x7f40cc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:34.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.172+0000 7f40e2ffd640 1 --2- 172.21.15.120:0/2982591156 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f40cc0a3240 0x7f40cc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:34.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.172+0000 7f40cbfff640 1 -- 172.21.15.120:0/2982591156 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f40dc0f0410 con 0x7f40e4106a80 2024-09-19T05:17:34.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.173+0000 7f40e2ffd640 1 --2- 172.21.15.120:0/2982591156 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f40cc0a3240 0x7f40cc0a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f40d4007e70 tx=0x7f40d4007850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:34.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.176+0000 7f40cbfff640 1 -- 172.21.15.120:0/2982591156 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f40dc0bd280 con 0x7f40e4106a80 2024-09-19T05:17:34.347 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.346+0000 7f40e96b3640 1 -- 172.21.15.120:0/2982591156 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f40e4109010 con 0x7f40e4106a80 2024-09-19T05:17:34.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.347+0000 7f40cbfff640 1 -- 172.21.15.120:0/2982591156 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22334 (secure 0 0 0) 0x7f40dc0bcb80 con 0x7f40e4106a80 2024-09-19T05:17:34.349 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:17:34.349 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":80,"fsid":"4e6e3df4-7645-11ef-bceb-c7b262605968","created":"2024-09-19T05:09:55.847220+0000","modified":"2024-09-19T05:17:30.795992+0000","last_up_change":"2024-09-19T05:16:42.808178+0000","last_in_change":"2024-09-19T05:16:18.315940+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:13:02.340027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:17:26.914416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:17:29.112997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"18907a03-1f43-419a-acb6-9fa4cf5020d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6803","nonce":3421474326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6805","nonce":3421474326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6809","nonce":3421474326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6807","nonce":3421474326}]},"public_addr":"172.21.15.120:6803/3421474326","cluster_addr":"172.21.15.120:6805/3421474326","heartbeat_back_addr":"172.21.15.120:6809/3421474326","heartbeat_front_addr":"172.21.15.120:6807/3421474326","state":["exists","up"]},{"osd":1,"uuid":"d21e029b-8a60-43f9-9ba7-30cdba19ba57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6801","nonce":1195511218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6803","nonce":1195511218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6807","nonce":1195511218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6805","nonce":1195511218}]},"public_addr":"172.21.15.178:6801/1195511218","cluster_addr":"172.21.15.178:6803/1195511218","heartbeat_back_addr":"172.21.15.178:6807/1195511218","heartbeat_front_addr":"172.21.15.178:6805/1195511218","state":["exists","up"]},{"osd":2,"uuid":"26ad9c8d-dbaa-46c2-a346-19717d81cc60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6801","nonce":3752826560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6803","nonce":3752826560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6807","nonce":3752826560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6805","nonce":3752826560}]},"public_addr":"172.21.15.194:6801/3752826560","cluster_addr":"172.21.15.194:6803/3752826560","heartbeat_back_addr":"172.21.15.194:6807/3752826560","heartbeat_front_addr":"172.21.15.194:6805/3752826560","state":["exists","up"]},{"osd":3,"uuid":"7e266576-8a98-40a8-9532-4b6f4611a908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6811","nonce":803566783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6813","nonce":803566783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6817","nonce":803566783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6815","nonce":803566783}]},"public_addr":"172.21.15.120:6811/803566783","cluster_addr":"172.21.15.120:6813/803566783","heartbeat_back_addr":"172.21.15.120:6817/803566783","heartbeat_front_addr":"172.21.15.120:6815/803566783","state":["exists","up"]},{"osd":4,"uuid":"c77d05c5-3b8f-4f7b-91f9-833735221684","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6809","nonce":541165323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6811","nonce":541165323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6815","nonce":541165323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6813","nonce":541165323}]},"public_addr":"172.21.15.178:6809/541165323","cluster_addr":"172.21.15.178:6811/541165323","heartbeat_back_addr":"172.21.15.178:6815/541165323","heartbeat_front_addr":"172.21.15.178:6813/541165323","state":["exists","up"]},{"osd":5,"uuid":"5f1c394b-e510-411f-969a-2db2b68cf41a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6809","nonce":2631415468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6811","nonce":2631415468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6815","nonce":2631415468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6813","nonce":2631415468}]},"public_addr":"172.21.15.194:6809/2631415468","cluster_addr":"172.21.15.194:6811/2631415468","heartbeat_back_addr":"172.21.15.194:6815/2631415468","heartbeat_front_addr":"172.21.15.194:6813/2631415468","state":["exists","up"]},{"osd":6,"uuid":"990af639-099e-49df-a083-05626cee3c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6819","nonce":388238976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6821","nonce":388238976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6825","nonce":388238976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6823","nonce":388238976}]},"public_addr":"172.21.15.120:6819/388238976","cluster_addr":"172.21.15.120:6821/388238976","heartbeat_back_addr":"172.21.15.120:6825/388238976","heartbeat_front_addr":"172.21.15.120:6823/388238976","state":["exists","up"]},{"osd":7,"uuid":"6f4aa6ab-b5f4-4c06-9f14-9a51bc195ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6817","nonce":1912109177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6819","nonce":1912109177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6823","nonce":1912109177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6821","nonce":1912109177}]},"public_addr":"172.21.15.178:6817/1912109177","cluster_addr":"172.21.15.178:6819/1912109177","heartbeat_back_addr":"172.21.15.178:6823/1912109177","heartbeat_front_addr":"172.21.15.178:6821/1912109177","state":["exists","up"]},{"osd":8,"uuid":"707739c9-732a-405c-847a-ce6a06e611b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6817","nonce":596878172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6819","nonce":596878172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6823","nonce":596878172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6821","nonce":596878172}]},"public_addr":"172.21.15.194:6817/596878172","cluster_addr":"172.21.15.194:6819/596878172","heartbeat_back_addr":"172.21.15.194:6823/596878172","heartbeat_front_addr":"172.21.15.194:6821/596878172","state":["exists","up"]},{"osd":9,"uuid":"9393b018-c924-4d75-99e5-25433d276567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6827","nonce":3257373801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6829","nonce":3257373801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6833","nonce":3257373801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6831","nonce":3257373801}]},"public_addr":"172.21.15.120:6827/3257373801","cluster_addr":"172.21.15.120:6829/3257373801","heartbeat_back_addr":"172.21.15.120:6833/3257373801","heartbeat_front_addr":"172.21.15.120:6831/3257373801","state":["exists","up"]},{"osd":10,"uuid":"45db7f62-87a6-4b2b-a3dc-012e2de505e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6825","nonce":3067822030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6827","nonce":3067822030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6831","nonce":3067822030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6829","nonce":3067822030}]},"public_addr":"172.21.15.178:6825/3067822030","cluster_addr":"172.21.15.178:6827/3067822030","heartbeat_back_addr":"172.21.15.178:6831/3067822030","heartbeat_front_addr":"172.21.15.178:6829/3067822030","state":["exists","up"]},{"osd":11,"uuid":"85ea248c-9a36-41cb-a200-87138fb31602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6825","nonce":2713146974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6827","nonce":2713146974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6831","nonce":2713146974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6829","nonce":2713146974}]},"public_addr":"172.21.15.194:6825/2713146974","cluster_addr":"172.21.15.194:6827/2713146974","heartbeat_back_addr":"172.21.15.194:6831/2713146974","heartbeat_front_addr":"172.21.15.194:6829/2713146974","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:09.395371+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:33.648930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:58.805048+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:23.621459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:48.553860+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:13.506636+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:38.520376+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:02.695124+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:27.084956+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:50.924128+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:15.396694+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:40.440416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:0/3419110398":"2024-09-20T05:10:48.027892+0000","172.21.15.120:6801/50152720":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/4177074351":"2024-09-20T05:10:48.027892+0000","172.21.15.120:6800/50152720":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/329623296":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/2867300720":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/3592867428":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/4255533863":"2024-09-20T05:10:23.348128+0000","172.21.15.120:6801/3412493069":"2024-09-20T05:10:23.348128+0000","172.21.15.120:6800/3412493069":"2024-09-20T05:10:23.348128+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:17:34.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.349+0000 7f40e96b3640 1 -- 172.21.15.120:0/2982591156 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f40cc0a3240 msgr2=0x7f40cc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:34.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.349+0000 7f40e96b3640 1 --2- 172.21.15.120:0/2982591156 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f40cc0a3240 0x7f40cc0a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f40d4007e70 tx=0x7f40d4007850 comp rx=0 tx=0).stop 2024-09-19T05:17:34.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.349+0000 7f40e96b3640 1 -- 172.21.15.120:0/2982591156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40e4106a80 msgr2=0x7f40e410ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:34.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.349+0000 7f40e96b3640 1 --2- 172.21.15.120:0/2982591156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40e4106a80 0x7f40e410ee60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f40dc009900 tx=0x7f40dc004270 comp rx=0 tx=0).stop 2024-09-19T05:17:34.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.349+0000 7f40e96b3640 1 -- 172.21.15.120:0/2982591156 shutdown_connections 2024-09-19T05:17:34.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.349+0000 7f40e96b3640 1 --2- 172.21.15.120:0/2982591156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f40e4106a80 0x7f40e410ee60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:34.351 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.349+0000 7f40e96b3640 1 --2- 172.21.15.120:0/2982591156 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f40cc0a3240 0x7f40cc0a5700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:34.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.349+0000 7f40e96b3640 1 --2- 172.21.15.120:0/2982591156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40e4101420 0x7f40e410e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:34.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.349+0000 7f40e96b3640 1 --2- 172.21.15.120:0/2982591156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40e4100a80 0x7f40e410e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:34.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.349+0000 7f40e96b3640 1 -- 172.21.15.120:0/2982591156 >> 172.21.15.120:0/2982591156 conn(0x7f40e40fc7a0 msgr2=0x7f40e40fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:34.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.349+0000 7f40e96b3640 1 -- 172.21.15.120:0/2982591156 shutdown_connections 2024-09-19T05:17:34.352 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:34.349+0000 7f40e96b3640 1 -- 172.21.15.120:0/2982591156 wait complete. 2024-09-19T05:17:34.964 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T05:17:35.210 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:35.457 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:35 smithi120 ceph-mon[30956]: pgmap v273: 97 pgs: 13 creating+peering, 4 unknown, 80 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 687 B/s wr, 2 op/s 2024-09-19T05:17:35.457 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:35 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2982591156' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:17:35.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:35 smithi194 ceph-mon[35228]: pgmap v273: 97 pgs: 13 creating+peering, 4 unknown, 80 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 687 B/s wr, 2 op/s 2024-09-19T05:17:35.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:35 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/2982591156' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:17:35.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.677+0000 7fa512300640 1 -- 172.21.15.120:0/1181714797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa50c100e20 msgr2=0x7fa50c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:35.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.677+0000 7fa512300640 1 --2- 172.21.15.120:0/1181714797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa50c100e20 0x7fa50c101200 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc009900 tx=0x7fa4fc02a480 comp rx=0 tx=0).stop 2024-09-19T05:17:35.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.677+0000 7fa512300640 1 -- 172.21.15.120:0/1181714797 shutdown_connections 2024-09-19T05:17:35.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.677+0000 7fa512300640 1 --2- 172.21.15.120:0/1181714797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa50c102ef0 0x7fa50c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:35.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.677+0000 7fa512300640 1 --2- 172.21.15.120:0/1181714797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa50c102570 0x7fa50c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:35.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.677+0000 7fa512300640 1 --2- 172.21.15.120:0/1181714797 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa50c100e20 0x7fa50c101200 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:35.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.677+0000 7fa512300640 1 -- 172.21.15.120:0/1181714797 >> 172.21.15.120:0/1181714797 conn(0x7fa50c0fc7d0 msgr2=0x7fa50c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:35.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.677+0000 7fa512300640 1 -- 172.21.15.120:0/1181714797 shutdown_connections 2024-09-19T05:17:35.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.677+0000 7fa512300640 1 -- 172.21.15.120:0/1181714797 wait complete. 2024-09-19T05:17:35.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.677+0000 7fa512300640 1 Processor -- start 2024-09-19T05:17:35.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.678+0000 7fa512300640 1 -- start start 2024-09-19T05:17:35.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.678+0000 7fa512300640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa50c100e20 0x7fa50c197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:35.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.678+0000 7fa512300640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa50c102570 0x7fa50c197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:35.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.678+0000 7fa512300640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa50c102ef0 0x7fa50c19bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:35.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.678+0000 7fa512300640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa50c110e50 con 0x7fa50c100e20 2024-09-19T05:17:35.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.678+0000 7fa512300640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa50c110cd0 con 0x7fa50c102ef0 2024-09-19T05:17:35.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.678+0000 7fa512300640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa50c110fd0 con 0x7fa50c102570 2024-09-19T05:17:35.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.678+0000 7fa50bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa50c100e20 0x7fa50c197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:35.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.678+0000 7fa50bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa50c100e20 0x7fa50c197330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51588/0 (socket says 172.21.15.120:51588) 2024-09-19T05:17:35.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.678+0000 7fa50bfff640 1 -- 172.21.15.120:0/4179717751 learned_addr learned my addr 172.21.15.120:0/4179717751 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:35.685 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.678+0000 7fa503fff640 1 --2- 172.21.15.120:0/4179717751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa50c102570 0x7fa50c197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:35.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.678+0000 7fa51089d640 1 --2- 172.21.15.120:0/4179717751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa50c102ef0 0x7fa50c19bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:35.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.678+0000 7fa50bfff640 1 -- 172.21.15.120:0/4179717751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa50c102570 msgr2=0x7fa50c197870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:35.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.678+0000 7fa50bfff640 1 --2- 172.21.15.120:0/4179717751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa50c102570 0x7fa50c197870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:35.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.678+0000 7fa50bfff640 1 -- 172.21.15.120:0/4179717751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa50c102ef0 msgr2=0x7fa50c19bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:35.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.678+0000 7fa50bfff640 1 --2- 172.21.15.120:0/4179717751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa50c102ef0 0x7fa50c19bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:35.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.678+0000 7fa50bfff640 1 -- 172.21.15.120:0/4179717751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa50c19c2e0 con 0x7fa50c100e20 2024-09-19T05:17:35.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.678+0000 7fa503fff640 1 --2- 172.21.15.120:0/4179717751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa50c102570 0x7fa50c197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:17:35.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.678+0000 7fa51089d640 1 --2- 172.21.15.120:0/4179717751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa50c102ef0 0x7fa50c19bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:17:35.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.678+0000 7fa50bfff640 1 --2- 172.21.15.120:0/4179717751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa50c100e20 0x7fa50c197330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc006010 tx=0x7fa4fc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:35.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.679+0000 7fa509ffb640 1 -- 172.21.15.120:0/4179717751 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc03f070 con 0x7fa50c100e20 2024-09-19T05:17:35.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.679+0000 7fa509ffb640 1 -- 172.21.15.120:0/4179717751 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa4fc003aa0 con 0x7fa50c100e20 2024-09-19T05:17:35.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.679+0000 7fa512300640 1 -- 172.21.15.120:0/4179717751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa50c19c570 con 0x7fa50c100e20 2024-09-19T05:17:35.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.679+0000 7fa509ffb640 1 -- 172.21.15.120:0/4179717751 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc035030 con 0x7fa50c100e20 2024-09-19T05:17:35.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.679+0000 7fa512300640 1 -- 172.21.15.120:0/4179717751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa50c069f70 con 0x7fa50c100e20 2024-09-19T05:17:35.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.680+0000 7fa512300640 1 -- 172.21.15.120:0/4179717751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa50c1021b0 con 0x7fa50c100e20 2024-09-19T05:17:35.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.681+0000 7fa509ffb640 1 -- 172.21.15.120:0/4179717751 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7fa4fc042070 con 0x7fa50c100e20 2024-09-19T05:17:35.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.681+0000 7fa509ffb640 1 --2- 172.21.15.120:0/4179717751 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa4f80a3240 0x7fa4f80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:35.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.681+0000 7fa503fff640 1 --2- 172.21.15.120:0/4179717751 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa4f80a3240 0x7fa4f80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:35.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.681+0000 7fa509ffb640 1 -- 172.21.15.120:0/4179717751 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fa4fc0f01f0 con 0x7fa50c100e20 2024-09-19T05:17:35.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.682+0000 7fa503fff640 1 --2- 172.21.15.120:0/4179717751 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa4f80a3240 0x7fa4f80a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0ffe30 tx=0x7fa4f4005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:35.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.685+0000 7fa509ffb640 1 -- 172.21.15.120:0/4179717751 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa4fc0bd060 con 0x7fa50c100e20 2024-09-19T05:17:35.691 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:35 smithi178 ceph-mon[34347]: pgmap v273: 97 pgs: 13 creating+peering, 4 unknown, 80 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 687 B/s wr, 2 op/s 2024-09-19T05:17:35.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:35 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/2982591156' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:17:35.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:35.890+0000 7fa512300640 1 -- 172.21.15.120:0/4179717751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa50c198690 con 0x7fa50c100e20 2024-09-19T05:17:36.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:36.207+0000 7fa509ffb640 1 -- 172.21.15.120:0/4179717751 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fa4fc0bc960 con 0x7fa50c100e20 2024-09-19T05:17:36.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:36.209+0000 7fa512300640 1 -- 172.21.15.120:0/4179717751 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa4f80a3240 msgr2=0x7fa4f80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:36.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:36.209+0000 7fa512300640 1 --2- 172.21.15.120:0/4179717751 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa4f80a3240 0x7fa4f80a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0ffe30 tx=0x7fa4f4005ec0 comp rx=0 tx=0).stop 2024-09-19T05:17:36.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:36.209+0000 7fa512300640 1 -- 172.21.15.120:0/4179717751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa50c100e20 msgr2=0x7fa50c197330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:36.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:36.209+0000 7fa512300640 1 --2- 172.21.15.120:0/4179717751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa50c100e20 0x7fa50c197330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc006010 tx=0x7fa4fc0042f0 comp rx=0 tx=0).stop 2024-09-19T05:17:36.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:36.209+0000 7fa512300640 1 -- 172.21.15.120:0/4179717751 shutdown_connections 2024-09-19T05:17:36.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:36.209+0000 7fa512300640 1 --2- 172.21.15.120:0/4179717751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa50c102ef0 0x7fa50c19bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:36.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:36.209+0000 7fa512300640 1 --2- 172.21.15.120:0/4179717751 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa4f80a3240 0x7fa4f80a5700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:36.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:36.209+0000 7fa512300640 1 --2- 172.21.15.120:0/4179717751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa50c102570 0x7fa50c197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:36.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:36.209+0000 7fa512300640 1 --2- 172.21.15.120:0/4179717751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa50c100e20 0x7fa50c197330 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:36.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:36.209+0000 7fa512300640 1 -- 172.21.15.120:0/4179717751 >> 172.21.15.120:0/4179717751 conn(0x7fa50c0fc7d0 msgr2=0x7fa50c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:36.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:36.210+0000 7fa512300640 1 -- 172.21.15.120:0/4179717751 shutdown_connections 2024-09-19T05:17:36.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:36.210+0000 7fa512300640 1 -- 172.21.15.120:0/4179717751 wait complete. 2024-09-19T05:17:36.517 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:36 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/4179717751' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T05:17:36.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:36 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/4179717751' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T05:17:36.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:36 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/4179717751' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T05:17:36.929 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-19T05:17:36.929 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-19T05:17:37.179 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:37.570 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:37 smithi120 ceph-mon[30956]: pgmap v274: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 5 op/s 2024-09-19T05:17:37.571 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:37 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/4179717751' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T05:17:37.571 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:37 smithi120 ceph-mon[30956]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:17:37.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:37 smithi194 ceph-mon[35228]: pgmap v274: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 5 op/s 2024-09-19T05:17:37.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:37 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/4179717751' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T05:17:37.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:37 smithi194 ceph-mon[35228]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:17:37.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.661+0000 7efd627c2640 1 -- 172.21.15.120:0/3308379036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd5c101420 msgr2=0x7efd5c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:37.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.661+0000 7efd627c2640 1 --2- 172.21.15.120:0/3308379036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd5c101420 0x7efd5c10d950 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efd54009cd0 tx=0x7efd5402a8e0 comp rx=0 tx=0).stop 2024-09-19T05:17:37.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.661+0000 7efd627c2640 1 -- 172.21.15.120:0/3308379036 shutdown_connections 2024-09-19T05:17:37.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.661+0000 7efd627c2640 1 --2- 172.21.15.120:0/3308379036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd5c101420 0x7efd5c10d950 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:37.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.661+0000 7efd627c2640 1 --2- 172.21.15.120:0/3308379036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd5c100a80 0x7efd5c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:37.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.661+0000 7efd627c2640 1 --2- 172.21.15.120:0/3308379036 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5c106a80 0x7efd5c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:37.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.661+0000 7efd627c2640 1 -- 172.21.15.120:0/3308379036 >> 172.21.15.120:0/3308379036 conn(0x7efd5c0fc7a0 msgr2=0x7efd5c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:37.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.661+0000 7efd627c2640 1 -- 172.21.15.120:0/3308379036 shutdown_connections 2024-09-19T05:17:37.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.661+0000 7efd627c2640 1 -- 172.21.15.120:0/3308379036 wait complete. 2024-09-19T05:17:37.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.661+0000 7efd627c2640 1 Processor -- start 2024-09-19T05:17:37.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.662+0000 7efd627c2640 1 -- start start 2024-09-19T05:17:37.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.662+0000 7efd627c2640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd5c100a80 0x7efd5c19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:37.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.662+0000 7efd627c2640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5c101420 0x7efd5c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:37.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.662+0000 7efd627c2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd5c106a80 0x7efd5c19edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:37.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.662+0000 7efd627c2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c110d50 con 0x7efd5c106a80 2024-09-19T05:17:37.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.662+0000 7efd627c2640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c110bd0 con 0x7efd5c100a80 2024-09-19T05:17:37.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.662+0000 7efd627c2640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c110ed0 con 0x7efd5c101420 2024-09-19T05:17:37.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.662+0000 7efd60d5f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd5c106a80 0x7efd5c19edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:37.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.662+0000 7efd60d5f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd5c106a80 0x7efd5c19edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51610/0 (socket says 172.21.15.120:51610) 2024-09-19T05:17:37.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.662+0000 7efd60d5f640 1 -- 172.21.15.120:0/2948086100 learned_addr learned my addr 172.21.15.120:0/2948086100 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:37.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.662+0000 7efd5bfff640 1 --2- 172.21.15.120:0/2948086100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd5c100a80 0x7efd5c19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:37.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.662+0000 7efd5b7fe640 1 --2- 172.21.15.120:0/2948086100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5c101420 0x7efd5c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:37.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.662+0000 7efd60d5f640 1 -- 172.21.15.120:0/2948086100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5c101420 msgr2=0x7efd5c19aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:37.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.662+0000 7efd60d5f640 1 --2- 172.21.15.120:0/2948086100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5c101420 0x7efd5c19aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:37.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.662+0000 7efd60d5f640 1 -- 172.21.15.120:0/2948086100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd5c100a80 msgr2=0x7efd5c19a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:37.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.662+0000 7efd60d5f640 1 --2- 172.21.15.120:0/2948086100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd5c100a80 0x7efd5c19a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:37.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.662+0000 7efd60d5f640 1 -- 172.21.15.120:0/2948086100 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5c19f4b0 con 0x7efd5c106a80 2024-09-19T05:17:37.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.663+0000 7efd60d5f640 1 --2- 172.21.15.120:0/2948086100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd5c106a80 0x7efd5c19edd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efd54005cc0 tx=0x7efd54003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:37.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.663+0000 7efd597fa640 1 -- 172.21.15.120:0/2948086100 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd54004240 con 0x7efd5c106a80 2024-09-19T05:17:37.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.663+0000 7efd597fa640 1 -- 172.21.15.120:0/2948086100 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efd540305a0 con 0x7efd5c106a80 2024-09-19T05:17:37.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.663+0000 7efd627c2640 1 -- 172.21.15.120:0/2948086100 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd5c19f740 con 0x7efd5c106a80 2024-09-19T05:17:37.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.663+0000 7efd597fa640 1 -- 172.21.15.120:0/2948086100 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd540466c0 con 0x7efd5c106a80 2024-09-19T05:17:37.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.663+0000 7efd627c2640 1 -- 172.21.15.120:0/2948086100 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd5c1a7080 con 0x7efd5c106a80 2024-09-19T05:17:37.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.664+0000 7efd627c2640 1 -- 172.21.15.120:0/2948086100 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd5c100ee0 con 0x7efd5c106a80 2024-09-19T05:17:37.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.665+0000 7efd597fa640 1 -- 172.21.15.120:0/2948086100 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7efd54030ac0 con 0x7efd5c106a80 2024-09-19T05:17:37.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.666+0000 7efd597fa640 1 --2- 172.21.15.120:0/2948086100 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7efd440a3240 0x7efd440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:37.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.666+0000 7efd5bfff640 1 --2- 172.21.15.120:0/2948086100 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7efd440a3240 0x7efd440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:37.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.666+0000 7efd597fa640 1 -- 172.21.15.120:0/2948086100 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7efd5402e030 con 0x7efd5c106a80 2024-09-19T05:17:37.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.666+0000 7efd5bfff640 1 --2- 172.21.15.120:0/2948086100 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7efd440a3240 0x7efd440a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efd4c009890 tx=0x7efd4c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:37.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.670+0000 7efd597fa640 1 -- 172.21.15.120:0/2948086100 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efd5404b060 con 0x7efd5c106a80 2024-09-19T05:17:37.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:37 smithi178 ceph-mon[34347]: pgmap v274: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 5 op/s 2024-09-19T05:17:37.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:37 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/4179717751' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T05:17:37.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:37 smithi178 ceph-mon[34347]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:17:37.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:37.872+0000 7efd627c2640 1 -- 172.21.15.120:0/2948086100 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7efd5c1a7320 con 0x7efd5c106a80 2024-09-19T05:17:38.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:38.214+0000 7efd597fa640 1 -- 172.21.15.120:0/2948086100 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7efd540bdd00 con 0x7efd5c106a80 2024-09-19T05:17:38.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:38.216+0000 7efd627c2640 1 -- 172.21.15.120:0/2948086100 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7efd440a3240 msgr2=0x7efd440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:38.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:38.216+0000 7efd627c2640 1 --2- 172.21.15.120:0/2948086100 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7efd440a3240 0x7efd440a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efd4c009890 tx=0x7efd4c008040 comp rx=0 tx=0).stop 2024-09-19T05:17:38.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:38.216+0000 7efd627c2640 1 -- 172.21.15.120:0/2948086100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd5c106a80 msgr2=0x7efd5c19edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:38.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:38.216+0000 7efd627c2640 1 --2- 172.21.15.120:0/2948086100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd5c106a80 0x7efd5c19edd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efd54005cc0 tx=0x7efd54003ba0 comp rx=0 tx=0).stop 2024-09-19T05:17:38.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:38.216+0000 7efd627c2640 1 -- 172.21.15.120:0/2948086100 shutdown_connections 2024-09-19T05:17:38.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:38.216+0000 7efd627c2640 1 --2- 172.21.15.120:0/2948086100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efd5c106a80 0x7efd5c19edd0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:38.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:38.216+0000 7efd627c2640 1 --2- 172.21.15.120:0/2948086100 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7efd440a3240 0x7efd440a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:38.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:38.216+0000 7efd627c2640 1 --2- 172.21.15.120:0/2948086100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5c101420 0x7efd5c19aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:38.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:38.216+0000 7efd627c2640 1 --2- 172.21.15.120:0/2948086100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd5c100a80 0x7efd5c19a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:38.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:38.216+0000 7efd627c2640 1 -- 172.21.15.120:0/2948086100 >> 172.21.15.120:0/2948086100 conn(0x7efd5c0fc7a0 msgr2=0x7efd5c06a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:38.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:38.216+0000 7efd627c2640 1 -- 172.21.15.120:0/2948086100 shutdown_connections 2024-09-19T05:17:38.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:38.216+0000 7efd627c2640 1 -- 172.21.15.120:0/2948086100 wait complete. 2024-09-19T05:17:38.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:38 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/2948086100' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T05:17:38.499 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:38 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2948086100' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T05:17:38.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:38 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/2948086100' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T05:17:39.013 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T05:17:39.275 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:39.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:39 smithi120 ceph-mon[30956]: pgmap v275: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T05:17:39.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:39 smithi120 ceph-mon[30956]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T05:17:39.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:39 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2948086100' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T05:17:39.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:39 smithi120 ceph-mon[30956]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T05:17:39.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:39 smithi120 ceph-mon[30956]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:17:39.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:39 smithi120 ceph-mon[30956]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-19T05:17:39.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:39 smithi120 ceph-mon[30956]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-19T05:17:39.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:39 smithi194 ceph-mon[35228]: pgmap v275: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T05:17:39.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:39 smithi194 ceph-mon[35228]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T05:17:39.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:39 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/2948086100' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T05:17:39.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:39 smithi194 ceph-mon[35228]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T05:17:39.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:39 smithi194 ceph-mon[35228]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:17:39.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:39 smithi194 ceph-mon[35228]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-19T05:17:39.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:39 smithi194 ceph-mon[35228]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-19T05:17:39.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:39 smithi178 ceph-mon[34347]: pgmap v275: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T05:17:39.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:39 smithi178 ceph-mon[34347]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T05:17:39.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:39 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/2948086100' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T05:17:39.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:39 smithi178 ceph-mon[34347]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T05:17:39.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:39 smithi178 ceph-mon[34347]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-19T05:17:39.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:39 smithi178 ceph-mon[34347]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-19T05:17:39.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:39 smithi178 ceph-mon[34347]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-19T05:17:39.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.728+0000 7f682f4b3640 1 -- 172.21.15.120:0/3370866989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6828103740 msgr2=0x7f6828107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:39.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.728+0000 7f682f4b3640 1 --2- 172.21.15.120:0/3370866989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6828103740 0x7f6828107b80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6818009930 tx=0x7f681802a420 comp rx=0 tx=0).stop 2024-09-19T05:17:39.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.728+0000 7f682f4b3640 1 -- 172.21.15.120:0/3370866989 shutdown_connections 2024-09-19T05:17:39.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.728+0000 7f682f4b3640 1 --2- 172.21.15.120:0/3370866989 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6828108290 0x7f682810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:39.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.728+0000 7f682f4b3640 1 --2- 172.21.15.120:0/3370866989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6828103740 0x7f6828107b80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:39.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.728+0000 7f682f4b3640 1 --2- 172.21.15.120:0/3370866989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6828102d90 0x7f6828103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:39.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.728+0000 7f682f4b3640 1 -- 172.21.15.120:0/3370866989 >> 172.21.15.120:0/3370866989 conn(0x7f68280fc7d0 msgr2=0x7f68280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:39.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.728+0000 7f682f4b3640 1 -- 172.21.15.120:0/3370866989 shutdown_connections 2024-09-19T05:17:39.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.728+0000 7f682f4b3640 1 -- 172.21.15.120:0/3370866989 wait complete. 2024-09-19T05:17:39.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.728+0000 7f682f4b3640 1 Processor -- start 2024-09-19T05:17:39.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.728+0000 7f682f4b3640 1 -- start start 2024-09-19T05:17:39.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.728+0000 7f682f4b3640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6828102d90 0x7f68281009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:39.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.728+0000 7f682f4b3640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6828103740 0x7f6828100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:39.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.728+0000 7f682f4b3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6828108290 0x7f6828101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:39.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.729+0000 7f682f4b3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6828111f60 con 0x7f6828108290 2024-09-19T05:17:39.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.729+0000 7f682f4b3640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6828111de0 con 0x7f6828102d90 2024-09-19T05:17:39.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.729+0000 7f682f4b3640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f68281120e0 con 0x7f6828103740 2024-09-19T05:17:39.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.729+0000 7f682da50640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6828108290 0x7f6828101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:39.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.729+0000 7f682da50640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6828108290 0x7f6828101470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51632/0 (socket says 172.21.15.120:51632) 2024-09-19T05:17:39.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.729+0000 7f682da50640 1 -- 172.21.15.120:0/2647165859 learned_addr learned my addr 172.21.15.120:0/2647165859 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:39.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.729+0000 7f682ca4e640 1 --2- 172.21.15.120:0/2647165859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6828103740 0x7f6828100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:39.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.729+0000 7f682d24f640 1 --2- 172.21.15.120:0/2647165859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6828102d90 0x7f68281009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:39.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.729+0000 7f682da50640 1 -- 172.21.15.120:0/2647165859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6828103740 msgr2=0x7f6828100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:39.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.729+0000 7f682da50640 1 --2- 172.21.15.120:0/2647165859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6828103740 0x7f6828100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:39.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.729+0000 7f682da50640 1 -- 172.21.15.120:0/2647165859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6828102d90 msgr2=0x7f68281009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:39.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.729+0000 7f682da50640 1 --2- 172.21.15.120:0/2647165859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6828102d90 0x7f68281009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:39.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.729+0000 7f682da50640 1 -- 172.21.15.120:0/2647165859 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68281a6980 con 0x7f6828108290 2024-09-19T05:17:39.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.729+0000 7f682d24f640 1 --2- 172.21.15.120:0/2647165859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6828102d90 0x7f68281009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:17:39.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.729+0000 7f682da50640 1 --2- 172.21.15.120:0/2647165859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6828108290 0x7f6828101470 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6824009fd0 tx=0x7f682400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:39.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.729+0000 7f681e7fc640 1 -- 172.21.15.120:0/2647165859 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6824011830 con 0x7f6828108290 2024-09-19T05:17:39.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.729+0000 7f681e7fc640 1 -- 172.21.15.120:0/2647165859 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6824016070 con 0x7f6828108290 2024-09-19T05:17:39.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.729+0000 7f682f4b3640 1 -- 172.21.15.120:0/2647165859 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68281a6c70 con 0x7f6828108290 2024-09-19T05:17:39.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.729+0000 7f681e7fc640 1 -- 172.21.15.120:0/2647165859 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6824010de0 con 0x7f6828108290 2024-09-19T05:17:39.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.729+0000 7f682f4b3640 1 -- 172.21.15.120:0/2647165859 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68281a7180 con 0x7f6828108290 2024-09-19T05:17:39.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.730+0000 7f682f4b3640 1 -- 172.21.15.120:0/2647165859 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6828103170 con 0x7f6828108290 2024-09-19T05:17:39.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.731+0000 7f681e7fc640 1 -- 172.21.15.120:0/2647165859 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f68240119d0 con 0x7f6828108290 2024-09-19T05:17:39.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.732+0000 7f681e7fc640 1 --2- 172.21.15.120:0/2647165859 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f68140a3240 0x7f68140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:39.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.732+0000 7f682d24f640 1 --2- 172.21.15.120:0/2647165859 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f68140a3240 0x7f68140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:39.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.732+0000 7f681e7fc640 1 -- 172.21.15.120:0/2647165859 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f68240cf560 con 0x7f6828108290 2024-09-19T05:17:39.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.732+0000 7f682d24f640 1 --2- 172.21.15.120:0/2647165859 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f68140a3240 0x7f68140a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6820007e70 tx=0x7f6820007850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:39.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.735+0000 7f681e7fc640 1 -- 172.21.15.120:0/2647165859 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f682409c3d0 con 0x7f6828108290 2024-09-19T05:17:39.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:39.937+0000 7f682f4b3640 1 -- 172.21.15.120:0/2647165859 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f682810a2a0 con 0x7f6828108290 2024-09-19T05:17:40.231 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:40.229+0000 7f681e7fc640 1 -- 172.21.15.120:0/2647165859 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f682409bcd0 con 0x7f6828108290 2024-09-19T05:17:40.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:40.231+0000 7f682f4b3640 1 -- 172.21.15.120:0/2647165859 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f68140a3240 msgr2=0x7f68140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:40.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:40.231+0000 7f682f4b3640 1 --2- 172.21.15.120:0/2647165859 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f68140a3240 0x7f68140a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6820007e70 tx=0x7f6820007850 comp rx=0 tx=0).stop 2024-09-19T05:17:40.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:40.231+0000 7f682f4b3640 1 -- 172.21.15.120:0/2647165859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6828108290 msgr2=0x7f6828101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:40.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:40.231+0000 7f682f4b3640 1 --2- 172.21.15.120:0/2647165859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6828108290 0x7f6828101470 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6824009fd0 tx=0x7f682400b8e0 comp rx=0 tx=0).stop 2024-09-19T05:17:40.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:40.231+0000 7f682f4b3640 1 -- 172.21.15.120:0/2647165859 shutdown_connections 2024-09-19T05:17:40.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:40.231+0000 7f682f4b3640 1 --2- 172.21.15.120:0/2647165859 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6828108290 0x7f6828101470 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:40.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:40.231+0000 7f682f4b3640 1 --2- 172.21.15.120:0/2647165859 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f68140a3240 0x7f68140a5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:40.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:40.231+0000 7f682f4b3640 1 --2- 172.21.15.120:0/2647165859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6828103740 0x7f6828100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:40.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:40.231+0000 7f682f4b3640 1 --2- 172.21.15.120:0/2647165859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6828102d90 0x7f68281009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:40.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:40.231+0000 7f682f4b3640 1 -- 172.21.15.120:0/2647165859 >> 172.21.15.120:0/2647165859 conn(0x7f68280fc7d0 msgr2=0x7f6828106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:40.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:40.231+0000 7f682f4b3640 1 -- 172.21.15.120:0/2647165859 shutdown_connections 2024-09-19T05:17:40.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:40.231+0000 7f682f4b3640 1 -- 172.21.15.120:0/2647165859 wait complete. 2024-09-19T05:17:40.584 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:40 smithi120 ceph-mon[30956]: mds.? [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] up:active 2024-09-19T05:17:40.584 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:40 smithi120 ceph-mon[30956]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T05:17:40.584 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:40 smithi120 ceph-mon[30956]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T05:17:40.584 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:40 smithi120 ceph-mon[30956]: Cluster is now healthy 2024-09-19T05:17:40.584 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:40 smithi120 ceph-mon[30956]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-19T05:17:40.584 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:40 smithi120 ceph-mon[30956]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-19T05:17:40.584 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:40 smithi120 ceph-mon[30956]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-19T05:17:40.584 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:40 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2647165859' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T05:17:40.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:40 smithi194 ceph-mon[35228]: mds.? [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] up:active 2024-09-19T05:17:40.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:40 smithi194 ceph-mon[35228]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T05:17:40.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:40 smithi194 ceph-mon[35228]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T05:17:40.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:40 smithi194 ceph-mon[35228]: Cluster is now healthy 2024-09-19T05:17:40.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:40 smithi194 ceph-mon[35228]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-19T05:17:40.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:40 smithi194 ceph-mon[35228]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-19T05:17:40.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:40 smithi194 ceph-mon[35228]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-19T05:17:40.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:40 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/2647165859' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T05:17:40.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:40 smithi178 ceph-mon[34347]: mds.? [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] up:active 2024-09-19T05:17:40.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:40 smithi178 ceph-mon[34347]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T05:17:40.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:40 smithi178 ceph-mon[34347]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T05:17:40.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:40 smithi178 ceph-mon[34347]: Cluster is now healthy 2024-09-19T05:17:40.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:40 smithi178 ceph-mon[34347]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-19T05:17:40.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:40 smithi178 ceph-mon[34347]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-19T05:17:40.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:40 smithi178 ceph-mon[34347]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-19T05:17:40.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:40 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/2647165859' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T05:17:40.919 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T05:17:41.168 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:41.572 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:41 smithi120 ceph-mon[30956]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-19T05:17:41.572 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:41 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2647165859' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T05:17:41.572 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:41 smithi120 ceph-mon[30956]: mds.? [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] up:active 2024-09-19T05:17:41.572 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:41 smithi120 ceph-mon[30956]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-19T05:17:41.572 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:41 smithi120 ceph-mon[30956]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:17:41.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:41 smithi194 ceph-mon[35228]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-19T05:17:41.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:41 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/2647165859' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T05:17:41.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:41 smithi194 ceph-mon[35228]: mds.? [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] up:active 2024-09-19T05:17:41.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:41 smithi194 ceph-mon[35228]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-19T05:17:41.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:41 smithi194 ceph-mon[35228]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:17:41.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.653+0000 7f4a38139640 1 -- 172.21.15.120:0/2560139960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a30102790 msgr2=0x7f4a301067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:41.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.653+0000 7f4a38139640 1 --2- 172.21.15.120:0/2560139960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a30102790 0x7f4a301067e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c009900 tx=0x7f4a2c02a410 comp rx=0 tx=0).stop 2024-09-19T05:17:41.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.653+0000 7f4a38139640 1 -- 172.21.15.120:0/2560139960 shutdown_connections 2024-09-19T05:17:41.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.653+0000 7f4a38139640 1 --2- 172.21.15.120:0/2560139960 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a30106f10 0x7f4a3010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:41.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.653+0000 7f4a38139640 1 --2- 172.21.15.120:0/2560139960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a30102790 0x7f4a301067e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:41.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.653+0000 7f4a38139640 1 --2- 172.21.15.120:0/2560139960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a30101de0 0x7f4a301021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:41.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.653+0000 7f4a38139640 1 -- 172.21.15.120:0/2560139960 >> 172.21.15.120:0/2560139960 conn(0x7f4a300fd8c0 msgr2=0x7f4a300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:41.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.653+0000 7f4a38139640 1 -- 172.21.15.120:0/2560139960 shutdown_connections 2024-09-19T05:17:41.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.653+0000 7f4a38139640 1 -- 172.21.15.120:0/2560139960 wait complete. 2024-09-19T05:17:41.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.654+0000 7f4a38139640 1 Processor -- start 2024-09-19T05:17:41.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.654+0000 7f4a38139640 1 -- start start 2024-09-19T05:17:41.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.654+0000 7f4a38139640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a30101de0 0x7f4a301984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:41.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.654+0000 7f4a38139640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a30102790 0x7f4a30198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:41.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.654+0000 7f4a38139640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a30106f10 0x7f4a3019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:41.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.654+0000 7f4a38139640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4a30111e60 con 0x7f4a30106f10 2024-09-19T05:17:41.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.654+0000 7f4a38139640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4a30111ce0 con 0x7f4a30101de0 2024-09-19T05:17:41.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.654+0000 7f4a38139640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4a30111fe0 con 0x7f4a30102790 2024-09-19T05:17:41.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.654+0000 7f4a366d6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a30106f10 0x7f4a3019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:41.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.654+0000 7f4a366d6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a30106f10 0x7f4a3019cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51660/0 (socket says 172.21.15.120:51660) 2024-09-19T05:17:41.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.654+0000 7f4a366d6640 1 -- 172.21.15.120:0/3469396231 learned_addr learned my addr 172.21.15.120:0/3469396231 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:41.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.654+0000 7f4a356d4640 1 --2- 172.21.15.120:0/3469396231 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a30102790 0x7f4a30198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:41.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.654+0000 7f4a35ed5640 1 --2- 172.21.15.120:0/3469396231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a30101de0 0x7f4a301984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:41.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.654+0000 7f4a366d6640 1 -- 172.21.15.120:0/3469396231 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a30102790 msgr2=0x7f4a30198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:41.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.654+0000 7f4a366d6640 1 --2- 172.21.15.120:0/3469396231 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a30102790 0x7f4a30198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:41.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.654+0000 7f4a366d6640 1 -- 172.21.15.120:0/3469396231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a30101de0 msgr2=0x7f4a301984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:41.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.654+0000 7f4a366d6640 1 --2- 172.21.15.120:0/3469396231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a30101de0 0x7f4a301984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:41.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.654+0000 7f4a366d6640 1 -- 172.21.15.120:0/3469396231 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3019d480 con 0x7f4a30106f10 2024-09-19T05:17:41.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.655+0000 7f4a366d6640 1 --2- 172.21.15.120:0/3469396231 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a30106f10 0x7f4a3019cda0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800b970 tx=0x7f4a2800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:41.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.655+0000 7f4a22ffd640 1 -- 172.21.15.120:0/3469396231 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a28019070 con 0x7f4a30106f10 2024-09-19T05:17:41.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.655+0000 7f4a38139640 1 -- 172.21.15.120:0/3469396231 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a3019d770 con 0x7f4a30106f10 2024-09-19T05:17:41.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.655+0000 7f4a22ffd640 1 -- 172.21.15.120:0/3469396231 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4a28014440 con 0x7f4a30106f10 2024-09-19T05:17:41.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.655+0000 7f4a22ffd640 1 -- 172.21.15.120:0/3469396231 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a280075d0 con 0x7f4a30106f10 2024-09-19T05:17:41.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.655+0000 7f4a38139640 1 -- 172.21.15.120:0/3469396231 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a301a5050 con 0x7f4a30106f10 2024-09-19T05:17:41.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.656+0000 7f4a38139640 1 -- 172.21.15.120:0/3469396231 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a301021c0 con 0x7f4a30106f10 2024-09-19T05:17:41.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.657+0000 7f4a22ffd640 1 -- 172.21.15.120:0/3469396231 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f4a2801c070 con 0x7f4a30106f10 2024-09-19T05:17:41.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.657+0000 7f4a22ffd640 1 --2- 172.21.15.120:0/3469396231 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f4a1c0a3240 0x7f4a1c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:41.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.658+0000 7f4a35ed5640 1 --2- 172.21.15.120:0/3469396231 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f4a1c0a3240 0x7f4a1c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:41.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.658+0000 7f4a22ffd640 1 -- 172.21.15.120:0/3469396231 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f4a280cf390 con 0x7f4a30106f10 2024-09-19T05:17:41.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.658+0000 7f4a35ed5640 1 --2- 172.21.15.120:0/3469396231 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f4a1c0a3240 0x7f4a1c0a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4a24005fd0 tx=0x7f4a24005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:41.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.661+0000 7f4a22ffd640 1 -- 172.21.15.120:0/3469396231 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4a2809c160 con 0x7f4a30106f10 2024-09-19T05:17:41.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:41 smithi178 ceph-mon[34347]: pgmap v276: 97 pgs: 97 active+clean; 579 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-09-19T05:17:41.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:41 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/2647165859' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T05:17:41.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:41 smithi178 ceph-mon[34347]: mds.? [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] up:active 2024-09-19T05:17:41.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:41 smithi178 ceph-mon[34347]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-19T05:17:41.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:41 smithi178 ceph-mon[34347]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:17:41.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:41.859+0000 7f4a38139640 1 -- 172.21.15.120:0/3469396231 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f4a3010a0f0 con 0x7f4a30106f10 2024-09-19T05:17:42.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:42.235+0000 7f4a22ffd640 1 -- 172.21.15.120:0/3469396231 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f4a2809ba60 con 0x7f4a30106f10 2024-09-19T05:17:42.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:42.238+0000 7f4a38139640 1 -- 172.21.15.120:0/3469396231 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f4a1c0a3240 msgr2=0x7f4a1c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:42.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:42.238+0000 7f4a38139640 1 --2- 172.21.15.120:0/3469396231 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f4a1c0a3240 0x7f4a1c0a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4a24005fd0 tx=0x7f4a24005e20 comp rx=0 tx=0).stop 2024-09-19T05:17:42.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:42.238+0000 7f4a38139640 1 -- 172.21.15.120:0/3469396231 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a30106f10 msgr2=0x7f4a3019cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:42.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:42.238+0000 7f4a38139640 1 --2- 172.21.15.120:0/3469396231 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a30106f10 0x7f4a3019cda0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800b970 tx=0x7f4a2800be30 comp rx=0 tx=0).stop 2024-09-19T05:17:42.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:42.238+0000 7f4a38139640 1 -- 172.21.15.120:0/3469396231 shutdown_connections 2024-09-19T05:17:42.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:42.238+0000 7f4a38139640 1 --2- 172.21.15.120:0/3469396231 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4a30106f10 0x7f4a3019cda0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:42.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:42.238+0000 7f4a38139640 1 --2- 172.21.15.120:0/3469396231 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f4a1c0a3240 0x7f4a1c0a5700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:42.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:42.238+0000 7f4a38139640 1 --2- 172.21.15.120:0/3469396231 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a30102790 0x7f4a30198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:42.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:42.238+0000 7f4a38139640 1 --2- 172.21.15.120:0/3469396231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a30101de0 0x7f4a301984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:42.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:42.238+0000 7f4a38139640 1 -- 172.21.15.120:0/3469396231 >> 172.21.15.120:0/3469396231 conn(0x7f4a300fd8c0 msgr2=0x7f4a300fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:42.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:42.238+0000 7f4a38139640 1 -- 172.21.15.120:0/3469396231 shutdown_connections 2024-09-19T05:17:42.241 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:42.238+0000 7f4a38139640 1 -- 172.21.15.120:0/3469396231 wait complete. 2024-09-19T05:17:42.534 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:42 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/3469396231' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T05:17:42.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:42 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/3469396231' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T05:17:42.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:42 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/3469396231' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T05:17:42.855 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-19T05:17:42.855 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T05:17:43.101 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:43.495 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:43 smithi120 ceph-mon[30956]: pgmap v277: 97 pgs: 97 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 841 B/s rd, 2.6 KiB/s wr, 9 op/s 2024-09-19T05:17:43.496 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:43 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/3469396231' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T05:17:43.496 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:43 smithi120 ceph-mon[30956]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:17:43.557 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:43 smithi194 ceph-mon[35228]: pgmap v277: 97 pgs: 97 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 841 B/s rd, 2.6 KiB/s wr, 9 op/s 2024-09-19T05:17:43.557 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:43 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/3469396231' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T05:17:43.557 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:43 smithi194 ceph-mon[35228]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:17:43.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.575+0000 7f148f1b1640 1 -- 172.21.15.120:0/3194806868 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1488102790 msgr2=0x7f14881067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:43.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.575+0000 7f148f1b1640 1 --2- 172.21.15.120:0/3194806868 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1488102790 0x7f14881067e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1474009900 tx=0x7f147402a410 comp rx=0 tx=0).stop 2024-09-19T05:17:43.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.575+0000 7f148f1b1640 1 -- 172.21.15.120:0/3194806868 shutdown_connections 2024-09-19T05:17:43.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.575+0000 7f148f1b1640 1 --2- 172.21.15.120:0/3194806868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1488106f10 0x7f148810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:43.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.575+0000 7f148f1b1640 1 --2- 172.21.15.120:0/3194806868 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1488102790 0x7f14881067e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:43.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.575+0000 7f148f1b1640 1 --2- 172.21.15.120:0/3194806868 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1488101de0 0x7f14881021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:43.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.575+0000 7f148f1b1640 1 -- 172.21.15.120:0/3194806868 >> 172.21.15.120:0/3194806868 conn(0x7f14880fd8c0 msgr2=0x7f14880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:43.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.575+0000 7f148f1b1640 1 -- 172.21.15.120:0/3194806868 shutdown_connections 2024-09-19T05:17:43.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.575+0000 7f148f1b1640 1 -- 172.21.15.120:0/3194806868 wait complete. 2024-09-19T05:17:43.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.576+0000 7f148f1b1640 1 Processor -- start 2024-09-19T05:17:43.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.576+0000 7f148f1b1640 1 -- start start 2024-09-19T05:17:43.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.576+0000 7f148f1b1640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1488101de0 0x7f14881983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:43.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.576+0000 7f148f1b1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1488102790 0x7f1488198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:43.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.576+0000 7f148f1b1640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1488106f10 0x7f148819cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:43.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.576+0000 7f148f1b1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1488111e20 con 0x7f1488102790 2024-09-19T05:17:43.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.576+0000 7f148f1b1640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1488111ca0 con 0x7f1488106f10 2024-09-19T05:17:43.580 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.576+0000 7f148f1b1640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1488111fa0 con 0x7f1488101de0 2024-09-19T05:17:43.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.576+0000 7f1487fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1488102790 0x7f1488198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:43.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.576+0000 7f1487fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1488102790 0x7f1488198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51676/0 (socket says 172.21.15.120:51676) 2024-09-19T05:17:43.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.576+0000 7f1487fff640 1 -- 172.21.15.120:0/3246920461 learned_addr learned my addr 172.21.15.120:0/3246920461 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:43.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.576+0000 7f148cf4d640 1 --2- 172.21.15.120:0/3246920461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1488101de0 0x7f14881983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:43.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.576+0000 7f148d74e640 1 --2- 172.21.15.120:0/3246920461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1488106f10 0x7f148819cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:43.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.576+0000 7f1487fff640 1 -- 172.21.15.120:0/3246920461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1488101de0 msgr2=0x7f14881983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:43.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.576+0000 7f1487fff640 1 --2- 172.21.15.120:0/3246920461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1488101de0 0x7f14881983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:43.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.576+0000 7f1487fff640 1 -- 172.21.15.120:0/3246920461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1488106f10 msgr2=0x7f148819cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:43.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.576+0000 7f1487fff640 1 --2- 172.21.15.120:0/3246920461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1488106f10 0x7f148819cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:43.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.576+0000 7f1487fff640 1 -- 172.21.15.120:0/3246920461 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148819d370 con 0x7f1488102790 2024-09-19T05:17:43.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.576+0000 7f148d74e640 1 --2- 172.21.15.120:0/3246920461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1488106f10 0x7f148819cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:17:43.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.577+0000 7f1487fff640 1 --2- 172.21.15.120:0/3246920461 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1488102790 0x7f1488198900 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1474005940 tx=0x7f1474004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:43.581 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.577+0000 7f1485ffb640 1 -- 172.21.15.120:0/3246920461 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147403f030 con 0x7f1488102790 2024-09-19T05:17:43.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.577+0000 7f1485ffb640 1 -- 172.21.15.120:0/3246920461 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1474003aa0 con 0x7f1488102790 2024-09-19T05:17:43.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.577+0000 7f148f1b1640 1 -- 172.21.15.120:0/3246920461 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f148819d600 con 0x7f1488102790 2024-09-19T05:17:43.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.577+0000 7f1485ffb640 1 -- 172.21.15.120:0/3246920461 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1474035070 con 0x7f1488102790 2024-09-19T05:17:43.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.577+0000 7f148f1b1640 1 -- 172.21.15.120:0/3246920461 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14881a4f40 con 0x7f1488102790 2024-09-19T05:17:43.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.578+0000 7f148f1b1640 1 -- 172.21.15.120:0/3246920461 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14881021c0 con 0x7f1488102790 2024-09-19T05:17:43.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.579+0000 7f1485ffb640 1 -- 172.21.15.120:0/3246920461 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 16) ==== 138356+0+0 (secure 0 0 0) 0x7f1474042030 con 0x7f1488102790 2024-09-19T05:17:43.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.580+0000 7f1485ffb640 1 --2- 172.21.15.120:0/3246920461 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f14780a3240 0x7f14780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:43.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.580+0000 7f148cf4d640 1 --2- 172.21.15.120:0/3246920461 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f14780a3240 0x7f14780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:43.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.580+0000 7f1485ffb640 1 -- 172.21.15.120:0/3246920461 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f14740f00c0 con 0x7f1488102790 2024-09-19T05:17:43.583 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.580+0000 7f148cf4d640 1 --2- 172.21.15.120:0/3246920461 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f14780a3240 0x7f14780a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f147c005fd0 tx=0x7f147c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:43.586 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.584+0000 7f1485ffb640 1 -- 172.21.15.120:0/3246920461 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f14740bce90 con 0x7f1488102790 2024-09-19T05:17:43.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:43 smithi178 ceph-mon[34347]: pgmap v277: 97 pgs: 97 active+clean; 581 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 841 B/s rd, 2.6 KiB/s wr, 9 op/s 2024-09-19T05:17:43.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:43 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/3469396231' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T05:17:43.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:43 smithi178 ceph-mon[34347]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:17:43.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.772+0000 7f148f1b1640 1 -- 172.21.15.120:0/3246920461 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f1488062630 con 0x7f14780a3240 2024-09-19T05:17:43.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.792+0000 7f1485ffb640 1 -- 172.21.15.120:0/3246920461 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1488062630 con 0x7f14780a3240 2024-09-19T05:17:43.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.794+0000 7f148f1b1640 1 -- 172.21.15.120:0/3246920461 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f14780a3240 msgr2=0x7f14780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:43.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.795+0000 7f148f1b1640 1 --2- 172.21.15.120:0/3246920461 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f14780a3240 0x7f14780a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f147c005fd0 tx=0x7f147c005850 comp rx=0 tx=0).stop 2024-09-19T05:17:43.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.795+0000 7f148f1b1640 1 -- 172.21.15.120:0/3246920461 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1488102790 msgr2=0x7f1488198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:43.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.795+0000 7f148f1b1640 1 --2- 172.21.15.120:0/3246920461 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1488102790 0x7f1488198900 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1474005940 tx=0x7f1474004270 comp rx=0 tx=0).stop 2024-09-19T05:17:43.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.795+0000 7f148f1b1640 1 -- 172.21.15.120:0/3246920461 shutdown_connections 2024-09-19T05:17:43.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.795+0000 7f148f1b1640 1 --2- 172.21.15.120:0/3246920461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1488106f10 0x7f148819cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:43.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.795+0000 7f148f1b1640 1 --2- 172.21.15.120:0/3246920461 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1488102790 0x7f1488198900 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:43.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.795+0000 7f148f1b1640 1 --2- 172.21.15.120:0/3246920461 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f14780a3240 0x7f14780a5700 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:43.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.795+0000 7f148f1b1640 1 --2- 172.21.15.120:0/3246920461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1488101de0 0x7f14881983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:43.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.795+0000 7f148f1b1640 1 -- 172.21.15.120:0/3246920461 >> 172.21.15.120:0/3246920461 conn(0x7f14880fd8c0 msgr2=0x7f14880fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:43.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.795+0000 7f148f1b1640 1 -- 172.21.15.120:0/3246920461 shutdown_connections 2024-09-19T05:17:43.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:43.795+0000 7f148f1b1640 1 -- 172.21.15.120:0/3246920461 wait complete. 2024-09-19T05:17:44.125 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:17:43 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:17:43.778+0000 7f38fcb64640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T05:17:44.125 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:17:43 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:17:43.778+0000 7f38fcb64640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T05:17:44.125 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:17:43 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:17:43.778+0000 7f38fcb64640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T05:17:44.125 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:17:43 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:17:43.778+0000 7f38fcb64640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T05:17:44.126 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:17:43 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:17:43.778+0000 7f38fcb64640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T05:17:44.579 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T05:17:44.825 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:45.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.357+0000 7fd23db6c640 1 -- 172.21.15.120:0/4116235874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd238102da0 msgr2=0x7fd238103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:45.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.357+0000 7fd23db6c640 1 --2- 172.21.15.120:0/4116235874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd238102da0 0x7fd238103180 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd228009900 tx=0x7fd22802a480 comp rx=0 tx=0).stop 2024-09-19T05:17:45.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.357+0000 7fd23db6c640 1 -- 172.21.15.120:0/4116235874 shutdown_connections 2024-09-19T05:17:45.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.357+0000 7fd23db6c640 1 --2- 172.21.15.120:0/4116235874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd23810c180 0x7fd23810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:45.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.357+0000 7fd23db6c640 1 --2- 172.21.15.120:0/4116235874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2381036c0 0x7fd23810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:45.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.357+0000 7fd23db6c640 1 --2- 172.21.15.120:0/4116235874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd238102da0 0x7fd238103180 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:45.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.357+0000 7fd23db6c640 1 -- 172.21.15.120:0/4116235874 >> 172.21.15.120:0/4116235874 conn(0x7fd2380fc7a0 msgr2=0x7fd2380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:45.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.357+0000 7fd23db6c640 1 -- 172.21.15.120:0/4116235874 shutdown_connections 2024-09-19T05:17:45.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.357+0000 7fd23db6c640 1 -- 172.21.15.120:0/4116235874 wait complete. 2024-09-19T05:17:45.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.358+0000 7fd23db6c640 1 Processor -- start 2024-09-19T05:17:45.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.358+0000 7fd23db6c640 1 -- start start 2024-09-19T05:17:45.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.358+0000 7fd23db6c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd238102da0 0x7fd238100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:45.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.358+0000 7fd23db6c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2381036c0 0x7fd238100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:45.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.358+0000 7fd23db6c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd23810c180 0x7fd238101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:45.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.358+0000 7fd23db6c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd238111e10 con 0x7fd23810c180 2024-09-19T05:17:45.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.358+0000 7fd23db6c640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd238111c90 con 0x7fd2381036c0 2024-09-19T05:17:45.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.358+0000 7fd23db6c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd238111f90 con 0x7fd238102da0 2024-09-19T05:17:45.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.358+0000 7fd237fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd23810c180 0x7fd238101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:45.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.358+0000 7fd2377fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd238102da0 0x7fd238100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:45.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.358+0000 7fd237fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd23810c180 0x7fd238101480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41134/0 (socket says 172.21.15.120:41134) 2024-09-19T05:17:45.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.358+0000 7fd237fff640 1 -- 172.21.15.120:0/3157755223 learned_addr learned my addr 172.21.15.120:0/3157755223 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:45.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.358+0000 7fd22ffff640 1 --2- 172.21.15.120:0/3157755223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2381036c0 0x7fd238100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:45.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.358+0000 7fd237fff640 1 -- 172.21.15.120:0/3157755223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd238102da0 msgr2=0x7fd238100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:45.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.358+0000 7fd237fff640 1 --2- 172.21.15.120:0/3157755223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd238102da0 0x7fd238100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:45.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.358+0000 7fd237fff640 1 -- 172.21.15.120:0/3157755223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2381036c0 msgr2=0x7fd238100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:45.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.358+0000 7fd237fff640 1 --2- 172.21.15.120:0/3157755223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2381036c0 0x7fd238100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:45.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.358+0000 7fd237fff640 1 -- 172.21.15.120:0/3157755223 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2381a6870 con 0x7fd23810c180 2024-09-19T05:17:45.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.359+0000 7fd237fff640 1 --2- 172.21.15.120:0/3157755223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd23810c180 0x7fd238101480 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd230009fd0 tx=0x7fd23000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:45.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.359+0000 7fd2357fa640 1 -- 172.21.15.120:0/3157755223 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd230017070 con 0x7fd23810c180 2024-09-19T05:17:45.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.359+0000 7fd2357fa640 1 -- 172.21.15.120:0/3157755223 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd230003e20 con 0x7fd23810c180 2024-09-19T05:17:45.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.359+0000 7fd23db6c640 1 -- 172.21.15.120:0/3157755223 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2381a6b60 con 0x7fd23810c180 2024-09-19T05:17:45.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.359+0000 7fd2357fa640 1 -- 172.21.15.120:0/3157755223 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd230010460 con 0x7fd23810c180 2024-09-19T05:17:45.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.359+0000 7fd23db6c640 1 -- 172.21.15.120:0/3157755223 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2381a7050 con 0x7fd23810c180 2024-09-19T05:17:45.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.360+0000 7fd23db6c640 1 -- 172.21.15.120:0/3157755223 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd238103180 con 0x7fd23810c180 2024-09-19T05:17:45.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.361+0000 7fd2357fa640 1 -- 172.21.15.120:0/3157755223 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fd230003970 con 0x7fd23810c180 2024-09-19T05:17:45.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.361+0000 7fd2357fa640 1 --2- 172.21.15.120:0/3157755223 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd2240a32d0 0x7fd2240a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:45.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.362+0000 7fd2377fe640 1 --2- 172.21.15.120:0/3157755223 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd2240a32d0 0x7fd2240a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:45.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.362+0000 7fd2357fa640 1 -- 172.21.15.120:0/3157755223 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fd2300cf640 con 0x7fd23810c180 2024-09-19T05:17:45.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.362+0000 7fd2377fe640 1 --2- 172.21.15.120:0/3157755223 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd2240a32d0 0x7fd2240a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd228031440 tx=0x7fd228005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:45.367 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.366+0000 7fd2357fa640 1 -- 172.21.15.120:0/3157755223 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd23009bd60 con 0x7fd23810c180 2024-09-19T05:17:45.558 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.556+0000 7fd23db6c640 1 -- 172.21.15.120:0/3157755223 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fd238107290 con 0x7fd2240a32d0 2024-09-19T05:17:45.558 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:45 smithi120 ceph-mon[30956]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:17:45.558 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:45 smithi120 ceph-mon[30956]: pgmap v278: 97 pgs: 97 active+clean; 582 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-19T05:17:45.558 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:45 smithi120 ceph-mon[30956]: mgrmap e17: x(active, since 6m), standbys: z, y 2024-09-19T05:17:45.582 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.580+0000 7fd2357fa640 1 -- 172.21.15.120:0/3157755223 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd228032de0 con 0x7fd2240a32d0 2024-09-19T05:17:45.584 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.582+0000 7fd23db6c640 1 -- 172.21.15.120:0/3157755223 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd2240a32d0 msgr2=0x7fd2240a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:45.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.582+0000 7fd23db6c640 1 --2- 172.21.15.120:0/3157755223 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd2240a32d0 0x7fd2240a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd228031440 tx=0x7fd228005b50 comp rx=0 tx=0).stop 2024-09-19T05:17:45.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.582+0000 7fd23db6c640 1 -- 172.21.15.120:0/3157755223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd23810c180 msgr2=0x7fd238101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:45.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.582+0000 7fd23db6c640 1 --2- 172.21.15.120:0/3157755223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd23810c180 0x7fd238101480 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd230009fd0 tx=0x7fd23000b260 comp rx=0 tx=0).stop 2024-09-19T05:17:45.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.582+0000 7fd23db6c640 1 -- 172.21.15.120:0/3157755223 shutdown_connections 2024-09-19T05:17:45.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.582+0000 7fd23db6c640 1 --2- 172.21.15.120:0/3157755223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd23810c180 0x7fd238101480 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:45.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.582+0000 7fd23db6c640 1 --2- 172.21.15.120:0/3157755223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2381036c0 0x7fd238100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:45.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.582+0000 7fd23db6c640 1 --2- 172.21.15.120:0/3157755223 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd2240a32d0 0x7fd2240a5790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:45.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.582+0000 7fd23db6c640 1 --2- 172.21.15.120:0/3157755223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd238102da0 0x7fd238100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:45.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.583+0000 7fd23db6c640 1 -- 172.21.15.120:0/3157755223 >> 172.21.15.120:0/3157755223 conn(0x7fd2380fc7a0 msgr2=0x7fd2380fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:45.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.583+0000 7fd23db6c640 1 -- 172.21.15.120:0/3157755223 shutdown_connections 2024-09-19T05:17:45.585 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:45.583+0000 7fd23db6c640 1 -- 172.21.15.120:0/3157755223 wait complete. 2024-09-19T05:17:45.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:45 smithi194 ceph-mon[35228]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:17:45.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:45 smithi194 ceph-mon[35228]: pgmap v278: 97 pgs: 97 active+clean; 582 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-19T05:17:45.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:45 smithi194 ceph-mon[35228]: mgrmap e17: x(active, since 6m), standbys: z, y 2024-09-19T05:17:45.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:45 smithi178 ceph-mon[34347]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:17:45.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:45 smithi178 ceph-mon[34347]: pgmap v278: 97 pgs: 97 active+clean; 582 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-19T05:17:45.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:45 smithi178 ceph-mon[34347]: mgrmap e17: x(active, since 6m), standbys: z, y 2024-09-19T05:17:46.305 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T05:17:46.549 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:47.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.030+0000 7fa2d16f1640 1 -- 172.21.15.120:0/2067191980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2cc105590 msgr2=0x7fa2cc10d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:47.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.030+0000 7fa2d16f1640 1 --2- 172.21.15.120:0/2067191980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2cc105590 0x7fa2cc10d110 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4009ca0 tx=0x7fa2c402a8c0 comp rx=0 tx=0).stop 2024-09-19T05:17:47.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.030+0000 7fa2d16f1640 1 -- 172.21.15.120:0/2067191980 shutdown_connections 2024-09-19T05:17:47.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.030+0000 7fa2d16f1640 1 --2- 172.21.15.120:0/2067191980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2cc105590 0x7fa2cc10d110 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:47.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.030+0000 7fa2d16f1640 1 --2- 172.21.15.120:0/2067191980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2cc100e10 0x7fa2cc104e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:47.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.030+0000 7fa2d16f1640 1 --2- 172.21.15.120:0/2067191980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2cc100460 0x7fa2cc100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:47.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.030+0000 7fa2d16f1640 1 -- 172.21.15.120:0/2067191980 >> 172.21.15.120:0/2067191980 conn(0x7fa2cc0fbee0 msgr2=0x7fa2cc0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:47.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.030+0000 7fa2d16f1640 1 -- 172.21.15.120:0/2067191980 shutdown_connections 2024-09-19T05:17:47.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.030+0000 7fa2d16f1640 1 -- 172.21.15.120:0/2067191980 wait complete. 2024-09-19T05:17:47.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.031+0000 7fa2d16f1640 1 Processor -- start 2024-09-19T05:17:47.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.031+0000 7fa2d16f1640 1 -- start start 2024-09-19T05:17:47.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.031+0000 7fa2d16f1640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2cc100460 0x7fa2cc196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:47.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.031+0000 7fa2d16f1640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2cc100e10 0x7fa2cc1965d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:47.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.031+0000 7fa2d16f1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2cc105590 0x7fa2cc19a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:47.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.031+0000 7fa2d16f1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa2cc10fc70 con 0x7fa2cc105590 2024-09-19T05:17:47.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.031+0000 7fa2d16f1640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa2cc10faf0 con 0x7fa2cc100460 2024-09-19T05:17:47.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.031+0000 7fa2d16f1640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa2cc10fdf0 con 0x7fa2cc100e10 2024-09-19T05:17:47.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.032+0000 7fa2cb7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2cc105590 0x7fa2cc19a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:47.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.032+0000 7fa2cb7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2cc105590 0x7fa2cc19a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41158/0 (socket says 172.21.15.120:41158) 2024-09-19T05:17:47.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.032+0000 7fa2cb7fe640 1 -- 172.21.15.120:0/3335593485 learned_addr learned my addr 172.21.15.120:0/3335593485 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:47.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.032+0000 7fa2c27fc640 1 --2- 172.21.15.120:0/3335593485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2cc100e10 0x7fa2cc1965d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:47.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.032+0000 7fa2caffd640 1 --2- 172.21.15.120:0/3335593485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2cc100460 0x7fa2cc196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:47.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.032+0000 7fa2cb7fe640 1 -- 172.21.15.120:0/3335593485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2cc100e10 msgr2=0x7fa2cc1965d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:47.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.032+0000 7fa2cb7fe640 1 --2- 172.21.15.120:0/3335593485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2cc100e10 0x7fa2cc1965d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:47.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.032+0000 7fa2cb7fe640 1 -- 172.21.15.120:0/3335593485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2cc100460 msgr2=0x7fa2cc196090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:47.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.032+0000 7fa2cb7fe640 1 --2- 172.21.15.120:0/3335593485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2cc100460 0x7fa2cc196090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:47.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.032+0000 7fa2cb7fe640 1 -- 172.21.15.120:0/3335593485 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2cc19b040 con 0x7fa2cc105590 2024-09-19T05:17:47.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.032+0000 7fa2caffd640 1 --2- 172.21.15.120:0/3335593485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2cc100460 0x7fa2cc196090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:17:47.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.032+0000 7fa2cb7fe640 1 --2- 172.21.15.120:0/3335593485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2cc105590 0x7fa2cc19a960 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4031040 tx=0x7fa2c4003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:47.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.032+0000 7fa2c8ff9640 1 -- 172.21.15.120:0/3335593485 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c4003ce0 con 0x7fa2cc105590 2024-09-19T05:17:47.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.032+0000 7fa2c8ff9640 1 -- 172.21.15.120:0/3335593485 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa2c40044f0 con 0x7fa2cc105590 2024-09-19T05:17:47.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.032+0000 7fa2d16f1640 1 -- 172.21.15.120:0/3335593485 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2cc19b2d0 con 0x7fa2cc105590 2024-09-19T05:17:47.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.032+0000 7fa2c8ff9640 1 -- 172.21.15.120:0/3335593485 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c4030bb0 con 0x7fa2cc105590 2024-09-19T05:17:47.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.032+0000 7fa2d16f1640 1 -- 172.21.15.120:0/3335593485 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2cc1a2c10 con 0x7fa2cc105590 2024-09-19T05:17:47.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.033+0000 7fa2d16f1640 1 -- 172.21.15.120:0/3335593485 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2cc100840 con 0x7fa2cc105590 2024-09-19T05:17:47.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.034+0000 7fa2c8ff9640 1 -- 172.21.15.120:0/3335593485 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fa2c40046a0 con 0x7fa2cc105590 2024-09-19T05:17:47.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.035+0000 7fa2c8ff9640 1 --2- 172.21.15.120:0/3335593485 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa2b80a3350 0x7fa2b80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:47.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.035+0000 7fa2caffd640 1 --2- 172.21.15.120:0/3335593485 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa2b80a3350 0x7fa2b80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:47.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.035+0000 7fa2c8ff9640 1 -- 172.21.15.120:0/3335593485 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fa2c40f0f50 con 0x7fa2cc105590 2024-09-19T05:17:47.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.035+0000 7fa2caffd640 1 --2- 172.21.15.120:0/3335593485 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa2b80a3350 0x7fa2b80a5810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc0058c0 tx=0x7fa2bc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:47.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.038+0000 7fa2c8ff9640 1 -- 172.21.15.120:0/3335593485 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa2c40bddd0 con 0x7fa2cc105590 2024-09-19T05:17:47.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.231+0000 7fa2d16f1640 1 -- 172.21.15.120:0/3335593485 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fa2cc0fd1c0 con 0x7fa2b80a3350 2024-09-19T05:17:47.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.236+0000 7fa2c8ff9640 1 -- 172.21.15.120:0/3335593485 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fa2cc0fd1c0 con 0x7fa2b80a3350 2024-09-19T05:17:47.237 INFO:teuthology.orchestra.run.smithi120.stdout:/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f 2024-09-19T05:17:47.239 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.237+0000 7fa2d16f1640 1 -- 172.21.15.120:0/3335593485 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa2b80a3350 msgr2=0x7fa2b80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:47.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.237+0000 7fa2d16f1640 1 --2- 172.21.15.120:0/3335593485 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa2b80a3350 0x7fa2b80a5810 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc0058c0 tx=0x7fa2bc005850 comp rx=0 tx=0).stop 2024-09-19T05:17:47.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.238+0000 7fa2d16f1640 1 -- 172.21.15.120:0/3335593485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2cc105590 msgr2=0x7fa2cc19a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:47.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.238+0000 7fa2d16f1640 1 --2- 172.21.15.120:0/3335593485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2cc105590 0x7fa2cc19a960 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4031040 tx=0x7fa2c4003970 comp rx=0 tx=0).stop 2024-09-19T05:17:47.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.238+0000 7fa2d16f1640 1 -- 172.21.15.120:0/3335593485 shutdown_connections 2024-09-19T05:17:47.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.238+0000 7fa2d16f1640 1 --2- 172.21.15.120:0/3335593485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa2cc105590 0x7fa2cc19a960 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:47.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.238+0000 7fa2d16f1640 1 --2- 172.21.15.120:0/3335593485 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa2b80a3350 0x7fa2b80a5810 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:47.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.238+0000 7fa2d16f1640 1 --2- 172.21.15.120:0/3335593485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2cc100e10 0x7fa2cc1965d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:47.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.238+0000 7fa2d16f1640 1 --2- 172.21.15.120:0/3335593485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2cc100460 0x7fa2cc196090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:47.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.238+0000 7fa2d16f1640 1 -- 172.21.15.120:0/3335593485 >> 172.21.15.120:0/3335593485 conn(0x7fa2cc0fbee0 msgr2=0x7fa2cc0fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:47.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.238+0000 7fa2d16f1640 1 -- 172.21.15.120:0/3335593485 shutdown_connections 2024-09-19T05:17:47.240 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:47.238+0000 7fa2d16f1640 1 -- 172.21.15.120:0/3335593485 wait complete. 2024-09-19T05:17:47.567 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:47 smithi120 ceph-mon[30956]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:17:47.567 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:47 smithi120 ceph-mon[30956]: pgmap v279: 97 pgs: 97 active+clean; 582 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 2.8 KiB/s wr, 12 op/s 2024-09-19T05:17:47.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:47 smithi194 ceph-mon[35228]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:17:47.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:47 smithi194 ceph-mon[35228]: pgmap v279: 97 pgs: 97 active+clean; 582 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 2.8 KiB/s wr, 12 op/s 2024-09-19T05:17:47.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:47 smithi178 ceph-mon[34347]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:17:47.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:47 smithi178 ceph-mon[34347]: pgmap v279: 97 pgs: 97 active+clean; 582 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 2.8 KiB/s wr, 12 op/s 2024-09-19T05:17:47.920 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T05:17:48.166 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:48.547 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:48 smithi120 ceph-mon[30956]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:17:48.547 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-19T05:17:48.547 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]: dispatch 2024-09-19T05:17:48.547 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-09-19T05:17:48.547 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-19T05:17:48.547 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]: dispatch 2024-09-19T05:17:48.547 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 8]}]: dispatch 2024-09-19T05:17:48.548 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2a", "id": [3, 6]}]: dispatch 2024-09-19T05:17:48.548 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9]}]: dispatch 2024-09-19T05:17:48.548 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2024-09-19T05:17:48.548 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:48 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-09-19T05:17:48.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.629+0000 7fa72cb30640 1 -- 172.21.15.120:0/2523335282 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa728102ef0 msgr2=0x7fa72810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:48.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.629+0000 7fa72cb30640 1 --2- 172.21.15.120:0/2523335282 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa728102ef0 0x7fa72810da40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa720009ca0 tx=0x7fa72002a950 comp rx=0 tx=0).stop 2024-09-19T05:17:48.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.629+0000 7fa72cb30640 1 -- 172.21.15.120:0/2523335282 shutdown_connections 2024-09-19T05:17:48.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.629+0000 7fa72cb30640 1 --2- 172.21.15.120:0/2523335282 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa728102ef0 0x7fa72810da40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:48.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.629+0000 7fa72cb30640 1 --2- 172.21.15.120:0/2523335282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa728102570 0x7fa7281029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:48.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.629+0000 7fa72cb30640 1 --2- 172.21.15.120:0/2523335282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa728100e20 0x7fa728101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:48.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.629+0000 7fa72cb30640 1 -- 172.21.15.120:0/2523335282 >> 172.21.15.120:0/2523335282 conn(0x7fa7280fc7d0 msgr2=0x7fa7280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:48.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.629+0000 7fa72cb30640 1 -- 172.21.15.120:0/2523335282 shutdown_connections 2024-09-19T05:17:48.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.629+0000 7fa72cb30640 1 -- 172.21.15.120:0/2523335282 wait complete. 2024-09-19T05:17:48.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.629+0000 7fa72cb30640 1 Processor -- start 2024-09-19T05:17:48.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.630+0000 7fa72cb30640 1 -- start start 2024-09-19T05:17:48.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.630+0000 7fa72cb30640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa728100e20 0x7fa7281982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:48.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.630+0000 7fa72cb30640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa728102570 0x7fa728198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:48.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.630+0000 7fa72cb30640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa728102ef0 0x7fa72819cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:48.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.630+0000 7fa72cb30640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa728111f50 con 0x7fa728102570 2024-09-19T05:17:48.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.630+0000 7fa72cb30640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa728111dd0 con 0x7fa728102ef0 2024-09-19T05:17:48.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.630+0000 7fa72cb30640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa7281120d0 con 0x7fa728100e20 2024-09-19T05:17:48.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.630+0000 7fa725d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa728102570 0x7fa728198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:48.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.630+0000 7fa725d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa728102570 0x7fa728198830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41182/0 (socket says 172.21.15.120:41182) 2024-09-19T05:17:48.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.630+0000 7fa725d9b640 1 -- 172.21.15.120:0/2540968188 learned_addr learned my addr 172.21.15.120:0/2540968188 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:48.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.630+0000 7fa72659c640 1 --2- 172.21.15.120:0/2540968188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa728100e20 0x7fa7281982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:48.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.630+0000 7fa725d9b640 1 -- 172.21.15.120:0/2540968188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa728100e20 msgr2=0x7fa7281982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:48.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.630+0000 7fa726d9d640 1 --2- 172.21.15.120:0/2540968188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa728102ef0 0x7fa72819cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:48.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.630+0000 7fa725d9b640 1 --2- 172.21.15.120:0/2540968188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa728100e20 0x7fa7281982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:48.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.630+0000 7fa725d9b640 1 -- 172.21.15.120:0/2540968188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa728102ef0 msgr2=0x7fa72819cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:48.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.630+0000 7fa725d9b640 1 --2- 172.21.15.120:0/2540968188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa728102ef0 0x7fa72819cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:48.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.630+0000 7fa725d9b640 1 -- 172.21.15.120:0/2540968188 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa72819d2a0 con 0x7fa728102570 2024-09-19T05:17:48.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.630+0000 7fa726d9d640 1 --2- 172.21.15.120:0/2540968188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa728102ef0 0x7fa72819cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:17:48.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.630+0000 7fa725d9b640 1 --2- 172.21.15.120:0/2540968188 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa728102570 0x7fa728198830 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa71c00c890 tx=0x7fa71c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:48.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.630+0000 7fa7177fe640 1 -- 172.21.15.120:0/2540968188 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71c004220 con 0x7fa728102570 2024-09-19T05:17:48.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.631+0000 7fa72cb30640 1 -- 172.21.15.120:0/2540968188 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa72819d590 con 0x7fa728102570 2024-09-19T05:17:48.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.631+0000 7fa7177fe640 1 -- 172.21.15.120:0/2540968188 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa71c0043c0 con 0x7fa728102570 2024-09-19T05:17:48.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.631+0000 7fa7177fe640 1 -- 172.21.15.120:0/2540968188 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71c004a00 con 0x7fa728102570 2024-09-19T05:17:48.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.631+0000 7fa72cb30640 1 -- 172.21.15.120:0/2540968188 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7281a4e70 con 0x7fa728102570 2024-09-19T05:17:48.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.631+0000 7fa72cb30640 1 -- 172.21.15.120:0/2540968188 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa728101200 con 0x7fa728102570 2024-09-19T05:17:48.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.633+0000 7fa7177fe640 1 -- 172.21.15.120:0/2540968188 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fa71c004ba0 con 0x7fa728102570 2024-09-19T05:17:48.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.633+0000 7fa7177fe640 1 --2- 172.21.15.120:0/2540968188 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa7100a32d0 0x7fa7100a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:48.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.634+0000 7fa72659c640 1 --2- 172.21.15.120:0/2540968188 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa7100a32d0 0x7fa7100a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:48.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.634+0000 7fa7177fe640 1 -- 172.21.15.120:0/2540968188 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8269+0+0 (secure 0 0 0) 0x7fa71c0cf830 con 0x7fa728102570 2024-09-19T05:17:48.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.634+0000 7fa72659c640 1 --2- 172.21.15.120:0/2540968188 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa7100a32d0 0x7fa7100a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa718005e10 tx=0x7fa718005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:48.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.638+0000 7fa7177fe640 1 -- 172.21.15.120:0/2540968188 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa71c014030 con 0x7fa728102570 2024-09-19T05:17:48.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:48 smithi194 ceph-mon[35228]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:17:48.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:48 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-19T05:17:48.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:48 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]: dispatch 2024-09-19T05:17:48.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:48 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-09-19T05:17:48.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:48 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-19T05:17:48.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:48 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]: dispatch 2024-09-19T05:17:48.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:48 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 8]}]: dispatch 2024-09-19T05:17:48.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:48 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2a", "id": [3, 6]}]: dispatch 2024-09-19T05:17:48.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:48 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9]}]: dispatch 2024-09-19T05:17:48.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:48 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2024-09-19T05:17:48.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:48 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-09-19T05:17:48.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:48 smithi178 ceph-mon[34347]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:17:48.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:48 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-09-19T05:17:48.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:48 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]: dispatch 2024-09-19T05:17:48.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:48 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-09-19T05:17:48.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:48 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-09-19T05:17:48.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:48 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]: dispatch 2024-09-19T05:17:48.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:48 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 8]}]: dispatch 2024-09-19T05:17:48.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:48 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2a", "id": [3, 6]}]: dispatch 2024-09-19T05:17:48.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:48 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9]}]: dispatch 2024-09-19T05:17:48.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:48 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2024-09-19T05:17:48.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:48 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-09-19T05:17:48.827 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.826+0000 7fa72cb30640 1 -- 172.21.15.120:0/2540968188 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa728106f20 con 0x7fa7100a32d0 2024-09-19T05:17:48.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.849+0000 7fa7177fe640 1 -- 172.21.15.120:0/2540968188 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa728106f20 con 0x7fa7100a32d0 2024-09-19T05:17:48.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.851+0000 7fa72cb30640 1 -- 172.21.15.120:0/2540968188 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa7100a32d0 msgr2=0x7fa7100a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:48.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.851+0000 7fa72cb30640 1 --2- 172.21.15.120:0/2540968188 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa7100a32d0 0x7fa7100a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa718005e10 tx=0x7fa718005da0 comp rx=0 tx=0).stop 2024-09-19T05:17:48.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.851+0000 7fa72cb30640 1 -- 172.21.15.120:0/2540968188 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa728102570 msgr2=0x7fa728198830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:48.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.851+0000 7fa72cb30640 1 --2- 172.21.15.120:0/2540968188 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa728102570 0x7fa728198830 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa71c00c890 tx=0x7fa71c00cd50 comp rx=0 tx=0).stop 2024-09-19T05:17:48.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.851+0000 7fa72cb30640 1 -- 172.21.15.120:0/2540968188 shutdown_connections 2024-09-19T05:17:48.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.851+0000 7fa72cb30640 1 --2- 172.21.15.120:0/2540968188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa728102ef0 0x7fa72819cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:48.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.851+0000 7fa72cb30640 1 --2- 172.21.15.120:0/2540968188 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa728102570 0x7fa728198830 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:48.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.851+0000 7fa72cb30640 1 --2- 172.21.15.120:0/2540968188 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa7100a32d0 0x7fa7100a5790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:48.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.851+0000 7fa72cb30640 1 --2- 172.21.15.120:0/2540968188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa728100e20 0x7fa7281982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:48.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.851+0000 7fa72cb30640 1 -- 172.21.15.120:0/2540968188 >> 172.21.15.120:0/2540968188 conn(0x7fa7280fc7d0 msgr2=0x7fa728106810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:48.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.851+0000 7fa72cb30640 1 -- 172.21.15.120:0/2540968188 shutdown_connections 2024-09-19T05:17:48.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:48.851+0000 7fa72cb30640 1 -- 172.21.15.120:0/2540968188 wait complete. 2024-09-19T05:17:49.503 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T05:17:49.526 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:49 smithi120 ceph-mon[30956]: pgmap v280: 97 pgs: 97 active+clean; 582 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-19T05:17:49.526 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:49 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-19T05:17:49.526 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:49 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2024-09-19T05:17:49.526 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:49 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-19T05:17:49.526 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:49 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-19T05:17:49.526 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:49 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2024-09-19T05:17:49.527 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:49 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 8]}]': finished 2024-09-19T05:17:49.527 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:49 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2a", "id": [3, 6]}]': finished 2024-09-19T05:17:49.527 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:49 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9]}]': finished 2024-09-19T05:17:49.527 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:49 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2024-09-19T05:17:49.527 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:49 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-19T05:17:49.527 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:49 smithi120 ceph-mon[30956]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T05:17:49.527 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:49 smithi120 ceph-mon[30956]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T05:17:49.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:49 smithi194 ceph-mon[35228]: pgmap v280: 97 pgs: 97 active+clean; 582 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-19T05:17:49.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:49 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-19T05:17:49.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:49 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2024-09-19T05:17:49.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:49 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-19T05:17:49.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:49 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-19T05:17:49.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:49 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2024-09-19T05:17:49.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:49 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 8]}]': finished 2024-09-19T05:17:49.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:49 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2a", "id": [3, 6]}]': finished 2024-09-19T05:17:49.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:49 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9]}]': finished 2024-09-19T05:17:49.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:49 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2024-09-19T05:17:49.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:49 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-19T05:17:49.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:49 smithi194 ceph-mon[35228]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T05:17:49.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:49 smithi194 ceph-mon[35228]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T05:17:49.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:49 smithi178 ceph-mon[34347]: pgmap v280: 97 pgs: 97 active+clean; 582 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-19T05:17:49.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:49 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-19T05:17:49.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:49 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2024-09-19T05:17:49.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:49 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-09-19T05:17:49.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:49 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-09-19T05:17:49.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:49 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2024-09-19T05:17:49.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:49 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 8]}]': finished 2024-09-19T05:17:49.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:49 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2a", "id": [3, 6]}]': finished 2024-09-19T05:17:49.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:49 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9]}]': finished 2024-09-19T05:17:49.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:49 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2024-09-19T05:17:49.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:49 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-19T05:17:49.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:49 smithi178 ceph-mon[34347]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T05:17:49.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:49 smithi178 ceph-mon[34347]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T05:17:49.752 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:50.215 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.213+0000 7fe58f842640 1 -- 172.21.15.120:0/69842262 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe588101de0 msgr2=0x7fe5881021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:50.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.213+0000 7fe58f842640 1 --2- 172.21.15.120:0/69842262 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe588101de0 0x7fe5881021c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe584009900 tx=0x7fe58402a410 comp rx=0 tx=0).stop 2024-09-19T05:17:50.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.213+0000 7fe58f842640 1 -- 172.21.15.120:0/69842262 shutdown_connections 2024-09-19T05:17:50.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.213+0000 7fe58f842640 1 --2- 172.21.15.120:0/69842262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe588106f10 0x7fe58810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:50.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.213+0000 7fe58f842640 1 --2- 172.21.15.120:0/69842262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe588102790 0x7fe5881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:50.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.213+0000 7fe58f842640 1 --2- 172.21.15.120:0/69842262 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe588101de0 0x7fe5881021c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:50.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.213+0000 7fe58f842640 1 -- 172.21.15.120:0/69842262 >> 172.21.15.120:0/69842262 conn(0x7fe5880fd8c0 msgr2=0x7fe5880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:50.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.213+0000 7fe58f842640 1 -- 172.21.15.120:0/69842262 shutdown_connections 2024-09-19T05:17:50.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.213+0000 7fe58f842640 1 -- 172.21.15.120:0/69842262 wait complete. 2024-09-19T05:17:50.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.214+0000 7fe58f842640 1 Processor -- start 2024-09-19T05:17:50.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.214+0000 7fe58f842640 1 -- start start 2024-09-19T05:17:50.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.214+0000 7fe58f842640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe588101de0 0x7fe588198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:50.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.214+0000 7fe58f842640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe588102790 0x7fe588198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:50.218 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.214+0000 7fe58f842640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe588106f10 0x7fe58819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:50.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.214+0000 7fe58f842640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe588111e90 con 0x7fe588101de0 2024-09-19T05:17:50.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.214+0000 7fe58f842640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe588111d10 con 0x7fe588106f10 2024-09-19T05:17:50.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.214+0000 7fe58f842640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe588112010 con 0x7fe588102790 2024-09-19T05:17:50.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.214+0000 7fe58d5de640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe588101de0 0x7fe588198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:50.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.214+0000 7fe58d5de640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe588101de0 0x7fe588198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41196/0 (socket says 172.21.15.120:41196) 2024-09-19T05:17:50.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.214+0000 7fe58d5de640 1 -- 172.21.15.120:0/116786261 learned_addr learned my addr 172.21.15.120:0/116786261 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:50.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.214+0000 7fe58dddf640 1 --2- 172.21.15.120:0/116786261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe588106f10 0x7fe58819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:50.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.215+0000 7fe58cddd640 1 --2- 172.21.15.120:0/116786261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe588102790 0x7fe588198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:50.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.215+0000 7fe58d5de640 1 -- 172.21.15.120:0/116786261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe588102790 msgr2=0x7fe588198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:50.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.215+0000 7fe58d5de640 1 --2- 172.21.15.120:0/116786261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe588102790 0x7fe588198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:50.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.215+0000 7fe58d5de640 1 -- 172.21.15.120:0/116786261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe588106f10 msgr2=0x7fe58819cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:50.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.215+0000 7fe58d5de640 1 --2- 172.21.15.120:0/116786261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe588106f10 0x7fe58819cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:50.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.215+0000 7fe58d5de640 1 -- 172.21.15.120:0/116786261 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe58819d300 con 0x7fe588101de0 2024-09-19T05:17:50.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.215+0000 7fe58dddf640 1 --2- 172.21.15.120:0/116786261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe588106f10 0x7fe58819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:17:50.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.215+0000 7fe58cddd640 1 --2- 172.21.15.120:0/116786261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe588102790 0x7fe588198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:17:50.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.215+0000 7fe58d5de640 1 --2- 172.21.15.120:0/116786261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe588101de0 0x7fe588198350 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe584005ab0 tx=0x7fe584003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:50.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.215+0000 7fe57e7fc640 1 -- 172.21.15.120:0/116786261 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58403f070 con 0x7fe588101de0 2024-09-19T05:17:50.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.215+0000 7fe57e7fc640 1 -- 172.21.15.120:0/116786261 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe584031d60 con 0x7fe588101de0 2024-09-19T05:17:50.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.215+0000 7fe58f842640 1 -- 172.21.15.120:0/116786261 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe58819d590 con 0x7fe588101de0 2024-09-19T05:17:50.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.215+0000 7fe57e7fc640 1 -- 172.21.15.120:0/116786261 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe584035030 con 0x7fe588101de0 2024-09-19T05:17:50.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.215+0000 7fe58f842640 1 -- 172.21.15.120:0/116786261 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5881a4ed0 con 0x7fe588101de0 2024-09-19T05:17:50.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.216+0000 7fe58f842640 1 -- 172.21.15.120:0/116786261 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5881021c0 con 0x7fe588101de0 2024-09-19T05:17:50.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.217+0000 7fe57e7fc640 1 -- 172.21.15.120:0/116786261 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fe584042070 con 0x7fe588101de0 2024-09-19T05:17:50.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.218+0000 7fe57e7fc640 1 --2- 172.21.15.120:0/116786261 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fe5740a32d0 0x7fe5740a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:50.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.218+0000 7fe58cddd640 1 --2- 172.21.15.120:0/116786261 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fe5740a32d0 0x7fe5740a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:50.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.218+0000 7fe57e7fc640 1 -- 172.21.15.120:0/116786261 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fe5840f0570 con 0x7fe588101de0 2024-09-19T05:17:50.221 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.218+0000 7fe58cddd640 1 --2- 172.21.15.120:0/116786261 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fe5740a32d0 0x7fe5740a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe5880fdd00 tx=0x7fe578005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:50.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.222+0000 7fe57e7fc640 1 -- 172.21.15.120:0/116786261 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe5840bd110 con 0x7fe588101de0 2024-09-19T05:17:50.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.420+0000 7fe58f842640 1 -- 172.21.15.120:0/116786261 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fe58810a160 con 0x7fe5740a32d0 2024-09-19T05:17:50.423 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:50 smithi120 ceph-mon[30956]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:17:50.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.426+0000 7fe57e7fc640 1 -- 172.21.15.120:0/116786261 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fe57800da80 con 0x7fe5740a32d0 2024-09-19T05:17:50.428 INFO:teuthology.orchestra.run.smithi120.stdout:/volumes/qa/sv_1/fbc3054b-bd93-44a8-b531-6422cded5f0a 2024-09-19T05:17:50.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.428+0000 7fe58f842640 1 -- 172.21.15.120:0/116786261 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fe5740a32d0 msgr2=0x7fe5740a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:50.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.428+0000 7fe58f842640 1 --2- 172.21.15.120:0/116786261 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fe5740a32d0 0x7fe5740a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe5880fdd00 tx=0x7fe578005d90 comp rx=0 tx=0).stop 2024-09-19T05:17:50.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.428+0000 7fe58f842640 1 -- 172.21.15.120:0/116786261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe588101de0 msgr2=0x7fe588198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:50.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.428+0000 7fe58f842640 1 --2- 172.21.15.120:0/116786261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe588101de0 0x7fe588198350 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe584005ab0 tx=0x7fe584003d50 comp rx=0 tx=0).stop 2024-09-19T05:17:50.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.428+0000 7fe58f842640 1 -- 172.21.15.120:0/116786261 shutdown_connections 2024-09-19T05:17:50.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.428+0000 7fe58f842640 1 --2- 172.21.15.120:0/116786261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe588106f10 0x7fe58819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:50.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.428+0000 7fe58f842640 1 --2- 172.21.15.120:0/116786261 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fe5740a32d0 0x7fe5740a5790 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:50.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.428+0000 7fe58f842640 1 --2- 172.21.15.120:0/116786261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe588102790 0x7fe588198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:50.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.428+0000 7fe58f842640 1 --2- 172.21.15.120:0/116786261 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe588101de0 0x7fe588198350 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:50.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.428+0000 7fe58f842640 1 -- 172.21.15.120:0/116786261 >> 172.21.15.120:0/116786261 conn(0x7fe5880fd8c0 msgr2=0x7fe5880feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:50.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.428+0000 7fe58f842640 1 -- 172.21.15.120:0/116786261 shutdown_connections 2024-09-19T05:17:50.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:50.428+0000 7fe58f842640 1 -- 172.21.15.120:0/116786261 wait complete. 2024-09-19T05:17:50.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:50 smithi194 ceph-mon[35228]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:17:50.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:50 smithi178 ceph-mon[34347]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:17:51.113 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:17:51.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:51 smithi120 ceph-mon[30956]: pgmap v283: 97 pgs: 1 activating, 96 active+clean; 607 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2024-09-19T05:17:51.402 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:51.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:51 smithi194 ceph-mon[35228]: pgmap v283: 97 pgs: 1 activating, 96 active+clean; 607 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2024-09-19T05:17:51.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:51 smithi178 ceph-mon[34347]: pgmap v283: 97 pgs: 1 activating, 96 active+clean; 607 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2024-09-19T05:17:51.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.864+0000 7f0d732d4640 1 -- 172.21.15.120:0/2209845997 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d6c106f10 msgr2=0x7f0d6c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:51.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.864+0000 7f0d732d4640 1 --2- 172.21.15.120:0/2209845997 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d6c106f10 0x7f0d6c10ea90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0d64009ca0 tx=0x7f0d6402a8c0 comp rx=0 tx=0).stop 2024-09-19T05:17:51.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.864+0000 7f0d732d4640 1 -- 172.21.15.120:0/2209845997 shutdown_connections 2024-09-19T05:17:51.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.864+0000 7f0d732d4640 1 --2- 172.21.15.120:0/2209845997 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d6c106f10 0x7f0d6c10ea90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:51.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.864+0000 7f0d732d4640 1 --2- 172.21.15.120:0/2209845997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d6c102790 0x7f0d6c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:51.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.864+0000 7f0d732d4640 1 --2- 172.21.15.120:0/2209845997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d6c101de0 0x7f0d6c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:51.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.864+0000 7f0d732d4640 1 -- 172.21.15.120:0/2209845997 >> 172.21.15.120:0/2209845997 conn(0x7f0d6c0fd8c0 msgr2=0x7f0d6c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:51.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.864+0000 7f0d732d4640 1 -- 172.21.15.120:0/2209845997 shutdown_connections 2024-09-19T05:17:51.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.864+0000 7f0d732d4640 1 -- 172.21.15.120:0/2209845997 wait complete. 2024-09-19T05:17:51.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.864+0000 7f0d732d4640 1 Processor -- start 2024-09-19T05:17:51.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.864+0000 7f0d732d4640 1 -- start start 2024-09-19T05:17:51.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.865+0000 7f0d732d4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d6c101de0 0x7f0d6c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:51.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.865+0000 7f0d732d4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d6c102790 0x7f0d6c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:51.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.865+0000 7f0d732d4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d6c106f10 0x7f0d6c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:51.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.865+0000 7f0d732d4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6c111e20 con 0x7f0d6c102790 2024-09-19T05:17:51.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.865+0000 7f0d732d4640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6c111ca0 con 0x7f0d6c106f10 2024-09-19T05:17:51.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.865+0000 7f0d732d4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6c111fa0 con 0x7f0d6c101de0 2024-09-19T05:17:51.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.865+0000 7f0d7086f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d6c102790 0x7f0d6c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:51.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.865+0000 7f0d7086f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d6c102790 0x7f0d6c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41210/0 (socket says 172.21.15.120:41210) 2024-09-19T05:17:51.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.865+0000 7f0d7086f640 1 -- 172.21.15.120:0/2262113727 learned_addr learned my addr 172.21.15.120:0/2262113727 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:51.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.865+0000 7f0d71871640 1 --2- 172.21.15.120:0/2262113727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d6c106f10 0x7f0d6c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:51.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.865+0000 7f0d71070640 1 --2- 172.21.15.120:0/2262113727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d6c101de0 0x7f0d6c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:51.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.865+0000 7f0d7086f640 1 -- 172.21.15.120:0/2262113727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d6c101de0 msgr2=0x7f0d6c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:51.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.865+0000 7f0d7086f640 1 --2- 172.21.15.120:0/2262113727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d6c101de0 0x7f0d6c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:51.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.865+0000 7f0d7086f640 1 -- 172.21.15.120:0/2262113727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d6c106f10 msgr2=0x7f0d6c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:51.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.865+0000 7f0d7086f640 1 --2- 172.21.15.120:0/2262113727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d6c106f10 0x7f0d6c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:51.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.865+0000 7f0d7086f640 1 -- 172.21.15.120:0/2262113727 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d6c1a6840 con 0x7f0d6c102790 2024-09-19T05:17:51.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.865+0000 7f0d7086f640 1 --2- 172.21.15.120:0/2262113727 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d6c102790 0x7f0d6c074a30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800c890 tx=0x7f0d6800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:51.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.865+0000 7f0d627fc640 1 -- 172.21.15.120:0/2262113727 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d68004220 con 0x7f0d6c102790 2024-09-19T05:17:51.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.865+0000 7f0d627fc640 1 -- 172.21.15.120:0/2262113727 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0d680043c0 con 0x7f0d6c102790 2024-09-19T05:17:51.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.865+0000 7f0d732d4640 1 -- 172.21.15.120:0/2262113727 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d6c1a6b30 con 0x7f0d6c102790 2024-09-19T05:17:51.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.865+0000 7f0d627fc640 1 -- 172.21.15.120:0/2262113727 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d68004a00 con 0x7f0d6c102790 2024-09-19T05:17:51.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.865+0000 7f0d732d4640 1 -- 172.21.15.120:0/2262113727 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d6c1a70c0 con 0x7f0d6c102790 2024-09-19T05:17:51.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.866+0000 7f0d732d4640 1 -- 172.21.15.120:0/2262113727 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d6c1021c0 con 0x7f0d6c102790 2024-09-19T05:17:51.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.867+0000 7f0d627fc640 1 -- 172.21.15.120:0/2262113727 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f0d68004ba0 con 0x7f0d6c102790 2024-09-19T05:17:51.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.868+0000 7f0d627fc640 1 --2- 172.21.15.120:0/2262113727 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0d580a3350 0x7f0d580a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:51.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.868+0000 7f0d71070640 1 --2- 172.21.15.120:0/2262113727 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0d580a3350 0x7f0d580a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:51.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.868+0000 7f0d627fc640 1 -- 172.21.15.120:0/2262113727 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f0d680cf740 con 0x7f0d6c102790 2024-09-19T05:17:51.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.868+0000 7f0d71070640 1 --2- 172.21.15.120:0/2262113727 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0d580a3350 0x7f0d580a5810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c005fd0 tx=0x7f0d5c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:51.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:51.872+0000 7f0d627fc640 1 -- 172.21.15.120:0/2262113727 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0d68014030 con 0x7f0d6c102790 2024-09-19T05:17:52.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:52.073+0000 7f0d732d4640 1 -- 172.21.15.120:0/2262113727 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d6c10a150 con 0x7f0d6c102790 2024-09-19T05:17:52.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:52.074+0000 7f0d627fc640 1 -- 172.21.15.120:0/2262113727 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11921 (secure 0 0 0) 0x7f0d6809c2e0 con 0x7f0d6c102790 2024-09-19T05:17:52.076 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:17:52.076 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":24,"btime":"2024-09-19T05:17:42:231927+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/93472898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":93472898},{"type":"v1","addr":"172.21.15.120:6835","nonce":93472898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1976835398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1976835398},{"type":"v1","addr":"172.21.15.120:6837","nonce":1976835398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6839/2975851469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":2975851469},{"type":"v1","addr":"172.21.15.120:6839","nonce":2975851469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6841/2837552754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":2837552754},{"type":"v1","addr":"172.21.15.120:6841","nonce":2837552754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/61682954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":61682954},{"type":"v1","addr":"172.21.15.178:6833","nonce":61682954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1778722040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1778722040},{"type":"v1","addr":"172.21.15.194:6833","nonce":1778722040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:17:30.796197+0000","modified":"2024-09-19T05:17:41.861437+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24445,"mds_1":24443,"mds_2":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24401":{"gid":24401,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/890775592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":890775592},{"type":"v1","addr":"172.21.15.178:6835","nonce":890775592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6837/3960720164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3960720164},{"type":"v1","addr":"172.21.15.178:6837","nonce":3960720164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6835/3268846994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3268846994},{"type":"v1","addr":"172.21.15.194:6835","nonce":3268846994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.194:6837/378729335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":378729335},{"type":"v1","addr":"172.21.15.194:6837","nonce":378729335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.178:6839/3389137566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3389137566},{"type":"v1","addr":"172.21.15.178:6839","nonce":3389137566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6839/3817420679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3817420679},{"type":"v1","addr":"172.21.15.194:6839","nonce":3817420679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24445,"qdb_cluster":[24430,24443,24445]},"id":1}]} 2024-09-19T05:17:52.076 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 24 2024-09-19T05:17:52.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:52.076+0000 7f0d732d4640 1 -- 172.21.15.120:0/2262113727 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0d580a3350 msgr2=0x7f0d580a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:52.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:52.076+0000 7f0d732d4640 1 --2- 172.21.15.120:0/2262113727 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0d580a3350 0x7f0d580a5810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c005fd0 tx=0x7f0d5c005850 comp rx=0 tx=0).stop 2024-09-19T05:17:52.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:52.076+0000 7f0d732d4640 1 -- 172.21.15.120:0/2262113727 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d6c102790 msgr2=0x7f0d6c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:52.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:52.076+0000 7f0d732d4640 1 --2- 172.21.15.120:0/2262113727 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d6c102790 0x7f0d6c074a30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800c890 tx=0x7f0d6800cd50 comp rx=0 tx=0).stop 2024-09-19T05:17:52.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:52.076+0000 7f0d732d4640 1 -- 172.21.15.120:0/2262113727 shutdown_connections 2024-09-19T05:17:52.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:52.076+0000 7f0d732d4640 1 --2- 172.21.15.120:0/2262113727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d6c106f10 0x7f0d6c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:52.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:52.076+0000 7f0d732d4640 1 --2- 172.21.15.120:0/2262113727 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0d6c102790 0x7f0d6c074a30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:52.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:52.076+0000 7f0d732d4640 1 --2- 172.21.15.120:0/2262113727 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0d580a3350 0x7f0d580a5810 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:52.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:52.076+0000 7f0d732d4640 1 --2- 172.21.15.120:0/2262113727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d6c101de0 0x7f0d6c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:52.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:52.076+0000 7f0d732d4640 1 -- 172.21.15.120:0/2262113727 >> 172.21.15.120:0/2262113727 conn(0x7f0d6c0fd8c0 msgr2=0x7f0d6c0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:52.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:52.076+0000 7f0d732d4640 1 -- 172.21.15.120:0/2262113727 shutdown_connections 2024-09-19T05:17:52.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:52.076+0000 7f0d732d4640 1 -- 172.21.15.120:0/2262113727 wait complete. 2024-09-19T05:17:52.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:52 smithi120 ceph-mon[30956]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:17:52.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:52 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2262113727' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:17:52.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:52 smithi194 ceph-mon[35228]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:17:52.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:52 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/2262113727' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:17:52.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:52 smithi178 ceph-mon[34347]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:17:52.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:52 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/2262113727' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:17:52.728 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T05:17:52.972 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:53.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:53 smithi120 ceph-mon[30956]: pgmap v284: 97 pgs: 1 activating, 96 active+clean; 607 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.1 KiB/s wr, 10 op/s 2024-09-19T05:17:53.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.456+0000 7f95982d5640 1 -- 172.21.15.120:0/2499861560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9590106f10 msgr2=0x7f959010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:53.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.456+0000 7f95982d5640 1 --2- 172.21.15.120:0/2499861560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9590106f10 0x7f959010ea90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9588009ca0 tx=0x7f958802a8c0 comp rx=0 tx=0).stop 2024-09-19T05:17:53.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.456+0000 7f95982d5640 1 -- 172.21.15.120:0/2499861560 shutdown_connections 2024-09-19T05:17:53.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.456+0000 7f95982d5640 1 --2- 172.21.15.120:0/2499861560 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9590106f10 0x7f959010ea90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:53.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.456+0000 7f95982d5640 1 --2- 172.21.15.120:0/2499861560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9590102790 0x7f95901067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:53.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.456+0000 7f95982d5640 1 --2- 172.21.15.120:0/2499861560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9590101de0 0x7f95901021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:53.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.456+0000 7f95982d5640 1 -- 172.21.15.120:0/2499861560 >> 172.21.15.120:0/2499861560 conn(0x7f95900fd8c0 msgr2=0x7f95900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:53.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.456+0000 7f95982d5640 1 -- 172.21.15.120:0/2499861560 shutdown_connections 2024-09-19T05:17:53.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.456+0000 7f95982d5640 1 -- 172.21.15.120:0/2499861560 wait complete. 2024-09-19T05:17:53.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.457+0000 7f95982d5640 1 Processor -- start 2024-09-19T05:17:53.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.457+0000 7f95982d5640 1 -- start start 2024-09-19T05:17:53.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.457+0000 7f95982d5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9590101de0 0x7f9590198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:53.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.457+0000 7f95982d5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9590102790 0x7f9590198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:53.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.457+0000 7f95982d5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9590106f10 0x7f959019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:53.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.457+0000 7f95982d5640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9590111e20 con 0x7f9590102790 2024-09-19T05:17:53.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.457+0000 7f95982d5640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9590111ca0 con 0x7f9590101de0 2024-09-19T05:17:53.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.457+0000 7f95982d5640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9590111fa0 con 0x7f9590106f10 2024-09-19T05:17:53.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.457+0000 7f9595870640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9590102790 0x7f9590198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:53.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.457+0000 7f9595870640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9590102790 0x7f9590198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41230/0 (socket says 172.21.15.120:41230) 2024-09-19T05:17:53.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.457+0000 7f9595870640 1 -- 172.21.15.120:0/4242499430 learned_addr learned my addr 172.21.15.120:0/4242499430 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:53.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.457+0000 7f9596071640 1 --2- 172.21.15.120:0/4242499430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9590101de0 0x7f9590198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:53.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.457+0000 7f9596872640 1 --2- 172.21.15.120:0/4242499430 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9590106f10 0x7f959019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:53.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.457+0000 7f9595870640 1 -- 172.21.15.120:0/4242499430 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9590106f10 msgr2=0x7f959019cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:53.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.457+0000 7f9595870640 1 --2- 172.21.15.120:0/4242499430 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9590106f10 0x7f959019cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:53.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.457+0000 7f9595870640 1 -- 172.21.15.120:0/4242499430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9590101de0 msgr2=0x7f9590198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:53.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.457+0000 7f9595870640 1 --2- 172.21.15.120:0/4242499430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9590101de0 0x7f9590198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:53.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.458+0000 7f9595870640 1 -- 172.21.15.120:0/4242499430 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959019d2b0 con 0x7f9590102790 2024-09-19T05:17:53.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.458+0000 7f9596071640 1 --2- 172.21.15.120:0/4242499430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9590101de0 0x7f9590198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:17:53.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.458+0000 7f9596872640 1 --2- 172.21.15.120:0/4242499430 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9590106f10 0x7f959019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:17:53.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.458+0000 7f9595870640 1 --2- 172.21.15.120:0/4242499430 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9590102790 0x7f9590198840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f958000d770 tx=0x7f958000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:53.465 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.458+0000 7f95877fe640 1 -- 172.21.15.120:0/4242499430 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9580017070 con 0x7f9590102790 2024-09-19T05:17:53.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.458+0000 7f95877fe640 1 -- 172.21.15.120:0/4242499430 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f95800054d0 con 0x7f9590102790 2024-09-19T05:17:53.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.458+0000 7f95982d5640 1 -- 172.21.15.120:0/4242499430 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f959019d5a0 con 0x7f9590102790 2024-09-19T05:17:53.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.458+0000 7f95877fe640 1 -- 172.21.15.120:0/4242499430 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9580004cf0 con 0x7f9590102790 2024-09-19T05:17:53.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.458+0000 7f95982d5640 1 -- 172.21.15.120:0/4242499430 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95901a4e80 con 0x7f9590102790 2024-09-19T05:17:53.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.459+0000 7f95982d5640 1 -- 172.21.15.120:0/4242499430 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95901021c0 con 0x7f9590102790 2024-09-19T05:17:53.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.460+0000 7f95877fe640 1 -- 172.21.15.120:0/4242499430 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f9580004e90 con 0x7f9590102790 2024-09-19T05:17:53.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.460+0000 7f95877fe640 1 --2- 172.21.15.120:0/4242499430 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f957c0a3350 0x7f957c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:53.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.461+0000 7f9596071640 1 --2- 172.21.15.120:0/4242499430 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f957c0a3350 0x7f957c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:53.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.461+0000 7f95877fe640 1 -- 172.21.15.120:0/4242499430 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f95800cf4e0 con 0x7f9590102790 2024-09-19T05:17:53.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.461+0000 7f9596071640 1 --2- 172.21.15.120:0/4242499430 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f957c0a3350 0x7f957c0a5810 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f958c0058c0 tx=0x7f958c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:53.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.465+0000 7f95877fe640 1 -- 172.21.15.120:0/4242499430 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f958009c080 con 0x7f9590102790 2024-09-19T05:17:53.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.633+0000 7f95982d5640 1 -- 172.21.15.120:0/4242499430 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f959010a150 con 0x7f9590102790 2024-09-19T05:17:53.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.635+0000 7f95877fe640 1 -- 172.21.15.120:0/4242499430 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22805 (secure 0 0 0) 0x7f958009b980 con 0x7f9590102790 2024-09-19T05:17:53.637 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:17:53.637 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":82,"fsid":"4e6e3df4-7645-11ef-bceb-c7b262605968","created":"2024-09-19T05:09:55.847220+0000","modified":"2024-09-19T05:17:49.248858+0000","last_up_change":"2024-09-19T05:16:42.808178+0000","last_in_change":"2024-09-19T05:16:18.315940+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:13:02.340027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:17:26.914416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:17:29.112997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"18907a03-1f43-419a-acb6-9fa4cf5020d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6803","nonce":3421474326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6805","nonce":3421474326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6809","nonce":3421474326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6807","nonce":3421474326}]},"public_addr":"172.21.15.120:6803/3421474326","cluster_addr":"172.21.15.120:6805/3421474326","heartbeat_back_addr":"172.21.15.120:6809/3421474326","heartbeat_front_addr":"172.21.15.120:6807/3421474326","state":["exists","up"]},{"osd":1,"uuid":"d21e029b-8a60-43f9-9ba7-30cdba19ba57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6801","nonce":1195511218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6803","nonce":1195511218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6807","nonce":1195511218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6805","nonce":1195511218}]},"public_addr":"172.21.15.178:6801/1195511218","cluster_addr":"172.21.15.178:6803/1195511218","heartbeat_back_addr":"172.21.15.178:6807/1195511218","heartbeat_front_addr":"172.21.15.178:6805/1195511218","state":["exists","up"]},{"osd":2,"uuid":"26ad9c8d-dbaa-46c2-a346-19717d81cc60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6801","nonce":3752826560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6803","nonce":3752826560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6807","nonce":3752826560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6805","nonce":3752826560}]},"public_addr":"172.21.15.194:6801/3752826560","cluster_addr":"172.21.15.194:6803/3752826560","heartbeat_back_addr":"172.21.15.194:6807/3752826560","heartbeat_front_addr":"172.21.15.194:6805/3752826560","state":["exists","up"]},{"osd":3,"uuid":"7e266576-8a98-40a8-9532-4b6f4611a908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6811","nonce":803566783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6813","nonce":803566783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6817","nonce":803566783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6815","nonce":803566783}]},"public_addr":"172.21.15.120:6811/803566783","cluster_addr":"172.21.15.120:6813/803566783","heartbeat_back_addr":"172.21.15.120:6817/803566783","heartbeat_front_addr":"172.21.15.120:6815/803566783","state":["exists","up"]},{"osd":4,"uuid":"c77d05c5-3b8f-4f7b-91f9-833735221684","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6809","nonce":541165323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6811","nonce":541165323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6815","nonce":541165323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6813","nonce":541165323}]},"public_addr":"172.21.15.178:6809/541165323","cluster_addr":"172.21.15.178:6811/541165323","heartbeat_back_addr":"172.21.15.178:6815/541165323","heartbeat_front_addr":"172.21.15.178:6813/541165323","state":["exists","up"]},{"osd":5,"uuid":"5f1c394b-e510-411f-969a-2db2b68cf41a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6809","nonce":2631415468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6811","nonce":2631415468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6815","nonce":2631415468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6813","nonce":2631415468}]},"public_addr":"172.21.15.194:6809/2631415468","cluster_addr":"172.21.15.194:6811/2631415468","heartbeat_back_addr":"172.21.15.194:6815/2631415468","heartbeat_front_addr":"172.21.15.194:6813/2631415468","state":["exists","up"]},{"osd":6,"uuid":"990af639-099e-49df-a083-05626cee3c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6819","nonce":388238976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6821","nonce":388238976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6825","nonce":388238976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6823","nonce":388238976}]},"public_addr":"172.21.15.120:6819/388238976","cluster_addr":"172.21.15.120:6821/388238976","heartbeat_back_addr":"172.21.15.120:6825/388238976","heartbeat_front_addr":"172.21.15.120:6823/388238976","state":["exists","up"]},{"osd":7,"uuid":"6f4aa6ab-b5f4-4c06-9f14-9a51bc195ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6817","nonce":1912109177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6819","nonce":1912109177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6823","nonce":1912109177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6821","nonce":1912109177}]},"public_addr":"172.21.15.178:6817/1912109177","cluster_addr":"172.21.15.178:6819/1912109177","heartbeat_back_addr":"172.21.15.178:6823/1912109177","heartbeat_front_addr":"172.21.15.178:6821/1912109177","state":["exists","up"]},{"osd":8,"uuid":"707739c9-732a-405c-847a-ce6a06e611b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6817","nonce":596878172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6819","nonce":596878172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6823","nonce":596878172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6821","nonce":596878172}]},"public_addr":"172.21.15.194:6817/596878172","cluster_addr":"172.21.15.194:6819/596878172","heartbeat_back_addr":"172.21.15.194:6823/596878172","heartbeat_front_addr":"172.21.15.194:6821/596878172","state":["exists","up"]},{"osd":9,"uuid":"9393b018-c924-4d75-99e5-25433d276567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6827","nonce":3257373801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6829","nonce":3257373801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6833","nonce":3257373801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6831","nonce":3257373801}]},"public_addr":"172.21.15.120:6827/3257373801","cluster_addr":"172.21.15.120:6829/3257373801","heartbeat_back_addr":"172.21.15.120:6833/3257373801","heartbeat_front_addr":"172.21.15.120:6831/3257373801","state":["exists","up"]},{"osd":10,"uuid":"45db7f62-87a6-4b2b-a3dc-012e2de505e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6825","nonce":3067822030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6827","nonce":3067822030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6831","nonce":3067822030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6829","nonce":3067822030}]},"public_addr":"172.21.15.178:6825/3067822030","cluster_addr":"172.21.15.178:6827/3067822030","heartbeat_back_addr":"172.21.15.178:6831/3067822030","heartbeat_front_addr":"172.21.15.178:6829/3067822030","state":["exists","up"]},{"osd":11,"uuid":"85ea248c-9a36-41cb-a200-87138fb31602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6825","nonce":2713146974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6827","nonce":2713146974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6831","nonce":2713146974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6829","nonce":2713146974}]},"public_addr":"172.21.15.194:6825/2713146974","cluster_addr":"172.21.15.194:6827/2713146974","heartbeat_back_addr":"172.21.15.194:6831/2713146974","heartbeat_front_addr":"172.21.15.194:6829/2713146974","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:09.395371+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:33.648930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:58.805048+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:23.621459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:48.553860+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:13.506636+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:38.520376+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:02.695124+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:27.084956+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:50.924128+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:15.396694+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:40.440416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":3,"to":8}]},{"pgid":"3.2a","mappings":[{"from":3,"to":6}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:0/3419110398":"2024-09-20T05:10:48.027892+0000","172.21.15.120:6801/50152720":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/4177074351":"2024-09-20T05:10:48.027892+0000","172.21.15.120:6800/50152720":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/329623296":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/2867300720":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/3592867428":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/4255533863":"2024-09-20T05:10:23.348128+0000","172.21.15.120:6801/3412493069":"2024-09-20T05:10:23.348128+0000","172.21.15.120:6800/3412493069":"2024-09-20T05:10:23.348128+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:17:53.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.637+0000 7f95982d5640 1 -- 172.21.15.120:0/4242499430 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f957c0a3350 msgr2=0x7f957c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:53.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.637+0000 7f95982d5640 1 --2- 172.21.15.120:0/4242499430 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f957c0a3350 0x7f957c0a5810 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f958c0058c0 tx=0x7f958c005850 comp rx=0 tx=0).stop 2024-09-19T05:17:53.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.637+0000 7f95982d5640 1 -- 172.21.15.120:0/4242499430 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9590102790 msgr2=0x7f9590198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:53.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.637+0000 7f95982d5640 1 --2- 172.21.15.120:0/4242499430 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9590102790 0x7f9590198840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f958000d770 tx=0x7f958000dc30 comp rx=0 tx=0).stop 2024-09-19T05:17:53.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.637+0000 7f95982d5640 1 -- 172.21.15.120:0/4242499430 shutdown_connections 2024-09-19T05:17:53.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.637+0000 7f95982d5640 1 --2- 172.21.15.120:0/4242499430 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f957c0a3350 0x7f957c0a5810 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:53.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.637+0000 7f95982d5640 1 --2- 172.21.15.120:0/4242499430 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9590106f10 0x7f959019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:53.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.637+0000 7f95982d5640 1 --2- 172.21.15.120:0/4242499430 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9590102790 0x7f9590198840 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:53.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.637+0000 7f95982d5640 1 --2- 172.21.15.120:0/4242499430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9590101de0 0x7f9590198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:53.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.637+0000 7f95982d5640 1 -- 172.21.15.120:0/4242499430 >> 172.21.15.120:0/4242499430 conn(0x7f95900fd8c0 msgr2=0x7f95900fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:53.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.637+0000 7f95982d5640 1 -- 172.21.15.120:0/4242499430 shutdown_connections 2024-09-19T05:17:53.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:53.637+0000 7f95982d5640 1 -- 172.21.15.120:0/4242499430 wait complete. 2024-09-19T05:17:53.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:53 smithi194 ceph-mon[35228]: pgmap v284: 97 pgs: 1 activating, 96 active+clean; 607 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.1 KiB/s wr, 10 op/s 2024-09-19T05:17:53.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:53 smithi178 ceph-mon[34347]: pgmap v284: 97 pgs: 1 activating, 96 active+clean; 607 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.1 KiB/s wr, 10 op/s 2024-09-19T05:17:54.343 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:54 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/4242499430' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:17:54.345 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T05:17:54.345 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T05:17:54.589 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:54.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:54 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/4242499430' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:17:54.691 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:54 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/4242499430' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:17:55.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.039+0000 7f23eb448640 1 -- 172.21.15.120:0/500490913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23e4101de0 msgr2=0x7f23e41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:55.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.039+0000 7f23eb448640 1 --2- 172.21.15.120:0/500490913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23e4101de0 0x7f23e41021c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f23e0009900 tx=0x7f23e002a410 comp rx=0 tx=0).stop 2024-09-19T05:17:55.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.039+0000 7f23eb448640 1 -- 172.21.15.120:0/500490913 shutdown_connections 2024-09-19T05:17:55.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.039+0000 7f23eb448640 1 --2- 172.21.15.120:0/500490913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23e4106f10 0x7f23e410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:55.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.039+0000 7f23eb448640 1 --2- 172.21.15.120:0/500490913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23e4102790 0x7f23e41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:55.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.039+0000 7f23eb448640 1 --2- 172.21.15.120:0/500490913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23e4101de0 0x7f23e41021c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:55.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.039+0000 7f23eb448640 1 -- 172.21.15.120:0/500490913 >> 172.21.15.120:0/500490913 conn(0x7f23e40fd8c0 msgr2=0x7f23e40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:55.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.039+0000 7f23eb448640 1 -- 172.21.15.120:0/500490913 shutdown_connections 2024-09-19T05:17:55.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.039+0000 7f23eb448640 1 -- 172.21.15.120:0/500490913 wait complete. 2024-09-19T05:17:55.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.040+0000 7f23eb448640 1 Processor -- start 2024-09-19T05:17:55.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.040+0000 7f23eb448640 1 -- start start 2024-09-19T05:17:55.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.040+0000 7f23eb448640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23e4101de0 0x7f23e40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:55.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.040+0000 7f23eb448640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23e4102790 0x7f23e4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:55.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.040+0000 7f23eb448640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23e4106f10 0x7f23e4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:55.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.040+0000 7f23eb448640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f23e4111ec0 con 0x7f23e4102790 2024-09-19T05:17:55.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.040+0000 7f23eb448640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f23e4111d40 con 0x7f23e4101de0 2024-09-19T05:17:55.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.040+0000 7f23eb448640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f23e4112040 con 0x7f23e4106f10 2024-09-19T05:17:55.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.040+0000 7f23e89e3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23e4102790 0x7f23e4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:55.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.040+0000 7f23e89e3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23e4102790 0x7f23e4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47716/0 (socket says 172.21.15.120:47716) 2024-09-19T05:17:55.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.040+0000 7f23e89e3640 1 -- 172.21.15.120:0/2280285553 learned_addr learned my addr 172.21.15.120:0/2280285553 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:55.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.040+0000 7f23e91e4640 1 --2- 172.21.15.120:0/2280285553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23e4101de0 0x7f23e40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:55.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.041+0000 7f23e89e3640 1 -- 172.21.15.120:0/2280285553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23e4106f10 msgr2=0x7f23e4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:55.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.041+0000 7f23e89e3640 1 --2- 172.21.15.120:0/2280285553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23e4106f10 0x7f23e4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:55.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.041+0000 7f23e89e3640 1 -- 172.21.15.120:0/2280285553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23e4101de0 msgr2=0x7f23e40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:55.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.041+0000 7f23e89e3640 1 --2- 172.21.15.120:0/2280285553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23e4101de0 0x7f23e40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:55.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.041+0000 7f23e89e3640 1 -- 172.21.15.120:0/2280285553 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e41a69e0 con 0x7f23e4102790 2024-09-19T05:17:55.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.041+0000 7f23e89e3640 1 --2- 172.21.15.120:0/2280285553 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23e4102790 0x7f23e4074a30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f23d400b4a0 tx=0x7f23d400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:55.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.041+0000 7f23da7fc640 1 -- 172.21.15.120:0/2280285553 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d4014070 con 0x7f23e4102790 2024-09-19T05:17:55.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.041+0000 7f23eb448640 1 -- 172.21.15.120:0/2280285553 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e41a6cd0 con 0x7f23e4102790 2024-09-19T05:17:55.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.041+0000 7f23da7fc640 1 -- 172.21.15.120:0/2280285553 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f23d4010ac0 con 0x7f23e4102790 2024-09-19T05:17:55.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.041+0000 7f23da7fc640 1 -- 172.21.15.120:0/2280285553 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23d4017c30 con 0x7f23e4102790 2024-09-19T05:17:55.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.041+0000 7f23eb448640 1 -- 172.21.15.120:0/2280285553 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e41a71c0 con 0x7f23e4102790 2024-09-19T05:17:55.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.042+0000 7f23eb448640 1 -- 172.21.15.120:0/2280285553 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e4102240 con 0x7f23e4102790 2024-09-19T05:17:55.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.043+0000 7f23da7fc640 1 -- 172.21.15.120:0/2280285553 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f23d4017070 con 0x7f23e4102790 2024-09-19T05:17:55.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.044+0000 7f23da7fc640 1 --2- 172.21.15.120:0/2280285553 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f23d00a32d0 0x7f23d00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:55.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.044+0000 7f23e91e4640 1 --2- 172.21.15.120:0/2280285553 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f23d00a32d0 0x7f23d00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:55.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.044+0000 7f23da7fc640 1 -- 172.21.15.120:0/2280285553 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f23d40cee10 con 0x7f23e4102790 2024-09-19T05:17:55.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.044+0000 7f23e91e4640 1 --2- 172.21.15.120:0/2280285553 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f23d00a32d0 0x7f23d00a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f23e0031440 tx=0x7f23e00095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:55.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.048+0000 7f23da7fc640 1 -- 172.21.15.120:0/2280285553 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f23d409bac0 con 0x7f23e4102790 2024-09-19T05:17:55.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.214+0000 7f23eb448640 1 -- 172.21.15.120:0/2280285553 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f23e4062630 con 0x7f23d00a32d0 2024-09-19T05:17:55.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.221+0000 7f23da7fc640 1 -- 172.21.15.120:0/2280285553 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258687 (secure 0 0 0) 0x7f23e4062630 con 0x7f23d00a32d0 2024-09-19T05:17:55.227 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:17:55.229 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-19T05:17:55.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.224+0000 7f23eb448640 1 -- 172.21.15.120:0/2280285553 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f23d00a32d0 msgr2=0x7f23d00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:55.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.224+0000 7f23eb448640 1 --2- 172.21.15.120:0/2280285553 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f23d00a32d0 0x7f23d00a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f23e0031440 tx=0x7f23e00095f0 comp rx=0 tx=0).stop 2024-09-19T05:17:55.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.224+0000 7f23eb448640 1 -- 172.21.15.120:0/2280285553 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23e4102790 msgr2=0x7f23e4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:55.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.224+0000 7f23eb448640 1 --2- 172.21.15.120:0/2280285553 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23e4102790 0x7f23e4074a30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f23d400b4a0 tx=0x7f23d400b960 comp rx=0 tx=0).stop 2024-09-19T05:17:55.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.224+0000 7f23eb448640 1 -- 172.21.15.120:0/2280285553 shutdown_connections 2024-09-19T05:17:55.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.224+0000 7f23eb448640 1 --2- 172.21.15.120:0/2280285553 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f23d00a32d0 0x7f23d00a5790 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:55.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.224+0000 7f23eb448640 1 --2- 172.21.15.120:0/2280285553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23e4106f10 0x7f23e4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:55.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.224+0000 7f23eb448640 1 --2- 172.21.15.120:0/2280285553 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23e4102790 0x7f23e4074a30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:55.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.224+0000 7f23eb448640 1 --2- 172.21.15.120:0/2280285553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23e4101de0 0x7f23e40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:55.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.224+0000 7f23eb448640 1 -- 172.21.15.120:0/2280285553 >> 172.21.15.120:0/2280285553 conn(0x7f23e40fd8c0 msgr2=0x7f23e40fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:55.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.224+0000 7f23eb448640 1 -- 172.21.15.120:0/2280285553 shutdown_connections 2024-09-19T05:17:55.232 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:55.225+0000 7f23eb448640 1 -- 172.21.15.120:0/2280285553 wait complete. 2024-09-19T05:17:55.484 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:55 smithi120 ceph-mon[30956]: pgmap v285: 97 pgs: 1 activating, 96 active+clean; 631 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.7 KiB/s wr, 11 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T05:17:55.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:55 smithi194 ceph-mon[35228]: pgmap v285: 97 pgs: 1 activating, 96 active+clean; 631 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.7 KiB/s wr, 11 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T05:17:55.691 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:55 smithi178 ceph-mon[34347]: pgmap v285: 97 pgs: 1 activating, 96 active+clean; 631 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.7 KiB/s wr, 11 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T05:17:56.001 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2024-09-19T05:17:54.137212+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":646312,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":232,"num_read_kb":227,"num_write":338,"num_write_kb":3038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272,"ondisk_log_size":272,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":287,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386768,"kb_used_data":12504,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124555056,"statfs":{"total":1151940427776,"available":1151544377344,"internally_reserved":0,"allocated":12804096,"data_stored":7094891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":50722,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":81,"num_write":32,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002027"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255222+0000","last_change":"2024-09-19T05:17:30.200993+0000","last_active":"2024-09-19T05:17:49.255222+0000","last_peered":"2024-09-19T05:17:49.255222+0000","last_clean":"2024-09-19T05:17:49.255222+0000","last_became_active":"2024-09-19T05:17:30.200587+0000","last_became_peered":"2024-09-19T05:17:30.200587+0000","last_unstale":"2024-09-19T05:17:49.255222+0000","last_undegraded":"2024-09-19T05:17:49.255222+0000","last_fullsized":"2024-09-19T05:17:49.255222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:24.484844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258121+0000","last_change":"2024-09-19T05:17:30.207784+0000","last_active":"2024-09-19T05:17:49.258121+0000","last_peered":"2024-09-19T05:17:49.258121+0000","last_clean":"2024-09-19T05:17:49.258121+0000","last_became_active":"2024-09-19T05:17:30.207485+0000","last_became_peered":"2024-09-19T05:17:30.207485+0000","last_unstale":"2024-09-19T05:17:49.258121+0000","last_undegraded":"2024-09-19T05:17:49.258121+0000","last_fullsized":"2024-09-19T05:17:49.258121+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:07.864813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257951+0000","last_change":"2024-09-19T05:17:30.203861+0000","last_active":"2024-09-19T05:17:49.257951+0000","last_peered":"2024-09-19T05:17:49.257951+0000","last_clean":"2024-09-19T05:17:49.257951+0000","last_became_active":"2024-09-19T05:17:30.203541+0000","last_became_peered":"2024-09-19T05:17:30.203541+0000","last_unstale":"2024-09-19T05:17:49.257951+0000","last_undegraded":"2024-09-19T05:17:49.257951+0000","last_fullsized":"2024-09-19T05:17:49.257951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:33:44.840055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259314+0000","last_change":"2024-09-19T05:17:30.214534+0000","last_active":"2024-09-19T05:17:49.259314+0000","last_peered":"2024-09-19T05:17:49.259314+0000","last_clean":"2024-09-19T05:17:49.259314+0000","last_became_active":"2024-09-19T05:17:30.213840+0000","last_became_peered":"2024-09-19T05:17:30.213840+0000","last_unstale":"2024-09-19T05:17:49.259314+0000","last_undegraded":"2024-09-19T05:17:49.259314+0000","last_fullsized":"2024-09-19T05:17:49.259314+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:03.673488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T05:17:48.258362+0000","last_change":"2024-09-19T05:17:30.201451+0000","last_active":"2024-09-19T05:17:48.258362+0000","last_peered":"2024-09-19T05:17:48.258362+0000","last_clean":"2024-09-19T05:17:48.258362+0000","last_became_active":"2024-09-19T05:17:30.201092+0000","last_became_peered":"2024-09-19T05:17:30.201092+0000","last_unstale":"2024-09-19T05:17:48.258362+0000","last_undegraded":"2024-09-19T05:17:48.258362+0000","last_fullsized":"2024-09-19T05:17:48.258362+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:18.958271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.506669+0000","last_change":"2024-09-19T05:17:49.506669+0000","last_active":"2024-09-19T05:17:49.506669+0000","last_peered":"2024-09-19T05:17:49.506669+0000","last_clean":"2024-09-19T05:17:49.506669+0000","last_became_active":"2024-09-19T05:17:49.506331+0000","last_became_peered":"2024-09-19T05:17:49.506331+0000","last_unstale":"2024-09-19T05:17:49.506669+0000","last_undegraded":"2024-09-19T05:17:49.506669+0000","last_fullsized":"2024-09-19T05:17:49.506669+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:23.460781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"activating","last_fresh":"2024-09-19T05:17:49.259659+0000","last_change":"2024-09-19T05:17:49.259659+0000","last_active":"2024-09-19T05:17:48.256170+0000","last_peered":"2024-09-19T05:17:31.200835+0000","last_clean":"2024-09-19T05:17:31.200835+0000","last_became_active":"2024-09-19T05:17:30.208999+0000","last_became_peered":"2024-09-19T05:17:30.208999+0000","last_unstale":"2024-09-19T05:17:49.259659+0000","last_undegraded":"2024-09-19T05:17:49.259659+0000","last_fullsized":"2024-09-19T05:17:49.259659+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":["7","5","8","9"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258361+0000","last_change":"2024-09-19T05:17:30.210132+0000","last_active":"2024-09-19T05:17:49.258361+0000","last_peered":"2024-09-19T05:17:49.258361+0000","last_clean":"2024-09-19T05:17:49.258361+0000","last_became_active":"2024-09-19T05:17:30.209240+0000","last_became_peered":"2024-09-19T05:17:30.209240+0000","last_unstale":"2024-09-19T05:17:49.258361+0000","last_undegraded":"2024-09-19T05:17:49.258361+0000","last_fullsized":"2024-09-19T05:17:49.258361+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:08:26.999751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259817+0000","last_change":"2024-09-19T05:17:49.259291+0000","last_active":"2024-09-19T05:17:49.259817+0000","last_peered":"2024-09-19T05:17:49.259817+0000","last_clean":"2024-09-19T05:17:49.259817+0000","last_became_active":"2024-09-19T05:17:49.258948+0000","last_became_peered":"2024-09-19T05:17:49.258948+0000","last_unstale":"2024-09-19T05:17:49.259817+0000","last_undegraded":"2024-09-19T05:17:49.259817+0000","last_fullsized":"2024-09-19T05:17:49.259817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:51.082539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,11],"acting":[9,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258154+0000","last_change":"2024-09-19T05:17:30.205429+0000","last_active":"2024-09-19T05:17:49.258154+0000","last_peered":"2024-09-19T05:17:49.258154+0000","last_clean":"2024-09-19T05:17:49.258154+0000","last_became_active":"2024-09-19T05:17:30.205094+0000","last_became_peered":"2024-09-19T05:17:30.205094+0000","last_unstale":"2024-09-19T05:17:49.258154+0000","last_undegraded":"2024-09-19T05:17:49.258154+0000","last_fullsized":"2024-09-19T05:17:49.258154+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:22.149473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258808+0000","last_change":"2024-09-19T05:17:30.213050+0000","last_active":"2024-09-19T05:17:49.258808+0000","last_peered":"2024-09-19T05:17:49.258808+0000","last_clean":"2024-09-19T05:17:49.258808+0000","last_became_active":"2024-09-19T05:17:30.211812+0000","last_became_peered":"2024-09-19T05:17:30.211812+0000","last_unstale":"2024-09-19T05:17:49.258808+0000","last_undegraded":"2024-09-19T05:17:49.258808+0000","last_fullsized":"2024-09-19T05:17:49.258808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:31.734317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259448+0000","last_change":"2024-09-19T05:17:30.212049+0000","last_active":"2024-09-19T05:17:49.259448+0000","last_peered":"2024-09-19T05:17:49.259448+0000","last_clean":"2024-09-19T05:17:49.259448+0000","last_became_active":"2024-09-19T05:17:30.211684+0000","last_became_peered":"2024-09-19T05:17:30.211684+0000","last_unstale":"2024-09-19T05:17:49.259448+0000","last_undegraded":"2024-09-19T05:17:49.259448+0000","last_fullsized":"2024-09-19T05:17:49.259448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:24.781815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255080+0000","last_change":"2024-09-19T05:17:30.191898+0000","last_active":"2024-09-19T05:17:49.255080+0000","last_peered":"2024-09-19T05:17:49.255080+0000","last_clean":"2024-09-19T05:17:49.255080+0000","last_became_active":"2024-09-19T05:17:30.191204+0000","last_became_peered":"2024-09-19T05:17:30.191204+0000","last_unstale":"2024-09-19T05:17:49.255080+0000","last_undegraded":"2024-09-19T05:17:49.255080+0000","last_fullsized":"2024-09-19T05:17:49.255080+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:19.043363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257585+0000","last_change":"2024-09-19T05:17:30.201754+0000","last_active":"2024-09-19T05:17:49.257585+0000","last_peered":"2024-09-19T05:17:49.257585+0000","last_clean":"2024-09-19T05:17:49.257585+0000","last_became_active":"2024-09-19T05:17:30.201439+0000","last_became_peered":"2024-09-19T05:17:30.201439+0000","last_unstale":"2024-09-19T05:17:49.257585+0000","last_undegraded":"2024-09-19T05:17:49.257585+0000","last_fullsized":"2024-09-19T05:17:49.257585+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:28.896899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257640+0000","last_change":"2024-09-19T05:17:30.202618+0000","last_active":"2024-09-19T05:17:49.257640+0000","last_peered":"2024-09-19T05:17:49.257640+0000","last_clean":"2024-09-19T05:17:49.257640+0000","last_became_active":"2024-09-19T05:17:30.202292+0000","last_became_peered":"2024-09-19T05:17:30.202292+0000","last_unstale":"2024-09-19T05:17:49.257640+0000","last_undegraded":"2024-09-19T05:17:49.257640+0000","last_fullsized":"2024-09-19T05:17:49.257640+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:54.206467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253112+0000","last_change":"2024-09-19T05:17:30.209411+0000","last_active":"2024-09-19T05:17:49.253112+0000","last_peered":"2024-09-19T05:17:49.253112+0000","last_clean":"2024-09-19T05:17:49.253112+0000","last_became_active":"2024-09-19T05:17:30.208525+0000","last_became_peered":"2024-09-19T05:17:30.208525+0000","last_unstale":"2024-09-19T05:17:49.253112+0000","last_undegraded":"2024-09-19T05:17:49.253112+0000","last_fullsized":"2024-09-19T05:17:49.253112+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:12:16.616413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255289+0000","last_change":"2024-09-19T05:17:30.203552+0000","last_active":"2024-09-19T05:17:49.255289+0000","last_peered":"2024-09-19T05:17:49.255289+0000","last_clean":"2024-09-19T05:17:49.255289+0000","last_became_active":"2024-09-19T05:17:30.203212+0000","last_became_peered":"2024-09-19T05:17:30.203212+0000","last_unstale":"2024-09-19T05:17:49.255289+0000","last_undegraded":"2024-09-19T05:17:49.255289+0000","last_fullsized":"2024-09-19T05:17:49.255289+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:38:50.948373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257055+0000","last_change":"2024-09-19T05:17:30.201540+0000","last_active":"2024-09-19T05:17:49.257055+0000","last_peered":"2024-09-19T05:17:49.257055+0000","last_clean":"2024-09-19T05:17:49.257055+0000","last_became_active":"2024-09-19T05:17:30.201222+0000","last_became_peered":"2024-09-19T05:17:30.201222+0000","last_unstale":"2024-09-19T05:17:49.257055+0000","last_undegraded":"2024-09-19T05:17:49.257055+0000","last_fullsized":"2024-09-19T05:17:49.257055+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:09.583473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253195+0000","last_change":"2024-09-19T05:17:30.205962+0000","last_active":"2024-09-19T05:17:49.253195+0000","last_peered":"2024-09-19T05:17:49.253195+0000","last_clean":"2024-09-19T05:17:49.253195+0000","last_became_active":"2024-09-19T05:17:30.205632+0000","last_became_peered":"2024-09-19T05:17:30.205632+0000","last_unstale":"2024-09-19T05:17:49.253195+0000","last_undegraded":"2024-09-19T05:17:49.253195+0000","last_fullsized":"2024-09-19T05:17:49.253195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:07.767502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254604+0000","last_change":"2024-09-19T05:17:30.208546+0000","last_active":"2024-09-19T05:17:49.254604+0000","last_peered":"2024-09-19T05:17:49.254604+0000","last_clean":"2024-09-19T05:17:49.254604+0000","last_became_active":"2024-09-19T05:17:30.208220+0000","last_became_peered":"2024-09-19T05:17:30.208220+0000","last_unstale":"2024-09-19T05:17:49.254604+0000","last_undegraded":"2024-09-19T05:17:49.254604+0000","last_fullsized":"2024-09-19T05:17:49.254604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:46:32.360282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255086+0000","last_change":"2024-09-19T05:17:30.204653+0000","last_active":"2024-09-19T05:17:49.255086+0000","last_peered":"2024-09-19T05:17:49.255086+0000","last_clean":"2024-09-19T05:17:49.255086+0000","last_became_active":"2024-09-19T05:17:30.204335+0000","last_became_peered":"2024-09-19T05:17:30.204335+0000","last_unstale":"2024-09-19T05:17:49.255086+0000","last_undegraded":"2024-09-19T05:17:49.255086+0000","last_fullsized":"2024-09-19T05:17:49.255086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:48.661902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.261216+0000","last_change":"2024-09-19T05:17:49.261216+0000","last_active":"2024-09-19T05:17:49.261216+0000","last_peered":"2024-09-19T05:17:49.261216+0000","last_clean":"2024-09-19T05:17:49.261216+0000","last_became_active":"2024-09-19T05:17:49.260691+0000","last_became_peered":"2024-09-19T05:17:49.260691+0000","last_unstale":"2024-09-19T05:17:49.261216+0000","last_undegraded":"2024-09-19T05:17:49.261216+0000","last_fullsized":"2024-09-19T05:17:49.261216+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:35.937669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,6],"acting":[1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257699+0000","last_change":"2024-09-19T05:17:30.201935+0000","last_active":"2024-09-19T05:17:49.257699+0000","last_peered":"2024-09-19T05:17:49.257699+0000","last_clean":"2024-09-19T05:17:49.257699+0000","last_became_active":"2024-09-19T05:17:30.201524+0000","last_became_peered":"2024-09-19T05:17:30.201524+0000","last_unstale":"2024-09-19T05:17:49.257699+0000","last_undegraded":"2024-09-19T05:17:49.257699+0000","last_fullsized":"2024-09-19T05:17:49.257699+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:34.018339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.506519+0000","last_change":"2024-09-19T05:17:49.506519+0000","last_active":"2024-09-19T05:17:49.506519+0000","last_peered":"2024-09-19T05:17:49.506519+0000","last_clean":"2024-09-19T05:17:49.506519+0000","last_became_active":"2024-09-19T05:17:49.506016+0000","last_became_peered":"2024-09-19T05:17:49.506016+0000","last_unstale":"2024-09-19T05:17:49.506519+0000","last_undegraded":"2024-09-19T05:17:49.506519+0000","last_fullsized":"2024-09-19T05:17:49.506519+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:31.064318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,8],"acting":[5,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258690+0000","last_change":"2024-09-19T05:17:30.205459+0000","last_active":"2024-09-19T05:17:49.258690+0000","last_peered":"2024-09-19T05:17:49.258690+0000","last_clean":"2024-09-19T05:17:49.258690+0000","last_became_active":"2024-09-19T05:17:30.205100+0000","last_became_peered":"2024-09-19T05:17:30.205100+0000","last_unstale":"2024-09-19T05:17:49.258690+0000","last_undegraded":"2024-09-19T05:17:49.258690+0000","last_fullsized":"2024-09-19T05:17:49.258690+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:35.246931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253212+0000","last_change":"2024-09-19T05:17:30.202812+0000","last_active":"2024-09-19T05:17:49.253212+0000","last_peered":"2024-09-19T05:17:49.253212+0000","last_clean":"2024-09-19T05:17:49.253212+0000","last_became_active":"2024-09-19T05:17:30.202477+0000","last_became_peered":"2024-09-19T05:17:30.202477+0000","last_unstale":"2024-09-19T05:17:49.253212+0000","last_undegraded":"2024-09-19T05:17:49.253212+0000","last_fullsized":"2024-09-19T05:17:49.253212+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:24.253576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254759+0000","last_change":"2024-09-19T05:17:30.206546+0000","last_active":"2024-09-19T05:17:49.254759+0000","last_peered":"2024-09-19T05:17:49.254759+0000","last_clean":"2024-09-19T05:17:49.254759+0000","last_became_active":"2024-09-19T05:17:30.206186+0000","last_became_peered":"2024-09-19T05:17:30.206186+0000","last_unstale":"2024-09-19T05:17:49.254759+0000","last_undegraded":"2024-09-19T05:17:49.254759+0000","last_fullsized":"2024-09-19T05:17:49.254759+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:30.589196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254959+0000","last_change":"2024-09-19T05:17:30.213894+0000","last_active":"2024-09-19T05:17:49.254959+0000","last_peered":"2024-09-19T05:17:49.254959+0000","last_clean":"2024-09-19T05:17:49.254959+0000","last_became_active":"2024-09-19T05:17:30.213586+0000","last_became_peered":"2024-09-19T05:17:30.213586+0000","last_unstale":"2024-09-19T05:17:49.254959+0000","last_undegraded":"2024-09-19T05:17:49.254959+0000","last_fullsized":"2024-09-19T05:17:49.254959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:46.215816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.262965+0000","last_change":"2024-09-19T05:17:49.262965+0000","last_active":"2024-09-19T05:17:49.262965+0000","last_peered":"2024-09-19T05:17:49.262965+0000","last_clean":"2024-09-19T05:17:49.262965+0000","last_became_active":"2024-09-19T05:17:49.262651+0000","last_became_peered":"2024-09-19T05:17:49.262651+0000","last_unstale":"2024-09-19T05:17:49.262965+0000","last_undegraded":"2024-09-19T05:17:49.262965+0000","last_fullsized":"2024-09-19T05:17:49.262965+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:57.601031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.252888+0000","last_change":"2024-09-19T05:17:30.204302+0000","last_active":"2024-09-19T05:17:49.252888+0000","last_peered":"2024-09-19T05:17:49.252888+0000","last_clean":"2024-09-19T05:17:49.252888+0000","last_became_active":"2024-09-19T05:17:30.203981+0000","last_became_peered":"2024-09-19T05:17:30.203981+0000","last_unstale":"2024-09-19T05:17:49.252888+0000","last_undegraded":"2024-09-19T05:17:49.252888+0000","last_fullsized":"2024-09-19T05:17:49.252888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:59.130439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.252943+0000","last_change":"2024-09-19T05:17:30.210610+0000","last_active":"2024-09-19T05:17:49.252943+0000","last_peered":"2024-09-19T05:17:49.252943+0000","last_clean":"2024-09-19T05:17:49.252943+0000","last_became_active":"2024-09-19T05:17:30.210231+0000","last_became_peered":"2024-09-19T05:17:30.210231+0000","last_unstale":"2024-09-19T05:17:49.252943+0000","last_undegraded":"2024-09-19T05:17:49.252943+0000","last_fullsized":"2024-09-19T05:17:49.252943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:37:41.885822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254442+0000","last_change":"2024-09-19T05:17:30.210755+0000","last_active":"2024-09-19T05:17:49.254442+0000","last_peered":"2024-09-19T05:17:49.254442+0000","last_clean":"2024-09-19T05:17:49.254442+0000","last_became_active":"2024-09-19T05:17:30.210383+0000","last_became_peered":"2024-09-19T05:17:30.210383+0000","last_unstale":"2024-09-19T05:17:49.254442+0000","last_undegraded":"2024-09-19T05:17:49.254442+0000","last_fullsized":"2024-09-19T05:17:49.254442+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:11.259830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T05:17:48.258739+0000","last_change":"2024-09-19T05:17:30.206345+0000","last_active":"2024-09-19T05:17:48.258739+0000","last_peered":"2024-09-19T05:17:48.258739+0000","last_clean":"2024-09-19T05:17:48.258739+0000","last_became_active":"2024-09-19T05:17:30.205988+0000","last_became_peered":"2024-09-19T05:17:30.205988+0000","last_unstale":"2024-09-19T05:17:48.258739+0000","last_undegraded":"2024-09-19T05:17:48.258739+0000","last_fullsized":"2024-09-19T05:17:48.258739+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:57.538280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":39,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255547+0000","last_change":"2024-09-19T05:17:28.183851+0000","last_active":"2024-09-19T05:17:49.255547+0000","last_peered":"2024-09-19T05:17:49.255547+0000","last_clean":"2024-09-19T05:17:49.255547+0000","last_became_active":"2024-09-19T05:17:28.183472+0000","last_became_peered":"2024-09-19T05:17:28.183472+0000","last_unstale":"2024-09-19T05:17:49.255547+0000","last_undegraded":"2024-09-19T05:17:49.255547+0000","last_fullsized":"2024-09-19T05:17:49.255547+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:22.942306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255294+0000","last_change":"2024-09-19T05:17:30.208784+0000","last_active":"2024-09-19T05:17:49.255294+0000","last_peered":"2024-09-19T05:17:49.255294+0000","last_clean":"2024-09-19T05:17:49.255294+0000","last_became_active":"2024-09-19T05:17:30.208232+0000","last_became_peered":"2024-09-19T05:17:30.208232+0000","last_unstale":"2024-09-19T05:17:49.255294+0000","last_undegraded":"2024-09-19T05:17:49.255294+0000","last_fullsized":"2024-09-19T05:17:49.255294+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:07.670401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257109+0000","last_change":"2024-09-19T05:17:28.181480+0000","last_active":"2024-09-19T05:17:49.257109+0000","last_peered":"2024-09-19T05:17:49.257109+0000","last_clean":"2024-09-19T05:17:49.257109+0000","last_became_active":"2024-09-19T05:17:28.181169+0000","last_became_peered":"2024-09-19T05:17:28.181169+0000","last_unstale":"2024-09-19T05:17:49.257109+0000","last_undegraded":"2024-09-19T05:17:49.257109+0000","last_fullsized":"2024-09-19T05:17:49.257109+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:09.590408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254730+0000","last_change":"2024-09-19T05:17:28.180636+0000","last_active":"2024-09-19T05:17:49.254730+0000","last_peered":"2024-09-19T05:17:49.254730+0000","last_clean":"2024-09-19T05:17:49.254730+0000","last_became_active":"2024-09-19T05:17:28.180298+0000","last_became_peered":"2024-09-19T05:17:28.180298+0000","last_unstale":"2024-09-19T05:17:49.254730+0000","last_undegraded":"2024-09-19T05:17:49.254730+0000","last_fullsized":"2024-09-19T05:17:49.254730+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:06.361677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258465+0000","last_change":"2024-09-19T05:17:30.199091+0000","last_active":"2024-09-19T05:17:49.258465+0000","last_peered":"2024-09-19T05:17:49.258465+0000","last_clean":"2024-09-19T05:17:49.258465+0000","last_became_active":"2024-09-19T05:17:30.198805+0000","last_became_peered":"2024-09-19T05:17:30.198805+0000","last_unstale":"2024-09-19T05:17:49.258465+0000","last_undegraded":"2024-09-19T05:17:49.258465+0000","last_fullsized":"2024-09-19T05:17:49.258465+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:27.906713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.256486+0000","last_change":"2024-09-19T05:17:28.182281+0000","last_active":"2024-09-19T05:17:49.256486+0000","last_peered":"2024-09-19T05:17:49.256486+0000","last_clean":"2024-09-19T05:17:49.256486+0000","last_became_active":"2024-09-19T05:17:28.181939+0000","last_became_peered":"2024-09-19T05:17:28.181939+0000","last_unstale":"2024-09-19T05:17:49.256486+0000","last_undegraded":"2024-09-19T05:17:49.256486+0000","last_fullsized":"2024-09-19T05:17:49.256486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:12.057601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.256715+0000","last_change":"2024-09-19T05:17:30.198849+0000","last_active":"2024-09-19T05:17:49.256715+0000","last_peered":"2024-09-19T05:17:49.256715+0000","last_clean":"2024-09-19T05:17:49.256715+0000","last_became_active":"2024-09-19T05:17:30.198473+0000","last_became_peered":"2024-09-19T05:17:30.198473+0000","last_unstale":"2024-09-19T05:17:49.256715+0000","last_undegraded":"2024-09-19T05:17:49.256715+0000","last_fullsized":"2024-09-19T05:17:49.256715+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:20.591516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:51.262428+0000","last_change":"2024-09-19T05:17:28.181393+0000","last_active":"2024-09-19T05:17:51.262428+0000","last_peered":"2024-09-19T05:17:51.262428+0000","last_clean":"2024-09-19T05:17:51.262428+0000","last_became_active":"2024-09-19T05:17:28.181069+0000","last_became_peered":"2024-09-19T05:17:28.181069+0000","last_unstale":"2024-09-19T05:17:51.262428+0000","last_undegraded":"2024-09-19T05:17:51.262428+0000","last_fullsized":"2024-09-19T05:17:51.262428+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:15.684564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253792+0000","last_change":"2024-09-19T05:17:30.204968+0000","last_active":"2024-09-19T05:17:49.253792+0000","last_peered":"2024-09-19T05:17:49.253792+0000","last_clean":"2024-09-19T05:17:49.253792+0000","last_became_active":"2024-09-19T05:17:30.204613+0000","last_became_peered":"2024-09-19T05:17:30.204613+0000","last_unstale":"2024-09-19T05:17:49.253792+0000","last_undegraded":"2024-09-19T05:17:49.253792+0000","last_fullsized":"2024-09-19T05:17:49.253792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:14.836220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258502+0000","last_change":"2024-09-19T05:17:28.185554+0000","last_active":"2024-09-19T05:17:49.258502+0000","last_peered":"2024-09-19T05:17:49.258502+0000","last_clean":"2024-09-19T05:17:49.258502+0000","last_became_active":"2024-09-19T05:17:28.185198+0000","last_became_peered":"2024-09-19T05:17:28.185198+0000","last_unstale":"2024-09-19T05:17:49.258502+0000","last_undegraded":"2024-09-19T05:17:49.258502+0000","last_fullsized":"2024-09-19T05:17:49.258502+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:59.753359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258434+0000","last_change":"2024-09-19T05:17:30.207418+0000","last_active":"2024-09-19T05:17:49.258434+0000","last_peered":"2024-09-19T05:17:49.258434+0000","last_clean":"2024-09-19T05:17:49.258434+0000","last_became_active":"2024-09-19T05:17:30.207079+0000","last_became_peered":"2024-09-19T05:17:30.207079+0000","last_unstale":"2024-09-19T05:17:49.258434+0000","last_undegraded":"2024-09-19T05:17:49.258434+0000","last_fullsized":"2024-09-19T05:17:49.258434+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:40:49.564649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255759+0000","last_change":"2024-09-19T05:17:28.204988+0000","last_active":"2024-09-19T05:17:49.255759+0000","last_peered":"2024-09-19T05:17:49.255759+0000","last_clean":"2024-09-19T05:17:49.255759+0000","last_became_active":"2024-09-19T05:17:28.204607+0000","last_became_peered":"2024-09-19T05:17:28.204607+0000","last_unstale":"2024-09-19T05:17:49.255759+0000","last_undegraded":"2024-09-19T05:17:49.255759+0000","last_fullsized":"2024-09-19T05:17:49.255759+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:17.914720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253360+0000","last_change":"2024-09-19T05:17:30.207876+0000","last_active":"2024-09-19T05:17:49.253360+0000","last_peered":"2024-09-19T05:17:49.253360+0000","last_clean":"2024-09-19T05:17:49.253360+0000","last_became_active":"2024-09-19T05:17:30.207561+0000","last_became_peered":"2024-09-19T05:17:30.207561+0000","last_unstale":"2024-09-19T05:17:49.253360+0000","last_undegraded":"2024-09-19T05:17:49.253360+0000","last_fullsized":"2024-09-19T05:17:49.253360+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:26.696949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'26","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:52.265939+0000","last_change":"2024-09-19T05:17:28.185152+0000","last_active":"2024-09-19T05:17:52.265939+0000","last_peered":"2024-09-19T05:17:52.265939+0000","last_clean":"2024-09-19T05:17:52.265939+0000","last_became_active":"2024-09-19T05:17:28.184792+0000","last_became_peered":"2024-09-19T05:17:28.184792+0000","last_unstale":"2024-09-19T05:17:52.265939+0000","last_undegraded":"2024-09-19T05:17:52.265939+0000","last_fullsized":"2024-09-19T05:17:52.265939+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:04.647138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52100,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":66,"num_write":27,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T05:17:48.259096+0000","last_change":"2024-09-19T05:17:30.209768+0000","last_active":"2024-09-19T05:17:48.259096+0000","last_peered":"2024-09-19T05:17:48.259096+0000","last_clean":"2024-09-19T05:17:48.259096+0000","last_became_active":"2024-09-19T05:17:30.209399+0000","last_became_peered":"2024-09-19T05:17:30.209399+0000","last_unstale":"2024-09-19T05:17:48.259096+0000","last_undegraded":"2024-09-19T05:17:48.259096+0000","last_fullsized":"2024-09-19T05:17:48.259096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:58.664138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.269672+0000","last_change":"2024-09-19T05:17:49.269241+0000","last_active":"2024-09-19T05:17:49.269672+0000","last_peered":"2024-09-19T05:17:49.269672+0000","last_clean":"2024-09-19T05:17:49.269672+0000","last_became_active":"2024-09-19T05:17:49.259494+0000","last_became_peered":"2024-09-19T05:17:49.259494+0000","last_unstale":"2024-09-19T05:17:49.269672+0000","last_undegraded":"2024-09-19T05:17:49.269672+0000","last_fullsized":"2024-09-19T05:17:49.269672+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:59.866742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254867+0000","last_change":"2024-09-19T05:17:30.204554+0000","last_active":"2024-09-19T05:17:49.254867+0000","last_peered":"2024-09-19T05:17:49.254867+0000","last_clean":"2024-09-19T05:17:49.254867+0000","last_became_active":"2024-09-19T05:17:30.203166+0000","last_became_peered":"2024-09-19T05:17:30.203166+0000","last_unstale":"2024-09-19T05:17:49.254867+0000","last_undegraded":"2024-09-19T05:17:49.254867+0000","last_fullsized":"2024-09-19T05:17:49.254867+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:23.517869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255318+0000","last_change":"2024-09-19T05:17:28.183800+0000","last_active":"2024-09-19T05:17:49.255318+0000","last_peered":"2024-09-19T05:17:49.255318+0000","last_clean":"2024-09-19T05:17:49.255318+0000","last_became_active":"2024-09-19T05:17:28.182819+0000","last_became_peered":"2024-09-19T05:17:28.182819+0000","last_unstale":"2024-09-19T05:17:49.255318+0000","last_undegraded":"2024-09-19T05:17:49.255318+0000","last_fullsized":"2024-09-19T05:17:49.255318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:44:52.215544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257754+0000","last_change":"2024-09-19T05:17:30.214723+0000","last_active":"2024-09-19T05:17:49.257754+0000","last_peered":"2024-09-19T05:17:49.257754+0000","last_clean":"2024-09-19T05:17:49.257754+0000","last_became_active":"2024-09-19T05:17:30.214343+0000","last_became_peered":"2024-09-19T05:17:30.214343+0000","last_unstale":"2024-09-19T05:17:49.257754+0000","last_undegraded":"2024-09-19T05:17:49.257754+0000","last_fullsized":"2024-09-19T05:17:49.257754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:13.008151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259087+0000","last_change":"2024-09-19T05:17:28.183130+0000","last_active":"2024-09-19T05:17:49.259087+0000","last_peered":"2024-09-19T05:17:49.259087+0000","last_clean":"2024-09-19T05:17:49.259087+0000","last_became_active":"2024-09-19T05:17:28.182834+0000","last_became_peered":"2024-09-19T05:17:28.182834+0000","last_unstale":"2024-09-19T05:17:49.259087+0000","last_undegraded":"2024-09-19T05:17:49.259087+0000","last_fullsized":"2024-09-19T05:17:49.259087+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:48.683776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257284+0000","last_change":"2024-09-19T05:17:30.212438+0000","last_active":"2024-09-19T05:17:49.257284+0000","last_peered":"2024-09-19T05:17:49.257284+0000","last_clean":"2024-09-19T05:17:49.257284+0000","last_became_active":"2024-09-19T05:17:30.209321+0000","last_became_peered":"2024-09-19T05:17:30.209321+0000","last_unstale":"2024-09-19T05:17:49.257284+0000","last_undegraded":"2024-09-19T05:17:49.257284+0000","last_fullsized":"2024-09-19T05:17:49.257284+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:42.772116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":36,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T05:17:48.258110+0000","last_change":"2024-09-19T05:17:28.204665+0000","last_active":"2024-09-19T05:17:48.258110+0000","last_peered":"2024-09-19T05:17:48.258110+0000","last_clean":"2024-09-19T05:17:48.258110+0000","last_became_active":"2024-09-19T05:17:28.204309+0000","last_became_peered":"2024-09-19T05:17:28.204309+0000","last_unstale":"2024-09-19T05:17:48.258110+0000","last_undegraded":"2024-09-19T05:17:48.258110+0000","last_fullsized":"2024-09-19T05:17:48.258110+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:26.372762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255224+0000","last_change":"2024-09-19T05:17:30.208518+0000","last_active":"2024-09-19T05:17:49.255224+0000","last_peered":"2024-09-19T05:17:49.255224+0000","last_clean":"2024-09-19T05:17:49.255224+0000","last_became_active":"2024-09-19T05:17:30.208172+0000","last_became_peered":"2024-09-19T05:17:30.208172+0000","last_unstale":"2024-09-19T05:17:49.255224+0000","last_undegraded":"2024-09-19T05:17:49.255224+0000","last_fullsized":"2024-09-19T05:17:49.255224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:40:25.754925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":23,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T05:17:48.259526+0000","last_change":"2024-09-19T05:17:28.180930+0000","last_active":"2024-09-19T05:17:48.259526+0000","last_peered":"2024-09-19T05:17:48.259526+0000","last_clean":"2024-09-19T05:17:48.259526+0000","last_became_active":"2024-09-19T05:17:28.180575+0000","last_became_peered":"2024-09-19T05:17:28.180575+0000","last_unstale":"2024-09-19T05:17:48.259526+0000","last_undegraded":"2024-09-19T05:17:48.259526+0000","last_fullsized":"2024-09-19T05:17:48.259526+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:36:15.390852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254917+0000","last_change":"2024-09-19T05:17:30.207002+0000","last_active":"2024-09-19T05:17:49.254917+0000","last_peered":"2024-09-19T05:17:49.254917+0000","last_clean":"2024-09-19T05:17:49.254917+0000","last_became_active":"2024-09-19T05:17:30.205750+0000","last_became_peered":"2024-09-19T05:17:30.205750+0000","last_unstale":"2024-09-19T05:17:49.254917+0000","last_undegraded":"2024-09-19T05:17:49.254917+0000","last_fullsized":"2024-09-19T05:17:49.254917+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:25:18.716206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255138+0000","last_change":"2024-09-19T05:17:28.184071+0000","last_active":"2024-09-19T05:17:49.255138+0000","last_peered":"2024-09-19T05:17:49.255138+0000","last_clean":"2024-09-19T05:17:49.255138+0000","last_became_active":"2024-09-19T05:17:28.183708+0000","last_became_peered":"2024-09-19T05:17:28.183708+0000","last_unstale":"2024-09-19T05:17:49.255138+0000","last_undegraded":"2024-09-19T05:17:49.255138+0000","last_fullsized":"2024-09-19T05:17:49.255138+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:57:23.831000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257299+0000","last_change":"2024-09-19T05:17:30.211919+0000","last_active":"2024-09-19T05:17:49.257299+0000","last_peered":"2024-09-19T05:17:49.257299+0000","last_clean":"2024-09-19T05:17:49.257299+0000","last_became_active":"2024-09-19T05:17:30.210639+0000","last_became_peered":"2024-09-19T05:17:30.210639+0000","last_unstale":"2024-09-19T05:17:49.257299+0000","last_undegraded":"2024-09-19T05:17:49.257299+0000","last_fullsized":"2024-09-19T05:17:49.257299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:25.231732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255846+0000","last_change":"2024-09-19T05:17:28.179372+0000","last_active":"2024-09-19T05:17:49.255846+0000","last_peered":"2024-09-19T05:17:49.255846+0000","last_clean":"2024-09-19T05:17:49.255846+0000","last_became_active":"2024-09-19T05:17:28.178792+0000","last_became_peered":"2024-09-19T05:17:28.178792+0000","last_unstale":"2024-09-19T05:17:49.255846+0000","last_undegraded":"2024-09-19T05:17:49.255846+0000","last_fullsized":"2024-09-19T05:17:49.255846+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:54.705552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258607+0000","last_change":"2024-09-19T05:17:30.208201+0000","last_active":"2024-09-19T05:17:49.258607+0000","last_peered":"2024-09-19T05:17:49.258607+0000","last_clean":"2024-09-19T05:17:49.258607+0000","last_became_active":"2024-09-19T05:17:30.207865+0000","last_became_peered":"2024-09-19T05:17:30.207865+0000","last_unstale":"2024-09-19T05:17:49.258607+0000","last_undegraded":"2024-09-19T05:17:49.258607+0000","last_fullsized":"2024-09-19T05:17:49.258607+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:35.954759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253446+0000","last_change":"2024-09-19T05:17:28.543685+0000","last_active":"2024-09-19T05:17:49.253446+0000","last_peered":"2024-09-19T05:17:49.253446+0000","last_clean":"2024-09-19T05:17:49.253446+0000","last_became_active":"2024-09-19T05:17:28.543292+0000","last_became_peered":"2024-09-19T05:17:28.543292+0000","last_unstale":"2024-09-19T05:17:49.253446+0000","last_undegraded":"2024-09-19T05:17:49.253446+0000","last_fullsized":"2024-09-19T05:17:49.253446+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:55:14.348544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258916+0000","last_change":"2024-09-19T05:17:30.212449+0000","last_active":"2024-09-19T05:17:49.258916+0000","last_peered":"2024-09-19T05:17:49.258916+0000","last_clean":"2024-09-19T05:17:49.258916+0000","last_became_active":"2024-09-19T05:17:30.211265+0000","last_became_peered":"2024-09-19T05:17:30.211265+0000","last_unstale":"2024-09-19T05:17:49.258916+0000","last_undegraded":"2024-09-19T05:17:49.258916+0000","last_fullsized":"2024-09-19T05:17:49.258916+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:27.687687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":346,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257570+0000","last_change":"2024-09-19T05:16:20.361975+0000","last_active":"2024-09-19T05:17:49.257570+0000","last_peered":"2024-09-19T05:17:49.257570+0000","last_clean":"2024-09-19T05:17:49.257570+0000","last_became_active":"2024-09-19T05:16:20.361553+0000","last_became_peered":"2024-09-19T05:16:20.361553+0000","last_unstale":"2024-09-19T05:17:49.257570+0000","last_undegraded":"2024-09-19T05:17:49.257570+0000","last_fullsized":"2024-09-19T05:17:49.257570+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:13:02.674575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:13:02.674575+0000","last_clean_scrub_stamp":"2024-09-19T05:13:02.674575+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:48.711411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259170+0000","last_change":"2024-09-19T05:17:28.180486+0000","last_active":"2024-09-19T05:17:49.259170+0000","last_peered":"2024-09-19T05:17:49.259170+0000","last_clean":"2024-09-19T05:17:49.259170+0000","last_became_active":"2024-09-19T05:17:28.180147+0000","last_became_peered":"2024-09-19T05:17:28.180147+0000","last_unstale":"2024-09-19T05:17:49.259170+0000","last_undegraded":"2024-09-19T05:17:49.259170+0000","last_fullsized":"2024-09-19T05:17:49.259170+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:57.820328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258205+0000","last_change":"2024-09-19T05:17:30.205560+0000","last_active":"2024-09-19T05:17:49.258205+0000","last_peered":"2024-09-19T05:17:49.258205+0000","last_clean":"2024-09-19T05:17:49.258205+0000","last_became_active":"2024-09-19T05:17:30.205269+0000","last_became_peered":"2024-09-19T05:17:30.205269+0000","last_unstale":"2024-09-19T05:17:49.258205+0000","last_undegraded":"2024-09-19T05:17:49.258205+0000","last_fullsized":"2024-09-19T05:17:49.258205+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:22.904616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257462+0000","last_change":"2024-09-19T05:17:28.181845+0000","last_active":"2024-09-19T05:17:49.257462+0000","last_peered":"2024-09-19T05:17:49.257462+0000","last_clean":"2024-09-19T05:17:49.257462+0000","last_became_active":"2024-09-19T05:17:28.181549+0000","last_became_peered":"2024-09-19T05:17:28.181549+0000","last_unstale":"2024-09-19T05:17:49.257462+0000","last_undegraded":"2024-09-19T05:17:49.257462+0000","last_fullsized":"2024-09-19T05:17:49.257462+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:01.222364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259631+0000","last_change":"2024-09-19T05:17:49.259631+0000","last_active":"2024-09-19T05:17:49.259631+0000","last_peered":"2024-09-19T05:17:49.259631+0000","last_clean":"2024-09-19T05:17:49.259631+0000","last_became_active":"2024-09-19T05:17:49.259240+0000","last_became_peered":"2024-09-19T05:17:49.259240+0000","last_unstale":"2024-09-19T05:17:49.259631+0000","last_undegraded":"2024-09-19T05:17:49.259631+0000","last_fullsized":"2024-09-19T05:17:49.259631+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:22.533248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255004+0000","last_change":"2024-09-19T05:17:28.204924+0000","last_active":"2024-09-19T05:17:49.255004+0000","last_peered":"2024-09-19T05:17:49.255004+0000","last_clean":"2024-09-19T05:17:49.255004+0000","last_became_active":"2024-09-19T05:17:28.204602+0000","last_became_peered":"2024-09-19T05:17:28.204602+0000","last_unstale":"2024-09-19T05:17:49.255004+0000","last_undegraded":"2024-09-19T05:17:49.255004+0000","last_fullsized":"2024-09-19T05:17:49.255004+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:13.303939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259147+0000","last_change":"2024-09-19T05:17:49.259147+0000","last_active":"2024-09-19T05:17:49.259147+0000","last_peered":"2024-09-19T05:17:49.259147+0000","last_clean":"2024-09-19T05:17:49.259147+0000","last_became_active":"2024-09-19T05:17:49.258666+0000","last_became_peered":"2024-09-19T05:17:49.258666+0000","last_unstale":"2024-09-19T05:17:49.259147+0000","last_undegraded":"2024-09-19T05:17:49.259147+0000","last_fullsized":"2024-09-19T05:17:49.259147+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:54.802994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257809+0000","last_change":"2024-09-19T05:17:28.182456+0000","last_active":"2024-09-19T05:17:49.257809+0000","last_peered":"2024-09-19T05:17:49.257809+0000","last_clean":"2024-09-19T05:17:49.257809+0000","last_became_active":"2024-09-19T05:17:28.182075+0000","last_became_peered":"2024-09-19T05:17:28.182075+0000","last_unstale":"2024-09-19T05:17:49.257809+0000","last_undegraded":"2024-09-19T05:17:49.257809+0000","last_fullsized":"2024-09-19T05:17:49.257809+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:42.771641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257506+0000","last_change":"2024-09-19T05:17:30.204300+0000","last_active":"2024-09-19T05:17:49.257506+0000","last_peered":"2024-09-19T05:17:49.257506+0000","last_clean":"2024-09-19T05:17:49.257506+0000","last_became_active":"2024-09-19T05:17:30.203840+0000","last_became_peered":"2024-09-19T05:17:30.203840+0000","last_unstale":"2024-09-19T05:17:49.257506+0000","last_undegraded":"2024-09-19T05:17:49.257506+0000","last_fullsized":"2024-09-19T05:17:49.257506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:48.363862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.256914+0000","last_change":"2024-09-19T05:17:28.204474+0000","last_active":"2024-09-19T05:17:49.256914+0000","last_peered":"2024-09-19T05:17:49.256914+0000","last_clean":"2024-09-19T05:17:49.256914+0000","last_became_active":"2024-09-19T05:17:28.204143+0000","last_became_peered":"2024-09-19T05:17:28.204143+0000","last_unstale":"2024-09-19T05:17:49.256914+0000","last_undegraded":"2024-09-19T05:17:49.256914+0000","last_fullsized":"2024-09-19T05:17:49.256914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:46.647789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257702+0000","last_change":"2024-09-19T05:17:30.198791+0000","last_active":"2024-09-19T05:17:49.257702+0000","last_peered":"2024-09-19T05:17:49.257702+0000","last_clean":"2024-09-19T05:17:49.257702+0000","last_became_active":"2024-09-19T05:17:30.198399+0000","last_became_peered":"2024-09-19T05:17:30.198399+0000","last_unstale":"2024-09-19T05:17:49.257702+0000","last_undegraded":"2024-09-19T05:17:49.257702+0000","last_fullsized":"2024-09-19T05:17:49.257702+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:46.676625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T05:17:48.259237+0000","last_change":"2024-09-19T05:17:28.204690+0000","last_active":"2024-09-19T05:17:48.259237+0000","last_peered":"2024-09-19T05:17:48.259237+0000","last_clean":"2024-09-19T05:17:48.259237+0000","last_became_active":"2024-09-19T05:17:28.204377+0000","last_became_peered":"2024-09-19T05:17:28.204377+0000","last_unstale":"2024-09-19T05:17:48.259237+0000","last_undegraded":"2024-09-19T05:17:48.259237+0000","last_fullsized":"2024-09-19T05:17:48.259237+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:29:20.583163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254992+0000","last_change":"2024-09-19T05:17:30.200584+0000","last_active":"2024-09-19T05:17:49.254992+0000","last_peered":"2024-09-19T05:17:49.254992+0000","last_clean":"2024-09-19T05:17:49.254992+0000","last_became_active":"2024-09-19T05:17:30.200270+0000","last_became_peered":"2024-09-19T05:17:30.200270+0000","last_unstale":"2024-09-19T05:17:49.254992+0000","last_undegraded":"2024-09-19T05:17:49.254992+0000","last_fullsized":"2024-09-19T05:17:49.254992+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:24:43.493332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:51.196734+0000","last_change":"2024-09-19T05:17:28.181020+0000","last_active":"2024-09-19T05:17:51.196734+0000","last_peered":"2024-09-19T05:17:51.196734+0000","last_clean":"2024-09-19T05:17:51.196734+0000","last_became_active":"2024-09-19T05:17:28.180298+0000","last_became_peered":"2024-09-19T05:17:28.180298+0000","last_unstale":"2024-09-19T05:17:51.196734+0000","last_undegraded":"2024-09-19T05:17:51.196734+0000","last_fullsized":"2024-09-19T05:17:51.196734+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:32.931699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258799+0000","last_change":"2024-09-19T05:17:30.209632+0000","last_active":"2024-09-19T05:17:49.258799+0000","last_peered":"2024-09-19T05:17:49.258799+0000","last_clean":"2024-09-19T05:17:49.258799+0000","last_became_active":"2024-09-19T05:17:30.209334+0000","last_became_peered":"2024-09-19T05:17:30.209334+0000","last_unstale":"2024-09-19T05:17:49.258799+0000","last_undegraded":"2024-09-19T05:17:49.258799+0000","last_fullsized":"2024-09-19T05:17:49.258799+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:21.159099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259725+0000","last_change":"2024-09-19T05:17:28.543802+0000","last_active":"2024-09-19T05:17:49.259725+0000","last_peered":"2024-09-19T05:17:49.259725+0000","last_clean":"2024-09-19T05:17:49.259725+0000","last_became_active":"2024-09-19T05:17:28.543503+0000","last_became_peered":"2024-09-19T05:17:28.543503+0000","last_unstale":"2024-09-19T05:17:49.259725+0000","last_undegraded":"2024-09-19T05:17:49.259725+0000","last_fullsized":"2024-09-19T05:17:49.259725+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:13.764141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258058+0000","last_change":"2024-09-19T05:17:30.206755+0000","last_active":"2024-09-19T05:17:49.258058+0000","last_peered":"2024-09-19T05:17:49.258058+0000","last_clean":"2024-09-19T05:17:49.258058+0000","last_became_active":"2024-09-19T05:17:30.205757+0000","last_became_peered":"2024-09-19T05:17:30.205757+0000","last_unstale":"2024-09-19T05:17:49.258058+0000","last_undegraded":"2024-09-19T05:17:49.258058+0000","last_fullsized":"2024-09-19T05:17:49.258058+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:16.281294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253238+0000","last_change":"2024-09-19T05:17:28.204819+0000","last_active":"2024-09-19T05:17:49.253238+0000","last_peered":"2024-09-19T05:17:49.253238+0000","last_clean":"2024-09-19T05:17:49.253238+0000","last_became_active":"2024-09-19T05:17:28.204445+0000","last_became_peered":"2024-09-19T05:17:28.204445+0000","last_unstale":"2024-09-19T05:17:49.253238+0000","last_undegraded":"2024-09-19T05:17:49.253238+0000","last_fullsized":"2024-09-19T05:17:49.253238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:26.473654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T05:17:48.258603+0000","last_change":"2024-09-19T05:17:30.201331+0000","last_active":"2024-09-19T05:17:48.258603+0000","last_peered":"2024-09-19T05:17:48.258603+0000","last_clean":"2024-09-19T05:17:48.258603+0000","last_became_active":"2024-09-19T05:17:30.200992+0000","last_became_peered":"2024-09-19T05:17:30.200992+0000","last_unstale":"2024-09-19T05:17:48.258603+0000","last_undegraded":"2024-09-19T05:17:48.258603+0000","last_fullsized":"2024-09-19T05:17:48.258603+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:17.033786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257860+0000","last_change":"2024-09-19T05:17:28.180149+0000","last_active":"2024-09-19T05:17:49.257860+0000","last_peered":"2024-09-19T05:17:49.257860+0000","last_clean":"2024-09-19T05:17:49.257860+0000","last_became_active":"2024-09-19T05:17:28.179767+0000","last_became_peered":"2024-09-19T05:17:28.179767+0000","last_unstale":"2024-09-19T05:17:49.257860+0000","last_undegraded":"2024-09-19T05:17:49.257860+0000","last_fullsized":"2024-09-19T05:17:49.257860+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:25.074252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254511+0000","last_change":"2024-09-19T05:17:30.204533+0000","last_active":"2024-09-19T05:17:49.254511+0000","last_peered":"2024-09-19T05:17:49.254511+0000","last_clean":"2024-09-19T05:17:49.254511+0000","last_became_active":"2024-09-19T05:17:30.204224+0000","last_became_peered":"2024-09-19T05:17:30.204224+0000","last_unstale":"2024-09-19T05:17:49.254511+0000","last_undegraded":"2024-09-19T05:17:49.254511+0000","last_fullsized":"2024-09-19T05:17:49.254511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:11.021297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253084+0000","last_change":"2024-09-19T05:17:28.187544+0000","last_active":"2024-09-19T05:17:49.253084+0000","last_peered":"2024-09-19T05:17:49.253084+0000","last_clean":"2024-09-19T05:17:49.253084+0000","last_became_active":"2024-09-19T05:17:28.187068+0000","last_became_peered":"2024-09-19T05:17:28.187068+0000","last_unstale":"2024-09-19T05:17:49.253084+0000","last_undegraded":"2024-09-19T05:17:49.253084+0000","last_fullsized":"2024-09-19T05:17:49.253084+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:01.151721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257927+0000","last_change":"2024-09-19T05:17:30.209549+0000","last_active":"2024-09-19T05:17:49.257927+0000","last_peered":"2024-09-19T05:17:49.257927+0000","last_clean":"2024-09-19T05:17:49.257927+0000","last_became_active":"2024-09-19T05:17:30.209225+0000","last_became_peered":"2024-09-19T05:17:30.209225+0000","last_unstale":"2024-09-19T05:17:49.257927+0000","last_undegraded":"2024-09-19T05:17:49.257927+0000","last_fullsized":"2024-09-19T05:17:49.257927+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:38.023351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T05:17:48.258481+0000","last_change":"2024-09-19T05:17:28.186601+0000","last_active":"2024-09-19T05:17:48.258481+0000","last_peered":"2024-09-19T05:17:48.258481+0000","last_clean":"2024-09-19T05:17:48.258481+0000","last_became_active":"2024-09-19T05:17:28.186236+0000","last_became_peered":"2024-09-19T05:17:28.186236+0000","last_unstale":"2024-09-19T05:17:48.258481+0000","last_undegraded":"2024-09-19T05:17:48.258481+0000","last_fullsized":"2024-09-19T05:17:48.258481+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:08.527906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257720+0000","last_change":"2024-09-19T05:17:30.203633+0000","last_active":"2024-09-19T05:17:49.257720+0000","last_peered":"2024-09-19T05:17:49.257720+0000","last_clean":"2024-09-19T05:17:49.257720+0000","last_became_active":"2024-09-19T05:17:30.203313+0000","last_became_peered":"2024-09-19T05:17:30.203313+0000","last_unstale":"2024-09-19T05:17:49.257720+0000","last_undegraded":"2024-09-19T05:17:49.257720+0000","last_fullsized":"2024-09-19T05:17:49.257720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:40.442434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.260731+0000","last_change":"2024-09-19T05:17:49.260345+0000","last_active":"2024-09-19T05:17:49.260731+0000","last_peered":"2024-09-19T05:17:49.260731+0000","last_clean":"2024-09-19T05:17:49.260731+0000","last_became_active":"2024-09-19T05:17:49.259938+0000","last_became_peered":"2024-09-19T05:17:49.259938+0000","last_unstale":"2024-09-19T05:17:49.260731+0000","last_undegraded":"2024-09-19T05:17:49.260731+0000","last_fullsized":"2024-09-19T05:17:49.260731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:01.904276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T05:17:48.258889+0000","last_change":"2024-09-19T05:17:28.182014+0000","last_active":"2024-09-19T05:17:48.258889+0000","last_peered":"2024-09-19T05:17:48.258889+0000","last_clean":"2024-09-19T05:17:48.258889+0000","last_became_active":"2024-09-19T05:17:28.181666+0000","last_became_peered":"2024-09-19T05:17:28.181666+0000","last_unstale":"2024-09-19T05:17:48.258889+0000","last_undegraded":"2024-09-19T05:17:48.258889+0000","last_fullsized":"2024-09-19T05:17:48.258889+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:00:57.069618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253344+0000","last_change":"2024-09-19T05:17:30.206428+0000","last_active":"2024-09-19T05:17:49.253344+0000","last_peered":"2024-09-19T05:17:49.253344+0000","last_clean":"2024-09-19T05:17:49.253344+0000","last_became_active":"2024-09-19T05:17:30.205818+0000","last_became_peered":"2024-09-19T05:17:30.205818+0000","last_unstale":"2024-09-19T05:17:49.253344+0000","last_undegraded":"2024-09-19T05:17:49.253344+0000","last_fullsized":"2024-09-19T05:17:49.253344+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:26.059019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-19T05:17:48.259173+0000","last_change":"2024-09-19T05:17:28.185596+0000","last_active":"2024-09-19T05:17:48.259173+0000","last_peered":"2024-09-19T05:17:48.259173+0000","last_clean":"2024-09-19T05:17:48.259173+0000","last_became_active":"2024-09-19T05:17:28.185278+0000","last_became_peered":"2024-09-19T05:17:28.185278+0000","last_unstale":"2024-09-19T05:17:48.259173+0000","last_undegraded":"2024-09-19T05:17:48.259173+0000","last_fullsized":"2024-09-19T05:17:48.259173+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:40.440874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258328+0000","last_change":"2024-09-19T05:17:30.200409+0000","last_active":"2024-09-19T05:17:49.258328+0000","last_peered":"2024-09-19T05:17:49.258328+0000","last_clean":"2024-09-19T05:17:49.258328+0000","last_became_active":"2024-09-19T05:17:30.200120+0000","last_became_peered":"2024-09-19T05:17:30.200120+0000","last_unstale":"2024-09-19T05:17:49.258328+0000","last_undegraded":"2024-09-19T05:17:49.258328+0000","last_fullsized":"2024-09-19T05:17:49.258328+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:12.396655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259201+0000","last_change":"2024-09-19T05:17:28.205371+0000","last_active":"2024-09-19T05:17:49.259201+0000","last_peered":"2024-09-19T05:17:49.259201+0000","last_clean":"2024-09-19T05:17:49.259201+0000","last_became_active":"2024-09-19T05:17:28.205026+0000","last_became_peered":"2024-09-19T05:17:28.205026+0000","last_unstale":"2024-09-19T05:17:49.259201+0000","last_undegraded":"2024-09-19T05:17:49.259201+0000","last_fullsized":"2024-09-19T05:17:49.259201+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:59.518580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258928+0000","last_change":"2024-09-19T05:17:30.206862+0000","last_active":"2024-09-19T05:17:49.258928+0000","last_peered":"2024-09-19T05:17:49.258928+0000","last_clean":"2024-09-19T05:17:49.258928+0000","last_became_active":"2024-09-19T05:17:30.206072+0000","last_became_peered":"2024-09-19T05:17:30.206072+0000","last_unstale":"2024-09-19T05:17:49.258928+0000","last_undegraded":"2024-09-19T05:17:49.258928+0000","last_fullsized":"2024-09-19T05:17:49.258928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:47.810496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257340+0000","last_change":"2024-09-19T05:17:28.181895+0000","last_active":"2024-09-19T05:17:49.257340+0000","last_peered":"2024-09-19T05:17:49.257340+0000","last_clean":"2024-09-19T05:17:49.257340+0000","last_became_active":"2024-09-19T05:17:28.181499+0000","last_became_peered":"2024-09-19T05:17:28.181499+0000","last_unstale":"2024-09-19T05:17:49.257340+0000","last_undegraded":"2024-09-19T05:17:49.257340+0000","last_fullsized":"2024-09-19T05:17:49.257340+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:29.722921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":55710,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":96,"num_read_kb":108,"num_write":155,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":145060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579921,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":433550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36888,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708264,"statfs":{"total":95995035648,"available":95957262336,"internally_reserved":0,"allocated":1581056,"data_stored":1077097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939675,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":909312,"data_stored":433752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168607,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":892928,"data_stored":425139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397539,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28476,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716676,"statfs":{"total":95995035648,"available":95965876224,"internally_reserved":0,"allocated":1482752,"data_stored":1016561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561065,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":897024,"data_stored":433141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913789997,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32672,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712480,"statfs":{"total":95995035648,"available":95961579520,"internally_reserved":0,"allocated":1515520,"data_stored":1024895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953523,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":433578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215160,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":433452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444093,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":958464,"data_stored":475315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607618,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":937984,"data_stored":473999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":917504,"data_stored":434412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":41065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":42381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":53678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:17:56.006 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T05:17:56.262 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:56.587 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:56 smithi120 ceph-mon[30956]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:17:56.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:56 smithi194 ceph-mon[35228]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:17:56.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.665+0000 7f4738a4c640 1 -- 172.21.15.120:0/3334308122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4734100e20 msgr2=0x7f4734101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:56.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.665+0000 7f4738a4c640 1 --2- 172.21.15.120:0/3334308122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4734100e20 0x7f4734101200 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f472c009900 tx=0x7f472c02a480 comp rx=0 tx=0).stop 2024-09-19T05:17:56.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.665+0000 7f4738a4c640 1 -- 172.21.15.120:0/3334308122 shutdown_connections 2024-09-19T05:17:56.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.665+0000 7f4738a4c640 1 --2- 172.21.15.120:0/3334308122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4734102ef0 0x7f473410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:56.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.665+0000 7f4738a4c640 1 --2- 172.21.15.120:0/3334308122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4734102570 0x7f47341029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:56.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.665+0000 7f4738a4c640 1 --2- 172.21.15.120:0/3334308122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4734100e20 0x7f4734101200 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:56.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.665+0000 7f4738a4c640 1 -- 172.21.15.120:0/3334308122 >> 172.21.15.120:0/3334308122 conn(0x7f47340fc7d0 msgr2=0x7f47340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:56.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.665+0000 7f4738a4c640 1 -- 172.21.15.120:0/3334308122 shutdown_connections 2024-09-19T05:17:56.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.665+0000 7f4738a4c640 1 -- 172.21.15.120:0/3334308122 wait complete. 2024-09-19T05:17:56.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.666+0000 7f4738a4c640 1 Processor -- start 2024-09-19T05:17:56.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.666+0000 7f4738a4c640 1 -- start start 2024-09-19T05:17:56.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.666+0000 7f4738a4c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4734100e20 0x7f4734197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:56.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.666+0000 7f4738a4c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4734102570 0x7f4734197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:56.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.666+0000 7f4738a4c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4734102ef0 0x7f473419bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:56.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.666+0000 7f4738a4c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4734110e50 con 0x7f4734100e20 2024-09-19T05:17:56.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.666+0000 7f4738a4c640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4734110cd0 con 0x7f4734102570 2024-09-19T05:17:56.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.666+0000 7f4738a4c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4734110fd0 con 0x7f4734102ef0 2024-09-19T05:17:56.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.666+0000 7f473259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4734100e20 0x7f4734197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:56.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.666+0000 7f473259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4734100e20 0x7f4734197350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47730/0 (socket says 172.21.15.120:47730) 2024-09-19T05:17:56.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.666+0000 7f473259c640 1 -- 172.21.15.120:0/617818657 learned_addr learned my addr 172.21.15.120:0/617818657 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:56.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.666+0000 7f4731d9b640 1 --2- 172.21.15.120:0/617818657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4734102570 0x7f4734197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:56.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.666+0000 7f473259c640 1 -- 172.21.15.120:0/617818657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4734102ef0 msgr2=0x7f473419bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:56.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.666+0000 7f473259c640 1 --2- 172.21.15.120:0/617818657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4734102ef0 0x7f473419bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:56.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.666+0000 7f473259c640 1 -- 172.21.15.120:0/617818657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4734102570 msgr2=0x7f4734197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:56.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.666+0000 7f473259c640 1 --2- 172.21.15.120:0/617818657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4734102570 0x7f4734197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:56.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.666+0000 7f473259c640 1 -- 172.21.15.120:0/617818657 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473419c300 con 0x7f4734100e20 2024-09-19T05:17:56.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.666+0000 7f4731d9b640 1 --2- 172.21.15.120:0/617818657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4734102570 0x7f4734197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:17:56.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.666+0000 7f473259c640 1 --2- 172.21.15.120:0/617818657 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4734100e20 0x7f4734197350 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f472c006010 tx=0x7f472c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:56.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.667+0000 7f472b7fe640 1 -- 172.21.15.120:0/617818657 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c03f070 con 0x7f4734100e20 2024-09-19T05:17:56.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.667+0000 7f472b7fe640 1 -- 172.21.15.120:0/617818657 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f472c003aa0 con 0x7f4734100e20 2024-09-19T05:17:56.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.667+0000 7f472b7fe640 1 -- 172.21.15.120:0/617818657 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472c035030 con 0x7f4734100e20 2024-09-19T05:17:56.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.667+0000 7f4738a4c640 1 -- 172.21.15.120:0/617818657 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f473419c590 con 0x7f4734100e20 2024-09-19T05:17:56.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.667+0000 7f4738a4c640 1 -- 172.21.15.120:0/617818657 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47341a3ed0 con 0x7f4734100e20 2024-09-19T05:17:56.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.668+0000 7f4738a4c640 1 -- 172.21.15.120:0/617818657 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4734101200 con 0x7f4734100e20 2024-09-19T05:17:56.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.669+0000 7f472b7fe640 1 -- 172.21.15.120:0/617818657 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f472c042070 con 0x7f4734100e20 2024-09-19T05:17:56.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.670+0000 7f472b7fe640 1 --2- 172.21.15.120:0/617818657 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f47200a3350 0x7f47200a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:56.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.670+0000 7f4731d9b640 1 --2- 172.21.15.120:0/617818657 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f47200a3350 0x7f47200a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:56.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.670+0000 7f472b7fe640 1 -- 172.21.15.120:0/617818657 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f472c0f04e0 con 0x7f4734100e20 2024-09-19T05:17:56.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.670+0000 7f4731d9b640 1 --2- 172.21.15.120:0/617818657 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f47200a3350 0x7f47200a5810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f47340ffe30 tx=0x7f471c0082f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:56.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.674+0000 7f472b7fe640 1 -- 172.21.15.120:0/617818657 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f472c0bd080 con 0x7f4734100e20 2024-09-19T05:17:56.698 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:56 smithi178 ceph-mon[34347]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:17:56.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.837+0000 7f4738a4c640 1 -- 172.21.15.120:0/617818657 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4734062630 con 0x7f47200a3350 2024-09-19T05:17:56.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.844+0000 7f472b7fe640 1 -- 172.21.15.120:0/617818657 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258712 (secure 0 0 0) 0x7f4734062630 con 0x7f47200a3350 2024-09-19T05:17:56.848 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:17:56.884 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-19T05:17:56.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.846+0000 7f4738a4c640 1 -- 172.21.15.120:0/617818657 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f47200a3350 msgr2=0x7f47200a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:56.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.846+0000 7f4738a4c640 1 --2- 172.21.15.120:0/617818657 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f47200a3350 0x7f47200a5810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f47340ffe30 tx=0x7f471c0082f0 comp rx=0 tx=0).stop 2024-09-19T05:17:56.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.846+0000 7f4738a4c640 1 -- 172.21.15.120:0/617818657 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4734100e20 msgr2=0x7f4734197350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:56.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.846+0000 7f4738a4c640 1 --2- 172.21.15.120:0/617818657 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4734100e20 0x7f4734197350 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f472c006010 tx=0x7f472c0042f0 comp rx=0 tx=0).stop 2024-09-19T05:17:56.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.846+0000 7f4738a4c640 1 -- 172.21.15.120:0/617818657 shutdown_connections 2024-09-19T05:17:56.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.846+0000 7f4738a4c640 1 --2- 172.21.15.120:0/617818657 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f47200a3350 0x7f47200a5810 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:56.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.846+0000 7f4738a4c640 1 --2- 172.21.15.120:0/617818657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4734102ef0 0x7f473419bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:56.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.846+0000 7f4738a4c640 1 --2- 172.21.15.120:0/617818657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4734102570 0x7f4734197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:56.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.846+0000 7f4738a4c640 1 --2- 172.21.15.120:0/617818657 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4734100e20 0x7f4734197350 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:56.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.846+0000 7f4738a4c640 1 -- 172.21.15.120:0/617818657 >> 172.21.15.120:0/617818657 conn(0x7f47340fc7d0 msgr2=0x7f47340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:56.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.846+0000 7f4738a4c640 1 -- 172.21.15.120:0/617818657 shutdown_connections 2024-09-19T05:17:56.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:56.846+0000 7f4738a4c640 1 -- 172.21.15.120:0/617818657 wait complete. 2024-09-19T05:17:57.593 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:57 smithi178 ceph-mon[34347]: pgmap v286: 97 pgs: 97 active+clean; 631 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.7 KiB/s wr, 10 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T05:17:57.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:57 smithi120 ceph-mon[30956]: pgmap v286: 97 pgs: 97 active+clean; 631 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.7 KiB/s wr, 10 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T05:17:57.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:57 smithi194 ceph-mon[35228]: pgmap v286: 97 pgs: 97 active+clean; 631 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.7 KiB/s wr, 10 op/s; 4 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T05:17:57.673 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2024-09-19T05:17:56.137645+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":646312,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":237,"num_read_kb":227,"num_write":338,"num_write_kb":3038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":272,"ondisk_log_size":272,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386816,"kb_used_data":12552,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124555008,"statfs":{"total":1151940427776,"available":1151544328192,"internally_reserved":0,"allocated":12853248,"data_stored":7123109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":50722,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":76,"num_write":32,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002020"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255222+0000","last_change":"2024-09-19T05:17:30.200993+0000","last_active":"2024-09-19T05:17:49.255222+0000","last_peered":"2024-09-19T05:17:49.255222+0000","last_clean":"2024-09-19T05:17:49.255222+0000","last_became_active":"2024-09-19T05:17:30.200587+0000","last_became_peered":"2024-09-19T05:17:30.200587+0000","last_unstale":"2024-09-19T05:17:49.255222+0000","last_undegraded":"2024-09-19T05:17:49.255222+0000","last_fullsized":"2024-09-19T05:17:49.255222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:24.484844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258121+0000","last_change":"2024-09-19T05:17:30.207784+0000","last_active":"2024-09-19T05:17:49.258121+0000","last_peered":"2024-09-19T05:17:49.258121+0000","last_clean":"2024-09-19T05:17:49.258121+0000","last_became_active":"2024-09-19T05:17:30.207485+0000","last_became_peered":"2024-09-19T05:17:30.207485+0000","last_unstale":"2024-09-19T05:17:49.258121+0000","last_undegraded":"2024-09-19T05:17:49.258121+0000","last_fullsized":"2024-09-19T05:17:49.258121+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:07.864813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257951+0000","last_change":"2024-09-19T05:17:30.203861+0000","last_active":"2024-09-19T05:17:49.257951+0000","last_peered":"2024-09-19T05:17:49.257951+0000","last_clean":"2024-09-19T05:17:49.257951+0000","last_became_active":"2024-09-19T05:17:30.203541+0000","last_became_peered":"2024-09-19T05:17:30.203541+0000","last_unstale":"2024-09-19T05:17:49.257951+0000","last_undegraded":"2024-09-19T05:17:49.257951+0000","last_fullsized":"2024-09-19T05:17:49.257951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:33:44.840055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259314+0000","last_change":"2024-09-19T05:17:30.214534+0000","last_active":"2024-09-19T05:17:49.259314+0000","last_peered":"2024-09-19T05:17:49.259314+0000","last_clean":"2024-09-19T05:17:49.259314+0000","last_became_active":"2024-09-19T05:17:30.213840+0000","last_became_peered":"2024-09-19T05:17:30.213840+0000","last_unstale":"2024-09-19T05:17:49.259314+0000","last_undegraded":"2024-09-19T05:17:49.259314+0000","last_fullsized":"2024-09-19T05:17:49.259314+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:03.673488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.505274+0000","last_change":"2024-09-19T05:17:30.201451+0000","last_active":"2024-09-19T05:17:49.505274+0000","last_peered":"2024-09-19T05:17:49.505274+0000","last_clean":"2024-09-19T05:17:49.505274+0000","last_became_active":"2024-09-19T05:17:30.201092+0000","last_became_peered":"2024-09-19T05:17:30.201092+0000","last_unstale":"2024-09-19T05:17:49.505274+0000","last_undegraded":"2024-09-19T05:17:49.505274+0000","last_fullsized":"2024-09-19T05:17:49.505274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:18.958271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.506669+0000","last_change":"2024-09-19T05:17:49.506669+0000","last_active":"2024-09-19T05:17:49.506669+0000","last_peered":"2024-09-19T05:17:49.506669+0000","last_clean":"2024-09-19T05:17:49.506669+0000","last_became_active":"2024-09-19T05:17:49.506331+0000","last_became_peered":"2024-09-19T05:17:49.506331+0000","last_unstale":"2024-09-19T05:17:49.506669+0000","last_undegraded":"2024-09-19T05:17:49.506669+0000","last_fullsized":"2024-09-19T05:17:49.506669+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:23.460781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.506866+0000","last_change":"2024-09-19T05:17:49.506866+0000","last_active":"2024-09-19T05:17:49.506866+0000","last_peered":"2024-09-19T05:17:49.506866+0000","last_clean":"2024-09-19T05:17:49.506866+0000","last_became_active":"2024-09-19T05:17:49.506386+0000","last_became_peered":"2024-09-19T05:17:49.506386+0000","last_unstale":"2024-09-19T05:17:49.506866+0000","last_undegraded":"2024-09-19T05:17:49.506866+0000","last_fullsized":"2024-09-19T05:17:49.506866+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:17.060301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258361+0000","last_change":"2024-09-19T05:17:30.210132+0000","last_active":"2024-09-19T05:17:49.258361+0000","last_peered":"2024-09-19T05:17:49.258361+0000","last_clean":"2024-09-19T05:17:49.258361+0000","last_became_active":"2024-09-19T05:17:30.209240+0000","last_became_peered":"2024-09-19T05:17:30.209240+0000","last_unstale":"2024-09-19T05:17:49.258361+0000","last_undegraded":"2024-09-19T05:17:49.258361+0000","last_fullsized":"2024-09-19T05:17:49.258361+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:08:26.999751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259817+0000","last_change":"2024-09-19T05:17:49.259291+0000","last_active":"2024-09-19T05:17:49.259817+0000","last_peered":"2024-09-19T05:17:49.259817+0000","last_clean":"2024-09-19T05:17:49.259817+0000","last_became_active":"2024-09-19T05:17:49.258948+0000","last_became_peered":"2024-09-19T05:17:49.258948+0000","last_unstale":"2024-09-19T05:17:49.259817+0000","last_undegraded":"2024-09-19T05:17:49.259817+0000","last_fullsized":"2024-09-19T05:17:49.259817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:51.082539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,11],"acting":[9,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258154+0000","last_change":"2024-09-19T05:17:30.205429+0000","last_active":"2024-09-19T05:17:49.258154+0000","last_peered":"2024-09-19T05:17:49.258154+0000","last_clean":"2024-09-19T05:17:49.258154+0000","last_became_active":"2024-09-19T05:17:30.205094+0000","last_became_peered":"2024-09-19T05:17:30.205094+0000","last_unstale":"2024-09-19T05:17:49.258154+0000","last_undegraded":"2024-09-19T05:17:49.258154+0000","last_fullsized":"2024-09-19T05:17:49.258154+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:22.149473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258808+0000","last_change":"2024-09-19T05:17:30.213050+0000","last_active":"2024-09-19T05:17:49.258808+0000","last_peered":"2024-09-19T05:17:49.258808+0000","last_clean":"2024-09-19T05:17:49.258808+0000","last_became_active":"2024-09-19T05:17:30.211812+0000","last_became_peered":"2024-09-19T05:17:30.211812+0000","last_unstale":"2024-09-19T05:17:49.258808+0000","last_undegraded":"2024-09-19T05:17:49.258808+0000","last_fullsized":"2024-09-19T05:17:49.258808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:31.734317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259448+0000","last_change":"2024-09-19T05:17:30.212049+0000","last_active":"2024-09-19T05:17:49.259448+0000","last_peered":"2024-09-19T05:17:49.259448+0000","last_clean":"2024-09-19T05:17:49.259448+0000","last_became_active":"2024-09-19T05:17:30.211684+0000","last_became_peered":"2024-09-19T05:17:30.211684+0000","last_unstale":"2024-09-19T05:17:49.259448+0000","last_undegraded":"2024-09-19T05:17:49.259448+0000","last_fullsized":"2024-09-19T05:17:49.259448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:24.781815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255080+0000","last_change":"2024-09-19T05:17:30.191898+0000","last_active":"2024-09-19T05:17:49.255080+0000","last_peered":"2024-09-19T05:17:49.255080+0000","last_clean":"2024-09-19T05:17:49.255080+0000","last_became_active":"2024-09-19T05:17:30.191204+0000","last_became_peered":"2024-09-19T05:17:30.191204+0000","last_unstale":"2024-09-19T05:17:49.255080+0000","last_undegraded":"2024-09-19T05:17:49.255080+0000","last_fullsized":"2024-09-19T05:17:49.255080+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:19.043363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257585+0000","last_change":"2024-09-19T05:17:30.201754+0000","last_active":"2024-09-19T05:17:49.257585+0000","last_peered":"2024-09-19T05:17:49.257585+0000","last_clean":"2024-09-19T05:17:49.257585+0000","last_became_active":"2024-09-19T05:17:30.201439+0000","last_became_peered":"2024-09-19T05:17:30.201439+0000","last_unstale":"2024-09-19T05:17:49.257585+0000","last_undegraded":"2024-09-19T05:17:49.257585+0000","last_fullsized":"2024-09-19T05:17:49.257585+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:28.896899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257640+0000","last_change":"2024-09-19T05:17:30.202618+0000","last_active":"2024-09-19T05:17:49.257640+0000","last_peered":"2024-09-19T05:17:49.257640+0000","last_clean":"2024-09-19T05:17:49.257640+0000","last_became_active":"2024-09-19T05:17:30.202292+0000","last_became_peered":"2024-09-19T05:17:30.202292+0000","last_unstale":"2024-09-19T05:17:49.257640+0000","last_undegraded":"2024-09-19T05:17:49.257640+0000","last_fullsized":"2024-09-19T05:17:49.257640+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:54.206467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253112+0000","last_change":"2024-09-19T05:17:30.209411+0000","last_active":"2024-09-19T05:17:49.253112+0000","last_peered":"2024-09-19T05:17:49.253112+0000","last_clean":"2024-09-19T05:17:49.253112+0000","last_became_active":"2024-09-19T05:17:30.208525+0000","last_became_peered":"2024-09-19T05:17:30.208525+0000","last_unstale":"2024-09-19T05:17:49.253112+0000","last_undegraded":"2024-09-19T05:17:49.253112+0000","last_fullsized":"2024-09-19T05:17:49.253112+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:12:16.616413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255289+0000","last_change":"2024-09-19T05:17:30.203552+0000","last_active":"2024-09-19T05:17:49.255289+0000","last_peered":"2024-09-19T05:17:49.255289+0000","last_clean":"2024-09-19T05:17:49.255289+0000","last_became_active":"2024-09-19T05:17:30.203212+0000","last_became_peered":"2024-09-19T05:17:30.203212+0000","last_unstale":"2024-09-19T05:17:49.255289+0000","last_undegraded":"2024-09-19T05:17:49.255289+0000","last_fullsized":"2024-09-19T05:17:49.255289+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:38:50.948373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257055+0000","last_change":"2024-09-19T05:17:30.201540+0000","last_active":"2024-09-19T05:17:49.257055+0000","last_peered":"2024-09-19T05:17:49.257055+0000","last_clean":"2024-09-19T05:17:49.257055+0000","last_became_active":"2024-09-19T05:17:30.201222+0000","last_became_peered":"2024-09-19T05:17:30.201222+0000","last_unstale":"2024-09-19T05:17:49.257055+0000","last_undegraded":"2024-09-19T05:17:49.257055+0000","last_fullsized":"2024-09-19T05:17:49.257055+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:09.583473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253195+0000","last_change":"2024-09-19T05:17:30.205962+0000","last_active":"2024-09-19T05:17:49.253195+0000","last_peered":"2024-09-19T05:17:49.253195+0000","last_clean":"2024-09-19T05:17:49.253195+0000","last_became_active":"2024-09-19T05:17:30.205632+0000","last_became_peered":"2024-09-19T05:17:30.205632+0000","last_unstale":"2024-09-19T05:17:49.253195+0000","last_undegraded":"2024-09-19T05:17:49.253195+0000","last_fullsized":"2024-09-19T05:17:49.253195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:07.767502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254604+0000","last_change":"2024-09-19T05:17:30.208546+0000","last_active":"2024-09-19T05:17:49.254604+0000","last_peered":"2024-09-19T05:17:49.254604+0000","last_clean":"2024-09-19T05:17:49.254604+0000","last_became_active":"2024-09-19T05:17:30.208220+0000","last_became_peered":"2024-09-19T05:17:30.208220+0000","last_unstale":"2024-09-19T05:17:49.254604+0000","last_undegraded":"2024-09-19T05:17:49.254604+0000","last_fullsized":"2024-09-19T05:17:49.254604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:46:32.360282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255086+0000","last_change":"2024-09-19T05:17:30.204653+0000","last_active":"2024-09-19T05:17:49.255086+0000","last_peered":"2024-09-19T05:17:49.255086+0000","last_clean":"2024-09-19T05:17:49.255086+0000","last_became_active":"2024-09-19T05:17:30.204335+0000","last_became_peered":"2024-09-19T05:17:30.204335+0000","last_unstale":"2024-09-19T05:17:49.255086+0000","last_undegraded":"2024-09-19T05:17:49.255086+0000","last_fullsized":"2024-09-19T05:17:49.255086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:48.661902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.261216+0000","last_change":"2024-09-19T05:17:49.261216+0000","last_active":"2024-09-19T05:17:49.261216+0000","last_peered":"2024-09-19T05:17:49.261216+0000","last_clean":"2024-09-19T05:17:49.261216+0000","last_became_active":"2024-09-19T05:17:49.260691+0000","last_became_peered":"2024-09-19T05:17:49.260691+0000","last_unstale":"2024-09-19T05:17:49.261216+0000","last_undegraded":"2024-09-19T05:17:49.261216+0000","last_fullsized":"2024-09-19T05:17:49.261216+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:35.937669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,6],"acting":[1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257699+0000","last_change":"2024-09-19T05:17:30.201935+0000","last_active":"2024-09-19T05:17:49.257699+0000","last_peered":"2024-09-19T05:17:49.257699+0000","last_clean":"2024-09-19T05:17:49.257699+0000","last_became_active":"2024-09-19T05:17:30.201524+0000","last_became_peered":"2024-09-19T05:17:30.201524+0000","last_unstale":"2024-09-19T05:17:49.257699+0000","last_undegraded":"2024-09-19T05:17:49.257699+0000","last_fullsized":"2024-09-19T05:17:49.257699+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:34.018339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.506519+0000","last_change":"2024-09-19T05:17:49.506519+0000","last_active":"2024-09-19T05:17:49.506519+0000","last_peered":"2024-09-19T05:17:49.506519+0000","last_clean":"2024-09-19T05:17:49.506519+0000","last_became_active":"2024-09-19T05:17:49.506016+0000","last_became_peered":"2024-09-19T05:17:49.506016+0000","last_unstale":"2024-09-19T05:17:49.506519+0000","last_undegraded":"2024-09-19T05:17:49.506519+0000","last_fullsized":"2024-09-19T05:17:49.506519+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:31.064318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,8],"acting":[5,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258690+0000","last_change":"2024-09-19T05:17:30.205459+0000","last_active":"2024-09-19T05:17:49.258690+0000","last_peered":"2024-09-19T05:17:49.258690+0000","last_clean":"2024-09-19T05:17:49.258690+0000","last_became_active":"2024-09-19T05:17:30.205100+0000","last_became_peered":"2024-09-19T05:17:30.205100+0000","last_unstale":"2024-09-19T05:17:49.258690+0000","last_undegraded":"2024-09-19T05:17:49.258690+0000","last_fullsized":"2024-09-19T05:17:49.258690+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:35.246931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253212+0000","last_change":"2024-09-19T05:17:30.202812+0000","last_active":"2024-09-19T05:17:49.253212+0000","last_peered":"2024-09-19T05:17:49.253212+0000","last_clean":"2024-09-19T05:17:49.253212+0000","last_became_active":"2024-09-19T05:17:30.202477+0000","last_became_peered":"2024-09-19T05:17:30.202477+0000","last_unstale":"2024-09-19T05:17:49.253212+0000","last_undegraded":"2024-09-19T05:17:49.253212+0000","last_fullsized":"2024-09-19T05:17:49.253212+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:24.253576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254759+0000","last_change":"2024-09-19T05:17:30.206546+0000","last_active":"2024-09-19T05:17:49.254759+0000","last_peered":"2024-09-19T05:17:49.254759+0000","last_clean":"2024-09-19T05:17:49.254759+0000","last_became_active":"2024-09-19T05:17:30.206186+0000","last_became_peered":"2024-09-19T05:17:30.206186+0000","last_unstale":"2024-09-19T05:17:49.254759+0000","last_undegraded":"2024-09-19T05:17:49.254759+0000","last_fullsized":"2024-09-19T05:17:49.254759+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:30.589196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254959+0000","last_change":"2024-09-19T05:17:30.213894+0000","last_active":"2024-09-19T05:17:49.254959+0000","last_peered":"2024-09-19T05:17:49.254959+0000","last_clean":"2024-09-19T05:17:49.254959+0000","last_became_active":"2024-09-19T05:17:30.213586+0000","last_became_peered":"2024-09-19T05:17:30.213586+0000","last_unstale":"2024-09-19T05:17:49.254959+0000","last_undegraded":"2024-09-19T05:17:49.254959+0000","last_fullsized":"2024-09-19T05:17:49.254959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:46.215816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.262965+0000","last_change":"2024-09-19T05:17:49.262965+0000","last_active":"2024-09-19T05:17:49.262965+0000","last_peered":"2024-09-19T05:17:49.262965+0000","last_clean":"2024-09-19T05:17:49.262965+0000","last_became_active":"2024-09-19T05:17:49.262651+0000","last_became_peered":"2024-09-19T05:17:49.262651+0000","last_unstale":"2024-09-19T05:17:49.262965+0000","last_undegraded":"2024-09-19T05:17:49.262965+0000","last_fullsized":"2024-09-19T05:17:49.262965+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:57.601031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.252888+0000","last_change":"2024-09-19T05:17:30.204302+0000","last_active":"2024-09-19T05:17:49.252888+0000","last_peered":"2024-09-19T05:17:49.252888+0000","last_clean":"2024-09-19T05:17:49.252888+0000","last_became_active":"2024-09-19T05:17:30.203981+0000","last_became_peered":"2024-09-19T05:17:30.203981+0000","last_unstale":"2024-09-19T05:17:49.252888+0000","last_undegraded":"2024-09-19T05:17:49.252888+0000","last_fullsized":"2024-09-19T05:17:49.252888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:59.130439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.252943+0000","last_change":"2024-09-19T05:17:30.210610+0000","last_active":"2024-09-19T05:17:49.252943+0000","last_peered":"2024-09-19T05:17:49.252943+0000","last_clean":"2024-09-19T05:17:49.252943+0000","last_became_active":"2024-09-19T05:17:30.210231+0000","last_became_peered":"2024-09-19T05:17:30.210231+0000","last_unstale":"2024-09-19T05:17:49.252943+0000","last_undegraded":"2024-09-19T05:17:49.252943+0000","last_fullsized":"2024-09-19T05:17:49.252943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:37:41.885822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254442+0000","last_change":"2024-09-19T05:17:30.210755+0000","last_active":"2024-09-19T05:17:49.254442+0000","last_peered":"2024-09-19T05:17:49.254442+0000","last_clean":"2024-09-19T05:17:49.254442+0000","last_became_active":"2024-09-19T05:17:30.210383+0000","last_became_peered":"2024-09-19T05:17:30.210383+0000","last_unstale":"2024-09-19T05:17:49.254442+0000","last_undegraded":"2024-09-19T05:17:49.254442+0000","last_fullsized":"2024-09-19T05:17:49.254442+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:11.259830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.505151+0000","last_change":"2024-09-19T05:17:30.206345+0000","last_active":"2024-09-19T05:17:49.505151+0000","last_peered":"2024-09-19T05:17:49.505151+0000","last_clean":"2024-09-19T05:17:49.505151+0000","last_became_active":"2024-09-19T05:17:30.205988+0000","last_became_peered":"2024-09-19T05:17:30.205988+0000","last_unstale":"2024-09-19T05:17:49.505151+0000","last_undegraded":"2024-09-19T05:17:49.505151+0000","last_fullsized":"2024-09-19T05:17:49.505151+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:57.538280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:53.265860+0000","last_change":"2024-09-19T05:17:28.183851+0000","last_active":"2024-09-19T05:17:53.265860+0000","last_peered":"2024-09-19T05:17:53.265860+0000","last_clean":"2024-09-19T05:17:53.265860+0000","last_became_active":"2024-09-19T05:17:28.183472+0000","last_became_peered":"2024-09-19T05:17:28.183472+0000","last_unstale":"2024-09-19T05:17:53.265860+0000","last_undegraded":"2024-09-19T05:17:53.265860+0000","last_fullsized":"2024-09-19T05:17:53.265860+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:22.942306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255294+0000","last_change":"2024-09-19T05:17:30.208784+0000","last_active":"2024-09-19T05:17:49.255294+0000","last_peered":"2024-09-19T05:17:49.255294+0000","last_clean":"2024-09-19T05:17:49.255294+0000","last_became_active":"2024-09-19T05:17:30.208232+0000","last_became_peered":"2024-09-19T05:17:30.208232+0000","last_unstale":"2024-09-19T05:17:49.255294+0000","last_undegraded":"2024-09-19T05:17:49.255294+0000","last_fullsized":"2024-09-19T05:17:49.255294+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:07.670401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257109+0000","last_change":"2024-09-19T05:17:28.181480+0000","last_active":"2024-09-19T05:17:49.257109+0000","last_peered":"2024-09-19T05:17:49.257109+0000","last_clean":"2024-09-19T05:17:49.257109+0000","last_became_active":"2024-09-19T05:17:28.181169+0000","last_became_peered":"2024-09-19T05:17:28.181169+0000","last_unstale":"2024-09-19T05:17:49.257109+0000","last_undegraded":"2024-09-19T05:17:49.257109+0000","last_fullsized":"2024-09-19T05:17:49.257109+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:09.590408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254730+0000","last_change":"2024-09-19T05:17:28.180636+0000","last_active":"2024-09-19T05:17:49.254730+0000","last_peered":"2024-09-19T05:17:49.254730+0000","last_clean":"2024-09-19T05:17:49.254730+0000","last_became_active":"2024-09-19T05:17:28.180298+0000","last_became_peered":"2024-09-19T05:17:28.180298+0000","last_unstale":"2024-09-19T05:17:49.254730+0000","last_undegraded":"2024-09-19T05:17:49.254730+0000","last_fullsized":"2024-09-19T05:17:49.254730+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:06.361677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258465+0000","last_change":"2024-09-19T05:17:30.199091+0000","last_active":"2024-09-19T05:17:49.258465+0000","last_peered":"2024-09-19T05:17:49.258465+0000","last_clean":"2024-09-19T05:17:49.258465+0000","last_became_active":"2024-09-19T05:17:30.198805+0000","last_became_peered":"2024-09-19T05:17:30.198805+0000","last_unstale":"2024-09-19T05:17:49.258465+0000","last_undegraded":"2024-09-19T05:17:49.258465+0000","last_fullsized":"2024-09-19T05:17:49.258465+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:27.906713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.256486+0000","last_change":"2024-09-19T05:17:28.182281+0000","last_active":"2024-09-19T05:17:49.256486+0000","last_peered":"2024-09-19T05:17:49.256486+0000","last_clean":"2024-09-19T05:17:49.256486+0000","last_became_active":"2024-09-19T05:17:28.181939+0000","last_became_peered":"2024-09-19T05:17:28.181939+0000","last_unstale":"2024-09-19T05:17:49.256486+0000","last_undegraded":"2024-09-19T05:17:49.256486+0000","last_fullsized":"2024-09-19T05:17:49.256486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:12.057601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.256715+0000","last_change":"2024-09-19T05:17:30.198849+0000","last_active":"2024-09-19T05:17:49.256715+0000","last_peered":"2024-09-19T05:17:49.256715+0000","last_clean":"2024-09-19T05:17:49.256715+0000","last_became_active":"2024-09-19T05:17:30.198473+0000","last_became_peered":"2024-09-19T05:17:30.198473+0000","last_unstale":"2024-09-19T05:17:49.256715+0000","last_undegraded":"2024-09-19T05:17:49.256715+0000","last_fullsized":"2024-09-19T05:17:49.256715+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:20.591516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:51.262428+0000","last_change":"2024-09-19T05:17:28.181393+0000","last_active":"2024-09-19T05:17:51.262428+0000","last_peered":"2024-09-19T05:17:51.262428+0000","last_clean":"2024-09-19T05:17:51.262428+0000","last_became_active":"2024-09-19T05:17:28.181069+0000","last_became_peered":"2024-09-19T05:17:28.181069+0000","last_unstale":"2024-09-19T05:17:51.262428+0000","last_undegraded":"2024-09-19T05:17:51.262428+0000","last_fullsized":"2024-09-19T05:17:51.262428+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:15.684564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253792+0000","last_change":"2024-09-19T05:17:30.204968+0000","last_active":"2024-09-19T05:17:49.253792+0000","last_peered":"2024-09-19T05:17:49.253792+0000","last_clean":"2024-09-19T05:17:49.253792+0000","last_became_active":"2024-09-19T05:17:30.204613+0000","last_became_peered":"2024-09-19T05:17:30.204613+0000","last_unstale":"2024-09-19T05:17:49.253792+0000","last_undegraded":"2024-09-19T05:17:49.253792+0000","last_fullsized":"2024-09-19T05:17:49.253792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:14.836220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258502+0000","last_change":"2024-09-19T05:17:28.185554+0000","last_active":"2024-09-19T05:17:49.258502+0000","last_peered":"2024-09-19T05:17:49.258502+0000","last_clean":"2024-09-19T05:17:49.258502+0000","last_became_active":"2024-09-19T05:17:28.185198+0000","last_became_peered":"2024-09-19T05:17:28.185198+0000","last_unstale":"2024-09-19T05:17:49.258502+0000","last_undegraded":"2024-09-19T05:17:49.258502+0000","last_fullsized":"2024-09-19T05:17:49.258502+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:59.753359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258434+0000","last_change":"2024-09-19T05:17:30.207418+0000","last_active":"2024-09-19T05:17:49.258434+0000","last_peered":"2024-09-19T05:17:49.258434+0000","last_clean":"2024-09-19T05:17:49.258434+0000","last_became_active":"2024-09-19T05:17:30.207079+0000","last_became_peered":"2024-09-19T05:17:30.207079+0000","last_unstale":"2024-09-19T05:17:49.258434+0000","last_undegraded":"2024-09-19T05:17:49.258434+0000","last_fullsized":"2024-09-19T05:17:49.258434+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:40:49.564649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255759+0000","last_change":"2024-09-19T05:17:28.204988+0000","last_active":"2024-09-19T05:17:49.255759+0000","last_peered":"2024-09-19T05:17:49.255759+0000","last_clean":"2024-09-19T05:17:49.255759+0000","last_became_active":"2024-09-19T05:17:28.204607+0000","last_became_peered":"2024-09-19T05:17:28.204607+0000","last_unstale":"2024-09-19T05:17:49.255759+0000","last_undegraded":"2024-09-19T05:17:49.255759+0000","last_fullsized":"2024-09-19T05:17:49.255759+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:17.914720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253360+0000","last_change":"2024-09-19T05:17:30.207876+0000","last_active":"2024-09-19T05:17:49.253360+0000","last_peered":"2024-09-19T05:17:49.253360+0000","last_clean":"2024-09-19T05:17:49.253360+0000","last_became_active":"2024-09-19T05:17:30.207561+0000","last_became_peered":"2024-09-19T05:17:30.207561+0000","last_unstale":"2024-09-19T05:17:49.253360+0000","last_undegraded":"2024-09-19T05:17:49.253360+0000","last_fullsized":"2024-09-19T05:17:49.253360+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:26.696949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'26","reported_seq":81,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:52.265939+0000","last_change":"2024-09-19T05:17:28.185152+0000","last_active":"2024-09-19T05:17:52.265939+0000","last_peered":"2024-09-19T05:17:52.265939+0000","last_clean":"2024-09-19T05:17:52.265939+0000","last_became_active":"2024-09-19T05:17:28.184792+0000","last_became_peered":"2024-09-19T05:17:28.184792+0000","last_unstale":"2024-09-19T05:17:52.265939+0000","last_undegraded":"2024-09-19T05:17:52.265939+0000","last_fullsized":"2024-09-19T05:17:52.265939+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:04.647138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52100,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":66,"num_write":27,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.505387+0000","last_change":"2024-09-19T05:17:30.209768+0000","last_active":"2024-09-19T05:17:49.505387+0000","last_peered":"2024-09-19T05:17:49.505387+0000","last_clean":"2024-09-19T05:17:49.505387+0000","last_became_active":"2024-09-19T05:17:30.209399+0000","last_became_peered":"2024-09-19T05:17:30.209399+0000","last_unstale":"2024-09-19T05:17:49.505387+0000","last_undegraded":"2024-09-19T05:17:49.505387+0000","last_fullsized":"2024-09-19T05:17:49.505387+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:58.664138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.269672+0000","last_change":"2024-09-19T05:17:49.269241+0000","last_active":"2024-09-19T05:17:49.269672+0000","last_peered":"2024-09-19T05:17:49.269672+0000","last_clean":"2024-09-19T05:17:49.269672+0000","last_became_active":"2024-09-19T05:17:49.259494+0000","last_became_peered":"2024-09-19T05:17:49.259494+0000","last_unstale":"2024-09-19T05:17:49.269672+0000","last_undegraded":"2024-09-19T05:17:49.269672+0000","last_fullsized":"2024-09-19T05:17:49.269672+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:59.866742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254867+0000","last_change":"2024-09-19T05:17:30.204554+0000","last_active":"2024-09-19T05:17:49.254867+0000","last_peered":"2024-09-19T05:17:49.254867+0000","last_clean":"2024-09-19T05:17:49.254867+0000","last_became_active":"2024-09-19T05:17:30.203166+0000","last_became_peered":"2024-09-19T05:17:30.203166+0000","last_unstale":"2024-09-19T05:17:49.254867+0000","last_undegraded":"2024-09-19T05:17:49.254867+0000","last_fullsized":"2024-09-19T05:17:49.254867+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:23.517869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255318+0000","last_change":"2024-09-19T05:17:28.183800+0000","last_active":"2024-09-19T05:17:49.255318+0000","last_peered":"2024-09-19T05:17:49.255318+0000","last_clean":"2024-09-19T05:17:49.255318+0000","last_became_active":"2024-09-19T05:17:28.182819+0000","last_became_peered":"2024-09-19T05:17:28.182819+0000","last_unstale":"2024-09-19T05:17:49.255318+0000","last_undegraded":"2024-09-19T05:17:49.255318+0000","last_fullsized":"2024-09-19T05:17:49.255318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:44:52.215544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257754+0000","last_change":"2024-09-19T05:17:30.214723+0000","last_active":"2024-09-19T05:17:49.257754+0000","last_peered":"2024-09-19T05:17:49.257754+0000","last_clean":"2024-09-19T05:17:49.257754+0000","last_became_active":"2024-09-19T05:17:30.214343+0000","last_became_peered":"2024-09-19T05:17:30.214343+0000","last_unstale":"2024-09-19T05:17:49.257754+0000","last_undegraded":"2024-09-19T05:17:49.257754+0000","last_fullsized":"2024-09-19T05:17:49.257754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:13.008151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259087+0000","last_change":"2024-09-19T05:17:28.183130+0000","last_active":"2024-09-19T05:17:49.259087+0000","last_peered":"2024-09-19T05:17:49.259087+0000","last_clean":"2024-09-19T05:17:49.259087+0000","last_became_active":"2024-09-19T05:17:28.182834+0000","last_became_peered":"2024-09-19T05:17:28.182834+0000","last_unstale":"2024-09-19T05:17:49.259087+0000","last_undegraded":"2024-09-19T05:17:49.259087+0000","last_fullsized":"2024-09-19T05:17:49.259087+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:48.683776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257284+0000","last_change":"2024-09-19T05:17:30.212438+0000","last_active":"2024-09-19T05:17:49.257284+0000","last_peered":"2024-09-19T05:17:49.257284+0000","last_clean":"2024-09-19T05:17:49.257284+0000","last_became_active":"2024-09-19T05:17:30.209321+0000","last_became_peered":"2024-09-19T05:17:30.209321+0000","last_unstale":"2024-09-19T05:17:49.257284+0000","last_undegraded":"2024-09-19T05:17:49.257284+0000","last_fullsized":"2024-09-19T05:17:49.257284+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:42.772116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.505105+0000","last_change":"2024-09-19T05:17:28.204665+0000","last_active":"2024-09-19T05:17:49.505105+0000","last_peered":"2024-09-19T05:17:49.505105+0000","last_clean":"2024-09-19T05:17:49.505105+0000","last_became_active":"2024-09-19T05:17:28.204309+0000","last_became_peered":"2024-09-19T05:17:28.204309+0000","last_unstale":"2024-09-19T05:17:49.505105+0000","last_undegraded":"2024-09-19T05:17:49.505105+0000","last_fullsized":"2024-09-19T05:17:49.505105+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:26.372762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255224+0000","last_change":"2024-09-19T05:17:30.208518+0000","last_active":"2024-09-19T05:17:49.255224+0000","last_peered":"2024-09-19T05:17:49.255224+0000","last_clean":"2024-09-19T05:17:49.255224+0000","last_became_active":"2024-09-19T05:17:30.208172+0000","last_became_peered":"2024-09-19T05:17:30.208172+0000","last_unstale":"2024-09-19T05:17:49.255224+0000","last_undegraded":"2024-09-19T05:17:49.255224+0000","last_fullsized":"2024-09-19T05:17:49.255224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:40:25.754925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.505491+0000","last_change":"2024-09-19T05:17:28.180930+0000","last_active":"2024-09-19T05:17:49.505491+0000","last_peered":"2024-09-19T05:17:49.505491+0000","last_clean":"2024-09-19T05:17:49.505491+0000","last_became_active":"2024-09-19T05:17:28.180575+0000","last_became_peered":"2024-09-19T05:17:28.180575+0000","last_unstale":"2024-09-19T05:17:49.505491+0000","last_undegraded":"2024-09-19T05:17:49.505491+0000","last_fullsized":"2024-09-19T05:17:49.505491+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:36:15.390852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254917+0000","last_change":"2024-09-19T05:17:30.207002+0000","last_active":"2024-09-19T05:17:49.254917+0000","last_peered":"2024-09-19T05:17:49.254917+0000","last_clean":"2024-09-19T05:17:49.254917+0000","last_became_active":"2024-09-19T05:17:30.205750+0000","last_became_peered":"2024-09-19T05:17:30.205750+0000","last_unstale":"2024-09-19T05:17:49.254917+0000","last_undegraded":"2024-09-19T05:17:49.254917+0000","last_fullsized":"2024-09-19T05:17:49.254917+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:25:18.716206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255138+0000","last_change":"2024-09-19T05:17:28.184071+0000","last_active":"2024-09-19T05:17:49.255138+0000","last_peered":"2024-09-19T05:17:49.255138+0000","last_clean":"2024-09-19T05:17:49.255138+0000","last_became_active":"2024-09-19T05:17:28.183708+0000","last_became_peered":"2024-09-19T05:17:28.183708+0000","last_unstale":"2024-09-19T05:17:49.255138+0000","last_undegraded":"2024-09-19T05:17:49.255138+0000","last_fullsized":"2024-09-19T05:17:49.255138+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:57:23.831000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257299+0000","last_change":"2024-09-19T05:17:30.211919+0000","last_active":"2024-09-19T05:17:49.257299+0000","last_peered":"2024-09-19T05:17:49.257299+0000","last_clean":"2024-09-19T05:17:49.257299+0000","last_became_active":"2024-09-19T05:17:30.210639+0000","last_became_peered":"2024-09-19T05:17:30.210639+0000","last_unstale":"2024-09-19T05:17:49.257299+0000","last_undegraded":"2024-09-19T05:17:49.257299+0000","last_fullsized":"2024-09-19T05:17:49.257299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:25.231732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255846+0000","last_change":"2024-09-19T05:17:28.179372+0000","last_active":"2024-09-19T05:17:49.255846+0000","last_peered":"2024-09-19T05:17:49.255846+0000","last_clean":"2024-09-19T05:17:49.255846+0000","last_became_active":"2024-09-19T05:17:28.178792+0000","last_became_peered":"2024-09-19T05:17:28.178792+0000","last_unstale":"2024-09-19T05:17:49.255846+0000","last_undegraded":"2024-09-19T05:17:49.255846+0000","last_fullsized":"2024-09-19T05:17:49.255846+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:54.705552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258607+0000","last_change":"2024-09-19T05:17:30.208201+0000","last_active":"2024-09-19T05:17:49.258607+0000","last_peered":"2024-09-19T05:17:49.258607+0000","last_clean":"2024-09-19T05:17:49.258607+0000","last_became_active":"2024-09-19T05:17:30.207865+0000","last_became_peered":"2024-09-19T05:17:30.207865+0000","last_unstale":"2024-09-19T05:17:49.258607+0000","last_undegraded":"2024-09-19T05:17:49.258607+0000","last_fullsized":"2024-09-19T05:17:49.258607+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:35.954759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253446+0000","last_change":"2024-09-19T05:17:28.543685+0000","last_active":"2024-09-19T05:17:49.253446+0000","last_peered":"2024-09-19T05:17:49.253446+0000","last_clean":"2024-09-19T05:17:49.253446+0000","last_became_active":"2024-09-19T05:17:28.543292+0000","last_became_peered":"2024-09-19T05:17:28.543292+0000","last_unstale":"2024-09-19T05:17:49.253446+0000","last_undegraded":"2024-09-19T05:17:49.253446+0000","last_fullsized":"2024-09-19T05:17:49.253446+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:55:14.348544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258916+0000","last_change":"2024-09-19T05:17:30.212449+0000","last_active":"2024-09-19T05:17:49.258916+0000","last_peered":"2024-09-19T05:17:49.258916+0000","last_clean":"2024-09-19T05:17:49.258916+0000","last_became_active":"2024-09-19T05:17:30.211265+0000","last_became_peered":"2024-09-19T05:17:30.211265+0000","last_unstale":"2024-09-19T05:17:49.258916+0000","last_undegraded":"2024-09-19T05:17:49.258916+0000","last_fullsized":"2024-09-19T05:17:49.258916+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:27.687687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":346,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257570+0000","last_change":"2024-09-19T05:16:20.361975+0000","last_active":"2024-09-19T05:17:49.257570+0000","last_peered":"2024-09-19T05:17:49.257570+0000","last_clean":"2024-09-19T05:17:49.257570+0000","last_became_active":"2024-09-19T05:16:20.361553+0000","last_became_peered":"2024-09-19T05:16:20.361553+0000","last_unstale":"2024-09-19T05:17:49.257570+0000","last_undegraded":"2024-09-19T05:17:49.257570+0000","last_fullsized":"2024-09-19T05:17:49.257570+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:13:02.674575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:13:02.674575+0000","last_clean_scrub_stamp":"2024-09-19T05:13:02.674575+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:48.711411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259170+0000","last_change":"2024-09-19T05:17:28.180486+0000","last_active":"2024-09-19T05:17:49.259170+0000","last_peered":"2024-09-19T05:17:49.259170+0000","last_clean":"2024-09-19T05:17:49.259170+0000","last_became_active":"2024-09-19T05:17:28.180147+0000","last_became_peered":"2024-09-19T05:17:28.180147+0000","last_unstale":"2024-09-19T05:17:49.259170+0000","last_undegraded":"2024-09-19T05:17:49.259170+0000","last_fullsized":"2024-09-19T05:17:49.259170+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:57.820328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258205+0000","last_change":"2024-09-19T05:17:30.205560+0000","last_active":"2024-09-19T05:17:49.258205+0000","last_peered":"2024-09-19T05:17:49.258205+0000","last_clean":"2024-09-19T05:17:49.258205+0000","last_became_active":"2024-09-19T05:17:30.205269+0000","last_became_peered":"2024-09-19T05:17:30.205269+0000","last_unstale":"2024-09-19T05:17:49.258205+0000","last_undegraded":"2024-09-19T05:17:49.258205+0000","last_fullsized":"2024-09-19T05:17:49.258205+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:22.904616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257462+0000","last_change":"2024-09-19T05:17:28.181845+0000","last_active":"2024-09-19T05:17:49.257462+0000","last_peered":"2024-09-19T05:17:49.257462+0000","last_clean":"2024-09-19T05:17:49.257462+0000","last_became_active":"2024-09-19T05:17:28.181549+0000","last_became_peered":"2024-09-19T05:17:28.181549+0000","last_unstale":"2024-09-19T05:17:49.257462+0000","last_undegraded":"2024-09-19T05:17:49.257462+0000","last_fullsized":"2024-09-19T05:17:49.257462+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:01.222364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259631+0000","last_change":"2024-09-19T05:17:49.259631+0000","last_active":"2024-09-19T05:17:49.259631+0000","last_peered":"2024-09-19T05:17:49.259631+0000","last_clean":"2024-09-19T05:17:49.259631+0000","last_became_active":"2024-09-19T05:17:49.259240+0000","last_became_peered":"2024-09-19T05:17:49.259240+0000","last_unstale":"2024-09-19T05:17:49.259631+0000","last_undegraded":"2024-09-19T05:17:49.259631+0000","last_fullsized":"2024-09-19T05:17:49.259631+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:22.533248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255004+0000","last_change":"2024-09-19T05:17:28.204924+0000","last_active":"2024-09-19T05:17:49.255004+0000","last_peered":"2024-09-19T05:17:49.255004+0000","last_clean":"2024-09-19T05:17:49.255004+0000","last_became_active":"2024-09-19T05:17:28.204602+0000","last_became_peered":"2024-09-19T05:17:28.204602+0000","last_unstale":"2024-09-19T05:17:49.255004+0000","last_undegraded":"2024-09-19T05:17:49.255004+0000","last_fullsized":"2024-09-19T05:17:49.255004+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:13.303939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259147+0000","last_change":"2024-09-19T05:17:49.259147+0000","last_active":"2024-09-19T05:17:49.259147+0000","last_peered":"2024-09-19T05:17:49.259147+0000","last_clean":"2024-09-19T05:17:49.259147+0000","last_became_active":"2024-09-19T05:17:49.258666+0000","last_became_peered":"2024-09-19T05:17:49.258666+0000","last_unstale":"2024-09-19T05:17:49.259147+0000","last_undegraded":"2024-09-19T05:17:49.259147+0000","last_fullsized":"2024-09-19T05:17:49.259147+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:54.802994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257809+0000","last_change":"2024-09-19T05:17:28.182456+0000","last_active":"2024-09-19T05:17:49.257809+0000","last_peered":"2024-09-19T05:17:49.257809+0000","last_clean":"2024-09-19T05:17:49.257809+0000","last_became_active":"2024-09-19T05:17:28.182075+0000","last_became_peered":"2024-09-19T05:17:28.182075+0000","last_unstale":"2024-09-19T05:17:49.257809+0000","last_undegraded":"2024-09-19T05:17:49.257809+0000","last_fullsized":"2024-09-19T05:17:49.257809+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:42.771641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257506+0000","last_change":"2024-09-19T05:17:30.204300+0000","last_active":"2024-09-19T05:17:49.257506+0000","last_peered":"2024-09-19T05:17:49.257506+0000","last_clean":"2024-09-19T05:17:49.257506+0000","last_became_active":"2024-09-19T05:17:30.203840+0000","last_became_peered":"2024-09-19T05:17:30.203840+0000","last_unstale":"2024-09-19T05:17:49.257506+0000","last_undegraded":"2024-09-19T05:17:49.257506+0000","last_fullsized":"2024-09-19T05:17:49.257506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:48.363862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.256914+0000","last_change":"2024-09-19T05:17:28.204474+0000","last_active":"2024-09-19T05:17:49.256914+0000","last_peered":"2024-09-19T05:17:49.256914+0000","last_clean":"2024-09-19T05:17:49.256914+0000","last_became_active":"2024-09-19T05:17:28.204143+0000","last_became_peered":"2024-09-19T05:17:28.204143+0000","last_unstale":"2024-09-19T05:17:49.256914+0000","last_undegraded":"2024-09-19T05:17:49.256914+0000","last_fullsized":"2024-09-19T05:17:49.256914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:46.647789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257702+0000","last_change":"2024-09-19T05:17:30.198791+0000","last_active":"2024-09-19T05:17:49.257702+0000","last_peered":"2024-09-19T05:17:49.257702+0000","last_clean":"2024-09-19T05:17:49.257702+0000","last_became_active":"2024-09-19T05:17:30.198399+0000","last_became_peered":"2024-09-19T05:17:30.198399+0000","last_unstale":"2024-09-19T05:17:49.257702+0000","last_undegraded":"2024-09-19T05:17:49.257702+0000","last_fullsized":"2024-09-19T05:17:49.257702+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:46.676625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.505515+0000","last_change":"2024-09-19T05:17:28.204690+0000","last_active":"2024-09-19T05:17:49.505515+0000","last_peered":"2024-09-19T05:17:49.505515+0000","last_clean":"2024-09-19T05:17:49.505515+0000","last_became_active":"2024-09-19T05:17:28.204377+0000","last_became_peered":"2024-09-19T05:17:28.204377+0000","last_unstale":"2024-09-19T05:17:49.505515+0000","last_undegraded":"2024-09-19T05:17:49.505515+0000","last_fullsized":"2024-09-19T05:17:49.505515+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:29:20.583163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254992+0000","last_change":"2024-09-19T05:17:30.200584+0000","last_active":"2024-09-19T05:17:49.254992+0000","last_peered":"2024-09-19T05:17:49.254992+0000","last_clean":"2024-09-19T05:17:49.254992+0000","last_became_active":"2024-09-19T05:17:30.200270+0000","last_became_peered":"2024-09-19T05:17:30.200270+0000","last_unstale":"2024-09-19T05:17:49.254992+0000","last_undegraded":"2024-09-19T05:17:49.254992+0000","last_fullsized":"2024-09-19T05:17:49.254992+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:24:43.493332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:51.196734+0000","last_change":"2024-09-19T05:17:28.181020+0000","last_active":"2024-09-19T05:17:51.196734+0000","last_peered":"2024-09-19T05:17:51.196734+0000","last_clean":"2024-09-19T05:17:51.196734+0000","last_became_active":"2024-09-19T05:17:28.180298+0000","last_became_peered":"2024-09-19T05:17:28.180298+0000","last_unstale":"2024-09-19T05:17:51.196734+0000","last_undegraded":"2024-09-19T05:17:51.196734+0000","last_fullsized":"2024-09-19T05:17:51.196734+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:32.931699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258799+0000","last_change":"2024-09-19T05:17:30.209632+0000","last_active":"2024-09-19T05:17:49.258799+0000","last_peered":"2024-09-19T05:17:49.258799+0000","last_clean":"2024-09-19T05:17:49.258799+0000","last_became_active":"2024-09-19T05:17:30.209334+0000","last_became_peered":"2024-09-19T05:17:30.209334+0000","last_unstale":"2024-09-19T05:17:49.258799+0000","last_undegraded":"2024-09-19T05:17:49.258799+0000","last_fullsized":"2024-09-19T05:17:49.258799+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:21.159099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259725+0000","last_change":"2024-09-19T05:17:28.543802+0000","last_active":"2024-09-19T05:17:49.259725+0000","last_peered":"2024-09-19T05:17:49.259725+0000","last_clean":"2024-09-19T05:17:49.259725+0000","last_became_active":"2024-09-19T05:17:28.543503+0000","last_became_peered":"2024-09-19T05:17:28.543503+0000","last_unstale":"2024-09-19T05:17:49.259725+0000","last_undegraded":"2024-09-19T05:17:49.259725+0000","last_fullsized":"2024-09-19T05:17:49.259725+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:13.764141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258058+0000","last_change":"2024-09-19T05:17:30.206755+0000","last_active":"2024-09-19T05:17:49.258058+0000","last_peered":"2024-09-19T05:17:49.258058+0000","last_clean":"2024-09-19T05:17:49.258058+0000","last_became_active":"2024-09-19T05:17:30.205757+0000","last_became_peered":"2024-09-19T05:17:30.205757+0000","last_unstale":"2024-09-19T05:17:49.258058+0000","last_undegraded":"2024-09-19T05:17:49.258058+0000","last_fullsized":"2024-09-19T05:17:49.258058+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:16.281294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253238+0000","last_change":"2024-09-19T05:17:28.204819+0000","last_active":"2024-09-19T05:17:49.253238+0000","last_peered":"2024-09-19T05:17:49.253238+0000","last_clean":"2024-09-19T05:17:49.253238+0000","last_became_active":"2024-09-19T05:17:28.204445+0000","last_became_peered":"2024-09-19T05:17:28.204445+0000","last_unstale":"2024-09-19T05:17:49.253238+0000","last_undegraded":"2024-09-19T05:17:49.253238+0000","last_fullsized":"2024-09-19T05:17:49.253238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:26.473654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.504996+0000","last_change":"2024-09-19T05:17:30.201331+0000","last_active":"2024-09-19T05:17:49.504996+0000","last_peered":"2024-09-19T05:17:49.504996+0000","last_clean":"2024-09-19T05:17:49.504996+0000","last_became_active":"2024-09-19T05:17:30.200992+0000","last_became_peered":"2024-09-19T05:17:30.200992+0000","last_unstale":"2024-09-19T05:17:49.504996+0000","last_undegraded":"2024-09-19T05:17:49.504996+0000","last_fullsized":"2024-09-19T05:17:49.504996+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:17.033786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257860+0000","last_change":"2024-09-19T05:17:28.180149+0000","last_active":"2024-09-19T05:17:49.257860+0000","last_peered":"2024-09-19T05:17:49.257860+0000","last_clean":"2024-09-19T05:17:49.257860+0000","last_became_active":"2024-09-19T05:17:28.179767+0000","last_became_peered":"2024-09-19T05:17:28.179767+0000","last_unstale":"2024-09-19T05:17:49.257860+0000","last_undegraded":"2024-09-19T05:17:49.257860+0000","last_fullsized":"2024-09-19T05:17:49.257860+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:25.074252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254511+0000","last_change":"2024-09-19T05:17:30.204533+0000","last_active":"2024-09-19T05:17:49.254511+0000","last_peered":"2024-09-19T05:17:49.254511+0000","last_clean":"2024-09-19T05:17:49.254511+0000","last_became_active":"2024-09-19T05:17:30.204224+0000","last_became_peered":"2024-09-19T05:17:30.204224+0000","last_unstale":"2024-09-19T05:17:49.254511+0000","last_undegraded":"2024-09-19T05:17:49.254511+0000","last_fullsized":"2024-09-19T05:17:49.254511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:11.021297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253084+0000","last_change":"2024-09-19T05:17:28.187544+0000","last_active":"2024-09-19T05:17:49.253084+0000","last_peered":"2024-09-19T05:17:49.253084+0000","last_clean":"2024-09-19T05:17:49.253084+0000","last_became_active":"2024-09-19T05:17:28.187068+0000","last_became_peered":"2024-09-19T05:17:28.187068+0000","last_unstale":"2024-09-19T05:17:49.253084+0000","last_undegraded":"2024-09-19T05:17:49.253084+0000","last_fullsized":"2024-09-19T05:17:49.253084+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:01.151721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257927+0000","last_change":"2024-09-19T05:17:30.209549+0000","last_active":"2024-09-19T05:17:49.257927+0000","last_peered":"2024-09-19T05:17:49.257927+0000","last_clean":"2024-09-19T05:17:49.257927+0000","last_became_active":"2024-09-19T05:17:30.209225+0000","last_became_peered":"2024-09-19T05:17:30.209225+0000","last_unstale":"2024-09-19T05:17:49.257927+0000","last_undegraded":"2024-09-19T05:17:49.257927+0000","last_fullsized":"2024-09-19T05:17:49.257927+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:38.023351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.504986+0000","last_change":"2024-09-19T05:17:28.186601+0000","last_active":"2024-09-19T05:17:49.504986+0000","last_peered":"2024-09-19T05:17:49.504986+0000","last_clean":"2024-09-19T05:17:49.504986+0000","last_became_active":"2024-09-19T05:17:28.186236+0000","last_became_peered":"2024-09-19T05:17:28.186236+0000","last_unstale":"2024-09-19T05:17:49.504986+0000","last_undegraded":"2024-09-19T05:17:49.504986+0000","last_fullsized":"2024-09-19T05:17:49.504986+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:08.527906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257720+0000","last_change":"2024-09-19T05:17:30.203633+0000","last_active":"2024-09-19T05:17:49.257720+0000","last_peered":"2024-09-19T05:17:49.257720+0000","last_clean":"2024-09-19T05:17:49.257720+0000","last_became_active":"2024-09-19T05:17:30.203313+0000","last_became_peered":"2024-09-19T05:17:30.203313+0000","last_unstale":"2024-09-19T05:17:49.257720+0000","last_undegraded":"2024-09-19T05:17:49.257720+0000","last_fullsized":"2024-09-19T05:17:49.257720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:40.442434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.260731+0000","last_change":"2024-09-19T05:17:49.260345+0000","last_active":"2024-09-19T05:17:49.260731+0000","last_peered":"2024-09-19T05:17:49.260731+0000","last_clean":"2024-09-19T05:17:49.260731+0000","last_became_active":"2024-09-19T05:17:49.259938+0000","last_became_peered":"2024-09-19T05:17:49.259938+0000","last_unstale":"2024-09-19T05:17:49.260731+0000","last_undegraded":"2024-09-19T05:17:49.260731+0000","last_fullsized":"2024-09-19T05:17:49.260731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:01.904276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.505270+0000","last_change":"2024-09-19T05:17:28.182014+0000","last_active":"2024-09-19T05:17:49.505270+0000","last_peered":"2024-09-19T05:17:49.505270+0000","last_clean":"2024-09-19T05:17:49.505270+0000","last_became_active":"2024-09-19T05:17:28.181666+0000","last_became_peered":"2024-09-19T05:17:28.181666+0000","last_unstale":"2024-09-19T05:17:49.505270+0000","last_undegraded":"2024-09-19T05:17:49.505270+0000","last_fullsized":"2024-09-19T05:17:49.505270+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:00:57.069618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253344+0000","last_change":"2024-09-19T05:17:30.206428+0000","last_active":"2024-09-19T05:17:49.253344+0000","last_peered":"2024-09-19T05:17:49.253344+0000","last_clean":"2024-09-19T05:17:49.253344+0000","last_became_active":"2024-09-19T05:17:30.205818+0000","last_became_peered":"2024-09-19T05:17:30.205818+0000","last_unstale":"2024-09-19T05:17:49.253344+0000","last_undegraded":"2024-09-19T05:17:49.253344+0000","last_fullsized":"2024-09-19T05:17:49.253344+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:26.059019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.505410+0000","last_change":"2024-09-19T05:17:28.185596+0000","last_active":"2024-09-19T05:17:49.505410+0000","last_peered":"2024-09-19T05:17:49.505410+0000","last_clean":"2024-09-19T05:17:49.505410+0000","last_became_active":"2024-09-19T05:17:28.185278+0000","last_became_peered":"2024-09-19T05:17:28.185278+0000","last_unstale":"2024-09-19T05:17:49.505410+0000","last_undegraded":"2024-09-19T05:17:49.505410+0000","last_fullsized":"2024-09-19T05:17:49.505410+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:40.440874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258328+0000","last_change":"2024-09-19T05:17:30.200409+0000","last_active":"2024-09-19T05:17:49.258328+0000","last_peered":"2024-09-19T05:17:49.258328+0000","last_clean":"2024-09-19T05:17:49.258328+0000","last_became_active":"2024-09-19T05:17:30.200120+0000","last_became_peered":"2024-09-19T05:17:30.200120+0000","last_unstale":"2024-09-19T05:17:49.258328+0000","last_undegraded":"2024-09-19T05:17:49.258328+0000","last_fullsized":"2024-09-19T05:17:49.258328+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:12.396655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259201+0000","last_change":"2024-09-19T05:17:28.205371+0000","last_active":"2024-09-19T05:17:49.259201+0000","last_peered":"2024-09-19T05:17:49.259201+0000","last_clean":"2024-09-19T05:17:49.259201+0000","last_became_active":"2024-09-19T05:17:28.205026+0000","last_became_peered":"2024-09-19T05:17:28.205026+0000","last_unstale":"2024-09-19T05:17:49.259201+0000","last_undegraded":"2024-09-19T05:17:49.259201+0000","last_fullsized":"2024-09-19T05:17:49.259201+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:59.518580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258928+0000","last_change":"2024-09-19T05:17:30.206862+0000","last_active":"2024-09-19T05:17:49.258928+0000","last_peered":"2024-09-19T05:17:49.258928+0000","last_clean":"2024-09-19T05:17:49.258928+0000","last_became_active":"2024-09-19T05:17:30.206072+0000","last_became_peered":"2024-09-19T05:17:30.206072+0000","last_unstale":"2024-09-19T05:17:49.258928+0000","last_undegraded":"2024-09-19T05:17:49.258928+0000","last_fullsized":"2024-09-19T05:17:49.258928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:47.810496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257340+0000","last_change":"2024-09-19T05:17:28.181895+0000","last_active":"2024-09-19T05:17:49.257340+0000","last_peered":"2024-09-19T05:17:49.257340+0000","last_clean":"2024-09-19T05:17:49.257340+0000","last_became_active":"2024-09-19T05:17:28.181499+0000","last_became_peered":"2024-09-19T05:17:28.181499+0000","last_unstale":"2024-09-19T05:17:49.257340+0000","last_undegraded":"2024-09-19T05:17:49.257340+0000","last_fullsized":"2024-09-19T05:17:49.257340+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:29.722921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":55710,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":101,"num_read_kb":108,"num_write":155,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":156095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579921,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":433550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36888,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708264,"statfs":{"total":95995035648,"available":95957262336,"internally_reserved":0,"allocated":1581056,"data_stored":1077097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939675,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":909312,"data_stored":433752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168608,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":909312,"data_stored":433672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397540,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1503232,"data_stored":1025211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561065,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":897024,"data_stored":433141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913789998,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32672,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712480,"statfs":{"total":95995035648,"available":95961579520,"internally_reserved":0,"allocated":1515520,"data_stored":1024895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953523,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":433578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215160,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":433452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444094,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":486350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607618,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":937984,"data_stored":473999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":917504,"data_stored":434412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":41065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":53416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":53678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:17:57.677 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T05:17:57.678 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T05:17:57.678 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T05:17:57.930 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:58.321 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:58 smithi120 ceph-mon[30956]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:17:58.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.408+0000 7f578fb04640 1 -- 172.21.15.120:0/3652953905 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5788100b10 msgr2=0x7f5788100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:58.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.408+0000 7f578fb04640 1 --2- 172.21.15.120:0/3652953905 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5788100b10 0x7f5788100f10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5784009900 tx=0x7f578402a410 comp rx=0 tx=0).stop 2024-09-19T05:17:58.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.408+0000 7f578fb04640 1 -- 172.21.15.120:0/3652953905 shutdown_connections 2024-09-19T05:17:58.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.408+0000 7f578fb04640 1 --2- 172.21.15.120:0/3652953905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57881026d0 0x7f5788108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:58.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.408+0000 7f578fb04640 1 --2- 172.21.15.120:0/3652953905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5788101d10 0x7f5788102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:58.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.408+0000 7f578fb04640 1 --2- 172.21.15.120:0/3652953905 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5788100b10 0x7f5788100f10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:58.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.408+0000 7f578fb04640 1 -- 172.21.15.120:0/3652953905 >> 172.21.15.120:0/3652953905 conn(0x7f57880fc2a0 msgr2=0x7f57880fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:58.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.408+0000 7f578fb04640 1 -- 172.21.15.120:0/3652953905 shutdown_connections 2024-09-19T05:17:58.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.408+0000 7f578fb04640 1 -- 172.21.15.120:0/3652953905 wait complete. 2024-09-19T05:17:58.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.408+0000 7f578fb04640 1 Processor -- start 2024-09-19T05:17:58.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.408+0000 7f578fb04640 1 -- start start 2024-09-19T05:17:58.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.409+0000 7f578fb04640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5788100b10 0x7f5788195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:58.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.409+0000 7f578fb04640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5788101d10 0x7f57881962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:58.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.409+0000 7f578fb04640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57881026d0 0x7f578819d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:58.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.409+0000 7f578fb04640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f578810b610 con 0x7f5788100b10 2024-09-19T05:17:58.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.409+0000 7f578fb04640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f578810b490 con 0x7f57881026d0 2024-09-19T05:17:58.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.409+0000 7f578fb04640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f578810b790 con 0x7f5788101d10 2024-09-19T05:17:58.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.409+0000 7f578d8a0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5788100b10 0x7f5788195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:58.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.409+0000 7f578d8a0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5788100b10 0x7f5788195da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47750/0 (socket says 172.21.15.120:47750) 2024-09-19T05:17:58.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.409+0000 7f578d8a0640 1 -- 172.21.15.120:0/36614524 learned_addr learned my addr 172.21.15.120:0/36614524 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:17:58.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.409+0000 7f578e0a1640 1 --2- 172.21.15.120:0/36614524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57881026d0 0x7f578819d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:58.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.409+0000 7f578d09f640 1 --2- 172.21.15.120:0/36614524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5788101d10 0x7f57881962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:58.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.409+0000 7f578d8a0640 1 -- 172.21.15.120:0/36614524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5788101d10 msgr2=0x7f57881962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:58.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.409+0000 7f578d8a0640 1 --2- 172.21.15.120:0/36614524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5788101d10 0x7f57881962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:58.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.409+0000 7f578d8a0640 1 -- 172.21.15.120:0/36614524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57881026d0 msgr2=0x7f578819d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:58.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.409+0000 7f578d8a0640 1 --2- 172.21.15.120:0/36614524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57881026d0 0x7f578819d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:58.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.409+0000 7f578d8a0640 1 -- 172.21.15.120:0/36614524 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578819d9d0 con 0x7f5788100b10 2024-09-19T05:17:58.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.409+0000 7f578d09f640 1 --2- 172.21.15.120:0/36614524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5788101d10 0x7f57881962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:17:58.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.409+0000 7f578d8a0640 1 --2- 172.21.15.120:0/36614524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5788100b10 0x7f5788195da0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5784009230 tx=0x7f5784004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:58.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.409+0000 7f577effd640 1 -- 172.21.15.120:0/36614524 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578403f030 con 0x7f5788100b10 2024-09-19T05:17:58.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.409+0000 7f577effd640 1 -- 172.21.15.120:0/36614524 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5784003cb0 con 0x7f5788100b10 2024-09-19T05:17:58.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.409+0000 7f578fb04640 1 -- 172.21.15.120:0/36614524 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f578819dc60 con 0x7f5788100b10 2024-09-19T05:17:58.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.409+0000 7f577effd640 1 -- 172.21.15.120:0/36614524 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784035070 con 0x7f5788100b10 2024-09-19T05:17:58.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.410+0000 7f578fb04640 1 -- 172.21.15.120:0/36614524 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f578819e190 con 0x7f5788100b10 2024-09-19T05:17:58.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.411+0000 7f578fb04640 1 -- 172.21.15.120:0/36614524 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5788108050 con 0x7f5788100b10 2024-09-19T05:17:58.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.412+0000 7f577effd640 1 -- 172.21.15.120:0/36614524 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f5784042030 con 0x7f5788100b10 2024-09-19T05:17:58.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.413+0000 7f577effd640 1 --2- 172.21.15.120:0/36614524 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f57740a5590 0x7f57740a7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:17:58.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.413+0000 7f578d09f640 1 --2- 172.21.15.120:0/36614524 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f57740a5590 0x7f57740a7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:17:58.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.413+0000 7f577effd640 1 -- 172.21.15.120:0/36614524 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f57840f0180 con 0x7f5788100b10 2024-09-19T05:17:58.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.413+0000 7f578d09f640 1 --2- 172.21.15.120:0/36614524 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f57740a5590 0x7f57740a7a50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5778006fd0 tx=0x7f5778008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:17:58.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.417+0000 7f577effd640 1 -- 172.21.15.120:0/36614524 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f57840bcd20 con 0x7f5788100b10 2024-09-19T05:17:58.608 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:58 smithi178 ceph-mon[34347]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:17:58.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.647+0000 7f578fb04640 1 -- 172.21.15.120:0/36614524 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f5788062df0 con 0x7f5788100b10 2024-09-19T05:17:58.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.649+0000 7f577effd640 1 -- 172.21.15.120:0/36614524 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f57840bc620 con 0x7f5788100b10 2024-09-19T05:17:58.651 INFO:teuthology.orchestra.run.smithi120.stdout:[client.0] 2024-09-19T05:17:58.651 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQAGtOtmU4erJhAAmWxHAHHDNyDtM/5Y9XLS8A== 2024-09-19T05:17:58.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.651+0000 7f578fb04640 1 -- 172.21.15.120:0/36614524 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f57740a5590 msgr2=0x7f57740a7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:58.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.651+0000 7f578fb04640 1 --2- 172.21.15.120:0/36614524 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f57740a5590 0x7f57740a7a50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5778006fd0 tx=0x7f5778008040 comp rx=0 tx=0).stop 2024-09-19T05:17:58.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.651+0000 7f578fb04640 1 -- 172.21.15.120:0/36614524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5788100b10 msgr2=0x7f5788195da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:17:58.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.651+0000 7f578fb04640 1 --2- 172.21.15.120:0/36614524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5788100b10 0x7f5788195da0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5784009230 tx=0x7f5784004340 comp rx=0 tx=0).stop 2024-09-19T05:17:58.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.651+0000 7f578fb04640 1 -- 172.21.15.120:0/36614524 shutdown_connections 2024-09-19T05:17:58.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.651+0000 7f578fb04640 1 --2- 172.21.15.120:0/36614524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57881026d0 0x7f578819d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:58.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.651+0000 7f578fb04640 1 --2- 172.21.15.120:0/36614524 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f57740a5590 0x7f57740a7a50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:58.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.651+0000 7f578fb04640 1 --2- 172.21.15.120:0/36614524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5788101d10 0x7f57881962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:58.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.652+0000 7f578fb04640 1 --2- 172.21.15.120:0/36614524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5788100b10 0x7f5788195da0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:17:58.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.652+0000 7f578fb04640 1 -- 172.21.15.120:0/36614524 >> 172.21.15.120:0/36614524 conn(0x7f57880fc2a0 msgr2=0x7f5788105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:17:58.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.652+0000 7f578fb04640 1 -- 172.21.15.120:0/36614524 shutdown_connections 2024-09-19T05:17:58.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:17:58.652+0000 7f578fb04640 1 -- 172.21.15.120:0/36614524 wait complete. 2024-09-19T05:17:58.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:58 smithi194 ceph-mon[35228]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:17:59.279 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T05:17:59.279 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T05:17:59.279 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T05:17:59.316 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T05:17:59.317 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T05:17:59.317 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T05:17:59.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:59 smithi120 ceph-mon[30956]: pgmap v287: 97 pgs: 97 active+clean; 631 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.0 KiB/s wr, 6 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T05:17:59.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:59 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/36614524' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T05:17:59.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:17:59 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/36614524' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T05:17:59.600 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:17:59.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:59 smithi194 ceph-mon[35228]: pgmap v287: 97 pgs: 97 active+clean; 631 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.0 KiB/s wr, 6 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T05:17:59.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:59 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/36614524' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T05:17:59.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:17:59 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/36614524' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T05:17:59.691 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:59 smithi178 ceph-mon[34347]: pgmap v287: 97 pgs: 97 active+clean; 631 KiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3.0 KiB/s wr, 6 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-09-19T05:17:59.691 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:59 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/36614524' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T05:17:59.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:17:59 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/36614524' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T05:18:00.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.030+0000 7f1be0027640 1 -- 172.21.15.120:0/1025250268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bd8106a80 msgr2=0x7f1bd8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:00.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.030+0000 7f1be0027640 1 --2- 172.21.15.120:0/1025250268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bd8106a80 0x7f1bd8106e60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4009930 tx=0x7f1bd402a420 comp rx=0 tx=0).stop 2024-09-19T05:18:00.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.030+0000 7f1be0027640 1 -- 172.21.15.120:0/1025250268 shutdown_connections 2024-09-19T05:18:00.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.030+0000 7f1be0027640 1 --2- 172.21.15.120:0/1025250268 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bd8101420 0x7f1bd810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:00.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.030+0000 7f1be0027640 1 --2- 172.21.15.120:0/1025250268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bd8100a80 0x7f1bd8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:00.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.030+0000 7f1be0027640 1 --2- 172.21.15.120:0/1025250268 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bd8106a80 0x7f1bd8106e60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:00.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.030+0000 7f1be0027640 1 -- 172.21.15.120:0/1025250268 >> 172.21.15.120:0/1025250268 conn(0x7f1bd80fc7a0 msgr2=0x7f1bd80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:00.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.030+0000 7f1be0027640 1 -- 172.21.15.120:0/1025250268 shutdown_connections 2024-09-19T05:18:00.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.030+0000 7f1be0027640 1 -- 172.21.15.120:0/1025250268 wait complete. 2024-09-19T05:18:00.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.031+0000 7f1be0027640 1 Processor -- start 2024-09-19T05:18:00.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.031+0000 7f1be0027640 1 -- start start 2024-09-19T05:18:00.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.031+0000 7f1be0027640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bd8100a80 0x7f1bd8198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:00.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.031+0000 7f1be0027640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bd8101420 0x7f1bd8198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:00.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.031+0000 7f1be0027640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bd8106a80 0x7f1bd819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:00.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.031+0000 7f1be0027640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd8110d30 con 0x7f1bd8101420 2024-09-19T05:18:00.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.031+0000 7f1be0027640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd8110bb0 con 0x7f1bd8106a80 2024-09-19T05:18:00.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.031+0000 7f1be0027640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd8110eb0 con 0x7f1bd8100a80 2024-09-19T05:18:00.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.031+0000 7f1bdd5c2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bd8101420 0x7f1bd8198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:00.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.031+0000 7f1bdd5c2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bd8101420 0x7f1bd8198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47766/0 (socket says 172.21.15.120:47766) 2024-09-19T05:18:00.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.031+0000 7f1bdd5c2640 1 -- 172.21.15.120:0/4104727919 learned_addr learned my addr 172.21.15.120:0/4104727919 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:00.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.031+0000 7f1bde5c4640 1 --2- 172.21.15.120:0/4104727919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bd8106a80 0x7f1bd819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:00.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.031+0000 7f1bdddc3640 1 --2- 172.21.15.120:0/4104727919 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bd8100a80 0x7f1bd8198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:00.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.032+0000 7f1bdd5c2640 1 -- 172.21.15.120:0/4104727919 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bd8100a80 msgr2=0x7f1bd8198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:00.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.032+0000 7f1bdd5c2640 1 --2- 172.21.15.120:0/4104727919 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bd8100a80 0x7f1bd8198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:00.048 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.032+0000 7f1bdd5c2640 1 -- 172.21.15.120:0/4104727919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bd8106a80 msgr2=0x7f1bd819cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:00.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.032+0000 7f1bdd5c2640 1 --2- 172.21.15.120:0/4104727919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bd8106a80 0x7f1bd819cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:00.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.032+0000 7f1bdd5c2640 1 -- 172.21.15.120:0/4104727919 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd819d2d0 con 0x7f1bd8101420 2024-09-19T05:18:00.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.032+0000 7f1bdd5c2640 1 --2- 172.21.15.120:0/4104727919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bd8101420 0x7f1bd8198860 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800c920 tx=0x7f1bc800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:00.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.032+0000 7f1bceffd640 1 -- 172.21.15.120:0/4104727919 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8007c70 con 0x7f1bd8101420 2024-09-19T05:18:00.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.032+0000 7f1bceffd640 1 -- 172.21.15.120:0/4104727919 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1bc8007e10 con 0x7f1bd8101420 2024-09-19T05:18:00.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.032+0000 7f1bceffd640 1 -- 172.21.15.120:0/4104727919 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8018820 con 0x7f1bd8101420 2024-09-19T05:18:00.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.032+0000 7f1be0027640 1 -- 172.21.15.120:0/4104727919 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd819d5c0 con 0x7f1bd8101420 2024-09-19T05:18:00.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.032+0000 7f1be0027640 1 -- 172.21.15.120:0/4104727919 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd81a4ea0 con 0x7f1bd8101420 2024-09-19T05:18:00.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.033+0000 7f1be0027640 1 -- 172.21.15.120:0/4104727919 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bd8100ee0 con 0x7f1bd8101420 2024-09-19T05:18:00.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.034+0000 7f1bceffd640 1 -- 172.21.15.120:0/4104727919 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f1bc80189c0 con 0x7f1bd8101420 2024-09-19T05:18:00.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.035+0000 7f1bceffd640 1 --2- 172.21.15.120:0/4104727919 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f1bc40a3350 0x7f1bc40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:00.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.035+0000 7f1bdddc3640 1 --2- 172.21.15.120:0/4104727919 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f1bc40a3350 0x7f1bc40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:00.049 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.035+0000 7f1bceffd640 1 -- 172.21.15.120:0/4104727919 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f1bc80cfd70 con 0x7f1bd8101420 2024-09-19T05:18:00.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.035+0000 7f1bdddc3640 1 --2- 172.21.15.120:0/4104727919 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f1bc40a3350 0x7f1bc40a5810 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4006010 tx=0x7f1bd4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:00.050 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.038+0000 7f1bceffd640 1 -- 172.21.15.120:0/4104727919 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1bc8014030 con 0x7f1bd8101420 2024-09-19T05:18:00.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.254+0000 7f1be0027640 1 -- 172.21.15.120:0/4104727919 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f1bd8199680 con 0x7f1bd8101420 2024-09-19T05:18:00.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.259+0000 7f1bceffd640 1 -- 172.21.15.120:0/4104727919 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264055 (secure 0 0 0) 0x7f1bd8199680 con 0x7f1bd8101420 2024-09-19T05:18:00.264 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:18:00.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.262+0000 7f1be0027640 1 -- 172.21.15.120:0/4104727919 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f1bc40a3350 msgr2=0x7f1bc40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:00.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.262+0000 7f1be0027640 1 --2- 172.21.15.120:0/4104727919 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f1bc40a3350 0x7f1bc40a5810 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4006010 tx=0x7f1bd4000bc0 comp rx=0 tx=0).stop 2024-09-19T05:18:00.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.262+0000 7f1be0027640 1 -- 172.21.15.120:0/4104727919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bd8101420 msgr2=0x7f1bd8198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:00.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.262+0000 7f1be0027640 1 --2- 172.21.15.120:0/4104727919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bd8101420 0x7f1bd8198860 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800c920 tx=0x7f1bc800cde0 comp rx=0 tx=0).stop 2024-09-19T05:18:00.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.262+0000 7f1be0027640 1 -- 172.21.15.120:0/4104727919 shutdown_connections 2024-09-19T05:18:00.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.262+0000 7f1be0027640 1 --2- 172.21.15.120:0/4104727919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bd8106a80 0x7f1bd819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:00.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.262+0000 7f1be0027640 1 --2- 172.21.15.120:0/4104727919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bd8101420 0x7f1bd8198860 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:00.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.262+0000 7f1be0027640 1 --2- 172.21.15.120:0/4104727919 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f1bc40a3350 0x7f1bc40a5810 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:00.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.262+0000 7f1be0027640 1 --2- 172.21.15.120:0/4104727919 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bd8100a80 0x7f1bd8198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:00.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.262+0000 7f1be0027640 1 -- 172.21.15.120:0/4104727919 >> 172.21.15.120:0/4104727919 conn(0x7f1bd80fc7a0 msgr2=0x7f1bd806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:00.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.262+0000 7f1be0027640 1 -- 172.21.15.120:0/4104727919 shutdown_connections 2024-09-19T05:18:00.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:00.262+0000 7f1be0027640 1 -- 172.21.15.120:0/4104727919 wait complete. 2024-09-19T05:18:00.558 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:00 smithi120 ceph-mon[30956]: pgmap v288: 97 pgs: 97 active+clean; 639 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.5 KiB/s wr, 7 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T05:18:00.559 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:00 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/4104727919' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T05:18:00.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:00 smithi194 ceph-mon[35228]: pgmap v288: 97 pgs: 97 active+clean; 639 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.5 KiB/s wr, 7 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T05:18:00.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:00 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/4104727919' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T05:18:00.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:00 smithi178 ceph-mon[34347]: pgmap v288: 97 pgs: 97 active+clean; 639 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.5 KiB/s wr, 7 op/s; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T05:18:00.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:00 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/4104727919' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T05:18:00.997 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":955692128},{"type":"v1","addr":"172.21.15.120:6801","nonce":955692128}]},"active_addr":"172.21.15.120:6801/955692128","active_change":"2024-09-19T05:10:48.028000+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.120:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.120:0","nonce":1358819866}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.120:0","nonce":1091097763}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.120:0","nonce":3049956965}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.120:0","nonce":316867529}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.120:0","nonce":3080806681}]}]} 2024-09-19T05:18:01.003 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T05:18:01.003 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T05:18:01.003 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T05:18:01.250 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:01.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.714+0000 7f6dbad98640 1 -- 172.21.15.120:0/3142152985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6db4106a80 msgr2=0x7f6db4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:01.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.714+0000 7f6dbad98640 1 --2- 172.21.15.120:0/3142152985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6db4106a80 0x7f6db4106e60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6da8009930 tx=0x7f6da802a420 comp rx=0 tx=0).stop 2024-09-19T05:18:01.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.714+0000 7f6dbad98640 1 -- 172.21.15.120:0/3142152985 shutdown_connections 2024-09-19T05:18:01.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.714+0000 7f6dbad98640 1 --2- 172.21.15.120:0/3142152985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6db4101420 0x7f6db410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:01.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.714+0000 7f6dbad98640 1 --2- 172.21.15.120:0/3142152985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6db4100a80 0x7f6db4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:01.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.714+0000 7f6dbad98640 1 --2- 172.21.15.120:0/3142152985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6db4106a80 0x7f6db4106e60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:01.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.714+0000 7f6dbad98640 1 -- 172.21.15.120:0/3142152985 >> 172.21.15.120:0/3142152985 conn(0x7f6db40fc7a0 msgr2=0x7f6db40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:01.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.714+0000 7f6dbad98640 1 -- 172.21.15.120:0/3142152985 shutdown_connections 2024-09-19T05:18:01.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.714+0000 7f6dbad98640 1 -- 172.21.15.120:0/3142152985 wait complete. 2024-09-19T05:18:01.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.715+0000 7f6dbad98640 1 Processor -- start 2024-09-19T05:18:01.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.715+0000 7f6dbad98640 1 -- start start 2024-09-19T05:18:01.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.715+0000 7f6dbad98640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6db4100a80 0x7f6db41983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:01.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.715+0000 7f6dbad98640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6db4101420 0x7f6db4198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:01.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.715+0000 7f6dbad98640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6db4106a80 0x7f6db419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:01.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.715+0000 7f6dbad98640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6db4110d50 con 0x7f6db4100a80 2024-09-19T05:18:01.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.715+0000 7f6dbad98640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6db4110bd0 con 0x7f6db4106a80 2024-09-19T05:18:01.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.715+0000 7f6dbad98640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6db4110ed0 con 0x7f6db4101420 2024-09-19T05:18:01.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.715+0000 7f6db8b34640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6db4100a80 0x7f6db41983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:01.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.715+0000 7f6db8b34640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6db4100a80 0x7f6db41983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47774/0 (socket says 172.21.15.120:47774) 2024-09-19T05:18:01.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.715+0000 7f6db8b34640 1 -- 172.21.15.120:0/177625457 learned_addr learned my addr 172.21.15.120:0/177625457 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:01.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.715+0000 7f6db9335640 1 --2- 172.21.15.120:0/177625457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6db4106a80 0x7f6db419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:01.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.715+0000 7f6db3fff640 1 --2- 172.21.15.120:0/177625457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6db4101420 0x7f6db4198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:01.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.715+0000 7f6db8b34640 1 -- 172.21.15.120:0/177625457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6db4101420 msgr2=0x7f6db4198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:01.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.715+0000 7f6db8b34640 1 --2- 172.21.15.120:0/177625457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6db4101420 0x7f6db4198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:01.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.715+0000 7f6db8b34640 1 -- 172.21.15.120:0/177625457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6db4106a80 msgr2=0x7f6db419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:01.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.715+0000 7f6db8b34640 1 --2- 172.21.15.120:0/177625457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6db4106a80 0x7f6db419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:01.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.715+0000 7f6db8b34640 1 -- 172.21.15.120:0/177625457 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db419d3a0 con 0x7f6db4100a80 2024-09-19T05:18:01.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.715+0000 7f6db3fff640 1 --2- 172.21.15.120:0/177625457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6db4101420 0x7f6db4198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:01.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.715+0000 7f6db9335640 1 --2- 172.21.15.120:0/177625457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6db4106a80 0x7f6db419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:18:01.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.715+0000 7f6db8b34640 1 --2- 172.21.15.120:0/177625457 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6db4100a80 0x7f6db41983f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6da8004770 tx=0x7f6da80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:01.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.716+0000 7f6db1ffb640 1 -- 172.21.15.120:0/177625457 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da803f070 con 0x7f6db4100a80 2024-09-19T05:18:01.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.716+0000 7f6db1ffb640 1 -- 172.21.15.120:0/177625457 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6da803b460 con 0x7f6db4100a80 2024-09-19T05:18:01.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.716+0000 7f6dbad98640 1 -- 172.21.15.120:0/177625457 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6db419d630 con 0x7f6db4100a80 2024-09-19T05:18:01.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.716+0000 7f6db1ffb640 1 -- 172.21.15.120:0/177625457 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da8035070 con 0x7f6db4100a80 2024-09-19T05:18:01.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.716+0000 7f6dbad98640 1 -- 172.21.15.120:0/177625457 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6db41a4f70 con 0x7f6db4100a80 2024-09-19T05:18:01.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.717+0000 7f6dbad98640 1 -- 172.21.15.120:0/177625457 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6db41021c0 con 0x7f6db4100a80 2024-09-19T05:18:01.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.718+0000 7f6db1ffb640 1 -- 172.21.15.120:0/177625457 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f6da803b610 con 0x7f6db4100a80 2024-09-19T05:18:01.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.718+0000 7f6db1ffb640 1 --2- 172.21.15.120:0/177625457 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f6da40a32d0 0x7f6da40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:01.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.718+0000 7f6db3fff640 1 --2- 172.21.15.120:0/177625457 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f6da40a32d0 0x7f6da40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:01.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.719+0000 7f6db1ffb640 1 -- 172.21.15.120:0/177625457 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f6da80eff00 con 0x7f6db4100a80 2024-09-19T05:18:01.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.719+0000 7f6db3fff640 1 --2- 172.21.15.120:0/177625457 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f6da40a32d0 0x7f6da40a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6db406b7e0 tx=0x7f6da0005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:01.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.723+0000 7f6db1ffb640 1 -- 172.21.15.120:0/177625457 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6da80bcaa0 con 0x7f6db4100a80 2024-09-19T05:18:01.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.890+0000 7f6dbad98640 1 -- 172.21.15.120:0/177625457 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6db41a5140 con 0x7f6db4100a80 2024-09-19T05:18:01.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.891+0000 7f6db1ffb640 1 -- 172.21.15.120:0/177625457 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22805 (secure 0 0 0) 0x7f6da80bc3a0 con 0x7f6db4100a80 2024-09-19T05:18:01.893 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:18:01.894 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":82,"fsid":"4e6e3df4-7645-11ef-bceb-c7b262605968","created":"2024-09-19T05:09:55.847220+0000","modified":"2024-09-19T05:17:49.248858+0000","last_up_change":"2024-09-19T05:16:42.808178+0000","last_in_change":"2024-09-19T05:16:18.315940+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:13:02.340027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:17:26.914416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:17:29.112997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"18907a03-1f43-419a-acb6-9fa4cf5020d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6803","nonce":3421474326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6805","nonce":3421474326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6809","nonce":3421474326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6807","nonce":3421474326}]},"public_addr":"172.21.15.120:6803/3421474326","cluster_addr":"172.21.15.120:6805/3421474326","heartbeat_back_addr":"172.21.15.120:6809/3421474326","heartbeat_front_addr":"172.21.15.120:6807/3421474326","state":["exists","up"]},{"osd":1,"uuid":"d21e029b-8a60-43f9-9ba7-30cdba19ba57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6801","nonce":1195511218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6803","nonce":1195511218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6807","nonce":1195511218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6805","nonce":1195511218}]},"public_addr":"172.21.15.178:6801/1195511218","cluster_addr":"172.21.15.178:6803/1195511218","heartbeat_back_addr":"172.21.15.178:6807/1195511218","heartbeat_front_addr":"172.21.15.178:6805/1195511218","state":["exists","up"]},{"osd":2,"uuid":"26ad9c8d-dbaa-46c2-a346-19717d81cc60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6801","nonce":3752826560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6803","nonce":3752826560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6807","nonce":3752826560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6805","nonce":3752826560}]},"public_addr":"172.21.15.194:6801/3752826560","cluster_addr":"172.21.15.194:6803/3752826560","heartbeat_back_addr":"172.21.15.194:6807/3752826560","heartbeat_front_addr":"172.21.15.194:6805/3752826560","state":["exists","up"]},{"osd":3,"uuid":"7e266576-8a98-40a8-9532-4b6f4611a908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6811","nonce":803566783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6813","nonce":803566783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6817","nonce":803566783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6815","nonce":803566783}]},"public_addr":"172.21.15.120:6811/803566783","cluster_addr":"172.21.15.120:6813/803566783","heartbeat_back_addr":"172.21.15.120:6817/803566783","heartbeat_front_addr":"172.21.15.120:6815/803566783","state":["exists","up"]},{"osd":4,"uuid":"c77d05c5-3b8f-4f7b-91f9-833735221684","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6809","nonce":541165323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6811","nonce":541165323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6815","nonce":541165323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6813","nonce":541165323}]},"public_addr":"172.21.15.178:6809/541165323","cluster_addr":"172.21.15.178:6811/541165323","heartbeat_back_addr":"172.21.15.178:6815/541165323","heartbeat_front_addr":"172.21.15.178:6813/541165323","state":["exists","up"]},{"osd":5,"uuid":"5f1c394b-e510-411f-969a-2db2b68cf41a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6809","nonce":2631415468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6811","nonce":2631415468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6815","nonce":2631415468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6813","nonce":2631415468}]},"public_addr":"172.21.15.194:6809/2631415468","cluster_addr":"172.21.15.194:6811/2631415468","heartbeat_back_addr":"172.21.15.194:6815/2631415468","heartbeat_front_addr":"172.21.15.194:6813/2631415468","state":["exists","up"]},{"osd":6,"uuid":"990af639-099e-49df-a083-05626cee3c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6819","nonce":388238976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6821","nonce":388238976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6825","nonce":388238976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6823","nonce":388238976}]},"public_addr":"172.21.15.120:6819/388238976","cluster_addr":"172.21.15.120:6821/388238976","heartbeat_back_addr":"172.21.15.120:6825/388238976","heartbeat_front_addr":"172.21.15.120:6823/388238976","state":["exists","up"]},{"osd":7,"uuid":"6f4aa6ab-b5f4-4c06-9f14-9a51bc195ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6817","nonce":1912109177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6819","nonce":1912109177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6823","nonce":1912109177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6821","nonce":1912109177}]},"public_addr":"172.21.15.178:6817/1912109177","cluster_addr":"172.21.15.178:6819/1912109177","heartbeat_back_addr":"172.21.15.178:6823/1912109177","heartbeat_front_addr":"172.21.15.178:6821/1912109177","state":["exists","up"]},{"osd":8,"uuid":"707739c9-732a-405c-847a-ce6a06e611b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6817","nonce":596878172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6819","nonce":596878172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6823","nonce":596878172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6821","nonce":596878172}]},"public_addr":"172.21.15.194:6817/596878172","cluster_addr":"172.21.15.194:6819/596878172","heartbeat_back_addr":"172.21.15.194:6823/596878172","heartbeat_front_addr":"172.21.15.194:6821/596878172","state":["exists","up"]},{"osd":9,"uuid":"9393b018-c924-4d75-99e5-25433d276567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6827","nonce":3257373801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6829","nonce":3257373801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6833","nonce":3257373801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6831","nonce":3257373801}]},"public_addr":"172.21.15.120:6827/3257373801","cluster_addr":"172.21.15.120:6829/3257373801","heartbeat_back_addr":"172.21.15.120:6833/3257373801","heartbeat_front_addr":"172.21.15.120:6831/3257373801","state":["exists","up"]},{"osd":10,"uuid":"45db7f62-87a6-4b2b-a3dc-012e2de505e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6825","nonce":3067822030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6827","nonce":3067822030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6831","nonce":3067822030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6829","nonce":3067822030}]},"public_addr":"172.21.15.178:6825/3067822030","cluster_addr":"172.21.15.178:6827/3067822030","heartbeat_back_addr":"172.21.15.178:6831/3067822030","heartbeat_front_addr":"172.21.15.178:6829/3067822030","state":["exists","up"]},{"osd":11,"uuid":"85ea248c-9a36-41cb-a200-87138fb31602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6825","nonce":2713146974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6827","nonce":2713146974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6831","nonce":2713146974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6829","nonce":2713146974}]},"public_addr":"172.21.15.194:6825/2713146974","cluster_addr":"172.21.15.194:6827/2713146974","heartbeat_back_addr":"172.21.15.194:6831/2713146974","heartbeat_front_addr":"172.21.15.194:6829/2713146974","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:09.395371+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:33.648930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:58.805048+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:23.621459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:48.553860+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:13.506636+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:38.520376+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:02.695124+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:27.084956+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:50.924128+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:15.396694+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:40.440416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":3,"to":8}]},{"pgid":"3.2a","mappings":[{"from":3,"to":6}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:0/3419110398":"2024-09-20T05:10:48.027892+0000","172.21.15.120:6801/50152720":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/4177074351":"2024-09-20T05:10:48.027892+0000","172.21.15.120:6800/50152720":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/329623296":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/2867300720":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/3592867428":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/4255533863":"2024-09-20T05:10:23.348128+0000","172.21.15.120:6801/3412493069":"2024-09-20T05:10:23.348128+0000","172.21.15.120:6800/3412493069":"2024-09-20T05:10:23.348128+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:18:01.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.894+0000 7f6dbad98640 1 -- 172.21.15.120:0/177625457 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f6da40a32d0 msgr2=0x7f6da40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:01.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.894+0000 7f6dbad98640 1 --2- 172.21.15.120:0/177625457 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f6da40a32d0 0x7f6da40a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6db406b7e0 tx=0x7f6da0005e50 comp rx=0 tx=0).stop 2024-09-19T05:18:01.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.894+0000 7f6dbad98640 1 -- 172.21.15.120:0/177625457 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6db4100a80 msgr2=0x7f6db41983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:01.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.894+0000 7f6dbad98640 1 --2- 172.21.15.120:0/177625457 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6db4100a80 0x7f6db41983f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6da8004770 tx=0x7f6da80042f0 comp rx=0 tx=0).stop 2024-09-19T05:18:01.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.894+0000 7f6dbad98640 1 -- 172.21.15.120:0/177625457 shutdown_connections 2024-09-19T05:18:01.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.894+0000 7f6dbad98640 1 --2- 172.21.15.120:0/177625457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6db4106a80 0x7f6db419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:01.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.894+0000 7f6dbad98640 1 --2- 172.21.15.120:0/177625457 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f6da40a32d0 0x7f6da40a5790 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:01.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.894+0000 7f6dbad98640 1 --2- 172.21.15.120:0/177625457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6db4101420 0x7f6db4198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:01.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.894+0000 7f6dbad98640 1 --2- 172.21.15.120:0/177625457 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6db4100a80 0x7f6db41983f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:01.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.894+0000 7f6dbad98640 1 -- 172.21.15.120:0/177625457 >> 172.21.15.120:0/177625457 conn(0x7f6db40fc7a0 msgr2=0x7f6db41048f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:01.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.894+0000 7f6dbad98640 1 -- 172.21.15.120:0/177625457 shutdown_connections 2024-09-19T05:18:01.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:01.894+0000 7f6dbad98640 1 -- 172.21.15.120:0/177625457 wait complete. 2024-09-19T05:18:02.233 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:01 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/177625457' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:18:02.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:01 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/177625457' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:18:02.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:01 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/177625457' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:18:02.540 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T05:18:02.540 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T05:18:02.788 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:03.180 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:02 smithi120 ceph-mon[30956]: pgmap v289: 97 pgs: 97 active+clean; 639 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.1 KiB/s wr, 8 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T05:18:03.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.259+0000 7f922be8f640 1 -- 172.21.15.120:0/4144690901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9224100e20 msgr2=0x7f9224101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:03.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.259+0000 7f922be8f640 1 --2- 172.21.15.120:0/4144690901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9224100e20 0x7f9224101200 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9214009ca0 tx=0x7f921402a950 comp rx=0 tx=0).stop 2024-09-19T05:18:03.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.259+0000 7f922be8f640 1 -- 172.21.15.120:0/4144690901 shutdown_connections 2024-09-19T05:18:03.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.259+0000 7f922be8f640 1 --2- 172.21.15.120:0/4144690901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9224102ef0 0x7f922410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:03.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.259+0000 7f922be8f640 1 --2- 172.21.15.120:0/4144690901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9224102570 0x7f92241029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:03.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.259+0000 7f922be8f640 1 --2- 172.21.15.120:0/4144690901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9224100e20 0x7f9224101200 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:03.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.259+0000 7f922be8f640 1 -- 172.21.15.120:0/4144690901 >> 172.21.15.120:0/4144690901 conn(0x7f92240fc7d0 msgr2=0x7f92240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:03.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.259+0000 7f922be8f640 1 -- 172.21.15.120:0/4144690901 shutdown_connections 2024-09-19T05:18:03.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.259+0000 7f922be8f640 1 -- 172.21.15.120:0/4144690901 wait complete. 2024-09-19T05:18:03.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.259+0000 7f922be8f640 1 Processor -- start 2024-09-19T05:18:03.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.260+0000 7f922be8f640 1 -- start start 2024-09-19T05:18:03.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.260+0000 7f922be8f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9224100e20 0x7f9224103750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:03.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.260+0000 7f922be8f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9224102570 0x7f9224103c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:03.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.260+0000 7f922be8f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9224102ef0 0x7f92241041d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:03.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.260+0000 7f922be8f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9224110e30 con 0x7f9224102570 2024-09-19T05:18:03.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.260+0000 7f922be8f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9224110cb0 con 0x7f9224102ef0 2024-09-19T05:18:03.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.260+0000 7f922be8f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9224110fb0 con 0x7f9224100e20 2024-09-19T05:18:03.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.260+0000 7f922942a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9224102570 0x7f9224103c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:03.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.260+0000 7f922942a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9224102570 0x7f9224103c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47786/0 (socket says 172.21.15.120:47786) 2024-09-19T05:18:03.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.260+0000 7f922942a640 1 -- 172.21.15.120:0/2871763367 learned_addr learned my addr 172.21.15.120:0/2871763367 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:03.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.260+0000 7f9229c2b640 1 --2- 172.21.15.120:0/2871763367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9224100e20 0x7f9224103750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:03.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.260+0000 7f922942a640 1 -- 172.21.15.120:0/2871763367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9224100e20 msgr2=0x7f9224103750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:03.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.260+0000 7f922942a640 1 --2- 172.21.15.120:0/2871763367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9224100e20 0x7f9224103750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:03.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.260+0000 7f922942a640 1 -- 172.21.15.120:0/2871763367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9224102ef0 msgr2=0x7f92241041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:03.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.260+0000 7f922a42c640 1 --2- 172.21.15.120:0/2871763367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9224102ef0 0x7f92241041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:03.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.260+0000 7f922942a640 1 --2- 172.21.15.120:0/2871763367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9224102ef0 0x7f92241041d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:03.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.260+0000 7f922942a640 1 -- 172.21.15.120:0/2871763367 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92241a6990 con 0x7f9224102570 2024-09-19T05:18:03.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.260+0000 7f9229c2b640 1 --2- 172.21.15.120:0/2871763367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9224100e20 0x7f9224103750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:18:03.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.260+0000 7f922942a640 1 --2- 172.21.15.120:0/2871763367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9224102570 0x7f9224103c90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f921800d770 tx=0x7f921800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:03.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.260+0000 7f9222ffd640 1 -- 172.21.15.120:0/2871763367 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9218017070 con 0x7f9224102570 2024-09-19T05:18:03.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.261+0000 7f9222ffd640 1 -- 172.21.15.120:0/2871763367 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f92180054d0 con 0x7f9224102570 2024-09-19T05:18:03.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.261+0000 7f922be8f640 1 -- 172.21.15.120:0/2871763367 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92241a6c80 con 0x7f9224102570 2024-09-19T05:18:03.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.261+0000 7f9222ffd640 1 -- 172.21.15.120:0/2871763367 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9218004cf0 con 0x7f9224102570 2024-09-19T05:18:03.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.261+0000 7f922be8f640 1 -- 172.21.15.120:0/2871763367 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92241a7170 con 0x7f9224102570 2024-09-19T05:18:03.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.261+0000 7f922be8f640 1 -- 172.21.15.120:0/2871763367 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9224101200 con 0x7f9224102570 2024-09-19T05:18:03.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.263+0000 7f9222ffd640 1 -- 172.21.15.120:0/2871763367 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f9218004e90 con 0x7f9224102570 2024-09-19T05:18:03.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.263+0000 7f9222ffd640 1 --2- 172.21.15.120:0/2871763367 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f920c0a32d0 0x7f920c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:03.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.263+0000 7f9229c2b640 1 --2- 172.21.15.120:0/2871763367 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f920c0a32d0 0x7f920c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:03.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.263+0000 7f9222ffd640 1 -- 172.21.15.120:0/2871763367 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f92180cf5e0 con 0x7f9224102570 2024-09-19T05:18:03.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.264+0000 7f9229c2b640 1 --2- 172.21.15.120:0/2871763367 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f920c0a32d0 0x7f920c0a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9214009a60 tx=0x7f9214005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:03.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.267+0000 7f9222ffd640 1 -- 172.21.15.120:0/2871763367 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f921809c180 con 0x7f9224102570 2024-09-19T05:18:03.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:02 smithi194 ceph-mon[35228]: pgmap v289: 97 pgs: 97 active+clean; 639 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.1 KiB/s wr, 8 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T05:18:03.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.436+0000 7f922be8f640 1 -- 172.21.15.120:0/2871763367 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92241a7340 con 0x7f9224102570 2024-09-19T05:18:03.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.437+0000 7f9222ffd640 1 -- 172.21.15.120:0/2871763367 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22805 (secure 0 0 0) 0x7f921809ba80 con 0x7f9224102570 2024-09-19T05:18:03.439 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:18:03.439 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":82,"fsid":"4e6e3df4-7645-11ef-bceb-c7b262605968","created":"2024-09-19T05:09:55.847220+0000","modified":"2024-09-19T05:17:49.248858+0000","last_up_change":"2024-09-19T05:16:42.808178+0000","last_in_change":"2024-09-19T05:16:18.315940+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:13:02.340027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:17:26.914416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:17:29.112997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"18907a03-1f43-419a-acb6-9fa4cf5020d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6803","nonce":3421474326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6805","nonce":3421474326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6809","nonce":3421474326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6807","nonce":3421474326}]},"public_addr":"172.21.15.120:6803/3421474326","cluster_addr":"172.21.15.120:6805/3421474326","heartbeat_back_addr":"172.21.15.120:6809/3421474326","heartbeat_front_addr":"172.21.15.120:6807/3421474326","state":["exists","up"]},{"osd":1,"uuid":"d21e029b-8a60-43f9-9ba7-30cdba19ba57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6801","nonce":1195511218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6803","nonce":1195511218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6807","nonce":1195511218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6805","nonce":1195511218}]},"public_addr":"172.21.15.178:6801/1195511218","cluster_addr":"172.21.15.178:6803/1195511218","heartbeat_back_addr":"172.21.15.178:6807/1195511218","heartbeat_front_addr":"172.21.15.178:6805/1195511218","state":["exists","up"]},{"osd":2,"uuid":"26ad9c8d-dbaa-46c2-a346-19717d81cc60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6801","nonce":3752826560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6803","nonce":3752826560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6807","nonce":3752826560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6805","nonce":3752826560}]},"public_addr":"172.21.15.194:6801/3752826560","cluster_addr":"172.21.15.194:6803/3752826560","heartbeat_back_addr":"172.21.15.194:6807/3752826560","heartbeat_front_addr":"172.21.15.194:6805/3752826560","state":["exists","up"]},{"osd":3,"uuid":"7e266576-8a98-40a8-9532-4b6f4611a908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6811","nonce":803566783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6813","nonce":803566783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6817","nonce":803566783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6815","nonce":803566783}]},"public_addr":"172.21.15.120:6811/803566783","cluster_addr":"172.21.15.120:6813/803566783","heartbeat_back_addr":"172.21.15.120:6817/803566783","heartbeat_front_addr":"172.21.15.120:6815/803566783","state":["exists","up"]},{"osd":4,"uuid":"c77d05c5-3b8f-4f7b-91f9-833735221684","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6809","nonce":541165323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6811","nonce":541165323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6815","nonce":541165323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6813","nonce":541165323}]},"public_addr":"172.21.15.178:6809/541165323","cluster_addr":"172.21.15.178:6811/541165323","heartbeat_back_addr":"172.21.15.178:6815/541165323","heartbeat_front_addr":"172.21.15.178:6813/541165323","state":["exists","up"]},{"osd":5,"uuid":"5f1c394b-e510-411f-969a-2db2b68cf41a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6809","nonce":2631415468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6811","nonce":2631415468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6815","nonce":2631415468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6813","nonce":2631415468}]},"public_addr":"172.21.15.194:6809/2631415468","cluster_addr":"172.21.15.194:6811/2631415468","heartbeat_back_addr":"172.21.15.194:6815/2631415468","heartbeat_front_addr":"172.21.15.194:6813/2631415468","state":["exists","up"]},{"osd":6,"uuid":"990af639-099e-49df-a083-05626cee3c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6819","nonce":388238976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6821","nonce":388238976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6825","nonce":388238976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6823","nonce":388238976}]},"public_addr":"172.21.15.120:6819/388238976","cluster_addr":"172.21.15.120:6821/388238976","heartbeat_back_addr":"172.21.15.120:6825/388238976","heartbeat_front_addr":"172.21.15.120:6823/388238976","state":["exists","up"]},{"osd":7,"uuid":"6f4aa6ab-b5f4-4c06-9f14-9a51bc195ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6817","nonce":1912109177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6819","nonce":1912109177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6823","nonce":1912109177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6821","nonce":1912109177}]},"public_addr":"172.21.15.178:6817/1912109177","cluster_addr":"172.21.15.178:6819/1912109177","heartbeat_back_addr":"172.21.15.178:6823/1912109177","heartbeat_front_addr":"172.21.15.178:6821/1912109177","state":["exists","up"]},{"osd":8,"uuid":"707739c9-732a-405c-847a-ce6a06e611b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6817","nonce":596878172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6819","nonce":596878172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6823","nonce":596878172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6821","nonce":596878172}]},"public_addr":"172.21.15.194:6817/596878172","cluster_addr":"172.21.15.194:6819/596878172","heartbeat_back_addr":"172.21.15.194:6823/596878172","heartbeat_front_addr":"172.21.15.194:6821/596878172","state":["exists","up"]},{"osd":9,"uuid":"9393b018-c924-4d75-99e5-25433d276567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6827","nonce":3257373801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6829","nonce":3257373801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6833","nonce":3257373801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6831","nonce":3257373801}]},"public_addr":"172.21.15.120:6827/3257373801","cluster_addr":"172.21.15.120:6829/3257373801","heartbeat_back_addr":"172.21.15.120:6833/3257373801","heartbeat_front_addr":"172.21.15.120:6831/3257373801","state":["exists","up"]},{"osd":10,"uuid":"45db7f62-87a6-4b2b-a3dc-012e2de505e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6825","nonce":3067822030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6827","nonce":3067822030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6831","nonce":3067822030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6829","nonce":3067822030}]},"public_addr":"172.21.15.178:6825/3067822030","cluster_addr":"172.21.15.178:6827/3067822030","heartbeat_back_addr":"172.21.15.178:6831/3067822030","heartbeat_front_addr":"172.21.15.178:6829/3067822030","state":["exists","up"]},{"osd":11,"uuid":"85ea248c-9a36-41cb-a200-87138fb31602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6825","nonce":2713146974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6827","nonce":2713146974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6831","nonce":2713146974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6829","nonce":2713146974}]},"public_addr":"172.21.15.194:6825/2713146974","cluster_addr":"172.21.15.194:6827/2713146974","heartbeat_back_addr":"172.21.15.194:6831/2713146974","heartbeat_front_addr":"172.21.15.194:6829/2713146974","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:09.395371+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:33.648930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:58.805048+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:23.621459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:48.553860+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:13.506636+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:38.520376+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:02.695124+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:27.084956+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:50.924128+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:15.396694+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:40.440416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":3,"to":8}]},{"pgid":"3.2a","mappings":[{"from":3,"to":6}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:0/3419110398":"2024-09-20T05:10:48.027892+0000","172.21.15.120:6801/50152720":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/4177074351":"2024-09-20T05:10:48.027892+0000","172.21.15.120:6800/50152720":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/329623296":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/2867300720":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/3592867428":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/4255533863":"2024-09-20T05:10:23.348128+0000","172.21.15.120:6801/3412493069":"2024-09-20T05:10:23.348128+0000","172.21.15.120:6800/3412493069":"2024-09-20T05:10:23.348128+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:18:03.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:02 smithi178 ceph-mon[34347]: pgmap v289: 97 pgs: 97 active+clean; 639 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.1 KiB/s wr, 8 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T05:18:03.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.440+0000 7f922be8f640 1 -- 172.21.15.120:0/2871763367 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f920c0a32d0 msgr2=0x7f920c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:03.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.440+0000 7f922be8f640 1 --2- 172.21.15.120:0/2871763367 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f920c0a32d0 0x7f920c0a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9214009a60 tx=0x7f9214005c30 comp rx=0 tx=0).stop 2024-09-19T05:18:03.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.440+0000 7f922be8f640 1 -- 172.21.15.120:0/2871763367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9224102570 msgr2=0x7f9224103c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:03.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.440+0000 7f922be8f640 1 --2- 172.21.15.120:0/2871763367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9224102570 0x7f9224103c90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f921800d770 tx=0x7f921800dc30 comp rx=0 tx=0).stop 2024-09-19T05:18:03.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.440+0000 7f922be8f640 1 -- 172.21.15.120:0/2871763367 shutdown_connections 2024-09-19T05:18:03.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.440+0000 7f922be8f640 1 --2- 172.21.15.120:0/2871763367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9224102ef0 0x7f92241041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:03.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.440+0000 7f922be8f640 1 --2- 172.21.15.120:0/2871763367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9224102570 0x7f9224103c90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:03.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.440+0000 7f922be8f640 1 --2- 172.21.15.120:0/2871763367 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f920c0a32d0 0x7f920c0a5790 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:03.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.440+0000 7f922be8f640 1 --2- 172.21.15.120:0/2871763367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9224100e20 0x7f9224103750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:03.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.440+0000 7f922be8f640 1 -- 172.21.15.120:0/2871763367 >> 172.21.15.120:0/2871763367 conn(0x7f92240fc7d0 msgr2=0x7f922406a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:03.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.441+0000 7f922be8f640 1 -- 172.21.15.120:0/2871763367 shutdown_connections 2024-09-19T05:18:03.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:03.441+0000 7f922be8f640 1 -- 172.21.15.120:0/2871763367 wait complete. 2024-09-19T05:18:04.093 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:03 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2871763367' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:18:04.121 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T05:18:04.122 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T05:18:04.122 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T05:18:04.123 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T05:18:04.123 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T05:18:04.123 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T05:18:04.124 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T05:18:04.124 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T05:18:04.125 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T05:18:04.125 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T05:18:04.125 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T05:18:04.126 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T05:18:04.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:03 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/2871763367' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:18:04.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:03 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/2871763367' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:18:04.791 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:04.811 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:04.811 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:04.880 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:04.923 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:04.930 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:04.932 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:04.932 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:04.942 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:04.942 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:05.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:04 smithi120 ceph-mon[30956]: pgmap v290: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.3 KiB/s wr, 8 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T05:18:05.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:04 smithi194 ceph-mon[35228]: pgmap v290: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.3 KiB/s wr, 8 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T05:18:05.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:04 smithi178 ceph-mon[34347]: pgmap v290: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.3 KiB/s wr, 8 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2024-09-19T05:18:06.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.009+0000 7fec8cd6e640 1 -- 172.21.15.120:0/409863938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec88102570 msgr2=0x7fec881029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:06.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.009+0000 7fec8cd6e640 1 --2- 172.21.15.120:0/409863938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec88102570 0x7fec881029b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fec7c009900 tx=0x7fec7c02a480 comp rx=0 tx=0).stop 2024-09-19T05:18:06.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.010+0000 7fec8cd6e640 1 -- 172.21.15.120:0/409863938 shutdown_connections 2024-09-19T05:18:06.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.010+0000 7fec8cd6e640 1 --2- 172.21.15.120:0/409863938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec88102ef0 0x7fec8810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:06.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.010+0000 7fec8cd6e640 1 --2- 172.21.15.120:0/409863938 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec88102570 0x7fec881029b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:06.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.010+0000 7fec8cd6e640 1 --2- 172.21.15.120:0/409863938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec88100e20 0x7fec88101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:06.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.010+0000 7fec8cd6e640 1 -- 172.21.15.120:0/409863938 >> 172.21.15.120:0/409863938 conn(0x7fec880fc7d0 msgr2=0x7fec880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.010+0000 7fec8cd6e640 1 -- 172.21.15.120:0/409863938 shutdown_connections 2024-09-19T05:18:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.010+0000 7fec8cd6e640 1 -- 172.21.15.120:0/409863938 wait complete. 2024-09-19T05:18:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.010+0000 7fec8cd6e640 1 Processor -- start 2024-09-19T05:18:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.010+0000 7fec8cd6e640 1 -- start start 2024-09-19T05:18:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.011+0000 7fec8cd6e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec88100e20 0x7fec880fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.011+0000 7fec8cd6e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec88102570 0x7fec880fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.011+0000 7fec8cd6e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec88102ef0 0x7fec880fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.011+0000 7fec8cd6e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fec88110ed0 con 0x7fec88102ef0 2024-09-19T05:18:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.011+0000 7fec8cd6e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fec88110d50 con 0x7fec88102570 2024-09-19T05:18:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.011+0000 7fec8cd6e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fec88111050 con 0x7fec88100e20 2024-09-19T05:18:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.011+0000 7fec86d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec88102ef0 0x7fec880fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.011+0000 7fec86d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec88102ef0 0x7fec880fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53294/0 (socket says 172.21.15.120:53294) 2024-09-19T05:18:06.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.011+0000 7fec86d9d640 1 -- 172.21.15.120:0/896369294 learned_addr learned my addr 172.21.15.120:0/896369294 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:06.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.011+0000 7fec8659c640 1 --2- 172.21.15.120:0/896369294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec88100e20 0x7fec880fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:06.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.011+0000 7fec86d9d640 1 -- 172.21.15.120:0/896369294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec88100e20 msgr2=0x7fec880fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:06.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.011+0000 7fec86d9d640 1 --2- 172.21.15.120:0/896369294 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec88100e20 0x7fec880fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:06.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.011+0000 7fec86d9d640 1 -- 172.21.15.120:0/896369294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec88102570 msgr2=0x7fec880fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:06.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.011+0000 7fec86d9d640 1 --2- 172.21.15.120:0/896369294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec88102570 0x7fec880fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:06.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.011+0000 7fec86d9d640 1 -- 172.21.15.120:0/896369294 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec881a69b0 con 0x7fec88102ef0 2024-09-19T05:18:06.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.011+0000 7fec86d9d640 1 --2- 172.21.15.120:0/896369294 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec88102ef0 0x7fec880fd700 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fec8000b970 tx=0x7fec8000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:06.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.011+0000 7fec777fe640 1 -- 172.21.15.120:0/896369294 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec80019070 con 0x7fec88102ef0 2024-09-19T05:18:06.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.011+0000 7fec777fe640 1 -- 172.21.15.120:0/896369294 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fec80014440 con 0x7fec88102ef0 2024-09-19T05:18:06.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.011+0000 7fec777fe640 1 -- 172.21.15.120:0/896369294 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec800075d0 con 0x7fec88102ef0 2024-09-19T05:18:06.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.011+0000 7fec8cd6e640 1 -- 172.21.15.120:0/896369294 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec881a6ca0 con 0x7fec88102ef0 2024-09-19T05:18:06.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.011+0000 7fec8cd6e640 1 -- 172.21.15.120:0/896369294 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec881a71e0 con 0x7fec88102ef0 2024-09-19T05:18:06.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.012+0000 7fec8cd6e640 1 -- 172.21.15.120:0/896369294 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fec88062900 con 0x7fec88102ef0 2024-09-19T05:18:06.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.013+0000 7fec777fe640 1 -- 172.21.15.120:0/896369294 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fec8001c070 con 0x7fec88102ef0 2024-09-19T05:18:06.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.014+0000 7fec777fe640 1 --2- 172.21.15.120:0/896369294 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fec700a32d0 0x7fec700a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:06.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.014+0000 7fec8659c640 1 --2- 172.21.15.120:0/896369294 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fec700a32d0 0x7fec700a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:06.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.014+0000 7fec777fe640 1 -- 172.21.15.120:0/896369294 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fec800cf7d0 con 0x7fec88102ef0 2024-09-19T05:18:06.060 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.014+0000 7fec777fe640 1 --2- 172.21.15.120:0/896369294 >> [v2:172.21.15.178:6808/541165323,v1:172.21.15.178:6809/541165323] conn(0x7fec700acf80 0x7fec700af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:06.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.014+0000 7fec777fe640 1 -- 172.21.15.120:0/896369294 --> [v2:172.21.15.178:6808/541165323,v1:172.21.15.178:6809/541165323] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fec8000fec0 con 0x7fec700acf80 2024-09-19T05:18:06.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.014+0000 7fec777fe640 1 -- 172.21.15.120:0/896369294 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fec800cfc20 con 0x7fec88102ef0 2024-09-19T05:18:06.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.015+0000 7fec8659c640 1 --2- 172.21.15.120:0/896369294 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fec700a32d0 0x7fec700a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fec7800a810 tx=0x7fec78008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:06.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.015+0000 7fec85d9b640 1 --2- 172.21.15.120:0/896369294 >> [v2:172.21.15.178:6808/541165323,v1:172.21.15.178:6809/541165323] conn(0x7fec700acf80 0x7fec700af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:06.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.015+0000 7fec85d9b640 1 --2- 172.21.15.120:0/896369294 >> [v2:172.21.15.178:6808/541165323,v1:172.21.15.178:6809/541165323] conn(0x7fec700acf80 0x7fec700af420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:06.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.016+0000 7fec777fe640 1 -- 172.21.15.120:0/896369294 <== osd.4 v2:172.21.15.178:6808/541165323 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fec8000fec0 con 0x7fec700acf80 2024-09-19T05:18:06.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.029+0000 7fec8cd6e640 1 -- 172.21.15.120:0/896369294 --> [v2:172.21.15.178:6808/541165323,v1:172.21.15.178:6809/541165323] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fec88062d80 con 0x7fec700acf80 2024-09-19T05:18:06.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.030+0000 7fec777fe640 1 -- 172.21.15.120:0/896369294 <== osd.4 v2:172.21.15.178:6808/541165323 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fec88062d80 con 0x7fec700acf80 2024-09-19T05:18:06.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.030+0000 7fec8cd6e640 1 -- 172.21.15.120:0/896369294 >> [v2:172.21.15.178:6808/541165323,v1:172.21.15.178:6809/541165323] conn(0x7fec700acf80 msgr2=0x7fec700af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:06.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.030+0000 7fec8cd6e640 1 --2- 172.21.15.120:0/896369294 >> [v2:172.21.15.178:6808/541165323,v1:172.21.15.178:6809/541165323] conn(0x7fec700acf80 0x7fec700af420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:06.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.030+0000 7fec8cd6e640 1 -- 172.21.15.120:0/896369294 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fec700a32d0 msgr2=0x7fec700a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:06.061 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.030+0000 7fec8cd6e640 1 --2- 172.21.15.120:0/896369294 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fec700a32d0 0x7fec700a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fec7800a810 tx=0x7fec78008040 comp rx=0 tx=0).stop 2024-09-19T05:18:06.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.030+0000 7fec8cd6e640 1 -- 172.21.15.120:0/896369294 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec88102ef0 msgr2=0x7fec880fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:06.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.030+0000 7fec8cd6e640 1 --2- 172.21.15.120:0/896369294 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fec88102ef0 0x7fec880fd700 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fec8000b970 tx=0x7fec8000be30 comp rx=0 tx=0).stop 2024-09-19T05:18:06.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.030+0000 7fec86d9d640 1 -- 172.21.15.120:0/896369294 reap_dead start 2024-09-19T05:18:06.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.030+0000 7fec8cd6e640 1 -- 172.21.15.120:0/896369294 shutdown_connections 2024-09-19T05:18:06.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.030+0000 7fec8cd6e640 1 -- 172.21.15.120:0/896369294 >> 172.21.15.120:0/896369294 conn(0x7fec880fc7d0 msgr2=0x7fec8806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:06.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.030+0000 7fec8cd6e640 1 -- 172.21.15.120:0/896369294 shutdown_connections 2024-09-19T05:18:06.062 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.030+0000 7fec8cd6e640 1 -- 172.21.15.120:0/896369294 wait complete. 2024-09-19T05:18:06.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.830+0000 7f7d7d442640 1 -- 172.21.15.120:0/116558392 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d780ffc20 msgr2=0x7f7d78100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:06.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.830+0000 7f7d7d442640 1 --2- 172.21.15.120:0/116558392 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d780ffc20 0x7f7d78100080 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c009900 tx=0x7f7d6c02a410 comp rx=0 tx=0).stop 2024-09-19T05:18:06.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.830+0000 7f7d7d442640 1 -- 172.21.15.120:0/116558392 shutdown_connections 2024-09-19T05:18:06.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.830+0000 7f7d7d442640 1 --2- 172.21.15.120:0/116558392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d781005c0 0x7f7d7810ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:06.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.830+0000 7f7d7d442640 1 --2- 172.21.15.120:0/116558392 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d780ffc20 0x7f7d78100080 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:06.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.830+0000 7f7d7d442640 1 --2- 172.21.15.120:0/116558392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d78106ba0 0x7f7d78106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:06.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.830+0000 7f7d7d442640 1 -- 172.21.15.120:0/116558392 >> 172.21.15.120:0/116558392 conn(0x7f7d780fba90 msgr2=0x7f7d780fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:06.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.831+0000 7f7d7d442640 1 -- 172.21.15.120:0/116558392 shutdown_connections 2024-09-19T05:18:06.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.831+0000 7f7d7d442640 1 -- 172.21.15.120:0/116558392 wait complete. 2024-09-19T05:18:06.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.831+0000 7f7d7d442640 1 Processor -- start 2024-09-19T05:18:06.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.831+0000 7f7d7d442640 1 -- start start 2024-09-19T05:18:06.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.831+0000 7f7d7d442640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d780ffc20 0x7f7d781983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:06.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.831+0000 7f7d7d442640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d781005c0 0x7f7d78198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:06.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.831+0000 7f7d7d442640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d78106ba0 0x7f7d7819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:06.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.831+0000 7f7d7d442640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7d78111eb0 con 0x7f7d780ffc20 2024-09-19T05:18:06.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.831+0000 7f7d7d442640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7d78111d30 con 0x7f7d781005c0 2024-09-19T05:18:06.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.831+0000 7f7d7d442640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7d78112030 con 0x7f7d78106ba0 2024-09-19T05:18:06.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.832+0000 7f7d76ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d780ffc20 0x7f7d781983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:06.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.832+0000 7f7d76ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d780ffc20 0x7f7d781983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53312/0 (socket says 172.21.15.120:53312) 2024-09-19T05:18:06.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.832+0000 7f7d76ffd640 1 -- 172.21.15.120:0/3406101625 learned_addr learned my addr 172.21.15.120:0/3406101625 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:06.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.832+0000 7f7d767fc640 1 --2- 172.21.15.120:0/3406101625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d781005c0 0x7f7d78198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:06.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.832+0000 7f7d777fe640 1 --2- 172.21.15.120:0/3406101625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d78106ba0 0x7f7d7819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:06.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.832+0000 7f7d76ffd640 1 -- 172.21.15.120:0/3406101625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d78106ba0 msgr2=0x7f7d7819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:06.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.832+0000 7f7d76ffd640 1 --2- 172.21.15.120:0/3406101625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d78106ba0 0x7f7d7819ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:06.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.832+0000 7f7d76ffd640 1 -- 172.21.15.120:0/3406101625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d781005c0 msgr2=0x7f7d78198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:06.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.832+0000 7f7d76ffd640 1 --2- 172.21.15.120:0/3406101625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d781005c0 0x7f7d78198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:06.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.832+0000 7f7d76ffd640 1 -- 172.21.15.120:0/3406101625 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d7819d3a0 con 0x7f7d780ffc20 2024-09-19T05:18:06.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.832+0000 7f7d76ffd640 1 --2- 172.21.15.120:0/3406101625 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d780ffc20 0x7f7d781983f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800b4a0 tx=0x7f7d6800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:06.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.832+0000 7f7d5ffff640 1 -- 172.21.15.120:0/3406101625 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d68014070 con 0x7f7d780ffc20 2024-09-19T05:18:06.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.832+0000 7f7d5ffff640 1 -- 172.21.15.120:0/3406101625 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7d68010ac0 con 0x7f7d780ffc20 2024-09-19T05:18:06.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.832+0000 7f7d5ffff640 1 -- 172.21.15.120:0/3406101625 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d68017c30 con 0x7f7d780ffc20 2024-09-19T05:18:06.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.832+0000 7f7d7d442640 1 -- 172.21.15.120:0/3406101625 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d7819d690 con 0x7f7d780ffc20 2024-09-19T05:18:06.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.832+0000 7f7d7d442640 1 -- 172.21.15.120:0/3406101625 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d781a4f70 con 0x7f7d780ffc20 2024-09-19T05:18:06.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.833+0000 7f7d7d442640 1 -- 172.21.15.120:0/3406101625 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7d78062900 con 0x7f7d780ffc20 2024-09-19T05:18:06.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.835+0000 7f7d5ffff640 1 -- 172.21.15.120:0/3406101625 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f7d68017070 con 0x7f7d780ffc20 2024-09-19T05:18:06.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.835+0000 7f7d5ffff640 1 --2- 172.21.15.120:0/3406101625 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f7d600a3350 0x7f7d600a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:06.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.835+0000 7f7d767fc640 1 --2- 172.21.15.120:0/3406101625 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f7d600a3350 0x7f7d600a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:06.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.835+0000 7f7d5ffff640 1 -- 172.21.15.120:0/3406101625 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f7d680cf170 con 0x7f7d780ffc20 2024-09-19T05:18:06.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.836+0000 7f7d5ffff640 1 --2- 172.21.15.120:0/3406101625 >> [v2:172.21.15.178:6824/3067822030,v1:172.21.15.178:6825/3067822030] conn(0x7f7d600ad000 0x7f7d600af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:06.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.836+0000 7f7d5ffff640 1 -- 172.21.15.120:0/3406101625 --> [v2:172.21.15.178:6824/3067822030,v1:172.21.15.178:6825/3067822030] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7d600afb70 con 0x7f7d600ad000 2024-09-19T05:18:06.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.836+0000 7f7d5ffff640 1 -- 172.21.15.120:0/3406101625 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f7d680cf5c0 con 0x7f7d780ffc20 2024-09-19T05:18:06.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.836+0000 7f7d767fc640 1 --2- 172.21.15.120:0/3406101625 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f7d600a3350 0x7f7d600a5810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c031440 tx=0x7f7d6c0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:06.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.836+0000 7f7d777fe640 1 --2- 172.21.15.120:0/3406101625 >> [v2:172.21.15.178:6824/3067822030,v1:172.21.15.178:6825/3067822030] conn(0x7f7d600ad000 0x7f7d600af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:06.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.836+0000 7f7d777fe640 1 --2- 172.21.15.120:0/3406101625 >> [v2:172.21.15.178:6824/3067822030,v1:172.21.15.178:6825/3067822030] conn(0x7f7d600ad000 0x7f7d600af4a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:06.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.837+0000 7f7d5ffff640 1 -- 172.21.15.120:0/3406101625 <== osd.10 v2:172.21.15.178:6824/3067822030 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7d600afb70 con 0x7f7d600ad000 2024-09-19T05:18:06.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.850+0000 7f7d7d442640 1 -- 172.21.15.120:0/3406101625 --> [v2:172.21.15.178:6824/3067822030,v1:172.21.15.178:6825/3067822030] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7d78062dd0 con 0x7f7d600ad000 2024-09-19T05:18:06.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.851+0000 7f7d5ffff640 1 -- 172.21.15.120:0/3406101625 <== osd.10 v2:172.21.15.178:6824/3067822030 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7d78062dd0 con 0x7f7d600ad000 2024-09-19T05:18:06.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.851+0000 7f7d7d442640 1 -- 172.21.15.120:0/3406101625 >> [v2:172.21.15.178:6824/3067822030,v1:172.21.15.178:6825/3067822030] conn(0x7f7d600ad000 msgr2=0x7f7d600af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:06.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.851+0000 7f7d7d442640 1 --2- 172.21.15.120:0/3406101625 >> [v2:172.21.15.178:6824/3067822030,v1:172.21.15.178:6825/3067822030] conn(0x7f7d600ad000 0x7f7d600af4a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:06.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.851+0000 7f7d7d442640 1 -- 172.21.15.120:0/3406101625 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f7d600a3350 msgr2=0x7f7d600a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:06.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.851+0000 7f7d7d442640 1 --2- 172.21.15.120:0/3406101625 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f7d600a3350 0x7f7d600a5810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c031440 tx=0x7f7d6c0095f0 comp rx=0 tx=0).stop 2024-09-19T05:18:06.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.851+0000 7f7d7d442640 1 -- 172.21.15.120:0/3406101625 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d780ffc20 msgr2=0x7f7d781983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:06.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.851+0000 7f7d7d442640 1 --2- 172.21.15.120:0/3406101625 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d780ffc20 0x7f7d781983f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800b4a0 tx=0x7f7d6800b960 comp rx=0 tx=0).stop 2024-09-19T05:18:06.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.851+0000 7f7d777fe640 1 -- 172.21.15.120:0/3406101625 reap_dead start 2024-09-19T05:18:06.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.851+0000 7f7d7d442640 1 -- 172.21.15.120:0/3406101625 shutdown_connections 2024-09-19T05:18:06.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.851+0000 7f7d7d442640 1 -- 172.21.15.120:0/3406101625 >> 172.21.15.120:0/3406101625 conn(0x7f7d780fba90 msgr2=0x7f7d780fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:06.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.852+0000 7f7d7d442640 1 -- 172.21.15.120:0/3406101625 shutdown_connections 2024-09-19T05:18:06.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:06.852+0000 7f7d7d442640 1 -- 172.21.15.120:0/3406101625 wait complete. 2024-09-19T05:18:07.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.022+0000 7fc3c33b4640 1 -- 172.21.15.120:0/2687600171 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3bc106a80 msgr2=0x7fc3bc106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:07.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.022+0000 7fc3c33b4640 1 --2- 172.21.15.120:0/2687600171 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3bc106a80 0x7fc3bc106e60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8009930 tx=0x7fc3b802a420 comp rx=0 tx=0).stop 2024-09-19T05:18:07.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.022+0000 7fc3c33b4640 1 -- 172.21.15.120:0/2687600171 shutdown_connections 2024-09-19T05:18:07.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.022+0000 7fc3c33b4640 1 --2- 172.21.15.120:0/2687600171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3bc101420 0x7fc3bc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:07.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.022+0000 7fc3c33b4640 1 --2- 172.21.15.120:0/2687600171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3bc100a80 0x7fc3bc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:07.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.022+0000 7fc3c33b4640 1 --2- 172.21.15.120:0/2687600171 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3bc106a80 0x7fc3bc106e60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:07.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.022+0000 7fc3c33b4640 1 -- 172.21.15.120:0/2687600171 >> 172.21.15.120:0/2687600171 conn(0x7fc3bc0fc7a0 msgr2=0x7fc3bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:07.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.022+0000 7fc3c33b4640 1 -- 172.21.15.120:0/2687600171 shutdown_connections 2024-09-19T05:18:07.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.022+0000 7fc3c33b4640 1 -- 172.21.15.120:0/2687600171 wait complete. 2024-09-19T05:18:07.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.022+0000 7fc3c33b4640 1 Processor -- start 2024-09-19T05:18:07.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.023+0000 7fc3c33b4640 1 -- start start 2024-09-19T05:18:07.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.023+0000 7fc3c33b4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3bc100a80 0x7fc3bc0fce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:07.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.023+0000 7fc3c33b4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3bc101420 0x7fc3bc0fd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:07.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.023+0000 7fc3c33b4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3bc106a80 0x7fc3bc0fd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:07.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.023+0000 7fc3c33b4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc110d30 con 0x7fc3bc101420 2024-09-19T05:18:07.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.023+0000 7fc3c33b4640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc110bb0 con 0x7fc3bc100a80 2024-09-19T05:18:07.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.023+0000 7fc3c33b4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc110eb0 con 0x7fc3bc106a80 2024-09-19T05:18:07.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.023+0000 7fc3c094f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3bc101420 0x7fc3bc0fd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:07.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.023+0000 7fc3c094f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3bc101420 0x7fc3bc0fd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53338/0 (socket says 172.21.15.120:53338) 2024-09-19T05:18:07.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.023+0000 7fc3c094f640 1 -- 172.21.15.120:0/1350060175 learned_addr learned my addr 172.21.15.120:0/1350060175 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:07.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.023+0000 7fc3c1951640 1 --2- 172.21.15.120:0/1350060175 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3bc106a80 0x7fc3bc0fd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:07.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.023+0000 7fc3c094f640 1 -- 172.21.15.120:0/1350060175 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3bc106a80 msgr2=0x7fc3bc0fd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:07.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.023+0000 7fc3c094f640 1 --2- 172.21.15.120:0/1350060175 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3bc106a80 0x7fc3bc0fd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:07.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.023+0000 7fc3c094f640 1 -- 172.21.15.120:0/1350060175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3bc100a80 msgr2=0x7fc3bc0fce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:07.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.023+0000 7fc3c1150640 1 --2- 172.21.15.120:0/1350060175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3bc100a80 0x7fc3bc0fce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:07.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.023+0000 7fc3c094f640 1 --2- 172.21.15.120:0/1350060175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3bc100a80 0x7fc3bc0fce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:07.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.023+0000 7fc3c094f640 1 -- 172.21.15.120:0/1350060175 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3bc1a6890 con 0x7fc3bc101420 2024-09-19T05:18:07.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.023+0000 7fc3c094f640 1 --2- 172.21.15.120:0/1350060175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3bc101420 0x7fc3bc0fd3d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000c970 tx=0x7fc3b000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:07.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.023+0000 7fc3ae7fc640 1 -- 172.21.15.120:0/1350060175 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0007bb0 con 0x7fc3bc101420 2024-09-19T05:18:07.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.024+0000 7fc3c33b4640 1 -- 172.21.15.120:0/1350060175 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3bc1a6b80 con 0x7fc3bc101420 2024-09-19T05:18:07.056 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.024+0000 7fc3ae7fc640 1 -- 172.21.15.120:0/1350060175 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3b0007d50 con 0x7fc3bc101420 2024-09-19T05:18:07.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.024+0000 7fc3ae7fc640 1 -- 172.21.15.120:0/1350060175 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b000f450 con 0x7fc3bc101420 2024-09-19T05:18:07.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.024+0000 7fc3c33b4640 1 -- 172.21.15.120:0/1350060175 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3bc1a70c0 con 0x7fc3bc101420 2024-09-19T05:18:07.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.024+0000 7fc3c33b4640 1 -- 172.21.15.120:0/1350060175 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc3bc0628c0 con 0x7fc3bc101420 2024-09-19T05:18:07.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.026+0000 7fc3ae7fc640 1 -- 172.21.15.120:0/1350060175 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fc3b0004f00 con 0x7fc3bc101420 2024-09-19T05:18:07.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.026+0000 7fc3ae7fc640 1 --2- 172.21.15.120:0/1350060175 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fc3a80a32d0 0x7fc3a80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:07.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.026+0000 7fc3c1150640 1 --2- 172.21.15.120:0/1350060175 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fc3a80a32d0 0x7fc3a80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:07.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.026+0000 7fc3ae7fc640 1 -- 172.21.15.120:0/1350060175 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fc3b00cfcd0 con 0x7fc3bc101420 2024-09-19T05:18:07.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.026+0000 7fc3ae7fc640 1 --2- 172.21.15.120:0/1350060175 >> [v2:172.21.15.194:6800/3752826560,v1:172.21.15.194:6801/3752826560] conn(0x7fc3a80acf80 0x7fc3a80af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:07.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.026+0000 7fc3ae7fc640 1 -- 172.21.15.120:0/1350060175 --> [v2:172.21.15.194:6800/3752826560,v1:172.21.15.194:6801/3752826560] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3b0012ec0 con 0x7fc3a80acf80 2024-09-19T05:18:07.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.026+0000 7fc3ae7fc640 1 -- 172.21.15.120:0/1350060175 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fc3b00d0120 con 0x7fc3bc101420 2024-09-19T05:18:07.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.027+0000 7fc3c1150640 1 --2- 172.21.15.120:0/1350060175 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fc3a80a32d0 0x7fc3a80a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8006010 tx=0x7fc3b8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:07.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.027+0000 7fc3c1951640 1 --2- 172.21.15.120:0/1350060175 >> [v2:172.21.15.194:6800/3752826560,v1:172.21.15.194:6801/3752826560] conn(0x7fc3a80acf80 0x7fc3a80af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:07.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.027+0000 7fc3c1951640 1 --2- 172.21.15.120:0/1350060175 >> [v2:172.21.15.194:6800/3752826560,v1:172.21.15.194:6801/3752826560] conn(0x7fc3a80acf80 0x7fc3a80af420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:07.057 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.028+0000 7fc3ae7fc640 1 -- 172.21.15.120:0/1350060175 <== osd.2 v2:172.21.15.194:6800/3752826560 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc3b0012ec0 con 0x7fc3a80acf80 2024-09-19T05:18:07.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.041+0000 7fc3c33b4640 1 -- 172.21.15.120:0/1350060175 --> [v2:172.21.15.194:6800/3752826560,v1:172.21.15.194:6801/3752826560] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc3bc062d40 con 0x7fc3a80acf80 2024-09-19T05:18:07.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.042+0000 7fc3ae7fc640 1 -- 172.21.15.120:0/1350060175 <== osd.2 v2:172.21.15.194:6800/3752826560 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc3bc062d40 con 0x7fc3a80acf80 2024-09-19T05:18:07.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.042+0000 7fc3c33b4640 1 -- 172.21.15.120:0/1350060175 >> [v2:172.21.15.194:6800/3752826560,v1:172.21.15.194:6801/3752826560] conn(0x7fc3a80acf80 msgr2=0x7fc3a80af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:07.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.042+0000 7fc3c33b4640 1 --2- 172.21.15.120:0/1350060175 >> [v2:172.21.15.194:6800/3752826560,v1:172.21.15.194:6801/3752826560] conn(0x7fc3a80acf80 0x7fc3a80af420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:07.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.042+0000 7fc3c33b4640 1 -- 172.21.15.120:0/1350060175 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fc3a80a32d0 msgr2=0x7fc3a80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:07.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.042+0000 7fc3c33b4640 1 --2- 172.21.15.120:0/1350060175 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fc3a80a32d0 0x7fc3a80a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8006010 tx=0x7fc3b8000bc0 comp rx=0 tx=0).stop 2024-09-19T05:18:07.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.042+0000 7fc3c33b4640 1 -- 172.21.15.120:0/1350060175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3bc101420 msgr2=0x7fc3bc0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:07.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.042+0000 7fc3c33b4640 1 --2- 172.21.15.120:0/1350060175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3bc101420 0x7fc3bc0fd3d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000c970 tx=0x7fc3b000ce30 comp rx=0 tx=0).stop 2024-09-19T05:18:07.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.042+0000 7fc3c1951640 1 -- 172.21.15.120:0/1350060175 reap_dead start 2024-09-19T05:18:07.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.042+0000 7fc3c33b4640 1 -- 172.21.15.120:0/1350060175 shutdown_connections 2024-09-19T05:18:07.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.042+0000 7fc3c33b4640 1 -- 172.21.15.120:0/1350060175 >> 172.21.15.120:0/1350060175 conn(0x7fc3bc0fc7a0 msgr2=0x7fc3bc06ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:07.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.042+0000 7fc3c33b4640 1 -- 172.21.15.120:0/1350060175 shutdown_connections 2024-09-19T05:18:07.058 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:07.042+0000 7fc3c33b4640 1 -- 172.21.15.120:0/1350060175 wait complete. 2024-09-19T05:18:07.366 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:07 smithi120 ceph-mon[30956]: pgmap v291: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-19T05:18:07.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:07 smithi194 ceph-mon[35228]: pgmap v291: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-19T05:18:07.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:07 smithi178 ceph-mon[34347]: pgmap v291: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-19T05:18:07.835 INFO:teuthology.orchestra.run.smithi120.stdout:73014444097 2024-09-19T05:18:07.835 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T05:18:08.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.427+0000 7f34f3c91640 1 -- 172.21.15.120:0/525826072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34ec102570 msgr2=0x7f34ec1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:08.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.427+0000 7f34f3c91640 1 --2- 172.21.15.120:0/525826072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34ec102570 0x7f34ec1029b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009900 tx=0x7f34e802a480 comp rx=0 tx=0).stop 2024-09-19T05:18:08.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.427+0000 7f34f3c91640 1 -- 172.21.15.120:0/525826072 shutdown_connections 2024-09-19T05:18:08.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.427+0000 7f34f3c91640 1 --2- 172.21.15.120:0/525826072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34ec102ef0 0x7f34ec10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:08.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.427+0000 7f34f3c91640 1 --2- 172.21.15.120:0/525826072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34ec102570 0x7f34ec1029b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:08.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.427+0000 7f34f3c91640 1 --2- 172.21.15.120:0/525826072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34ec100e20 0x7f34ec101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:08.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.427+0000 7f34f3c91640 1 -- 172.21.15.120:0/525826072 >> 172.21.15.120:0/525826072 conn(0x7f34ec0fc7d0 msgr2=0x7f34ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:08.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.427+0000 7f34f3c91640 1 -- 172.21.15.120:0/525826072 shutdown_connections 2024-09-19T05:18:08.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.427+0000 7f34f3c91640 1 -- 172.21.15.120:0/525826072 wait complete. 2024-09-19T05:18:08.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.428+0000 7f34f3c91640 1 Processor -- start 2024-09-19T05:18:08.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.428+0000 7f34f3c91640 1 -- start start 2024-09-19T05:18:08.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.428+0000 7f34f3c91640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34ec100e20 0x7f34ec1972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:08.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.428+0000 7f34f3c91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34ec102570 0x7f34ec197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:08.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.428+0000 7f34f3c91640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34ec102ef0 0x7f34ec19bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:08.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.428+0000 7f34f3c91640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f34ec110e50 con 0x7f34ec102570 2024-09-19T05:18:08.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.428+0000 7f34f3c91640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f34ec110cd0 con 0x7f34ec102ef0 2024-09-19T05:18:08.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.428+0000 7f34f3c91640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f34ec110fd0 con 0x7f34ec100e20 2024-09-19T05:18:08.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.428+0000 7f34f122c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34ec102570 0x7f34ec197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:08.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.428+0000 7f34f122c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34ec102570 0x7f34ec197810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53364/0 (socket says 172.21.15.120:53364) 2024-09-19T05:18:08.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.428+0000 7f34f122c640 1 -- 172.21.15.120:0/2139012946 learned_addr learned my addr 172.21.15.120:0/2139012946 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:08.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.428+0000 7f34f222e640 1 --2- 172.21.15.120:0/2139012946 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34ec102ef0 0x7f34ec19bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:08.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.428+0000 7f34f1a2d640 1 --2- 172.21.15.120:0/2139012946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34ec100e20 0x7f34ec1972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:08.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.428+0000 7f34f122c640 1 -- 172.21.15.120:0/2139012946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34ec100e20 msgr2=0x7f34ec1972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:08.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.428+0000 7f34f122c640 1 --2- 172.21.15.120:0/2139012946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34ec100e20 0x7f34ec1972d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:08.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.429+0000 7f34f122c640 1 -- 172.21.15.120:0/2139012946 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34ec102ef0 msgr2=0x7f34ec19bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:08.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.429+0000 7f34f122c640 1 --2- 172.21.15.120:0/2139012946 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34ec102ef0 0x7f34ec19bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:08.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.429+0000 7f34f122c640 1 -- 172.21.15.120:0/2139012946 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34ec19c280 con 0x7f34ec102570 2024-09-19T05:18:08.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.429+0000 7f34f1a2d640 1 --2- 172.21.15.120:0/2139012946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34ec100e20 0x7f34ec1972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:08.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.429+0000 7f34f122c640 1 --2- 172.21.15.120:0/2139012946 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34ec102570 0x7f34ec197810 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f34e8006010 tx=0x7f34e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:08.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.429+0000 7f34e2ffd640 1 -- 172.21.15.120:0/2139012946 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e803f070 con 0x7f34ec102570 2024-09-19T05:18:08.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.429+0000 7f34e2ffd640 1 -- 172.21.15.120:0/2139012946 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f34e8003aa0 con 0x7f34ec102570 2024-09-19T05:18:08.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.429+0000 7f34e2ffd640 1 -- 172.21.15.120:0/2139012946 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34e8035030 con 0x7f34ec102570 2024-09-19T05:18:08.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.429+0000 7f34f3c91640 1 -- 172.21.15.120:0/2139012946 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34ec19c510 con 0x7f34ec102570 2024-09-19T05:18:08.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.429+0000 7f34f3c91640 1 -- 172.21.15.120:0/2139012946 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34ec19c9a0 con 0x7f34ec102570 2024-09-19T05:18:08.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.430+0000 7f34f3c91640 1 -- 172.21.15.120:0/2139012946 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f34ec062980 con 0x7f34ec102570 2024-09-19T05:18:08.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.431+0000 7f34e2ffd640 1 -- 172.21.15.120:0/2139012946 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f34e8042070 con 0x7f34ec102570 2024-09-19T05:18:08.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.432+0000 7f34e2ffd640 1 --2- 172.21.15.120:0/2139012946 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f34d80a32d0 0x7f34d80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:08.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.432+0000 7f34e2ffd640 1 -- 172.21.15.120:0/2139012946 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f34e80f0b30 con 0x7f34ec102570 2024-09-19T05:18:08.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.432+0000 7f34f1a2d640 1 --2- 172.21.15.120:0/2139012946 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f34d80a32d0 0x7f34d80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:08.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.432+0000 7f34e2ffd640 1 --2- 172.21.15.120:0/2139012946 >> [v2:172.21.15.194:6824/2713146974,v1:172.21.15.194:6825/2713146974] conn(0x7f34d80acf80 0x7f34d80af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:08.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.432+0000 7f34e2ffd640 1 -- 172.21.15.120:0/2139012946 --> [v2:172.21.15.194:6824/2713146974,v1:172.21.15.194:6825/2713146974] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f34d80afaf0 con 0x7f34d80acf80 2024-09-19T05:18:08.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.432+0000 7f34e2ffd640 1 -- 172.21.15.120:0/2139012946 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f34e80f0f80 con 0x7f34ec102570 2024-09-19T05:18:08.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.432+0000 7f34f1a2d640 1 --2- 172.21.15.120:0/2139012946 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f34d80a32d0 0x7f34d80a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f34dc00baa0 tx=0x7f34dc005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:08.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.432+0000 7f34f222e640 1 --2- 172.21.15.120:0/2139012946 >> [v2:172.21.15.194:6824/2713146974,v1:172.21.15.194:6825/2713146974] conn(0x7f34d80acf80 0x7f34d80af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:08.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.433+0000 7f34f222e640 1 --2- 172.21.15.120:0/2139012946 >> [v2:172.21.15.194:6824/2713146974,v1:172.21.15.194:6825/2713146974] conn(0x7f34d80acf80 0x7f34d80af420 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:08.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.434+0000 7f34e2ffd640 1 -- 172.21.15.120:0/2139012946 <== osd.11 v2:172.21.15.194:6824/2713146974 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f34d80afaf0 con 0x7f34d80acf80 2024-09-19T05:18:08.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.447+0000 7f34f3c91640 1 -- 172.21.15.120:0/2139012946 --> [v2:172.21.15.194:6824/2713146974,v1:172.21.15.194:6825/2713146974] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f34ec062e00 con 0x7f34d80acf80 2024-09-19T05:18:08.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.448+0000 7f34e2ffd640 1 -- 172.21.15.120:0/2139012946 <== osd.11 v2:172.21.15.194:6824/2713146974 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f34ec062e00 con 0x7f34d80acf80 2024-09-19T05:18:08.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.448+0000 7f34f3c91640 1 -- 172.21.15.120:0/2139012946 >> [v2:172.21.15.194:6824/2713146974,v1:172.21.15.194:6825/2713146974] conn(0x7f34d80acf80 msgr2=0x7f34d80af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:08.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.448+0000 7f34f3c91640 1 --2- 172.21.15.120:0/2139012946 >> [v2:172.21.15.194:6824/2713146974,v1:172.21.15.194:6825/2713146974] conn(0x7f34d80acf80 0x7f34d80af420 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:08.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.448+0000 7f34f3c91640 1 -- 172.21.15.120:0/2139012946 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f34d80a32d0 msgr2=0x7f34d80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:08.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.448+0000 7f34f3c91640 1 --2- 172.21.15.120:0/2139012946 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f34d80a32d0 0x7f34d80a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f34dc00baa0 tx=0x7f34dc005d90 comp rx=0 tx=0).stop 2024-09-19T05:18:08.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.448+0000 7f34f3c91640 1 -- 172.21.15.120:0/2139012946 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34ec102570 msgr2=0x7f34ec197810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:08.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.448+0000 7f34f3c91640 1 --2- 172.21.15.120:0/2139012946 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f34ec102570 0x7f34ec197810 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f34e8006010 tx=0x7f34e80042f0 comp rx=0 tx=0).stop 2024-09-19T05:18:08.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.448+0000 7f34f222e640 1 -- 172.21.15.120:0/2139012946 reap_dead start 2024-09-19T05:18:08.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.448+0000 7f34f3c91640 1 -- 172.21.15.120:0/2139012946 shutdown_connections 2024-09-19T05:18:08.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.448+0000 7f34f3c91640 1 -- 172.21.15.120:0/2139012946 >> 172.21.15.120:0/2139012946 conn(0x7f34ec0fc7d0 msgr2=0x7f34ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:08.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.449+0000 7f34f3c91640 1 -- 172.21.15.120:0/2139012946 shutdown_connections 2024-09-19T05:18:08.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.449+0000 7f34f3c91640 1 -- 172.21.15.120:0/2139012946 wait complete. 2024-09-19T05:18:08.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.628+0000 7f03e4d59640 1 -- 172.21.15.120:0/2446799727 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03e0100e20 msgr2=0x7f03e0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:08.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.628+0000 7f03e4d59640 1 --2- 172.21.15.120:0/2446799727 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03e0100e20 0x7f03e0101200 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f03d0009900 tx=0x7f03d002a480 comp rx=0 tx=0).stop 2024-09-19T05:18:08.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.628+0000 7f03e4d59640 1 -- 172.21.15.120:0/2446799727 shutdown_connections 2024-09-19T05:18:08.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.628+0000 7f03e4d59640 1 --2- 172.21.15.120:0/2446799727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03e0102ef0 0x7f03e010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:08.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.628+0000 7f03e4d59640 1 --2- 172.21.15.120:0/2446799727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03e0102570 0x7f03e01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:08.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.628+0000 7f03e4d59640 1 --2- 172.21.15.120:0/2446799727 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03e0100e20 0x7f03e0101200 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:08.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.628+0000 7f03e4d59640 1 -- 172.21.15.120:0/2446799727 >> 172.21.15.120:0/2446799727 conn(0x7f03e00fc7d0 msgr2=0x7f03e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:08.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.628+0000 7f03e4d59640 1 -- 172.21.15.120:0/2446799727 shutdown_connections 2024-09-19T05:18:08.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.628+0000 7f03e4d59640 1 -- 172.21.15.120:0/2446799727 wait complete. 2024-09-19T05:18:08.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.629+0000 7f03e4d59640 1 Processor -- start 2024-09-19T05:18:08.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.629+0000 7f03e4d59640 1 -- start start 2024-09-19T05:18:08.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.629+0000 7f03e4d59640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03e0100e20 0x7f03e01984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:08.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.629+0000 7f03e4d59640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03e0102570 0x7f03e0198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:08.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.629+0000 7f03e4d59640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03e0102ef0 0x7f03e019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:08.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.629+0000 7f03e4d59640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f03e0110ed0 con 0x7f03e0102ef0 2024-09-19T05:18:08.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.629+0000 7f03e4d59640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f03e0110d50 con 0x7f03e0100e20 2024-09-19T05:18:08.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.629+0000 7f03e4d59640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f03e0111050 con 0x7f03e0102570 2024-09-19T05:18:08.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.629+0000 7f03ded9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03e0102ef0 0x7f03e019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:08.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.629+0000 7f03ded9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03e0102ef0 0x7f03e019cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53384/0 (socket says 172.21.15.120:53384) 2024-09-19T05:18:08.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.629+0000 7f03ded9d640 1 -- 172.21.15.120:0/35079567 learned_addr learned my addr 172.21.15.120:0/35079567 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:08.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.629+0000 7f03ddd9b640 1 --2- 172.21.15.120:0/35079567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03e0102570 0x7f03e0198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:08.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.629+0000 7f03de59c640 1 --2- 172.21.15.120:0/35079567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03e0100e20 0x7f03e01984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:08.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.629+0000 7f03ded9d640 1 -- 172.21.15.120:0/35079567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03e0102570 msgr2=0x7f03e0198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:08.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.629+0000 7f03ded9d640 1 --2- 172.21.15.120:0/35079567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03e0102570 0x7f03e0198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:08.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.629+0000 7f03ded9d640 1 -- 172.21.15.120:0/35079567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03e0100e20 msgr2=0x7f03e01984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:08.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.629+0000 7f03ded9d640 1 --2- 172.21.15.120:0/35079567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03e0100e20 0x7f03e01984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:08.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.629+0000 7f03ded9d640 1 -- 172.21.15.120:0/35079567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03e019d490 con 0x7f03e0102ef0 2024-09-19T05:18:08.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.629+0000 7f03de59c640 1 --2- 172.21.15.120:0/35079567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03e0100e20 0x7f03e01984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:18:08.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.630+0000 7f03ded9d640 1 --2- 172.21.15.120:0/35079567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03e0102ef0 0x7f03e019cdb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f03d800b970 tx=0x7f03d800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:08.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.630+0000 7f03cf7fe640 1 -- 172.21.15.120:0/35079567 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d8019070 con 0x7f03e0102ef0 2024-09-19T05:18:08.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.630+0000 7f03e4d59640 1 -- 172.21.15.120:0/35079567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03e019d780 con 0x7f03e0102ef0 2024-09-19T05:18:08.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.630+0000 7f03cf7fe640 1 -- 172.21.15.120:0/35079567 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f03d8014440 con 0x7f03e0102ef0 2024-09-19T05:18:08.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.630+0000 7f03cf7fe640 1 -- 172.21.15.120:0/35079567 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d80075d0 con 0x7f03e0102ef0 2024-09-19T05:18:08.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.630+0000 7f03e4d59640 1 -- 172.21.15.120:0/35079567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03e01a5060 con 0x7f03e0102ef0 2024-09-19T05:18:08.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.631+0000 7f03e4d59640 1 -- 172.21.15.120:0/35079567 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f03e0062980 con 0x7f03e0102ef0 2024-09-19T05:18:08.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.632+0000 7f03cf7fe640 1 -- 172.21.15.120:0/35079567 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f03d801c070 con 0x7f03e0102ef0 2024-09-19T05:18:08.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.632+0000 7f03cf7fe640 1 --2- 172.21.15.120:0/35079567 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f03c80a32d0 0x7f03c80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:08.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.633+0000 7f03de59c640 1 --2- 172.21.15.120:0/35079567 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f03c80a32d0 0x7f03c80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:08.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.633+0000 7f03cf7fe640 1 -- 172.21.15.120:0/35079567 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f03d80cf730 con 0x7f03e0102ef0 2024-09-19T05:18:08.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.633+0000 7f03cf7fe640 1 --2- 172.21.15.120:0/35079567 >> [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801] conn(0x7f03c80acf80 0x7f03c80af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:08.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.633+0000 7f03cf7fe640 1 -- 172.21.15.120:0/35079567 --> [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f03d801ce50 con 0x7f03c80acf80 2024-09-19T05:18:08.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.633+0000 7f03cf7fe640 1 -- 172.21.15.120:0/35079567 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f03d80cfb80 con 0x7f03e0102ef0 2024-09-19T05:18:08.662 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.633+0000 7f03ddd9b640 1 --2- 172.21.15.120:0/35079567 >> [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801] conn(0x7f03c80acf80 0x7f03c80af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:08.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.633+0000 7f03de59c640 1 --2- 172.21.15.120:0/35079567 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f03c80a32d0 0x7f03c80a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f03d0005ab0 tx=0x7f03d0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:08.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.633+0000 7f03ddd9b640 1 --2- 172.21.15.120:0/35079567 >> [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801] conn(0x7f03c80acf80 0x7f03c80af420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:08.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.634+0000 7f03cf7fe640 1 -- 172.21.15.120:0/35079567 <== osd.9 v2:172.21.15.120:6826/3257373801 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f03d801ce50 con 0x7f03c80acf80 2024-09-19T05:18:08.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.647+0000 7f03e4d59640 1 -- 172.21.15.120:0/35079567 --> [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f03e0062d80 con 0x7f03c80acf80 2024-09-19T05:18:08.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.647+0000 7f03cf7fe640 1 -- 172.21.15.120:0/35079567 <== osd.9 v2:172.21.15.120:6826/3257373801 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f03e0062d80 con 0x7f03c80acf80 2024-09-19T05:18:08.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.648+0000 7f03e4d59640 1 -- 172.21.15.120:0/35079567 >> [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801] conn(0x7f03c80acf80 msgr2=0x7f03c80af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:08.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.648+0000 7f03e4d59640 1 --2- 172.21.15.120:0/35079567 >> [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801] conn(0x7f03c80acf80 0x7f03c80af420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:08.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.648+0000 7f03e4d59640 1 -- 172.21.15.120:0/35079567 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f03c80a32d0 msgr2=0x7f03c80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:08.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.648+0000 7f03e4d59640 1 --2- 172.21.15.120:0/35079567 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f03c80a32d0 0x7f03c80a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f03d0005ab0 tx=0x7f03d0005a20 comp rx=0 tx=0).stop 2024-09-19T05:18:08.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.648+0000 7f03e4d59640 1 -- 172.21.15.120:0/35079567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03e0102ef0 msgr2=0x7f03e019cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:08.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.648+0000 7f03e4d59640 1 --2- 172.21.15.120:0/35079567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03e0102ef0 0x7f03e019cdb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f03d800b970 tx=0x7f03d800bd70 comp rx=0 tx=0).stop 2024-09-19T05:18:08.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.648+0000 7f03ded9d640 1 -- 172.21.15.120:0/35079567 reap_dead start 2024-09-19T05:18:08.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.648+0000 7f03e4d59640 1 -- 172.21.15.120:0/35079567 shutdown_connections 2024-09-19T05:18:08.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.648+0000 7f03e4d59640 1 -- 172.21.15.120:0/35079567 >> 172.21.15.120:0/35079567 conn(0x7f03e00fc7d0 msgr2=0x7f03e006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:08.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.648+0000 7f03e4d59640 1 -- 172.21.15.120:0/35079567 shutdown_connections 2024-09-19T05:18:08.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:08.648+0000 7f03e4d59640 1 -- 172.21.15.120:0/35079567 wait complete. 2024-09-19T05:18:09.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.912+0000 7f68d465b640 1 -- 172.21.15.120:0/2427431159 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68cc102790 msgr2=0x7f68cc1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:09.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.912+0000 7f68d465b640 1 --2- 172.21.15.120:0/2427431159 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68cc102790 0x7f68cc1067e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f68c0009900 tx=0x7f68c002a410 comp rx=0 tx=0).stop 2024-09-19T05:18:09.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.912+0000 7f68d465b640 1 -- 172.21.15.120:0/2427431159 shutdown_connections 2024-09-19T05:18:09.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.912+0000 7f68d465b640 1 --2- 172.21.15.120:0/2427431159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68cc106f10 0x7f68cc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:09.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.912+0000 7f68d465b640 1 --2- 172.21.15.120:0/2427431159 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68cc102790 0x7f68cc1067e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:09.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.912+0000 7f68d465b640 1 --2- 172.21.15.120:0/2427431159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68cc101de0 0x7f68cc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:09.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.912+0000 7f68d465b640 1 -- 172.21.15.120:0/2427431159 >> 172.21.15.120:0/2427431159 conn(0x7f68cc0fd880 msgr2=0x7f68cc0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:09.145 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.912+0000 7f68d465b640 1 -- 172.21.15.120:0/2427431159 shutdown_connections 2024-09-19T05:18:09.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.912+0000 7f68d465b640 1 -- 172.21.15.120:0/2427431159 wait complete. 2024-09-19T05:18:09.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.913+0000 7f68d465b640 1 Processor -- start 2024-09-19T05:18:09.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.913+0000 7f68d465b640 1 -- start start 2024-09-19T05:18:09.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.913+0000 7f68d465b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68cc101de0 0x7f68cc1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:09.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.913+0000 7f68d465b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68cc102790 0x7f68cc198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:09.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.913+0000 7f68d465b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68cc106f10 0x7f68cc19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:09.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.913+0000 7f68d465b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f68cc111ec0 con 0x7f68cc106f10 2024-09-19T05:18:09.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.913+0000 7f68d465b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f68cc111d40 con 0x7f68cc102790 2024-09-19T05:18:09.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.913+0000 7f68d465b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f68cc112040 con 0x7f68cc101de0 2024-09-19T05:18:09.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.913+0000 7f68d2bf8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68cc106f10 0x7f68cc19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:09.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.913+0000 7f68d2bf8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68cc106f10 0x7f68cc19cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53268/0 (socket says 172.21.15.120:53268) 2024-09-19T05:18:09.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.913+0000 7f68d2bf8640 1 -- 172.21.15.120:0/1531629752 learned_addr learned my addr 172.21.15.120:0/1531629752 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:09.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.913+0000 7f68d1bf6640 1 --2- 172.21.15.120:0/1531629752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68cc102790 0x7f68cc198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:09.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.913+0000 7f68d23f7640 1 --2- 172.21.15.120:0/1531629752 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68cc101de0 0x7f68cc1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:09.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.914+0000 7f68d2bf8640 1 -- 172.21.15.120:0/1531629752 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68cc101de0 msgr2=0x7f68cc1984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:09.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.914+0000 7f68d2bf8640 1 --2- 172.21.15.120:0/1531629752 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68cc101de0 0x7f68cc1984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:09.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.914+0000 7f68d2bf8640 1 -- 172.21.15.120:0/1531629752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68cc102790 msgr2=0x7f68cc198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:09.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.914+0000 7f68d2bf8640 1 --2- 172.21.15.120:0/1531629752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68cc102790 0x7f68cc198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:09.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.914+0000 7f68d2bf8640 1 -- 172.21.15.120:0/1531629752 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68cc19d4a0 con 0x7f68cc106f10 2024-09-19T05:18:09.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.914+0000 7f68d2bf8640 1 --2- 172.21.15.120:0/1531629752 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68cc106f10 0x7f68cc19cdc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009fd0 tx=0x7f68c400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:09.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.914+0000 7f68cb7fe640 1 -- 172.21.15.120:0/1531629752 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c4011830 con 0x7f68cc106f10 2024-09-19T05:18:09.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.914+0000 7f68d465b640 1 -- 172.21.15.120:0/1531629752 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68cc19d790 con 0x7f68cc106f10 2024-09-19T05:18:09.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.914+0000 7f68cb7fe640 1 -- 172.21.15.120:0/1531629752 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f68c4016070 con 0x7f68cc106f10 2024-09-19T05:18:09.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.914+0000 7f68cb7fe640 1 -- 172.21.15.120:0/1531629752 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c4010de0 con 0x7f68cc106f10 2024-09-19T05:18:09.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.914+0000 7f68d465b640 1 -- 172.21.15.120:0/1531629752 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68cc1a5070 con 0x7f68cc106f10 2024-09-19T05:18:09.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.915+0000 7f68d465b640 1 -- 172.21.15.120:0/1531629752 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f68cc062980 con 0x7f68cc106f10 2024-09-19T05:18:09.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.916+0000 7f68cb7fe640 1 -- 172.21.15.120:0/1531629752 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f68c40119d0 con 0x7f68cc106f10 2024-09-19T05:18:09.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.917+0000 7f68cb7fe640 1 --2- 172.21.15.120:0/1531629752 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f68b40a32d0 0x7f68b40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:09.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.917+0000 7f68d23f7640 1 --2- 172.21.15.120:0/1531629752 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f68b40a32d0 0x7f68b40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:09.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.917+0000 7f68cb7fe640 1 -- 172.21.15.120:0/1531629752 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f68c40cfa80 con 0x7f68cc106f10 2024-09-19T05:18:09.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.917+0000 7f68cb7fe640 1 --2- 172.21.15.120:0/1531629752 >> [v2:172.21.15.178:6800/1195511218,v1:172.21.15.178:6801/1195511218] conn(0x7f68b40acf80 0x7f68b40af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:09.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.917+0000 7f68cb7fe640 1 -- 172.21.15.120:0/1531629752 --> [v2:172.21.15.178:6800/1195511218,v1:172.21.15.178:6801/1195511218] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68c4004450 con 0x7f68b40acf80 2024-09-19T05:18:09.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.917+0000 7f68cb7fe640 1 -- 172.21.15.120:0/1531629752 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f68c40cfed0 con 0x7f68cc106f10 2024-09-19T05:18:09.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.917+0000 7f68d23f7640 1 --2- 172.21.15.120:0/1531629752 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f68b40a32d0 0x7f68b40a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f68bc00a400 tx=0x7f68bc00d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:09.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.918+0000 7f68d1bf6640 1 --2- 172.21.15.120:0/1531629752 >> [v2:172.21.15.178:6800/1195511218,v1:172.21.15.178:6801/1195511218] conn(0x7f68b40acf80 0x7f68b40af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:09.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.918+0000 7f68d1bf6640 1 --2- 172.21.15.120:0/1531629752 >> [v2:172.21.15.178:6800/1195511218,v1:172.21.15.178:6801/1195511218] conn(0x7f68b40acf80 0x7f68b40af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:09.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.919+0000 7f68cb7fe640 1 -- 172.21.15.120:0/1531629752 <== osd.1 v2:172.21.15.178:6800/1195511218 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f68c4004450 con 0x7f68b40acf80 2024-09-19T05:18:09.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.934+0000 7f68d465b640 1 -- 172.21.15.120:0/1531629752 --> [v2:172.21.15.178:6800/1195511218,v1:172.21.15.178:6801/1195511218] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f68cc062e00 con 0x7f68b40acf80 2024-09-19T05:18:09.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.934+0000 7f68cb7fe640 1 -- 172.21.15.120:0/1531629752 <== osd.1 v2:172.21.15.178:6800/1195511218 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f68cc062e00 con 0x7f68b40acf80 2024-09-19T05:18:09.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.935+0000 7f68d465b640 1 -- 172.21.15.120:0/1531629752 >> [v2:172.21.15.178:6800/1195511218,v1:172.21.15.178:6801/1195511218] conn(0x7f68b40acf80 msgr2=0x7f68b40af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:09.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.935+0000 7f68d465b640 1 --2- 172.21.15.120:0/1531629752 >> [v2:172.21.15.178:6800/1195511218,v1:172.21.15.178:6801/1195511218] conn(0x7f68b40acf80 0x7f68b40af420 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:09.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.935+0000 7f68d465b640 1 -- 172.21.15.120:0/1531629752 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f68b40a32d0 msgr2=0x7f68b40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:09.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.935+0000 7f68d465b640 1 --2- 172.21.15.120:0/1531629752 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f68b40a32d0 0x7f68b40a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f68bc00a400 tx=0x7f68bc00d040 comp rx=0 tx=0).stop 2024-09-19T05:18:09.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.935+0000 7f68d465b640 1 -- 172.21.15.120:0/1531629752 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68cc106f10 msgr2=0x7f68cc19cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:09.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.935+0000 7f68d465b640 1 --2- 172.21.15.120:0/1531629752 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68cc106f10 0x7f68cc19cdc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009fd0 tx=0x7f68c400b8e0 comp rx=0 tx=0).stop 2024-09-19T05:18:09.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.935+0000 7f68d2bf8640 1 -- 172.21.15.120:0/1531629752 reap_dead start 2024-09-19T05:18:09.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.935+0000 7f68d465b640 1 -- 172.21.15.120:0/1531629752 shutdown_connections 2024-09-19T05:18:09.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.935+0000 7f68d465b640 1 -- 172.21.15.120:0/1531629752 >> 172.21.15.120:0/1531629752 conn(0x7f68cc0fd880 msgr2=0x7f68cc0fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:09.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.935+0000 7f68d465b640 1 -- 172.21.15.120:0/1531629752 shutdown_connections 2024-09-19T05:18:09.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:05.935+0000 7f68d465b640 1 -- 172.21.15.120:0/1531629752 wait complete. 2024-09-19T05:18:09.405 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:09 smithi120 ceph-mon[30956]: pgmap v292: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T05:18:09.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:09 smithi194 ceph-mon[35228]: pgmap v292: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T05:18:09.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:09 smithi178 ceph-mon[34347]: pgmap v292: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T05:18:10.009 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:10.019 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:10.043 INFO:teuthology.orchestra.run.smithi120.stdout:51539607621 2024-09-19T05:18:10.044 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T05:18:10.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.484+0000 7f0ec0270640 1 -- 172.21.15.120:0/707354355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0eb8106f10 msgr2=0x7f0eb810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:10.118 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.484+0000 7f0ec0270640 1 --2- 172.21.15.120:0/707354355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0eb8106f10 0x7f0eb810ea90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0009ca0 tx=0x7f0eb002a8c0 comp rx=0 tx=0).stop 2024-09-19T05:18:10.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.484+0000 7f0ec0270640 1 -- 172.21.15.120:0/707354355 shutdown_connections 2024-09-19T05:18:10.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.484+0000 7f0ec0270640 1 --2- 172.21.15.120:0/707354355 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0eb8106f10 0x7f0eb810ea90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:10.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.484+0000 7f0ec0270640 1 --2- 172.21.15.120:0/707354355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0eb8102790 0x7f0eb81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:10.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.484+0000 7f0ec0270640 1 --2- 172.21.15.120:0/707354355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0eb8101de0 0x7f0eb81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:10.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.484+0000 7f0ec0270640 1 -- 172.21.15.120:0/707354355 >> 172.21.15.120:0/707354355 conn(0x7f0eb80fd8c0 msgr2=0x7f0eb80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:10.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.484+0000 7f0ec0270640 1 -- 172.21.15.120:0/707354355 shutdown_connections 2024-09-19T05:18:10.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.484+0000 7f0ec0270640 1 -- 172.21.15.120:0/707354355 wait complete. 2024-09-19T05:18:10.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.485+0000 7f0ec0270640 1 Processor -- start 2024-09-19T05:18:10.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.485+0000 7f0ec0270640 1 -- start start 2024-09-19T05:18:10.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.485+0000 7f0ec0270640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0eb8101de0 0x7f0eb81983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:10.119 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.485+0000 7f0ec0270640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0eb8102790 0x7f0eb81988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:10.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.485+0000 7f0ec0270640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0eb8106f10 0x7f0eb819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:10.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.485+0000 7f0ec0270640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb8111e60 con 0x7f0eb8102790 2024-09-19T05:18:10.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.485+0000 7f0ec0270640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb8111ce0 con 0x7f0eb8106f10 2024-09-19T05:18:10.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.485+0000 7f0ec0270640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb8111fe0 con 0x7f0eb8101de0 2024-09-19T05:18:10.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.485+0000 7f0ebd80b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0eb8102790 0x7f0eb81988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:10.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.485+0000 7f0ebd80b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0eb8102790 0x7f0eb81988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53402/0 (socket says 172.21.15.120:53402) 2024-09-19T05:18:10.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.485+0000 7f0ebd80b640 1 -- 172.21.15.120:0/3875401117 learned_addr learned my addr 172.21.15.120:0/3875401117 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:10.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.485+0000 7f0ebd80b640 1 -- 172.21.15.120:0/3875401117 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0eb8101de0 msgr2=0x7f0eb81983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:10.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.485+0000 7f0ebd80b640 1 --2- 172.21.15.120:0/3875401117 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0eb8101de0 0x7f0eb81983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:10.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.485+0000 7f0ebd80b640 1 -- 172.21.15.120:0/3875401117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0eb8106f10 msgr2=0x7f0eb819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:10.120 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.485+0000 7f0ebd80b640 1 --2- 172.21.15.120:0/3875401117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0eb8106f10 0x7f0eb819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:10.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.485+0000 7f0ebd80b640 1 -- 172.21.15.120:0/3875401117 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb819d350 con 0x7f0eb8102790 2024-09-19T05:18:10.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.485+0000 7f0ebd80b640 1 --2- 172.21.15.120:0/3875401117 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0eb8102790 0x7f0eb81988e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400d770 tx=0x7f0eb400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:10.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.486+0000 7f0eab7fe640 1 -- 172.21.15.120:0/3875401117 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4017070 con 0x7f0eb8102790 2024-09-19T05:18:10.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.486+0000 7f0eab7fe640 1 -- 172.21.15.120:0/3875401117 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0eb40054d0 con 0x7f0eb8102790 2024-09-19T05:18:10.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.486+0000 7f0eab7fe640 1 -- 172.21.15.120:0/3875401117 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4004cf0 con 0x7f0eb8102790 2024-09-19T05:18:10.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.486+0000 7f0ec0270640 1 -- 172.21.15.120:0/3875401117 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eb819d640 con 0x7f0eb8102790 2024-09-19T05:18:10.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.486+0000 7f0ec0270640 1 -- 172.21.15.120:0/3875401117 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eb81a4f20 con 0x7f0eb8102790 2024-09-19T05:18:10.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.486+0000 7f0ec0270640 1 -- 172.21.15.120:0/3875401117 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0eb8062980 con 0x7f0eb8102790 2024-09-19T05:18:10.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.488+0000 7f0eab7fe640 1 -- 172.21.15.120:0/3875401117 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f0eb4004e90 con 0x7f0eb8102790 2024-09-19T05:18:10.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.488+0000 7f0eab7fe640 1 --2- 172.21.15.120:0/3875401117 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0ea40a3350 0x7f0ea40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:10.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.488+0000 7f0ebe00c640 1 --2- 172.21.15.120:0/3875401117 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0ea40a3350 0x7f0ea40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:10.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.488+0000 7f0eab7fe640 1 -- 172.21.15.120:0/3875401117 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f0eb40cf970 con 0x7f0eb8102790 2024-09-19T05:18:10.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.489+0000 7f0eab7fe640 1 --2- 172.21.15.120:0/3875401117 >> [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783] conn(0x7f0ea40ad000 0x7f0ea40af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:10.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.489+0000 7f0eab7fe640 1 -- 172.21.15.120:0/3875401117 --> [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0eb4001d30 con 0x7f0ea40ad000 2024-09-19T05:18:10.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.489+0000 7f0eab7fe640 1 -- 172.21.15.120:0/3875401117 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f0eb40cfdc0 con 0x7f0eb8102790 2024-09-19T05:18:10.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.489+0000 7f0ebe80d640 1 --2- 172.21.15.120:0/3875401117 >> [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783] conn(0x7f0ea40ad000 0x7f0ea40af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:10.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.489+0000 7f0ebe00c640 1 --2- 172.21.15.120:0/3875401117 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0ea40a3350 0x7f0ea40a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0eac009710 tx=0x7f0eac006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:10.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.489+0000 7f0ebe80d640 1 --2- 172.21.15.120:0/3875401117 >> [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783] conn(0x7f0ea40ad000 0x7f0ea40af4a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:10.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.490+0000 7f0eab7fe640 1 -- 172.21.15.120:0/3875401117 <== osd.3 v2:172.21.15.120:6810/803566783 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0eb4001d30 con 0x7f0ea40ad000 2024-09-19T05:18:10.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.503+0000 7f0ec0270640 1 -- 172.21.15.120:0/3875401117 --> [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0eb8062d80 con 0x7f0ea40ad000 2024-09-19T05:18:10.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.503+0000 7f0eab7fe640 1 -- 172.21.15.120:0/3875401117 <== osd.3 v2:172.21.15.120:6810/803566783 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0eb8062d80 con 0x7f0ea40ad000 2024-09-19T05:18:10.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.504+0000 7f0ec0270640 1 -- 172.21.15.120:0/3875401117 >> [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783] conn(0x7f0ea40ad000 msgr2=0x7f0ea40af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:10.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.504+0000 7f0ec0270640 1 --2- 172.21.15.120:0/3875401117 >> [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783] conn(0x7f0ea40ad000 0x7f0ea40af4a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:10.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.504+0000 7f0ec0270640 1 -- 172.21.15.120:0/3875401117 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0ea40a3350 msgr2=0x7f0ea40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:10.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.504+0000 7f0ec0270640 1 --2- 172.21.15.120:0/3875401117 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0ea40a3350 0x7f0ea40a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0eac009710 tx=0x7f0eac006c90 comp rx=0 tx=0).stop 2024-09-19T05:18:10.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.504+0000 7f0ec0270640 1 -- 172.21.15.120:0/3875401117 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0eb8102790 msgr2=0x7f0eb81988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:10.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.504+0000 7f0ec0270640 1 --2- 172.21.15.120:0/3875401117 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0eb8102790 0x7f0eb81988e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400d770 tx=0x7f0eb400dc30 comp rx=0 tx=0).stop 2024-09-19T05:18:10.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.504+0000 7f0ebe80d640 1 -- 172.21.15.120:0/3875401117 reap_dead start 2024-09-19T05:18:10.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.504+0000 7f0ec0270640 1 -- 172.21.15.120:0/3875401117 shutdown_connections 2024-09-19T05:18:10.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.504+0000 7f0ec0270640 1 -- 172.21.15.120:0/3875401117 >> 172.21.15.120:0/3875401117 conn(0x7f0eb80fd8c0 msgr2=0x7f0eb80feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:10.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.504+0000 7f0ec0270640 1 -- 172.21.15.120:0/3875401117 shutdown_connections 2024-09-19T05:18:10.123 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:09.504+0000 7f0ec0270640 1 -- 172.21.15.120:0/3875401117 wait complete. 2024-09-19T05:18:10.790 INFO:teuthology.orchestra.run.smithi120.stdout:270582939679 2024-09-19T05:18:10.791 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T05:18:11.299 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:11 smithi120 ceph-mon[30956]: pgmap v293: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T05:18:11.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:11 smithi194 ceph-mon[35228]: pgmap v293: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T05:18:11.682 INFO:teuthology.orchestra.run.smithi120.stdout:287762808857 2024-09-19T05:18:11.682 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T05:18:11.691 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:11 smithi178 ceph-mon[34347]: pgmap v293: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-19T05:18:11.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.840+0000 7f50dfda3640 1 -- 172.21.15.120:0/1142740021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50d8102ef0 msgr2=0x7f50d810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:11.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.840+0000 7f50dfda3640 1 --2- 172.21.15.120:0/1142740021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50d8102ef0 0x7f50d810da40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009ca0 tx=0x7f50d002a950 comp rx=0 tx=0).stop 2024-09-19T05:18:11.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.840+0000 7f50dfda3640 1 -- 172.21.15.120:0/1142740021 shutdown_connections 2024-09-19T05:18:11.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.840+0000 7f50dfda3640 1 --2- 172.21.15.120:0/1142740021 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50d8102ef0 0x7f50d810da40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:11.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.840+0000 7f50dfda3640 1 --2- 172.21.15.120:0/1142740021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50d8102570 0x7f50d81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:11.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.840+0000 7f50dfda3640 1 --2- 172.21.15.120:0/1142740021 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50d8100e20 0x7f50d8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:11.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.840+0000 7f50dfda3640 1 -- 172.21.15.120:0/1142740021 >> 172.21.15.120:0/1142740021 conn(0x7f50d80fc7d0 msgr2=0x7f50d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:11.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.841+0000 7f50dfda3640 1 -- 172.21.15.120:0/1142740021 shutdown_connections 2024-09-19T05:18:11.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.841+0000 7f50dfda3640 1 -- 172.21.15.120:0/1142740021 wait complete. 2024-09-19T05:18:11.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.841+0000 7f50dfda3640 1 Processor -- start 2024-09-19T05:18:11.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.841+0000 7f50dfda3640 1 -- start start 2024-09-19T05:18:11.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.842+0000 7f50dfda3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50d8100e20 0x7f50d8199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:11.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.842+0000 7f50dfda3640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50d8102570 0x7f50d8199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:11.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.842+0000 7f50dfda3640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50d8102ef0 0x7f50d8199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:11.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.842+0000 7f50dfda3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f50d8110e30 con 0x7f50d8100e20 2024-09-19T05:18:11.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.842+0000 7f50dfda3640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f50d8110cb0 con 0x7f50d8102ef0 2024-09-19T05:18:11.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.842+0000 7f50dfda3640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f50d8110fb0 con 0x7f50d8102570 2024-09-19T05:18:11.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.842+0000 7f50ddb3f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50d8100e20 0x7f50d8199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:11.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.842+0000 7f50ddb3f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50d8100e20 0x7f50d8199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53412/0 (socket says 172.21.15.120:53412) 2024-09-19T05:18:11.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.842+0000 7f50ddb3f640 1 -- 172.21.15.120:0/518946714 learned_addr learned my addr 172.21.15.120:0/518946714 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:11.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.842+0000 7f50dd33e640 1 --2- 172.21.15.120:0/518946714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50d8102570 0x7f50d8199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:11.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.842+0000 7f50de340640 1 --2- 172.21.15.120:0/518946714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50d8102ef0 0x7f50d8199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:11.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.843+0000 7f50dd33e640 1 -- 172.21.15.120:0/518946714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50d8102ef0 msgr2=0x7f50d8199dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:11.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.843+0000 7f50dd33e640 1 --2- 172.21.15.120:0/518946714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50d8102ef0 0x7f50d8199dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:11.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.843+0000 7f50dd33e640 1 -- 172.21.15.120:0/518946714 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50d8100e20 msgr2=0x7f50d8199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:11.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.843+0000 7f50dd33e640 1 --2- 172.21.15.120:0/518946714 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f50d8100e20 0x7f50d8199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:11.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.843+0000 7f50dd33e640 1 -- 172.21.15.120:0/518946714 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d81a4700 con 0x7f50d8102570 2024-09-19T05:18:11.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.843+0000 7f50dd33e640 1 --2- 172.21.15.120:0/518946714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50d8102570 0x7f50d8199840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f50c8005fd0 tx=0x7f50c800dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:11.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.843+0000 7f50ceffd640 1 -- 172.21.15.120:0/518946714 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c8009c30 con 0x7f50d8102570 2024-09-19T05:18:11.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.843+0000 7f50dfda3640 1 -- 172.21.15.120:0/518946714 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50d8197150 con 0x7f50d8102570 2024-09-19T05:18:11.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.843+0000 7f50dfda3640 1 -- 172.21.15.120:0/518946714 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50d81976e0 con 0x7f50d8102570 2024-09-19T05:18:11.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.843+0000 7f50ceffd640 1 -- 172.21.15.120:0/518946714 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f50c8009dd0 con 0x7f50d8102570 2024-09-19T05:18:11.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.844+0000 7f50ceffd640 1 -- 172.21.15.120:0/518946714 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c8020060 con 0x7f50d8102570 2024-09-19T05:18:11.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.845+0000 7f50dfda3640 1 -- 172.21.15.120:0/518946714 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f50d8062900 con 0x7f50d8102570 2024-09-19T05:18:11.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.846+0000 7f50ceffd640 1 -- 172.21.15.120:0/518946714 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f50c8005020 con 0x7f50d8102570 2024-09-19T05:18:11.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.846+0000 7f50ceffd640 1 --2- 172.21.15.120:0/518946714 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f50c40a32d0 0x7f50c40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:11.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.846+0000 7f50ddb3f640 1 --2- 172.21.15.120:0/518946714 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f50c40a32d0 0x7f50c40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:11.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.846+0000 7f50ceffd640 1 -- 172.21.15.120:0/518946714 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f50c80cf660 con 0x7f50d8102570 2024-09-19T05:18:11.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.847+0000 7f50ceffd640 1 --2- 172.21.15.120:0/518946714 >> [v2:172.21.15.194:6816/596878172,v1:172.21.15.194:6817/596878172] conn(0x7f50c40acf80 0x7f50c40af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:11.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.847+0000 7f50ceffd640 1 -- 172.21.15.120:0/518946714 --> [v2:172.21.15.194:6816/596878172,v1:172.21.15.194:6817/596878172] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f50c8048ea0 con 0x7f50c40acf80 2024-09-19T05:18:11.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.847+0000 7f50ceffd640 1 -- 172.21.15.120:0/518946714 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f50c80cfab0 con 0x7f50d8102570 2024-09-19T05:18:11.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.847+0000 7f50de340640 1 --2- 172.21.15.120:0/518946714 >> [v2:172.21.15.194:6816/596878172,v1:172.21.15.194:6817/596878172] conn(0x7f50c40acf80 0x7f50c40af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:11.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.847+0000 7f50ddb3f640 1 --2- 172.21.15.120:0/518946714 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f50c40a32d0 0x7f50c40a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f50d4005fd0 tx=0x7f50d400b2c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:11.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.847+0000 7f50de340640 1 --2- 172.21.15.120:0/518946714 >> [v2:172.21.15.194:6816/596878172,v1:172.21.15.194:6817/596878172] conn(0x7f50c40acf80 0x7f50c40af420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:11.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.848+0000 7f50ceffd640 1 -- 172.21.15.120:0/518946714 <== osd.8 v2:172.21.15.194:6816/596878172 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f50c8048ea0 con 0x7f50c40acf80 2024-09-19T05:18:11.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.862+0000 7f50dfda3640 1 -- 172.21.15.120:0/518946714 --> [v2:172.21.15.194:6816/596878172,v1:172.21.15.194:6817/596878172] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f50d8062d30 con 0x7f50c40acf80 2024-09-19T05:18:11.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.863+0000 7f50ceffd640 1 -- 172.21.15.120:0/518946714 <== osd.8 v2:172.21.15.194:6816/596878172 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f50d8062d30 con 0x7f50c40acf80 2024-09-19T05:18:11.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.863+0000 7f50dfda3640 1 -- 172.21.15.120:0/518946714 >> [v2:172.21.15.194:6816/596878172,v1:172.21.15.194:6817/596878172] conn(0x7f50c40acf80 msgr2=0x7f50c40af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:11.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.863+0000 7f50dfda3640 1 --2- 172.21.15.120:0/518946714 >> [v2:172.21.15.194:6816/596878172,v1:172.21.15.194:6817/596878172] conn(0x7f50c40acf80 0x7f50c40af420 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:11.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.863+0000 7f50dfda3640 1 -- 172.21.15.120:0/518946714 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f50c40a32d0 msgr2=0x7f50c40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:11.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.863+0000 7f50dfda3640 1 --2- 172.21.15.120:0/518946714 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f50c40a32d0 0x7f50c40a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f50d4005fd0 tx=0x7f50d400b2c0 comp rx=0 tx=0).stop 2024-09-19T05:18:11.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.863+0000 7f50dfda3640 1 -- 172.21.15.120:0/518946714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50d8102570 msgr2=0x7f50d8199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:11.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.863+0000 7f50dfda3640 1 --2- 172.21.15.120:0/518946714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50d8102570 0x7f50d8199840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f50c8005fd0 tx=0x7f50c800dde0 comp rx=0 tx=0).stop 2024-09-19T05:18:11.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.863+0000 7f50de340640 1 -- 172.21.15.120:0/518946714 reap_dead start 2024-09-19T05:18:11.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.863+0000 7f50dfda3640 1 -- 172.21.15.120:0/518946714 shutdown_connections 2024-09-19T05:18:11.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.863+0000 7f50dfda3640 1 -- 172.21.15.120:0/518946714 >> 172.21.15.120:0/518946714 conn(0x7f50d80fc7d0 msgr2=0x7f50d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:11.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.863+0000 7f50dfda3640 1 -- 172.21.15.120:0/518946714 shutdown_connections 2024-09-19T05:18:11.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:11.863+0000 7f50dfda3640 1 -- 172.21.15.120:0/518946714 wait complete. 2024-09-19T05:18:12.833 INFO:teuthology.orchestra.run.smithi120.stdout:103079215164 2024-09-19T05:18:12.833 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T05:18:13.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:13 smithi120 ceph-mon[30956]: pgmap v294: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T05:18:13.437 INFO:teuthology.orchestra.run.smithi120.stdout:317827579925 2024-09-19T05:18:13.438 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T05:18:13.458 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:13 smithi194 ceph-mon[35228]: pgmap v294: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T05:18:13.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.609+0000 7f6ed8c8f640 1 -- 172.21.15.120:0/691060932 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ed4102d30 msgr2=0x7f6ed4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:13.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.609+0000 7f6ed8c8f640 1 --2- 172.21.15.120:0/691060932 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ed4102d30 0x7f6ed4103110 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4009930 tx=0x7f6ec402a420 comp rx=0 tx=0).stop 2024-09-19T05:18:13.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.609+0000 7f6ed8c8f640 1 -- 172.21.15.120:0/691060932 shutdown_connections 2024-09-19T05:18:13.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.609+0000 7f6ed8c8f640 1 --2- 172.21.15.120:0/691060932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ed41082a0 0x7f6ed410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:13.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.609+0000 7f6ed8c8f640 1 --2- 172.21.15.120:0/691060932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ed41036e0 0x7f6ed4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:13.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.609+0000 7f6ed8c8f640 1 --2- 172.21.15.120:0/691060932 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ed4102d30 0x7f6ed4103110 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:13.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.609+0000 7f6ed8c8f640 1 -- 172.21.15.120:0/691060932 >> 172.21.15.120:0/691060932 conn(0x7f6ed40fc7d0 msgr2=0x7f6ed40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:13.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.609+0000 7f6ed8c8f640 1 -- 172.21.15.120:0/691060932 shutdown_connections 2024-09-19T05:18:13.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.609+0000 7f6ed8c8f640 1 -- 172.21.15.120:0/691060932 wait complete. 2024-09-19T05:18:13.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.610+0000 7f6ed8c8f640 1 Processor -- start 2024-09-19T05:18:13.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.610+0000 7f6ed8c8f640 1 -- start start 2024-09-19T05:18:13.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.610+0000 7f6ed8c8f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ed4102d30 0x7f6ed4198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:13.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.610+0000 7f6ed8c8f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ed41036e0 0x7f6ed4198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:13.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.610+0000 7f6ed8c8f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ed41082a0 0x7f6ed419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:13.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.610+0000 7f6ed8c8f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed4111f50 con 0x7f6ed41036e0 2024-09-19T05:18:13.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.610+0000 7f6ed8c8f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed4111dd0 con 0x7f6ed41082a0 2024-09-19T05:18:13.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.610+0000 7f6ed8c8f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed41120d0 con 0x7f6ed4102d30 2024-09-19T05:18:13.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.611+0000 7f6ecbfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ed41036e0 0x7f6ed4198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:13.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.611+0000 7f6ed259c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ed4102d30 0x7f6ed4198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:13.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.611+0000 7f6ecbfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ed41036e0 0x7f6ed4198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53434/0 (socket says 172.21.15.120:53434) 2024-09-19T05:18:13.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.611+0000 7f6ecbfff640 1 -- 172.21.15.120:0/911938871 learned_addr learned my addr 172.21.15.120:0/911938871 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:13.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.611+0000 7f6ed259c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ed4102d30 0x7f6ed4198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:51612/0 (socket says 172.21.15.120:51612) 2024-09-19T05:18:13.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.611+0000 7f6ed2d9d640 1 --2- 172.21.15.120:0/911938871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ed41082a0 0x7f6ed419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:13.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.611+0000 7f6ed259c640 1 -- 172.21.15.120:0/911938871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ed41082a0 msgr2=0x7f6ed419cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:13.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.611+0000 7f6ed259c640 1 --2- 172.21.15.120:0/911938871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ed41082a0 0x7f6ed419cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:13.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.611+0000 7f6ed259c640 1 -- 172.21.15.120:0/911938871 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ed41036e0 msgr2=0x7f6ed4198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:13.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.611+0000 7f6ed259c640 1 --2- 172.21.15.120:0/911938871 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ed41036e0 0x7f6ed4198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:13.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.611+0000 7f6ed259c640 1 -- 172.21.15.120:0/911938871 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed419d4c0 con 0x7f6ed4102d30 2024-09-19T05:18:13.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.611+0000 7f6ecbfff640 1 --2- 172.21.15.120:0/911938871 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6ed41036e0 0x7f6ed4198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:18:13.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.611+0000 7f6ed259c640 1 --2- 172.21.15.120:0/911938871 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ed4102d30 0x7f6ed4198510 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4031440 tx=0x7f6ec4004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:13.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.611+0000 7f6ecb7fe640 1 -- 172.21.15.120:0/911938871 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec403f070 con 0x7f6ed4102d30 2024-09-19T05:18:13.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.611+0000 7f6ecb7fe640 1 -- 172.21.15.120:0/911938871 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6ec4003ca0 con 0x7f6ed4102d30 2024-09-19T05:18:13.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.611+0000 7f6ed8c8f640 1 -- 172.21.15.120:0/911938871 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ed419d750 con 0x7f6ed4102d30 2024-09-19T05:18:13.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.612+0000 7f6ecb7fe640 1 -- 172.21.15.120:0/911938871 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4035070 con 0x7f6ed4102d30 2024-09-19T05:18:13.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.612+0000 7f6ed8c8f640 1 -- 172.21.15.120:0/911938871 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ed41a5090 con 0x7f6ed4102d30 2024-09-19T05:18:13.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.612+0000 7f6ed8c8f640 1 -- 172.21.15.120:0/911938871 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ed4062980 con 0x7f6ed4102d30 2024-09-19T05:18:13.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.614+0000 7f6ecb7fe640 1 -- 172.21.15.120:0/911938871 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f6ec403b640 con 0x7f6ed4102d30 2024-09-19T05:18:13.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.614+0000 7f6ecb7fe640 1 --2- 172.21.15.120:0/911938871 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f6ec00a3350 0x7f6ec00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:13.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.614+0000 7f6ecb7fe640 1 -- 172.21.15.120:0/911938871 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f6ec40f06f0 con 0x7f6ed4102d30 2024-09-19T05:18:13.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.614+0000 7f6ecbfff640 1 --2- 172.21.15.120:0/911938871 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f6ec00a3350 0x7f6ec00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:13.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.614+0000 7f6ecb7fe640 1 --2- 172.21.15.120:0/911938871 >> [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326] conn(0x7f6ec00ad000 0x7f6ec00af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:13.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.614+0000 7f6ecb7fe640 1 -- 172.21.15.120:0/911938871 --> [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ec4001d30 con 0x7f6ec00ad000 2024-09-19T05:18:13.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.614+0000 7f6ecb7fe640 1 -- 172.21.15.120:0/911938871 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f6ec40f0aa0 con 0x7f6ed4102d30 2024-09-19T05:18:13.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.615+0000 7f6ed2d9d640 1 --2- 172.21.15.120:0/911938871 >> [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326] conn(0x7f6ec00ad000 0x7f6ec00af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:13.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.615+0000 7f6ecbfff640 1 --2- 172.21.15.120:0/911938871 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f6ec00a3350 0x7f6ec00a5810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40fef40 tx=0x7f6ebc00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:13.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.615+0000 7f6ed2d9d640 1 --2- 172.21.15.120:0/911938871 >> [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326] conn(0x7f6ec00ad000 0x7f6ec00af4a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:13.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.616+0000 7f6ecb7fe640 1 -- 172.21.15.120:0/911938871 <== osd.0 v2:172.21.15.120:6802/3421474326 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6ec4001d30 con 0x7f6ec00ad000 2024-09-19T05:18:13.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.630+0000 7f6ed8c8f640 1 -- 172.21.15.120:0/911938871 --> [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6ed4062d80 con 0x7f6ec00ad000 2024-09-19T05:18:13.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.631+0000 7f6ecb7fe640 1 -- 172.21.15.120:0/911938871 <== osd.0 v2:172.21.15.120:6802/3421474326 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6ed4062d80 con 0x7f6ec00ad000 2024-09-19T05:18:13.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.631+0000 7f6ed8c8f640 1 -- 172.21.15.120:0/911938871 >> [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326] conn(0x7f6ec00ad000 msgr2=0x7f6ec00af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:13.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.631+0000 7f6ed8c8f640 1 --2- 172.21.15.120:0/911938871 >> [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326] conn(0x7f6ec00ad000 0x7f6ec00af4a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:13.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.631+0000 7f6ed8c8f640 1 -- 172.21.15.120:0/911938871 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f6ec00a3350 msgr2=0x7f6ec00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:13.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.631+0000 7f6ed8c8f640 1 --2- 172.21.15.120:0/911938871 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f6ec00a3350 0x7f6ec00a5810 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40fef40 tx=0x7f6ebc00a2d0 comp rx=0 tx=0).stop 2024-09-19T05:18:13.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.631+0000 7f6ed8c8f640 1 -- 172.21.15.120:0/911938871 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ed4102d30 msgr2=0x7f6ed4198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:13.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.631+0000 7f6ed8c8f640 1 --2- 172.21.15.120:0/911938871 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ed4102d30 0x7f6ed4198510 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4031440 tx=0x7f6ec4004270 comp rx=0 tx=0).stop 2024-09-19T05:18:13.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.631+0000 7f6ed2d9d640 1 -- 172.21.15.120:0/911938871 reap_dead start 2024-09-19T05:18:13.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.631+0000 7f6ed8c8f640 1 -- 172.21.15.120:0/911938871 shutdown_connections 2024-09-19T05:18:13.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.631+0000 7f6ed8c8f640 1 -- 172.21.15.120:0/911938871 >> 172.21.15.120:0/911938871 conn(0x7f6ed40fc7d0 msgr2=0x7f6ed4105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:13.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.632+0000 7f6ed8c8f640 1 -- 172.21.15.120:0/911938871 shutdown_connections 2024-09-19T05:18:13.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:13.632+0000 7f6ed8c8f640 1 -- 172.21.15.120:0/911938871 wait complete. 2024-09-19T05:18:13.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:13 smithi178 ceph-mon[34347]: pgmap v294: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T05:18:14.446 INFO:teuthology.orchestra.run.smithi120.stdout:34359738444 2024-09-19T05:18:14.447 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T05:18:15.061 INFO:teuthology.orchestra.run.smithi120.stdout:137438953526 2024-09-19T05:18:15.062 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T05:18:15.283 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:15 smithi120 ceph-mon[30956]: pgmap v295: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T05:18:15.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.403+0000 7f418ea56640 1 -- 172.21.15.120:0/1791148412 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4188102ef0 msgr2=0x7f418810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:15.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.403+0000 7f418ea56640 1 --2- 172.21.15.120:0/1791148412 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4188102ef0 0x7f418810da40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4180009ca0 tx=0x7f418002a950 comp rx=0 tx=0).stop 2024-09-19T05:18:15.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.403+0000 7f418ea56640 1 -- 172.21.15.120:0/1791148412 shutdown_connections 2024-09-19T05:18:15.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.403+0000 7f418ea56640 1 --2- 172.21.15.120:0/1791148412 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4188102ef0 0x7f418810da40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:15.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.403+0000 7f418ea56640 1 --2- 172.21.15.120:0/1791148412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4188102570 0x7f41881029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:15.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.403+0000 7f418ea56640 1 --2- 172.21.15.120:0/1791148412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4188100e20 0x7f4188101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:15.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.403+0000 7f418ea56640 1 -- 172.21.15.120:0/1791148412 >> 172.21.15.120:0/1791148412 conn(0x7f41880fc7d0 msgr2=0x7f41880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:15.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.403+0000 7f418ea56640 1 -- 172.21.15.120:0/1791148412 shutdown_connections 2024-09-19T05:18:15.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.403+0000 7f418ea56640 1 -- 172.21.15.120:0/1791148412 wait complete. 2024-09-19T05:18:15.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.403+0000 7f418ea56640 1 Processor -- start 2024-09-19T05:18:15.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.403+0000 7f418ea56640 1 -- start start 2024-09-19T05:18:15.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.404+0000 7f418ea56640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4188100e20 0x7f41881973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:15.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.404+0000 7f418ea56640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4188102570 0x7f41881978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:15.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.404+0000 7f418ea56640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4188102ef0 0x7f418819bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:15.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.404+0000 7f418ea56640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4188110e50 con 0x7f4188100e20 2024-09-19T05:18:15.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.404+0000 7f418ea56640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4188110cd0 con 0x7f4188102570 2024-09-19T05:18:15.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.404+0000 7f418ea56640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4188110fd0 con 0x7f4188102ef0 2024-09-19T05:18:15.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.404+0000 7f4187fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4188100e20 0x7f41881973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:15.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.404+0000 7f4187fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4188100e20 0x7f41881973b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43802/0 (socket says 172.21.15.120:43802) 2024-09-19T05:18:15.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.404+0000 7f4187fff640 1 -- 172.21.15.120:0/1415502831 learned_addr learned my addr 172.21.15.120:0/1415502831 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:15.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.404+0000 7f417ffff640 1 --2- 172.21.15.120:0/1415502831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4188102570 0x7f41881978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:15.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.404+0000 7f418cff3640 1 --2- 172.21.15.120:0/1415502831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4188102ef0 0x7f418819bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:15.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.404+0000 7f4187fff640 1 -- 172.21.15.120:0/1415502831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4188102ef0 msgr2=0x7f418819bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:15.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.404+0000 7f4187fff640 1 --2- 172.21.15.120:0/1415502831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4188102ef0 0x7f418819bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:15.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.404+0000 7f4187fff640 1 -- 172.21.15.120:0/1415502831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4188102570 msgr2=0x7f41881978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:15.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.404+0000 7f4187fff640 1 --2- 172.21.15.120:0/1415502831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4188102570 0x7f41881978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:15.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.404+0000 7f4187fff640 1 -- 172.21.15.120:0/1415502831 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418819c360 con 0x7f4188100e20 2024-09-19T05:18:15.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.404+0000 7f418cff3640 1 --2- 172.21.15.120:0/1415502831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4188102ef0 0x7f418819bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:15.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.404+0000 7f4187fff640 1 --2- 172.21.15.120:0/1415502831 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4188100e20 0x7f41881973b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4178009970 tx=0x7f4178009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:15.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.404+0000 7f4185ffb640 1 -- 172.21.15.120:0/1415502831 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417800d020 con 0x7f4188100e20 2024-09-19T05:18:15.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.404+0000 7f4185ffb640 1 -- 172.21.15.120:0/1415502831 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f417800d1c0 con 0x7f4188100e20 2024-09-19T05:18:15.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.404+0000 7f418ea56640 1 -- 172.21.15.120:0/1415502831 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f418819c650 con 0x7f4188100e20 2024-09-19T05:18:15.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.404+0000 7f4185ffb640 1 -- 172.21.15.120:0/1415502831 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417800cc50 con 0x7f4188100e20 2024-09-19T05:18:15.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.404+0000 7f418ea56640 1 -- 172.21.15.120:0/1415502831 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4188069f70 con 0x7f4188100e20 2024-09-19T05:18:15.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.405+0000 7f418ea56640 1 -- 172.21.15.120:0/1415502831 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f418806a520 con 0x7f4188100e20 2024-09-19T05:18:15.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.406+0000 7f4185ffb640 1 -- 172.21.15.120:0/1415502831 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f417800c460 con 0x7f4188100e20 2024-09-19T05:18:15.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.407+0000 7f4185ffb640 1 --2- 172.21.15.120:0/1415502831 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f41740a32d0 0x7f41740a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:15.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.407+0000 7f417ffff640 1 --2- 172.21.15.120:0/1415502831 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f41740a32d0 0x7f41740a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:15.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.407+0000 7f4185ffb640 1 -- 172.21.15.120:0/1415502831 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f41780d1790 con 0x7f4188100e20 2024-09-19T05:18:15.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.407+0000 7f4185ffb640 1 --2- 172.21.15.120:0/1415502831 >> [v2:172.21.15.194:6808/2631415468,v1:172.21.15.194:6809/2631415468] conn(0x7f41740acf80 0x7f41740af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:15.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.407+0000 7f4185ffb640 1 -- 172.21.15.120:0/1415502831 --> [v2:172.21.15.194:6808/2631415468,v1:172.21.15.194:6809/2631415468] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f41740afaf0 con 0x7f41740acf80 2024-09-19T05:18:15.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.407+0000 7f4185ffb640 1 -- 172.21.15.120:0/1415502831 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f41780d1be0 con 0x7f4188100e20 2024-09-19T05:18:15.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.407+0000 7f417ffff640 1 --2- 172.21.15.120:0/1415502831 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f41740a32d0 0x7f41740a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f41880ffe90 tx=0x7f4170008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:15.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.408+0000 7f418cff3640 1 --2- 172.21.15.120:0/1415502831 >> [v2:172.21.15.194:6808/2631415468,v1:172.21.15.194:6809/2631415468] conn(0x7f41740acf80 0x7f41740af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:15.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.408+0000 7f418cff3640 1 --2- 172.21.15.120:0/1415502831 >> [v2:172.21.15.194:6808/2631415468,v1:172.21.15.194:6809/2631415468] conn(0x7f41740acf80 0x7f41740af420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:15.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.409+0000 7f4185ffb640 1 -- 172.21.15.120:0/1415502831 <== osd.5 v2:172.21.15.194:6808/2631415468 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f41740afaf0 con 0x7f41740acf80 2024-09-19T05:18:15.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.422+0000 7f418ea56640 1 -- 172.21.15.120:0/1415502831 --> [v2:172.21.15.194:6808/2631415468,v1:172.21.15.194:6809/2631415468] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f418806a9a0 con 0x7f41740acf80 2024-09-19T05:18:15.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.422+0000 7f4185ffb640 1 -- 172.21.15.120:0/1415502831 <== osd.5 v2:172.21.15.194:6808/2631415468 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f418806a9a0 con 0x7f41740acf80 2024-09-19T05:18:15.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.423+0000 7f418ea56640 1 -- 172.21.15.120:0/1415502831 >> [v2:172.21.15.194:6808/2631415468,v1:172.21.15.194:6809/2631415468] conn(0x7f41740acf80 msgr2=0x7f41740af420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:15.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.423+0000 7f418ea56640 1 --2- 172.21.15.120:0/1415502831 >> [v2:172.21.15.194:6808/2631415468,v1:172.21.15.194:6809/2631415468] conn(0x7f41740acf80 0x7f41740af420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:15.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.423+0000 7f418ea56640 1 -- 172.21.15.120:0/1415502831 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f41740a32d0 msgr2=0x7f41740a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:15.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.423+0000 7f418ea56640 1 --2- 172.21.15.120:0/1415502831 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f41740a32d0 0x7f41740a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f41880ffe90 tx=0x7f4170008040 comp rx=0 tx=0).stop 2024-09-19T05:18:15.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.423+0000 7f418ea56640 1 -- 172.21.15.120:0/1415502831 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4188100e20 msgr2=0x7f41881973b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:15.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.423+0000 7f418ea56640 1 --2- 172.21.15.120:0/1415502831 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4188100e20 0x7f41881973b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4178009970 tx=0x7f4178009e30 comp rx=0 tx=0).stop 2024-09-19T05:18:15.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.423+0000 7f418cff3640 1 -- 172.21.15.120:0/1415502831 reap_dead start 2024-09-19T05:18:15.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.423+0000 7f418ea56640 1 -- 172.21.15.120:0/1415502831 shutdown_connections 2024-09-19T05:18:15.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.423+0000 7f418ea56640 1 -- 172.21.15.120:0/1415502831 >> 172.21.15.120:0/1415502831 conn(0x7f41880fc7d0 msgr2=0x7f41880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:15.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.423+0000 7f418ea56640 1 -- 172.21.15.120:0/1415502831 shutdown_connections 2024-09-19T05:18:15.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.423+0000 7f418ea56640 1 -- 172.21.15.120:0/1415502831 wait complete. 2024-09-19T05:18:15.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:15 smithi194 ceph-mon[35228]: pgmap v295: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T05:18:15.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:15 smithi178 ceph-mon[34347]: pgmap v295: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T05:18:15.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.717+0000 7f624c470640 1 -- 172.21.15.120:0/962925363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6244102ef0 msgr2=0x7f624410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:15.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.717+0000 7f624c470640 1 --2- 172.21.15.120:0/962925363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6244102ef0 0x7f624410da40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f623c009ca0 tx=0x7f623c02a950 comp rx=0 tx=0).stop 2024-09-19T05:18:15.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.717+0000 7f624c470640 1 -- 172.21.15.120:0/962925363 shutdown_connections 2024-09-19T05:18:15.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.717+0000 7f624c470640 1 --2- 172.21.15.120:0/962925363 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6244102ef0 0x7f624410da40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:15.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.717+0000 7f624c470640 1 --2- 172.21.15.120:0/962925363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6244102570 0x7f62441029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:15.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.717+0000 7f624c470640 1 --2- 172.21.15.120:0/962925363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6244100e20 0x7f6244101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:15.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.717+0000 7f624c470640 1 -- 172.21.15.120:0/962925363 >> 172.21.15.120:0/962925363 conn(0x7f62440fc7d0 msgr2=0x7f62440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:15.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.717+0000 7f624c470640 1 -- 172.21.15.120:0/962925363 shutdown_connections 2024-09-19T05:18:15.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.717+0000 7f624c470640 1 -- 172.21.15.120:0/962925363 wait complete. 2024-09-19T05:18:15.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.717+0000 7f624c470640 1 Processor -- start 2024-09-19T05:18:15.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.717+0000 7f624c470640 1 -- start start 2024-09-19T05:18:15.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.717+0000 7f624c470640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6244100e20 0x7f62441984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:15.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.718+0000 7f624c470640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6244102570 0x7f62441989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:15.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.718+0000 7f624c470640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6244102ef0 0x7f624419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:15.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.718+0000 7f624c470640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6244111f50 con 0x7f6244100e20 2024-09-19T05:18:15.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.718+0000 7f624c470640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6244111dd0 con 0x7f6244102570 2024-09-19T05:18:15.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.718+0000 7f624c470640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f62441120d0 con 0x7f6244102ef0 2024-09-19T05:18:15.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.718+0000 7f624a20c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6244100e20 0x7f62441984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:15.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.718+0000 7f624a20c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6244100e20 0x7f62441984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43822/0 (socket says 172.21.15.120:43822) 2024-09-19T05:18:15.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.718+0000 7f624a20c640 1 -- 172.21.15.120:0/3443127341 learned_addr learned my addr 172.21.15.120:0/3443127341 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:15.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.718+0000 7f624aa0d640 1 --2- 172.21.15.120:0/3443127341 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6244102ef0 0x7f624419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:15.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.718+0000 7f6249a0b640 1 --2- 172.21.15.120:0/3443127341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6244102570 0x7f62441989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:15.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.718+0000 7f624a20c640 1 -- 172.21.15.120:0/3443127341 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6244102ef0 msgr2=0x7f624419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:15.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.718+0000 7f624a20c640 1 --2- 172.21.15.120:0/3443127341 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6244102ef0 0x7f624419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:15.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.718+0000 7f624a20c640 1 -- 172.21.15.120:0/3443127341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6244102570 msgr2=0x7f62441989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:15.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.718+0000 7f624a20c640 1 --2- 172.21.15.120:0/3443127341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6244102570 0x7f62441989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:15.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.718+0000 7f624a20c640 1 -- 172.21.15.120:0/3443127341 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624419d460 con 0x7f6244100e20 2024-09-19T05:18:15.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.718+0000 7f624aa0d640 1 --2- 172.21.15.120:0/3443127341 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6244102ef0 0x7f624419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:15.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.718+0000 7f6249a0b640 1 --2- 172.21.15.120:0/3443127341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6244102570 0x7f62441989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:15.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.718+0000 7f624a20c640 1 --2- 172.21.15.120:0/3443127341 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6244100e20 0x7f62441984b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f624000d770 tx=0x7f624000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:15.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.718+0000 7f623b7fe640 1 -- 172.21.15.120:0/3443127341 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6240017070 con 0x7f6244100e20 2024-09-19T05:18:15.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.718+0000 7f623b7fe640 1 -- 172.21.15.120:0/3443127341 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f62400054d0 con 0x7f6244100e20 2024-09-19T05:18:15.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.718+0000 7f624c470640 1 -- 172.21.15.120:0/3443127341 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f624419d750 con 0x7f6244100e20 2024-09-19T05:18:15.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.718+0000 7f623b7fe640 1 -- 172.21.15.120:0/3443127341 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6240004cf0 con 0x7f6244100e20 2024-09-19T05:18:15.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.718+0000 7f624c470640 1 -- 172.21.15.120:0/3443127341 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62441a5030 con 0x7f6244100e20 2024-09-19T05:18:15.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.719+0000 7f624c470640 1 -- 172.21.15.120:0/3443127341 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6244062900 con 0x7f6244100e20 2024-09-19T05:18:15.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.721+0000 7f623b7fe640 1 -- 172.21.15.120:0/3443127341 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f6240004e90 con 0x7f6244100e20 2024-09-19T05:18:15.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.721+0000 7f623b7fe640 1 --2- 172.21.15.120:0/3443127341 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f62300a3350 0x7f62300a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:15.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.721+0000 7f623b7fe640 1 -- 172.21.15.120:0/3443127341 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f62400cf980 con 0x7f6244100e20 2024-09-19T05:18:15.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.721+0000 7f6249a0b640 1 --2- 172.21.15.120:0/3443127341 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f62300a3350 0x7f62300a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:15.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.721+0000 7f623b7fe640 1 --2- 172.21.15.120:0/3443127341 >> [v2:172.21.15.178:6816/1912109177,v1:172.21.15.178:6817/1912109177] conn(0x7f62300ad000 0x7f62300af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:15.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.721+0000 7f623b7fe640 1 -- 172.21.15.120:0/3443127341 --> [v2:172.21.15.178:6816/1912109177,v1:172.21.15.178:6817/1912109177] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6240001d30 con 0x7f62300ad000 2024-09-19T05:18:15.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.721+0000 7f623b7fe640 1 -- 172.21.15.120:0/3443127341 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f62400cfdd0 con 0x7f6244100e20 2024-09-19T05:18:15.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.722+0000 7f6249a0b640 1 --2- 172.21.15.120:0/3443127341 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f62300a3350 0x7f62300a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f62440ffe90 tx=0x7f6234005cb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:15.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.722+0000 7f624aa0d640 1 --2- 172.21.15.120:0/3443127341 >> [v2:172.21.15.178:6816/1912109177,v1:172.21.15.178:6817/1912109177] conn(0x7f62300ad000 0x7f62300af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:15.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.722+0000 7f624aa0d640 1 --2- 172.21.15.120:0/3443127341 >> [v2:172.21.15.178:6816/1912109177,v1:172.21.15.178:6817/1912109177] conn(0x7f62300ad000 0x7f62300af4a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:15.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.723+0000 7f623b7fe640 1 -- 172.21.15.120:0/3443127341 <== osd.7 v2:172.21.15.178:6816/1912109177 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6240001d30 con 0x7f62300ad000 2024-09-19T05:18:15.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.736+0000 7f624c470640 1 -- 172.21.15.120:0/3443127341 --> [v2:172.21.15.178:6816/1912109177,v1:172.21.15.178:6817/1912109177] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6244062d00 con 0x7f62300ad000 2024-09-19T05:18:15.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.737+0000 7f623b7fe640 1 -- 172.21.15.120:0/3443127341 <== osd.7 v2:172.21.15.178:6816/1912109177 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6244062d00 con 0x7f62300ad000 2024-09-19T05:18:15.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.738+0000 7f624c470640 1 -- 172.21.15.120:0/3443127341 >> [v2:172.21.15.178:6816/1912109177,v1:172.21.15.178:6817/1912109177] conn(0x7f62300ad000 msgr2=0x7f62300af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:15.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.738+0000 7f624c470640 1 --2- 172.21.15.120:0/3443127341 >> [v2:172.21.15.178:6816/1912109177,v1:172.21.15.178:6817/1912109177] conn(0x7f62300ad000 0x7f62300af4a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:15.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.738+0000 7f624c470640 1 -- 172.21.15.120:0/3443127341 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f62300a3350 msgr2=0x7f62300a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:15.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.738+0000 7f624c470640 1 --2- 172.21.15.120:0/3443127341 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f62300a3350 0x7f62300a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f62440ffe90 tx=0x7f6234005cb0 comp rx=0 tx=0).stop 2024-09-19T05:18:15.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.738+0000 7f624c470640 1 -- 172.21.15.120:0/3443127341 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6244100e20 msgr2=0x7f62441984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:15.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.738+0000 7f624c470640 1 --2- 172.21.15.120:0/3443127341 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6244100e20 0x7f62441984b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f624000d770 tx=0x7f624000dc30 comp rx=0 tx=0).stop 2024-09-19T05:18:15.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.738+0000 7f624aa0d640 1 -- 172.21.15.120:0/3443127341 reap_dead start 2024-09-19T05:18:15.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.738+0000 7f624c470640 1 -- 172.21.15.120:0/3443127341 shutdown_connections 2024-09-19T05:18:15.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.738+0000 7f624c470640 1 -- 172.21.15.120:0/3443127341 >> 172.21.15.120:0/3443127341 conn(0x7f62440fc7d0 msgr2=0x7f62440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:15.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.738+0000 7f624c470640 1 -- 172.21.15.120:0/3443127341 shutdown_connections 2024-09-19T05:18:15.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.738+0000 7f624c470640 1 -- 172.21.15.120:0/3443127341 wait complete. 2024-09-19T05:18:15.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.281+0000 7f3d76d81640 1 -- 172.21.15.120:0/82491279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d70106a80 msgr2=0x7f3d70106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:15.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.281+0000 7f3d76d81640 1 --2- 172.21.15.120:0/82491279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d70106a80 0x7f3d70106e60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009930 tx=0x7f3d6c02a420 comp rx=0 tx=0).stop 2024-09-19T05:18:15.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.281+0000 7f3d76d81640 1 -- 172.21.15.120:0/82491279 shutdown_connections 2024-09-19T05:18:15.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.281+0000 7f3d76d81640 1 --2- 172.21.15.120:0/82491279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d70101420 0x7f3d7010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:15.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.281+0000 7f3d76d81640 1 --2- 172.21.15.120:0/82491279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d70100a80 0x7f3d70100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:15.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.281+0000 7f3d76d81640 1 --2- 172.21.15.120:0/82491279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d70106a80 0x7f3d70106e60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:15.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.281+0000 7f3d76d81640 1 -- 172.21.15.120:0/82491279 >> 172.21.15.120:0/82491279 conn(0x7f3d700fc7a0 msgr2=0x7f3d700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:15.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.281+0000 7f3d76d81640 1 -- 172.21.15.120:0/82491279 shutdown_connections 2024-09-19T05:18:15.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.281+0000 7f3d76d81640 1 -- 172.21.15.120:0/82491279 wait complete. 2024-09-19T05:18:15.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.281+0000 7f3d76d81640 1 Processor -- start 2024-09-19T05:18:15.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.282+0000 7f3d76d81640 1 -- start start 2024-09-19T05:18:15.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.282+0000 7f3d76d81640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d70100a80 0x7f3d701972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:15.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.282+0000 7f3d76d81640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d70101420 0x7f3d70197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:15.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.282+0000 7f3d76d81640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d70106a80 0x7f3d7019bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:15.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.282+0000 7f3d76d81640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3d70110d50 con 0x7f3d70101420 2024-09-19T05:18:15.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.282+0000 7f3d76d81640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3d70110bd0 con 0x7f3d70106a80 2024-09-19T05:18:15.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.282+0000 7f3d76d81640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3d70110ed0 con 0x7f3d70100a80 2024-09-19T05:18:15.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.282+0000 7f3d67fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d70101420 0x7f3d70197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:15.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.282+0000 7f3d67fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d70101420 0x7f3d70197800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43788/0 (socket says 172.21.15.120:43788) 2024-09-19T05:18:15.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.282+0000 7f3d67fff640 1 -- 172.21.15.120:0/4157237862 learned_addr learned my addr 172.21.15.120:0/4157237862 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:15.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.282+0000 7f3d74b1d640 1 --2- 172.21.15.120:0/4157237862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d70100a80 0x7f3d701972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:15.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.282+0000 7f3d7531e640 1 --2- 172.21.15.120:0/4157237862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d70106a80 0x7f3d7019bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:15.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.282+0000 7f3d67fff640 1 -- 172.21.15.120:0/4157237862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d70100a80 msgr2=0x7f3d701972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:15.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.282+0000 7f3d67fff640 1 --2- 172.21.15.120:0/4157237862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d70100a80 0x7f3d701972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:15.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.282+0000 7f3d67fff640 1 -- 172.21.15.120:0/4157237862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d70106a80 msgr2=0x7f3d7019bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:15.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.282+0000 7f3d67fff640 1 --2- 172.21.15.120:0/4157237862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d70106a80 0x7f3d7019bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:15.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.282+0000 7f3d67fff640 1 -- 172.21.15.120:0/4157237862 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7019c270 con 0x7f3d70101420 2024-09-19T05:18:15.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.282+0000 7f3d7531e640 1 --2- 172.21.15.120:0/4157237862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d70106a80 0x7f3d7019bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:18:15.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.282+0000 7f3d67fff640 1 --2- 172.21.15.120:0/4157237862 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d70101420 0x7f3d70197800 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3d6000d950 tx=0x7f3d6000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:15.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.283+0000 7f3d65ffb640 1 -- 172.21.15.120:0/4157237862 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d60017070 con 0x7f3d70101420 2024-09-19T05:18:15.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.283+0000 7f3d65ffb640 1 -- 172.21.15.120:0/4157237862 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3d60009c30 con 0x7f3d70101420 2024-09-19T05:18:15.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.283+0000 7f3d65ffb640 1 -- 172.21.15.120:0/4157237862 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6000f620 con 0x7f3d70101420 2024-09-19T05:18:15.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.283+0000 7f3d76d81640 1 -- 172.21.15.120:0/4157237862 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d7019c560 con 0x7f3d70101420 2024-09-19T05:18:15.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.283+0000 7f3d76d81640 1 -- 172.21.15.120:0/4157237862 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d701a3e40 con 0x7f3d70101420 2024-09-19T05:18:15.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.284+0000 7f3d76d81640 1 -- 172.21.15.120:0/4157237862 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3d70062980 con 0x7f3d70101420 2024-09-19T05:18:15.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.285+0000 7f3d65ffb640 1 -- 172.21.15.120:0/4157237862 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f3d600109a0 con 0x7f3d70101420 2024-09-19T05:18:15.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.285+0000 7f3d65ffb640 1 --2- 172.21.15.120:0/4157237862 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3d580a3350 0x7f3d580a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:15.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.286+0000 7f3d74b1d640 1 --2- 172.21.15.120:0/4157237862 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3d580a3350 0x7f3d580a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:15.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.286+0000 7f3d65ffb640 1 -- 172.21.15.120:0/4157237862 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f3d600cfa40 con 0x7f3d70101420 2024-09-19T05:18:15.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.286+0000 7f3d65ffb640 1 --2- 172.21.15.120:0/4157237862 >> [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976] conn(0x7f3d580ad000 0x7f3d580af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:15.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.286+0000 7f3d65ffb640 1 -- 172.21.15.120:0/4157237862 --> [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d60005600 con 0x7f3d580ad000 2024-09-19T05:18:15.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.286+0000 7f3d65ffb640 1 -- 172.21.15.120:0/4157237862 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f3d600cfe90 con 0x7f3d70101420 2024-09-19T05:18:15.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.286+0000 7f3d74b1d640 1 --2- 172.21.15.120:0/4157237862 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3d580a3350 0x7f3d580a5810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009900 tx=0x7f3d6c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:15.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.286+0000 7f3d7531e640 1 --2- 172.21.15.120:0/4157237862 >> [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976] conn(0x7f3d580ad000 0x7f3d580af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:15.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.286+0000 7f3d7531e640 1 --2- 172.21.15.120:0/4157237862 >> [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976] conn(0x7f3d580ad000 0x7f3d580af4a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:15.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.287+0000 7f3d65ffb640 1 -- 172.21.15.120:0/4157237862 <== osd.6 v2:172.21.15.120:6818/388238976 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3d60005600 con 0x7f3d580ad000 2024-09-19T05:18:15.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.300+0000 7f3d76d81640 1 -- 172.21.15.120:0/4157237862 --> [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3d70062d80 con 0x7f3d580ad000 2024-09-19T05:18:15.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.301+0000 7f3d65ffb640 1 -- 172.21.15.120:0/4157237862 <== osd.6 v2:172.21.15.120:6818/388238976 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3d70062d80 con 0x7f3d580ad000 2024-09-19T05:18:15.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.301+0000 7f3d76d81640 1 -- 172.21.15.120:0/4157237862 >> [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976] conn(0x7f3d580ad000 msgr2=0x7f3d580af4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:15.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.301+0000 7f3d76d81640 1 --2- 172.21.15.120:0/4157237862 >> [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976] conn(0x7f3d580ad000 0x7f3d580af4a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:15.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.301+0000 7f3d76d81640 1 -- 172.21.15.120:0/4157237862 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3d580a3350 msgr2=0x7f3d580a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:15.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.301+0000 7f3d76d81640 1 --2- 172.21.15.120:0/4157237862 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3d580a3350 0x7f3d580a5810 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c009900 tx=0x7f3d6c000bc0 comp rx=0 tx=0).stop 2024-09-19T05:18:15.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.301+0000 7f3d76d81640 1 -- 172.21.15.120:0/4157237862 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d70101420 msgr2=0x7f3d70197800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:15.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.301+0000 7f3d76d81640 1 --2- 172.21.15.120:0/4157237862 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3d70101420 0x7f3d70197800 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3d6000d950 tx=0x7f3d6000de10 comp rx=0 tx=0).stop 2024-09-19T05:18:15.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.301+0000 7f3d7531e640 1 -- 172.21.15.120:0/4157237862 reap_dead start 2024-09-19T05:18:15.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.301+0000 7f3d76d81640 1 -- 172.21.15.120:0/4157237862 shutdown_connections 2024-09-19T05:18:15.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.301+0000 7f3d76d81640 1 -- 172.21.15.120:0/4157237862 >> 172.21.15.120:0/4157237862 conn(0x7f3d700fc7a0 msgr2=0x7f3d700fe0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:15.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.301+0000 7f3d76d81640 1 -- 172.21.15.120:0/4157237862 shutdown_connections 2024-09-19T05:18:15.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:15.301+0000 7f3d76d81640 1 -- 172.21.15.120:0/4157237862 wait complete. 2024-09-19T05:18:16.844 INFO:teuthology.orchestra.run.smithi120.stdout:188978561070 2024-09-19T05:18:16.845 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T05:18:17.597 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:17 smithi120 ceph-mon[30956]: pgmap v296: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T05:18:17.624 INFO:teuthology.orchestra.run.smithi120.stdout:240518168612 2024-09-19T05:18:17.624 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T05:18:17.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:17 smithi194 ceph-mon[35228]: pgmap v296: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T05:18:17.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:17 smithi178 ceph-mon[34347]: pgmap v296: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T05:18:18.100 INFO:teuthology.orchestra.run.smithi120.stdout:210453397545 2024-09-19T05:18:18.100 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T05:18:18.592 INFO:teuthology.orchestra.run.smithi120.stdout:158913790003 2024-09-19T05:18:18.592 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T05:18:18.619 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:18.620 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:18.687 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:18.691 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:18.692 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:18.695 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:19.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.254+0000 7fcead3eb640 1 -- 172.21.15.120:0/2040373586 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcea8100100 msgr2=0x7fcea8100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.254+0000 7fcead3eb640 1 --2- 172.21.15.120:0/2040373586 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcea8100100 0x7fcea8100560 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fce90009900 tx=0x7fce9002a400 comp rx=0 tx=0).stop 2024-09-19T05:18:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.254+0000 7fcead3eb640 1 -- 172.21.15.120:0/2040373586 shutdown_connections 2024-09-19T05:18:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.254+0000 7fcead3eb640 1 --2- 172.21.15.120:0/2040373586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcea8100aa0 0x7fcea810ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.254+0000 7fcead3eb640 1 --2- 172.21.15.120:0/2040373586 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcea8100100 0x7fcea8100560 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.254+0000 7fcead3eb640 1 --2- 172.21.15.120:0/2040373586 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcea8106b80 0x7fcea8106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.254+0000 7fcead3eb640 1 -- 172.21.15.120:0/2040373586 >> 172.21.15.120:0/2040373586 conn(0x7fcea8077230 msgr2=0x7fcea80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.254+0000 7fcead3eb640 1 -- 172.21.15.120:0/2040373586 shutdown_connections 2024-09-19T05:18:19.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.254+0000 7fcead3eb640 1 -- 172.21.15.120:0/2040373586 wait complete. 2024-09-19T05:18:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.255+0000 7fcead3eb640 1 Processor -- start 2024-09-19T05:18:19.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.256+0000 7fcead3eb640 1 -- start start 2024-09-19T05:18:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.256+0000 7fcead3eb640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcea8100100 0x7fcea8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.256+0000 7fcead3eb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcea8100aa0 0x7fcea8198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.256+0000 7fcead3eb640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcea8106b80 0x7fcea819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.256+0000 7fcead3eb640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcea8111f10 con 0x7fcea8100aa0 2024-09-19T05:18:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.256+0000 7fcead3eb640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fcea8111d90 con 0x7fcea8100100 2024-09-19T05:18:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.256+0000 7fcead3eb640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcea8112090 con 0x7fcea8106b80 2024-09-19T05:18:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.256+0000 7fce9ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcea8100aa0 0x7fcea8198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.256+0000 7fce9ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcea8100aa0 0x7fcea8198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43842/0 (socket says 172.21.15.120:43842) 2024-09-19T05:18:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.256+0000 7fce9ffff640 1 -- 172.21.15.120:0/2822080011 learned_addr learned my addr 172.21.15.120:0/2822080011 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.256+0000 7fcea77fe640 1 --2- 172.21.15.120:0/2822080011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcea8106b80 0x7fcea819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.256+0000 7fcea6ffd640 1 --2- 172.21.15.120:0/2822080011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcea8100100 0x7fcea8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:19.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.257+0000 7fcea77fe640 1 -- 172.21.15.120:0/2822080011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcea8100100 msgr2=0x7fcea8198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.257+0000 7fcea77fe640 1 --2- 172.21.15.120:0/2822080011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcea8100100 0x7fcea8198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.257+0000 7fcea77fe640 1 -- 172.21.15.120:0/2822080011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcea8100aa0 msgr2=0x7fcea8198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.257+0000 7fcea77fe640 1 --2- 172.21.15.120:0/2822080011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcea8100aa0 0x7fcea8198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.257+0000 7fcea77fe640 1 -- 172.21.15.120:0/2822080011 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea819d400 con 0x7fcea8106b80 2024-09-19T05:18:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.257+0000 7fcea6ffd640 1 --2- 172.21.15.120:0/2822080011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcea8100100 0x7fcea8198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:18:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.257+0000 7fcea77fe640 1 --2- 172.21.15.120:0/2822080011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcea8106b80 0x7fcea819cd20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcea0005fd0 tx=0x7fcea000edd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.257+0000 7fcea4ff9640 1 -- 172.21.15.120:0/2822080011 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea0004d20 con 0x7fcea8106b80 2024-09-19T05:18:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.257+0000 7fcea4ff9640 1 -- 172.21.15.120:0/2822080011 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcea0005020 con 0x7fcea8106b80 2024-09-19T05:18:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.257+0000 7fcea4ff9640 1 -- 172.21.15.120:0/2822080011 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea00116b0 con 0x7fcea8106b80 2024-09-19T05:18:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.257+0000 7fcead3eb640 1 -- 172.21.15.120:0/2822080011 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcea819d6f0 con 0x7fcea8106b80 2024-09-19T05:18:19.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.258+0000 7fcead3eb640 1 -- 172.21.15.120:0/2822080011 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcea8101210 con 0x7fcea8106b80 2024-09-19T05:18:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.259+0000 7fcead3eb640 1 -- 172.21.15.120:0/2822080011 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcea8100560 con 0x7fcea8106b80 2024-09-19T05:18:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.260+0000 7fcea4ff9640 1 -- 172.21.15.120:0/2822080011 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fcea000cb20 con 0x7fcea8106b80 2024-09-19T05:18:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.261+0000 7fcea4ff9640 1 --2- 172.21.15.120:0/2822080011 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fce940a32d0 0x7fce940a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.261+0000 7fcea6ffd640 1 --2- 172.21.15.120:0/2822080011 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fce940a32d0 0x7fce940a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.261+0000 7fcea4ff9640 1 -- 172.21.15.120:0/2822080011 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fcea00cfbf0 con 0x7fcea8106b80 2024-09-19T05:18:19.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.261+0000 7fcea6ffd640 1 --2- 172.21.15.120:0/2822080011 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fce940a32d0 0x7fce940a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fce98009fc0 tx=0x7fce98005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:19.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.265+0000 7fcea4ff9640 1 -- 172.21.15.120:0/2822080011 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcea0016030 con 0x7fcea8106b80 2024-09-19T05:18:19.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.440+0000 7fcead3eb640 1 -- 172.21.15.120:0/2822080011 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fcea8109b50 con 0x7fcea8106b80 2024-09-19T05:18:19.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.441+0000 7fcea4ff9640 1 -- 172.21.15.120:0/2822080011 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcea009c790 con 0x7fcea8106b80 2024-09-19T05:18:19.443 INFO:teuthology.orchestra.run.smithi120.stdout:51539607624 2024-09-19T05:18:19.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.443+0000 7fcead3eb640 1 -- 172.21.15.120:0/2822080011 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fce940a32d0 msgr2=0x7fce940a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:19.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.443+0000 7fcead3eb640 1 --2- 172.21.15.120:0/2822080011 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fce940a32d0 0x7fce940a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fce98009fc0 tx=0x7fce98005f90 comp rx=0 tx=0).stop 2024-09-19T05:18:19.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.443+0000 7fcead3eb640 1 -- 172.21.15.120:0/2822080011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcea8106b80 msgr2=0x7fcea819cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:19.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.443+0000 7fcead3eb640 1 --2- 172.21.15.120:0/2822080011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcea8106b80 0x7fcea819cd20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcea0005fd0 tx=0x7fcea000edd0 comp rx=0 tx=0).stop 2024-09-19T05:18:19.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.443+0000 7fcead3eb640 1 -- 172.21.15.120:0/2822080011 shutdown_connections 2024-09-19T05:18:19.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.443+0000 7fcead3eb640 1 --2- 172.21.15.120:0/2822080011 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fce940a32d0 0x7fce940a5790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:19.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.443+0000 7fcead3eb640 1 --2- 172.21.15.120:0/2822080011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcea8106b80 0x7fcea819cd20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:19.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.443+0000 7fcead3eb640 1 --2- 172.21.15.120:0/2822080011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcea8100aa0 0x7fcea8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:19.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.443+0000 7fcead3eb640 1 --2- 172.21.15.120:0/2822080011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcea8100100 0x7fcea8198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:19.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.443+0000 7fcead3eb640 1 -- 172.21.15.120:0/2822080011 >> 172.21.15.120:0/2822080011 conn(0x7fcea8077230 msgr2=0x7fcea8104de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:19.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.443+0000 7fcead3eb640 1 -- 172.21.15.120:0/2822080011 shutdown_connections 2024-09-19T05:18:19.446 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.443+0000 7fcead3eb640 1 -- 172.21.15.120:0/2822080011 wait complete. 2024-09-19T05:18:19.512 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:19 smithi120 ceph-mon[30956]: pgmap v297: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T05:18:19.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:19 smithi194 ceph-mon[35228]: pgmap v297: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T05:18:19.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:19 smithi178 ceph-mon[34347]: pgmap v297: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T05:18:19.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.905+0000 7f6b10b73640 1 -- 172.21.15.120:0/3620333553 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b0c101420 msgr2=0x7f6b0c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:19.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.905+0000 7f6b10b73640 1 --2- 172.21.15.120:0/3620333553 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b0c101420 0x7f6b0c10d950 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6b04009cd0 tx=0x7f6b0402a8e0 comp rx=0 tx=0).stop 2024-09-19T05:18:19.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.905+0000 7f6b10b73640 1 -- 172.21.15.120:0/3620333553 shutdown_connections 2024-09-19T05:18:19.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.905+0000 7f6b10b73640 1 --2- 172.21.15.120:0/3620333553 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b0c101420 0x7f6b0c10d950 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:19.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.905+0000 7f6b10b73640 1 --2- 172.21.15.120:0/3620333553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b0c100a80 0x7f6b0c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:19.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.905+0000 7f6b10b73640 1 --2- 172.21.15.120:0/3620333553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b0c106a80 0x7f6b0c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:19.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.905+0000 7f6b10b73640 1 -- 172.21.15.120:0/3620333553 >> 172.21.15.120:0/3620333553 conn(0x7f6b0c0fc7a0 msgr2=0x7f6b0c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:19.928 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.905+0000 7f6b10b73640 1 -- 172.21.15.120:0/3620333553 shutdown_connections 2024-09-19T05:18:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.905+0000 7f6b10b73640 1 -- 172.21.15.120:0/3620333553 wait complete. 2024-09-19T05:18:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.906+0000 7f6b10b73640 1 Processor -- start 2024-09-19T05:18:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.906+0000 7f6b10b73640 1 -- start start 2024-09-19T05:18:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.906+0000 7f6b10b73640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b0c100a80 0x7f6b0c1991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.906+0000 7f6b10b73640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b0c101420 0x7f6b0c199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.906+0000 7f6b10b73640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b0c106a80 0x7f6b0c1a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.906+0000 7f6b10b73640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c110d30 con 0x7f6b0c106a80 2024-09-19T05:18:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.906+0000 7f6b10b73640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c110bb0 con 0x7f6b0c100a80 2024-09-19T05:18:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.906+0000 7f6b10b73640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c110eb0 con 0x7f6b0c101420 2024-09-19T05:18:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.906+0000 7f6b0ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b0c106a80 0x7f6b0c1a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.906+0000 7f6b0ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b0c106a80 0x7f6b0c1a4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43864/0 (socket says 172.21.15.120:43864) 2024-09-19T05:18:19.929 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.906+0000 7f6b0ad9d640 1 -- 172.21.15.120:0/3748718569 learned_addr learned my addr 172.21.15.120:0/3748718569 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.906+0000 7f6b03fff640 1 --2- 172.21.15.120:0/3748718569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b0c101420 0x7f6b0c199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.906+0000 7f6b0a59c640 1 --2- 172.21.15.120:0/3748718569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b0c100a80 0x7f6b0c1991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.907+0000 7f6b0ad9d640 1 -- 172.21.15.120:0/3748718569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b0c101420 msgr2=0x7f6b0c199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.907+0000 7f6b0ad9d640 1 --2- 172.21.15.120:0/3748718569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b0c101420 0x7f6b0c199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.907+0000 7f6b0ad9d640 1 -- 172.21.15.120:0/3748718569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b0c100a80 msgr2=0x7f6b0c1991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.907+0000 7f6b0ad9d640 1 --2- 172.21.15.120:0/3748718569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b0c100a80 0x7f6b0c1991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.907+0000 7f6b0ad9d640 1 -- 172.21.15.120:0/3748718569 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0c1a4780 con 0x7f6b0c106a80 2024-09-19T05:18:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.907+0000 7f6b0a59c640 1 --2- 172.21.15.120:0/3748718569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b0c100a80 0x7f6b0c1991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.907+0000 7f6b03fff640 1 --2- 172.21.15.120:0/3748718569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b0c101420 0x7f6b0c199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:18:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.907+0000 7f6b0ad9d640 1 --2- 172.21.15.120:0/3748718569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b0c106a80 0x7f6b0c1a4240 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6b04005cc0 tx=0x7f6b04003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.907+0000 7f6b037fe640 1 -- 172.21.15.120:0/3748718569 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b04004450 con 0x7f6b0c106a80 2024-09-19T05:18:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.907+0000 7f6b037fe640 1 -- 172.21.15.120:0/3748718569 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6b04031c90 con 0x7f6b0c106a80 2024-09-19T05:18:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.907+0000 7f6b10b73640 1 -- 172.21.15.120:0/3748718569 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b0c1a4950 con 0x7f6b0c106a80 2024-09-19T05:18:19.930 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.907+0000 7f6b037fe640 1 -- 172.21.15.120:0/3748718569 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b0403b400 con 0x7f6b0c106a80 2024-09-19T05:18:19.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.907+0000 7f6b10b73640 1 -- 172.21.15.120:0/3748718569 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b0c1a4e00 con 0x7f6b0c106a80 2024-09-19T05:18:19.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.908+0000 7f6b10b73640 1 -- 172.21.15.120:0/3748718569 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b0c100ee0 con 0x7f6b0c106a80 2024-09-19T05:18:19.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.909+0000 7f6b037fe640 1 -- 172.21.15.120:0/3748718569 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f6b04004680 con 0x7f6b0c106a80 2024-09-19T05:18:19.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.910+0000 7f6b037fe640 1 --2- 172.21.15.120:0/3748718569 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f6af80a32d0 0x7f6af80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:19.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.910+0000 7f6b0a59c640 1 --2- 172.21.15.120:0/3748718569 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f6af80a32d0 0x7f6af80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:19.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.910+0000 7f6b037fe640 1 -- 172.21.15.120:0/3748718569 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f6b0402e030 con 0x7f6b0c106a80 2024-09-19T05:18:19.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.910+0000 7f6b0a59c640 1 --2- 172.21.15.120:0/3748718569 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f6af80a32d0 0x7f6af80a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6afc0058c0 tx=0x7f6afc005cb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:19.931 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:19.914+0000 7f6b037fe640 1 -- 172.21.15.120:0/3748718569 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6b040bd930 con 0x7f6b0c106a80 2024-09-19T05:18:20.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.086+0000 7f6b10b73640 1 -- 172.21.15.120:0/3748718569 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6b0c109010 con 0x7f6b0c106a80 2024-09-19T05:18:20.089 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.087+0000 7f6b037fe640 1 -- 172.21.15.120:0/3748718569 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6b040098b0 con 0x7f6b0c106a80 2024-09-19T05:18:20.089 INFO:teuthology.orchestra.run.smithi120.stdout:34359738445 2024-09-19T05:18:20.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.090+0000 7f6b10b73640 1 -- 172.21.15.120:0/3748718569 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f6af80a32d0 msgr2=0x7f6af80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:20.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.090+0000 7f6b10b73640 1 --2- 172.21.15.120:0/3748718569 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f6af80a32d0 0x7f6af80a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6afc0058c0 tx=0x7f6afc005cb0 comp rx=0 tx=0).stop 2024-09-19T05:18:20.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.090+0000 7f6b10b73640 1 -- 172.21.15.120:0/3748718569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b0c106a80 msgr2=0x7f6b0c1a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:20.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.090+0000 7f6b10b73640 1 --2- 172.21.15.120:0/3748718569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b0c106a80 0x7f6b0c1a4240 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6b04005cc0 tx=0x7f6b04003c20 comp rx=0 tx=0).stop 2024-09-19T05:18:20.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.090+0000 7f6b10b73640 1 -- 172.21.15.120:0/3748718569 shutdown_connections 2024-09-19T05:18:20.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.090+0000 7f6b10b73640 1 --2- 172.21.15.120:0/3748718569 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b0c106a80 0x7f6b0c1a4240 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:20.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.090+0000 7f6b10b73640 1 --2- 172.21.15.120:0/3748718569 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f6af80a32d0 0x7f6af80a5790 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:20.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.090+0000 7f6b10b73640 1 --2- 172.21.15.120:0/3748718569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b0c101420 0x7f6b0c199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:20.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.090+0000 7f6b10b73640 1 --2- 172.21.15.120:0/3748718569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b0c100a80 0x7f6b0c1991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:20.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.090+0000 7f6b10b73640 1 -- 172.21.15.120:0/3748718569 >> 172.21.15.120:0/3748718569 conn(0x7f6b0c0fc7a0 msgr2=0x7f6b0c0fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:20.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.090+0000 7f6b10b73640 1 -- 172.21.15.120:0/3748718569 shutdown_connections 2024-09-19T05:18:20.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.090+0000 7f6b10b73640 1 -- 172.21.15.120:0/3748718569 wait complete. 2024-09-19T05:18:20.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.119+0000 7f27c3931640 1 -- 172.21.15.120:0/3599280242 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27bc10eb10 msgr2=0x7f27bc10eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:20.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.119+0000 7f27c3931640 1 --2- 172.21.15.120:0/3599280242 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27bc10eb10 0x7f27bc10eef0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f27b8009900 tx=0x7f27b802a410 comp rx=0 tx=0).stop 2024-09-19T05:18:20.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.119+0000 7f27c3931640 1 -- 172.21.15.120:0/3599280242 shutdown_connections 2024-09-19T05:18:20.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.119+0000 7f27c3931640 1 --2- 172.21.15.120:0/3599280242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27bc109b90 0x7f27bc1158a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:20.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.119+0000 7f27c3931640 1 --2- 172.21.15.120:0/3599280242 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27bc1091f0 0x7f27bc109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:20.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.119+0000 7f27c3931640 1 --2- 172.21.15.120:0/3599280242 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27bc10eb10 0x7f27bc10eef0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:20.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.119+0000 7f27c3931640 1 -- 172.21.15.120:0/3599280242 >> 172.21.15.120:0/3599280242 conn(0x7f27bc06e2d0 msgr2=0x7f27bc06e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:20.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.119+0000 7f27c3931640 1 -- 172.21.15.120:0/3599280242 shutdown_connections 2024-09-19T05:18:20.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.119+0000 7f27c3931640 1 -- 172.21.15.120:0/3599280242 wait complete. 2024-09-19T05:18:20.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.120+0000 7f27c3931640 1 Processor -- start 2024-09-19T05:18:20.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.120+0000 7f27c3931640 1 -- start start 2024-09-19T05:18:20.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.120+0000 7f27c3931640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27bc1091f0 0x7f27bc10f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:20.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.120+0000 7f27c3931640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27bc109b90 0x7f27bc10fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:20.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.120+0000 7f27c3931640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27bc10eb10 0x7f27bc1103c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:20.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.120+0000 7f27c3931640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc118c90 con 0x7f27bc109b90 2024-09-19T05:18:20.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.120+0000 7f27c3931640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc118b10 con 0x7f27bc10eb10 2024-09-19T05:18:20.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.120+0000 7f27c3931640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f27bc118e10 con 0x7f27bc1091f0 2024-09-19T05:18:20.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.120+0000 7f27c0ecc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27bc109b90 0x7f27bc10fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:20.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.120+0000 7f27c0ecc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27bc109b90 0x7f27bc10fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43872/0 (socket says 172.21.15.120:43872) 2024-09-19T05:18:20.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.120+0000 7f27c0ecc640 1 -- 172.21.15.120:0/4041101636 learned_addr learned my addr 172.21.15.120:0/4041101636 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:20.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.120+0000 7f27c1ece640 1 --2- 172.21.15.120:0/4041101636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27bc10eb10 0x7f27bc1103c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:20.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.120+0000 7f27c16cd640 1 --2- 172.21.15.120:0/4041101636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27bc1091f0 0x7f27bc10f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:20.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.120+0000 7f27c0ecc640 1 -- 172.21.15.120:0/4041101636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27bc1091f0 msgr2=0x7f27bc10f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:20.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.120+0000 7f27c0ecc640 1 --2- 172.21.15.120:0/4041101636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27bc1091f0 0x7f27bc10f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:20.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.120+0000 7f27c0ecc640 1 -- 172.21.15.120:0/4041101636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27bc10eb10 msgr2=0x7f27bc1103c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:20.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.120+0000 7f27c0ecc640 1 --2- 172.21.15.120:0/4041101636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27bc10eb10 0x7f27bc1103c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:20.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.120+0000 7f27c0ecc640 1 -- 172.21.15.120:0/4041101636 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27bc1af020 con 0x7f27bc109b90 2024-09-19T05:18:20.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.121+0000 7f27c0ecc640 1 --2- 172.21.15.120:0/4041101636 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27bc109b90 0x7f27bc10fe80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00c890 tx=0x7f27ac00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:20.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.121+0000 7f27b27fc640 1 -- 172.21.15.120:0/4041101636 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac004220 con 0x7f27bc109b90 2024-09-19T05:18:20.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.121+0000 7f27b27fc640 1 -- 172.21.15.120:0/4041101636 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f27ac0043c0 con 0x7f27bc109b90 2024-09-19T05:18:20.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.121+0000 7f27c3931640 1 -- 172.21.15.120:0/4041101636 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27bc1af310 con 0x7f27bc109b90 2024-09-19T05:18:20.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.121+0000 7f27b27fc640 1 -- 172.21.15.120:0/4041101636 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ac004a00 con 0x7f27bc109b90 2024-09-19T05:18:20.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.121+0000 7f27c3931640 1 -- 172.21.15.120:0/4041101636 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27bc1af850 con 0x7f27bc109b90 2024-09-19T05:18:20.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.122+0000 7f27c3931640 1 -- 172.21.15.120:0/4041101636 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27bc10eef0 con 0x7f27bc109b90 2024-09-19T05:18:20.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.123+0000 7f27b27fc640 1 -- 172.21.15.120:0/4041101636 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f27ac004ba0 con 0x7f27bc109b90 2024-09-19T05:18:20.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.123+0000 7f27b27fc640 1 --2- 172.21.15.120:0/4041101636 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f27a80a32d0 0x7f27a80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:20.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.124+0000 7f27c16cd640 1 --2- 172.21.15.120:0/4041101636 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f27a80a32d0 0x7f27a80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:20.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.124+0000 7f27b27fc640 1 -- 172.21.15.120:0/4041101636 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f27ac0cf830 con 0x7f27bc109b90 2024-09-19T05:18:20.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.124+0000 7f27c16cd640 1 --2- 172.21.15.120:0/4041101636 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f27a80a32d0 0x7f27a80a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f27b8031440 tx=0x7f27b80095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:20.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.128+0000 7f27b27fc640 1 -- 172.21.15.120:0/4041101636 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f27ac014030 con 0x7f27bc109b90 2024-09-19T05:18:20.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.307+0000 7f27c3931640 1 -- 172.21.15.120:0/4041101636 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f27bc1afb10 con 0x7f27bc109b90 2024-09-19T05:18:20.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.307+0000 7f27b27fc640 1 -- 172.21.15.120:0/4041101636 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f27ac09c3d0 con 0x7f27bc109b90 2024-09-19T05:18:20.309 INFO:teuthology.orchestra.run.smithi120.stdout:137438953529 2024-09-19T05:18:20.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.309+0000 7f27c3931640 1 -- 172.21.15.120:0/4041101636 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f27a80a32d0 msgr2=0x7f27a80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:20.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.309+0000 7f27c3931640 1 --2- 172.21.15.120:0/4041101636 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f27a80a32d0 0x7f27a80a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f27b8031440 tx=0x7f27b80095f0 comp rx=0 tx=0).stop 2024-09-19T05:18:20.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.309+0000 7f27c3931640 1 -- 172.21.15.120:0/4041101636 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27bc109b90 msgr2=0x7f27bc10fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:20.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.309+0000 7f27c3931640 1 --2- 172.21.15.120:0/4041101636 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27bc109b90 0x7f27bc10fe80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00c890 tx=0x7f27ac00cd50 comp rx=0 tx=0).stop 2024-09-19T05:18:20.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.309+0000 7f27c3931640 1 -- 172.21.15.120:0/4041101636 shutdown_connections 2024-09-19T05:18:20.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.309+0000 7f27c3931640 1 --2- 172.21.15.120:0/4041101636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27bc10eb10 0x7f27bc1103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:20.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.309+0000 7f27c3931640 1 --2- 172.21.15.120:0/4041101636 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f27bc109b90 0x7f27bc10fe80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:20.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.309+0000 7f27c3931640 1 --2- 172.21.15.120:0/4041101636 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f27a80a32d0 0x7f27a80a5790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:20.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.309+0000 7f27c3931640 1 --2- 172.21.15.120:0/4041101636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27bc1091f0 0x7f27bc10f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:20.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.309+0000 7f27c3931640 1 -- 172.21.15.120:0/4041101636 >> 172.21.15.120:0/4041101636 conn(0x7f27bc06e2d0 msgr2=0x7f27bc10c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:20.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.309+0000 7f27c3931640 1 -- 172.21.15.120:0/4041101636 shutdown_connections 2024-09-19T05:18:20.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:20.309+0000 7f27c3931640 1 -- 172.21.15.120:0/4041101636 wait complete. 2024-09-19T05:18:20.354 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:20 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2822080011' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T05:18:20.354 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:20 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/3748718569' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T05:18:20.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:20 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/2822080011' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T05:18:20.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:20 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/3748718569' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T05:18:20.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:20 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/2822080011' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T05:18:20.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:20 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/3748718569' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T05:18:21.029 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953526 got 137438953529 for osd.4 2024-09-19T05:18:21.029 DEBUG:teuthology.parallel:result is None 2024-09-19T05:18:21.236 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:21.253 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:21 smithi120 ceph-mon[30956]: pgmap v298: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T05:18:21.253 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:21 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/4041101636' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T05:18:21.256 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:21.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.435+0000 7fbd9bb81640 1 -- 172.21.15.120:0/3502155999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd94101240 msgr2=0x7fbd94101680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:21.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.435+0000 7fbd9bb81640 1 --2- 172.21.15.120:0/3502155999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd94101240 0x7fbd94101680 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbd90009900 tx=0x7fbd9002a410 comp rx=0 tx=0).stop 2024-09-19T05:18:21.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.435+0000 7fbd9bb81640 1 -- 172.21.15.120:0/3502155999 shutdown_connections 2024-09-19T05:18:21.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.435+0000 7fbd9bb81640 1 --2- 172.21.15.120:0/3502155999 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd94101bc0 0x7fbd9410d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:21.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.435+0000 7fbd9bb81640 1 --2- 172.21.15.120:0/3502155999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd94101240 0x7fbd94101680 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:21.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.435+0000 7fbd9bb81640 1 --2- 172.21.15.120:0/3502155999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd94105a90 0x7fbd94105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:21.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.435+0000 7fbd9bb81640 1 -- 172.21.15.120:0/3502155999 >> 172.21.15.120:0/3502155999 conn(0x7fbd94077210 msgr2=0x7fbd940fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:21.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.435+0000 7fbd9bb81640 1 -- 172.21.15.120:0/3502155999 shutdown_connections 2024-09-19T05:18:21.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.435+0000 7fbd9bb81640 1 -- 172.21.15.120:0/3502155999 wait complete. 2024-09-19T05:18:21.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.435+0000 7fbd9bb81640 1 Processor -- start 2024-09-19T05:18:21.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.435+0000 7fbd9bb81640 1 -- start start 2024-09-19T05:18:21.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.436+0000 7fbd9bb81640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd94101240 0x7fbd941984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:21.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.436+0000 7fbd9bb81640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd94101bc0 0x7fbd94198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:21.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.436+0000 7fbd9bb81640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd94105a90 0x7fbd9419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:21.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.436+0000 7fbd9bb81640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fbd94110ee0 con 0x7fbd94105a90 2024-09-19T05:18:21.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.436+0000 7fbd9bb81640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fbd94110d60 con 0x7fbd94101240 2024-09-19T05:18:21.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.436+0000 7fbd9bb81640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbd94111060 con 0x7fbd94101bc0 2024-09-19T05:18:21.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.436+0000 7fbd9a11e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd94105a90 0x7fbd9419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:21.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.436+0000 7fbd9a11e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd94105a90 0x7fbd9419cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43890/0 (socket says 172.21.15.120:43890) 2024-09-19T05:18:21.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.436+0000 7fbd9a11e640 1 -- 172.21.15.120:0/1481774288 learned_addr learned my addr 172.21.15.120:0/1481774288 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:21.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.436+0000 7fbd9a11e640 1 -- 172.21.15.120:0/1481774288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd94101bc0 msgr2=0x7fbd94198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:21.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.436+0000 7fbd9911c640 1 --2- 172.21.15.120:0/1481774288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd94101bc0 0x7fbd94198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:21.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.436+0000 7fbd9991d640 1 --2- 172.21.15.120:0/1481774288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd94101240 0x7fbd941984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:21.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.436+0000 7fbd9a11e640 1 --2- 172.21.15.120:0/1481774288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd94101bc0 0x7fbd94198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:21.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.436+0000 7fbd9a11e640 1 -- 172.21.15.120:0/1481774288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd94101240 msgr2=0x7fbd941984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:21.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.436+0000 7fbd9a11e640 1 --2- 172.21.15.120:0/1481774288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd94101240 0x7fbd941984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:21.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.436+0000 7fbd9a11e640 1 -- 172.21.15.120:0/1481774288 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9419d480 con 0x7fbd94105a90 2024-09-19T05:18:21.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.436+0000 7fbd9911c640 1 --2- 172.21.15.120:0/1481774288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd94101bc0 0x7fbd94198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:21.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.436+0000 7fbd9a11e640 1 --2- 172.21.15.120:0/1481774288 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd94105a90 0x7fbd9419cda0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c00b970 tx=0x7fbd8c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:21.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.436+0000 7fbd8affd640 1 -- 172.21.15.120:0/1481774288 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c019070 con 0x7fbd94105a90 2024-09-19T05:18:21.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.436+0000 7fbd8affd640 1 -- 172.21.15.120:0/1481774288 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fbd8c014440 con 0x7fbd94105a90 2024-09-19T05:18:21.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.436+0000 7fbd9bb81640 1 -- 172.21.15.120:0/1481774288 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd9419d770 con 0x7fbd94105a90 2024-09-19T05:18:21.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.436+0000 7fbd8affd640 1 -- 172.21.15.120:0/1481774288 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c0075d0 con 0x7fbd94105a90 2024-09-19T05:18:21.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.436+0000 7fbd9bb81640 1 -- 172.21.15.120:0/1481774288 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd941a5050 con 0x7fbd94105a90 2024-09-19T05:18:21.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.437+0000 7fbd9bb81640 1 -- 172.21.15.120:0/1481774288 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd94101680 con 0x7fbd94105a90 2024-09-19T05:18:21.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.438+0000 7fbd8affd640 1 -- 172.21.15.120:0/1481774288 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fbd8c01c070 con 0x7fbd94105a90 2024-09-19T05:18:21.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.439+0000 7fbd8affd640 1 --2- 172.21.15.120:0/1481774288 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fbd800a32d0 0x7fbd800a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:21.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.439+0000 7fbd9991d640 1 --2- 172.21.15.120:0/1481774288 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fbd800a32d0 0x7fbd800a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:21.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.439+0000 7fbd8affd640 1 -- 172.21.15.120:0/1481774288 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fbd8c0cf0a0 con 0x7fbd94105a90 2024-09-19T05:18:21.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.440+0000 7fbd9991d640 1 --2- 172.21.15.120:0/1481774288 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fbd800a32d0 0x7fbd800a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400a810 tx=0x7fbd84008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:21.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.445+0000 7fbd8affd640 1 -- 172.21.15.120:0/1481774288 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbd8c09bcf0 con 0x7fbd94105a90 2024-09-19T05:18:21.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.619+0000 7fbd9bb81640 1 -- 172.21.15.120:0/1481774288 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fbd941a5280 con 0x7fbd94105a90 2024-09-19T05:18:21.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.620+0000 7fbd8affd640 1 -- 172.21.15.120:0/1481774288 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbd8c09b5f0 con 0x7fbd94105a90 2024-09-19T05:18:21.622 INFO:teuthology.orchestra.run.smithi120.stdout:103079215166 2024-09-19T05:18:21.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.622+0000 7fbd9bb81640 1 -- 172.21.15.120:0/1481774288 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fbd800a32d0 msgr2=0x7fbd800a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:21.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.622+0000 7fbd9bb81640 1 --2- 172.21.15.120:0/1481774288 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fbd800a32d0 0x7fbd800a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400a810 tx=0x7fbd84008040 comp rx=0 tx=0).stop 2024-09-19T05:18:21.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.622+0000 7fbd9bb81640 1 -- 172.21.15.120:0/1481774288 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd94105a90 msgr2=0x7fbd9419cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:21.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.622+0000 7fbd9bb81640 1 --2- 172.21.15.120:0/1481774288 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd94105a90 0x7fbd9419cda0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c00b970 tx=0x7fbd8c00be30 comp rx=0 tx=0).stop 2024-09-19T05:18:21.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.622+0000 7fbd9bb81640 1 -- 172.21.15.120:0/1481774288 shutdown_connections 2024-09-19T05:18:21.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.622+0000 7fbd9bb81640 1 --2- 172.21.15.120:0/1481774288 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd94105a90 0x7fbd9419cda0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:21.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.622+0000 7fbd9bb81640 1 --2- 172.21.15.120:0/1481774288 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fbd800a32d0 0x7fbd800a5790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:21.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.622+0000 7fbd9bb81640 1 --2- 172.21.15.120:0/1481774288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd94101bc0 0x7fbd94198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:21.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.622+0000 7fbd9bb81640 1 --2- 172.21.15.120:0/1481774288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd94101240 0x7fbd941984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:21.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.622+0000 7fbd9bb81640 1 -- 172.21.15.120:0/1481774288 >> 172.21.15.120:0/1481774288 conn(0x7fbd94077210 msgr2=0x7fbd941002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:21.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.622+0000 7fbd9bb81640 1 -- 172.21.15.120:0/1481774288 shutdown_connections 2024-09-19T05:18:21.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:21.622+0000 7fbd9bb81640 1 -- 172.21.15.120:0/1481774288 wait complete. 2024-09-19T05:18:21.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:21 smithi194 ceph-mon[35228]: pgmap v298: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T05:18:21.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:21 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/4041101636' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T05:18:21.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:21 smithi178 ceph-mon[34347]: pgmap v298: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T05:18:21.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:21 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/4041101636' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T05:18:22.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:22 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1481774288' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T05:18:22.442 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215164 got 103079215166 for osd.3 2024-09-19T05:18:22.442 DEBUG:teuthology.parallel:result is None 2024-09-19T05:18:22.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.630+0000 7f7a3962d640 1 -- 172.21.15.120:0/3639497878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a34106f50 msgr2=0x7f7a3410eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:22.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.630+0000 7f7a3962d640 1 --2- 172.21.15.120:0/3639497878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a34106f50 0x7f7a3410eaf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7a24009cd0 tx=0x7f7a2402a8e0 comp rx=0 tx=0).stop 2024-09-19T05:18:22.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.630+0000 7f7a3962d640 1 -- 172.21.15.120:0/3639497878 shutdown_connections 2024-09-19T05:18:22.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.630+0000 7f7a3962d640 1 --2- 172.21.15.120:0/3639497878 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a34106f50 0x7f7a3410eaf0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:22.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.630+0000 7f7a3962d640 1 --2- 172.21.15.120:0/3639497878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a34100ca0 0x7f7a34106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:22.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.630+0000 7f7a3962d640 1 --2- 172.21.15.120:0/3639497878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a341002f0 0x7f7a341006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:22.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.630+0000 7f7a3962d640 1 -- 172.21.15.120:0/3639497878 >> 172.21.15.120:0/3639497878 conn(0x7f7a34077210 msgr2=0x7f7a340fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:22.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.630+0000 7f7a3962d640 1 -- 172.21.15.120:0/3639497878 shutdown_connections 2024-09-19T05:18:22.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.630+0000 7f7a3962d640 1 -- 172.21.15.120:0/3639497878 wait complete. 2024-09-19T05:18:22.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.630+0000 7f7a3962d640 1 Processor -- start 2024-09-19T05:18:22.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.630+0000 7f7a3962d640 1 -- start start 2024-09-19T05:18:22.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.631+0000 7f7a3962d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a341002f0 0x7f7a341983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:22.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.631+0000 7f7a3962d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a34100ca0 0x7f7a341988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:22.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.631+0000 7f7a3962d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a34106f50 0x7f7a3419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:22.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.631+0000 7f7a3962d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7a34111e50 con 0x7f7a341002f0 2024-09-19T05:18:22.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.631+0000 7f7a3962d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7a34111cd0 con 0x7f7a34100ca0 2024-09-19T05:18:22.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.631+0000 7f7a3962d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7a34111fd0 con 0x7f7a34106f50 2024-09-19T05:18:22.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.631+0000 7f7a32ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a341002f0 0x7f7a341983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:22.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.631+0000 7f7a32ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a341002f0 0x7f7a341983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43920/0 (socket says 172.21.15.120:43920) 2024-09-19T05:18:22.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.631+0000 7f7a32ffd640 1 -- 172.21.15.120:0/644548810 learned_addr learned my addr 172.21.15.120:0/644548810 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:22.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.631+0000 7f7a327fc640 1 --2- 172.21.15.120:0/644548810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a34100ca0 0x7f7a341988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:22.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.631+0000 7f7a337fe640 1 --2- 172.21.15.120:0/644548810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a34106f50 0x7f7a3419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:22.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.631+0000 7f7a32ffd640 1 -- 172.21.15.120:0/644548810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a34106f50 msgr2=0x7f7a3419cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:22.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.631+0000 7f7a32ffd640 1 --2- 172.21.15.120:0/644548810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a34106f50 0x7f7a3419cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:22.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.631+0000 7f7a32ffd640 1 -- 172.21.15.120:0/644548810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a34100ca0 msgr2=0x7f7a341988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:22.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.631+0000 7f7a32ffd640 1 --2- 172.21.15.120:0/644548810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a34100ca0 0x7f7a341988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:22.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.631+0000 7f7a32ffd640 1 -- 172.21.15.120:0/644548810 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3419d360 con 0x7f7a341002f0 2024-09-19T05:18:22.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.631+0000 7f7a327fc640 1 --2- 172.21.15.120:0/644548810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a34100ca0 0x7f7a341988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:22.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.631+0000 7f7a32ffd640 1 --2- 172.21.15.120:0/644548810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a341002f0 0x7f7a341983b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c00d950 tx=0x7f7a2c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:22.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.631+0000 7f7a2bfff640 1 -- 172.21.15.120:0/644548810 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c017070 con 0x7f7a341002f0 2024-09-19T05:18:22.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.631+0000 7f7a3962d640 1 -- 172.21.15.120:0/644548810 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a3419d650 con 0x7f7a341002f0 2024-09-19T05:18:22.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.631+0000 7f7a2bfff640 1 -- 172.21.15.120:0/644548810 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a2c009c30 con 0x7f7a341002f0 2024-09-19T05:18:22.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.631+0000 7f7a2bfff640 1 -- 172.21.15.120:0/644548810 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c00f620 con 0x7f7a341002f0 2024-09-19T05:18:22.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.631+0000 7f7a3962d640 1 -- 172.21.15.120:0/644548810 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a341a4f30 con 0x7f7a341002f0 2024-09-19T05:18:22.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.632+0000 7f7a3962d640 1 -- 172.21.15.120:0/644548810 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a341006d0 con 0x7f7a341002f0 2024-09-19T05:18:22.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.633+0000 7f7a2bfff640 1 -- 172.21.15.120:0/644548810 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f7a2c0109a0 con 0x7f7a341002f0 2024-09-19T05:18:22.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.634+0000 7f7a2bfff640 1 --2- 172.21.15.120:0/644548810 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f7a200a32d0 0x7f7a200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:22.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.634+0000 7f7a327fc640 1 --2- 172.21.15.120:0/644548810 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f7a200a32d0 0x7f7a200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:22.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.634+0000 7f7a2bfff640 1 -- 172.21.15.120:0/644548810 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f7a2c0cf7c0 con 0x7f7a341002f0 2024-09-19T05:18:22.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.634+0000 7f7a327fc640 1 --2- 172.21.15.120:0/644548810 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f7a200a32d0 0x7f7a200a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7a340ff7f0 tx=0x7f7a1c005cb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:22.653 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.638+0000 7f7a2bfff640 1 -- 172.21.15.120:0/644548810 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7a2c009de0 con 0x7f7a341002f0 2024-09-19T05:18:22.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:22 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1481774288' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T05:18:22.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:22 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1481774288' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T05:18:22.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.812+0000 7f7a3962d640 1 -- 172.21.15.120:0/644548810 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f7a34109b90 con 0x7f7a341002f0 2024-09-19T05:18:22.813 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.812+0000 7f7a2bfff640 1 -- 172.21.15.120:0/644548810 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7a2c09c360 con 0x7f7a341002f0 2024-09-19T05:18:22.813 INFO:teuthology.orchestra.run.smithi120.stdout:188978561072 2024-09-19T05:18:22.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.814+0000 7f7a3962d640 1 -- 172.21.15.120:0/644548810 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f7a200a32d0 msgr2=0x7f7a200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:22.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.814+0000 7f7a3962d640 1 --2- 172.21.15.120:0/644548810 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f7a200a32d0 0x7f7a200a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7a340ff7f0 tx=0x7f7a1c005cb0 comp rx=0 tx=0).stop 2024-09-19T05:18:22.815 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.815+0000 7f7a3962d640 1 -- 172.21.15.120:0/644548810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a341002f0 msgr2=0x7f7a341983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:22.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.815+0000 7f7a3962d640 1 --2- 172.21.15.120:0/644548810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a341002f0 0x7f7a341983b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c00d950 tx=0x7f7a2c00de10 comp rx=0 tx=0).stop 2024-09-19T05:18:22.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.815+0000 7f7a3962d640 1 -- 172.21.15.120:0/644548810 shutdown_connections 2024-09-19T05:18:22.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.815+0000 7f7a3962d640 1 --2- 172.21.15.120:0/644548810 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f7a200a32d0 0x7f7a200a5790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:22.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.815+0000 7f7a3962d640 1 --2- 172.21.15.120:0/644548810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a34106f50 0x7f7a3419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:22.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.815+0000 7f7a3962d640 1 --2- 172.21.15.120:0/644548810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a34100ca0 0x7f7a341988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:22.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.815+0000 7f7a3962d640 1 --2- 172.21.15.120:0/644548810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a341002f0 0x7f7a341983b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:22.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.815+0000 7f7a3962d640 1 -- 172.21.15.120:0/644548810 >> 172.21.15.120:0/644548810 conn(0x7f7a34077210 msgr2=0x7f7a341051d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:22.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.815+0000 7f7a3962d640 1 -- 172.21.15.120:0/644548810 shutdown_connections 2024-09-19T05:18:22.816 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:22.815+0000 7f7a3962d640 1 -- 172.21.15.120:0/644548810 wait complete. 2024-09-19T05:18:23.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:23 smithi120 ceph-mon[30956]: pgmap v299: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T05:18:23.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:23 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/644548810' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T05:18:23.643 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607621 got 51539607624 for osd.1 2024-09-19T05:18:23.644 DEBUG:teuthology.parallel:result is None 2024-09-19T05:18:23.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:23 smithi194 ceph-mon[35228]: pgmap v299: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T05:18:23.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:23 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/644548810' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T05:18:23.691 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:23 smithi178 ceph-mon[34347]: pgmap v299: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T05:18:23.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:23 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/644548810' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T05:18:24.162 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:24.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.170+0000 7fc67522e640 1 -- 172.21.15.120:0/3405023402 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc670102d50 msgr2=0x7fc670103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:24.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.170+0000 7fc67522e640 1 --2- 172.21.15.120:0/3405023402 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc670102d50 0x7fc670103130 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc660009900 tx=0x7fc66002a480 comp rx=0 tx=0).stop 2024-09-19T05:18:24.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.170+0000 7fc67522e640 1 -- 172.21.15.120:0/3405023402 shutdown_connections 2024-09-19T05:18:24.172 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.170+0000 7fc67522e640 1 --2- 172.21.15.120:0/3405023402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc67010c180 0x7fc67010e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.170+0000 7fc67522e640 1 --2- 172.21.15.120:0/3405023402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc670103670 0x7fc67010bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.170+0000 7fc67522e640 1 --2- 172.21.15.120:0/3405023402 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc670102d50 0x7fc670103130 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.170+0000 7fc67522e640 1 -- 172.21.15.120:0/3405023402 >> 172.21.15.120:0/3405023402 conn(0x7fc6700fc7d0 msgr2=0x7fc6700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:24.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.170+0000 7fc67522e640 1 -- 172.21.15.120:0/3405023402 shutdown_connections 2024-09-19T05:18:24.173 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.170+0000 7fc67522e640 1 -- 172.21.15.120:0/3405023402 wait complete. 2024-09-19T05:18:24.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.171+0000 7fc67522e640 1 Processor -- start 2024-09-19T05:18:24.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.172+0000 7fc67522e640 1 -- start start 2024-09-19T05:18:24.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.172+0000 7fc67522e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc670102d50 0x7fc6701983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:24.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.172+0000 7fc67522e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc670103670 0x7fc6701988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:24.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.172+0000 7fc67522e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc67010c180 0x7fc67019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:24.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.172+0000 7fc67522e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc670111e80 con 0x7fc670103670 2024-09-19T05:18:24.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.172+0000 7fc67522e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc670111d00 con 0x7fc670102d50 2024-09-19T05:18:24.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.172+0000 7fc67522e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc670112000 con 0x7fc67010c180 2024-09-19T05:18:24.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.172+0000 7fc66e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc670103670 0x7fc6701988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:24.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.172+0000 7fc66e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc670103670 0x7fc6701988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43960/0 (socket says 172.21.15.120:43960) 2024-09-19T05:18:24.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.172+0000 7fc66e59c640 1 -- 172.21.15.120:0/3173885171 learned_addr learned my addr 172.21.15.120:0/3173885171 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:24.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.172+0000 7fc66ed9d640 1 --2- 172.21.15.120:0/3173885171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc670102d50 0x7fc6701983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:24.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.172+0000 7fc66f59e640 1 --2- 172.21.15.120:0/3173885171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc67010c180 0x7fc67019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:24.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.173+0000 7fc66e59c640 1 -- 172.21.15.120:0/3173885171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc67010c180 msgr2=0x7fc67019cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:24.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.173+0000 7fc66e59c640 1 --2- 172.21.15.120:0/3173885171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc67010c180 0x7fc67019cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.173+0000 7fc66e59c640 1 -- 172.21.15.120:0/3173885171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc670102d50 msgr2=0x7fc6701983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:24.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.173+0000 7fc66e59c640 1 --2- 172.21.15.120:0/3173885171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc670102d50 0x7fc6701983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.173+0000 7fc66e59c640 1 -- 172.21.15.120:0/3173885171 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc67019d350 con 0x7fc670103670 2024-09-19T05:18:24.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.173+0000 7fc66e59c640 1 --2- 172.21.15.120:0/3173885171 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc670103670 0x7fc6701988e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc66400d750 tx=0x7fc66400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:24.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.173+0000 7fc657fff640 1 -- 172.21.15.120:0/3173885171 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc664017070 con 0x7fc670103670 2024-09-19T05:18:24.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.173+0000 7fc657fff640 1 -- 172.21.15.120:0/3173885171 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc664005020 con 0x7fc670103670 2024-09-19T05:18:24.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.173+0000 7fc67522e640 1 -- 172.21.15.120:0/3173885171 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc67019d640 con 0x7fc670103670 2024-09-19T05:18:24.176 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.173+0000 7fc657fff640 1 -- 172.21.15.120:0/3173885171 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc664004c60 con 0x7fc670103670 2024-09-19T05:18:24.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.173+0000 7fc67522e640 1 -- 172.21.15.120:0/3173885171 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6701a4f20 con 0x7fc670103670 2024-09-19T05:18:24.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.174+0000 7fc67522e640 1 -- 172.21.15.120:0/3173885171 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc670103130 con 0x7fc670103670 2024-09-19T05:18:24.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.176+0000 7fc657fff640 1 -- 172.21.15.120:0/3173885171 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fc664009a30 con 0x7fc670103670 2024-09-19T05:18:24.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.176+0000 7fc657fff640 1 --2- 172.21.15.120:0/3173885171 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fc6580a32d0 0x7fc6580a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:24.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.177+0000 7fc657fff640 1 -- 172.21.15.120:0/3173885171 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fc6640cf7f0 con 0x7fc670103670 2024-09-19T05:18:24.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.177+0000 7fc66ed9d640 1 --2- 172.21.15.120:0/3173885171 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fc6580a32d0 0x7fc6580a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:24.179 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.177+0000 7fc66ed9d640 1 --2- 172.21.15.120:0/3173885171 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fc6580a32d0 0x7fc6580a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc660005ab0 tx=0x7fc660005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:24.182 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.180+0000 7fc657fff640 1 -- 172.21.15.120:0/3173885171 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc66409bce0 con 0x7fc670103670 2024-09-19T05:18:24.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.065+0000 7fcc1d7a7640 1 -- 172.21.15.120:0/1108153705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc18108290 msgr2=0x7fcc1810ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:24.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.065+0000 7fcc1d7a7640 1 --2- 172.21.15.120:0/1108153705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc18108290 0x7fcc1810ec30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcc10009cd0 tx=0x7fcc1002a8e0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.065+0000 7fcc1d7a7640 1 -- 172.21.15.120:0/1108153705 shutdown_connections 2024-09-19T05:18:24.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.065+0000 7fcc1d7a7640 1 --2- 172.21.15.120:0/1108153705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc18108290 0x7fcc1810ec30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.065+0000 7fcc1d7a7640 1 --2- 172.21.15.120:0/1108153705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc18103740 0x7fcc18107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.065+0000 7fcc1d7a7640 1 --2- 172.21.15.120:0/1108153705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc18102d90 0x7fcc18103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.065+0000 7fcc1d7a7640 1 -- 172.21.15.120:0/1108153705 >> 172.21.15.120:0/1108153705 conn(0x7fcc180fc7d0 msgr2=0x7fcc180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:24.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.065+0000 7fcc1d7a7640 1 -- 172.21.15.120:0/1108153705 shutdown_connections 2024-09-19T05:18:24.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.066+0000 7fcc1d7a7640 1 -- 172.21.15.120:0/1108153705 wait complete. 2024-09-19T05:18:24.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.066+0000 7fcc1d7a7640 1 Processor -- start 2024-09-19T05:18:24.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.066+0000 7fcc1d7a7640 1 -- start start 2024-09-19T05:18:24.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.066+0000 7fcc1d7a7640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc18102d90 0x7fcc181984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:24.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.066+0000 7fcc1d7a7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc18103740 0x7fcc18198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:24.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.066+0000 7fcc1d7a7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc18108290 0x7fcc1819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:24.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.066+0000 7fcc1d7a7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcc18111f80 con 0x7fcc18103740 2024-09-19T05:18:24.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.066+0000 7fcc1d7a7640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fcc18111e00 con 0x7fcc18102d90 2024-09-19T05:18:24.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.066+0000 7fcc1d7a7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcc18112100 con 0x7fcc18108290 2024-09-19T05:18:24.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.067+0000 7fcc167fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc18103740 0x7fcc18198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:24.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.067+0000 7fcc167fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc18103740 0x7fcc18198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43940/0 (socket says 172.21.15.120:43940) 2024-09-19T05:18:24.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.067+0000 7fcc167fc640 1 -- 172.21.15.120:0/2236236662 learned_addr learned my addr 172.21.15.120:0/2236236662 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:24.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.067+0000 7fcc16ffd640 1 --2- 172.21.15.120:0/2236236662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc18102d90 0x7fcc181984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:24.301 INFO:teuthology.orchestra.run.smithi120.stdout:287762808861 2024-09-19T05:18:24.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.067+0000 7fcc177fe640 1 --2- 172.21.15.120:0/2236236662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc18108290 0x7fcc1819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:24.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.067+0000 7fcc167fc640 1 -- 172.21.15.120:0/2236236662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc18108290 msgr2=0x7fcc1819cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:24.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.067+0000 7fcc167fc640 1 --2- 172.21.15.120:0/2236236662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc18108290 0x7fcc1819cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.067+0000 7fcc167fc640 1 -- 172.21.15.120:0/2236236662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc18102d90 msgr2=0x7fcc181984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:24.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.067+0000 7fcc167fc640 1 --2- 172.21.15.120:0/2236236662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc18102d90 0x7fcc181984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.067+0000 7fcc167fc640 1 -- 172.21.15.120:0/2236236662 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc1819d4a0 con 0x7fcc18103740 2024-09-19T05:18:24.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.067+0000 7fcc167fc640 1 --2- 172.21.15.120:0/2236236662 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc18103740 0x7fcc18198a30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c00b450 tx=0x7fcc0c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:24.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.067+0000 7fcbfffff640 1 -- 172.21.15.120:0/2236236662 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c015020 con 0x7fcc18103740 2024-09-19T05:18:24.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.067+0000 7fcbfffff640 1 -- 172.21.15.120:0/2236236662 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcc0c011d40 con 0x7fcc18103740 2024-09-19T05:18:24.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.067+0000 7fcc1d7a7640 1 -- 172.21.15.120:0/2236236662 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc1819d790 con 0x7fcc18103740 2024-09-19T05:18:24.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.067+0000 7fcbfffff640 1 -- 172.21.15.120:0/2236236662 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c00f340 con 0x7fcc18103740 2024-09-19T05:18:24.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.067+0000 7fcc1d7a7640 1 -- 172.21.15.120:0/2236236662 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc181a5070 con 0x7fcc18103740 2024-09-19T05:18:24.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.068+0000 7fcc1d7a7640 1 -- 172.21.15.120:0/2236236662 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc18103170 con 0x7fcc18103740 2024-09-19T05:18:24.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.069+0000 7fcbfffff640 1 -- 172.21.15.120:0/2236236662 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fcc0c018020 con 0x7fcc18103740 2024-09-19T05:18:24.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.070+0000 7fcbfffff640 1 --2- 172.21.15.120:0/2236236662 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fcc000a3350 0x7fcc000a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:24.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.070+0000 7fcc16ffd640 1 --2- 172.21.15.120:0/2236236662 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fcc000a3350 0x7fcc000a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:24.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.070+0000 7fcbfffff640 1 -- 172.21.15.120:0/2236236662 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fcc0c0cf4c0 con 0x7fcc18103740 2024-09-19T05:18:24.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.071+0000 7fcc16ffd640 1 --2- 172.21.15.120:0/2236236662 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fcc000a3350 0x7fcc000a5810 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcc080058c0 tx=0x7fcc0800a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:24.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.074+0000 7fcbfffff640 1 -- 172.21.15.120:0/2236236662 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcc0c01f020 con 0x7fcc18103740 2024-09-19T05:18:24.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.258+0000 7fcc1d7a7640 1 -- 172.21.15.120:0/2236236662 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fcc1810a2d0 con 0x7fcc18103740 2024-09-19T05:18:24.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.259+0000 7fcbfffff640 1 -- 172.21.15.120:0/2236236662 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fcc0c00d040 con 0x7fcc18103740 2024-09-19T05:18:24.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.261+0000 7fcc1d7a7640 1 -- 172.21.15.120:0/2236236662 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fcc000a3350 msgr2=0x7fcc000a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:24.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.261+0000 7fcc1d7a7640 1 --2- 172.21.15.120:0/2236236662 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fcc000a3350 0x7fcc000a5810 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcc080058c0 tx=0x7fcc0800a4c0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.261+0000 7fcc1d7a7640 1 -- 172.21.15.120:0/2236236662 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc18103740 msgr2=0x7fcc18198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:24.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.261+0000 7fcc1d7a7640 1 --2- 172.21.15.120:0/2236236662 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc18103740 0x7fcc18198a30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c00b450 tx=0x7fcc0c00b910 comp rx=0 tx=0).stop 2024-09-19T05:18:24.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.261+0000 7fcc1d7a7640 1 -- 172.21.15.120:0/2236236662 shutdown_connections 2024-09-19T05:18:24.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.261+0000 7fcc1d7a7640 1 --2- 172.21.15.120:0/2236236662 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fcc000a3350 0x7fcc000a5810 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.261+0000 7fcc1d7a7640 1 --2- 172.21.15.120:0/2236236662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc18108290 0x7fcc1819cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.261+0000 7fcc1d7a7640 1 --2- 172.21.15.120:0/2236236662 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcc18103740 0x7fcc18198a30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.261+0000 7fcc1d7a7640 1 --2- 172.21.15.120:0/2236236662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc18102d90 0x7fcc181984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.261+0000 7fcc1d7a7640 1 -- 172.21.15.120:0/2236236662 >> 172.21.15.120:0/2236236662 conn(0x7fcc180fc7d0 msgr2=0x7fcc18105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:24.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.261+0000 7fcc1d7a7640 1 -- 172.21.15.120:0/2236236662 shutdown_connections 2024-09-19T05:18:24.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.261+0000 7fcc1d7a7640 1 -- 172.21.15.120:0/2236236662 wait complete. 2024-09-19T05:18:24.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.358+0000 7fc67522e640 1 -- 172.21.15.120:0/3173885171 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc670199700 con 0x7fc670103670 2024-09-19T05:18:24.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.358+0000 7fc657fff640 1 -- 172.21.15.120:0/3173885171 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc670199700 con 0x7fc670103670 2024-09-19T05:18:24.360 INFO:teuthology.orchestra.run.smithi120.stdout:73014444100 2024-09-19T05:18:24.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.360+0000 7fc67522e640 1 -- 172.21.15.120:0/3173885171 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fc6580a32d0 msgr2=0x7fc6580a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:24.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.360+0000 7fc67522e640 1 --2- 172.21.15.120:0/3173885171 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fc6580a32d0 0x7fc6580a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc660005ab0 tx=0x7fc660005a20 comp rx=0 tx=0).stop 2024-09-19T05:18:24.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.360+0000 7fc67522e640 1 -- 172.21.15.120:0/3173885171 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc670103670 msgr2=0x7fc6701988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:24.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.360+0000 7fc67522e640 1 --2- 172.21.15.120:0/3173885171 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc670103670 0x7fc6701988e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc66400d750 tx=0x7fc66400dc10 comp rx=0 tx=0).stop 2024-09-19T05:18:24.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.360+0000 7fc67522e640 1 -- 172.21.15.120:0/3173885171 shutdown_connections 2024-09-19T05:18:24.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.360+0000 7fc67522e640 1 --2- 172.21.15.120:0/3173885171 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fc6580a32d0 0x7fc6580a5790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.360+0000 7fc67522e640 1 --2- 172.21.15.120:0/3173885171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc67010c180 0x7fc67019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.360+0000 7fc67522e640 1 --2- 172.21.15.120:0/3173885171 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc670103670 0x7fc6701988e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.360+0000 7fc67522e640 1 --2- 172.21.15.120:0/3173885171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc670102d50 0x7fc6701983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.360+0000 7fc67522e640 1 -- 172.21.15.120:0/3173885171 >> 172.21.15.120:0/3173885171 conn(0x7fc6700fc7d0 msgr2=0x7fc6700fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:24.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.360+0000 7fc67522e640 1 -- 172.21.15.120:0/3173885171 shutdown_connections 2024-09-19T05:18:24.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.360+0000 7fc67522e640 1 -- 172.21.15.120:0/3173885171 wait complete. 2024-09-19T05:18:24.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.654+0000 7fe5aa39a640 1 -- 172.21.15.120:0/1863599971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5a4100e20 msgr2=0x7fe5a4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:24.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.654+0000 7fe5aa39a640 1 --2- 172.21.15.120:0/1863599971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5a4100e20 0x7fe5a4101200 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe594009900 tx=0x7fe59402a480 comp rx=0 tx=0).stop 2024-09-19T05:18:24.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.654+0000 7fe5aa39a640 1 -- 172.21.15.120:0/1863599971 shutdown_connections 2024-09-19T05:18:24.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.654+0000 7fe5aa39a640 1 --2- 172.21.15.120:0/1863599971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5a4102ef0 0x7fe5a410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.654+0000 7fe5aa39a640 1 --2- 172.21.15.120:0/1863599971 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5a4102570 0x7fe5a41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.654+0000 7fe5aa39a640 1 --2- 172.21.15.120:0/1863599971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5a4100e20 0x7fe5a4101200 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.654+0000 7fe5aa39a640 1 -- 172.21.15.120:0/1863599971 >> 172.21.15.120:0/1863599971 conn(0x7fe5a40fc7d0 msgr2=0x7fe5a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:24.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.654+0000 7fe5aa39a640 1 -- 172.21.15.120:0/1863599971 shutdown_connections 2024-09-19T05:18:24.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.654+0000 7fe5aa39a640 1 -- 172.21.15.120:0/1863599971 wait complete. 2024-09-19T05:18:24.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.654+0000 7fe5aa39a640 1 Processor -- start 2024-09-19T05:18:24.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.654+0000 7fe5aa39a640 1 -- start start 2024-09-19T05:18:24.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.655+0000 7fe5aa39a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5a4100e20 0x7fe5a40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:24.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.655+0000 7fe5aa39a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5a4102570 0x7fe5a40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:24.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.655+0000 7fe5aa39a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5a4102ef0 0x7fe5a40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:24.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.655+0000 7fe5aa39a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a4110e50 con 0x7fe5a4102570 2024-09-19T05:18:24.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.655+0000 7fe5aa39a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a4110cd0 con 0x7fe5a4102ef0 2024-09-19T05:18:24.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.655+0000 7fe5aa39a640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a4110fd0 con 0x7fe5a4100e20 2024-09-19T05:18:24.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.655+0000 7fe5a37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5a4102570 0x7fe5a40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:24.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.655+0000 7fe5a37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5a4102570 0x7fe5a40fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43984/0 (socket says 172.21.15.120:43984) 2024-09-19T05:18:24.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.655+0000 7fe5a37fe640 1 -- 172.21.15.120:0/3138972585 learned_addr learned my addr 172.21.15.120:0/3138972585 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:24.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.655+0000 7fe5a3fff640 1 --2- 172.21.15.120:0/3138972585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5a4100e20 0x7fe5a40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:24.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.655+0000 7fe5a8937640 1 --2- 172.21.15.120:0/3138972585 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5a4102ef0 0x7fe5a40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:24.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.655+0000 7fe5a37fe640 1 -- 172.21.15.120:0/3138972585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5a4100e20 msgr2=0x7fe5a40fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:24.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.655+0000 7fe5a37fe640 1 --2- 172.21.15.120:0/3138972585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5a4100e20 0x7fe5a40fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.655+0000 7fe5a37fe640 1 -- 172.21.15.120:0/3138972585 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5a4102ef0 msgr2=0x7fe5a40fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:24.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.655+0000 7fe5a37fe640 1 --2- 172.21.15.120:0/3138972585 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5a4102ef0 0x7fe5a40fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.655+0000 7fe5a37fe640 1 -- 172.21.15.120:0/3138972585 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a41a68d0 con 0x7fe5a4102570 2024-09-19T05:18:24.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.655+0000 7fe5a37fe640 1 --2- 172.21.15.120:0/3138972585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5a4102570 0x7fe5a40fd1c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe58c00c920 tx=0x7fe58c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:24.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.655+0000 7fe5a17fa640 1 -- 172.21.15.120:0/3138972585 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58c007c70 con 0x7fe5a4102570 2024-09-19T05:18:24.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.655+0000 7fe5aa39a640 1 -- 172.21.15.120:0/3138972585 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5a41a6bc0 con 0x7fe5a4102570 2024-09-19T05:18:24.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.655+0000 7fe5a17fa640 1 -- 172.21.15.120:0/3138972585 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe58c007e10 con 0x7fe5a4102570 2024-09-19T05:18:24.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.655+0000 7fe5a17fa640 1 -- 172.21.15.120:0/3138972585 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58c018820 con 0x7fe5a4102570 2024-09-19T05:18:24.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.655+0000 7fe5aa39a640 1 -- 172.21.15.120:0/3138972585 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5a41a7100 con 0x7fe5a4102570 2024-09-19T05:18:24.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.656+0000 7fe5aa39a640 1 -- 172.21.15.120:0/3138972585 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5a4101200 con 0x7fe5a4102570 2024-09-19T05:18:24.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.658+0000 7fe5a17fa640 1 -- 172.21.15.120:0/3138972585 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fe58c0189c0 con 0x7fe5a4102570 2024-09-19T05:18:24.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.658+0000 7fe5a17fa640 1 --2- 172.21.15.120:0/3138972585 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fe5900a32d0 0x7fe5900a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:24.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.658+0000 7fe5a3fff640 1 --2- 172.21.15.120:0/3138972585 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fe5900a32d0 0x7fe5900a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:24.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.658+0000 7fe5a17fa640 1 -- 172.21.15.120:0/3138972585 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fe58c0cff60 con 0x7fe5a4102570 2024-09-19T05:18:24.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.659+0000 7fe5a3fff640 1 --2- 172.21.15.120:0/3138972585 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fe5900a32d0 0x7fe5900a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe594000c00 tx=0x7fe594005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:24.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.661+0000 7fe5a17fa640 1 -- 172.21.15.120:0/3138972585 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe58c014030 con 0x7fe5a4102570 2024-09-19T05:18:24.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.831+0000 7fe5aa39a640 1 -- 172.21.15.120:0/3138972585 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fe5a40fe1b0 con 0x7fe5a4102570 2024-09-19T05:18:24.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.832+0000 7fe5a17fa640 1 -- 172.21.15.120:0/3138972585 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fe5a40fe1b0 con 0x7fe5a4102570 2024-09-19T05:18:24.834 INFO:teuthology.orchestra.run.smithi120.stdout:317827579928 2024-09-19T05:18:24.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.834+0000 7fe5aa39a640 1 -- 172.21.15.120:0/3138972585 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fe5900a32d0 msgr2=0x7fe5900a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:24.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.834+0000 7fe5aa39a640 1 --2- 172.21.15.120:0/3138972585 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fe5900a32d0 0x7fe5900a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe594000c00 tx=0x7fe594005a20 comp rx=0 tx=0).stop 2024-09-19T05:18:24.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.834+0000 7fe5aa39a640 1 -- 172.21.15.120:0/3138972585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5a4102570 msgr2=0x7fe5a40fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:24.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.834+0000 7fe5aa39a640 1 --2- 172.21.15.120:0/3138972585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5a4102570 0x7fe5a40fd1c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe58c00c920 tx=0x7fe58c00cde0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.834+0000 7fe5aa39a640 1 -- 172.21.15.120:0/3138972585 shutdown_connections 2024-09-19T05:18:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.834+0000 7fe5aa39a640 1 --2- 172.21.15.120:0/3138972585 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5a4102ef0 0x7fe5a40fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.834+0000 7fe5aa39a640 1 --2- 172.21.15.120:0/3138972585 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe5a4102570 0x7fe5a40fd1c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.834+0000 7fe5aa39a640 1 --2- 172.21.15.120:0/3138972585 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fe5900a32d0 0x7fe5900a5790 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.834+0000 7fe5aa39a640 1 --2- 172.21.15.120:0/3138972585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5a4100e20 0x7fe5a40fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.834+0000 7fe5aa39a640 1 -- 172.21.15.120:0/3138972585 >> 172.21.15.120:0/3138972585 conn(0x7fe5a40fc7d0 msgr2=0x7fe5a4069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.835+0000 7fe5aa39a640 1 -- 172.21.15.120:0/3138972585 shutdown_connections 2024-09-19T05:18:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:24.835+0000 7fe5aa39a640 1 -- 172.21.15.120:0/3138972585 wait complete. 2024-09-19T05:18:25.509 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:25 smithi120 ceph-mon[30956]: pgmap v300: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T05:18:25.509 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:25 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2236236662' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T05:18:25.509 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:25 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/3173885171' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T05:18:25.509 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:25 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/3138972585' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T05:18:25.539 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561070 got 188978561072 for osd.6 2024-09-19T05:18:25.539 DEBUG:teuthology.parallel:result is None 2024-09-19T05:18:25.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:25 smithi194 ceph-mon[35228]: pgmap v300: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T05:18:25.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:25 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/2236236662' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T05:18:25.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:25 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/3173885171' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T05:18:25.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:25 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/3138972585' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T05:18:25.691 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:25 smithi178 ceph-mon[34347]: pgmap v300: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T05:18:25.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:25 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/2236236662' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T05:18:25.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:25 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/3173885171' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T05:18:25.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:25 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/3138972585' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T05:18:26.129 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738444 got 34359738445 for osd.0 2024-09-19T05:18:26.129 DEBUG:teuthology.parallel:result is None 2024-09-19T05:18:26.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.747+0000 7f6e7bb1e640 1 -- 172.21.15.120:0/2908205159 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e74102ef0 msgr2=0x7f6e7410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:26.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.747+0000 7f6e7bb1e640 1 --2- 172.21.15.120:0/2908205159 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e74102ef0 0x7f6e7410da40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c009ca0 tx=0x7f6e6c02a950 comp rx=0 tx=0).stop 2024-09-19T05:18:26.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.747+0000 7f6e7bb1e640 1 -- 172.21.15.120:0/2908205159 shutdown_connections 2024-09-19T05:18:26.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.747+0000 7f6e7bb1e640 1 --2- 172.21.15.120:0/2908205159 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e74102ef0 0x7f6e7410da40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:26.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.747+0000 7f6e7bb1e640 1 --2- 172.21.15.120:0/2908205159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e74102570 0x7f6e741029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:26.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.747+0000 7f6e7bb1e640 1 --2- 172.21.15.120:0/2908205159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e74100e20 0x7f6e74101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:26.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.747+0000 7f6e7bb1e640 1 -- 172.21.15.120:0/2908205159 >> 172.21.15.120:0/2908205159 conn(0x7f6e740fc7d0 msgr2=0x7f6e740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:26.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.747+0000 7f6e7bb1e640 1 -- 172.21.15.120:0/2908205159 shutdown_connections 2024-09-19T05:18:26.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.747+0000 7f6e7bb1e640 1 -- 172.21.15.120:0/2908205159 wait complete. 2024-09-19T05:18:26.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.748+0000 7f6e7bb1e640 1 Processor -- start 2024-09-19T05:18:26.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.748+0000 7f6e7bb1e640 1 -- start start 2024-09-19T05:18:26.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.748+0000 7f6e7bb1e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e74100e20 0x7f6e741991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:26.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.748+0000 7f6e7bb1e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e74102570 0x7f6e74199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:26.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.748+0000 7f6e7bb1e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e74102ef0 0x7f6e74199ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:26.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.748+0000 7f6e7bb1e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6e74110e30 con 0x7f6e74102ef0 2024-09-19T05:18:26.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.748+0000 7f6e7bb1e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6e74110cb0 con 0x7f6e74100e20 2024-09-19T05:18:26.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.748+0000 7f6e7bb1e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6e74110fb0 con 0x7f6e74102570 2024-09-19T05:18:26.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.748+0000 7f6e7a0bb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e74102ef0 0x7f6e74199ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:26.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.748+0000 7f6e7a0bb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e74102ef0 0x7f6e74199ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60450/0 (socket says 172.21.15.120:60450) 2024-09-19T05:18:26.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.748+0000 7f6e7a0bb640 1 -- 172.21.15.120:0/1951282820 learned_addr learned my addr 172.21.15.120:0/1951282820 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:26.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.748+0000 7f6e798ba640 1 --2- 172.21.15.120:0/1951282820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e74100e20 0x7f6e741991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:26.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.749+0000 7f6e790b9640 1 --2- 172.21.15.120:0/1951282820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e74102570 0x7f6e74199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:26.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.749+0000 7f6e7a0bb640 1 -- 172.21.15.120:0/1951282820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e74102570 msgr2=0x7f6e74199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:26.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.749+0000 7f6e7a0bb640 1 --2- 172.21.15.120:0/1951282820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e74102570 0x7f6e74199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:26.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.749+0000 7f6e7a0bb640 1 -- 172.21.15.120:0/1951282820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e74100e20 msgr2=0x7f6e741991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:26.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.749+0000 7f6e7a0bb640 1 --2- 172.21.15.120:0/1951282820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e74100e20 0x7f6e741991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:26.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.749+0000 7f6e7a0bb640 1 -- 172.21.15.120:0/1951282820 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e741a45e0 con 0x7f6e74102ef0 2024-09-19T05:18:26.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.749+0000 7f6e798ba640 1 --2- 172.21.15.120:0/1951282820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e74100e20 0x7f6e741991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:18:26.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.749+0000 7f6e7a0bb640 1 --2- 172.21.15.120:0/1951282820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e74102ef0 0x7f6e74199ca0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c006010 tx=0x7f6e6c02f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:26.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.749+0000 7f6e6affd640 1 -- 172.21.15.120:0/1951282820 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c034040 con 0x7f6e74102ef0 2024-09-19T05:18:26.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.749+0000 7f6e6affd640 1 -- 172.21.15.120:0/1951282820 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6e6c003e00 con 0x7f6e74102ef0 2024-09-19T05:18:26.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.749+0000 7f6e7bb1e640 1 -- 172.21.15.120:0/1951282820 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e741a4870 con 0x7f6e74102ef0 2024-09-19T05:18:26.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.749+0000 7f6e6affd640 1 -- 172.21.15.120:0/1951282820 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c045480 con 0x7f6e74102ef0 2024-09-19T05:18:26.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.749+0000 7f6e7bb1e640 1 -- 172.21.15.120:0/1951282820 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e741a4da0 con 0x7f6e74102ef0 2024-09-19T05:18:26.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.750+0000 7f6e7bb1e640 1 -- 172.21.15.120:0/1951282820 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e74101200 con 0x7f6e74102ef0 2024-09-19T05:18:26.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.752+0000 7f6e6affd640 1 -- 172.21.15.120:0/1951282820 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f6e6c037020 con 0x7f6e74102ef0 2024-09-19T05:18:26.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.753+0000 7f6e6affd640 1 --2- 172.21.15.120:0/1951282820 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f6e600a3350 0x7f6e600a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:26.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.753+0000 7f6e798ba640 1 --2- 172.21.15.120:0/1951282820 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f6e600a3350 0x7f6e600a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:26.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.753+0000 7f6e6affd640 1 -- 172.21.15.120:0/1951282820 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f6e6c0f0ca0 con 0x7f6e74102ef0 2024-09-19T05:18:26.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.753+0000 7f6e798ba640 1 --2- 172.21.15.120:0/1951282820 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f6e600a3350 0x7f6e600a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000abe0 tx=0x7f6e7000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:26.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.756+0000 7f6e6affd640 1 -- 172.21.15.120:0/1951282820 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6e6c0bd9e0 con 0x7f6e74102ef0 2024-09-19T05:18:26.939 INFO:teuthology.orchestra.run.smithi120.stdout:270582939682 2024-09-19T05:18:26.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.937+0000 7f6e7bb1e640 1 -- 172.21.15.120:0/1951282820 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f6e741a50c0 con 0x7f6e74102ef0 2024-09-19T05:18:26.940 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.937+0000 7f6e6affd640 1 -- 172.21.15.120:0/1951282820 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6e6c0bd2e0 con 0x7f6e74102ef0 2024-09-19T05:18:26.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.939+0000 7f6e7bb1e640 1 -- 172.21.15.120:0/1951282820 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f6e600a3350 msgr2=0x7f6e600a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:26.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.939+0000 7f6e7bb1e640 1 --2- 172.21.15.120:0/1951282820 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f6e600a3350 0x7f6e600a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000abe0 tx=0x7f6e7000a5c0 comp rx=0 tx=0).stop 2024-09-19T05:18:26.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.939+0000 7f6e7bb1e640 1 -- 172.21.15.120:0/1951282820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e74102ef0 msgr2=0x7f6e74199ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:26.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.939+0000 7f6e7bb1e640 1 --2- 172.21.15.120:0/1951282820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e74102ef0 0x7f6e74199ca0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c006010 tx=0x7f6e6c02f710 comp rx=0 tx=0).stop 2024-09-19T05:18:26.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.940+0000 7f6e7bb1e640 1 -- 172.21.15.120:0/1951282820 shutdown_connections 2024-09-19T05:18:26.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.940+0000 7f6e7bb1e640 1 --2- 172.21.15.120:0/1951282820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e74102ef0 0x7f6e74199ca0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:26.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.940+0000 7f6e7bb1e640 1 --2- 172.21.15.120:0/1951282820 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f6e600a3350 0x7f6e600a5810 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:26.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.940+0000 7f6e7bb1e640 1 --2- 172.21.15.120:0/1951282820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e74102570 0x7f6e74199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:26.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.940+0000 7f6e7bb1e640 1 --2- 172.21.15.120:0/1951282820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e74100e20 0x7f6e741991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:26.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.940+0000 7f6e7bb1e640 1 -- 172.21.15.120:0/1951282820 >> 172.21.15.120:0/1951282820 conn(0x7f6e740fc7d0 msgr2=0x7f6e740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:26.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.940+0000 7f6e7bb1e640 1 -- 172.21.15.120:0/1951282820 shutdown_connections 2024-09-19T05:18:26.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:26.940+0000 7f6e7bb1e640 1 -- 172.21.15.120:0/1951282820 wait complete. 2024-09-19T05:18:27.260 INFO:tasks.cephadm.ceph_manager.ceph:need seq 317827579925 got 317827579928 for osd.11 2024-09-19T05:18:27.261 DEBUG:teuthology.parallel:result is None 2024-09-19T05:18:27.494 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:27 smithi178 ceph-mon[34347]: pgmap v301: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T05:18:27.494 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:27 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1951282820' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T05:18:27.494 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:27 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:18:27.624 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:27 smithi120 ceph-mon[30956]: pgmap v301: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T05:18:27.624 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:27 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1951282820' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T05:18:27.624 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:27 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:18:27.652 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:27 smithi194 ceph-mon[35228]: pgmap v301: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T05:18:27.652 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:27 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1951282820' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T05:18:27.652 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:27 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:18:27.971 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939679 got 270582939682 for osd.9 2024-09-19T05:18:27.972 DEBUG:teuthology.parallel:result is None 2024-09-19T05:18:28.432 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:28.434 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808857 got 287762808861 for osd.10 2024-09-19T05:18:28.434 DEBUG:teuthology.parallel:result is None 2024-09-19T05:18:28.818 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:28.819 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:28.856 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444097 got 73014444100 for osd.2 2024-09-19T05:18:28.856 DEBUG:teuthology.parallel:result is None 2024-09-19T05:18:29.331 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:29 smithi120 ceph-mon[30956]: pgmap v302: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-19T05:18:29.331 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:29 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:18:29.331 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:29 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:18:29.331 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:29 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:18:29.331 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:29 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:18:29.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.520+0000 7f568f174640 1 -- 172.21.15.120:0/639162942 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5688101420 msgr2=0x7f568810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:29.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.520+0000 7f568f174640 1 --2- 172.21.15.120:0/639162942 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5688101420 0x7f568810d950 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5680009cd0 tx=0x7f568002a8e0 comp rx=0 tx=0).stop 2024-09-19T05:18:29.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.520+0000 7f568f174640 1 -- 172.21.15.120:0/639162942 shutdown_connections 2024-09-19T05:18:29.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.520+0000 7f568f174640 1 --2- 172.21.15.120:0/639162942 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5688101420 0x7f568810d950 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:29.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.520+0000 7f568f174640 1 --2- 172.21.15.120:0/639162942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5688100a80 0x7f5688100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:29.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.520+0000 7f568f174640 1 --2- 172.21.15.120:0/639162942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5688106a80 0x7f5688106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:29.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.520+0000 7f568f174640 1 -- 172.21.15.120:0/639162942 >> 172.21.15.120:0/639162942 conn(0x7f56880fc7a0 msgr2=0x7f56880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:29.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.520+0000 7f568f174640 1 -- 172.21.15.120:0/639162942 shutdown_connections 2024-09-19T05:18:29.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.520+0000 7f568f174640 1 -- 172.21.15.120:0/639162942 wait complete. 2024-09-19T05:18:29.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.520+0000 7f568f174640 1 Processor -- start 2024-09-19T05:18:29.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.520+0000 7f568f174640 1 -- start start 2024-09-19T05:18:29.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.521+0000 7f568f174640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5688100a80 0x7f5688198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:29.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.521+0000 7f568f174640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5688101420 0x7f5688198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:29.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.521+0000 7f568f174640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5688106a80 0x7f568819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:29.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.521+0000 7f568f174640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5688110d30 con 0x7f5688101420 2024-09-19T05:18:29.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.521+0000 7f568f174640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5688110bb0 con 0x7f5688100a80 2024-09-19T05:18:29.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.521+0000 7f568f174640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5688110eb0 con 0x7f5688106a80 2024-09-19T05:18:29.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.521+0000 7f5687fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5688101420 0x7f5688198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:29.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.521+0000 7f5687fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5688101420 0x7f5688198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60458/0 (socket says 172.21.15.120:60458) 2024-09-19T05:18:29.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.521+0000 7f5687fff640 1 -- 172.21.15.120:0/4229318751 learned_addr learned my addr 172.21.15.120:0/4229318751 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:29.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.521+0000 7f568cf10640 1 --2- 172.21.15.120:0/4229318751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5688100a80 0x7f5688198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:29.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.521+0000 7f568d711640 1 --2- 172.21.15.120:0/4229318751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5688106a80 0x7f568819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:29.550 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.521+0000 7f5687fff640 1 -- 172.21.15.120:0/4229318751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5688106a80 msgr2=0x7f568819cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:29.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.521+0000 7f5687fff640 1 --2- 172.21.15.120:0/4229318751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5688106a80 0x7f568819cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:29.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.521+0000 7f5687fff640 1 -- 172.21.15.120:0/4229318751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5688100a80 msgr2=0x7f5688198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:29.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.521+0000 7f5687fff640 1 --2- 172.21.15.120:0/4229318751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5688100a80 0x7f5688198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:29.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.521+0000 7f5687fff640 1 -- 172.21.15.120:0/4229318751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f568819d300 con 0x7f5688101420 2024-09-19T05:18:29.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.521+0000 7f568d711640 1 --2- 172.21.15.120:0/4229318751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5688106a80 0x7f568819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:29.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.521+0000 7f5687fff640 1 --2- 172.21.15.120:0/4229318751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5688101420 0x7f5688198890 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f567400e9f0 tx=0x7f567400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:29.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.521+0000 7f5685ffb640 1 -- 172.21.15.120:0/4229318751 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567400cd80 con 0x7f5688101420 2024-09-19T05:18:29.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.521+0000 7f5685ffb640 1 -- 172.21.15.120:0/4229318751 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f56740054d0 con 0x7f5688101420 2024-09-19T05:18:29.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.521+0000 7f568f174640 1 -- 172.21.15.120:0/4229318751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f568819d5f0 con 0x7f5688101420 2024-09-19T05:18:29.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.521+0000 7f5685ffb640 1 -- 172.21.15.120:0/4229318751 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5674010490 con 0x7f5688101420 2024-09-19T05:18:29.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.522+0000 7f568f174640 1 -- 172.21.15.120:0/4229318751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56881a4ed0 con 0x7f5688101420 2024-09-19T05:18:29.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.523+0000 7f568f174640 1 -- 172.21.15.120:0/4229318751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5688100ee0 con 0x7f5688101420 2024-09-19T05:18:29.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.523+0000 7f5685ffb640 1 -- 172.21.15.120:0/4229318751 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f5674005020 con 0x7f5688101420 2024-09-19T05:18:29.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.524+0000 7f5685ffb640 1 --2- 172.21.15.120:0/4229318751 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f56780a32d0 0x7f56780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:29.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.524+0000 7f568cf10640 1 --2- 172.21.15.120:0/4229318751 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f56780a32d0 0x7f56780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:29.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.524+0000 7f5685ffb640 1 -- 172.21.15.120:0/4229318751 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f56740cfed0 con 0x7f5688101420 2024-09-19T05:18:29.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.525+0000 7f568cf10640 1 --2- 172.21.15.120:0/4229318751 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f56780a32d0 0x7f56780a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f567c009b50 tx=0x7f567c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:29.552 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.528+0000 7f5685ffb640 1 -- 172.21.15.120:0/4229318751 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f567409ca70 con 0x7f5688101420 2024-09-19T05:18:29.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:29 smithi194 ceph-mon[35228]: pgmap v302: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-19T05:18:29.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:29 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:18:29.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:29 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:18:29.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:29 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:18:29.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:29 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:18:29.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:29 smithi178 ceph-mon[34347]: pgmap v302: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-19T05:18:29.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:18:29.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:18:29.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:18:29.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:29 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:18:29.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.700+0000 7f568f174640 1 -- 172.21.15.120:0/4229318751 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f56881996b0 con 0x7f5688101420 2024-09-19T05:18:29.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.700+0000 7f5685ffb640 1 -- 172.21.15.120:0/4229318751 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f567409c370 con 0x7f5688101420 2024-09-19T05:18:29.703 INFO:teuthology.orchestra.run.smithi120.stdout:240518168615 2024-09-19T05:18:29.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.703+0000 7f568f174640 1 -- 172.21.15.120:0/4229318751 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f56780a32d0 msgr2=0x7f56780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:29.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.703+0000 7f568f174640 1 --2- 172.21.15.120:0/4229318751 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f56780a32d0 0x7f56780a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f567c009b50 tx=0x7f567c005f90 comp rx=0 tx=0).stop 2024-09-19T05:18:29.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.703+0000 7f568f174640 1 -- 172.21.15.120:0/4229318751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5688101420 msgr2=0x7f5688198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:29.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.703+0000 7f568f174640 1 --2- 172.21.15.120:0/4229318751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5688101420 0x7f5688198890 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f567400e9f0 tx=0x7f567400edf0 comp rx=0 tx=0).stop 2024-09-19T05:18:29.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.703+0000 7f568f174640 1 -- 172.21.15.120:0/4229318751 shutdown_connections 2024-09-19T05:18:29.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.703+0000 7f568f174640 1 --2- 172.21.15.120:0/4229318751 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f56780a32d0 0x7f56780a5790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:29.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.703+0000 7f568f174640 1 --2- 172.21.15.120:0/4229318751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5688106a80 0x7f568819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:29.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.703+0000 7f568f174640 1 --2- 172.21.15.120:0/4229318751 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5688101420 0x7f5688198890 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:29.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.703+0000 7f568f174640 1 --2- 172.21.15.120:0/4229318751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5688100a80 0x7f5688198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:29.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.703+0000 7f568f174640 1 -- 172.21.15.120:0/4229318751 >> 172.21.15.120:0/4229318751 conn(0x7f56880fc7a0 msgr2=0x7f568806aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:29.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.703+0000 7f568f174640 1 -- 172.21.15.120:0/4229318751 shutdown_connections 2024-09-19T05:18:29.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.703+0000 7f568f174640 1 -- 172.21.15.120:0/4229318751 wait complete. 2024-09-19T05:18:29.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.771+0000 7f30d8bde640 1 -- 172.21.15.120:0/4140953773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30d4100e20 msgr2=0x7f30d4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:29.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.771+0000 7f30d8bde640 1 --2- 172.21.15.120:0/4140953773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30d4100e20 0x7f30d4101200 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009ca0 tx=0x7f30cc02a950 comp rx=0 tx=0).stop 2024-09-19T05:18:29.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.771+0000 7f30d8bde640 1 -- 172.21.15.120:0/4140953773 shutdown_connections 2024-09-19T05:18:29.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.771+0000 7f30d8bde640 1 --2- 172.21.15.120:0/4140953773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30d4102ef0 0x7f30d410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:29.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.771+0000 7f30d8bde640 1 --2- 172.21.15.120:0/4140953773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d4102570 0x7f30d41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:29.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.771+0000 7f30d8bde640 1 --2- 172.21.15.120:0/4140953773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30d4100e20 0x7f30d4101200 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:29.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.771+0000 7f30d8bde640 1 -- 172.21.15.120:0/4140953773 >> 172.21.15.120:0/4140953773 conn(0x7f30d40fc7d0 msgr2=0x7f30d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:29.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.771+0000 7f30d8bde640 1 -- 172.21.15.120:0/4140953773 shutdown_connections 2024-09-19T05:18:29.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.771+0000 7f30d8bde640 1 -- 172.21.15.120:0/4140953773 wait complete. 2024-09-19T05:18:29.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.772+0000 7f30d8bde640 1 Processor -- start 2024-09-19T05:18:29.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.772+0000 7f30d8bde640 1 -- start start 2024-09-19T05:18:29.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.772+0000 7f30d8bde640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30d4100e20 0x7f30d4198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:29.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.772+0000 7f30d8bde640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30d4102570 0x7f30d4198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:29.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.772+0000 7f30d8bde640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d4102ef0 0x7f30d419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:29.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.772+0000 7f30d8bde640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f30d4110e30 con 0x7f30d4102570 2024-09-19T05:18:29.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.772+0000 7f30d8bde640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f30d4110cb0 con 0x7f30d4100e20 2024-09-19T05:18:29.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.772+0000 7f30d8bde640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f30d4110fb0 con 0x7f30d4102ef0 2024-09-19T05:18:29.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.773+0000 7f30d1d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30d4102570 0x7f30d4198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:29.801 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.773+0000 7f30d259c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30d4100e20 0x7f30d4198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:29.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.773+0000 7f30d1d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30d4102570 0x7f30d4198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60468/0 (socket says 172.21.15.120:60468) 2024-09-19T05:18:29.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.773+0000 7f30d1d9b640 1 -- 172.21.15.120:0/1664599656 learned_addr learned my addr 172.21.15.120:0/1664599656 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:29.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.773+0000 7f30d259c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30d4100e20 0x7f30d4198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:34964/0 (socket says 172.21.15.120:34964) 2024-09-19T05:18:29.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.773+0000 7f30d2d9d640 1 --2- 172.21.15.120:0/1664599656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d4102ef0 0x7f30d419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:29.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.773+0000 7f30d259c640 1 -- 172.21.15.120:0/1664599656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d4102ef0 msgr2=0x7f30d419cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:29.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.773+0000 7f30d259c640 1 --2- 172.21.15.120:0/1664599656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d4102ef0 0x7f30d419cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:29.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.773+0000 7f30d259c640 1 -- 172.21.15.120:0/1664599656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30d4102570 msgr2=0x7f30d4198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:29.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.773+0000 7f30d259c640 1 --2- 172.21.15.120:0/1664599656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30d4102570 0x7f30d4198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:29.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.773+0000 7f30d259c640 1 -- 172.21.15.120:0/1664599656 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d419d3c0 con 0x7f30d4100e20 2024-09-19T05:18:29.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.773+0000 7f30d2d9d640 1 --2- 172.21.15.120:0/1664599656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d4102ef0 0x7f30d419cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:18:29.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.773+0000 7f30d1d9b640 1 --2- 172.21.15.120:0/1664599656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30d4102570 0x7f30d4198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:18:29.802 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.773+0000 7f30d259c640 1 --2- 172.21.15.120:0/1664599656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30d4100e20 0x7f30d4198410 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f30cc006010 tx=0x7f30cc02f5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:29.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.773+0000 7f30cb7fe640 1 -- 172.21.15.120:0/1664599656 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc034040 con 0x7f30d4100e20 2024-09-19T05:18:29.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.773+0000 7f30d8bde640 1 -- 172.21.15.120:0/1664599656 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30d419d650 con 0x7f30d4100e20 2024-09-19T05:18:29.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.773+0000 7f30cb7fe640 1 -- 172.21.15.120:0/1664599656 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f30cc0308f0 con 0x7f30d4100e20 2024-09-19T05:18:29.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.773+0000 7f30cb7fe640 1 -- 172.21.15.120:0/1664599656 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc0046b0 con 0x7f30d4100e20 2024-09-19T05:18:29.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.773+0000 7f30d8bde640 1 -- 172.21.15.120:0/1664599656 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30d41a4f90 con 0x7f30d4100e20 2024-09-19T05:18:29.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.774+0000 7f30d8bde640 1 -- 172.21.15.120:0/1664599656 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30d41021b0 con 0x7f30d4100e20 2024-09-19T05:18:29.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.775+0000 7f30cb7fe640 1 -- 172.21.15.120:0/1664599656 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f30cc037020 con 0x7f30d4100e20 2024-09-19T05:18:29.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.776+0000 7f30cb7fe640 1 --2- 172.21.15.120:0/1664599656 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f30c00a32d0 0x7f30c00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:29.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.776+0000 7f30d1d9b640 1 --2- 172.21.15.120:0/1664599656 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f30c00a32d0 0x7f30c00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:29.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.776+0000 7f30cb7fe640 1 -- 172.21.15.120:0/1664599656 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f30cc0f0a50 con 0x7f30d4100e20 2024-09-19T05:18:29.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.777+0000 7f30d1d9b640 1 --2- 172.21.15.120:0/1664599656 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f30c00a32d0 0x7f30c00a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f30d406afc0 tx=0x7f30bc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:29.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.779+0000 7f30cb7fe640 1 -- 172.21.15.120:0/1664599656 <== mon.2 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f30cc0bd6a0 con 0x7f30d4100e20 2024-09-19T05:18:29.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.948+0000 7f30d8bde640 1 -- 172.21.15.120:0/1664599656 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f30d41a5160 con 0x7f30d4100e20 2024-09-19T05:18:29.950 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.949+0000 7f30cb7fe640 1 -- 172.21.15.120:0/1664599656 <== mon.2 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f30cc0bcfa0 con 0x7f30d4100e20 2024-09-19T05:18:29.951 INFO:teuthology.orchestra.run.smithi120.stdout:158913790005 2024-09-19T05:18:29.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.951+0000 7f30d8bde640 1 -- 172.21.15.120:0/1664599656 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f30c00a32d0 msgr2=0x7f30c00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:29.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.951+0000 7f30d8bde640 1 --2- 172.21.15.120:0/1664599656 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f30c00a32d0 0x7f30c00a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f30d406afc0 tx=0x7f30bc00b410 comp rx=0 tx=0).stop 2024-09-19T05:18:29.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.951+0000 7f30d8bde640 1 -- 172.21.15.120:0/1664599656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30d4100e20 msgr2=0x7f30d4198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:29.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.951+0000 7f30d8bde640 1 --2- 172.21.15.120:0/1664599656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30d4100e20 0x7f30d4198410 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f30cc006010 tx=0x7f30cc02f5d0 comp rx=0 tx=0).stop 2024-09-19T05:18:29.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.951+0000 7f30d8bde640 1 -- 172.21.15.120:0/1664599656 shutdown_connections 2024-09-19T05:18:29.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.951+0000 7f30d8bde640 1 --2- 172.21.15.120:0/1664599656 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f30c00a32d0 0x7f30c00a5790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:29.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.951+0000 7f30d8bde640 1 --2- 172.21.15.120:0/1664599656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d4102ef0 0x7f30d419cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:29.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.951+0000 7f30d8bde640 1 --2- 172.21.15.120:0/1664599656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30d4102570 0x7f30d4198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:29.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.951+0000 7f30d8bde640 1 --2- 172.21.15.120:0/1664599656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30d4100e20 0x7f30d4198410 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:29.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.951+0000 7f30d8bde640 1 -- 172.21.15.120:0/1664599656 >> 172.21.15.120:0/1664599656 conn(0x7f30d40fc7d0 msgr2=0x7f30d4106030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:29.953 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.951+0000 7f30d8bde640 1 -- 172.21.15.120:0/1664599656 shutdown_connections 2024-09-19T05:18:29.954 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:29.951+0000 7f30d8bde640 1 -- 172.21.15.120:0/1664599656 wait complete. 2024-09-19T05:18:30.381 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168612 got 240518168615 for osd.8 2024-09-19T05:18:30.381 DEBUG:teuthology.parallel:result is None 2024-09-19T05:18:30.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:30 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/4229318751' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T05:18:30.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:30 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1664599656' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T05:18:30.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:30 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/4229318751' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T05:18:30.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:30 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1664599656' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T05:18:30.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:30 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/4229318751' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T05:18:30.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:30 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1664599656' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T05:18:31.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.051+0000 7f66710b0640 1 -- 172.21.15.120:0/3889243192 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f666c106f20 msgr2=0x7f666c10eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:31.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.051+0000 7f66710b0640 1 --2- 172.21.15.120:0/3889243192 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f666c106f20 0x7f666c10eaa0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6664009ca0 tx=0x7f666402a8c0 comp rx=0 tx=0).stop 2024-09-19T05:18:31.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.051+0000 7f66710b0640 1 -- 172.21.15.120:0/3889243192 shutdown_connections 2024-09-19T05:18:31.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.051+0000 7f66710b0640 1 --2- 172.21.15.120:0/3889243192 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f666c106f20 0x7f666c10eaa0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:31.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.051+0000 7f66710b0640 1 --2- 172.21.15.120:0/3889243192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f666c1027a0 0x7f666c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:31.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.051+0000 7f66710b0640 1 --2- 172.21.15.120:0/3889243192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f666c101df0 0x7f666c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:31.066 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.051+0000 7f66710b0640 1 -- 172.21.15.120:0/3889243192 >> 172.21.15.120:0/3889243192 conn(0x7f666c0fd8f0 msgr2=0x7f666c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:31.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.051+0000 7f66710b0640 1 -- 172.21.15.120:0/3889243192 shutdown_connections 2024-09-19T05:18:31.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.051+0000 7f66710b0640 1 -- 172.21.15.120:0/3889243192 wait complete. 2024-09-19T05:18:31.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.052+0000 7f66710b0640 1 Processor -- start 2024-09-19T05:18:31.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.052+0000 7f66710b0640 1 -- start start 2024-09-19T05:18:31.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.053+0000 7f66710b0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f666c101df0 0x7f666c198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:31.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.053+0000 7f66710b0640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f666c1027a0 0x7f666c198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:31.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.053+0000 7f66710b0640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f666c106f20 0x7f666c19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:31.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.053+0000 7f66710b0640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f666c111e30 con 0x7f666c101df0 2024-09-19T05:18:31.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.053+0000 7f66710b0640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f666c111cb0 con 0x7f666c106f20 2024-09-19T05:18:31.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.053+0000 7f66710b0640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f666c111fb0 con 0x7f666c1027a0 2024-09-19T05:18:31.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.053+0000 7f666ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f666c101df0 0x7f666c198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:31.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.053+0000 7f666ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f666c101df0 0x7f666c198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60490/0 (socket says 172.21.15.120:60490) 2024-09-19T05:18:31.067 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.053+0000 7f666ad9d640 1 -- 172.21.15.120:0/636849554 learned_addr learned my addr 172.21.15.120:0/636849554 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:31.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.053+0000 7f666a59c640 1 --2- 172.21.15.120:0/636849554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f666c1027a0 0x7f666c198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:31.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.053+0000 7f666b59e640 1 --2- 172.21.15.120:0/636849554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f666c106f20 0x7f666c19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:31.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.053+0000 7f666ad9d640 1 -- 172.21.15.120:0/636849554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f666c1027a0 msgr2=0x7f666c198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:31.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.053+0000 7f666ad9d640 1 --2- 172.21.15.120:0/636849554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f666c1027a0 0x7f666c198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:31.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.053+0000 7f666ad9d640 1 -- 172.21.15.120:0/636849554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f666c106f20 msgr2=0x7f666c19cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:31.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.053+0000 7f666ad9d640 1 --2- 172.21.15.120:0/636849554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f666c106f20 0x7f666c19cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:31.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.053+0000 7f666ad9d640 1 -- 172.21.15.120:0/636849554 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f666c19d300 con 0x7f666c101df0 2024-09-19T05:18:31.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.053+0000 7f666b59e640 1 --2- 172.21.15.120:0/636849554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f666c106f20 0x7f666c19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:31.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.053+0000 7f666ad9d640 1 --2- 172.21.15.120:0/636849554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f666c101df0 0x7f666c198350 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f665400d770 tx=0x7f665400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:31.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.053+0000 7f6663fff640 1 -- 172.21.15.120:0/636849554 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6654017070 con 0x7f666c101df0 2024-09-19T05:18:31.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.053+0000 7f66710b0640 1 -- 172.21.15.120:0/636849554 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f666c19d5f0 con 0x7f666c101df0 2024-09-19T05:18:31.068 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.053+0000 7f6663fff640 1 -- 172.21.15.120:0/636849554 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f66540054d0 con 0x7f666c101df0 2024-09-19T05:18:31.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.053+0000 7f6663fff640 1 -- 172.21.15.120:0/636849554 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6654004cf0 con 0x7f666c101df0 2024-09-19T05:18:31.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.053+0000 7f66710b0640 1 -- 172.21.15.120:0/636849554 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f666c1a4ed0 con 0x7f666c101df0 2024-09-19T05:18:31.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.054+0000 7f66710b0640 1 -- 172.21.15.120:0/636849554 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f666c1021d0 con 0x7f666c101df0 2024-09-19T05:18:31.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.055+0000 7f6663fff640 1 -- 172.21.15.120:0/636849554 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f6654004e90 con 0x7f666c101df0 2024-09-19T05:18:31.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.057+0000 7f6663fff640 1 --2- 172.21.15.120:0/636849554 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f66580a32d0 0x7f66580a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:31.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.057+0000 7f666a59c640 1 --2- 172.21.15.120:0/636849554 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f66580a32d0 0x7f66580a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:31.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.057+0000 7f6663fff640 1 -- 172.21.15.120:0/636849554 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f66540cf5e0 con 0x7f666c101df0 2024-09-19T05:18:31.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.057+0000 7f666a59c640 1 --2- 172.21.15.120:0/636849554 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f66580a32d0 0x7f66580a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f665c005d90 tx=0x7f665c005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:31.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.061+0000 7f6663fff640 1 -- 172.21.15.120:0/636849554 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f665409c180 con 0x7f666c101df0 2024-09-19T05:18:31.233 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.231+0000 7f66710b0640 1 -- 172.21.15.120:0/636849554 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f666c10a160 con 0x7f666c101df0 2024-09-19T05:18:31.234 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.232+0000 7f6663fff640 1 -- 172.21.15.120:0/636849554 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f665409ba80 con 0x7f666c101df0 2024-09-19T05:18:31.234 INFO:teuthology.orchestra.run.smithi120.stdout:210453397548 2024-09-19T05:18:31.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.234+0000 7f66710b0640 1 -- 172.21.15.120:0/636849554 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f66580a32d0 msgr2=0x7f66580a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:31.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.234+0000 7f66710b0640 1 --2- 172.21.15.120:0/636849554 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f66580a32d0 0x7f66580a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f665c005d90 tx=0x7f665c005d20 comp rx=0 tx=0).stop 2024-09-19T05:18:31.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.234+0000 7f66710b0640 1 -- 172.21.15.120:0/636849554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f666c101df0 msgr2=0x7f666c198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:31.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.234+0000 7f66710b0640 1 --2- 172.21.15.120:0/636849554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f666c101df0 0x7f666c198350 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f665400d770 tx=0x7f665400dc30 comp rx=0 tx=0).stop 2024-09-19T05:18:31.236 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.234+0000 7f66710b0640 1 -- 172.21.15.120:0/636849554 shutdown_connections 2024-09-19T05:18:31.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.234+0000 7f66710b0640 1 --2- 172.21.15.120:0/636849554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f666c106f20 0x7f666c19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:31.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.234+0000 7f66710b0640 1 --2- 172.21.15.120:0/636849554 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f66580a32d0 0x7f66580a5790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:31.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.234+0000 7f66710b0640 1 --2- 172.21.15.120:0/636849554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f666c1027a0 0x7f666c198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:31.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.234+0000 7f66710b0640 1 --2- 172.21.15.120:0/636849554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f666c101df0 0x7f666c198350 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:31.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.234+0000 7f66710b0640 1 -- 172.21.15.120:0/636849554 >> 172.21.15.120:0/636849554 conn(0x7f666c0fd8f0 msgr2=0x7f666c0fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:31.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.234+0000 7f66710b0640 1 -- 172.21.15.120:0/636849554 shutdown_connections 2024-09-19T05:18:31.237 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:31.234+0000 7f66710b0640 1 -- 172.21.15.120:0/636849554 wait complete. 2024-09-19T05:18:31.495 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:31 smithi120 ceph-mon[30956]: pgmap v303: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T05:18:31.495 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:31 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/636849554' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T05:18:31.521 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790003 got 158913790005 for osd.5 2024-09-19T05:18:31.521 DEBUG:teuthology.parallel:result is None 2024-09-19T05:18:31.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:31 smithi194 ceph-mon[35228]: pgmap v303: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T05:18:31.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:31 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/636849554' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T05:18:31.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:31 smithi178 ceph-mon[34347]: pgmap v303: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T05:18:31.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:31 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/636849554' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T05:18:32.805 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397545 got 210453397548 for osd.7 2024-09-19T05:18:32.806 DEBUG:teuthology.parallel:result is None 2024-09-19T05:18:32.806 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T05:18:32.806 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T05:18:33.099 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:33.545 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:33 smithi120 ceph-mon[30956]: pgmap v304: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T05:18:33.575 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.542+0000 7fd6d6b13640 1 -- 172.21.15.120:0/611624616 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6d0106a80 msgr2=0x7fd6d0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:33.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.542+0000 7fd6d6b13640 1 --2- 172.21.15.120:0/611624616 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6d0106a80 0x7fd6d0106e60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0009930 tx=0x7fd6c002a420 comp rx=0 tx=0).stop 2024-09-19T05:18:33.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.542+0000 7fd6d6b13640 1 -- 172.21.15.120:0/611624616 shutdown_connections 2024-09-19T05:18:33.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.542+0000 7fd6d6b13640 1 --2- 172.21.15.120:0/611624616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6d0101420 0x7fd6d010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:33.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.542+0000 7fd6d6b13640 1 --2- 172.21.15.120:0/611624616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6d0100a80 0x7fd6d0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:33.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.542+0000 7fd6d6b13640 1 --2- 172.21.15.120:0/611624616 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6d0106a80 0x7fd6d0106e60 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:33.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.542+0000 7fd6d6b13640 1 -- 172.21.15.120:0/611624616 >> 172.21.15.120:0/611624616 conn(0x7fd6d00fc7a0 msgr2=0x7fd6d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:33.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.543+0000 7fd6d6b13640 1 -- 172.21.15.120:0/611624616 shutdown_connections 2024-09-19T05:18:33.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.543+0000 7fd6d6b13640 1 -- 172.21.15.120:0/611624616 wait complete. 2024-09-19T05:18:33.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.543+0000 7fd6d6b13640 1 Processor -- start 2024-09-19T05:18:33.576 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.543+0000 7fd6d6b13640 1 -- start start 2024-09-19T05:18:33.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.543+0000 7fd6d6b13640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6d0100a80 0x7fd6d01a4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:33.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.543+0000 7fd6d6b13640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6d0101420 0x7fd6d01a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:33.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.544+0000 7fd6d6b13640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6d0106a80 0x7fd6d019eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:33.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.544+0000 7fd6d6b13640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d0110dd0 con 0x7fd6d0106a80 2024-09-19T05:18:33.577 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.544+0000 7fd6d6b13640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d0110c50 con 0x7fd6d0101420 2024-09-19T05:18:33.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.544+0000 7fd6d6b13640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d0110f50 con 0x7fd6d0100a80 2024-09-19T05:18:33.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.544+0000 7fd6d50b0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6d0106a80 0x7fd6d019eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:33.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.544+0000 7fd6d50b0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6d0106a80 0x7fd6d019eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60498/0 (socket says 172.21.15.120:60498) 2024-09-19T05:18:33.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.544+0000 7fd6d50b0640 1 -- 172.21.15.120:0/2651381196 learned_addr learned my addr 172.21.15.120:0/2651381196 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:33.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.544+0000 7fd6d48af640 1 --2- 172.21.15.120:0/2651381196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6d0100a80 0x7fd6d01a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:33.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.544+0000 7fd6cffff640 1 --2- 172.21.15.120:0/2651381196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6d0101420 0x7fd6d01a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:33.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.544+0000 7fd6d50b0640 1 -- 172.21.15.120:0/2651381196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6d0100a80 msgr2=0x7fd6d01a4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:33.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.544+0000 7fd6d50b0640 1 --2- 172.21.15.120:0/2651381196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6d0100a80 0x7fd6d01a4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:33.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.544+0000 7fd6d50b0640 1 -- 172.21.15.120:0/2651381196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6d0101420 msgr2=0x7fd6d01a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:33.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.544+0000 7fd6d50b0640 1 --2- 172.21.15.120:0/2651381196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6d0101420 0x7fd6d01a4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:33.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.544+0000 7fd6d50b0640 1 -- 172.21.15.120:0/2651381196 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d019f1e0 con 0x7fd6d0106a80 2024-09-19T05:18:33.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.544+0000 7fd6d50b0640 1 --2- 172.21.15.120:0/2651381196 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6d0106a80 0x7fd6d019eab0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800b970 tx=0x7fd6c800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:33.578 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.544+0000 7fd6cdffb640 1 -- 172.21.15.120:0/2651381196 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8019070 con 0x7fd6d0106a80 2024-09-19T05:18:33.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.544+0000 7fd6cdffb640 1 -- 172.21.15.120:0/2651381196 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd6c8014440 con 0x7fd6d0106a80 2024-09-19T05:18:33.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.544+0000 7fd6cdffb640 1 -- 172.21.15.120:0/2651381196 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c80075d0 con 0x7fd6d0106a80 2024-09-19T05:18:33.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.544+0000 7fd6d6b13640 1 -- 172.21.15.120:0/2651381196 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d019f4d0 con 0x7fd6d0106a80 2024-09-19T05:18:33.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.545+0000 7fd6d6b13640 1 -- 172.21.15.120:0/2651381196 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d01ab660 con 0x7fd6d0106a80 2024-09-19T05:18:33.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.545+0000 7fd6d6b13640 1 -- 172.21.15.120:0/2651381196 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6d0100f60 con 0x7fd6d0106a80 2024-09-19T05:18:33.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.546+0000 7fd6cdffb640 1 -- 172.21.15.120:0/2651381196 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fd6c801c070 con 0x7fd6d0106a80 2024-09-19T05:18:33.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.547+0000 7fd6cdffb640 1 --2- 172.21.15.120:0/2651381196 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd6b80a32d0 0x7fd6b80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:33.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.547+0000 7fd6d48af640 1 --2- 172.21.15.120:0/2651381196 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd6b80a32d0 0x7fd6b80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:33.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.547+0000 7fd6cdffb640 1 -- 172.21.15.120:0/2651381196 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fd6c80ceec0 con 0x7fd6d0106a80 2024-09-19T05:18:33.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.548+0000 7fd6d48af640 1 --2- 172.21.15.120:0/2651381196 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd6b80a32d0 0x7fd6b80a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0009900 tx=0x7fd6c0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:33.579 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.552+0000 7fd6cdffb640 1 -- 172.21.15.120:0/2651381196 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd6c809b520 con 0x7fd6d0106a80 2024-09-19T05:18:33.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:33 smithi194 ceph-mon[35228]: pgmap v304: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T05:18:33.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:33 smithi178 ceph-mon[34347]: pgmap v304: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T05:18:33.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.724+0000 7fd6d6b13640 1 -- 172.21.15.120:0/2651381196 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd6d00fde00 con 0x7fd6b80a32d0 2024-09-19T05:18:33.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.730+0000 7fd6cdffb640 1 -- 172.21.15.120:0/2651381196 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258711 (secure 0 0 0) 0x7fd6d00fde00 con 0x7fd6b80a32d0 2024-09-19T05:18:33.734 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:18:33.735 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-19T05:18:33.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.734+0000 7fd6d6b13640 1 -- 172.21.15.120:0/2651381196 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd6b80a32d0 msgr2=0x7fd6b80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:33.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.734+0000 7fd6d6b13640 1 --2- 172.21.15.120:0/2651381196 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd6b80a32d0 0x7fd6b80a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0009900 tx=0x7fd6c0000bc0 comp rx=0 tx=0).stop 2024-09-19T05:18:33.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.734+0000 7fd6d6b13640 1 -- 172.21.15.120:0/2651381196 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6d0106a80 msgr2=0x7fd6d019eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:33.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.734+0000 7fd6d6b13640 1 --2- 172.21.15.120:0/2651381196 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6d0106a80 0x7fd6d019eab0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800b970 tx=0x7fd6c800bd70 comp rx=0 tx=0).stop 2024-09-19T05:18:33.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.734+0000 7fd6d6b13640 1 -- 172.21.15.120:0/2651381196 shutdown_connections 2024-09-19T05:18:33.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.734+0000 7fd6d6b13640 1 --2- 172.21.15.120:0/2651381196 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6d0106a80 0x7fd6d019eab0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:33.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.734+0000 7fd6d6b13640 1 --2- 172.21.15.120:0/2651381196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6d0101420 0x7fd6d01a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:33.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.734+0000 7fd6d6b13640 1 --2- 172.21.15.120:0/2651381196 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd6b80a32d0 0x7fd6b80a5790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:33.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.734+0000 7fd6d6b13640 1 --2- 172.21.15.120:0/2651381196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6d0100a80 0x7fd6d01a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:33.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.734+0000 7fd6d6b13640 1 -- 172.21.15.120:0/2651381196 >> 172.21.15.120:0/2651381196 conn(0x7fd6d00fc7a0 msgr2=0x7fd6d006a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:33.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.734+0000 7fd6d6b13640 1 -- 172.21.15.120:0/2651381196 shutdown_connections 2024-09-19T05:18:33.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:33.734+0000 7fd6d6b13640 1 -- 172.21.15.120:0/2651381196 wait complete. 2024-09-19T05:18:34.513 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2024-09-19T05:18:32.146443+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655379,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":459,"num_read_kb":347,"num_write":347,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":278,"ondisk_log_size":278,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":391000,"kb_used_data":12588,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124550824,"statfs":{"total":1151940427776,"available":1151540043776,"internally_reserved":0,"allocated":12890112,"data_stored":7161345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":387233083},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002722"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255222+0000","last_change":"2024-09-19T05:17:30.200993+0000","last_active":"2024-09-19T05:17:49.255222+0000","last_peered":"2024-09-19T05:17:49.255222+0000","last_clean":"2024-09-19T05:17:49.255222+0000","last_became_active":"2024-09-19T05:17:30.200587+0000","last_became_peered":"2024-09-19T05:17:30.200587+0000","last_unstale":"2024-09-19T05:17:49.255222+0000","last_undegraded":"2024-09-19T05:17:49.255222+0000","last_fullsized":"2024-09-19T05:17:49.255222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:24.484844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258121+0000","last_change":"2024-09-19T05:17:30.207784+0000","last_active":"2024-09-19T05:17:49.258121+0000","last_peered":"2024-09-19T05:17:49.258121+0000","last_clean":"2024-09-19T05:17:49.258121+0000","last_became_active":"2024-09-19T05:17:30.207485+0000","last_became_peered":"2024-09-19T05:17:30.207485+0000","last_unstale":"2024-09-19T05:17:49.258121+0000","last_undegraded":"2024-09-19T05:17:49.258121+0000","last_fullsized":"2024-09-19T05:17:49.258121+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:07.864813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257951+0000","last_change":"2024-09-19T05:17:30.203861+0000","last_active":"2024-09-19T05:17:49.257951+0000","last_peered":"2024-09-19T05:17:49.257951+0000","last_clean":"2024-09-19T05:17:49.257951+0000","last_became_active":"2024-09-19T05:17:30.203541+0000","last_became_peered":"2024-09-19T05:17:30.203541+0000","last_unstale":"2024-09-19T05:17:49.257951+0000","last_undegraded":"2024-09-19T05:17:49.257951+0000","last_fullsized":"2024-09-19T05:17:49.257951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:33:44.840055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259314+0000","last_change":"2024-09-19T05:17:30.214534+0000","last_active":"2024-09-19T05:17:49.259314+0000","last_peered":"2024-09-19T05:17:49.259314+0000","last_clean":"2024-09-19T05:17:49.259314+0000","last_became_active":"2024-09-19T05:17:30.213840+0000","last_became_peered":"2024-09-19T05:17:30.213840+0000","last_unstale":"2024-09-19T05:17:49.259314+0000","last_undegraded":"2024-09-19T05:17:49.259314+0000","last_fullsized":"2024-09-19T05:17:49.259314+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:03.673488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.505274+0000","last_change":"2024-09-19T05:17:30.201451+0000","last_active":"2024-09-19T05:17:49.505274+0000","last_peered":"2024-09-19T05:17:49.505274+0000","last_clean":"2024-09-19T05:17:49.505274+0000","last_became_active":"2024-09-19T05:17:30.201092+0000","last_became_peered":"2024-09-19T05:17:30.201092+0000","last_unstale":"2024-09-19T05:17:49.505274+0000","last_undegraded":"2024-09-19T05:17:49.505274+0000","last_fullsized":"2024-09-19T05:17:49.505274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:18.958271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.506669+0000","last_change":"2024-09-19T05:17:49.506669+0000","last_active":"2024-09-19T05:17:49.506669+0000","last_peered":"2024-09-19T05:17:49.506669+0000","last_clean":"2024-09-19T05:17:49.506669+0000","last_became_active":"2024-09-19T05:17:49.506331+0000","last_became_peered":"2024-09-19T05:17:49.506331+0000","last_unstale":"2024-09-19T05:17:49.506669+0000","last_undegraded":"2024-09-19T05:17:49.506669+0000","last_fullsized":"2024-09-19T05:17:49.506669+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:23.460781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.506866+0000","last_change":"2024-09-19T05:17:49.506866+0000","last_active":"2024-09-19T05:17:49.506866+0000","last_peered":"2024-09-19T05:17:49.506866+0000","last_clean":"2024-09-19T05:17:49.506866+0000","last_became_active":"2024-09-19T05:17:49.506386+0000","last_became_peered":"2024-09-19T05:17:49.506386+0000","last_unstale":"2024-09-19T05:17:49.506866+0000","last_undegraded":"2024-09-19T05:17:49.506866+0000","last_fullsized":"2024-09-19T05:17:49.506866+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:17.060301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258361+0000","last_change":"2024-09-19T05:17:30.210132+0000","last_active":"2024-09-19T05:17:49.258361+0000","last_peered":"2024-09-19T05:17:49.258361+0000","last_clean":"2024-09-19T05:17:49.258361+0000","last_became_active":"2024-09-19T05:17:30.209240+0000","last_became_peered":"2024-09-19T05:17:30.209240+0000","last_unstale":"2024-09-19T05:17:49.258361+0000","last_undegraded":"2024-09-19T05:17:49.258361+0000","last_fullsized":"2024-09-19T05:17:49.258361+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:08:26.999751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259817+0000","last_change":"2024-09-19T05:17:49.259291+0000","last_active":"2024-09-19T05:17:49.259817+0000","last_peered":"2024-09-19T05:17:49.259817+0000","last_clean":"2024-09-19T05:17:49.259817+0000","last_became_active":"2024-09-19T05:17:49.258948+0000","last_became_peered":"2024-09-19T05:17:49.258948+0000","last_unstale":"2024-09-19T05:17:49.259817+0000","last_undegraded":"2024-09-19T05:17:49.259817+0000","last_fullsized":"2024-09-19T05:17:49.259817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:51.082539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,11],"acting":[9,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258154+0000","last_change":"2024-09-19T05:17:30.205429+0000","last_active":"2024-09-19T05:17:49.258154+0000","last_peered":"2024-09-19T05:17:49.258154+0000","last_clean":"2024-09-19T05:17:49.258154+0000","last_became_active":"2024-09-19T05:17:30.205094+0000","last_became_peered":"2024-09-19T05:17:30.205094+0000","last_unstale":"2024-09-19T05:17:49.258154+0000","last_undegraded":"2024-09-19T05:17:49.258154+0000","last_fullsized":"2024-09-19T05:17:49.258154+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:22.149473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258808+0000","last_change":"2024-09-19T05:17:30.213050+0000","last_active":"2024-09-19T05:17:49.258808+0000","last_peered":"2024-09-19T05:17:49.258808+0000","last_clean":"2024-09-19T05:17:49.258808+0000","last_became_active":"2024-09-19T05:17:30.211812+0000","last_became_peered":"2024-09-19T05:17:30.211812+0000","last_unstale":"2024-09-19T05:17:49.258808+0000","last_undegraded":"2024-09-19T05:17:49.258808+0000","last_fullsized":"2024-09-19T05:17:49.258808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:31.734317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259448+0000","last_change":"2024-09-19T05:17:30.212049+0000","last_active":"2024-09-19T05:17:49.259448+0000","last_peered":"2024-09-19T05:17:49.259448+0000","last_clean":"2024-09-19T05:17:49.259448+0000","last_became_active":"2024-09-19T05:17:30.211684+0000","last_became_peered":"2024-09-19T05:17:30.211684+0000","last_unstale":"2024-09-19T05:17:49.259448+0000","last_undegraded":"2024-09-19T05:17:49.259448+0000","last_fullsized":"2024-09-19T05:17:49.259448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:24.781815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255080+0000","last_change":"2024-09-19T05:17:30.191898+0000","last_active":"2024-09-19T05:17:49.255080+0000","last_peered":"2024-09-19T05:17:49.255080+0000","last_clean":"2024-09-19T05:17:49.255080+0000","last_became_active":"2024-09-19T05:17:30.191204+0000","last_became_peered":"2024-09-19T05:17:30.191204+0000","last_unstale":"2024-09-19T05:17:49.255080+0000","last_undegraded":"2024-09-19T05:17:49.255080+0000","last_fullsized":"2024-09-19T05:17:49.255080+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:19.043363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257585+0000","last_change":"2024-09-19T05:17:30.201754+0000","last_active":"2024-09-19T05:17:49.257585+0000","last_peered":"2024-09-19T05:17:49.257585+0000","last_clean":"2024-09-19T05:17:49.257585+0000","last_became_active":"2024-09-19T05:17:30.201439+0000","last_became_peered":"2024-09-19T05:17:30.201439+0000","last_unstale":"2024-09-19T05:17:49.257585+0000","last_undegraded":"2024-09-19T05:17:49.257585+0000","last_fullsized":"2024-09-19T05:17:49.257585+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:28.896899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257640+0000","last_change":"2024-09-19T05:17:30.202618+0000","last_active":"2024-09-19T05:17:49.257640+0000","last_peered":"2024-09-19T05:17:49.257640+0000","last_clean":"2024-09-19T05:17:49.257640+0000","last_became_active":"2024-09-19T05:17:30.202292+0000","last_became_peered":"2024-09-19T05:17:30.202292+0000","last_unstale":"2024-09-19T05:17:49.257640+0000","last_undegraded":"2024-09-19T05:17:49.257640+0000","last_fullsized":"2024-09-19T05:17:49.257640+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:54.206467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253112+0000","last_change":"2024-09-19T05:17:30.209411+0000","last_active":"2024-09-19T05:17:49.253112+0000","last_peered":"2024-09-19T05:17:49.253112+0000","last_clean":"2024-09-19T05:17:49.253112+0000","last_became_active":"2024-09-19T05:17:30.208525+0000","last_became_peered":"2024-09-19T05:17:30.208525+0000","last_unstale":"2024-09-19T05:17:49.253112+0000","last_undegraded":"2024-09-19T05:17:49.253112+0000","last_fullsized":"2024-09-19T05:17:49.253112+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:12:16.616413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255289+0000","last_change":"2024-09-19T05:17:30.203552+0000","last_active":"2024-09-19T05:17:49.255289+0000","last_peered":"2024-09-19T05:17:49.255289+0000","last_clean":"2024-09-19T05:17:49.255289+0000","last_became_active":"2024-09-19T05:17:30.203212+0000","last_became_peered":"2024-09-19T05:17:30.203212+0000","last_unstale":"2024-09-19T05:17:49.255289+0000","last_undegraded":"2024-09-19T05:17:49.255289+0000","last_fullsized":"2024-09-19T05:17:49.255289+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:38:50.948373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257055+0000","last_change":"2024-09-19T05:17:30.201540+0000","last_active":"2024-09-19T05:17:49.257055+0000","last_peered":"2024-09-19T05:17:49.257055+0000","last_clean":"2024-09-19T05:17:49.257055+0000","last_became_active":"2024-09-19T05:17:30.201222+0000","last_became_peered":"2024-09-19T05:17:30.201222+0000","last_unstale":"2024-09-19T05:17:49.257055+0000","last_undegraded":"2024-09-19T05:17:49.257055+0000","last_fullsized":"2024-09-19T05:17:49.257055+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:09.583473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253195+0000","last_change":"2024-09-19T05:17:30.205962+0000","last_active":"2024-09-19T05:17:49.253195+0000","last_peered":"2024-09-19T05:17:49.253195+0000","last_clean":"2024-09-19T05:17:49.253195+0000","last_became_active":"2024-09-19T05:17:30.205632+0000","last_became_peered":"2024-09-19T05:17:30.205632+0000","last_unstale":"2024-09-19T05:17:49.253195+0000","last_undegraded":"2024-09-19T05:17:49.253195+0000","last_fullsized":"2024-09-19T05:17:49.253195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:07.767502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254604+0000","last_change":"2024-09-19T05:17:30.208546+0000","last_active":"2024-09-19T05:17:49.254604+0000","last_peered":"2024-09-19T05:17:49.254604+0000","last_clean":"2024-09-19T05:17:49.254604+0000","last_became_active":"2024-09-19T05:17:30.208220+0000","last_became_peered":"2024-09-19T05:17:30.208220+0000","last_unstale":"2024-09-19T05:17:49.254604+0000","last_undegraded":"2024-09-19T05:17:49.254604+0000","last_fullsized":"2024-09-19T05:17:49.254604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:46:32.360282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255086+0000","last_change":"2024-09-19T05:17:30.204653+0000","last_active":"2024-09-19T05:17:49.255086+0000","last_peered":"2024-09-19T05:17:49.255086+0000","last_clean":"2024-09-19T05:17:49.255086+0000","last_became_active":"2024-09-19T05:17:30.204335+0000","last_became_peered":"2024-09-19T05:17:30.204335+0000","last_unstale":"2024-09-19T05:17:49.255086+0000","last_undegraded":"2024-09-19T05:17:49.255086+0000","last_fullsized":"2024-09-19T05:17:49.255086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:48.661902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.261216+0000","last_change":"2024-09-19T05:17:49.261216+0000","last_active":"2024-09-19T05:17:49.261216+0000","last_peered":"2024-09-19T05:17:49.261216+0000","last_clean":"2024-09-19T05:17:49.261216+0000","last_became_active":"2024-09-19T05:17:49.260691+0000","last_became_peered":"2024-09-19T05:17:49.260691+0000","last_unstale":"2024-09-19T05:17:49.261216+0000","last_undegraded":"2024-09-19T05:17:49.261216+0000","last_fullsized":"2024-09-19T05:17:49.261216+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:35.937669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,6],"acting":[1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257699+0000","last_change":"2024-09-19T05:17:30.201935+0000","last_active":"2024-09-19T05:17:49.257699+0000","last_peered":"2024-09-19T05:17:49.257699+0000","last_clean":"2024-09-19T05:17:49.257699+0000","last_became_active":"2024-09-19T05:17:30.201524+0000","last_became_peered":"2024-09-19T05:17:30.201524+0000","last_unstale":"2024-09-19T05:17:49.257699+0000","last_undegraded":"2024-09-19T05:17:49.257699+0000","last_fullsized":"2024-09-19T05:17:49.257699+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:34.018339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.506519+0000","last_change":"2024-09-19T05:17:49.506519+0000","last_active":"2024-09-19T05:17:49.506519+0000","last_peered":"2024-09-19T05:17:49.506519+0000","last_clean":"2024-09-19T05:17:49.506519+0000","last_became_active":"2024-09-19T05:17:49.506016+0000","last_became_peered":"2024-09-19T05:17:49.506016+0000","last_unstale":"2024-09-19T05:17:49.506519+0000","last_undegraded":"2024-09-19T05:17:49.506519+0000","last_fullsized":"2024-09-19T05:17:49.506519+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:31.064318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,8],"acting":[5,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258690+0000","last_change":"2024-09-19T05:17:30.205459+0000","last_active":"2024-09-19T05:17:49.258690+0000","last_peered":"2024-09-19T05:17:49.258690+0000","last_clean":"2024-09-19T05:17:49.258690+0000","last_became_active":"2024-09-19T05:17:30.205100+0000","last_became_peered":"2024-09-19T05:17:30.205100+0000","last_unstale":"2024-09-19T05:17:49.258690+0000","last_undegraded":"2024-09-19T05:17:49.258690+0000","last_fullsized":"2024-09-19T05:17:49.258690+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:35.246931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253212+0000","last_change":"2024-09-19T05:17:30.202812+0000","last_active":"2024-09-19T05:17:49.253212+0000","last_peered":"2024-09-19T05:17:49.253212+0000","last_clean":"2024-09-19T05:17:49.253212+0000","last_became_active":"2024-09-19T05:17:30.202477+0000","last_became_peered":"2024-09-19T05:17:30.202477+0000","last_unstale":"2024-09-19T05:17:49.253212+0000","last_undegraded":"2024-09-19T05:17:49.253212+0000","last_fullsized":"2024-09-19T05:17:49.253212+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:24.253576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254759+0000","last_change":"2024-09-19T05:17:30.206546+0000","last_active":"2024-09-19T05:17:49.254759+0000","last_peered":"2024-09-19T05:17:49.254759+0000","last_clean":"2024-09-19T05:17:49.254759+0000","last_became_active":"2024-09-19T05:17:30.206186+0000","last_became_peered":"2024-09-19T05:17:30.206186+0000","last_unstale":"2024-09-19T05:17:49.254759+0000","last_undegraded":"2024-09-19T05:17:49.254759+0000","last_fullsized":"2024-09-19T05:17:49.254759+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:30.589196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254959+0000","last_change":"2024-09-19T05:17:30.213894+0000","last_active":"2024-09-19T05:17:49.254959+0000","last_peered":"2024-09-19T05:17:49.254959+0000","last_clean":"2024-09-19T05:17:49.254959+0000","last_became_active":"2024-09-19T05:17:30.213586+0000","last_became_peered":"2024-09-19T05:17:30.213586+0000","last_unstale":"2024-09-19T05:17:49.254959+0000","last_undegraded":"2024-09-19T05:17:49.254959+0000","last_fullsized":"2024-09-19T05:17:49.254959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:46.215816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.262965+0000","last_change":"2024-09-19T05:17:49.262965+0000","last_active":"2024-09-19T05:17:49.262965+0000","last_peered":"2024-09-19T05:17:49.262965+0000","last_clean":"2024-09-19T05:17:49.262965+0000","last_became_active":"2024-09-19T05:17:49.262651+0000","last_became_peered":"2024-09-19T05:17:49.262651+0000","last_unstale":"2024-09-19T05:17:49.262965+0000","last_undegraded":"2024-09-19T05:17:49.262965+0000","last_fullsized":"2024-09-19T05:17:49.262965+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:57.601031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.252888+0000","last_change":"2024-09-19T05:17:30.204302+0000","last_active":"2024-09-19T05:17:49.252888+0000","last_peered":"2024-09-19T05:17:49.252888+0000","last_clean":"2024-09-19T05:17:49.252888+0000","last_became_active":"2024-09-19T05:17:30.203981+0000","last_became_peered":"2024-09-19T05:17:30.203981+0000","last_unstale":"2024-09-19T05:17:49.252888+0000","last_undegraded":"2024-09-19T05:17:49.252888+0000","last_fullsized":"2024-09-19T05:17:49.252888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:59.130439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.252943+0000","last_change":"2024-09-19T05:17:30.210610+0000","last_active":"2024-09-19T05:17:49.252943+0000","last_peered":"2024-09-19T05:17:49.252943+0000","last_clean":"2024-09-19T05:17:49.252943+0000","last_became_active":"2024-09-19T05:17:30.210231+0000","last_became_peered":"2024-09-19T05:17:30.210231+0000","last_unstale":"2024-09-19T05:17:49.252943+0000","last_undegraded":"2024-09-19T05:17:49.252943+0000","last_fullsized":"2024-09-19T05:17:49.252943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:37:41.885822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254442+0000","last_change":"2024-09-19T05:17:30.210755+0000","last_active":"2024-09-19T05:17:49.254442+0000","last_peered":"2024-09-19T05:17:49.254442+0000","last_clean":"2024-09-19T05:17:49.254442+0000","last_became_active":"2024-09-19T05:17:30.210383+0000","last_became_peered":"2024-09-19T05:17:30.210383+0000","last_unstale":"2024-09-19T05:17:49.254442+0000","last_undegraded":"2024-09-19T05:17:49.254442+0000","last_fullsized":"2024-09-19T05:17:49.254442+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:11.259830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.505151+0000","last_change":"2024-09-19T05:17:30.206345+0000","last_active":"2024-09-19T05:17:49.505151+0000","last_peered":"2024-09-19T05:17:49.505151+0000","last_clean":"2024-09-19T05:17:49.505151+0000","last_became_active":"2024-09-19T05:17:30.205988+0000","last_became_peered":"2024-09-19T05:17:30.205988+0000","last_unstale":"2024-09-19T05:17:49.505151+0000","last_undegraded":"2024-09-19T05:17:49.505151+0000","last_fullsized":"2024-09-19T05:17:49.505151+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:57.538280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:18:28.314196+0000","last_change":"2024-09-19T05:17:28.183851+0000","last_active":"2024-09-19T05:18:28.314196+0000","last_peered":"2024-09-19T05:18:28.314196+0000","last_clean":"2024-09-19T05:18:28.314196+0000","last_became_active":"2024-09-19T05:17:28.183472+0000","last_became_peered":"2024-09-19T05:17:28.183472+0000","last_unstale":"2024-09-19T05:18:28.314196+0000","last_undegraded":"2024-09-19T05:18:28.314196+0000","last_fullsized":"2024-09-19T05:18:28.314196+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:22.942306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255294+0000","last_change":"2024-09-19T05:17:30.208784+0000","last_active":"2024-09-19T05:17:49.255294+0000","last_peered":"2024-09-19T05:17:49.255294+0000","last_clean":"2024-09-19T05:17:49.255294+0000","last_became_active":"2024-09-19T05:17:30.208232+0000","last_became_peered":"2024-09-19T05:17:30.208232+0000","last_unstale":"2024-09-19T05:17:49.255294+0000","last_undegraded":"2024-09-19T05:17:49.255294+0000","last_fullsized":"2024-09-19T05:17:49.255294+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:07.670401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257109+0000","last_change":"2024-09-19T05:17:28.181480+0000","last_active":"2024-09-19T05:17:49.257109+0000","last_peered":"2024-09-19T05:17:49.257109+0000","last_clean":"2024-09-19T05:17:49.257109+0000","last_became_active":"2024-09-19T05:17:28.181169+0000","last_became_peered":"2024-09-19T05:17:28.181169+0000","last_unstale":"2024-09-19T05:17:49.257109+0000","last_undegraded":"2024-09-19T05:17:49.257109+0000","last_fullsized":"2024-09-19T05:17:49.257109+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:09.590408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254730+0000","last_change":"2024-09-19T05:17:28.180636+0000","last_active":"2024-09-19T05:17:49.254730+0000","last_peered":"2024-09-19T05:17:49.254730+0000","last_clean":"2024-09-19T05:17:49.254730+0000","last_became_active":"2024-09-19T05:17:28.180298+0000","last_became_peered":"2024-09-19T05:17:28.180298+0000","last_unstale":"2024-09-19T05:17:49.254730+0000","last_undegraded":"2024-09-19T05:17:49.254730+0000","last_fullsized":"2024-09-19T05:17:49.254730+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:06.361677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258465+0000","last_change":"2024-09-19T05:17:30.199091+0000","last_active":"2024-09-19T05:17:49.258465+0000","last_peered":"2024-09-19T05:17:49.258465+0000","last_clean":"2024-09-19T05:17:49.258465+0000","last_became_active":"2024-09-19T05:17:30.198805+0000","last_became_peered":"2024-09-19T05:17:30.198805+0000","last_unstale":"2024-09-19T05:17:49.258465+0000","last_undegraded":"2024-09-19T05:17:49.258465+0000","last_fullsized":"2024-09-19T05:17:49.258465+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:27.906713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.256486+0000","last_change":"2024-09-19T05:17:28.182281+0000","last_active":"2024-09-19T05:17:49.256486+0000","last_peered":"2024-09-19T05:17:49.256486+0000","last_clean":"2024-09-19T05:17:49.256486+0000","last_became_active":"2024-09-19T05:17:28.181939+0000","last_became_peered":"2024-09-19T05:17:28.181939+0000","last_unstale":"2024-09-19T05:17:49.256486+0000","last_undegraded":"2024-09-19T05:17:49.256486+0000","last_fullsized":"2024-09-19T05:17:49.256486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:12.057601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.256715+0000","last_change":"2024-09-19T05:17:30.198849+0000","last_active":"2024-09-19T05:17:49.256715+0000","last_peered":"2024-09-19T05:17:49.256715+0000","last_clean":"2024-09-19T05:17:49.256715+0000","last_became_active":"2024-09-19T05:17:30.198473+0000","last_became_peered":"2024-09-19T05:17:30.198473+0000","last_unstale":"2024-09-19T05:17:49.256715+0000","last_undegraded":"2024-09-19T05:17:49.256715+0000","last_fullsized":"2024-09-19T05:17:49.256715+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:20.591516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":73,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:18:26.311323+0000","last_change":"2024-09-19T05:17:28.181393+0000","last_active":"2024-09-19T05:18:26.311323+0000","last_peered":"2024-09-19T05:18:26.311323+0000","last_clean":"2024-09-19T05:18:26.311323+0000","last_became_active":"2024-09-19T05:17:28.181069+0000","last_became_peered":"2024-09-19T05:17:28.181069+0000","last_unstale":"2024-09-19T05:18:26.311323+0000","last_undegraded":"2024-09-19T05:18:26.311323+0000","last_fullsized":"2024-09-19T05:18:26.311323+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:15.684564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253792+0000","last_change":"2024-09-19T05:17:30.204968+0000","last_active":"2024-09-19T05:17:49.253792+0000","last_peered":"2024-09-19T05:17:49.253792+0000","last_clean":"2024-09-19T05:17:49.253792+0000","last_became_active":"2024-09-19T05:17:30.204613+0000","last_became_peered":"2024-09-19T05:17:30.204613+0000","last_unstale":"2024-09-19T05:17:49.253792+0000","last_undegraded":"2024-09-19T05:17:49.253792+0000","last_fullsized":"2024-09-19T05:17:49.253792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:14.836220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258502+0000","last_change":"2024-09-19T05:17:28.185554+0000","last_active":"2024-09-19T05:17:49.258502+0000","last_peered":"2024-09-19T05:17:49.258502+0000","last_clean":"2024-09-19T05:17:49.258502+0000","last_became_active":"2024-09-19T05:17:28.185198+0000","last_became_peered":"2024-09-19T05:17:28.185198+0000","last_unstale":"2024-09-19T05:17:49.258502+0000","last_undegraded":"2024-09-19T05:17:49.258502+0000","last_fullsized":"2024-09-19T05:17:49.258502+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:59.753359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258434+0000","last_change":"2024-09-19T05:17:30.207418+0000","last_active":"2024-09-19T05:17:49.258434+0000","last_peered":"2024-09-19T05:17:49.258434+0000","last_clean":"2024-09-19T05:17:49.258434+0000","last_became_active":"2024-09-19T05:17:30.207079+0000","last_became_peered":"2024-09-19T05:17:30.207079+0000","last_unstale":"2024-09-19T05:17:49.258434+0000","last_undegraded":"2024-09-19T05:17:49.258434+0000","last_fullsized":"2024-09-19T05:17:49.258434+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:40:49.564649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255759+0000","last_change":"2024-09-19T05:17:28.204988+0000","last_active":"2024-09-19T05:17:49.255759+0000","last_peered":"2024-09-19T05:17:49.255759+0000","last_clean":"2024-09-19T05:17:49.255759+0000","last_became_active":"2024-09-19T05:17:28.204607+0000","last_became_peered":"2024-09-19T05:17:28.204607+0000","last_unstale":"2024-09-19T05:17:49.255759+0000","last_undegraded":"2024-09-19T05:17:49.255759+0000","last_fullsized":"2024-09-19T05:17:49.255759+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:17.914720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253360+0000","last_change":"2024-09-19T05:17:30.207876+0000","last_active":"2024-09-19T05:17:49.253360+0000","last_peered":"2024-09-19T05:17:49.253360+0000","last_clean":"2024-09-19T05:17:49.253360+0000","last_became_active":"2024-09-19T05:17:30.207561+0000","last_became_peered":"2024-09-19T05:17:30.207561+0000","last_unstale":"2024-09-19T05:17:49.253360+0000","last_undegraded":"2024-09-19T05:17:49.253360+0000","last_fullsized":"2024-09-19T05:17:49.253360+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:26.696949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'29","reported_seq":156,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:18:27.312465+0000","last_change":"2024-09-19T05:17:28.185152+0000","last_active":"2024-09-19T05:18:27.312465+0000","last_peered":"2024-09-19T05:18:27.312465+0000","last_clean":"2024-09-19T05:18:27.312465+0000","last_became_active":"2024-09-19T05:17:28.184792+0000","last_became_peered":"2024-09-19T05:17:28.184792+0000","last_unstale":"2024-09-19T05:18:27.312465+0000","last_undegraded":"2024-09-19T05:18:27.312465+0000","last_fullsized":"2024-09-19T05:18:27.312465+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:04.647138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61167,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":111,"num_write":30,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.505387+0000","last_change":"2024-09-19T05:17:30.209768+0000","last_active":"2024-09-19T05:17:49.505387+0000","last_peered":"2024-09-19T05:17:49.505387+0000","last_clean":"2024-09-19T05:17:49.505387+0000","last_became_active":"2024-09-19T05:17:30.209399+0000","last_became_peered":"2024-09-19T05:17:30.209399+0000","last_unstale":"2024-09-19T05:17:49.505387+0000","last_undegraded":"2024-09-19T05:17:49.505387+0000","last_fullsized":"2024-09-19T05:17:49.505387+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:58.664138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.269672+0000","last_change":"2024-09-19T05:17:49.269241+0000","last_active":"2024-09-19T05:17:49.269672+0000","last_peered":"2024-09-19T05:17:49.269672+0000","last_clean":"2024-09-19T05:17:49.269672+0000","last_became_active":"2024-09-19T05:17:49.259494+0000","last_became_peered":"2024-09-19T05:17:49.259494+0000","last_unstale":"2024-09-19T05:17:49.269672+0000","last_undegraded":"2024-09-19T05:17:49.269672+0000","last_fullsized":"2024-09-19T05:17:49.269672+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:59.866742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254867+0000","last_change":"2024-09-19T05:17:30.204554+0000","last_active":"2024-09-19T05:17:49.254867+0000","last_peered":"2024-09-19T05:17:49.254867+0000","last_clean":"2024-09-19T05:17:49.254867+0000","last_became_active":"2024-09-19T05:17:30.203166+0000","last_became_peered":"2024-09-19T05:17:30.203166+0000","last_unstale":"2024-09-19T05:17:49.254867+0000","last_undegraded":"2024-09-19T05:17:49.254867+0000","last_fullsized":"2024-09-19T05:17:49.254867+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:23.517869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255318+0000","last_change":"2024-09-19T05:17:28.183800+0000","last_active":"2024-09-19T05:17:49.255318+0000","last_peered":"2024-09-19T05:17:49.255318+0000","last_clean":"2024-09-19T05:17:49.255318+0000","last_became_active":"2024-09-19T05:17:28.182819+0000","last_became_peered":"2024-09-19T05:17:28.182819+0000","last_unstale":"2024-09-19T05:17:49.255318+0000","last_undegraded":"2024-09-19T05:17:49.255318+0000","last_fullsized":"2024-09-19T05:17:49.255318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:44:52.215544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257754+0000","last_change":"2024-09-19T05:17:30.214723+0000","last_active":"2024-09-19T05:17:49.257754+0000","last_peered":"2024-09-19T05:17:49.257754+0000","last_clean":"2024-09-19T05:17:49.257754+0000","last_became_active":"2024-09-19T05:17:30.214343+0000","last_became_peered":"2024-09-19T05:17:30.214343+0000","last_unstale":"2024-09-19T05:17:49.257754+0000","last_undegraded":"2024-09-19T05:17:49.257754+0000","last_fullsized":"2024-09-19T05:17:49.257754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:13.008151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":78,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:18:29.330926+0000","last_change":"2024-09-19T05:17:28.183130+0000","last_active":"2024-09-19T05:18:29.330926+0000","last_peered":"2024-09-19T05:18:29.330926+0000","last_clean":"2024-09-19T05:18:29.330926+0000","last_became_active":"2024-09-19T05:17:28.182834+0000","last_became_peered":"2024-09-19T05:17:28.182834+0000","last_unstale":"2024-09-19T05:18:29.330926+0000","last_undegraded":"2024-09-19T05:18:29.330926+0000","last_fullsized":"2024-09-19T05:18:29.330926+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:48.683776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257284+0000","last_change":"2024-09-19T05:17:30.212438+0000","last_active":"2024-09-19T05:17:49.257284+0000","last_peered":"2024-09-19T05:17:49.257284+0000","last_clean":"2024-09-19T05:17:49.257284+0000","last_became_active":"2024-09-19T05:17:30.209321+0000","last_became_peered":"2024-09-19T05:17:30.209321+0000","last_unstale":"2024-09-19T05:17:49.257284+0000","last_undegraded":"2024-09-19T05:17:49.257284+0000","last_fullsized":"2024-09-19T05:17:49.257284+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:42.772116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.505105+0000","last_change":"2024-09-19T05:17:28.204665+0000","last_active":"2024-09-19T05:17:49.505105+0000","last_peered":"2024-09-19T05:17:49.505105+0000","last_clean":"2024-09-19T05:17:49.505105+0000","last_became_active":"2024-09-19T05:17:28.204309+0000","last_became_peered":"2024-09-19T05:17:28.204309+0000","last_unstale":"2024-09-19T05:17:49.505105+0000","last_undegraded":"2024-09-19T05:17:49.505105+0000","last_fullsized":"2024-09-19T05:17:49.505105+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:26.372762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255224+0000","last_change":"2024-09-19T05:17:30.208518+0000","last_active":"2024-09-19T05:17:49.255224+0000","last_peered":"2024-09-19T05:17:49.255224+0000","last_clean":"2024-09-19T05:17:49.255224+0000","last_became_active":"2024-09-19T05:17:30.208172+0000","last_became_peered":"2024-09-19T05:17:30.208172+0000","last_unstale":"2024-09-19T05:17:49.255224+0000","last_undegraded":"2024-09-19T05:17:49.255224+0000","last_fullsized":"2024-09-19T05:17:49.255224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:40:25.754925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.505491+0000","last_change":"2024-09-19T05:17:28.180930+0000","last_active":"2024-09-19T05:17:49.505491+0000","last_peered":"2024-09-19T05:17:49.505491+0000","last_clean":"2024-09-19T05:17:49.505491+0000","last_became_active":"2024-09-19T05:17:28.180575+0000","last_became_peered":"2024-09-19T05:17:28.180575+0000","last_unstale":"2024-09-19T05:17:49.505491+0000","last_undegraded":"2024-09-19T05:17:49.505491+0000","last_fullsized":"2024-09-19T05:17:49.505491+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:36:15.390852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254917+0000","last_change":"2024-09-19T05:17:30.207002+0000","last_active":"2024-09-19T05:17:49.254917+0000","last_peered":"2024-09-19T05:17:49.254917+0000","last_clean":"2024-09-19T05:17:49.254917+0000","last_became_active":"2024-09-19T05:17:30.205750+0000","last_became_peered":"2024-09-19T05:17:30.205750+0000","last_unstale":"2024-09-19T05:17:49.254917+0000","last_undegraded":"2024-09-19T05:17:49.254917+0000","last_fullsized":"2024-09-19T05:17:49.254917+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:25:18.716206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255138+0000","last_change":"2024-09-19T05:17:28.184071+0000","last_active":"2024-09-19T05:17:49.255138+0000","last_peered":"2024-09-19T05:17:49.255138+0000","last_clean":"2024-09-19T05:17:49.255138+0000","last_became_active":"2024-09-19T05:17:28.183708+0000","last_became_peered":"2024-09-19T05:17:28.183708+0000","last_unstale":"2024-09-19T05:17:49.255138+0000","last_undegraded":"2024-09-19T05:17:49.255138+0000","last_fullsized":"2024-09-19T05:17:49.255138+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:57:23.831000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257299+0000","last_change":"2024-09-19T05:17:30.211919+0000","last_active":"2024-09-19T05:17:49.257299+0000","last_peered":"2024-09-19T05:17:49.257299+0000","last_clean":"2024-09-19T05:17:49.257299+0000","last_became_active":"2024-09-19T05:17:30.210639+0000","last_became_peered":"2024-09-19T05:17:30.210639+0000","last_unstale":"2024-09-19T05:17:49.257299+0000","last_undegraded":"2024-09-19T05:17:49.257299+0000","last_fullsized":"2024-09-19T05:17:49.257299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:25.231732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255846+0000","last_change":"2024-09-19T05:17:28.179372+0000","last_active":"2024-09-19T05:17:49.255846+0000","last_peered":"2024-09-19T05:17:49.255846+0000","last_clean":"2024-09-19T05:17:49.255846+0000","last_became_active":"2024-09-19T05:17:28.178792+0000","last_became_peered":"2024-09-19T05:17:28.178792+0000","last_unstale":"2024-09-19T05:17:49.255846+0000","last_undegraded":"2024-09-19T05:17:49.255846+0000","last_fullsized":"2024-09-19T05:17:49.255846+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:54.705552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258607+0000","last_change":"2024-09-19T05:17:30.208201+0000","last_active":"2024-09-19T05:17:49.258607+0000","last_peered":"2024-09-19T05:17:49.258607+0000","last_clean":"2024-09-19T05:17:49.258607+0000","last_became_active":"2024-09-19T05:17:30.207865+0000","last_became_peered":"2024-09-19T05:17:30.207865+0000","last_unstale":"2024-09-19T05:17:49.258607+0000","last_undegraded":"2024-09-19T05:17:49.258607+0000","last_fullsized":"2024-09-19T05:17:49.258607+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:35.954759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253446+0000","last_change":"2024-09-19T05:17:28.543685+0000","last_active":"2024-09-19T05:17:49.253446+0000","last_peered":"2024-09-19T05:17:49.253446+0000","last_clean":"2024-09-19T05:17:49.253446+0000","last_became_active":"2024-09-19T05:17:28.543292+0000","last_became_peered":"2024-09-19T05:17:28.543292+0000","last_unstale":"2024-09-19T05:17:49.253446+0000","last_undegraded":"2024-09-19T05:17:49.253446+0000","last_fullsized":"2024-09-19T05:17:49.253446+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:55:14.348544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258916+0000","last_change":"2024-09-19T05:17:30.212449+0000","last_active":"2024-09-19T05:17:49.258916+0000","last_peered":"2024-09-19T05:17:49.258916+0000","last_clean":"2024-09-19T05:17:49.258916+0000","last_became_active":"2024-09-19T05:17:30.211265+0000","last_became_peered":"2024-09-19T05:17:30.211265+0000","last_unstale":"2024-09-19T05:17:49.258916+0000","last_undegraded":"2024-09-19T05:17:49.258916+0000","last_fullsized":"2024-09-19T05:17:49.258916+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:27.687687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":346,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257570+0000","last_change":"2024-09-19T05:16:20.361975+0000","last_active":"2024-09-19T05:17:49.257570+0000","last_peered":"2024-09-19T05:17:49.257570+0000","last_clean":"2024-09-19T05:17:49.257570+0000","last_became_active":"2024-09-19T05:16:20.361553+0000","last_became_peered":"2024-09-19T05:16:20.361553+0000","last_unstale":"2024-09-19T05:17:49.257570+0000","last_undegraded":"2024-09-19T05:17:49.257570+0000","last_fullsized":"2024-09-19T05:17:49.257570+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:13:02.674575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:13:02.674575+0000","last_clean_scrub_stamp":"2024-09-19T05:13:02.674575+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:48.711411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259170+0000","last_change":"2024-09-19T05:17:28.180486+0000","last_active":"2024-09-19T05:17:49.259170+0000","last_peered":"2024-09-19T05:17:49.259170+0000","last_clean":"2024-09-19T05:17:49.259170+0000","last_became_active":"2024-09-19T05:17:28.180147+0000","last_became_peered":"2024-09-19T05:17:28.180147+0000","last_unstale":"2024-09-19T05:17:49.259170+0000","last_undegraded":"2024-09-19T05:17:49.259170+0000","last_fullsized":"2024-09-19T05:17:49.259170+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:57.820328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258205+0000","last_change":"2024-09-19T05:17:30.205560+0000","last_active":"2024-09-19T05:17:49.258205+0000","last_peered":"2024-09-19T05:17:49.258205+0000","last_clean":"2024-09-19T05:17:49.258205+0000","last_became_active":"2024-09-19T05:17:30.205269+0000","last_became_peered":"2024-09-19T05:17:30.205269+0000","last_unstale":"2024-09-19T05:17:49.258205+0000","last_undegraded":"2024-09-19T05:17:49.258205+0000","last_fullsized":"2024-09-19T05:17:49.258205+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:22.904616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257462+0000","last_change":"2024-09-19T05:17:28.181845+0000","last_active":"2024-09-19T05:17:49.257462+0000","last_peered":"2024-09-19T05:17:49.257462+0000","last_clean":"2024-09-19T05:17:49.257462+0000","last_became_active":"2024-09-19T05:17:28.181549+0000","last_became_peered":"2024-09-19T05:17:28.181549+0000","last_unstale":"2024-09-19T05:17:49.257462+0000","last_undegraded":"2024-09-19T05:17:49.257462+0000","last_fullsized":"2024-09-19T05:17:49.257462+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:01.222364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259631+0000","last_change":"2024-09-19T05:17:49.259631+0000","last_active":"2024-09-19T05:17:49.259631+0000","last_peered":"2024-09-19T05:17:49.259631+0000","last_clean":"2024-09-19T05:17:49.259631+0000","last_became_active":"2024-09-19T05:17:49.259240+0000","last_became_peered":"2024-09-19T05:17:49.259240+0000","last_unstale":"2024-09-19T05:17:49.259631+0000","last_undegraded":"2024-09-19T05:17:49.259631+0000","last_fullsized":"2024-09-19T05:17:49.259631+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:22.533248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:18:29.330382+0000","last_change":"2024-09-19T05:17:28.204924+0000","last_active":"2024-09-19T05:18:29.330382+0000","last_peered":"2024-09-19T05:18:29.330382+0000","last_clean":"2024-09-19T05:18:29.330382+0000","last_became_active":"2024-09-19T05:17:28.204602+0000","last_became_peered":"2024-09-19T05:17:28.204602+0000","last_unstale":"2024-09-19T05:18:29.330382+0000","last_undegraded":"2024-09-19T05:18:29.330382+0000","last_fullsized":"2024-09-19T05:18:29.330382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:13.303939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259147+0000","last_change":"2024-09-19T05:17:49.259147+0000","last_active":"2024-09-19T05:17:49.259147+0000","last_peered":"2024-09-19T05:17:49.259147+0000","last_clean":"2024-09-19T05:17:49.259147+0000","last_became_active":"2024-09-19T05:17:49.258666+0000","last_became_peered":"2024-09-19T05:17:49.258666+0000","last_unstale":"2024-09-19T05:17:49.259147+0000","last_undegraded":"2024-09-19T05:17:49.259147+0000","last_fullsized":"2024-09-19T05:17:49.259147+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:54.802994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257809+0000","last_change":"2024-09-19T05:17:28.182456+0000","last_active":"2024-09-19T05:17:49.257809+0000","last_peered":"2024-09-19T05:17:49.257809+0000","last_clean":"2024-09-19T05:17:49.257809+0000","last_became_active":"2024-09-19T05:17:28.182075+0000","last_became_peered":"2024-09-19T05:17:28.182075+0000","last_unstale":"2024-09-19T05:17:49.257809+0000","last_undegraded":"2024-09-19T05:17:49.257809+0000","last_fullsized":"2024-09-19T05:17:49.257809+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:42.771641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257506+0000","last_change":"2024-09-19T05:17:30.204300+0000","last_active":"2024-09-19T05:17:49.257506+0000","last_peered":"2024-09-19T05:17:49.257506+0000","last_clean":"2024-09-19T05:17:49.257506+0000","last_became_active":"2024-09-19T05:17:30.203840+0000","last_became_peered":"2024-09-19T05:17:30.203840+0000","last_unstale":"2024-09-19T05:17:49.257506+0000","last_undegraded":"2024-09-19T05:17:49.257506+0000","last_fullsized":"2024-09-19T05:17:49.257506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:48.363862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.256914+0000","last_change":"2024-09-19T05:17:28.204474+0000","last_active":"2024-09-19T05:17:49.256914+0000","last_peered":"2024-09-19T05:17:49.256914+0000","last_clean":"2024-09-19T05:17:49.256914+0000","last_became_active":"2024-09-19T05:17:28.204143+0000","last_became_peered":"2024-09-19T05:17:28.204143+0000","last_unstale":"2024-09-19T05:17:49.256914+0000","last_undegraded":"2024-09-19T05:17:49.256914+0000","last_fullsized":"2024-09-19T05:17:49.256914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:46.647789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257702+0000","last_change":"2024-09-19T05:17:30.198791+0000","last_active":"2024-09-19T05:17:49.257702+0000","last_peered":"2024-09-19T05:17:49.257702+0000","last_clean":"2024-09-19T05:17:49.257702+0000","last_became_active":"2024-09-19T05:17:30.198399+0000","last_became_peered":"2024-09-19T05:17:30.198399+0000","last_unstale":"2024-09-19T05:17:49.257702+0000","last_undegraded":"2024-09-19T05:17:49.257702+0000","last_fullsized":"2024-09-19T05:17:49.257702+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:46.676625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.505515+0000","last_change":"2024-09-19T05:17:28.204690+0000","last_active":"2024-09-19T05:17:49.505515+0000","last_peered":"2024-09-19T05:17:49.505515+0000","last_clean":"2024-09-19T05:17:49.505515+0000","last_became_active":"2024-09-19T05:17:28.204377+0000","last_became_peered":"2024-09-19T05:17:28.204377+0000","last_unstale":"2024-09-19T05:17:49.505515+0000","last_undegraded":"2024-09-19T05:17:49.505515+0000","last_fullsized":"2024-09-19T05:17:49.505515+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:29:20.583163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254992+0000","last_change":"2024-09-19T05:17:30.200584+0000","last_active":"2024-09-19T05:17:49.254992+0000","last_peered":"2024-09-19T05:17:49.254992+0000","last_clean":"2024-09-19T05:17:49.254992+0000","last_became_active":"2024-09-19T05:17:30.200270+0000","last_became_peered":"2024-09-19T05:17:30.200270+0000","last_unstale":"2024-09-19T05:17:49.254992+0000","last_undegraded":"2024-09-19T05:17:49.254992+0000","last_fullsized":"2024-09-19T05:17:49.254992+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:24:43.493332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'12","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:55.197772+0000","last_change":"2024-09-19T05:17:28.181020+0000","last_active":"2024-09-19T05:17:55.197772+0000","last_peered":"2024-09-19T05:17:55.197772+0000","last_clean":"2024-09-19T05:17:55.197772+0000","last_became_active":"2024-09-19T05:17:28.180298+0000","last_became_peered":"2024-09-19T05:17:28.180298+0000","last_unstale":"2024-09-19T05:17:55.197772+0000","last_undegraded":"2024-09-19T05:17:55.197772+0000","last_fullsized":"2024-09-19T05:17:55.197772+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:32.931699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258799+0000","last_change":"2024-09-19T05:17:30.209632+0000","last_active":"2024-09-19T05:17:49.258799+0000","last_peered":"2024-09-19T05:17:49.258799+0000","last_clean":"2024-09-19T05:17:49.258799+0000","last_became_active":"2024-09-19T05:17:30.209334+0000","last_became_peered":"2024-09-19T05:17:30.209334+0000","last_unstale":"2024-09-19T05:17:49.258799+0000","last_undegraded":"2024-09-19T05:17:49.258799+0000","last_fullsized":"2024-09-19T05:17:49.258799+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:21.159099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259725+0000","last_change":"2024-09-19T05:17:28.543802+0000","last_active":"2024-09-19T05:17:49.259725+0000","last_peered":"2024-09-19T05:17:49.259725+0000","last_clean":"2024-09-19T05:17:49.259725+0000","last_became_active":"2024-09-19T05:17:28.543503+0000","last_became_peered":"2024-09-19T05:17:28.543503+0000","last_unstale":"2024-09-19T05:17:49.259725+0000","last_undegraded":"2024-09-19T05:17:49.259725+0000","last_fullsized":"2024-09-19T05:17:49.259725+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:13.764141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258058+0000","last_change":"2024-09-19T05:17:30.206755+0000","last_active":"2024-09-19T05:17:49.258058+0000","last_peered":"2024-09-19T05:17:49.258058+0000","last_clean":"2024-09-19T05:17:49.258058+0000","last_became_active":"2024-09-19T05:17:30.205757+0000","last_became_peered":"2024-09-19T05:17:30.205757+0000","last_unstale":"2024-09-19T05:17:49.258058+0000","last_undegraded":"2024-09-19T05:17:49.258058+0000","last_fullsized":"2024-09-19T05:17:49.258058+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:16.281294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253238+0000","last_change":"2024-09-19T05:17:28.204819+0000","last_active":"2024-09-19T05:17:49.253238+0000","last_peered":"2024-09-19T05:17:49.253238+0000","last_clean":"2024-09-19T05:17:49.253238+0000","last_became_active":"2024-09-19T05:17:28.204445+0000","last_became_peered":"2024-09-19T05:17:28.204445+0000","last_unstale":"2024-09-19T05:17:49.253238+0000","last_undegraded":"2024-09-19T05:17:49.253238+0000","last_fullsized":"2024-09-19T05:17:49.253238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:26.473654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.504996+0000","last_change":"2024-09-19T05:17:30.201331+0000","last_active":"2024-09-19T05:17:49.504996+0000","last_peered":"2024-09-19T05:17:49.504996+0000","last_clean":"2024-09-19T05:17:49.504996+0000","last_became_active":"2024-09-19T05:17:30.200992+0000","last_became_peered":"2024-09-19T05:17:30.200992+0000","last_unstale":"2024-09-19T05:17:49.504996+0000","last_undegraded":"2024-09-19T05:17:49.504996+0000","last_fullsized":"2024-09-19T05:17:49.504996+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:17.033786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257860+0000","last_change":"2024-09-19T05:17:28.180149+0000","last_active":"2024-09-19T05:17:49.257860+0000","last_peered":"2024-09-19T05:17:49.257860+0000","last_clean":"2024-09-19T05:17:49.257860+0000","last_became_active":"2024-09-19T05:17:28.179767+0000","last_became_peered":"2024-09-19T05:17:28.179767+0000","last_unstale":"2024-09-19T05:17:49.257860+0000","last_undegraded":"2024-09-19T05:17:49.257860+0000","last_fullsized":"2024-09-19T05:17:49.257860+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:25.074252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254511+0000","last_change":"2024-09-19T05:17:30.204533+0000","last_active":"2024-09-19T05:17:49.254511+0000","last_peered":"2024-09-19T05:17:49.254511+0000","last_clean":"2024-09-19T05:17:49.254511+0000","last_became_active":"2024-09-19T05:17:30.204224+0000","last_became_peered":"2024-09-19T05:17:30.204224+0000","last_unstale":"2024-09-19T05:17:49.254511+0000","last_undegraded":"2024-09-19T05:17:49.254511+0000","last_fullsized":"2024-09-19T05:17:49.254511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:11.021297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253084+0000","last_change":"2024-09-19T05:17:28.187544+0000","last_active":"2024-09-19T05:17:49.253084+0000","last_peered":"2024-09-19T05:17:49.253084+0000","last_clean":"2024-09-19T05:17:49.253084+0000","last_became_active":"2024-09-19T05:17:28.187068+0000","last_became_peered":"2024-09-19T05:17:28.187068+0000","last_unstale":"2024-09-19T05:17:49.253084+0000","last_undegraded":"2024-09-19T05:17:49.253084+0000","last_fullsized":"2024-09-19T05:17:49.253084+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:01.151721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257927+0000","last_change":"2024-09-19T05:17:30.209549+0000","last_active":"2024-09-19T05:17:49.257927+0000","last_peered":"2024-09-19T05:17:49.257927+0000","last_clean":"2024-09-19T05:17:49.257927+0000","last_became_active":"2024-09-19T05:17:30.209225+0000","last_became_peered":"2024-09-19T05:17:30.209225+0000","last_unstale":"2024-09-19T05:17:49.257927+0000","last_undegraded":"2024-09-19T05:17:49.257927+0000","last_fullsized":"2024-09-19T05:17:49.257927+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:38.023351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.504986+0000","last_change":"2024-09-19T05:17:28.186601+0000","last_active":"2024-09-19T05:17:49.504986+0000","last_peered":"2024-09-19T05:17:49.504986+0000","last_clean":"2024-09-19T05:17:49.504986+0000","last_became_active":"2024-09-19T05:17:28.186236+0000","last_became_peered":"2024-09-19T05:17:28.186236+0000","last_unstale":"2024-09-19T05:17:49.504986+0000","last_undegraded":"2024-09-19T05:17:49.504986+0000","last_fullsized":"2024-09-19T05:17:49.504986+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:08.527906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257720+0000","last_change":"2024-09-19T05:17:30.203633+0000","last_active":"2024-09-19T05:17:49.257720+0000","last_peered":"2024-09-19T05:17:49.257720+0000","last_clean":"2024-09-19T05:17:49.257720+0000","last_became_active":"2024-09-19T05:17:30.203313+0000","last_became_peered":"2024-09-19T05:17:30.203313+0000","last_unstale":"2024-09-19T05:17:49.257720+0000","last_undegraded":"2024-09-19T05:17:49.257720+0000","last_fullsized":"2024-09-19T05:17:49.257720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:40.442434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.260731+0000","last_change":"2024-09-19T05:17:49.260345+0000","last_active":"2024-09-19T05:17:49.260731+0000","last_peered":"2024-09-19T05:17:49.260731+0000","last_clean":"2024-09-19T05:17:49.260731+0000","last_became_active":"2024-09-19T05:17:49.259938+0000","last_became_peered":"2024-09-19T05:17:49.259938+0000","last_unstale":"2024-09-19T05:17:49.260731+0000","last_undegraded":"2024-09-19T05:17:49.260731+0000","last_fullsized":"2024-09-19T05:17:49.260731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:01.904276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.505270+0000","last_change":"2024-09-19T05:17:28.182014+0000","last_active":"2024-09-19T05:17:49.505270+0000","last_peered":"2024-09-19T05:17:49.505270+0000","last_clean":"2024-09-19T05:17:49.505270+0000","last_became_active":"2024-09-19T05:17:28.181666+0000","last_became_peered":"2024-09-19T05:17:28.181666+0000","last_unstale":"2024-09-19T05:17:49.505270+0000","last_undegraded":"2024-09-19T05:17:49.505270+0000","last_fullsized":"2024-09-19T05:17:49.505270+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:00:57.069618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253344+0000","last_change":"2024-09-19T05:17:30.206428+0000","last_active":"2024-09-19T05:17:49.253344+0000","last_peered":"2024-09-19T05:17:49.253344+0000","last_clean":"2024-09-19T05:17:49.253344+0000","last_became_active":"2024-09-19T05:17:30.205818+0000","last_became_peered":"2024-09-19T05:17:30.205818+0000","last_unstale":"2024-09-19T05:17:49.253344+0000","last_undegraded":"2024-09-19T05:17:49.253344+0000","last_fullsized":"2024-09-19T05:17:49.253344+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:26.059019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.505410+0000","last_change":"2024-09-19T05:17:28.185596+0000","last_active":"2024-09-19T05:17:49.505410+0000","last_peered":"2024-09-19T05:17:49.505410+0000","last_clean":"2024-09-19T05:17:49.505410+0000","last_became_active":"2024-09-19T05:17:28.185278+0000","last_became_peered":"2024-09-19T05:17:28.185278+0000","last_unstale":"2024-09-19T05:17:49.505410+0000","last_undegraded":"2024-09-19T05:17:49.505410+0000","last_fullsized":"2024-09-19T05:17:49.505410+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:40.440874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258328+0000","last_change":"2024-09-19T05:17:30.200409+0000","last_active":"2024-09-19T05:17:49.258328+0000","last_peered":"2024-09-19T05:17:49.258328+0000","last_clean":"2024-09-19T05:17:49.258328+0000","last_became_active":"2024-09-19T05:17:30.200120+0000","last_became_peered":"2024-09-19T05:17:30.200120+0000","last_unstale":"2024-09-19T05:17:49.258328+0000","last_undegraded":"2024-09-19T05:17:49.258328+0000","last_fullsized":"2024-09-19T05:17:49.258328+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:12.396655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259201+0000","last_change":"2024-09-19T05:17:28.205371+0000","last_active":"2024-09-19T05:17:49.259201+0000","last_peered":"2024-09-19T05:17:49.259201+0000","last_clean":"2024-09-19T05:17:49.259201+0000","last_became_active":"2024-09-19T05:17:28.205026+0000","last_became_peered":"2024-09-19T05:17:28.205026+0000","last_unstale":"2024-09-19T05:17:49.259201+0000","last_undegraded":"2024-09-19T05:17:49.259201+0000","last_fullsized":"2024-09-19T05:17:49.259201+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:59.518580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258928+0000","last_change":"2024-09-19T05:17:30.206862+0000","last_active":"2024-09-19T05:17:49.258928+0000","last_peered":"2024-09-19T05:17:49.258928+0000","last_clean":"2024-09-19T05:17:49.258928+0000","last_became_active":"2024-09-19T05:17:30.206072+0000","last_became_peered":"2024-09-19T05:17:30.206072+0000","last_unstale":"2024-09-19T05:17:49.258928+0000","last_undegraded":"2024-09-19T05:17:49.258928+0000","last_fullsized":"2024-09-19T05:17:49.258928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:47.810496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257340+0000","last_change":"2024-09-19T05:17:28.181895+0000","last_active":"2024-09-19T05:17:49.257340+0000","last_peered":"2024-09-19T05:17:49.257340+0000","last_clean":"2024-09-19T05:17:49.257340+0000","last_became_active":"2024-09-19T05:17:28.181499+0000","last_became_peered":"2024-09-19T05:17:28.181499+0000","last_unstale":"2024-09-19T05:17:49.257340+0000","last_undegraded":"2024-09-19T05:17:49.257340+0000","last_fullsized":"2024-09-19T05:17:49.257340+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:29.722921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64777,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":323,"num_read_kb":228,"num_write":164,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":194331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579929,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":433550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808862,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36896,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708256,"statfs":{"total":95995035648,"available":95957254144,"internally_reserved":0,"allocated":1589248,"data_stored":1086164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939683,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":433752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168616,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":433672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397548,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1503232,"data_stored":1025211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561074,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":897024,"data_stored":433141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790006,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32672,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712480,"statfs":{"total":95995035648,"available":95961579520,"internally_reserved":0,"allocated":1515520,"data_stored":1024895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953532,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":433578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215169,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":433452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444102,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":495417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607627,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":494101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":917504,"data_stored":434412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":62483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:18:34.518 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T05:18:34.764 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:34.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:18:34.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:18:34.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:34 smithi120 ceph-mon[30956]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:18:34.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:34 smithi120 ceph-mon[30956]: pgmap v305: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T05:18:34.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:34.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:18:34.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:34 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:18:34.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:18:34.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:18:34.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:34 smithi194 ceph-mon[35228]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:18:34.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:34 smithi194 ceph-mon[35228]: pgmap v305: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T05:18:34.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:34.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:18:34.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:34 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:18:34.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:34 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:18:34.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:34 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:18:34.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:34 smithi178 ceph-mon[34347]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:18:34.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:34 smithi178 ceph-mon[34347]: pgmap v305: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T05:18:34.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:34 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:18:34.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:34 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:18:34.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:34 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' 2024-09-19T05:18:35.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.202+0000 7f128681e640 1 -- 172.21.15.120:0/2931797818 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1280100a80 msgr2=0x7f1280100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:35.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.202+0000 7f128681e640 1 --2- 172.21.15.120:0/2931797818 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1280100a80 0x7f1280100ee0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1268009930 tx=0x7f126802a420 comp rx=0 tx=0).stop 2024-09-19T05:18:35.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.202+0000 7f128681e640 1 -- 172.21.15.120:0/2931797818 shutdown_connections 2024-09-19T05:18:35.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.202+0000 7f128681e640 1 --2- 172.21.15.120:0/2931797818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1280101420 0x7f128010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:35.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.202+0000 7f128681e640 1 --2- 172.21.15.120:0/2931797818 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1280100a80 0x7f1280100ee0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:35.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.202+0000 7f128681e640 1 --2- 172.21.15.120:0/2931797818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1280106a80 0x7f1280106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:35.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.202+0000 7f128681e640 1 -- 172.21.15.120:0/2931797818 >> 172.21.15.120:0/2931797818 conn(0x7f12800fc7a0 msgr2=0x7f12800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:35.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.202+0000 7f128681e640 1 -- 172.21.15.120:0/2931797818 shutdown_connections 2024-09-19T05:18:35.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.202+0000 7f128681e640 1 -- 172.21.15.120:0/2931797818 wait complete. 2024-09-19T05:18:35.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.203+0000 7f128681e640 1 Processor -- start 2024-09-19T05:18:35.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.203+0000 7f128681e640 1 -- start start 2024-09-19T05:18:35.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.203+0000 7f128681e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1280100a80 0x7f12801983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:35.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.203+0000 7f128681e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1280101420 0x7f1280198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:35.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.203+0000 7f128681e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1280106a80 0x7f128019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:35.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.203+0000 7f128681e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1280110d50 con 0x7f1280106a80 2024-09-19T05:18:35.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.203+0000 7f128681e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1280110bd0 con 0x7f1280100a80 2024-09-19T05:18:35.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.203+0000 7f128681e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1280110ed0 con 0x7f1280101420 2024-09-19T05:18:35.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.203+0000 7f1284dbb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1280106a80 0x7f128019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:35.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.203+0000 7f1284dbb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1280106a80 0x7f128019ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36964/0 (socket says 172.21.15.120:36964) 2024-09-19T05:18:35.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.203+0000 7f1284dbb640 1 -- 172.21.15.120:0/3369244738 learned_addr learned my addr 172.21.15.120:0/3369244738 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:35.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.203+0000 7f1277fff640 1 --2- 172.21.15.120:0/3369244738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1280101420 0x7f1280198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:35.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.203+0000 7f127ffff640 1 --2- 172.21.15.120:0/3369244738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1280100a80 0x7f12801983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:35.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.203+0000 7f1284dbb640 1 -- 172.21.15.120:0/3369244738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1280101420 msgr2=0x7f1280198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:35.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.203+0000 7f1284dbb640 1 --2- 172.21.15.120:0/3369244738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1280101420 0x7f1280198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:35.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.203+0000 7f1284dbb640 1 -- 172.21.15.120:0/3369244738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1280100a80 msgr2=0x7f12801983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:35.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.203+0000 7f1284dbb640 1 --2- 172.21.15.120:0/3369244738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1280100a80 0x7f12801983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:35.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.203+0000 7f1284dbb640 1 -- 172.21.15.120:0/3369244738 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f128019d3a0 con 0x7f1280106a80 2024-09-19T05:18:35.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.203+0000 7f1277fff640 1 --2- 172.21.15.120:0/3369244738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1280101420 0x7f1280198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:35.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.204+0000 7f1284dbb640 1 --2- 172.21.15.120:0/3369244738 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1280106a80 0x7f128019ccc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f127800b970 tx=0x7f127800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:35.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.204+0000 7f127dffb640 1 -- 172.21.15.120:0/3369244738 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1278019070 con 0x7f1280106a80 2024-09-19T05:18:35.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.204+0000 7f127dffb640 1 -- 172.21.15.120:0/3369244738 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1278014440 con 0x7f1280106a80 2024-09-19T05:18:35.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.204+0000 7f127dffb640 1 -- 172.21.15.120:0/3369244738 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12780075d0 con 0x7f1280106a80 2024-09-19T05:18:35.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.204+0000 7f128681e640 1 -- 172.21.15.120:0/3369244738 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f128019d690 con 0x7f1280106a80 2024-09-19T05:18:35.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.204+0000 7f128681e640 1 -- 172.21.15.120:0/3369244738 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12801a4f70 con 0x7f1280106a80 2024-09-19T05:18:35.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.205+0000 7f128681e640 1 -- 172.21.15.120:0/3369244738 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1280100ee0 con 0x7f1280106a80 2024-09-19T05:18:35.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.206+0000 7f127dffb640 1 -- 172.21.15.120:0/3369244738 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f127801c070 con 0x7f1280106a80 2024-09-19T05:18:35.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.206+0000 7f127dffb640 1 --2- 172.21.15.120:0/3369244738 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f126c0a32d0 0x7f126c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:35.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.207+0000 7f127ffff640 1 --2- 172.21.15.120:0/3369244738 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f126c0a32d0 0x7f126c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:35.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.207+0000 7f127dffb640 1 -- 172.21.15.120:0/3369244738 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f12780cf030 con 0x7f1280106a80 2024-09-19T05:18:35.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.207+0000 7f127ffff640 1 --2- 172.21.15.120:0/3369244738 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f126c0a32d0 0x7f126c0a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1270005fd0 tx=0x7f1270005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:35.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.211+0000 7f127dffb640 1 -- 172.21.15.120:0/3369244738 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f127809bce0 con 0x7f1280106a80 2024-09-19T05:18:35.375 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.374+0000 7f128681e640 1 -- 172.21.15.120:0/3369244738 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1280062630 con 0x7f126c0a32d0 2024-09-19T05:18:35.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.380+0000 7f127dffb640 1 -- 172.21.15.120:0/3369244738 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258711 (secure 0 0 0) 0x7f1280062630 con 0x7f126c0a32d0 2024-09-19T05:18:35.384 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:18:35.385 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-19T05:18:35.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.383+0000 7f128681e640 1 -- 172.21.15.120:0/3369244738 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f126c0a32d0 msgr2=0x7f126c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:35.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.383+0000 7f128681e640 1 --2- 172.21.15.120:0/3369244738 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f126c0a32d0 0x7f126c0a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1270005fd0 tx=0x7f1270005850 comp rx=0 tx=0).stop 2024-09-19T05:18:35.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.383+0000 7f128681e640 1 -- 172.21.15.120:0/3369244738 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1280106a80 msgr2=0x7f128019ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:35.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.383+0000 7f128681e640 1 --2- 172.21.15.120:0/3369244738 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1280106a80 0x7f128019ccc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f127800b970 tx=0x7f127800be30 comp rx=0 tx=0).stop 2024-09-19T05:18:35.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.383+0000 7f128681e640 1 -- 172.21.15.120:0/3369244738 shutdown_connections 2024-09-19T05:18:35.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.383+0000 7f128681e640 1 --2- 172.21.15.120:0/3369244738 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1280106a80 0x7f128019ccc0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:35.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.383+0000 7f128681e640 1 --2- 172.21.15.120:0/3369244738 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f126c0a32d0 0x7f126c0a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:35.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.383+0000 7f128681e640 1 --2- 172.21.15.120:0/3369244738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1280101420 0x7f1280198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:35.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.383+0000 7f128681e640 1 --2- 172.21.15.120:0/3369244738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1280100a80 0x7f12801983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:35.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.383+0000 7f128681e640 1 -- 172.21.15.120:0/3369244738 >> 172.21.15.120:0/3369244738 conn(0x7f12800fc7a0 msgr2=0x7f128006ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:35.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.383+0000 7f128681e640 1 -- 172.21.15.120:0/3369244738 shutdown_connections 2024-09-19T05:18:35.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:35.383+0000 7f128681e640 1 -- 172.21.15.120:0/3369244738 wait complete. 2024-09-19T05:18:36.032 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2024-09-19T05:18:34.146848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655379,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":474,"num_read_kb":357,"num_write":347,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180770,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":278,"ondisk_log_size":278,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":391000,"kb_used_data":12588,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124550824,"statfs":{"total":1151940427776,"available":1151540043776,"internally_reserved":0,"allocated":12890112,"data_stored":7161345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":387233083},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002736"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255222+0000","last_change":"2024-09-19T05:17:30.200993+0000","last_active":"2024-09-19T05:17:49.255222+0000","last_peered":"2024-09-19T05:17:49.255222+0000","last_clean":"2024-09-19T05:17:49.255222+0000","last_became_active":"2024-09-19T05:17:30.200587+0000","last_became_peered":"2024-09-19T05:17:30.200587+0000","last_unstale":"2024-09-19T05:17:49.255222+0000","last_undegraded":"2024-09-19T05:17:49.255222+0000","last_fullsized":"2024-09-19T05:17:49.255222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:24.484844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258121+0000","last_change":"2024-09-19T05:17:30.207784+0000","last_active":"2024-09-19T05:17:49.258121+0000","last_peered":"2024-09-19T05:17:49.258121+0000","last_clean":"2024-09-19T05:17:49.258121+0000","last_became_active":"2024-09-19T05:17:30.207485+0000","last_became_peered":"2024-09-19T05:17:30.207485+0000","last_unstale":"2024-09-19T05:17:49.258121+0000","last_undegraded":"2024-09-19T05:17:49.258121+0000","last_fullsized":"2024-09-19T05:17:49.258121+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:07.864813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257951+0000","last_change":"2024-09-19T05:17:30.203861+0000","last_active":"2024-09-19T05:17:49.257951+0000","last_peered":"2024-09-19T05:17:49.257951+0000","last_clean":"2024-09-19T05:17:49.257951+0000","last_became_active":"2024-09-19T05:17:30.203541+0000","last_became_peered":"2024-09-19T05:17:30.203541+0000","last_unstale":"2024-09-19T05:17:49.257951+0000","last_undegraded":"2024-09-19T05:17:49.257951+0000","last_fullsized":"2024-09-19T05:17:49.257951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:33:44.840055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259314+0000","last_change":"2024-09-19T05:17:30.214534+0000","last_active":"2024-09-19T05:17:49.259314+0000","last_peered":"2024-09-19T05:17:49.259314+0000","last_clean":"2024-09-19T05:17:49.259314+0000","last_became_active":"2024-09-19T05:17:30.213840+0000","last_became_peered":"2024-09-19T05:17:30.213840+0000","last_unstale":"2024-09-19T05:17:49.259314+0000","last_undegraded":"2024-09-19T05:17:49.259314+0000","last_fullsized":"2024-09-19T05:17:49.259314+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:03.673488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.505274+0000","last_change":"2024-09-19T05:17:30.201451+0000","last_active":"2024-09-19T05:17:49.505274+0000","last_peered":"2024-09-19T05:17:49.505274+0000","last_clean":"2024-09-19T05:17:49.505274+0000","last_became_active":"2024-09-19T05:17:30.201092+0000","last_became_peered":"2024-09-19T05:17:30.201092+0000","last_unstale":"2024-09-19T05:17:49.505274+0000","last_undegraded":"2024-09-19T05:17:49.505274+0000","last_fullsized":"2024-09-19T05:17:49.505274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:18.958271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.506669+0000","last_change":"2024-09-19T05:17:49.506669+0000","last_active":"2024-09-19T05:17:49.506669+0000","last_peered":"2024-09-19T05:17:49.506669+0000","last_clean":"2024-09-19T05:17:49.506669+0000","last_became_active":"2024-09-19T05:17:49.506331+0000","last_became_peered":"2024-09-19T05:17:49.506331+0000","last_unstale":"2024-09-19T05:17:49.506669+0000","last_undegraded":"2024-09-19T05:17:49.506669+0000","last_fullsized":"2024-09-19T05:17:49.506669+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:23.460781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.506866+0000","last_change":"2024-09-19T05:17:49.506866+0000","last_active":"2024-09-19T05:17:49.506866+0000","last_peered":"2024-09-19T05:17:49.506866+0000","last_clean":"2024-09-19T05:17:49.506866+0000","last_became_active":"2024-09-19T05:17:49.506386+0000","last_became_peered":"2024-09-19T05:17:49.506386+0000","last_unstale":"2024-09-19T05:17:49.506866+0000","last_undegraded":"2024-09-19T05:17:49.506866+0000","last_fullsized":"2024-09-19T05:17:49.506866+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:17.060301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258361+0000","last_change":"2024-09-19T05:17:30.210132+0000","last_active":"2024-09-19T05:17:49.258361+0000","last_peered":"2024-09-19T05:17:49.258361+0000","last_clean":"2024-09-19T05:17:49.258361+0000","last_became_active":"2024-09-19T05:17:30.209240+0000","last_became_peered":"2024-09-19T05:17:30.209240+0000","last_unstale":"2024-09-19T05:17:49.258361+0000","last_undegraded":"2024-09-19T05:17:49.258361+0000","last_fullsized":"2024-09-19T05:17:49.258361+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:08:26.999751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259817+0000","last_change":"2024-09-19T05:17:49.259291+0000","last_active":"2024-09-19T05:17:49.259817+0000","last_peered":"2024-09-19T05:17:49.259817+0000","last_clean":"2024-09-19T05:17:49.259817+0000","last_became_active":"2024-09-19T05:17:49.258948+0000","last_became_peered":"2024-09-19T05:17:49.258948+0000","last_unstale":"2024-09-19T05:17:49.259817+0000","last_undegraded":"2024-09-19T05:17:49.259817+0000","last_fullsized":"2024-09-19T05:17:49.259817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:51.082539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,11],"acting":[9,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258154+0000","last_change":"2024-09-19T05:17:30.205429+0000","last_active":"2024-09-19T05:17:49.258154+0000","last_peered":"2024-09-19T05:17:49.258154+0000","last_clean":"2024-09-19T05:17:49.258154+0000","last_became_active":"2024-09-19T05:17:30.205094+0000","last_became_peered":"2024-09-19T05:17:30.205094+0000","last_unstale":"2024-09-19T05:17:49.258154+0000","last_undegraded":"2024-09-19T05:17:49.258154+0000","last_fullsized":"2024-09-19T05:17:49.258154+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:22.149473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258808+0000","last_change":"2024-09-19T05:17:30.213050+0000","last_active":"2024-09-19T05:17:49.258808+0000","last_peered":"2024-09-19T05:17:49.258808+0000","last_clean":"2024-09-19T05:17:49.258808+0000","last_became_active":"2024-09-19T05:17:30.211812+0000","last_became_peered":"2024-09-19T05:17:30.211812+0000","last_unstale":"2024-09-19T05:17:49.258808+0000","last_undegraded":"2024-09-19T05:17:49.258808+0000","last_fullsized":"2024-09-19T05:17:49.258808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:31.734317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259448+0000","last_change":"2024-09-19T05:17:30.212049+0000","last_active":"2024-09-19T05:17:49.259448+0000","last_peered":"2024-09-19T05:17:49.259448+0000","last_clean":"2024-09-19T05:17:49.259448+0000","last_became_active":"2024-09-19T05:17:30.211684+0000","last_became_peered":"2024-09-19T05:17:30.211684+0000","last_unstale":"2024-09-19T05:17:49.259448+0000","last_undegraded":"2024-09-19T05:17:49.259448+0000","last_fullsized":"2024-09-19T05:17:49.259448+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:24.781815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255080+0000","last_change":"2024-09-19T05:17:30.191898+0000","last_active":"2024-09-19T05:17:49.255080+0000","last_peered":"2024-09-19T05:17:49.255080+0000","last_clean":"2024-09-19T05:17:49.255080+0000","last_became_active":"2024-09-19T05:17:30.191204+0000","last_became_peered":"2024-09-19T05:17:30.191204+0000","last_unstale":"2024-09-19T05:17:49.255080+0000","last_undegraded":"2024-09-19T05:17:49.255080+0000","last_fullsized":"2024-09-19T05:17:49.255080+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:19.043363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257585+0000","last_change":"2024-09-19T05:17:30.201754+0000","last_active":"2024-09-19T05:17:49.257585+0000","last_peered":"2024-09-19T05:17:49.257585+0000","last_clean":"2024-09-19T05:17:49.257585+0000","last_became_active":"2024-09-19T05:17:30.201439+0000","last_became_peered":"2024-09-19T05:17:30.201439+0000","last_unstale":"2024-09-19T05:17:49.257585+0000","last_undegraded":"2024-09-19T05:17:49.257585+0000","last_fullsized":"2024-09-19T05:17:49.257585+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:28.896899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257640+0000","last_change":"2024-09-19T05:17:30.202618+0000","last_active":"2024-09-19T05:17:49.257640+0000","last_peered":"2024-09-19T05:17:49.257640+0000","last_clean":"2024-09-19T05:17:49.257640+0000","last_became_active":"2024-09-19T05:17:30.202292+0000","last_became_peered":"2024-09-19T05:17:30.202292+0000","last_unstale":"2024-09-19T05:17:49.257640+0000","last_undegraded":"2024-09-19T05:17:49.257640+0000","last_fullsized":"2024-09-19T05:17:49.257640+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:54.206467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253112+0000","last_change":"2024-09-19T05:17:30.209411+0000","last_active":"2024-09-19T05:17:49.253112+0000","last_peered":"2024-09-19T05:17:49.253112+0000","last_clean":"2024-09-19T05:17:49.253112+0000","last_became_active":"2024-09-19T05:17:30.208525+0000","last_became_peered":"2024-09-19T05:17:30.208525+0000","last_unstale":"2024-09-19T05:17:49.253112+0000","last_undegraded":"2024-09-19T05:17:49.253112+0000","last_fullsized":"2024-09-19T05:17:49.253112+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:12:16.616413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255289+0000","last_change":"2024-09-19T05:17:30.203552+0000","last_active":"2024-09-19T05:17:49.255289+0000","last_peered":"2024-09-19T05:17:49.255289+0000","last_clean":"2024-09-19T05:17:49.255289+0000","last_became_active":"2024-09-19T05:17:30.203212+0000","last_became_peered":"2024-09-19T05:17:30.203212+0000","last_unstale":"2024-09-19T05:17:49.255289+0000","last_undegraded":"2024-09-19T05:17:49.255289+0000","last_fullsized":"2024-09-19T05:17:49.255289+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:38:50.948373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257055+0000","last_change":"2024-09-19T05:17:30.201540+0000","last_active":"2024-09-19T05:17:49.257055+0000","last_peered":"2024-09-19T05:17:49.257055+0000","last_clean":"2024-09-19T05:17:49.257055+0000","last_became_active":"2024-09-19T05:17:30.201222+0000","last_became_peered":"2024-09-19T05:17:30.201222+0000","last_unstale":"2024-09-19T05:17:49.257055+0000","last_undegraded":"2024-09-19T05:17:49.257055+0000","last_fullsized":"2024-09-19T05:17:49.257055+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:09.583473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253195+0000","last_change":"2024-09-19T05:17:30.205962+0000","last_active":"2024-09-19T05:17:49.253195+0000","last_peered":"2024-09-19T05:17:49.253195+0000","last_clean":"2024-09-19T05:17:49.253195+0000","last_became_active":"2024-09-19T05:17:30.205632+0000","last_became_peered":"2024-09-19T05:17:30.205632+0000","last_unstale":"2024-09-19T05:17:49.253195+0000","last_undegraded":"2024-09-19T05:17:49.253195+0000","last_fullsized":"2024-09-19T05:17:49.253195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:07.767502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254604+0000","last_change":"2024-09-19T05:17:30.208546+0000","last_active":"2024-09-19T05:17:49.254604+0000","last_peered":"2024-09-19T05:17:49.254604+0000","last_clean":"2024-09-19T05:17:49.254604+0000","last_became_active":"2024-09-19T05:17:30.208220+0000","last_became_peered":"2024-09-19T05:17:30.208220+0000","last_unstale":"2024-09-19T05:17:49.254604+0000","last_undegraded":"2024-09-19T05:17:49.254604+0000","last_fullsized":"2024-09-19T05:17:49.254604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:46:32.360282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255086+0000","last_change":"2024-09-19T05:17:30.204653+0000","last_active":"2024-09-19T05:17:49.255086+0000","last_peered":"2024-09-19T05:17:49.255086+0000","last_clean":"2024-09-19T05:17:49.255086+0000","last_became_active":"2024-09-19T05:17:30.204335+0000","last_became_peered":"2024-09-19T05:17:30.204335+0000","last_unstale":"2024-09-19T05:17:49.255086+0000","last_undegraded":"2024-09-19T05:17:49.255086+0000","last_fullsized":"2024-09-19T05:17:49.255086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:48.661902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.261216+0000","last_change":"2024-09-19T05:17:49.261216+0000","last_active":"2024-09-19T05:17:49.261216+0000","last_peered":"2024-09-19T05:17:49.261216+0000","last_clean":"2024-09-19T05:17:49.261216+0000","last_became_active":"2024-09-19T05:17:49.260691+0000","last_became_peered":"2024-09-19T05:17:49.260691+0000","last_unstale":"2024-09-19T05:17:49.261216+0000","last_undegraded":"2024-09-19T05:17:49.261216+0000","last_fullsized":"2024-09-19T05:17:49.261216+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:35.937669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,6],"acting":[1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257699+0000","last_change":"2024-09-19T05:17:30.201935+0000","last_active":"2024-09-19T05:17:49.257699+0000","last_peered":"2024-09-19T05:17:49.257699+0000","last_clean":"2024-09-19T05:17:49.257699+0000","last_became_active":"2024-09-19T05:17:30.201524+0000","last_became_peered":"2024-09-19T05:17:30.201524+0000","last_unstale":"2024-09-19T05:17:49.257699+0000","last_undegraded":"2024-09-19T05:17:49.257699+0000","last_fullsized":"2024-09-19T05:17:49.257699+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:34.018339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.506519+0000","last_change":"2024-09-19T05:17:49.506519+0000","last_active":"2024-09-19T05:17:49.506519+0000","last_peered":"2024-09-19T05:17:49.506519+0000","last_clean":"2024-09-19T05:17:49.506519+0000","last_became_active":"2024-09-19T05:17:49.506016+0000","last_became_peered":"2024-09-19T05:17:49.506016+0000","last_unstale":"2024-09-19T05:17:49.506519+0000","last_undegraded":"2024-09-19T05:17:49.506519+0000","last_fullsized":"2024-09-19T05:17:49.506519+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:31.064318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,8],"acting":[5,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258690+0000","last_change":"2024-09-19T05:17:30.205459+0000","last_active":"2024-09-19T05:17:49.258690+0000","last_peered":"2024-09-19T05:17:49.258690+0000","last_clean":"2024-09-19T05:17:49.258690+0000","last_became_active":"2024-09-19T05:17:30.205100+0000","last_became_peered":"2024-09-19T05:17:30.205100+0000","last_unstale":"2024-09-19T05:17:49.258690+0000","last_undegraded":"2024-09-19T05:17:49.258690+0000","last_fullsized":"2024-09-19T05:17:49.258690+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:35.246931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253212+0000","last_change":"2024-09-19T05:17:30.202812+0000","last_active":"2024-09-19T05:17:49.253212+0000","last_peered":"2024-09-19T05:17:49.253212+0000","last_clean":"2024-09-19T05:17:49.253212+0000","last_became_active":"2024-09-19T05:17:30.202477+0000","last_became_peered":"2024-09-19T05:17:30.202477+0000","last_unstale":"2024-09-19T05:17:49.253212+0000","last_undegraded":"2024-09-19T05:17:49.253212+0000","last_fullsized":"2024-09-19T05:17:49.253212+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:24.253576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254759+0000","last_change":"2024-09-19T05:17:30.206546+0000","last_active":"2024-09-19T05:17:49.254759+0000","last_peered":"2024-09-19T05:17:49.254759+0000","last_clean":"2024-09-19T05:17:49.254759+0000","last_became_active":"2024-09-19T05:17:30.206186+0000","last_became_peered":"2024-09-19T05:17:30.206186+0000","last_unstale":"2024-09-19T05:17:49.254759+0000","last_undegraded":"2024-09-19T05:17:49.254759+0000","last_fullsized":"2024-09-19T05:17:49.254759+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:30.589196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254959+0000","last_change":"2024-09-19T05:17:30.213894+0000","last_active":"2024-09-19T05:17:49.254959+0000","last_peered":"2024-09-19T05:17:49.254959+0000","last_clean":"2024-09-19T05:17:49.254959+0000","last_became_active":"2024-09-19T05:17:30.213586+0000","last_became_peered":"2024-09-19T05:17:30.213586+0000","last_unstale":"2024-09-19T05:17:49.254959+0000","last_undegraded":"2024-09-19T05:17:49.254959+0000","last_fullsized":"2024-09-19T05:17:49.254959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:46.215816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.262965+0000","last_change":"2024-09-19T05:17:49.262965+0000","last_active":"2024-09-19T05:17:49.262965+0000","last_peered":"2024-09-19T05:17:49.262965+0000","last_clean":"2024-09-19T05:17:49.262965+0000","last_became_active":"2024-09-19T05:17:49.262651+0000","last_became_peered":"2024-09-19T05:17:49.262651+0000","last_unstale":"2024-09-19T05:17:49.262965+0000","last_undegraded":"2024-09-19T05:17:49.262965+0000","last_fullsized":"2024-09-19T05:17:49.262965+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:57.601031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.252888+0000","last_change":"2024-09-19T05:17:30.204302+0000","last_active":"2024-09-19T05:17:49.252888+0000","last_peered":"2024-09-19T05:17:49.252888+0000","last_clean":"2024-09-19T05:17:49.252888+0000","last_became_active":"2024-09-19T05:17:30.203981+0000","last_became_peered":"2024-09-19T05:17:30.203981+0000","last_unstale":"2024-09-19T05:17:49.252888+0000","last_undegraded":"2024-09-19T05:17:49.252888+0000","last_fullsized":"2024-09-19T05:17:49.252888+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:59.130439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.252943+0000","last_change":"2024-09-19T05:17:30.210610+0000","last_active":"2024-09-19T05:17:49.252943+0000","last_peered":"2024-09-19T05:17:49.252943+0000","last_clean":"2024-09-19T05:17:49.252943+0000","last_became_active":"2024-09-19T05:17:30.210231+0000","last_became_peered":"2024-09-19T05:17:30.210231+0000","last_unstale":"2024-09-19T05:17:49.252943+0000","last_undegraded":"2024-09-19T05:17:49.252943+0000","last_fullsized":"2024-09-19T05:17:49.252943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:37:41.885822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254442+0000","last_change":"2024-09-19T05:17:30.210755+0000","last_active":"2024-09-19T05:17:49.254442+0000","last_peered":"2024-09-19T05:17:49.254442+0000","last_clean":"2024-09-19T05:17:49.254442+0000","last_became_active":"2024-09-19T05:17:30.210383+0000","last_became_peered":"2024-09-19T05:17:30.210383+0000","last_unstale":"2024-09-19T05:17:49.254442+0000","last_undegraded":"2024-09-19T05:17:49.254442+0000","last_fullsized":"2024-09-19T05:17:49.254442+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:11.259830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.505151+0000","last_change":"2024-09-19T05:17:30.206345+0000","last_active":"2024-09-19T05:17:49.505151+0000","last_peered":"2024-09-19T05:17:49.505151+0000","last_clean":"2024-09-19T05:17:49.505151+0000","last_became_active":"2024-09-19T05:17:30.205988+0000","last_became_peered":"2024-09-19T05:17:30.205988+0000","last_unstale":"2024-09-19T05:17:49.505151+0000","last_undegraded":"2024-09-19T05:17:49.505151+0000","last_fullsized":"2024-09-19T05:17:49.505151+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:57.538280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":79,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:18:28.314196+0000","last_change":"2024-09-19T05:17:28.183851+0000","last_active":"2024-09-19T05:18:28.314196+0000","last_peered":"2024-09-19T05:18:28.314196+0000","last_clean":"2024-09-19T05:18:28.314196+0000","last_became_active":"2024-09-19T05:17:28.183472+0000","last_became_peered":"2024-09-19T05:17:28.183472+0000","last_unstale":"2024-09-19T05:18:28.314196+0000","last_undegraded":"2024-09-19T05:18:28.314196+0000","last_fullsized":"2024-09-19T05:18:28.314196+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:22.942306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255294+0000","last_change":"2024-09-19T05:17:30.208784+0000","last_active":"2024-09-19T05:17:49.255294+0000","last_peered":"2024-09-19T05:17:49.255294+0000","last_clean":"2024-09-19T05:17:49.255294+0000","last_became_active":"2024-09-19T05:17:30.208232+0000","last_became_peered":"2024-09-19T05:17:30.208232+0000","last_unstale":"2024-09-19T05:17:49.255294+0000","last_undegraded":"2024-09-19T05:17:49.255294+0000","last_fullsized":"2024-09-19T05:17:49.255294+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:07.670401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257109+0000","last_change":"2024-09-19T05:17:28.181480+0000","last_active":"2024-09-19T05:17:49.257109+0000","last_peered":"2024-09-19T05:17:49.257109+0000","last_clean":"2024-09-19T05:17:49.257109+0000","last_became_active":"2024-09-19T05:17:28.181169+0000","last_became_peered":"2024-09-19T05:17:28.181169+0000","last_unstale":"2024-09-19T05:17:49.257109+0000","last_undegraded":"2024-09-19T05:17:49.257109+0000","last_fullsized":"2024-09-19T05:17:49.257109+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:09.590408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254730+0000","last_change":"2024-09-19T05:17:28.180636+0000","last_active":"2024-09-19T05:17:49.254730+0000","last_peered":"2024-09-19T05:17:49.254730+0000","last_clean":"2024-09-19T05:17:49.254730+0000","last_became_active":"2024-09-19T05:17:28.180298+0000","last_became_peered":"2024-09-19T05:17:28.180298+0000","last_unstale":"2024-09-19T05:17:49.254730+0000","last_undegraded":"2024-09-19T05:17:49.254730+0000","last_fullsized":"2024-09-19T05:17:49.254730+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:06.361677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258465+0000","last_change":"2024-09-19T05:17:30.199091+0000","last_active":"2024-09-19T05:17:49.258465+0000","last_peered":"2024-09-19T05:17:49.258465+0000","last_clean":"2024-09-19T05:17:49.258465+0000","last_became_active":"2024-09-19T05:17:30.198805+0000","last_became_peered":"2024-09-19T05:17:30.198805+0000","last_unstale":"2024-09-19T05:17:49.258465+0000","last_undegraded":"2024-09-19T05:17:49.258465+0000","last_fullsized":"2024-09-19T05:17:49.258465+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:27.906713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.256486+0000","last_change":"2024-09-19T05:17:28.182281+0000","last_active":"2024-09-19T05:17:49.256486+0000","last_peered":"2024-09-19T05:17:49.256486+0000","last_clean":"2024-09-19T05:17:49.256486+0000","last_became_active":"2024-09-19T05:17:28.181939+0000","last_became_peered":"2024-09-19T05:17:28.181939+0000","last_unstale":"2024-09-19T05:17:49.256486+0000","last_undegraded":"2024-09-19T05:17:49.256486+0000","last_fullsized":"2024-09-19T05:17:49.256486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:12.057601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.256715+0000","last_change":"2024-09-19T05:17:30.198849+0000","last_active":"2024-09-19T05:17:49.256715+0000","last_peered":"2024-09-19T05:17:49.256715+0000","last_clean":"2024-09-19T05:17:49.256715+0000","last_became_active":"2024-09-19T05:17:30.198473+0000","last_became_peered":"2024-09-19T05:17:30.198473+0000","last_unstale":"2024-09-19T05:17:49.256715+0000","last_undegraded":"2024-09-19T05:17:49.256715+0000","last_fullsized":"2024-09-19T05:17:49.256715+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:20.591516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":78,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:18:31.317116+0000","last_change":"2024-09-19T05:17:28.181393+0000","last_active":"2024-09-19T05:18:31.317116+0000","last_peered":"2024-09-19T05:18:31.317116+0000","last_clean":"2024-09-19T05:18:31.317116+0000","last_became_active":"2024-09-19T05:17:28.181069+0000","last_became_peered":"2024-09-19T05:17:28.181069+0000","last_unstale":"2024-09-19T05:18:31.317116+0000","last_undegraded":"2024-09-19T05:18:31.317116+0000","last_fullsized":"2024-09-19T05:18:31.317116+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:15.684564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253792+0000","last_change":"2024-09-19T05:17:30.204968+0000","last_active":"2024-09-19T05:17:49.253792+0000","last_peered":"2024-09-19T05:17:49.253792+0000","last_clean":"2024-09-19T05:17:49.253792+0000","last_became_active":"2024-09-19T05:17:30.204613+0000","last_became_peered":"2024-09-19T05:17:30.204613+0000","last_unstale":"2024-09-19T05:17:49.253792+0000","last_undegraded":"2024-09-19T05:17:49.253792+0000","last_fullsized":"2024-09-19T05:17:49.253792+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:14.836220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258502+0000","last_change":"2024-09-19T05:17:28.185554+0000","last_active":"2024-09-19T05:17:49.258502+0000","last_peered":"2024-09-19T05:17:49.258502+0000","last_clean":"2024-09-19T05:17:49.258502+0000","last_became_active":"2024-09-19T05:17:28.185198+0000","last_became_peered":"2024-09-19T05:17:28.185198+0000","last_unstale":"2024-09-19T05:17:49.258502+0000","last_undegraded":"2024-09-19T05:17:49.258502+0000","last_fullsized":"2024-09-19T05:17:49.258502+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:59.753359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258434+0000","last_change":"2024-09-19T05:17:30.207418+0000","last_active":"2024-09-19T05:17:49.258434+0000","last_peered":"2024-09-19T05:17:49.258434+0000","last_clean":"2024-09-19T05:17:49.258434+0000","last_became_active":"2024-09-19T05:17:30.207079+0000","last_became_peered":"2024-09-19T05:17:30.207079+0000","last_unstale":"2024-09-19T05:17:49.258434+0000","last_undegraded":"2024-09-19T05:17:49.258434+0000","last_fullsized":"2024-09-19T05:17:49.258434+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:40:49.564649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255759+0000","last_change":"2024-09-19T05:17:28.204988+0000","last_active":"2024-09-19T05:17:49.255759+0000","last_peered":"2024-09-19T05:17:49.255759+0000","last_clean":"2024-09-19T05:17:49.255759+0000","last_became_active":"2024-09-19T05:17:28.204607+0000","last_became_peered":"2024-09-19T05:17:28.204607+0000","last_unstale":"2024-09-19T05:17:49.255759+0000","last_undegraded":"2024-09-19T05:17:49.255759+0000","last_fullsized":"2024-09-19T05:17:49.255759+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:17.914720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253360+0000","last_change":"2024-09-19T05:17:30.207876+0000","last_active":"2024-09-19T05:17:49.253360+0000","last_peered":"2024-09-19T05:17:49.253360+0000","last_clean":"2024-09-19T05:17:49.253360+0000","last_became_active":"2024-09-19T05:17:30.207561+0000","last_became_peered":"2024-09-19T05:17:30.207561+0000","last_unstale":"2024-09-19T05:17:49.253360+0000","last_undegraded":"2024-09-19T05:17:49.253360+0000","last_fullsized":"2024-09-19T05:17:49.253360+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:26.696949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'29","reported_seq":166,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:18:32.318639+0000","last_change":"2024-09-19T05:17:28.185152+0000","last_active":"2024-09-19T05:18:32.318639+0000","last_peered":"2024-09-19T05:18:32.318639+0000","last_clean":"2024-09-19T05:18:32.318639+0000","last_became_active":"2024-09-19T05:17:28.184792+0000","last_became_peered":"2024-09-19T05:17:28.184792+0000","last_unstale":"2024-09-19T05:18:32.318639+0000","last_undegraded":"2024-09-19T05:18:32.318639+0000","last_fullsized":"2024-09-19T05:18:32.318639+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:04.647138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61167,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":115,"num_read_kb":116,"num_write":30,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.505387+0000","last_change":"2024-09-19T05:17:30.209768+0000","last_active":"2024-09-19T05:17:49.505387+0000","last_peered":"2024-09-19T05:17:49.505387+0000","last_clean":"2024-09-19T05:17:49.505387+0000","last_became_active":"2024-09-19T05:17:30.209399+0000","last_became_peered":"2024-09-19T05:17:30.209399+0000","last_unstale":"2024-09-19T05:17:49.505387+0000","last_undegraded":"2024-09-19T05:17:49.505387+0000","last_fullsized":"2024-09-19T05:17:49.505387+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:58.664138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.269672+0000","last_change":"2024-09-19T05:17:49.269241+0000","last_active":"2024-09-19T05:17:49.269672+0000","last_peered":"2024-09-19T05:17:49.269672+0000","last_clean":"2024-09-19T05:17:49.269672+0000","last_became_active":"2024-09-19T05:17:49.259494+0000","last_became_peered":"2024-09-19T05:17:49.259494+0000","last_unstale":"2024-09-19T05:17:49.269672+0000","last_undegraded":"2024-09-19T05:17:49.269672+0000","last_fullsized":"2024-09-19T05:17:49.269672+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:59.866742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254867+0000","last_change":"2024-09-19T05:17:30.204554+0000","last_active":"2024-09-19T05:17:49.254867+0000","last_peered":"2024-09-19T05:17:49.254867+0000","last_clean":"2024-09-19T05:17:49.254867+0000","last_became_active":"2024-09-19T05:17:30.203166+0000","last_became_peered":"2024-09-19T05:17:30.203166+0000","last_unstale":"2024-09-19T05:17:49.254867+0000","last_undegraded":"2024-09-19T05:17:49.254867+0000","last_fullsized":"2024-09-19T05:17:49.254867+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:23.517869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255318+0000","last_change":"2024-09-19T05:17:28.183800+0000","last_active":"2024-09-19T05:17:49.255318+0000","last_peered":"2024-09-19T05:17:49.255318+0000","last_clean":"2024-09-19T05:17:49.255318+0000","last_became_active":"2024-09-19T05:17:28.182819+0000","last_became_peered":"2024-09-19T05:17:28.182819+0000","last_unstale":"2024-09-19T05:17:49.255318+0000","last_undegraded":"2024-09-19T05:17:49.255318+0000","last_fullsized":"2024-09-19T05:17:49.255318+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:44:52.215544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257754+0000","last_change":"2024-09-19T05:17:30.214723+0000","last_active":"2024-09-19T05:17:49.257754+0000","last_peered":"2024-09-19T05:17:49.257754+0000","last_clean":"2024-09-19T05:17:49.257754+0000","last_became_active":"2024-09-19T05:17:30.214343+0000","last_became_peered":"2024-09-19T05:17:30.214343+0000","last_unstale":"2024-09-19T05:17:49.257754+0000","last_undegraded":"2024-09-19T05:17:49.257754+0000","last_fullsized":"2024-09-19T05:17:49.257754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:13.008151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'3","reported_seq":78,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:18:29.330926+0000","last_change":"2024-09-19T05:17:28.183130+0000","last_active":"2024-09-19T05:18:29.330926+0000","last_peered":"2024-09-19T05:18:29.330926+0000","last_clean":"2024-09-19T05:18:29.330926+0000","last_became_active":"2024-09-19T05:17:28.182834+0000","last_became_peered":"2024-09-19T05:17:28.182834+0000","last_unstale":"2024-09-19T05:18:29.330926+0000","last_undegraded":"2024-09-19T05:18:29.330926+0000","last_fullsized":"2024-09-19T05:18:29.330926+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:48.683776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257284+0000","last_change":"2024-09-19T05:17:30.212438+0000","last_active":"2024-09-19T05:17:49.257284+0000","last_peered":"2024-09-19T05:17:49.257284+0000","last_clean":"2024-09-19T05:17:49.257284+0000","last_became_active":"2024-09-19T05:17:30.209321+0000","last_became_peered":"2024-09-19T05:17:30.209321+0000","last_unstale":"2024-09-19T05:17:49.257284+0000","last_undegraded":"2024-09-19T05:17:49.257284+0000","last_fullsized":"2024-09-19T05:17:49.257284+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:42.772116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.505105+0000","last_change":"2024-09-19T05:17:28.204665+0000","last_active":"2024-09-19T05:17:49.505105+0000","last_peered":"2024-09-19T05:17:49.505105+0000","last_clean":"2024-09-19T05:17:49.505105+0000","last_became_active":"2024-09-19T05:17:28.204309+0000","last_became_peered":"2024-09-19T05:17:28.204309+0000","last_unstale":"2024-09-19T05:17:49.505105+0000","last_undegraded":"2024-09-19T05:17:49.505105+0000","last_fullsized":"2024-09-19T05:17:49.505105+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:26.372762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255224+0000","last_change":"2024-09-19T05:17:30.208518+0000","last_active":"2024-09-19T05:17:49.255224+0000","last_peered":"2024-09-19T05:17:49.255224+0000","last_clean":"2024-09-19T05:17:49.255224+0000","last_became_active":"2024-09-19T05:17:30.208172+0000","last_became_peered":"2024-09-19T05:17:30.208172+0000","last_unstale":"2024-09-19T05:17:49.255224+0000","last_undegraded":"2024-09-19T05:17:49.255224+0000","last_fullsized":"2024-09-19T05:17:49.255224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:40:25.754925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.505491+0000","last_change":"2024-09-19T05:17:28.180930+0000","last_active":"2024-09-19T05:17:49.505491+0000","last_peered":"2024-09-19T05:17:49.505491+0000","last_clean":"2024-09-19T05:17:49.505491+0000","last_became_active":"2024-09-19T05:17:28.180575+0000","last_became_peered":"2024-09-19T05:17:28.180575+0000","last_unstale":"2024-09-19T05:17:49.505491+0000","last_undegraded":"2024-09-19T05:17:49.505491+0000","last_fullsized":"2024-09-19T05:17:49.505491+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:36:15.390852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254917+0000","last_change":"2024-09-19T05:17:30.207002+0000","last_active":"2024-09-19T05:17:49.254917+0000","last_peered":"2024-09-19T05:17:49.254917+0000","last_clean":"2024-09-19T05:17:49.254917+0000","last_became_active":"2024-09-19T05:17:30.205750+0000","last_became_peered":"2024-09-19T05:17:30.205750+0000","last_unstale":"2024-09-19T05:17:49.254917+0000","last_undegraded":"2024-09-19T05:17:49.254917+0000","last_fullsized":"2024-09-19T05:17:49.254917+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:25:18.716206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255138+0000","last_change":"2024-09-19T05:17:28.184071+0000","last_active":"2024-09-19T05:17:49.255138+0000","last_peered":"2024-09-19T05:17:49.255138+0000","last_clean":"2024-09-19T05:17:49.255138+0000","last_became_active":"2024-09-19T05:17:28.183708+0000","last_became_peered":"2024-09-19T05:17:28.183708+0000","last_unstale":"2024-09-19T05:17:49.255138+0000","last_undegraded":"2024-09-19T05:17:49.255138+0000","last_fullsized":"2024-09-19T05:17:49.255138+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:57:23.831000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257299+0000","last_change":"2024-09-19T05:17:30.211919+0000","last_active":"2024-09-19T05:17:49.257299+0000","last_peered":"2024-09-19T05:17:49.257299+0000","last_clean":"2024-09-19T05:17:49.257299+0000","last_became_active":"2024-09-19T05:17:30.210639+0000","last_became_peered":"2024-09-19T05:17:30.210639+0000","last_unstale":"2024-09-19T05:17:49.257299+0000","last_undegraded":"2024-09-19T05:17:49.257299+0000","last_fullsized":"2024-09-19T05:17:49.257299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:25.231732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.255846+0000","last_change":"2024-09-19T05:17:28.179372+0000","last_active":"2024-09-19T05:17:49.255846+0000","last_peered":"2024-09-19T05:17:49.255846+0000","last_clean":"2024-09-19T05:17:49.255846+0000","last_became_active":"2024-09-19T05:17:28.178792+0000","last_became_peered":"2024-09-19T05:17:28.178792+0000","last_unstale":"2024-09-19T05:17:49.255846+0000","last_undegraded":"2024-09-19T05:17:49.255846+0000","last_fullsized":"2024-09-19T05:17:49.255846+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:54.705552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258607+0000","last_change":"2024-09-19T05:17:30.208201+0000","last_active":"2024-09-19T05:17:49.258607+0000","last_peered":"2024-09-19T05:17:49.258607+0000","last_clean":"2024-09-19T05:17:49.258607+0000","last_became_active":"2024-09-19T05:17:30.207865+0000","last_became_peered":"2024-09-19T05:17:30.207865+0000","last_unstale":"2024-09-19T05:17:49.258607+0000","last_undegraded":"2024-09-19T05:17:49.258607+0000","last_fullsized":"2024-09-19T05:17:49.258607+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:35.954759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253446+0000","last_change":"2024-09-19T05:17:28.543685+0000","last_active":"2024-09-19T05:17:49.253446+0000","last_peered":"2024-09-19T05:17:49.253446+0000","last_clean":"2024-09-19T05:17:49.253446+0000","last_became_active":"2024-09-19T05:17:28.543292+0000","last_became_peered":"2024-09-19T05:17:28.543292+0000","last_unstale":"2024-09-19T05:17:49.253446+0000","last_undegraded":"2024-09-19T05:17:49.253446+0000","last_fullsized":"2024-09-19T05:17:49.253446+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:55:14.348544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258916+0000","last_change":"2024-09-19T05:17:30.212449+0000","last_active":"2024-09-19T05:17:49.258916+0000","last_peered":"2024-09-19T05:17:49.258916+0000","last_clean":"2024-09-19T05:17:49.258916+0000","last_became_active":"2024-09-19T05:17:30.211265+0000","last_became_peered":"2024-09-19T05:17:30.211265+0000","last_unstale":"2024-09-19T05:17:49.258916+0000","last_undegraded":"2024-09-19T05:17:49.258916+0000","last_fullsized":"2024-09-19T05:17:49.258916+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:27.687687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":346,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257570+0000","last_change":"2024-09-19T05:16:20.361975+0000","last_active":"2024-09-19T05:17:49.257570+0000","last_peered":"2024-09-19T05:17:49.257570+0000","last_clean":"2024-09-19T05:17:49.257570+0000","last_became_active":"2024-09-19T05:16:20.361553+0000","last_became_peered":"2024-09-19T05:16:20.361553+0000","last_unstale":"2024-09-19T05:17:49.257570+0000","last_undegraded":"2024-09-19T05:17:49.257570+0000","last_fullsized":"2024-09-19T05:17:49.257570+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:13:02.674575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:13:02.674575+0000","last_clean_scrub_stamp":"2024-09-19T05:13:02.674575+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:48.711411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259170+0000","last_change":"2024-09-19T05:17:28.180486+0000","last_active":"2024-09-19T05:17:49.259170+0000","last_peered":"2024-09-19T05:17:49.259170+0000","last_clean":"2024-09-19T05:17:49.259170+0000","last_became_active":"2024-09-19T05:17:28.180147+0000","last_became_peered":"2024-09-19T05:17:28.180147+0000","last_unstale":"2024-09-19T05:17:49.259170+0000","last_undegraded":"2024-09-19T05:17:49.259170+0000","last_fullsized":"2024-09-19T05:17:49.259170+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:57.820328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258205+0000","last_change":"2024-09-19T05:17:30.205560+0000","last_active":"2024-09-19T05:17:49.258205+0000","last_peered":"2024-09-19T05:17:49.258205+0000","last_clean":"2024-09-19T05:17:49.258205+0000","last_became_active":"2024-09-19T05:17:30.205269+0000","last_became_peered":"2024-09-19T05:17:30.205269+0000","last_unstale":"2024-09-19T05:17:49.258205+0000","last_undegraded":"2024-09-19T05:17:49.258205+0000","last_fullsized":"2024-09-19T05:17:49.258205+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:22.904616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257462+0000","last_change":"2024-09-19T05:17:28.181845+0000","last_active":"2024-09-19T05:17:49.257462+0000","last_peered":"2024-09-19T05:17:49.257462+0000","last_clean":"2024-09-19T05:17:49.257462+0000","last_became_active":"2024-09-19T05:17:28.181549+0000","last_became_peered":"2024-09-19T05:17:28.181549+0000","last_unstale":"2024-09-19T05:17:49.257462+0000","last_undegraded":"2024-09-19T05:17:49.257462+0000","last_fullsized":"2024-09-19T05:17:49.257462+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:01.222364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259631+0000","last_change":"2024-09-19T05:17:49.259631+0000","last_active":"2024-09-19T05:17:49.259631+0000","last_peered":"2024-09-19T05:17:49.259631+0000","last_clean":"2024-09-19T05:17:49.259631+0000","last_became_active":"2024-09-19T05:17:49.259240+0000","last_became_peered":"2024-09-19T05:17:49.259240+0000","last_unstale":"2024-09-19T05:17:49.259631+0000","last_undegraded":"2024-09-19T05:17:49.259631+0000","last_fullsized":"2024-09-19T05:17:49.259631+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:22.533248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:18:29.330382+0000","last_change":"2024-09-19T05:17:28.204924+0000","last_active":"2024-09-19T05:18:29.330382+0000","last_peered":"2024-09-19T05:18:29.330382+0000","last_clean":"2024-09-19T05:18:29.330382+0000","last_became_active":"2024-09-19T05:17:28.204602+0000","last_became_peered":"2024-09-19T05:17:28.204602+0000","last_unstale":"2024-09-19T05:18:29.330382+0000","last_undegraded":"2024-09-19T05:18:29.330382+0000","last_fullsized":"2024-09-19T05:18:29.330382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:13.303939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259147+0000","last_change":"2024-09-19T05:17:49.259147+0000","last_active":"2024-09-19T05:17:49.259147+0000","last_peered":"2024-09-19T05:17:49.259147+0000","last_clean":"2024-09-19T05:17:49.259147+0000","last_became_active":"2024-09-19T05:17:49.258666+0000","last_became_peered":"2024-09-19T05:17:49.258666+0000","last_unstale":"2024-09-19T05:17:49.259147+0000","last_undegraded":"2024-09-19T05:17:49.259147+0000","last_fullsized":"2024-09-19T05:17:49.259147+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:54.802994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257809+0000","last_change":"2024-09-19T05:17:28.182456+0000","last_active":"2024-09-19T05:17:49.257809+0000","last_peered":"2024-09-19T05:17:49.257809+0000","last_clean":"2024-09-19T05:17:49.257809+0000","last_became_active":"2024-09-19T05:17:28.182075+0000","last_became_peered":"2024-09-19T05:17:28.182075+0000","last_unstale":"2024-09-19T05:17:49.257809+0000","last_undegraded":"2024-09-19T05:17:49.257809+0000","last_fullsized":"2024-09-19T05:17:49.257809+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:42.771641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257506+0000","last_change":"2024-09-19T05:17:30.204300+0000","last_active":"2024-09-19T05:17:49.257506+0000","last_peered":"2024-09-19T05:17:49.257506+0000","last_clean":"2024-09-19T05:17:49.257506+0000","last_became_active":"2024-09-19T05:17:30.203840+0000","last_became_peered":"2024-09-19T05:17:30.203840+0000","last_unstale":"2024-09-19T05:17:49.257506+0000","last_undegraded":"2024-09-19T05:17:49.257506+0000","last_fullsized":"2024-09-19T05:17:49.257506+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:48.363862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.256914+0000","last_change":"2024-09-19T05:17:28.204474+0000","last_active":"2024-09-19T05:17:49.256914+0000","last_peered":"2024-09-19T05:17:49.256914+0000","last_clean":"2024-09-19T05:17:49.256914+0000","last_became_active":"2024-09-19T05:17:28.204143+0000","last_became_peered":"2024-09-19T05:17:28.204143+0000","last_unstale":"2024-09-19T05:17:49.256914+0000","last_undegraded":"2024-09-19T05:17:49.256914+0000","last_fullsized":"2024-09-19T05:17:49.256914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:46.647789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257702+0000","last_change":"2024-09-19T05:17:30.198791+0000","last_active":"2024-09-19T05:17:49.257702+0000","last_peered":"2024-09-19T05:17:49.257702+0000","last_clean":"2024-09-19T05:17:49.257702+0000","last_became_active":"2024-09-19T05:17:30.198399+0000","last_became_peered":"2024-09-19T05:17:30.198399+0000","last_unstale":"2024-09-19T05:17:49.257702+0000","last_undegraded":"2024-09-19T05:17:49.257702+0000","last_fullsized":"2024-09-19T05:17:49.257702+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:46.676625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.505515+0000","last_change":"2024-09-19T05:17:28.204690+0000","last_active":"2024-09-19T05:17:49.505515+0000","last_peered":"2024-09-19T05:17:49.505515+0000","last_clean":"2024-09-19T05:17:49.505515+0000","last_became_active":"2024-09-19T05:17:28.204377+0000","last_became_peered":"2024-09-19T05:17:28.204377+0000","last_unstale":"2024-09-19T05:17:49.505515+0000","last_undegraded":"2024-09-19T05:17:49.505515+0000","last_fullsized":"2024-09-19T05:17:49.505515+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:29:20.583163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254992+0000","last_change":"2024-09-19T05:17:30.200584+0000","last_active":"2024-09-19T05:17:49.254992+0000","last_peered":"2024-09-19T05:17:49.254992+0000","last_clean":"2024-09-19T05:17:49.254992+0000","last_became_active":"2024-09-19T05:17:30.200270+0000","last_became_peered":"2024-09-19T05:17:30.200270+0000","last_unstale":"2024-09-19T05:17:49.254992+0000","last_undegraded":"2024-09-19T05:17:49.254992+0000","last_fullsized":"2024-09-19T05:17:49.254992+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:24:43.493332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'12","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:55.197772+0000","last_change":"2024-09-19T05:17:28.181020+0000","last_active":"2024-09-19T05:17:55.197772+0000","last_peered":"2024-09-19T05:17:55.197772+0000","last_clean":"2024-09-19T05:17:55.197772+0000","last_became_active":"2024-09-19T05:17:28.180298+0000","last_became_peered":"2024-09-19T05:17:28.180298+0000","last_unstale":"2024-09-19T05:17:55.197772+0000","last_undegraded":"2024-09-19T05:17:55.197772+0000","last_fullsized":"2024-09-19T05:17:55.197772+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:32.931699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258799+0000","last_change":"2024-09-19T05:17:30.209632+0000","last_active":"2024-09-19T05:17:49.258799+0000","last_peered":"2024-09-19T05:17:49.258799+0000","last_clean":"2024-09-19T05:17:49.258799+0000","last_became_active":"2024-09-19T05:17:30.209334+0000","last_became_peered":"2024-09-19T05:17:30.209334+0000","last_unstale":"2024-09-19T05:17:49.258799+0000","last_undegraded":"2024-09-19T05:17:49.258799+0000","last_fullsized":"2024-09-19T05:17:49.258799+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:21.159099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259725+0000","last_change":"2024-09-19T05:17:28.543802+0000","last_active":"2024-09-19T05:17:49.259725+0000","last_peered":"2024-09-19T05:17:49.259725+0000","last_clean":"2024-09-19T05:17:49.259725+0000","last_became_active":"2024-09-19T05:17:28.543503+0000","last_became_peered":"2024-09-19T05:17:28.543503+0000","last_unstale":"2024-09-19T05:17:49.259725+0000","last_undegraded":"2024-09-19T05:17:49.259725+0000","last_fullsized":"2024-09-19T05:17:49.259725+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:13.764141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258058+0000","last_change":"2024-09-19T05:17:30.206755+0000","last_active":"2024-09-19T05:17:49.258058+0000","last_peered":"2024-09-19T05:17:49.258058+0000","last_clean":"2024-09-19T05:17:49.258058+0000","last_became_active":"2024-09-19T05:17:30.205757+0000","last_became_peered":"2024-09-19T05:17:30.205757+0000","last_unstale":"2024-09-19T05:17:49.258058+0000","last_undegraded":"2024-09-19T05:17:49.258058+0000","last_fullsized":"2024-09-19T05:17:49.258058+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:16.281294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253238+0000","last_change":"2024-09-19T05:17:28.204819+0000","last_active":"2024-09-19T05:17:49.253238+0000","last_peered":"2024-09-19T05:17:49.253238+0000","last_clean":"2024-09-19T05:17:49.253238+0000","last_became_active":"2024-09-19T05:17:28.204445+0000","last_became_peered":"2024-09-19T05:17:28.204445+0000","last_unstale":"2024-09-19T05:17:49.253238+0000","last_undegraded":"2024-09-19T05:17:49.253238+0000","last_fullsized":"2024-09-19T05:17:49.253238+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:26.473654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.504996+0000","last_change":"2024-09-19T05:17:30.201331+0000","last_active":"2024-09-19T05:17:49.504996+0000","last_peered":"2024-09-19T05:17:49.504996+0000","last_clean":"2024-09-19T05:17:49.504996+0000","last_became_active":"2024-09-19T05:17:30.200992+0000","last_became_peered":"2024-09-19T05:17:30.200992+0000","last_unstale":"2024-09-19T05:17:49.504996+0000","last_undegraded":"2024-09-19T05:17:49.504996+0000","last_fullsized":"2024-09-19T05:17:49.504996+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:17.033786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257860+0000","last_change":"2024-09-19T05:17:28.180149+0000","last_active":"2024-09-19T05:17:49.257860+0000","last_peered":"2024-09-19T05:17:49.257860+0000","last_clean":"2024-09-19T05:17:49.257860+0000","last_became_active":"2024-09-19T05:17:28.179767+0000","last_became_peered":"2024-09-19T05:17:28.179767+0000","last_unstale":"2024-09-19T05:17:49.257860+0000","last_undegraded":"2024-09-19T05:17:49.257860+0000","last_fullsized":"2024-09-19T05:17:49.257860+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:25.074252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.254511+0000","last_change":"2024-09-19T05:17:30.204533+0000","last_active":"2024-09-19T05:17:49.254511+0000","last_peered":"2024-09-19T05:17:49.254511+0000","last_clean":"2024-09-19T05:17:49.254511+0000","last_became_active":"2024-09-19T05:17:30.204224+0000","last_became_peered":"2024-09-19T05:17:30.204224+0000","last_unstale":"2024-09-19T05:17:49.254511+0000","last_undegraded":"2024-09-19T05:17:49.254511+0000","last_fullsized":"2024-09-19T05:17:49.254511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:11.021297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253084+0000","last_change":"2024-09-19T05:17:28.187544+0000","last_active":"2024-09-19T05:17:49.253084+0000","last_peered":"2024-09-19T05:17:49.253084+0000","last_clean":"2024-09-19T05:17:49.253084+0000","last_became_active":"2024-09-19T05:17:28.187068+0000","last_became_peered":"2024-09-19T05:17:28.187068+0000","last_unstale":"2024-09-19T05:17:49.253084+0000","last_undegraded":"2024-09-19T05:17:49.253084+0000","last_fullsized":"2024-09-19T05:17:49.253084+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:01.151721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257927+0000","last_change":"2024-09-19T05:17:30.209549+0000","last_active":"2024-09-19T05:17:49.257927+0000","last_peered":"2024-09-19T05:17:49.257927+0000","last_clean":"2024-09-19T05:17:49.257927+0000","last_became_active":"2024-09-19T05:17:30.209225+0000","last_became_peered":"2024-09-19T05:17:30.209225+0000","last_unstale":"2024-09-19T05:17:49.257927+0000","last_undegraded":"2024-09-19T05:17:49.257927+0000","last_fullsized":"2024-09-19T05:17:49.257927+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:38.023351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.504986+0000","last_change":"2024-09-19T05:17:28.186601+0000","last_active":"2024-09-19T05:17:49.504986+0000","last_peered":"2024-09-19T05:17:49.504986+0000","last_clean":"2024-09-19T05:17:49.504986+0000","last_became_active":"2024-09-19T05:17:28.186236+0000","last_became_peered":"2024-09-19T05:17:28.186236+0000","last_unstale":"2024-09-19T05:17:49.504986+0000","last_undegraded":"2024-09-19T05:17:49.504986+0000","last_fullsized":"2024-09-19T05:17:49.504986+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:08.527906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257720+0000","last_change":"2024-09-19T05:17:30.203633+0000","last_active":"2024-09-19T05:17:49.257720+0000","last_peered":"2024-09-19T05:17:49.257720+0000","last_clean":"2024-09-19T05:17:49.257720+0000","last_became_active":"2024-09-19T05:17:30.203313+0000","last_became_peered":"2024-09-19T05:17:30.203313+0000","last_unstale":"2024-09-19T05:17:49.257720+0000","last_undegraded":"2024-09-19T05:17:49.257720+0000","last_fullsized":"2024-09-19T05:17:49.257720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:40.442434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.260731+0000","last_change":"2024-09-19T05:17:49.260345+0000","last_active":"2024-09-19T05:17:49.260731+0000","last_peered":"2024-09-19T05:17:49.260731+0000","last_clean":"2024-09-19T05:17:49.260731+0000","last_became_active":"2024-09-19T05:17:49.259938+0000","last_became_peered":"2024-09-19T05:17:49.259938+0000","last_unstale":"2024-09-19T05:17:49.260731+0000","last_undegraded":"2024-09-19T05:17:49.260731+0000","last_fullsized":"2024-09-19T05:17:49.260731+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:01.904276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.505270+0000","last_change":"2024-09-19T05:17:28.182014+0000","last_active":"2024-09-19T05:17:49.505270+0000","last_peered":"2024-09-19T05:17:49.505270+0000","last_clean":"2024-09-19T05:17:49.505270+0000","last_became_active":"2024-09-19T05:17:28.181666+0000","last_became_peered":"2024-09-19T05:17:28.181666+0000","last_unstale":"2024-09-19T05:17:49.505270+0000","last_undegraded":"2024-09-19T05:17:49.505270+0000","last_fullsized":"2024-09-19T05:17:49.505270+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:00:57.069618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.253344+0000","last_change":"2024-09-19T05:17:30.206428+0000","last_active":"2024-09-19T05:17:49.253344+0000","last_peered":"2024-09-19T05:17:49.253344+0000","last_clean":"2024-09-19T05:17:49.253344+0000","last_became_active":"2024-09-19T05:17:30.205818+0000","last_became_peered":"2024-09-19T05:17:30.205818+0000","last_unstale":"2024-09-19T05:17:49.253344+0000","last_undegraded":"2024-09-19T05:17:49.253344+0000","last_fullsized":"2024-09-19T05:17:49.253344+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:26.059019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.505410+0000","last_change":"2024-09-19T05:17:28.185596+0000","last_active":"2024-09-19T05:17:49.505410+0000","last_peered":"2024-09-19T05:17:49.505410+0000","last_clean":"2024-09-19T05:17:49.505410+0000","last_became_active":"2024-09-19T05:17:28.185278+0000","last_became_peered":"2024-09-19T05:17:28.185278+0000","last_unstale":"2024-09-19T05:17:49.505410+0000","last_undegraded":"2024-09-19T05:17:49.505410+0000","last_fullsized":"2024-09-19T05:17:49.505410+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:40.440874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258328+0000","last_change":"2024-09-19T05:17:30.200409+0000","last_active":"2024-09-19T05:17:49.258328+0000","last_peered":"2024-09-19T05:17:49.258328+0000","last_clean":"2024-09-19T05:17:49.258328+0000","last_became_active":"2024-09-19T05:17:30.200120+0000","last_became_peered":"2024-09-19T05:17:30.200120+0000","last_unstale":"2024-09-19T05:17:49.258328+0000","last_undegraded":"2024-09-19T05:17:49.258328+0000","last_fullsized":"2024-09-19T05:17:49.258328+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:12.396655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.259201+0000","last_change":"2024-09-19T05:17:28.205371+0000","last_active":"2024-09-19T05:17:49.259201+0000","last_peered":"2024-09-19T05:17:49.259201+0000","last_clean":"2024-09-19T05:17:49.259201+0000","last_became_active":"2024-09-19T05:17:28.205026+0000","last_became_peered":"2024-09-19T05:17:28.205026+0000","last_unstale":"2024-09-19T05:17:49.259201+0000","last_undegraded":"2024-09-19T05:17:49.259201+0000","last_fullsized":"2024-09-19T05:17:49.259201+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:59.518580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.258928+0000","last_change":"2024-09-19T05:17:30.206862+0000","last_active":"2024-09-19T05:17:49.258928+0000","last_peered":"2024-09-19T05:17:49.258928+0000","last_clean":"2024-09-19T05:17:49.258928+0000","last_became_active":"2024-09-19T05:17:30.206072+0000","last_became_peered":"2024-09-19T05:17:30.206072+0000","last_unstale":"2024-09-19T05:17:49.258928+0000","last_undegraded":"2024-09-19T05:17:49.258928+0000","last_fullsized":"2024-09-19T05:17:49.258928+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:47.810496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T05:17:49.257340+0000","last_change":"2024-09-19T05:17:28.181895+0000","last_active":"2024-09-19T05:17:49.257340+0000","last_peered":"2024-09-19T05:17:49.257340+0000","last_clean":"2024-09-19T05:17:49.257340+0000","last_became_active":"2024-09-19T05:17:28.181499+0000","last_became_peered":"2024-09-19T05:17:28.181499+0000","last_unstale":"2024-09-19T05:17:49.257340+0000","last_undegraded":"2024-09-19T05:17:49.257340+0000","last_fullsized":"2024-09-19T05:17:49.257340+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:29.722921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64777,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":338,"num_read_kb":238,"num_write":164,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":194331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579930,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":897024,"data_stored":433550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808863,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36896,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708256,"statfs":{"total":95995035648,"available":95957254144,"internally_reserved":0,"allocated":1589248,"data_stored":1086164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939684,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":909312,"data_stored":433752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168616,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":909312,"data_stored":433672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397548,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28500,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716652,"statfs":{"total":95995035648,"available":95965851648,"internally_reserved":0,"allocated":1503232,"data_stored":1025211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561074,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":897024,"data_stored":433141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790006,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32672,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712480,"statfs":{"total":95995035648,"available":95961579520,"internally_reserved":0,"allocated":1515520,"data_stored":1024895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953532,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":433578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215169,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":433452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444102,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":495417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607627,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":494101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36248,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708904,"statfs":{"total":95995035648,"available":95957917696,"internally_reserved":0,"allocated":917504,"data_stored":434412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":62483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:18:36.036 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T05:18:36.036 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T05:18:36.036 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T05:18:36.036 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T05:18:36.286 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:36.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.721+0000 7fb72bc86640 1 -- 172.21.15.120:0/2599720974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb724101de0 msgr2=0x7fb7241021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:36.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.721+0000 7fb72bc86640 1 --2- 172.21.15.120:0/2599720974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb724101de0 0x7fb7241021c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb718009900 tx=0x7fb71802a410 comp rx=0 tx=0).stop 2024-09-19T05:18:36.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.721+0000 7fb72bc86640 1 -- 172.21.15.120:0/2599720974 shutdown_connections 2024-09-19T05:18:36.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.721+0000 7fb72bc86640 1 --2- 172.21.15.120:0/2599720974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb724106f10 0x7fb72410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:36.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.721+0000 7fb72bc86640 1 --2- 172.21.15.120:0/2599720974 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb724102790 0x7fb7241067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:36.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.721+0000 7fb72bc86640 1 --2- 172.21.15.120:0/2599720974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb724101de0 0x7fb7241021c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:36.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.721+0000 7fb72bc86640 1 -- 172.21.15.120:0/2599720974 >> 172.21.15.120:0/2599720974 conn(0x7fb7240fd8c0 msgr2=0x7fb7240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:36.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.721+0000 7fb72bc86640 1 -- 172.21.15.120:0/2599720974 shutdown_connections 2024-09-19T05:18:36.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.721+0000 7fb72bc86640 1 -- 172.21.15.120:0/2599720974 wait complete. 2024-09-19T05:18:36.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.722+0000 7fb72bc86640 1 Processor -- start 2024-09-19T05:18:36.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.722+0000 7fb72bc86640 1 -- start start 2024-09-19T05:18:36.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.722+0000 7fb72bc86640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb724101de0 0x7fb7241984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:36.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.722+0000 7fb72bc86640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb724102790 0x7fb7241989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:36.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.722+0000 7fb72bc86640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb724106f10 0x7fb72419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:36.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.722+0000 7fb72bc86640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb724111e40 con 0x7fb724106f10 2024-09-19T05:18:36.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.722+0000 7fb72bc86640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb724111cc0 con 0x7fb724102790 2024-09-19T05:18:36.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.722+0000 7fb72bc86640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb724111fc0 con 0x7fb724101de0 2024-09-19T05:18:36.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.723+0000 7fb72a223640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb724106f10 0x7fb72419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:36.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.723+0000 7fb72a223640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb724106f10 0x7fb72419cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36986/0 (socket says 172.21.15.120:36986) 2024-09-19T05:18:36.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.723+0000 7fb72a223640 1 -- 172.21.15.120:0/1905286896 learned_addr learned my addr 172.21.15.120:0/1905286896 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:36.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.723+0000 7fb729221640 1 --2- 172.21.15.120:0/1905286896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb724102790 0x7fb7241989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:36.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.723+0000 7fb729a22640 1 --2- 172.21.15.120:0/1905286896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb724101de0 0x7fb7241984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:36.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.723+0000 7fb72a223640 1 -- 172.21.15.120:0/1905286896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb724101de0 msgr2=0x7fb7241984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:36.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.723+0000 7fb72a223640 1 --2- 172.21.15.120:0/1905286896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb724101de0 0x7fb7241984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:36.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.723+0000 7fb72a223640 1 -- 172.21.15.120:0/1905286896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb724102790 msgr2=0x7fb7241989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:36.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.723+0000 7fb72a223640 1 --2- 172.21.15.120:0/1905286896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb724102790 0x7fb7241989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:36.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.723+0000 7fb72a223640 1 -- 172.21.15.120:0/1905286896 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72419d460 con 0x7fb724106f10 2024-09-19T05:18:36.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.723+0000 7fb72a223640 1 --2- 172.21.15.120:0/1905286896 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb724106f10 0x7fb72419cd80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00b970 tx=0x7fb71c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:36.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.723+0000 7fb716ffd640 1 -- 172.21.15.120:0/1905286896 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c019070 con 0x7fb724106f10 2024-09-19T05:18:36.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.723+0000 7fb716ffd640 1 -- 172.21.15.120:0/1905286896 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb71c014440 con 0x7fb724106f10 2024-09-19T05:18:36.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.723+0000 7fb716ffd640 1 -- 172.21.15.120:0/1905286896 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c0075d0 con 0x7fb724106f10 2024-09-19T05:18:36.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.723+0000 7fb72bc86640 1 -- 172.21.15.120:0/1905286896 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb72419d750 con 0x7fb724106f10 2024-09-19T05:18:36.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.723+0000 7fb72bc86640 1 -- 172.21.15.120:0/1905286896 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7241a5030 con 0x7fb724106f10 2024-09-19T05:18:36.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.724+0000 7fb72bc86640 1 -- 172.21.15.120:0/1905286896 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7241021c0 con 0x7fb724106f10 2024-09-19T05:18:36.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.725+0000 7fb716ffd640 1 -- 172.21.15.120:0/1905286896 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fb71c01c070 con 0x7fb724106f10 2024-09-19T05:18:36.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.726+0000 7fb716ffd640 1 --2- 172.21.15.120:0/1905286896 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fb7100a32d0 0x7fb7100a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:36.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.726+0000 7fb729a22640 1 --2- 172.21.15.120:0/1905286896 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fb7100a32d0 0x7fb7100a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:36.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.726+0000 7fb716ffd640 1 -- 172.21.15.120:0/1905286896 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fb71c0cef80 con 0x7fb724106f10 2024-09-19T05:18:36.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.726+0000 7fb729a22640 1 --2- 172.21.15.120:0/1905286896 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fb7100a32d0 0x7fb7100a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb718031440 tx=0x7fb718005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:36.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.730+0000 7fb716ffd640 1 -- 172.21.15.120:0/1905286896 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb71c09b5e0 con 0x7fb724106f10 2024-09-19T05:18:36.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.936+0000 7fb72bc86640 1 -- 172.21.15.120:0/1905286896 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb72410a120 con 0x7fb724106f10 2024-09-19T05:18:36.939 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.936+0000 7fb716ffd640 1 -- 172.21.15.120:0/1905286896 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fb71c09f8e0 con 0x7fb724106f10 2024-09-19T05:18:36.939 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:18:36.940 INFO:teuthology.orchestra.run.smithi120.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T05:18:36.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.938+0000 7fb72bc86640 1 -- 172.21.15.120:0/1905286896 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fb7100a32d0 msgr2=0x7fb7100a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:36.941 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.938+0000 7fb72bc86640 1 --2- 172.21.15.120:0/1905286896 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fb7100a32d0 0x7fb7100a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb718031440 tx=0x7fb718005b50 comp rx=0 tx=0).stop 2024-09-19T05:18:36.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.938+0000 7fb72bc86640 1 -- 172.21.15.120:0/1905286896 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb724106f10 msgr2=0x7fb72419cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:36.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.938+0000 7fb72bc86640 1 --2- 172.21.15.120:0/1905286896 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb724106f10 0x7fb72419cd80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00b970 tx=0x7fb71c00be30 comp rx=0 tx=0).stop 2024-09-19T05:18:36.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.938+0000 7fb72bc86640 1 -- 172.21.15.120:0/1905286896 shutdown_connections 2024-09-19T05:18:36.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.938+0000 7fb72bc86640 1 --2- 172.21.15.120:0/1905286896 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb724106f10 0x7fb72419cd80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:36.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.938+0000 7fb72bc86640 1 --2- 172.21.15.120:0/1905286896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb724102790 0x7fb7241989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:36.942 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.938+0000 7fb72bc86640 1 --2- 172.21.15.120:0/1905286896 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fb7100a32d0 0x7fb7100a5790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:36.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.938+0000 7fb72bc86640 1 --2- 172.21.15.120:0/1905286896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb724101de0 0x7fb7241984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:36.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.938+0000 7fb72bc86640 1 -- 172.21.15.120:0/1905286896 >> 172.21.15.120:0/1905286896 conn(0x7fb7240fd8c0 msgr2=0x7fb7240feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:36.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.939+0000 7fb72bc86640 1 -- 172.21.15.120:0/1905286896 shutdown_connections 2024-09-19T05:18:36.943 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:36.939+0000 7fb72bc86640 1 -- 172.21.15.120:0/1905286896 wait complete. 2024-09-19T05:18:37.505 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:37 smithi120 ceph-mon[30956]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:18:37.505 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:37 smithi120 ceph-mon[30956]: pgmap v306: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T05:18:37.506 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:37 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1905286896' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T05:18:37.594 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T05:18:37.594 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:18:37.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:37 smithi194 ceph-mon[35228]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:18:37.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:37 smithi194 ceph-mon[35228]: pgmap v306: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T05:18:37.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:37 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1905286896' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T05:18:37.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:37 smithi178 ceph-mon[34347]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:18:37.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:37 smithi178 ceph-mon[34347]: pgmap v306: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T05:18:37.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:37 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1905286896' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T05:18:37.837 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:38.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.318+0000 7f87f2732640 1 -- 172.21.15.120:0/3700859837 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87ec100e20 msgr2=0x7f87ec101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:38.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.318+0000 7f87f2732640 1 --2- 172.21.15.120:0/3700859837 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87ec100e20 0x7f87ec101200 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f87dc009900 tx=0x7f87dc02a480 comp rx=0 tx=0).stop 2024-09-19T05:18:38.329 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.318+0000 7f87f2732640 1 -- 172.21.15.120:0/3700859837 shutdown_connections 2024-09-19T05:18:38.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.318+0000 7f87f2732640 1 --2- 172.21.15.120:0/3700859837 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87ec102ef0 0x7f87ec10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:38.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.318+0000 7f87f2732640 1 --2- 172.21.15.120:0/3700859837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87ec102570 0x7f87ec1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:38.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.318+0000 7f87f2732640 1 --2- 172.21.15.120:0/3700859837 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87ec100e20 0x7f87ec101200 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:38.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.318+0000 7f87f2732640 1 -- 172.21.15.120:0/3700859837 >> 172.21.15.120:0/3700859837 conn(0x7f87ec0fc7d0 msgr2=0x7f87ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:38.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.318+0000 7f87f2732640 1 -- 172.21.15.120:0/3700859837 shutdown_connections 2024-09-19T05:18:38.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.318+0000 7f87f2732640 1 -- 172.21.15.120:0/3700859837 wait complete. 2024-09-19T05:18:38.330 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.319+0000 7f87f2732640 1 Processor -- start 2024-09-19T05:18:38.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.319+0000 7f87f2732640 1 -- start start 2024-09-19T05:18:38.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.319+0000 7f87f2732640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87ec100e20 0x7f87ec198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:38.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.319+0000 7f87f2732640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87ec102570 0x7f87ec1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:38.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.319+0000 7f87f2732640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87ec102ef0 0x7f87ec19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:38.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.319+0000 7f87f2732640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f87ec110e50 con 0x7f87ec100e20 2024-09-19T05:18:38.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.319+0000 7f87f2732640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f87ec110cd0 con 0x7f87ec102ef0 2024-09-19T05:18:38.331 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.319+0000 7f87f2732640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f87ec110fd0 con 0x7f87ec102570 2024-09-19T05:18:38.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.319+0000 7f87ebfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87ec100e20 0x7f87ec198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:38.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.319+0000 7f87ebfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87ec100e20 0x7f87ec198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37006/0 (socket says 172.21.15.120:37006) 2024-09-19T05:18:38.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.319+0000 7f87ebfff640 1 -- 172.21.15.120:0/1052697726 learned_addr learned my addr 172.21.15.120:0/1052697726 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:38.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.320+0000 7f87f0ccf640 1 --2- 172.21.15.120:0/1052697726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87ec102ef0 0x7f87ec19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:38.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.320+0000 7f87eb7fe640 1 --2- 172.21.15.120:0/1052697726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87ec102570 0x7f87ec1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:38.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.320+0000 7f87ebfff640 1 -- 172.21.15.120:0/1052697726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87ec102570 msgr2=0x7f87ec1989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:38.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.320+0000 7f87ebfff640 1 --2- 172.21.15.120:0/1052697726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87ec102570 0x7f87ec1989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:38.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.320+0000 7f87ebfff640 1 -- 172.21.15.120:0/1052697726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87ec102ef0 msgr2=0x7f87ec19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:38.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.320+0000 7f87ebfff640 1 --2- 172.21.15.120:0/1052697726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87ec102ef0 0x7f87ec19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:38.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.320+0000 7f87ebfff640 1 -- 172.21.15.120:0/1052697726 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87ec19d410 con 0x7f87ec100e20 2024-09-19T05:18:38.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.320+0000 7f87f0ccf640 1 --2- 172.21.15.120:0/1052697726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87ec102ef0 0x7f87ec19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:18:38.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.320+0000 7f87ebfff640 1 --2- 172.21.15.120:0/1052697726 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87ec100e20 0x7f87ec198460 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f87dc006010 tx=0x7f87dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:38.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.320+0000 7f87e97fa640 1 -- 172.21.15.120:0/1052697726 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87dc03f070 con 0x7f87ec100e20 2024-09-19T05:18:38.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.320+0000 7f87f2732640 1 -- 172.21.15.120:0/1052697726 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87ec19d6a0 con 0x7f87ec100e20 2024-09-19T05:18:38.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.320+0000 7f87e97fa640 1 -- 172.21.15.120:0/1052697726 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f87dc003aa0 con 0x7f87ec100e20 2024-09-19T05:18:38.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.320+0000 7f87e97fa640 1 -- 172.21.15.120:0/1052697726 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87dc035030 con 0x7f87ec100e20 2024-09-19T05:18:38.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.320+0000 7f87f2732640 1 -- 172.21.15.120:0/1052697726 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87ec1a4fe0 con 0x7f87ec100e20 2024-09-19T05:18:38.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.321+0000 7f87f2732640 1 -- 172.21.15.120:0/1052697726 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87ec101200 con 0x7f87ec100e20 2024-09-19T05:18:38.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.323+0000 7f87e97fa640 1 -- 172.21.15.120:0/1052697726 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f87dc042070 con 0x7f87ec100e20 2024-09-19T05:18:38.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.324+0000 7f87e97fa640 1 --2- 172.21.15.120:0/1052697726 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f87d40a32d0 0x7f87d40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:38.334 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.324+0000 7f87eb7fe640 1 --2- 172.21.15.120:0/1052697726 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f87d40a32d0 0x7f87d40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:38.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.324+0000 7f87e97fa640 1 -- 172.21.15.120:0/1052697726 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f87dc0f0b40 con 0x7f87ec100e20 2024-09-19T05:18:38.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.324+0000 7f87eb7fe640 1 --2- 172.21.15.120:0/1052697726 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f87d40a32d0 0x7f87d40a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0fffe0 tx=0x7f87e000a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:38.335 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.327+0000 7f87e97fa640 1 -- 172.21.15.120:0/1052697726 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f87dc0bd6e0 con 0x7f87ec100e20 2024-09-19T05:18:38.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.535+0000 7f87f2732640 1 -- 172.21.15.120:0/1052697726 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87ec1997c0 con 0x7f87ec100e20 2024-09-19T05:18:38.537 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.536+0000 7f87e97fa640 1 -- 172.21.15.120:0/1052697726 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11921 (secure 0 0 0) 0x7f87ec1997c0 con 0x7f87ec100e20 2024-09-19T05:18:38.538 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:18:38.538 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":24,"btime":"2024-09-19T05:17:42:231927+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/93472898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":93472898},{"type":"v1","addr":"172.21.15.120:6835","nonce":93472898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1976835398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1976835398},{"type":"v1","addr":"172.21.15.120:6837","nonce":1976835398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6839/2975851469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":2975851469},{"type":"v1","addr":"172.21.15.120:6839","nonce":2975851469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6841/2837552754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":2837552754},{"type":"v1","addr":"172.21.15.120:6841","nonce":2837552754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/61682954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":61682954},{"type":"v1","addr":"172.21.15.178:6833","nonce":61682954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1778722040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1778722040},{"type":"v1","addr":"172.21.15.194:6833","nonce":1778722040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:17:30.796197+0000","modified":"2024-09-19T05:17:41.861437+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24445,"mds_1":24443,"mds_2":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24401":{"gid":24401,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/890775592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":890775592},{"type":"v1","addr":"172.21.15.178:6835","nonce":890775592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6837/3960720164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3960720164},{"type":"v1","addr":"172.21.15.178:6837","nonce":3960720164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6835/3268846994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3268846994},{"type":"v1","addr":"172.21.15.194:6835","nonce":3268846994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.194:6837/378729335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":378729335},{"type":"v1","addr":"172.21.15.194:6837","nonce":378729335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.178:6839/3389137566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3389137566},{"type":"v1","addr":"172.21.15.178:6839","nonce":3389137566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6839/3817420679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3817420679},{"type":"v1","addr":"172.21.15.194:6839","nonce":3817420679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24445,"qdb_cluster":[24430,24443,24445]},"id":1}]} 2024-09-19T05:18:38.538 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 24 2024-09-19T05:18:38.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.539+0000 7f87f2732640 1 -- 172.21.15.120:0/1052697726 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f87d40a32d0 msgr2=0x7f87d40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:38.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.539+0000 7f87f2732640 1 --2- 172.21.15.120:0/1052697726 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f87d40a32d0 0x7f87d40a5790 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0fffe0 tx=0x7f87e000a4c0 comp rx=0 tx=0).stop 2024-09-19T05:18:38.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.539+0000 7f87f2732640 1 -- 172.21.15.120:0/1052697726 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87ec100e20 msgr2=0x7f87ec198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:38.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.539+0000 7f87f2732640 1 --2- 172.21.15.120:0/1052697726 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87ec100e20 0x7f87ec198460 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f87dc006010 tx=0x7f87dc0042f0 comp rx=0 tx=0).stop 2024-09-19T05:18:38.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.539+0000 7f87f2732640 1 -- 172.21.15.120:0/1052697726 shutdown_connections 2024-09-19T05:18:38.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.539+0000 7f87f2732640 1 --2- 172.21.15.120:0/1052697726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87ec102ef0 0x7f87ec19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:38.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.539+0000 7f87f2732640 1 --2- 172.21.15.120:0/1052697726 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f87d40a32d0 0x7f87d40a5790 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:38.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.539+0000 7f87f2732640 1 --2- 172.21.15.120:0/1052697726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87ec102570 0x7f87ec1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:38.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.539+0000 7f87f2732640 1 --2- 172.21.15.120:0/1052697726 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f87ec100e20 0x7f87ec198460 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:38.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.539+0000 7f87f2732640 1 -- 172.21.15.120:0/1052697726 >> 172.21.15.120:0/1052697726 conn(0x7f87ec0fc7d0 msgr2=0x7f87ec06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:38.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.539+0000 7f87f2732640 1 -- 172.21.15.120:0/1052697726 shutdown_connections 2024-09-19T05:18:38.541 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:38.539+0000 7f87f2732640 1 -- 172.21.15.120:0/1052697726 wait complete. 2024-09-19T05:18:39.202 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:18:39.454 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:39.506 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:39 smithi120 ceph-mon[30956]: pgmap v307: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T05:18:39.506 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:39 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1052697726' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:39.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:39 smithi194 ceph-mon[35228]: pgmap v307: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T05:18:39.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:39 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1052697726' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:39.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:39 smithi178 ceph-mon[34347]: pgmap v307: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T05:18:39.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:39 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1052697726' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:39.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.965+0000 7fa7e175b640 1 -- 172.21.15.120:0/818434618 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7dc106f10 msgr2=0x7fa7dc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:39.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.965+0000 7fa7e175b640 1 --2- 172.21.15.120:0/818434618 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7dc106f10 0x7fa7dc10ea90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4009900 tx=0x7fa7d402a410 comp rx=0 tx=0).stop 2024-09-19T05:18:39.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.965+0000 7fa7e175b640 1 -- 172.21.15.120:0/818434618 shutdown_connections 2024-09-19T05:18:39.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.965+0000 7fa7e175b640 1 --2- 172.21.15.120:0/818434618 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7dc106f10 0x7fa7dc10ea90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:39.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.965+0000 7fa7e175b640 1 --2- 172.21.15.120:0/818434618 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7dc102790 0x7fa7dc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:39.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.965+0000 7fa7e175b640 1 --2- 172.21.15.120:0/818434618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7dc101de0 0x7fa7dc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:39.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.965+0000 7fa7e175b640 1 -- 172.21.15.120:0/818434618 >> 172.21.15.120:0/818434618 conn(0x7fa7dc0fd8c0 msgr2=0x7fa7dc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:39.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.965+0000 7fa7e175b640 1 -- 172.21.15.120:0/818434618 shutdown_connections 2024-09-19T05:18:39.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.965+0000 7fa7e175b640 1 -- 172.21.15.120:0/818434618 wait complete. 2024-09-19T05:18:39.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.966+0000 7fa7e175b640 1 Processor -- start 2024-09-19T05:18:39.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.966+0000 7fa7e175b640 1 -- start start 2024-09-19T05:18:39.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.966+0000 7fa7e175b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7dc101de0 0x7fa7dc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:39.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.966+0000 7fa7e175b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7dc102790 0x7fa7dc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:39.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.966+0000 7fa7e175b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7dc106f10 0x7fa7dc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:39.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.966+0000 7fa7e175b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa7dc111eb0 con 0x7fa7dc102790 2024-09-19T05:18:39.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.966+0000 7fa7e175b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa7dc111d30 con 0x7fa7dc106f10 2024-09-19T05:18:39.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.966+0000 7fa7e175b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa7dc112030 con 0x7fa7dc101de0 2024-09-19T05:18:39.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.966+0000 7fa7da7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7dc102790 0x7fa7dc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:39.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.966+0000 7fa7da7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7dc102790 0x7fa7dc074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37020/0 (socket says 172.21.15.120:37020) 2024-09-19T05:18:39.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.966+0000 7fa7da7fc640 1 -- 172.21.15.120:0/468563456 learned_addr learned my addr 172.21.15.120:0/468563456 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:39.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.966+0000 7fa7daffd640 1 --2- 172.21.15.120:0/468563456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7dc101de0 0x7fa7dc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:39.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.967+0000 7fa7db7fe640 1 --2- 172.21.15.120:0/468563456 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7dc106f10 0x7fa7dc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:39.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.967+0000 7fa7da7fc640 1 -- 172.21.15.120:0/468563456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7dc101de0 msgr2=0x7fa7dc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:39.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.967+0000 7fa7da7fc640 1 --2- 172.21.15.120:0/468563456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7dc101de0 0x7fa7dc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:39.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.967+0000 7fa7da7fc640 1 -- 172.21.15.120:0/468563456 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7dc106f10 msgr2=0x7fa7dc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:39.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.967+0000 7fa7da7fc640 1 --2- 172.21.15.120:0/468563456 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7dc106f10 0x7fa7dc074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:39.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.967+0000 7fa7da7fc640 1 -- 172.21.15.120:0/468563456 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7dc1a6870 con 0x7fa7dc102790 2024-09-19T05:18:39.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.967+0000 7fa7db7fe640 1 --2- 172.21.15.120:0/468563456 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7dc106f10 0x7fa7dc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:39.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.967+0000 7fa7daffd640 1 --2- 172.21.15.120:0/468563456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7dc101de0 0x7fa7dc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:18:39.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.967+0000 7fa7da7fc640 1 --2- 172.21.15.120:0/468563456 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7dc102790 0x7fa7dc074a30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400b4a0 tx=0x7fa7c400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:39.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.967+0000 7fa7d3fff640 1 -- 172.21.15.120:0/468563456 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4014070 con 0x7fa7dc102790 2024-09-19T05:18:39.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.967+0000 7fa7e175b640 1 -- 172.21.15.120:0/468563456 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7dc1a6b60 con 0x7fa7dc102790 2024-09-19T05:18:39.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.967+0000 7fa7d3fff640 1 -- 172.21.15.120:0/468563456 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa7c4010ac0 con 0x7fa7dc102790 2024-09-19T05:18:39.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.967+0000 7fa7d3fff640 1 -- 172.21.15.120:0/468563456 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4017c30 con 0x7fa7dc102790 2024-09-19T05:18:39.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.967+0000 7fa7e175b640 1 -- 172.21.15.120:0/468563456 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7dc1a70f0 con 0x7fa7dc102790 2024-09-19T05:18:39.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.968+0000 7fa7e175b640 1 -- 172.21.15.120:0/468563456 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7dc1021c0 con 0x7fa7dc102790 2024-09-19T05:18:39.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.969+0000 7fa7d3fff640 1 -- 172.21.15.120:0/468563456 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fa7c4017070 con 0x7fa7dc102790 2024-09-19T05:18:39.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.970+0000 7fa7d3fff640 1 --2- 172.21.15.120:0/468563456 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa7c80a32d0 0x7fa7c80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:39.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.970+0000 7fa7daffd640 1 --2- 172.21.15.120:0/468563456 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa7c80a32d0 0x7fa7c80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:39.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.970+0000 7fa7d3fff640 1 -- 172.21.15.120:0/468563456 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fa7c40cf140 con 0x7fa7dc102790 2024-09-19T05:18:39.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.970+0000 7fa7daffd640 1 --2- 172.21.15.120:0/468563456 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa7c80a32d0 0x7fa7c80a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc005fd0 tx=0x7fa7cc009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:39.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:39.974+0000 7fa7d3fff640 1 -- 172.21.15.120:0/468563456 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa7c409bdf0 con 0x7fa7dc102790 2024-09-19T05:18:40.174 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:40.173+0000 7fa7e175b640 1 -- 172.21.15.120:0/468563456 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7dc10a180 con 0x7fa7dc102790 2024-09-19T05:18:40.175 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:40.173+0000 7fa7d3fff640 1 -- 172.21.15.120:0/468563456 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11921 (secure 0 0 0) 0x7fa7c409b6f0 con 0x7fa7dc102790 2024-09-19T05:18:40.175 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:18:40.175 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":24,"btime":"2024-09-19T05:17:42:231927+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/93472898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":93472898},{"type":"v1","addr":"172.21.15.120:6835","nonce":93472898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1976835398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1976835398},{"type":"v1","addr":"172.21.15.120:6837","nonce":1976835398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6839/2975851469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":2975851469},{"type":"v1","addr":"172.21.15.120:6839","nonce":2975851469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6841/2837552754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":2837552754},{"type":"v1","addr":"172.21.15.120:6841","nonce":2837552754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/61682954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":61682954},{"type":"v1","addr":"172.21.15.178:6833","nonce":61682954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1778722040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1778722040},{"type":"v1","addr":"172.21.15.194:6833","nonce":1778722040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:17:30.796197+0000","modified":"2024-09-19T05:17:41.861437+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24445,"mds_1":24443,"mds_2":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24401":{"gid":24401,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/890775592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":890775592},{"type":"v1","addr":"172.21.15.178:6835","nonce":890775592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6837/3960720164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3960720164},{"type":"v1","addr":"172.21.15.178:6837","nonce":3960720164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6835/3268846994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3268846994},{"type":"v1","addr":"172.21.15.194:6835","nonce":3268846994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.194:6837/378729335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":378729335},{"type":"v1","addr":"172.21.15.194:6837","nonce":378729335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.178:6839/3389137566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3389137566},{"type":"v1","addr":"172.21.15.178:6839","nonce":3389137566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6839/3817420679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3817420679},{"type":"v1","addr":"172.21.15.194:6839","nonce":3817420679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24445,"qdb_cluster":[24430,24443,24445]},"id":1}]} 2024-09-19T05:18:40.176 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 24 2024-09-19T05:18:40.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:40.175+0000 7fa7e175b640 1 -- 172.21.15.120:0/468563456 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa7c80a32d0 msgr2=0x7fa7c80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:40.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:40.175+0000 7fa7e175b640 1 --2- 172.21.15.120:0/468563456 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa7c80a32d0 0x7fa7c80a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc005fd0 tx=0x7fa7cc009520 comp rx=0 tx=0).stop 2024-09-19T05:18:40.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:40.175+0000 7fa7e175b640 1 -- 172.21.15.120:0/468563456 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7dc102790 msgr2=0x7fa7dc074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:40.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:40.175+0000 7fa7e175b640 1 --2- 172.21.15.120:0/468563456 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7dc102790 0x7fa7dc074a30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400b4a0 tx=0x7fa7c400b960 comp rx=0 tx=0).stop 2024-09-19T05:18:40.177 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:40.175+0000 7fa7e175b640 1 -- 172.21.15.120:0/468563456 shutdown_connections 2024-09-19T05:18:40.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:40.175+0000 7fa7e175b640 1 --2- 172.21.15.120:0/468563456 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7dc106f10 0x7fa7dc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:40.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:40.175+0000 7fa7e175b640 1 --2- 172.21.15.120:0/468563456 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7dc102790 0x7fa7dc074a30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:40.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:40.175+0000 7fa7e175b640 1 --2- 172.21.15.120:0/468563456 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa7c80a32d0 0x7fa7c80a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:40.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:40.175+0000 7fa7e175b640 1 --2- 172.21.15.120:0/468563456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7dc101de0 0x7fa7dc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:40.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:40.175+0000 7fa7e175b640 1 -- 172.21.15.120:0/468563456 >> 172.21.15.120:0/468563456 conn(0x7fa7dc0fd8c0 msgr2=0x7fa7dc0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:40.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:40.176+0000 7fa7e175b640 1 -- 172.21.15.120:0/468563456 shutdown_connections 2024-09-19T05:18:40.178 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:40.176+0000 7fa7e175b640 1 -- 172.21.15.120:0/468563456 wait complete. 2024-09-19T05:18:40.531 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:40 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/468563456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:40.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:40 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/468563456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:40.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:40 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/468563456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:40.842 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T05:18:41.089 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:41.501 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:41 smithi120 ceph-mon[30956]: pgmap v308: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T05:18:41.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.578+0000 7f0f1eb5e640 1 -- 172.21.15.120:0/1833818430 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f18102570 msgr2=0x7f0f181029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:41.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.578+0000 7f0f1eb5e640 1 --2- 172.21.15.120:0/1833818430 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f18102570 0x7f0f181029b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009ca0 tx=0x7f0f0802a950 comp rx=0 tx=0).stop 2024-09-19T05:18:41.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.578+0000 7f0f1eb5e640 1 -- 172.21.15.120:0/1833818430 shutdown_connections 2024-09-19T05:18:41.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.578+0000 7f0f1eb5e640 1 --2- 172.21.15.120:0/1833818430 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f18102ef0 0x7f0f1810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:41.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.578+0000 7f0f1eb5e640 1 --2- 172.21.15.120:0/1833818430 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f18102570 0x7f0f181029b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:41.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.578+0000 7f0f1eb5e640 1 --2- 172.21.15.120:0/1833818430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f18100e20 0x7f0f18101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:41.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.578+0000 7f0f1eb5e640 1 -- 172.21.15.120:0/1833818430 >> 172.21.15.120:0/1833818430 conn(0x7f0f180fc7d0 msgr2=0x7f0f180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:41.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.578+0000 7f0f1eb5e640 1 -- 172.21.15.120:0/1833818430 shutdown_connections 2024-09-19T05:18:41.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.578+0000 7f0f1eb5e640 1 -- 172.21.15.120:0/1833818430 wait complete. 2024-09-19T05:18:41.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.578+0000 7f0f1eb5e640 1 Processor -- start 2024-09-19T05:18:41.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.578+0000 7f0f1eb5e640 1 -- start start 2024-09-19T05:18:41.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.579+0000 7f0f1eb5e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f18100e20 0x7f0f180fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:41.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.579+0000 7f0f1eb5e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f18102570 0x7f0f180fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:41.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.579+0000 7f0f1eb5e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f18102ef0 0x7f0f180fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:41.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.579+0000 7f0f1eb5e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0f18110e50 con 0x7f0f18100e20 2024-09-19T05:18:41.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.579+0000 7f0f1eb5e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0f18110cd0 con 0x7f0f18102570 2024-09-19T05:18:41.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.579+0000 7f0f1eb5e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0f18110fd0 con 0x7f0f18102ef0 2024-09-19T05:18:41.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.579+0000 7f0f1c8fa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f18100e20 0x7f0f180fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:41.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.579+0000 7f0f1c8fa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f18100e20 0x7f0f180fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37038/0 (socket says 172.21.15.120:37038) 2024-09-19T05:18:41.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.579+0000 7f0f1c8fa640 1 -- 172.21.15.120:0/244186199 learned_addr learned my addr 172.21.15.120:0/244186199 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:41.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.579+0000 7f0f1d0fb640 1 --2- 172.21.15.120:0/244186199 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f18102ef0 0x7f0f180fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:41.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.579+0000 7f0f17fff640 1 --2- 172.21.15.120:0/244186199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f18102570 0x7f0f180fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:41.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.579+0000 7f0f1c8fa640 1 -- 172.21.15.120:0/244186199 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f18102ef0 msgr2=0x7f0f180fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:41.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.579+0000 7f0f1c8fa640 1 --2- 172.21.15.120:0/244186199 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f18102ef0 0x7f0f180fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:41.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.579+0000 7f0f1c8fa640 1 -- 172.21.15.120:0/244186199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f18102570 msgr2=0x7f0f180fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:41.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.579+0000 7f0f1c8fa640 1 --2- 172.21.15.120:0/244186199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f18102570 0x7f0f180fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:41.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.579+0000 7f0f1c8fa640 1 -- 172.21.15.120:0/244186199 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f181a68d0 con 0x7f0f18100e20 2024-09-19T05:18:41.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.579+0000 7f0f17fff640 1 --2- 172.21.15.120:0/244186199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f18102570 0x7f0f180fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:41.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.579+0000 7f0f1c8fa640 1 --2- 172.21.15.120:0/244186199 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f18100e20 0x7f0f180fcc80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000b4a0 tx=0x7f0f1000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:41.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.580+0000 7f0f15ffb640 1 -- 172.21.15.120:0/244186199 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f10014070 con 0x7f0f18100e20 2024-09-19T05:18:41.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.580+0000 7f0f15ffb640 1 -- 172.21.15.120:0/244186199 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f10010ac0 con 0x7f0f18100e20 2024-09-19T05:18:41.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.580+0000 7f0f1eb5e640 1 -- 172.21.15.120:0/244186199 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f181a6bc0 con 0x7f0f18100e20 2024-09-19T05:18:41.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.580+0000 7f0f15ffb640 1 -- 172.21.15.120:0/244186199 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f10017c30 con 0x7f0f18100e20 2024-09-19T05:18:41.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.580+0000 7f0f1eb5e640 1 -- 172.21.15.120:0/244186199 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f181a7150 con 0x7f0f18100e20 2024-09-19T05:18:41.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.581+0000 7f0f1eb5e640 1 -- 172.21.15.120:0/244186199 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f18101200 con 0x7f0f18100e20 2024-09-19T05:18:41.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.582+0000 7f0f15ffb640 1 -- 172.21.15.120:0/244186199 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f0f10017070 con 0x7f0f18100e20 2024-09-19T05:18:41.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.582+0000 7f0f15ffb640 1 --2- 172.21.15.120:0/244186199 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0f040a3350 0x7f0f040a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:41.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.583+0000 7f0f17fff640 1 --2- 172.21.15.120:0/244186199 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0f040a3350 0x7f0f040a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:41.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.583+0000 7f0f15ffb640 1 -- 172.21.15.120:0/244186199 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f0f100cefe0 con 0x7f0f18100e20 2024-09-19T05:18:41.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.583+0000 7f0f17fff640 1 --2- 172.21.15.120:0/244186199 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0f040a3350 0x7f0f040a5810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0f08006010 tx=0x7f0f08005f80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:41.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.587+0000 7f0f15ffb640 1 -- 172.21.15.120:0/244186199 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0f1009bc90 con 0x7f0f18100e20 2024-09-19T05:18:41.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:41 smithi194 ceph-mon[35228]: pgmap v308: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T05:18:41.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:41 smithi178 ceph-mon[34347]: pgmap v308: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T05:18:41.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.756+0000 7f0f1eb5e640 1 -- 172.21.15.120:0/244186199 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f180fe1b0 con 0x7f0f18100e20 2024-09-19T05:18:41.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.758+0000 7f0f15ffb640 1 -- 172.21.15.120:0/244186199 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22805 (secure 0 0 0) 0x7f0f1009b590 con 0x7f0f18100e20 2024-09-19T05:18:41.760 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:18:41.760 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":82,"fsid":"4e6e3df4-7645-11ef-bceb-c7b262605968","created":"2024-09-19T05:09:55.847220+0000","modified":"2024-09-19T05:17:49.248858+0000","last_up_change":"2024-09-19T05:16:42.808178+0000","last_in_change":"2024-09-19T05:16:18.315940+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:13:02.340027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:17:26.914416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:17:29.112997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"18907a03-1f43-419a-acb6-9fa4cf5020d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6803","nonce":3421474326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6805","nonce":3421474326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6809","nonce":3421474326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6807","nonce":3421474326}]},"public_addr":"172.21.15.120:6803/3421474326","cluster_addr":"172.21.15.120:6805/3421474326","heartbeat_back_addr":"172.21.15.120:6809/3421474326","heartbeat_front_addr":"172.21.15.120:6807/3421474326","state":["exists","up"]},{"osd":1,"uuid":"d21e029b-8a60-43f9-9ba7-30cdba19ba57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6801","nonce":1195511218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6803","nonce":1195511218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6807","nonce":1195511218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6805","nonce":1195511218}]},"public_addr":"172.21.15.178:6801/1195511218","cluster_addr":"172.21.15.178:6803/1195511218","heartbeat_back_addr":"172.21.15.178:6807/1195511218","heartbeat_front_addr":"172.21.15.178:6805/1195511218","state":["exists","up"]},{"osd":2,"uuid":"26ad9c8d-dbaa-46c2-a346-19717d81cc60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6801","nonce":3752826560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6803","nonce":3752826560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6807","nonce":3752826560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6805","nonce":3752826560}]},"public_addr":"172.21.15.194:6801/3752826560","cluster_addr":"172.21.15.194:6803/3752826560","heartbeat_back_addr":"172.21.15.194:6807/3752826560","heartbeat_front_addr":"172.21.15.194:6805/3752826560","state":["exists","up"]},{"osd":3,"uuid":"7e266576-8a98-40a8-9532-4b6f4611a908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6811","nonce":803566783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6813","nonce":803566783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6817","nonce":803566783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6815","nonce":803566783}]},"public_addr":"172.21.15.120:6811/803566783","cluster_addr":"172.21.15.120:6813/803566783","heartbeat_back_addr":"172.21.15.120:6817/803566783","heartbeat_front_addr":"172.21.15.120:6815/803566783","state":["exists","up"]},{"osd":4,"uuid":"c77d05c5-3b8f-4f7b-91f9-833735221684","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6809","nonce":541165323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6811","nonce":541165323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6815","nonce":541165323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6813","nonce":541165323}]},"public_addr":"172.21.15.178:6809/541165323","cluster_addr":"172.21.15.178:6811/541165323","heartbeat_back_addr":"172.21.15.178:6815/541165323","heartbeat_front_addr":"172.21.15.178:6813/541165323","state":["exists","up"]},{"osd":5,"uuid":"5f1c394b-e510-411f-969a-2db2b68cf41a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6809","nonce":2631415468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6811","nonce":2631415468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6815","nonce":2631415468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6813","nonce":2631415468}]},"public_addr":"172.21.15.194:6809/2631415468","cluster_addr":"172.21.15.194:6811/2631415468","heartbeat_back_addr":"172.21.15.194:6815/2631415468","heartbeat_front_addr":"172.21.15.194:6813/2631415468","state":["exists","up"]},{"osd":6,"uuid":"990af639-099e-49df-a083-05626cee3c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6819","nonce":388238976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6821","nonce":388238976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6825","nonce":388238976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6823","nonce":388238976}]},"public_addr":"172.21.15.120:6819/388238976","cluster_addr":"172.21.15.120:6821/388238976","heartbeat_back_addr":"172.21.15.120:6825/388238976","heartbeat_front_addr":"172.21.15.120:6823/388238976","state":["exists","up"]},{"osd":7,"uuid":"6f4aa6ab-b5f4-4c06-9f14-9a51bc195ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6817","nonce":1912109177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6819","nonce":1912109177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6823","nonce":1912109177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6821","nonce":1912109177}]},"public_addr":"172.21.15.178:6817/1912109177","cluster_addr":"172.21.15.178:6819/1912109177","heartbeat_back_addr":"172.21.15.178:6823/1912109177","heartbeat_front_addr":"172.21.15.178:6821/1912109177","state":["exists","up"]},{"osd":8,"uuid":"707739c9-732a-405c-847a-ce6a06e611b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6817","nonce":596878172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6819","nonce":596878172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6823","nonce":596878172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6821","nonce":596878172}]},"public_addr":"172.21.15.194:6817/596878172","cluster_addr":"172.21.15.194:6819/596878172","heartbeat_back_addr":"172.21.15.194:6823/596878172","heartbeat_front_addr":"172.21.15.194:6821/596878172","state":["exists","up"]},{"osd":9,"uuid":"9393b018-c924-4d75-99e5-25433d276567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6827","nonce":3257373801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6829","nonce":3257373801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6833","nonce":3257373801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6831","nonce":3257373801}]},"public_addr":"172.21.15.120:6827/3257373801","cluster_addr":"172.21.15.120:6829/3257373801","heartbeat_back_addr":"172.21.15.120:6833/3257373801","heartbeat_front_addr":"172.21.15.120:6831/3257373801","state":["exists","up"]},{"osd":10,"uuid":"45db7f62-87a6-4b2b-a3dc-012e2de505e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6825","nonce":3067822030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6827","nonce":3067822030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6831","nonce":3067822030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6829","nonce":3067822030}]},"public_addr":"172.21.15.178:6825/3067822030","cluster_addr":"172.21.15.178:6827/3067822030","heartbeat_back_addr":"172.21.15.178:6831/3067822030","heartbeat_front_addr":"172.21.15.178:6829/3067822030","state":["exists","up"]},{"osd":11,"uuid":"85ea248c-9a36-41cb-a200-87138fb31602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6825","nonce":2713146974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6827","nonce":2713146974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6831","nonce":2713146974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6829","nonce":2713146974}]},"public_addr":"172.21.15.194:6825/2713146974","cluster_addr":"172.21.15.194:6827/2713146974","heartbeat_back_addr":"172.21.15.194:6831/2713146974","heartbeat_front_addr":"172.21.15.194:6829/2713146974","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:09.395371+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:33.648930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:58.805048+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:23.621459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:48.553860+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:13.506636+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:38.520376+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:02.695124+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:27.084956+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:50.924128+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:15.396694+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:40.440416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":3,"to":8}]},{"pgid":"3.2a","mappings":[{"from":3,"to":6}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:0/3419110398":"2024-09-20T05:10:48.027892+0000","172.21.15.120:6801/50152720":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/4177074351":"2024-09-20T05:10:48.027892+0000","172.21.15.120:6800/50152720":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/329623296":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/2867300720":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/3592867428":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/4255533863":"2024-09-20T05:10:23.348128+0000","172.21.15.120:6801/3412493069":"2024-09-20T05:10:23.348128+0000","172.21.15.120:6800/3412493069":"2024-09-20T05:10:23.348128+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:18:41.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.760+0000 7f0f1eb5e640 1 -- 172.21.15.120:0/244186199 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0f040a3350 msgr2=0x7f0f040a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:41.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.760+0000 7f0f1eb5e640 1 --2- 172.21.15.120:0/244186199 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0f040a3350 0x7f0f040a5810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0f08006010 tx=0x7f0f08005f80 comp rx=0 tx=0).stop 2024-09-19T05:18:41.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.760+0000 7f0f1eb5e640 1 -- 172.21.15.120:0/244186199 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f18100e20 msgr2=0x7f0f180fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:41.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.760+0000 7f0f1eb5e640 1 --2- 172.21.15.120:0/244186199 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f18100e20 0x7f0f180fcc80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000b4a0 tx=0x7f0f1000b960 comp rx=0 tx=0).stop 2024-09-19T05:18:41.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.760+0000 7f0f1eb5e640 1 -- 172.21.15.120:0/244186199 shutdown_connections 2024-09-19T05:18:41.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.760+0000 7f0f1eb5e640 1 --2- 172.21.15.120:0/244186199 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f0f040a3350 0x7f0f040a5810 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:41.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.760+0000 7f0f1eb5e640 1 --2- 172.21.15.120:0/244186199 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f18102ef0 0x7f0f180fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:41.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.760+0000 7f0f1eb5e640 1 --2- 172.21.15.120:0/244186199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f18102570 0x7f0f180fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:41.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.760+0000 7f0f1eb5e640 1 --2- 172.21.15.120:0/244186199 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f18100e20 0x7f0f180fcc80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:41.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.760+0000 7f0f1eb5e640 1 -- 172.21.15.120:0/244186199 >> 172.21.15.120:0/244186199 conn(0x7f0f180fc7d0 msgr2=0x7f0f1806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:41.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.760+0000 7f0f1eb5e640 1 -- 172.21.15.120:0/244186199 shutdown_connections 2024-09-19T05:18:41.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:41.760+0000 7f0f1eb5e640 1 -- 172.21.15.120:0/244186199 wait complete. 2024-09-19T05:18:42.447 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:42 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/244186199' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:18:42.478 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:18:42.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:42 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/244186199' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:18:42.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:42 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/244186199' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:18:42.722 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:43.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.218+0000 7f215ff8e640 1 -- 172.21.15.120:0/2094679384 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2158102ef0 msgr2=0x7f215810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:43.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.218+0000 7f215ff8e640 1 --2- 172.21.15.120:0/2094679384 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2158102ef0 0x7f215810da40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2150009ca0 tx=0x7f215002a950 comp rx=0 tx=0).stop 2024-09-19T05:18:43.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.218+0000 7f215ff8e640 1 -- 172.21.15.120:0/2094679384 shutdown_connections 2024-09-19T05:18:43.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.218+0000 7f215ff8e640 1 --2- 172.21.15.120:0/2094679384 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2158102ef0 0x7f215810da40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:43.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.218+0000 7f215ff8e640 1 --2- 172.21.15.120:0/2094679384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2158102570 0x7f21581029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:43.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.218+0000 7f215ff8e640 1 --2- 172.21.15.120:0/2094679384 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2158100e20 0x7f2158101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:43.222 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.218+0000 7f215ff8e640 1 -- 172.21.15.120:0/2094679384 >> 172.21.15.120:0/2094679384 conn(0x7f21580fc7d0 msgr2=0x7f21580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:43.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.218+0000 7f215ff8e640 1 -- 172.21.15.120:0/2094679384 shutdown_connections 2024-09-19T05:18:43.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.218+0000 7f215ff8e640 1 -- 172.21.15.120:0/2094679384 wait complete. 2024-09-19T05:18:43.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.219+0000 7f215ff8e640 1 Processor -- start 2024-09-19T05:18:43.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.219+0000 7f215ff8e640 1 -- start start 2024-09-19T05:18:43.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.219+0000 7f215ff8e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2158100e20 0x7f2158199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:43.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.219+0000 7f215ff8e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2158102570 0x7f2158199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:43.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.219+0000 7f215ff8e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2158102ef0 0x7f21581a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:43.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.219+0000 7f215ff8e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2158110e80 con 0x7f2158100e20 2024-09-19T05:18:43.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.219+0000 7f215ff8e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2158110d00 con 0x7f2158102ef0 2024-09-19T05:18:43.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.219+0000 7f215ff8e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2158111000 con 0x7f2158102570 2024-09-19T05:18:43.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.219+0000 7f215dd2a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2158100e20 0x7f2158199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:43.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.219+0000 7f215dd2a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2158100e20 0x7f2158199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37064/0 (socket says 172.21.15.120:37064) 2024-09-19T05:18:43.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.219+0000 7f215dd2a640 1 -- 172.21.15.120:0/4184444296 learned_addr learned my addr 172.21.15.120:0/4184444296 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:43.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.219+0000 7f215e52b640 1 --2- 172.21.15.120:0/4184444296 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2158102ef0 0x7f21581a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:43.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.219+0000 7f215d529640 1 --2- 172.21.15.120:0/4184444296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2158102570 0x7f2158199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:43.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.220+0000 7f215dd2a640 1 -- 172.21.15.120:0/4184444296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2158102570 msgr2=0x7f2158199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:43.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.220+0000 7f215dd2a640 1 --2- 172.21.15.120:0/4184444296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2158102570 0x7f2158199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:43.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.220+0000 7f215dd2a640 1 -- 172.21.15.120:0/4184444296 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2158102ef0 msgr2=0x7f21581a42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:43.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.220+0000 7f215dd2a640 1 --2- 172.21.15.120:0/4184444296 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2158102ef0 0x7f21581a42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:43.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.220+0000 7f215dd2a640 1 -- 172.21.15.120:0/4184444296 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21581a4810 con 0x7f2158100e20 2024-09-19T05:18:43.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.220+0000 7f215d529640 1 --2- 172.21.15.120:0/4184444296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2158102570 0x7f2158199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:18:43.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.220+0000 7f215dd2a640 1 --2- 172.21.15.120:0/4184444296 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2158100e20 0x7f2158199250 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f215400d950 tx=0x7f215400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:43.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.220+0000 7f214effd640 1 -- 172.21.15.120:0/4184444296 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2154017070 con 0x7f2158100e20 2024-09-19T05:18:43.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.220+0000 7f214effd640 1 -- 172.21.15.120:0/4184444296 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2154009c30 con 0x7f2158100e20 2024-09-19T05:18:43.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.220+0000 7f215ff8e640 1 -- 172.21.15.120:0/4184444296 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21581a49e0 con 0x7f2158100e20 2024-09-19T05:18:43.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.220+0000 7f214effd640 1 -- 172.21.15.120:0/4184444296 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215400f620 con 0x7f2158100e20 2024-09-19T05:18:43.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.220+0000 7f215ff8e640 1 -- 172.21.15.120:0/4184444296 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21581a4ef0 con 0x7f2158100e20 2024-09-19T05:18:43.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.221+0000 7f215ff8e640 1 -- 172.21.15.120:0/4184444296 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2158101200 con 0x7f2158100e20 2024-09-19T05:18:43.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.222+0000 7f214effd640 1 -- 172.21.15.120:0/4184444296 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f21540109a0 con 0x7f2158100e20 2024-09-19T05:18:43.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.223+0000 7f214effd640 1 --2- 172.21.15.120:0/4184444296 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f21440a32d0 0x7f21440a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:43.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.223+0000 7f215d529640 1 --2- 172.21.15.120:0/4184444296 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f21440a32d0 0x7f21440a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:43.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.223+0000 7f214effd640 1 -- 172.21.15.120:0/4184444296 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f21540cf710 con 0x7f2158100e20 2024-09-19T05:18:43.226 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.223+0000 7f215d529640 1 --2- 172.21.15.120:0/4184444296 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f21440a32d0 0x7f21440a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2148005fd0 tx=0x7f214800b5d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:43.228 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.227+0000 7f214effd640 1 -- 172.21.15.120:0/4184444296 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2154009de0 con 0x7f2158100e20 2024-09-19T05:18:43.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.427+0000 7f215ff8e640 1 -- 172.21.15.120:0/4184444296 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21581a5120 con 0x7f2158100e20 2024-09-19T05:18:43.429 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:43 smithi120 ceph-mon[30956]: pgmap v309: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T05:18:43.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.428+0000 7f214effd640 1 -- 172.21.15.120:0/4184444296 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11921 (secure 0 0 0) 0x7f215409c2b0 con 0x7f2158100e20 2024-09-19T05:18:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:18:43.430 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":24,"btime":"2024-09-19T05:17:42:231927+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/93472898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":93472898},{"type":"v1","addr":"172.21.15.120:6835","nonce":93472898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1976835398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1976835398},{"type":"v1","addr":"172.21.15.120:6837","nonce":1976835398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6839/2975851469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":2975851469},{"type":"v1","addr":"172.21.15.120:6839","nonce":2975851469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6841/2837552754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":2837552754},{"type":"v1","addr":"172.21.15.120:6841","nonce":2837552754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/61682954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":61682954},{"type":"v1","addr":"172.21.15.178:6833","nonce":61682954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1778722040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1778722040},{"type":"v1","addr":"172.21.15.194:6833","nonce":1778722040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:17:30.796197+0000","modified":"2024-09-19T05:17:41.861437+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24445,"mds_1":24443,"mds_2":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24401":{"gid":24401,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/890775592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":890775592},{"type":"v1","addr":"172.21.15.178:6835","nonce":890775592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6837/3960720164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3960720164},{"type":"v1","addr":"172.21.15.178:6837","nonce":3960720164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6835/3268846994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3268846994},{"type":"v1","addr":"172.21.15.194:6835","nonce":3268846994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.194:6837/378729335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":378729335},{"type":"v1","addr":"172.21.15.194:6837","nonce":378729335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.178:6839/3389137566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3389137566},{"type":"v1","addr":"172.21.15.178:6839","nonce":3389137566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6839/3817420679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3817420679},{"type":"v1","addr":"172.21.15.194:6839","nonce":3817420679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24445,"qdb_cluster":[24430,24443,24445]},"id":1}]} 2024-09-19T05:18:43.430 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 24 2024-09-19T05:18:43.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.430+0000 7f215ff8e640 1 -- 172.21.15.120:0/4184444296 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f21440a32d0 msgr2=0x7f21440a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:43.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.430+0000 7f215ff8e640 1 --2- 172.21.15.120:0/4184444296 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f21440a32d0 0x7f21440a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2148005fd0 tx=0x7f214800b5d0 comp rx=0 tx=0).stop 2024-09-19T05:18:43.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.430+0000 7f215ff8e640 1 -- 172.21.15.120:0/4184444296 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2158100e20 msgr2=0x7f2158199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:43.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.430+0000 7f215ff8e640 1 --2- 172.21.15.120:0/4184444296 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2158100e20 0x7f2158199250 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f215400d950 tx=0x7f215400de10 comp rx=0 tx=0).stop 2024-09-19T05:18:43.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.430+0000 7f215ff8e640 1 -- 172.21.15.120:0/4184444296 shutdown_connections 2024-09-19T05:18:43.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.430+0000 7f215ff8e640 1 --2- 172.21.15.120:0/4184444296 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2158102ef0 0x7f21581a42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:43.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.430+0000 7f215ff8e640 1 --2- 172.21.15.120:0/4184444296 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f21440a32d0 0x7f21440a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:43.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.430+0000 7f215ff8e640 1 --2- 172.21.15.120:0/4184444296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2158102570 0x7f2158199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:43.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.430+0000 7f215ff8e640 1 --2- 172.21.15.120:0/4184444296 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2158100e20 0x7f2158199250 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:43.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.430+0000 7f215ff8e640 1 -- 172.21.15.120:0/4184444296 >> 172.21.15.120:0/4184444296 conn(0x7f21580fc7d0 msgr2=0x7f21581068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:43.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.430+0000 7f215ff8e640 1 -- 172.21.15.120:0/4184444296 shutdown_connections 2024-09-19T05:18:43.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:43.430+0000 7f215ff8e640 1 -- 172.21.15.120:0/4184444296 wait complete. 2024-09-19T05:18:43.557 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:43 smithi194 ceph-mon[35228]: pgmap v309: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T05:18:43.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:43 smithi178 ceph-mon[34347]: pgmap v309: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-19T05:18:44.048 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T05:17:30.796197+0000', 'modified': '2024-09-19T05:17:41.861437+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24445, 'mds_1': 24443, 'mds_2': 24430}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24401': {'gid': 24401, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.178:6835/890775592', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6834', 'nonce': 890775592}, {'type': 'v1', 'addr': '172.21.15.178:6835', 'nonce': 890775592}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24419': {'gid': 24419, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.178:6837/3960720164', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6836', 'nonce': 3960720164}, {'type': 'v1', 'addr': '172.21.15.178:6837', 'nonce': 3960720164}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24424': {'gid': 24424, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.194:6835/3268846994', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6834', 'nonce': 3268846994}, {'type': 'v1', 'addr': '172.21.15.194:6835', 'nonce': 3268846994}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.194:6837/378729335', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6836', 'nonce': 378729335}, {'type': 'v1', 'addr': '172.21.15.194:6837', 'nonce': 378729335}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24443': {'gid': 24443, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.178:6839/3389137566', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6838', 'nonce': 3389137566}, {'type': 'v1', 'addr': '172.21.15.178:6839', 'nonce': 3389137566}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24445': {'gid': 24445, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.194:6839/3817420679', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6838', 'nonce': 3817420679}, {'type': 'v1', 'addr': '172.21.15.194:6839', 'nonce': 3817420679}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24445, 'qdb_cluster': [24430, 24443, 24445]} 2024-09-19T05:18:44.048 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T05:18:44.049 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T05:18:44.296 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:44.537 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:44 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/4184444296' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:44.569 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:44 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/4184444296' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:44.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:44 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/4184444296' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:18:44.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.735+0000 7fe6cb6ff640 1 -- 172.21.15.120:0/994396826 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6c4100e20 msgr2=0x7fe6c4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:44.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.735+0000 7fe6cb6ff640 1 --2- 172.21.15.120:0/994396826 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6c4100e20 0x7fe6c4101200 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0009900 tx=0x7fe6c002a480 comp rx=0 tx=0).stop 2024-09-19T05:18:44.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.736+0000 7fe6cb6ff640 1 -- 172.21.15.120:0/994396826 shutdown_connections 2024-09-19T05:18:44.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.736+0000 7fe6cb6ff640 1 --2- 172.21.15.120:0/994396826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6c4102ef0 0x7fe6c410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.736+0000 7fe6cb6ff640 1 --2- 172.21.15.120:0/994396826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6c4102570 0x7fe6c41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.736+0000 7fe6cb6ff640 1 --2- 172.21.15.120:0/994396826 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6c4100e20 0x7fe6c4101200 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.736+0000 7fe6cb6ff640 1 -- 172.21.15.120:0/994396826 >> 172.21.15.120:0/994396826 conn(0x7fe6c40fc7d0 msgr2=0x7fe6c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:44.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.736+0000 7fe6cb6ff640 1 -- 172.21.15.120:0/994396826 shutdown_connections 2024-09-19T05:18:44.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.736+0000 7fe6cb6ff640 1 -- 172.21.15.120:0/994396826 wait complete. 2024-09-19T05:18:44.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.736+0000 7fe6cb6ff640 1 Processor -- start 2024-09-19T05:18:44.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.736+0000 7fe6cb6ff640 1 -- start start 2024-09-19T05:18:44.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.736+0000 7fe6cb6ff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6c4100e20 0x7fe6c41992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:44.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.736+0000 7fe6cb6ff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6c4102570 0x7fe6c4199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:44.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.736+0000 7fe6cb6ff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6c4102ef0 0x7fe6c41a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:44.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.736+0000 7fe6cb6ff640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c4110e70 con 0x7fe6c4100e20 2024-09-19T05:18:44.742 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.736+0000 7fe6cb6ff640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c4110cf0 con 0x7fe6c4102570 2024-09-19T05:18:44.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.736+0000 7fe6cb6ff640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c4110ff0 con 0x7fe6c4102ef0 2024-09-19T05:18:44.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.737+0000 7fe6c949b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6c4100e20 0x7fe6c41992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:44.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.737+0000 7fe6c949b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6c4100e20 0x7fe6c41992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37082/0 (socket says 172.21.15.120:37082) 2024-09-19T05:18:44.743 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.737+0000 7fe6c949b640 1 -- 172.21.15.120:0/1166932259 learned_addr learned my addr 172.21.15.120:0/1166932259 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:44.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.737+0000 7fe6c9c9c640 1 --2- 172.21.15.120:0/1166932259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6c4102ef0 0x7fe6c41a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:44.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.737+0000 7fe6c8c9a640 1 --2- 172.21.15.120:0/1166932259 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6c4102570 0x7fe6c4199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:44.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.737+0000 7fe6c949b640 1 -- 172.21.15.120:0/1166932259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6c4102ef0 msgr2=0x7fe6c41a4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:44.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.737+0000 7fe6c949b640 1 --2- 172.21.15.120:0/1166932259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6c4102ef0 0x7fe6c41a4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.737+0000 7fe6c949b640 1 -- 172.21.15.120:0/1166932259 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6c4102570 msgr2=0x7fe6c4199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:44.744 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.737+0000 7fe6c949b640 1 --2- 172.21.15.120:0/1166932259 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6c4102570 0x7fe6c4199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.737+0000 7fe6c949b640 1 -- 172.21.15.120:0/1166932259 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c41a48a0 con 0x7fe6c4100e20 2024-09-19T05:18:44.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.737+0000 7fe6c949b640 1 --2- 172.21.15.120:0/1166932259 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6c4100e20 0x7fe6c41992e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0006010 tx=0x7fe6c00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:44.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.737+0000 7fe6b67fc640 1 -- 172.21.15.120:0/1166932259 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c003f030 con 0x7fe6c4100e20 2024-09-19T05:18:44.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.737+0000 7fe6cb6ff640 1 -- 172.21.15.120:0/1166932259 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6c41a4a70 con 0x7fe6c4100e20 2024-09-19T05:18:44.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.737+0000 7fe6b67fc640 1 -- 172.21.15.120:0/1166932259 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe6c0003cb0 con 0x7fe6c4100e20 2024-09-19T05:18:44.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.737+0000 7fe6b67fc640 1 -- 172.21.15.120:0/1166932259 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0035070 con 0x7fe6c4100e20 2024-09-19T05:18:44.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.737+0000 7fe6cb6ff640 1 -- 172.21.15.120:0/1166932259 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6c41a4ec0 con 0x7fe6c4100e20 2024-09-19T05:18:44.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.739+0000 7fe6b67fc640 1 -- 172.21.15.120:0/1166932259 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fe6c0042030 con 0x7fe6c4100e20 2024-09-19T05:18:44.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.740+0000 7fe6cdad8740 1 Processor -- start 2024-09-19T05:18:44.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.740+0000 7fe6cdad8740 1 -- start start 2024-09-19T05:18:44.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.740+0000 7fe6cdad8740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3669d0 0x55abfa366db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:44.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.740+0000 7fe6cdad8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55abfa3672f0 0x55abfa371670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:44.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.740+0000 7fe6cdad8740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abfa371bb0 0x55abfa373fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:44.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.740+0000 7fe6cdad8740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55abfa2cd090 con 0x55abfa3669d0 2024-09-19T05:18:44.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.740+0000 7fe6cdad8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55abfa274a70 con 0x55abfa3672f0 2024-09-19T05:18:44.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.740+0000 7fe6cdad8740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55abfa2c9050 con 0x55abfa371bb0 2024-09-19T05:18:44.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.740+0000 7fe6b67fc640 1 --2- 172.21.15.120:0/1166932259 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fe6b00a32d0 0x7fe6b00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:44.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.740+0000 7fe6c9c9c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3669d0 0x55abfa366db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:44.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.740+0000 7fe6c9c9c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3669d0 0x55abfa366db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37086/0 (socket says 172.21.15.120:37086) 2024-09-19T05:18:44.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.740+0000 7fe6c9c9c640 1 -- 172.21.15.120:0/559174821 learned_addr learned my addr 172.21.15.120:0/559174821 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:44.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.740+0000 7fe6c949b640 1 --2- 172.21.15.120:0/559174821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55abfa3672f0 0x55abfa371670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:44.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.740+0000 7fe6c9c9c640 1 --2- 172.21.15.120:0/1166932259 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fe6b00a32d0 0x7fe6b00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:44.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.741+0000 7fe6c8c9a640 1 --2- 172.21.15.120:0/559174821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abfa371bb0 0x55abfa373fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:44.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.741+0000 7fe6b67fc640 1 -- 172.21.15.120:0/1166932259 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fe6c00efd10 con 0x7fe6c4100e20 2024-09-19T05:18:44.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.741+0000 7fe6c9c9c640 1 -- 172.21.15.120:0/559174821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abfa371bb0 msgr2=0x55abfa373fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:18:44.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.741+0000 7fe6c9c9c640 1 --2- 172.21.15.120:0/559174821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abfa371bb0 0x55abfa373fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.741+0000 7fe6c9c9c640 1 -- 172.21.15.120:0/559174821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55abfa3672f0 msgr2=0x55abfa371670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:18:44.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.741+0000 7fe6c9c9c640 1 --2- 172.21.15.120:0/559174821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55abfa3672f0 0x55abfa371670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.741+0000 7fe6c9c9c640 1 -- 172.21.15.120:0/559174821 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abfa281130 con 0x55abfa3669d0 2024-09-19T05:18:44.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.741+0000 7fe6c9c9c640 1 --2- 172.21.15.120:0/559174821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3669d0 0x55abfa366db0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc012d90 tx=0x7fe6bc010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65559d249a2aca3d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:44.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.741+0000 7fe6c9c9c640 1 --2- 172.21.15.120:0/1166932259 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fe6b00a32d0 0x7fe6b00a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc010c40 tx=0x7fe6bc00c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:44.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.741+0000 7fe6af7fe640 1 -- 172.21.15.120:0/559174821 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc010df0 con 0x55abfa3669d0 2024-09-19T05:18:44.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.741+0000 7fe6af7fe640 1 -- 172.21.15.120:0/559174821 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe6bc026070 con 0x55abfa3669d0 2024-09-19T05:18:44.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.741+0000 7fe6af7fe640 1 -- 172.21.15.120:0/559174821 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc00c9c0 con 0x55abfa3669d0 2024-09-19T05:18:44.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.742+0000 7fe6cdad8740 1 -- 172.21.15.120:0/559174821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3669d0 msgr2=0x55abfa366db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:44.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.742+0000 7fe6cdad8740 1 --2- 172.21.15.120:0/559174821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3669d0 0x55abfa366db0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc012d90 tx=0x7fe6bc010740 comp rx=0 tx=0).stop 2024-09-19T05:18:44.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.742+0000 7fe6cdad8740 1 -- 172.21.15.120:0/559174821 shutdown_connections 2024-09-19T05:18:44.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.742+0000 7fe6cdad8740 1 --2- 172.21.15.120:0/559174821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abfa371bb0 0x55abfa373fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.742+0000 7fe6cdad8740 1 --2- 172.21.15.120:0/559174821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55abfa3672f0 0x55abfa371670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.742+0000 7fe6cdad8740 1 --2- 172.21.15.120:0/559174821 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3669d0 0x55abfa366db0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.742+0000 7fe6cdad8740 1 -- 172.21.15.120:0/559174821 >> 172.21.15.120:0/559174821 conn(0x55abfa362f60 msgr2=0x55abfa363340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:44.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.742+0000 7fe6cdad8740 1 -- 172.21.15.120:0/559174821 shutdown_connections 2024-09-19T05:18:44.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.742+0000 7fe6cdad8740 1 -- 172.21.15.120:0/559174821 wait complete. 2024-09-19T05:18:44.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.742+0000 7fe6cdad8740 1 -- start start 2024-09-19T05:18:44.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.742+0000 7fe6cdad8740 1 Processor -- start 2024-09-19T05:18:44.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.743+0000 7fe6cdad8740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3669d0 0x55abfa3714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:44.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.743+0000 7fe6cdad8740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abfa3672f0 0x55abfa36e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:44.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.743+0000 7fe6cdad8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55abfa371bb0 0x55abfa36ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:44.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.743+0000 7fe6cdad8740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55abfa374780 con 0x55abfa3669d0 2024-09-19T05:18:44.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.743+0000 7fe6cdad8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55abfa287f20 con 0x55abfa371bb0 2024-09-19T05:18:44.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.743+0000 7fe6cdad8740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55abfa374900 con 0x55abfa3672f0 2024-09-19T05:18:44.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.743+0000 7fe6cdad8740 10 client.0 _ll_register_callbacks cb 0x55abfa251030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:18:44.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.743+0000 7fe6c949b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3669d0 0x55abfa3714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:44.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.743+0000 7fe6c949b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3669d0 0x55abfa3714f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37100/0 (socket says 172.21.15.120:37100) 2024-09-19T05:18:44.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.743+0000 7fe6c949b640 1 -- 172.21.15.120:0/1112909929 learned_addr learned my addr 172.21.15.120:0/1112909929 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:44.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.743+0000 7fe6c8c9a640 1 --2- 172.21.15.120:0/1112909929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abfa3672f0 0x55abfa36e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:44.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.743+0000 7fe6c949b640 1 -- 172.21.15.120:0/1112909929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abfa3672f0 msgr2=0x55abfa36e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:18:44.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.743+0000 7fe6c949b640 1 --2- 172.21.15.120:0/1112909929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abfa3672f0 0x55abfa36e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.743+0000 7fe6c949b640 1 -- 172.21.15.120:0/1112909929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55abfa371bb0 msgr2=0x55abfa36ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:18:44.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.743+0000 7fe6c949b640 1 --2- 172.21.15.120:0/1112909929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55abfa371bb0 0x55abfa36ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.743+0000 7fe6c949b640 1 -- 172.21.15.120:0/1112909929 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abfa03e2b0 con 0x55abfa3669d0 2024-09-19T05:18:44.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.743+0000 7fe6c949b640 1 --2- 172.21.15.120:0/1112909929 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3669d0 0x55abfa3714f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00b85b0 tx=0x7fe6c008ae90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637f06bb432b515b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:44.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.743+0000 7fe6acff9640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:18:44.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.744+0000 7fe6acff9640 1 -- 172.21.15.120:0/1112909929 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0049040 con 0x55abfa3669d0 2024-09-19T05:18:44.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.744+0000 7fe6acff9640 1 -- 172.21.15.120:0/1112909929 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fe6c00ed890 con 0x55abfa3669d0 2024-09-19T05:18:44.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.744+0000 7fe6cdad8740 1 -- 172.21.15.120:0/1112909929 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6bc026070 con 0x55abfa3669d0 2024-09-19T05:18:44.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.744+0000 7fe6acff9640 1 -- 172.21.15.120:0/1112909929 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe6c00bc150 con 0x55abfa3669d0 2024-09-19T05:18:44.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.744+0000 7fe6cdad8740 10 client.14976 fetch_fsmap learned FSMap version 24 2024-09-19T05:18:44.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.744+0000 7fe6cdad8740 1 -- 172.21.15.120:0/1112909929 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55abfa380130 con 0x55abfa3669d0 2024-09-19T05:18:44.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.744+0000 7fe6acff9640 1 -- 172.21.15.120:0/1112909929 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe6bc026070 con 0x55abfa3669d0 2024-09-19T05:18:44.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.744+0000 7fe6acff9640 1 -- 172.21.15.120:0/1112909929 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe6c004c060 con 0x55abfa3669d0 2024-09-19T05:18:44.760 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.744+0000 7fe6cdad8740 10 client.14976 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:18:44.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.744+0000 7fe6cdad8740 10 client.14976 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:18:44.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.744+0000 7fe6cdad8740 20 client.14976 populate_metadata read hostname 'smithi120' 2024-09-19T05:18:44.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.744+0000 7fe6cdad8740 1 --2- 172.21.15.120:0/1112909929 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55abfa382830 0x55abfa383ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:44.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.744+0000 7fe6cdad8740 4 client.14976 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:18:44.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.744+0000 7fe6cdad8740 1 -- 172.21.15.120:0/1112909929 --> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55abfa2da600 con 0x55abfa382830 2024-09-19T05:18:44.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.744+0000 7fe6c8c9a640 1 --2- 172.21.15.120:0/1112909929 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55abfa382830 0x55abfa383ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:44.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.745+0000 7fe6acff9640 10 client.14976 ms_handle_connect on v2:172.21.15.194:6836/378729335 2024-09-19T05:18:44.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.745+0000 7fe6c8c9a640 1 --2- 172.21.15.120:0/1112909929 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55abfa382830 0x55abfa383ca0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=27b3d332ff0ed1c4 server_cookie=39cefad62031041a in_seq=0 out_seq=0 2024-09-19T05:18:44.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.745+0000 7fe6acff9640 1 -- 172.21.15.120:0/1112909929 <== mds.2 v2:172.21.15.194:6836/378729335 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55abfa2da600 con 0x55abfa382830 2024-09-19T05:18:44.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.745+0000 7fe6acff9640 10 client.14976 handle_command_reply: tid=0 2024-09-19T05:18:44.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.745+0000 7fe6cdad8740 1 client.14976 shutdown 2024-09-19T05:18:44.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.745+0000 7fe6cdad8740 1 -- 172.21.15.120:0/1112909929 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3669d0 msgr2=0x55abfa3714f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:44.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.745+0000 7fe6cdad8740 1 --2- 172.21.15.120:0/1112909929 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3669d0 0x55abfa3714f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00b85b0 tx=0x7fe6c008ae90 comp rx=0 tx=0).stop 2024-09-19T05:18:44.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.746+0000 7fe6cdad8740 1 -- 172.21.15.120:0/1112909929 shutdown_connections 2024-09-19T05:18:44.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.746+0000 7fe6cdad8740 1 --2- 172.21.15.120:0/1112909929 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55abfa382830 0x55abfa383ca0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.746+0000 7fe6cdad8740 1 --2- 172.21.15.120:0/1112909929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55abfa371bb0 0x55abfa36ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.746+0000 7fe6cdad8740 1 --2- 172.21.15.120:0/1112909929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abfa3672f0 0x55abfa36e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.746+0000 7fe6cdad8740 1 --2- 172.21.15.120:0/1112909929 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3669d0 0x55abfa3714f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.746+0000 7fe6cdad8740 1 -- 172.21.15.120:0/1112909929 >> 172.21.15.120:0/1112909929 conn(0x55abfa362f60 msgr2=0x55abfa368c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:44.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.746+0000 7fe6acff9640 0 client.14976 ms_handle_reset on v2:172.21.15.194:6836/378729335 2024-09-19T05:18:44.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.746+0000 7fe6cdad8740 1 -- 172.21.15.120:0/1112909929 shutdown_connections 2024-09-19T05:18:44.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.746+0000 7fe6cdad8740 1 -- 172.21.15.120:0/1112909929 wait complete. 2024-09-19T05:18:44.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.746+0000 7fe6cdad8740 20 client.14976 trim_cache size 0 max 16384 2024-09-19T05:18:44.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.763+0000 7fe6cdad8740 1 Processor -- start 2024-09-19T05:18:44.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.763+0000 7fe6cdad8740 1 -- start start 2024-09-19T05:18:44.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.763+0000 7fe6cdad8740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3669d0 0x55abfa382830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:44.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.763+0000 7fe6cdad8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55abfa3672f0 0x55abfa381480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:44.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.763+0000 7fe6cdad8740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abfa371bb0 0x55abfa3819c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:44.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.763+0000 7fe6cdad8740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55abfa381fe0 con 0x55abfa3669d0 2024-09-19T05:18:44.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.763+0000 7fe6cdad8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55abfa3826b0 con 0x55abfa3672f0 2024-09-19T05:18:44.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.763+0000 7fe6cdad8740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55abfa382d80 con 0x55abfa371bb0 2024-09-19T05:18:44.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.764+0000 7fe6c949b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3669d0 0x55abfa382830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:44.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.764+0000 7fe6c949b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3669d0 0x55abfa382830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37104/0 (socket says 172.21.15.120:37104) 2024-09-19T05:18:44.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.764+0000 7fe6c949b640 1 -- 172.21.15.120:0/353127949 learned_addr learned my addr 172.21.15.120:0/353127949 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:44.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.764+0000 7fe6c9c9c640 1 --2- 172.21.15.120:0/353127949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abfa371bb0 0x55abfa3819c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:44.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.764+0000 7fe6c8c9a640 1 --2- 172.21.15.120:0/353127949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55abfa3672f0 0x55abfa381480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:44.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.764+0000 7fe6c949b640 1 -- 172.21.15.120:0/353127949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abfa371bb0 msgr2=0x55abfa3819c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:18:44.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.764+0000 7fe6c949b640 1 --2- 172.21.15.120:0/353127949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abfa371bb0 0x55abfa3819c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.764+0000 7fe6c949b640 1 -- 172.21.15.120:0/353127949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55abfa3672f0 msgr2=0x55abfa381480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:18:44.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.764+0000 7fe6c949b640 1 --2- 172.21.15.120:0/353127949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55abfa3672f0 0x55abfa381480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.764+0000 7fe6c949b640 1 -- 172.21.15.120:0/353127949 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abfa371860 con 0x55abfa3669d0 2024-09-19T05:18:44.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.764+0000 7fe6c9c9c640 1 --2- 172.21.15.120:0/353127949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abfa371bb0 0x55abfa3819c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:18:44.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.764+0000 7fe6c8c9a640 1 --2- 172.21.15.120:0/353127949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55abfa3672f0 0x55abfa381480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:44.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.764+0000 7fe6c949b640 1 --2- 172.21.15.120:0/353127949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3669d0 0x55abfa382830 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00bc310 tx=0x7fe6c002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23543b125093f0bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:44.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.764+0000 7fe6aeffd640 1 -- 172.21.15.120:0/353127949 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c00d5070 con 0x55abfa3669d0 2024-09-19T05:18:44.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.764+0000 7fe6aeffd640 1 -- 172.21.15.120:0/353127949 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe6c00c0500 con 0x55abfa3669d0 2024-09-19T05:18:44.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.764+0000 7fe6aeffd640 1 -- 172.21.15.120:0/353127949 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0049070 con 0x55abfa3669d0 2024-09-19T05:18:44.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.765+0000 7fe6cdad8740 1 -- 172.21.15.120:0/353127949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3669d0 msgr2=0x55abfa382830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:44.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.765+0000 7fe6cdad8740 1 --2- 172.21.15.120:0/353127949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3669d0 0x55abfa382830 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00bc310 tx=0x7fe6c002a480 comp rx=0 tx=0).stop 2024-09-19T05:18:44.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.765+0000 7fe6cdad8740 1 -- 172.21.15.120:0/353127949 shutdown_connections 2024-09-19T05:18:44.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.765+0000 7fe6cdad8740 1 --2- 172.21.15.120:0/353127949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abfa371bb0 0x55abfa3819c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.765+0000 7fe6cdad8740 1 --2- 172.21.15.120:0/353127949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55abfa3672f0 0x55abfa381480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.765+0000 7fe6cdad8740 1 --2- 172.21.15.120:0/353127949 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3669d0 0x55abfa382830 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.765+0000 7fe6cdad8740 1 -- 172.21.15.120:0/353127949 >> 172.21.15.120:0/353127949 conn(0x55abfa362f60 msgr2=0x55abfa35dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:44.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.765+0000 7fe6cdad8740 1 -- 172.21.15.120:0/353127949 shutdown_connections 2024-09-19T05:18:44.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.765+0000 7fe6cdad8740 1 -- 172.21.15.120:0/353127949 wait complete. 2024-09-19T05:18:44.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.765+0000 7fe6cdad8740 1 -- start start 2024-09-19T05:18:44.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.765+0000 7fe6cdad8740 1 Processor -- start 2024-09-19T05:18:44.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.766+0000 7fe6cdad8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55abfa3669d0 0x55abfa36aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:44.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.766+0000 7fe6cdad8740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3672f0 0x55abfa36b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:44.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.766+0000 7fe6cdad8740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abfa371bb0 0x55abfa36b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:44.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.766+0000 7fe6cdad8740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55abfa383b20 con 0x55abfa3672f0 2024-09-19T05:18:44.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.766+0000 7fe6cdad8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55abfa383450 con 0x55abfa3669d0 2024-09-19T05:18:44.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.766+0000 7fe6cdad8740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55abfa3841f0 con 0x55abfa371bb0 2024-09-19T05:18:44.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.766+0000 7fe6cdad8740 10 client.0 _ll_register_callbacks cb 0x7fe6c0003e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:18:44.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.766+0000 7fe6c8c9a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3672f0 0x55abfa36b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:44.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.766+0000 7fe6c8c9a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3672f0 0x55abfa36b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37120/0 (socket says 172.21.15.120:37120) 2024-09-19T05:18:44.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.766+0000 7fe6c8c9a640 1 -- 172.21.15.120:0/218488748 learned_addr learned my addr 172.21.15.120:0/218488748 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:44.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.766+0000 7fe6c9c9c640 1 --2- 172.21.15.120:0/218488748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abfa371bb0 0x55abfa36b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:44.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.766+0000 7fe6c8c9a640 1 -- 172.21.15.120:0/218488748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abfa371bb0 msgr2=0x55abfa36b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:18:44.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.766+0000 7fe6c8c9a640 1 --2- 172.21.15.120:0/218488748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abfa371bb0 0x55abfa36b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.766+0000 7fe6c949b640 1 --2- 172.21.15.120:0/218488748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55abfa3669d0 0x55abfa36aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:44.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.766+0000 7fe6c8c9a640 1 -- 172.21.15.120:0/218488748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55abfa3669d0 msgr2=0x55abfa36aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:18:44.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.766+0000 7fe6c8c9a640 1 --2- 172.21.15.120:0/218488748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55abfa3669d0 0x55abfa36aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.766+0000 7fe6c8c9a640 1 -- 172.21.15.120:0/218488748 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abfa38aef0 con 0x55abfa3672f0 2024-09-19T05:18:44.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.766+0000 7fe6c8c9a640 1 --2- 172.21.15.120:0/218488748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3672f0 0x55abfa36b010 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8004700 tx=0x7fe6b800b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1240bf1ce88369c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:44.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.766+0000 7fe6acff9640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:18:44.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.766+0000 7fe6acff9640 1 -- 172.21.15.120:0/218488748 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b801e030 con 0x55abfa3672f0 2024-09-19T05:18:44.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.766+0000 7fe6acff9640 1 -- 172.21.15.120:0/218488748 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7fe6b800f040 con 0x55abfa3672f0 2024-09-19T05:18:44.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.766+0000 7fe6cdad8740 1 -- 172.21.15.120:0/218488748 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6c00c0500 con 0x55abfa3672f0 2024-09-19T05:18:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.766+0000 7fe6acff9640 1 -- 172.21.15.120:0/218488748 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe6b8029070 con 0x55abfa3672f0 2024-09-19T05:18:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.766+0000 7fe6cdad8740 10 client.14982 fetch_fsmap learned FSMap version 24 2024-09-19T05:18:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.766+0000 7fe6cdad8740 1 -- 172.21.15.120:0/218488748 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55abfa38c1f0 con 0x55abfa3672f0 2024-09-19T05:18:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.767+0000 7fe6acff9640 1 -- 172.21.15.120:0/218488748 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe6c00c0500 con 0x55abfa3672f0 2024-09-19T05:18:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.767+0000 7fe6acff9640 1 -- 172.21.15.120:0/218488748 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe6b80234a0 con 0x55abfa3672f0 2024-09-19T05:18:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.767+0000 7fe6cdad8740 10 client.14982 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:18:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.767+0000 7fe6cdad8740 10 client.14982 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:18:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.767+0000 7fe6cdad8740 20 client.14982 populate_metadata read hostname 'smithi120' 2024-09-19T05:18:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.767+0000 7fe6cdad8740 1 --2- 172.21.15.120:0/218488748 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55abfa3f0f40 0x55abfa3efc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.767+0000 7fe6cdad8740 4 client.14982 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:18:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.767+0000 7fe6cdad8740 1 -- 172.21.15.120:0/218488748 --> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] -- command(tid 0: {"prefix": "status"}) -- 0x55abfa2d4b10 con 0x55abfa3f0f40 2024-09-19T05:18:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.767+0000 7fe6c949b640 1 --2- 172.21.15.120:0/218488748 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55abfa3f0f40 0x55abfa3efc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.767+0000 7fe6acff9640 10 client.14982 ms_handle_connect on v2:172.21.15.194:6836/378729335 2024-09-19T05:18:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.767+0000 7fe6c949b640 1 --2- 172.21.15.120:0/218488748 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55abfa3f0f40 0x55abfa3efc50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ff5db58344fc9a97 server_cookie=1cb61ac77c583345 in_seq=0 out_seq=0 2024-09-19T05:18:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.768+0000 7fe6acff9640 1 -- 172.21.15.120:0/218488748 <== mds.2 v2:172.21.15.194:6836/378729335 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55abfa2d4b10 con 0x55abfa3f0f40 2024-09-19T05:18:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.768+0000 7fe6acff9640 10 client.14982 handle_command_reply: tid=0 2024-09-19T05:18:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.768+0000 7fe6cdad8740 1 client.14982 shutdown 2024-09-19T05:18:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.768+0000 7fe6cdad8740 1 -- 172.21.15.120:0/218488748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3672f0 msgr2=0x55abfa36b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.768+0000 7fe6cdad8740 1 --2- 172.21.15.120:0/218488748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3672f0 0x55abfa36b010 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8004700 tx=0x7fe6b800b750 comp rx=0 tx=0).stop 2024-09-19T05:18:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.768+0000 7fe6cdad8740 1 -- 172.21.15.120:0/218488748 shutdown_connections 2024-09-19T05:18:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.768+0000 7fe6cdad8740 1 --2- 172.21.15.120:0/218488748 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55abfa3f0f40 0x55abfa3efc50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.768+0000 7fe6cdad8740 1 --2- 172.21.15.120:0/218488748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abfa371bb0 0x55abfa36b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.768+0000 7fe6cdad8740 1 --2- 172.21.15.120:0/218488748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55abfa3672f0 0x55abfa36b010 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.768+0000 7fe6acff9640 0 client.14982 ms_handle_reset on v2:172.21.15.194:6836/378729335 2024-09-19T05:18:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.768+0000 7fe6cdad8740 1 --2- 172.21.15.120:0/218488748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55abfa3669d0 0x55abfa36aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.768+0000 7fe6cdad8740 1 -- 172.21.15.120:0/218488748 >> 172.21.15.120:0/218488748 conn(0x55abfa362f60 msgr2=0x55abfa36e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.768+0000 7fe6cdad8740 1 -- 172.21.15.120:0/218488748 shutdown_connections 2024-09-19T05:18:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.768+0000 7fe6cdad8740 1 -- 172.21.15.120:0/218488748 wait complete. 2024-09-19T05:18:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.768+0000 7fe6cdad8740 20 client.14982 trim_cache size 0 max 16384 2024-09-19T05:18:44.776 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T05:18:44.776 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "4e6e3df4-7645-11ef-bceb-c7b262605968", 2024-09-19T05:18:44.776 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 2, 2024-09-19T05:18:44.776 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 24430, 2024-09-19T05:18:44.776 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-09-19T05:18:44.776 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-09-19T05:18:44.776 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-09-19T05:18:44.777 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 65.542077184999997, 2024-09-19T05:18:44.777 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 24, 2024-09-19T05:18:44.777 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 82, 2024-09-19T05:18:44.777 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T05:18:44.777 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 97.741812035999999 2024-09-19T05:18:44.777 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T05:18:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.768+0000 7fe6cb6ff640 1 -- 172.21.15.120:0/1166932259 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fe6b00a32d0 msgr2=0x7fe6b00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.769+0000 7fe6cb6ff640 1 --2- 172.21.15.120:0/1166932259 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fe6b00a32d0 0x7fe6b00a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc010c40 tx=0x7fe6bc00c000 comp rx=0 tx=0).stop 2024-09-19T05:18:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.769+0000 7fe6cb6ff640 1 -- 172.21.15.120:0/1166932259 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6c4100e20 msgr2=0x7fe6c41992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.769+0000 7fe6cb6ff640 1 --2- 172.21.15.120:0/1166932259 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6c4100e20 0x7fe6c41992e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0006010 tx=0x7fe6c00042f0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.769+0000 7fe6cb6ff640 1 -- 172.21.15.120:0/1166932259 shutdown_connections 2024-09-19T05:18:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.769+0000 7fe6cb6ff640 1 --2- 172.21.15.120:0/1166932259 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fe6b00a32d0 0x7fe6b00a5790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.769+0000 7fe6cb6ff640 1 --2- 172.21.15.120:0/1166932259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6c4102ef0 0x7fe6c41a4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.769+0000 7fe6cb6ff640 1 --2- 172.21.15.120:0/1166932259 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6c4102570 0x7fe6c4199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.769+0000 7fe6cb6ff640 1 --2- 172.21.15.120:0/1166932259 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe6c4100e20 0x7fe6c41992e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.769+0000 7fe6cb6ff640 1 -- 172.21.15.120:0/1166932259 >> 172.21.15.120:0/1166932259 conn(0x7fe6c40fc7d0 msgr2=0x7fe6c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.769+0000 7fe6cb6ff640 1 -- 172.21.15.120:0/1166932259 shutdown_connections 2024-09-19T05:18:44.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:44.769+0000 7fe6cb6ff640 1 -- 172.21.15.120:0/1166932259 wait complete. 2024-09-19T05:18:45.510 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:45 smithi120 ceph-mon[30956]: pgmap v310: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T05:18:45.537 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T05:18:45.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:45 smithi194 ceph-mon[35228]: pgmap v310: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T05:18:45.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:45 smithi178 ceph-mon[34347]: pgmap v310: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T05:18:45.780 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:46.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.234+0000 7f8d40d99640 1 -- 172.21.15.120:0/3949249186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d3c1036e0 msgr2=0x7f8d3c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:46.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.234+0000 7f8d40d99640 1 --2- 172.21.15.120:0/3949249186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d3c1036e0 0x7f8d3c107b90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009930 tx=0x7f8d3002a420 comp rx=0 tx=0).stop 2024-09-19T05:18:46.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.234+0000 7f8d40d99640 1 -- 172.21.15.120:0/3949249186 shutdown_connections 2024-09-19T05:18:46.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.234+0000 7f8d40d99640 1 --2- 172.21.15.120:0/3949249186 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d3c1082a0 0x7f8d3c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.234+0000 7f8d40d99640 1 --2- 172.21.15.120:0/3949249186 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d3c1036e0 0x7f8d3c107b90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.234+0000 7f8d40d99640 1 --2- 172.21.15.120:0/3949249186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d3c102d30 0x7f8d3c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.234+0000 7f8d40d99640 1 -- 172.21.15.120:0/3949249186 >> 172.21.15.120:0/3949249186 conn(0x7f8d3c0fc7d0 msgr2=0x7f8d3c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:46.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.234+0000 7f8d40d99640 1 -- 172.21.15.120:0/3949249186 shutdown_connections 2024-09-19T05:18:46.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.234+0000 7f8d40d99640 1 -- 172.21.15.120:0/3949249186 wait complete. 2024-09-19T05:18:46.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.234+0000 7f8d40d99640 1 Processor -- start 2024-09-19T05:18:46.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.235+0000 7f8d40d99640 1 -- start start 2024-09-19T05:18:46.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.235+0000 7f8d40d99640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d3c102d30 0x7f8d3c198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:46.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.235+0000 7f8d40d99640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d3c1036e0 0x7f8d3c198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:46.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.235+0000 7f8d40d99640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d3c1082a0 0x7f8d3c19ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:46.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.235+0000 7f8d40d99640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c111f70 con 0x7f8d3c102d30 2024-09-19T05:18:46.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.235+0000 7f8d40d99640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c111df0 con 0x7f8d3c1036e0 2024-09-19T05:18:46.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.235+0000 7f8d40d99640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c1120f0 con 0x7f8d3c1082a0 2024-09-19T05:18:46.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.235+0000 7f8d3a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d3c102d30 0x7f8d3c198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:46.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.235+0000 7f8d3a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d3c102d30 0x7f8d3c198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58414/0 (socket says 172.21.15.120:58414) 2024-09-19T05:18:46.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.235+0000 7f8d3a59c640 1 -- 172.21.15.120:0/2276224190 learned_addr learned my addr 172.21.15.120:0/2276224190 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:46.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.235+0000 7f8d39d9b640 1 --2- 172.21.15.120:0/2276224190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d3c1036e0 0x7f8d3c198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:46.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.235+0000 7f8d3ad9d640 1 --2- 172.21.15.120:0/2276224190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d3c1082a0 0x7f8d3c19ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:46.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.235+0000 7f8d3a59c640 1 -- 172.21.15.120:0/2276224190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d3c1082a0 msgr2=0x7f8d3c19ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:46.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.235+0000 7f8d3a59c640 1 --2- 172.21.15.120:0/2276224190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d3c1082a0 0x7f8d3c19ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.235+0000 7f8d3a59c640 1 -- 172.21.15.120:0/2276224190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d3c1036e0 msgr2=0x7f8d3c198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:46.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.235+0000 7f8d3a59c640 1 --2- 172.21.15.120:0/2276224190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d3c1036e0 0x7f8d3c198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.235+0000 7f8d3a59c640 1 -- 172.21.15.120:0/2276224190 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d3c19d520 con 0x7f8d3c102d30 2024-09-19T05:18:46.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.235+0000 7f8d3ad9d640 1 --2- 172.21.15.120:0/2276224190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d3c1082a0 0x7f8d3c19ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:46.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.235+0000 7f8d39d9b640 1 --2- 172.21.15.120:0/2276224190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d3c1036e0 0x7f8d3c198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:18:46.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.235+0000 7f8d3a59c640 1 --2- 172.21.15.120:0/2276224190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d3c102d30 0x7f8d3c198570 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c00cce0 tx=0x7f8d2c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:46.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.235+0000 7f8d2b7fe640 1 -- 172.21.15.120:0/2276224190 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c004b20 con 0x7f8d3c102d30 2024-09-19T05:18:46.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.235+0000 7f8d2b7fe640 1 -- 172.21.15.120:0/2276224190 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8d2c004cc0 con 0x7f8d3c102d30 2024-09-19T05:18:46.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.235+0000 7f8d40d99640 1 -- 172.21.15.120:0/2276224190 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d3c19d810 con 0x7f8d3c102d30 2024-09-19T05:18:46.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.235+0000 7f8d2b7fe640 1 -- 172.21.15.120:0/2276224190 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c00f6b0 con 0x7f8d3c102d30 2024-09-19T05:18:46.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.235+0000 7f8d40d99640 1 -- 172.21.15.120:0/2276224190 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d3c1a50f0 con 0x7f8d3c102d30 2024-09-19T05:18:46.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.238+0000 7f8d2b7fe640 1 -- 172.21.15.120:0/2276224190 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f8d2c00f850 con 0x7f8d3c102d30 2024-09-19T05:18:46.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.238+0000 7f8d43172740 1 Processor -- start 2024-09-19T05:18:46.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.238+0000 7f8d43172740 1 -- start start 2024-09-19T05:18:46.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.239+0000 7f8d2b7fe640 1 --2- 172.21.15.120:0/2276224190 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f8d240a32d0 0x7f8d240a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:46.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.239+0000 7f8d43172740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dad7c6f8b0 0x55dad7c6fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:46.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.239+0000 7f8d43172740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dad7c701d0 0x55dad7c7ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:46.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.239+0000 7f8d43172740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c7efc0 0x55dad7c813b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:46.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.239+0000 7f8d43172740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55dad7bd6090 con 0x55dad7c7efc0 2024-09-19T05:18:46.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.239+0000 7f8d43172740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55dad7b7da70 con 0x55dad7c6f8b0 2024-09-19T05:18:46.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.239+0000 7f8d43172740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55dad7bd2050 con 0x55dad7c701d0 2024-09-19T05:18:46.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.239+0000 7f8d3ad9d640 1 --2- 172.21.15.120:0/2276224190 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f8d240a32d0 0x7f8d240a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:46.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.239+0000 7f8d2b7fe640 1 -- 172.21.15.120:0/2276224190 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f8d2c0cfc30 con 0x7f8d3c102d30 2024-09-19T05:18:46.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.239+0000 7f8d3ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c7efc0 0x55dad7c813b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:46.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.239+0000 7f8d39d9b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dad7c701d0 0x55dad7c7ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:46.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.239+0000 7f8d3ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c7efc0 0x55dad7c813b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58416/0 (socket says 172.21.15.120:58416) 2024-09-19T05:18:46.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.239+0000 7f8d3ad9d640 1 -- 172.21.15.120:0/2594751137 learned_addr learned my addr 172.21.15.120:0/2594751137 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:46.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.239+0000 7f8d3a59c640 1 --2- 172.21.15.120:0/2594751137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dad7c6f8b0 0x55dad7c6fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:46.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.239+0000 7f8d39d9b640 1 -- 172.21.15.120:0/2594751137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dad7c6f8b0 msgr2=0x55dad7c6fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:18:46.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.239+0000 7f8d39d9b640 1 --2- 172.21.15.120:0/2594751137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dad7c6f8b0 0x55dad7c6fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.239+0000 7f8d39d9b640 1 -- 172.21.15.120:0/2594751137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c7efc0 msgr2=0x55dad7c813b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:18:46.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.239+0000 7f8d39d9b640 1 --2- 172.21.15.120:0/2594751137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c7efc0 0x55dad7c813b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.239+0000 7f8d39d9b640 1 -- 172.21.15.120:0/2594751137 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dad7b8a130 con 0x55dad7c701d0 2024-09-19T05:18:46.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.239+0000 7f8d3a59c640 1 --2- 172.21.15.120:0/2594751137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dad7c6f8b0 0x55dad7c6fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:18:46.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.239+0000 7f8d3ad9d640 1 --2- 172.21.15.120:0/2594751137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c7efc0 0x55dad7c813b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:18:46.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.239+0000 7f8d3ad9d640 1 --2- 172.21.15.120:0/2276224190 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f8d240a32d0 0x7f8d240a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8d340154f0 tx=0x7f8d34009860 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:46.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.239+0000 7f8d39d9b640 1 --2- 172.21.15.120:0/2594751137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dad7c701d0 0x55dad7c7ea80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8d3002a940 tx=0x7f8d30031cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5842bc8229c2a65b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:46.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.239+0000 7f8d28ff9640 1 -- 172.21.15.120:0/2594751137 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3003f070 con 0x55dad7c701d0 2024-09-19T05:18:46.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.240+0000 7f8d28ff9640 1 -- 172.21.15.120:0/2594751137 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8d300044d0 con 0x55dad7c701d0 2024-09-19T05:18:46.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.240+0000 7f8d28ff9640 1 -- 172.21.15.120:0/2594751137 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d30035070 con 0x55dad7c701d0 2024-09-19T05:18:46.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.240+0000 7f8d43172740 1 -- 172.21.15.120:0/2594751137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dad7c701d0 msgr2=0x55dad7c7ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:46.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.240+0000 7f8d43172740 1 --2- 172.21.15.120:0/2594751137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dad7c701d0 0x55dad7c7ea80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8d3002a940 tx=0x7f8d30031cb0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.240+0000 7f8d43172740 1 -- 172.21.15.120:0/2594751137 shutdown_connections 2024-09-19T05:18:46.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.240+0000 7f8d43172740 1 --2- 172.21.15.120:0/2594751137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c7efc0 0x55dad7c813b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.240+0000 7f8d43172740 1 --2- 172.21.15.120:0/2594751137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dad7c701d0 0x55dad7c7ea80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.240+0000 7f8d43172740 1 --2- 172.21.15.120:0/2594751137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dad7c6f8b0 0x55dad7c6fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.240+0000 7f8d43172740 1 -- 172.21.15.120:0/2594751137 >> 172.21.15.120:0/2594751137 conn(0x55dad7c6bf60 msgr2=0x55dad7c6c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:46.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.240+0000 7f8d43172740 1 -- 172.21.15.120:0/2594751137 shutdown_connections 2024-09-19T05:18:46.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.240+0000 7f8d43172740 1 -- 172.21.15.120:0/2594751137 wait complete. 2024-09-19T05:18:46.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.241+0000 7f8d43172740 1 -- start start 2024-09-19T05:18:46.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.241+0000 7f8d43172740 1 Processor -- start 2024-09-19T05:18:46.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.241+0000 7f8d43172740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c6f8b0 0x55dad7c7e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:46.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.241+0000 7f8d43172740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dad7c701d0 0x55dad7c7bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:46.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.241+0000 7f8d43172740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dad7c7efc0 0x55dad7c7c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:46.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.241+0000 7f8d43172740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55dad7c81b90 con 0x55dad7c6f8b0 2024-09-19T05:18:46.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.241+0000 7f8d43172740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55dad7b90f20 con 0x55dad7c7efc0 2024-09-19T05:18:46.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.241+0000 7f8d43172740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55dad7c81d10 con 0x55dad7c701d0 2024-09-19T05:18:46.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.241+0000 7f8d43172740 10 client.0 _ll_register_callbacks cb 0x55dad7b5a030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:18:46.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.241+0000 7f8d3a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c6f8b0 0x55dad7c7e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:46.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.241+0000 7f8d3a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c6f8b0 0x55dad7c7e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58426/0 (socket says 172.21.15.120:58426) 2024-09-19T05:18:46.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.241+0000 7f8d39d9b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dad7c701d0 0x55dad7c7bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:46.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.241+0000 7f8d3a59c640 1 -- 172.21.15.120:0/2862081558 learned_addr learned my addr 172.21.15.120:0/2862081558 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:46.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.241+0000 7f8d3ad9d640 1 --2- 172.21.15.120:0/2862081558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dad7c7efc0 0x55dad7c7c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:46.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.241+0000 7f8d3a59c640 1 -- 172.21.15.120:0/2862081558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dad7c701d0 msgr2=0x55dad7c7bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:18:46.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.241+0000 7f8d3a59c640 1 --2- 172.21.15.120:0/2862081558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dad7c701d0 0x55dad7c7bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.241+0000 7f8d3a59c640 1 -- 172.21.15.120:0/2862081558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dad7c7efc0 msgr2=0x55dad7c7c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:18:46.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.241+0000 7f8d3a59c640 1 --2- 172.21.15.120:0/2862081558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dad7c7efc0 0x55dad7c7c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.241+0000 7f8d3a59c640 1 -- 172.21.15.120:0/2862081558 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dad79472b0 con 0x55dad7c6f8b0 2024-09-19T05:18:46.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.241+0000 7f8d39d9b640 1 --2- 172.21.15.120:0/2862081558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dad7c701d0 0x55dad7c7bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:18:46.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.242+0000 7f8d3a59c640 1 --2- 172.21.15.120:0/2862081558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c6f8b0 0x55dad7c7e8c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c09bdd0 tx=0x7f8d2c09c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1579c4bd04dfed50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:46.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.242+0000 7f8d21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:18:46.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.242+0000 7f8d21ffb640 1 -- 172.21.15.120:0/2862081558 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c01d040 con 0x55dad7c6f8b0 2024-09-19T05:18:46.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.242+0000 7f8d21ffb640 1 -- 172.21.15.120:0/2862081558 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f8d2c098740 con 0x55dad7c6f8b0 2024-09-19T05:18:46.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.242+0000 7f8d43172740 1 -- 172.21.15.120:0/2862081558 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d300044d0 con 0x55dad7c6f8b0 2024-09-19T05:18:46.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.242+0000 7f8d21ffb640 1 -- 172.21.15.120:0/2862081558 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8d2c0c8430 con 0x55dad7c6f8b0 2024-09-19T05:18:46.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.242+0000 7f8d43172740 10 client.14994 fetch_fsmap learned FSMap version 24 2024-09-19T05:18:46.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.242+0000 7f8d43172740 1 -- 172.21.15.120:0/2862081558 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55dad7c8d540 con 0x55dad7c6f8b0 2024-09-19T05:18:46.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.242+0000 7f8d21ffb640 1 -- 172.21.15.120:0/2862081558 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8d300044d0 con 0x55dad7c6f8b0 2024-09-19T05:18:46.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.242+0000 7f8d21ffb640 1 -- 172.21.15.120:0/2862081558 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8d2c0a48b0 con 0x55dad7c6f8b0 2024-09-19T05:18:46.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.242+0000 7f8d43172740 10 client.14994 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:18:46.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.242+0000 7f8d43172740 10 client.14994 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T05:18:46.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.242+0000 7f8d43172740 20 client.14994 populate_metadata read hostname 'smithi120' 2024-09-19T05:18:46.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.242+0000 7f8d43172740 1 --2- 172.21.15.120:0/2862081558 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55dad7c8fba0 0x55dad7c91010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:46.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.242+0000 7f8d43172740 4 client.14994 mds_command: new command op to 24443 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:18:46.276 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.242+0000 7f8d43172740 1 -- 172.21.15.120:0/2862081558 --> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dad7be3600 con 0x55dad7c8fba0 2024-09-19T05:18:46.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.242+0000 7f8d39d9b640 1 --2- 172.21.15.120:0/2862081558 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55dad7c8fba0 0x55dad7c91010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:46.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.243+0000 7f8d21ffb640 10 client.14994 ms_handle_connect on v2:172.21.15.178:6838/3389137566 2024-09-19T05:18:46.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.243+0000 7f8d39d9b640 1 --2- 172.21.15.120:0/2862081558 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55dad7c8fba0 0x55dad7c91010 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c48f8e8e4777c9b server_cookie=c86ede432bcbe673 in_seq=0 out_seq=0 2024-09-19T05:18:46.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.244+0000 7f8d21ffb640 1 -- 172.21.15.120:0/2862081558 <== mds.1 v2:172.21.15.178:6838/3389137566 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dad7be3600 con 0x55dad7c8fba0 2024-09-19T05:18:46.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.244+0000 7f8d21ffb640 10 client.14994 handle_command_reply: tid=0 2024-09-19T05:18:46.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.244+0000 7f8d43172740 1 client.14994 shutdown 2024-09-19T05:18:46.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.244+0000 7f8d43172740 1 -- 172.21.15.120:0/2862081558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c6f8b0 msgr2=0x55dad7c7e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:46.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.244+0000 7f8d43172740 1 --2- 172.21.15.120:0/2862081558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c6f8b0 0x55dad7c7e8c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c09bdd0 tx=0x7f8d2c09c910 comp rx=0 tx=0).stop 2024-09-19T05:18:46.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.244+0000 7f8d43172740 1 -- 172.21.15.120:0/2862081558 shutdown_connections 2024-09-19T05:18:46.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.244+0000 7f8d43172740 1 --2- 172.21.15.120:0/2862081558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dad7c7efc0 0x55dad7c7c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.244+0000 7f8d43172740 1 --2- 172.21.15.120:0/2862081558 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55dad7c8fba0 0x55dad7c91010 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.244+0000 7f8d43172740 1 --2- 172.21.15.120:0/2862081558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dad7c701d0 0x55dad7c7bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.244+0000 7f8d43172740 1 --2- 172.21.15.120:0/2862081558 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c6f8b0 0x55dad7c7e8c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.244+0000 7f8d21ffb640 0 client.14994 ms_handle_reset on v2:172.21.15.178:6838/3389137566 2024-09-19T05:18:46.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.244+0000 7f8d43172740 1 -- 172.21.15.120:0/2862081558 >> 172.21.15.120:0/2862081558 conn(0x55dad7c6bf60 msgr2=0x55dad7c71cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:46.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.244+0000 7f8d43172740 1 -- 172.21.15.120:0/2862081558 shutdown_connections 2024-09-19T05:18:46.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.244+0000 7f8d43172740 1 -- 172.21.15.120:0/2862081558 wait complete. 2024-09-19T05:18:46.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.244+0000 7f8d43172740 20 client.14994 trim_cache size 0 max 16384 2024-09-19T05:18:46.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.261+0000 7f8d43172740 1 Processor -- start 2024-09-19T05:18:46.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.261+0000 7f8d43172740 1 -- start start 2024-09-19T05:18:46.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.262+0000 7f8d43172740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c6f8b0 0x55dad7c91010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:46.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.262+0000 7f8d43172740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dad7c701d0 0x55dad7c6a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:46.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.262+0000 7f8d43172740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dad7c7efc0 0x55dad7c6ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:46.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.262+0000 7f8d43172740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55dad7c8f350 con 0x55dad7c6f8b0 2024-09-19T05:18:46.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.262+0000 7f8d43172740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55dad7c8fa20 con 0x55dad7c7efc0 2024-09-19T05:18:46.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.262+0000 7f8d43172740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55dad7c900f0 con 0x55dad7c701d0 2024-09-19T05:18:46.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.262+0000 7f8d3a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c6f8b0 0x55dad7c91010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:46.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.262+0000 7f8d3a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c6f8b0 0x55dad7c91010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58438/0 (socket says 172.21.15.120:58438) 2024-09-19T05:18:46.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.262+0000 7f8d3a59c640 1 -- 172.21.15.120:0/1056165589 learned_addr learned my addr 172.21.15.120:0/1056165589 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:46.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.262+0000 7f8d39d9b640 1 --2- 172.21.15.120:0/1056165589 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dad7c701d0 0x55dad7c6a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:46.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.262+0000 7f8d3a59c640 1 -- 172.21.15.120:0/1056165589 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dad7c701d0 msgr2=0x55dad7c6a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:18:46.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.262+0000 7f8d3a59c640 1 --2- 172.21.15.120:0/1056165589 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dad7c701d0 0x55dad7c6a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.262+0000 7f8d3a59c640 1 -- 172.21.15.120:0/1056165589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dad7c7efc0 msgr2=0x55dad7c6ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:18:46.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.262+0000 7f8d3a59c640 1 --2- 172.21.15.120:0/1056165589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dad7c7efc0 0x55dad7c6ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.262+0000 7f8d3a59c640 1 -- 172.21.15.120:0/1056165589 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dad7c723d0 con 0x55dad7c6f8b0 2024-09-19T05:18:46.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.262+0000 7f8d39d9b640 1 --2- 172.21.15.120:0/1056165589 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dad7c701d0 0x55dad7c6a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:18:46.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.262+0000 7f8d3a59c640 1 --2- 172.21.15.120:0/1056165589 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c6f8b0 0x55dad7c91010 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c098aa0 tx=0x7f8d2c09a5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0abdc9dc3960635 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:46.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.262+0000 7f8d23fff640 1 -- 172.21.15.120:0/1056165589 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c01d030 con 0x55dad7c6f8b0 2024-09-19T05:18:46.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.262+0000 7f8d23fff640 1 -- 172.21.15.120:0/1056165589 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8d2c0b4020 con 0x55dad7c6f8b0 2024-09-19T05:18:46.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.262+0000 7f8d23fff640 1 -- 172.21.15.120:0/1056165589 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c0a48b0 con 0x55dad7c6f8b0 2024-09-19T05:18:46.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.263+0000 7f8d43172740 1 -- 172.21.15.120:0/1056165589 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c6f8b0 msgr2=0x55dad7c91010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:46.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.263+0000 7f8d43172740 1 --2- 172.21.15.120:0/1056165589 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c6f8b0 0x55dad7c91010 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c098aa0 tx=0x7f8d2c09a5e0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.263+0000 7f8d43172740 1 -- 172.21.15.120:0/1056165589 shutdown_connections 2024-09-19T05:18:46.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.263+0000 7f8d43172740 1 --2- 172.21.15.120:0/1056165589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dad7c7efc0 0x55dad7c6ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.263+0000 7f8d43172740 1 --2- 172.21.15.120:0/1056165589 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dad7c701d0 0x55dad7c6a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.263+0000 7f8d43172740 1 --2- 172.21.15.120:0/1056165589 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c6f8b0 0x55dad7c91010 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.263+0000 7f8d43172740 1 -- 172.21.15.120:0/1056165589 >> 172.21.15.120:0/1056165589 conn(0x55dad7c6bf60 msgr2=0x55dad7c7a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:46.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.263+0000 7f8d43172740 1 -- 172.21.15.120:0/1056165589 shutdown_connections 2024-09-19T05:18:46.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.263+0000 7f8d43172740 1 -- 172.21.15.120:0/1056165589 wait complete. 2024-09-19T05:18:46.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.263+0000 7f8d43172740 1 -- start start 2024-09-19T05:18:46.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.263+0000 7f8d43172740 1 Processor -- start 2024-09-19T05:18:46.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.264+0000 7f8d43172740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dad7c6f8b0 0x55dad7c782c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:46.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.264+0000 7f8d43172740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dad7c701d0 0x55dad7c78800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:46.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.264+0000 7f8d43172740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c7efc0 0x55dad7c98260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:46.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.264+0000 7f8d43172740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55dad7c90e90 con 0x55dad7c7efc0 2024-09-19T05:18:46.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.264+0000 7f8d43172740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55dad7c907c0 con 0x55dad7c6f8b0 2024-09-19T05:18:46.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.264+0000 7f8d43172740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55dad7c91560 con 0x55dad7c701d0 2024-09-19T05:18:46.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.264+0000 7f8d43172740 10 client.0 _ll_register_callbacks cb 0x7f8d2c004eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:18:46.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.264+0000 7f8d3ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c7efc0 0x55dad7c98260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:46.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.264+0000 7f8d3ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c7efc0 0x55dad7c98260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58440/0 (socket says 172.21.15.120:58440) 2024-09-19T05:18:46.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.264+0000 7f8d3ad9d640 1 -- 172.21.15.120:0/1313398470 learned_addr learned my addr 172.21.15.120:0/1313398470 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:46.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.264+0000 7f8d3a59c640 1 --2- 172.21.15.120:0/1313398470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dad7c6f8b0 0x55dad7c782c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:46.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.264+0000 7f8d39d9b640 1 --2- 172.21.15.120:0/1313398470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dad7c701d0 0x55dad7c78800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:46.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.264+0000 7f8d3ad9d640 1 -- 172.21.15.120:0/1313398470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dad7c701d0 msgr2=0x55dad7c78800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:18:46.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.264+0000 7f8d3ad9d640 1 --2- 172.21.15.120:0/1313398470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dad7c701d0 0x55dad7c78800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.264+0000 7f8d3ad9d640 1 -- 172.21.15.120:0/1313398470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dad7c6f8b0 msgr2=0x55dad7c782c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:18:46.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.264+0000 7f8d3ad9d640 1 --2- 172.21.15.120:0/1313398470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dad7c6f8b0 0x55dad7c782c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.281 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.264+0000 7f8d3ad9d640 1 -- 172.21.15.120:0/1313398470 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dad7c987a0 con 0x55dad7c7efc0 2024-09-19T05:18:46.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.264+0000 7f8d39d9b640 1 --2- 172.21.15.120:0/1313398470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dad7c701d0 0x55dad7c78800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:18:46.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.264+0000 7f8d3ad9d640 1 --2- 172.21.15.120:0/1313398470 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c7efc0 0x55dad7c98260 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x55dad7c6d050 tx=0x7f8d340047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71416643347b621 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:46.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.264+0000 7f8d21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:18:46.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.264+0000 7f8d21ffb640 1 -- 172.21.15.120:0/1313398470 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d34028060 con 0x55dad7c7efc0 2024-09-19T05:18:46.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.264+0000 7f8d21ffb640 1 -- 172.21.15.120:0/1313398470 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f8d34018ae0 con 0x55dad7c7efc0 2024-09-19T05:18:46.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.264+0000 7f8d43172740 1 -- 172.21.15.120:0/1313398470 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d2c0b4020 con 0x55dad7c7efc0 2024-09-19T05:18:46.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.265+0000 7f8d21ffb640 1 -- 172.21.15.120:0/1313398470 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8d3400f040 con 0x55dad7c7efc0 2024-09-19T05:18:46.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.265+0000 7f8d43172740 10 client.15000 fetch_fsmap learned FSMap version 24 2024-09-19T05:18:46.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.265+0000 7f8d43172740 1 -- 172.21.15.120:0/1313398470 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55dad7c99a60 con 0x55dad7c7efc0 2024-09-19T05:18:46.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.265+0000 7f8d21ffb640 1 -- 172.21.15.120:0/1313398470 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8d2c0b4020 con 0x55dad7c7efc0 2024-09-19T05:18:46.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.265+0000 7f8d21ffb640 1 -- 172.21.15.120:0/1313398470 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8d34015040 con 0x55dad7c7efc0 2024-09-19T05:18:46.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.265+0000 7f8d43172740 10 client.15000 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:18:46.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.265+0000 7f8d43172740 10 client.15000 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T05:18:46.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.265+0000 7f8d43172740 20 client.15000 populate_metadata read hostname 'smithi120' 2024-09-19T05:18:46.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.265+0000 7f8d43172740 1 --2- 172.21.15.120:0/1313398470 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55dad7cfe640 0x55dad7cfd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:46.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.265+0000 7f8d43172740 4 client.15000 mds_command: new command op to 24443 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:18:46.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.265+0000 7f8d43172740 1 -- 172.21.15.120:0/1313398470 --> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] -- command(tid 0: {"prefix": "status"}) -- 0x55dad7bddb10 con 0x55dad7cfe640 2024-09-19T05:18:46.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.265+0000 7f8d3a59c640 1 --2- 172.21.15.120:0/1313398470 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55dad7cfe640 0x55dad7cfd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:46.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.266+0000 7f8d21ffb640 10 client.15000 ms_handle_connect on v2:172.21.15.178:6838/3389137566 2024-09-19T05:18:46.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.266+0000 7f8d3a59c640 1 --2- 172.21.15.120:0/1313398470 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55dad7cfe640 0x55dad7cfd350 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=da9f2546a219998 server_cookie=dfc3186b03e78797 in_seq=0 out_seq=0 2024-09-19T05:18:46.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.266+0000 7f8d21ffb640 1 -- 172.21.15.120:0/1313398470 <== mds.1 v2:172.21.15.178:6838/3389137566 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55dad7bddb10 con 0x55dad7cfe640 2024-09-19T05:18:46.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.266+0000 7f8d21ffb640 10 client.15000 handle_command_reply: tid=0 2024-09-19T05:18:46.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.266+0000 7f8d43172740 1 client.15000 shutdown 2024-09-19T05:18:46.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.266+0000 7f8d43172740 1 -- 172.21.15.120:0/1313398470 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c7efc0 msgr2=0x55dad7c98260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:46.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.266+0000 7f8d43172740 1 --2- 172.21.15.120:0/1313398470 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c7efc0 0x55dad7c98260 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x55dad7c6d050 tx=0x7f8d340047d0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.266+0000 7f8d43172740 1 -- 172.21.15.120:0/1313398470 shutdown_connections 2024-09-19T05:18:46.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.266+0000 7f8d43172740 1 --2- 172.21.15.120:0/1313398470 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55dad7c7efc0 0x55dad7c98260 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.266+0000 7f8d43172740 1 --2- 172.21.15.120:0/1313398470 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55dad7cfe640 0x55dad7cfd350 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.266+0000 7f8d43172740 1 --2- 172.21.15.120:0/1313398470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dad7c701d0 0x55dad7c78800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.266+0000 7f8d43172740 1 --2- 172.21.15.120:0/1313398470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dad7c6f8b0 0x55dad7c782c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.266+0000 7f8d43172740 1 -- 172.21.15.120:0/1313398470 >> 172.21.15.120:0/1313398470 conn(0x55dad7c6bf60 msgr2=0x55dad7c71be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:46.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.266+0000 7f8d21ffb640 0 client.15000 ms_handle_reset on v2:172.21.15.178:6838/3389137566 2024-09-19T05:18:46.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.266+0000 7f8d43172740 1 -- 172.21.15.120:0/1313398470 shutdown_connections 2024-09-19T05:18:46.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.266+0000 7f8d43172740 1 -- 172.21.15.120:0/1313398470 wait complete. 2024-09-19T05:18:46.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.266+0000 7f8d43172740 20 client.15000 trim_cache size 0 max 16384 2024-09-19T05:18:46.284 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T05:18:46.284 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "4e6e3df4-7645-11ef-bceb-c7b262605968", 2024-09-19T05:18:46.284 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 1, 2024-09-19T05:18:46.285 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 24443, 2024-09-19T05:18:46.285 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-09-19T05:18:46.285 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-09-19T05:18:46.285 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-09-19T05:18:46.285 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 68.046782078000007, 2024-09-19T05:18:46.285 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 24, 2024-09-19T05:18:46.285 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 82, 2024-09-19T05:18:46.285 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T05:18:46.285 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 85.506152407000002 2024-09-19T05:18:46.285 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T05:18:46.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.267+0000 7f8d40d99640 1 -- 172.21.15.120:0/2276224190 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f8d240a32d0 msgr2=0x7f8d240a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:46.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.267+0000 7f8d40d99640 1 --2- 172.21.15.120:0/2276224190 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f8d240a32d0 0x7f8d240a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8d340154f0 tx=0x7f8d34009860 comp rx=0 tx=0).stop 2024-09-19T05:18:46.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.267+0000 7f8d40d99640 1 -- 172.21.15.120:0/2276224190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d3c102d30 msgr2=0x7f8d3c198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:46.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.267+0000 7f8d40d99640 1 --2- 172.21.15.120:0/2276224190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d3c102d30 0x7f8d3c198570 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c00cce0 tx=0x7f8d2c00a620 comp rx=0 tx=0).stop 2024-09-19T05:18:46.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.267+0000 7f8d40d99640 1 -- 172.21.15.120:0/2276224190 shutdown_connections 2024-09-19T05:18:46.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.267+0000 7f8d40d99640 1 --2- 172.21.15.120:0/2276224190 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f8d240a32d0 0x7f8d240a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.267+0000 7f8d40d99640 1 --2- 172.21.15.120:0/2276224190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d3c1082a0 0x7f8d3c19ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.267+0000 7f8d40d99640 1 --2- 172.21.15.120:0/2276224190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d3c1036e0 0x7f8d3c198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.267+0000 7f8d40d99640 1 --2- 172.21.15.120:0/2276224190 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d3c102d30 0x7f8d3c198570 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:46.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.267+0000 7f8d40d99640 1 -- 172.21.15.120:0/2276224190 >> 172.21.15.120:0/2276224190 conn(0x7f8d3c0fc7d0 msgr2=0x7f8d3c105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:46.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.267+0000 7f8d40d99640 1 -- 172.21.15.120:0/2276224190 shutdown_connections 2024-09-19T05:18:46.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:46.267+0000 7f8d40d99640 1 -- 172.21.15.120:0/2276224190 wait complete. 2024-09-19T05:18:47.083 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T05:18:47.332 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:47.479 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:47 smithi120 ceph-mon[30956]: pgmap v311: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T05:18:47.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:47 smithi194 ceph-mon[35228]: pgmap v311: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T05:18:47.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:47 smithi178 ceph-mon[34347]: pgmap v311: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T05:18:47.829 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.788+0000 7f239fbd5640 1 -- 172.21.15.120:0/347779634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2398100b30 msgr2=0x7f2398100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:47.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.788+0000 7f239fbd5640 1 --2- 172.21.15.120:0/347779634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2398100b30 0x7f2398100f10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2394009900 tx=0x7f239402a470 comp rx=0 tx=0).stop 2024-09-19T05:18:47.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.788+0000 7f239fbd5640 1 -- 172.21.15.120:0/347779634 shutdown_connections 2024-09-19T05:18:47.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.788+0000 7f239fbd5640 1 --2- 172.21.15.120:0/347779634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2398105f40 0x7f23981063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.788+0000 7f239fbd5640 1 --2- 172.21.15.120:0/347779634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2398101450 0x7f2398105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.788+0000 7f239fbd5640 1 --2- 172.21.15.120:0/347779634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2398100b30 0x7f2398100f10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.788+0000 7f239fbd5640 1 -- 172.21.15.120:0/347779634 >> 172.21.15.120:0/347779634 conn(0x7f23980fc7a0 msgr2=0x7f23980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:47.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.789+0000 7f239fbd5640 1 -- 172.21.15.120:0/347779634 shutdown_connections 2024-09-19T05:18:47.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.789+0000 7f239fbd5640 1 -- 172.21.15.120:0/347779634 wait complete. 2024-09-19T05:18:47.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.789+0000 7f239fbd5640 1 Processor -- start 2024-09-19T05:18:47.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.789+0000 7f239fbd5640 1 -- start start 2024-09-19T05:18:47.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.789+0000 7f239fbd5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2398100b30 0x7f23981a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:47.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.789+0000 7f239fbd5640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2398101450 0x7f23981a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:47.830 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.789+0000 7f239fbd5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2398105f40 0x7f239819e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:47.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.789+0000 7f239fbd5640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f23981184f0 con 0x7f2398100b30 2024-09-19T05:18:47.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.789+0000 7f239fbd5640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2398118370 con 0x7f2398101450 2024-09-19T05:18:47.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.789+0000 7f239fbd5640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2398118670 con 0x7f2398105f40 2024-09-19T05:18:47.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.790+0000 7f239d971640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2398100b30 0x7f23981a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:47.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.790+0000 7f239d971640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2398100b30 0x7f23981a4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58452/0 (socket says 172.21.15.120:58452) 2024-09-19T05:18:47.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.790+0000 7f239d971640 1 -- 172.21.15.120:0/1290622293 learned_addr learned my addr 172.21.15.120:0/1290622293 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:47.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.790+0000 7f239e172640 1 --2- 172.21.15.120:0/1290622293 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2398105f40 0x7f239819e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:47.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.790+0000 7f239d170640 1 --2- 172.21.15.120:0/1290622293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2398101450 0x7f23981a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:47.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.790+0000 7f239d971640 1 -- 172.21.15.120:0/1290622293 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2398105f40 msgr2=0x7f239819e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:47.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.790+0000 7f239d971640 1 --2- 172.21.15.120:0/1290622293 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2398105f40 0x7f239819e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.790+0000 7f239d971640 1 -- 172.21.15.120:0/1290622293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2398101450 msgr2=0x7f23981a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:47.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.790+0000 7f239d971640 1 --2- 172.21.15.120:0/1290622293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2398101450 0x7f23981a4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.831 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.790+0000 7f239d971640 1 -- 172.21.15.120:0/1290622293 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f239819f050 con 0x7f2398100b30 2024-09-19T05:18:47.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.790+0000 7f239e172640 1 --2- 172.21.15.120:0/1290622293 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2398105f40 0x7f239819e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:18:47.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.790+0000 7f239d971640 1 --2- 172.21.15.120:0/1290622293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2398100b30 0x7f23981a4760 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2394006010 tx=0x7f2394004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:47.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.790+0000 7f238effd640 1 -- 172.21.15.120:0/1290622293 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239403f030 con 0x7f2398100b30 2024-09-19T05:18:47.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.790+0000 7f238effd640 1 -- 172.21.15.120:0/1290622293 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f23940035f0 con 0x7f2398100b30 2024-09-19T05:18:47.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.790+0000 7f239fbd5640 1 -- 172.21.15.120:0/1290622293 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f239819f2e0 con 0x7f2398100b30 2024-09-19T05:18:47.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.790+0000 7f238effd640 1 -- 172.21.15.120:0/1290622293 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2394035070 con 0x7f2398100b30 2024-09-19T05:18:47.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.790+0000 7f239fbd5640 1 -- 172.21.15.120:0/1290622293 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23981ab630 con 0x7f2398100b30 2024-09-19T05:18:47.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.792+0000 7f238effd640 1 -- 172.21.15.120:0/1290622293 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f2394003b10 con 0x7f2398100b30 2024-09-19T05:18:47.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.793+0000 7f23a1fae740 1 Processor -- start 2024-09-19T05:18:47.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.793+0000 7f23a1fae740 1 -- start start 2024-09-19T05:18:47.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.793+0000 7f23a1fae740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c49d0 0x5580887c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:47.832 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.793+0000 7f23a1fae740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580887c52f0 0x5580887cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:47.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.793+0000 7f23a1fae740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580887cfbb0 0x5580887d1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:47.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.793+0000 7f23a1fae740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55808872b090 con 0x5580887c49d0 2024-09-19T05:18:47.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.793+0000 7f23a1fae740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5580886d2a70 con 0x5580887c52f0 2024-09-19T05:18:47.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.793+0000 7f23a1fae740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x558088727050 con 0x5580887cfbb0 2024-09-19T05:18:47.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.793+0000 7f239e172640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c49d0 0x5580887c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:47.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.793+0000 7f239e172640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c49d0 0x5580887c4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58468/0 (socket says 172.21.15.120:58468) 2024-09-19T05:18:47.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.793+0000 7f239e172640 1 -- 172.21.15.120:0/3157112362 learned_addr learned my addr 172.21.15.120:0/3157112362 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:47.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.793+0000 7f238effd640 1 --2- 172.21.15.120:0/1290622293 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f23840a32d0 0x7f23840a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:47.833 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.793+0000 7f239d971640 1 --2- 172.21.15.120:0/3157112362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580887c52f0 0x5580887cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:47.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.793+0000 7f239e172640 1 -- 172.21.15.120:0/3157112362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580887cfbb0 msgr2=0x5580887d1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:18:47.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.793+0000 7f239e172640 1 --2- 172.21.15.120:0/3157112362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580887cfbb0 0x5580887d1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.793+0000 7f239e172640 1 -- 172.21.15.120:0/3157112362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580887c52f0 msgr2=0x5580887cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:18:47.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.793+0000 7f239e172640 1 --2- 172.21.15.120:0/3157112362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580887c52f0 0x5580887cf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.794+0000 7f239e172640 1 -- 172.21.15.120:0/3157112362 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580886df130 con 0x5580887c49d0 2024-09-19T05:18:47.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.794+0000 7f239d971640 1 --2- 172.21.15.120:0/3157112362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580887c52f0 0x5580887cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:47.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.794+0000 7f239e172640 1 --2- 172.21.15.120:0/1290622293 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f23840a32d0 0x7f23840a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:47.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.794+0000 7f238effd640 1 -- 172.21.15.120:0/1290622293 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f23940f06f0 con 0x7f2398100b30 2024-09-19T05:18:47.834 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.794+0000 7f239e172640 1 --2- 172.21.15.120:0/3157112362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c49d0 0x5580887c4db0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f239000c550 tx=0x7f239000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc40ad71c376eb5e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:47.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.794+0000 7f2383fff640 1 -- 172.21.15.120:0/3157112362 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239000a600 con 0x5580887c49d0 2024-09-19T05:18:47.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.794+0000 7f2383fff640 1 -- 172.21.15.120:0/3157112362 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f239000ac50 con 0x5580887c49d0 2024-09-19T05:18:47.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.794+0000 7f2383fff640 1 -- 172.21.15.120:0/3157112362 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2390018a00 con 0x5580887c49d0 2024-09-19T05:18:47.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.794+0000 7f239e172640 1 --2- 172.21.15.120:0/1290622293 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f23840a32d0 0x7f23840a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f239001f000 tx=0x7f2390018000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:47.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.795+0000 7f23a1fae740 1 -- 172.21.15.120:0/3157112362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c49d0 msgr2=0x5580887c4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:47.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.795+0000 7f23a1fae740 1 --2- 172.21.15.120:0/3157112362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c49d0 0x5580887c4db0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f239000c550 tx=0x7f239000ca10 comp rx=0 tx=0).stop 2024-09-19T05:18:47.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.795+0000 7f23a1fae740 1 -- 172.21.15.120:0/3157112362 shutdown_connections 2024-09-19T05:18:47.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.795+0000 7f23a1fae740 1 --2- 172.21.15.120:0/3157112362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580887cfbb0 0x5580887d1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.795+0000 7f23a1fae740 1 --2- 172.21.15.120:0/3157112362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580887c52f0 0x5580887cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.795+0000 7f23a1fae740 1 --2- 172.21.15.120:0/3157112362 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c49d0 0x5580887c4db0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.795+0000 7f23a1fae740 1 -- 172.21.15.120:0/3157112362 >> 172.21.15.120:0/3157112362 conn(0x5580887c0f60 msgr2=0x5580887c1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:47.835 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.795+0000 7f23a1fae740 1 -- 172.21.15.120:0/3157112362 shutdown_connections 2024-09-19T05:18:47.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.795+0000 7f23a1fae740 1 -- 172.21.15.120:0/3157112362 wait complete. 2024-09-19T05:18:47.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.795+0000 7f23a1fae740 1 -- start start 2024-09-19T05:18:47.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.795+0000 7f23a1fae740 1 Processor -- start 2024-09-19T05:18:47.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.796+0000 7f23a1fae740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580887c49d0 0x5580887cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:47.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.796+0000 7f23a1fae740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c52f0 0x5580887cc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:47.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.796+0000 7f23a1fae740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580887cfbb0 0x5580887ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:47.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.796+0000 7f23a1fae740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5580887d2780 con 0x5580887c52f0 2024-09-19T05:18:47.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.796+0000 7f23a1fae740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5580886e5f20 con 0x5580887c49d0 2024-09-19T05:18:47.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.796+0000 7f23a1fae740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5580887d2900 con 0x5580887cfbb0 2024-09-19T05:18:47.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.796+0000 7f23a1fae740 10 client.0 _ll_register_callbacks cb 0x5580886af030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:18:47.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.796+0000 7f239d170640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c52f0 0x5580887cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:47.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.796+0000 7f239d170640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c52f0 0x5580887cc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58470/0 (socket says 172.21.15.120:58470) 2024-09-19T05:18:47.836 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.796+0000 7f239d170640 1 -- 172.21.15.120:0/86780764 learned_addr learned my addr 172.21.15.120:0/86780764 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:47.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.796+0000 7f239d971640 1 --2- 172.21.15.120:0/86780764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580887c49d0 0x5580887cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:47.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.796+0000 7f239e172640 1 --2- 172.21.15.120:0/86780764 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580887cfbb0 0x5580887ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:47.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.796+0000 7f239d170640 1 -- 172.21.15.120:0/86780764 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580887cfbb0 msgr2=0x5580887ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:18:47.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.796+0000 7f239d170640 1 --2- 172.21.15.120:0/86780764 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580887cfbb0 0x5580887ccd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.796+0000 7f239d170640 1 -- 172.21.15.120:0/86780764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580887c49d0 msgr2=0x5580887cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:18:47.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.796+0000 7f239d170640 1 --2- 172.21.15.120:0/86780764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580887c49d0 0x5580887cf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.796+0000 7f239d170640 1 -- 172.21.15.120:0/86780764 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55808849c2b0 con 0x5580887c52f0 2024-09-19T05:18:47.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.796+0000 7f239d971640 1 --2- 172.21.15.120:0/86780764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580887c49d0 0x5580887cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:18:47.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.796+0000 7f239d170640 1 --2- 172.21.15.120:0/86780764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c52f0 0x5580887cc810 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2388007ee0 tx=0x7f238800d530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b9e1f0145bd16e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:47.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.796+0000 7f23817fa640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:18:47.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.796+0000 7f23817fa640 1 -- 172.21.15.120:0/86780764 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388013480 con 0x5580887c52f0 2024-09-19T05:18:47.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.796+0000 7f23817fa640 1 -- 172.21.15.120:0/86780764 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f2388013620 con 0x5580887c52f0 2024-09-19T05:18:47.837 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.796+0000 7f23a1fae740 1 -- 172.21.15.120:0/86780764 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f239000ac50 con 0x5580887c52f0 2024-09-19T05:18:47.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.797+0000 7f23817fa640 1 -- 172.21.15.120:0/86780764 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2388013820 con 0x5580887c52f0 2024-09-19T05:18:47.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.797+0000 7f23a1fae740 10 client.15012 fetch_fsmap learned FSMap version 24 2024-09-19T05:18:47.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.797+0000 7f23a1fae740 1 -- 172.21.15.120:0/86780764 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5580887de0d0 con 0x5580887c52f0 2024-09-19T05:18:47.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.797+0000 7f23817fa640 1 -- 172.21.15.120:0/86780764 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f239000ac50 con 0x5580887c52f0 2024-09-19T05:18:47.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.797+0000 7f23817fa640 1 -- 172.21.15.120:0/86780764 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f238801cae0 con 0x5580887c52f0 2024-09-19T05:18:47.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.797+0000 7f23a1fae740 10 client.15012 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:18:47.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.797+0000 7f23a1fae740 10 client.15012 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T05:18:47.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.797+0000 7f23a1fae740 20 client.15012 populate_metadata read hostname 'smithi120' 2024-09-19T05:18:47.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.797+0000 7f23a1fae740 1 --2- 172.21.15.120:0/86780764 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5580887e0790 0x5580887e1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:47.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.797+0000 7f23a1fae740 4 client.15012 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:18:47.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.797+0000 7f23a1fae740 1 -- 172.21.15.120:0/86780764 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558088738600 con 0x5580887e0790 2024-09-19T05:18:47.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.797+0000 7f239d971640 1 --2- 172.21.15.120:0/86780764 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5580887e0790 0x5580887e1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:47.838 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.798+0000 7f239d971640 1 --2- 172.21.15.120:0/86780764 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5580887e0790 0x5580887e1c00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d00404762f880c0 server_cookie=983bc86618d6872e in_seq=0 out_seq=0 2024-09-19T05:18:47.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.798+0000 7f23817fa640 10 client.15012 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:18:47.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.799+0000 7f23817fa640 1 -- 172.21.15.120:0/86780764 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558088738600 con 0x5580887e0790 2024-09-19T05:18:47.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.799+0000 7f23817fa640 10 client.15012 handle_command_reply: tid=0 2024-09-19T05:18:47.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.799+0000 7f23a1fae740 1 client.15012 shutdown 2024-09-19T05:18:47.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.799+0000 7f23a1fae740 1 -- 172.21.15.120:0/86780764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c52f0 msgr2=0x5580887cc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:47.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.799+0000 7f23a1fae740 1 --2- 172.21.15.120:0/86780764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c52f0 0x5580887cc810 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2388007ee0 tx=0x7f238800d530 comp rx=0 tx=0).stop 2024-09-19T05:18:47.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.799+0000 7f23a1fae740 1 -- 172.21.15.120:0/86780764 shutdown_connections 2024-09-19T05:18:47.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.799+0000 7f23a1fae740 1 --2- 172.21.15.120:0/86780764 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5580887e0790 0x5580887e1c00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.799+0000 7f23a1fae740 1 --2- 172.21.15.120:0/86780764 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580887cfbb0 0x5580887ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.799+0000 7f23a1fae740 1 --2- 172.21.15.120:0/86780764 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c52f0 0x5580887cc810 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.799+0000 7f23a1fae740 1 --2- 172.21.15.120:0/86780764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580887c49d0 0x5580887cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.799+0000 7f23a1fae740 1 -- 172.21.15.120:0/86780764 >> 172.21.15.120:0/86780764 conn(0x5580887c0f60 msgr2=0x5580887c6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:47.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.799+0000 7f23817fa640 0 client.15012 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:18:47.839 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.799+0000 7f23a1fae740 1 -- 172.21.15.120:0/86780764 shutdown_connections 2024-09-19T05:18:47.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.799+0000 7f23a1fae740 1 -- 172.21.15.120:0/86780764 wait complete. 2024-09-19T05:18:47.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.799+0000 7f23a1fae740 20 client.15012 trim_cache size 0 max 16384 2024-09-19T05:18:47.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.816+0000 7f23a1fae740 1 Processor -- start 2024-09-19T05:18:47.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.816+0000 7f23a1fae740 1 -- start start 2024-09-19T05:18:47.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.816+0000 7f23a1fae740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c49d0 0x5580887c6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:47.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.816+0000 7f23a1fae740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580887c52f0 0x5580887c6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:47.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.816+0000 7f23a1fae740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580887cfbb0 0x5580887c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:47.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.816+0000 7f23a1fae740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5580887dff40 con 0x5580887c49d0 2024-09-19T05:18:47.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.816+0000 7f23a1fae740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5580887e0610 con 0x5580887cfbb0 2024-09-19T05:18:47.840 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.816+0000 7f23a1fae740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5580887e0ce0 con 0x5580887c52f0 2024-09-19T05:18:47.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.816+0000 7f239d971640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c49d0 0x5580887c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:47.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.816+0000 7f239d971640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c49d0 0x5580887c6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58472/0 (socket says 172.21.15.120:58472) 2024-09-19T05:18:47.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.817+0000 7f239d971640 1 -- 172.21.15.120:0/686511778 learned_addr learned my addr 172.21.15.120:0/686511778 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:47.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.817+0000 7f239d170640 1 --2- 172.21.15.120:0/686511778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580887c52f0 0x5580887c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:47.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.817+0000 7f239d971640 1 -- 172.21.15.120:0/686511778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580887c52f0 msgr2=0x5580887c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:18:47.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.817+0000 7f239e172640 1 --2- 172.21.15.120:0/686511778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580887cfbb0 0x5580887c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:47.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.817+0000 7f239d971640 1 --2- 172.21.15.120:0/686511778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580887c52f0 0x5580887c6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.817+0000 7f239d971640 1 -- 172.21.15.120:0/686511778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580887cfbb0 msgr2=0x5580887c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:18:47.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.817+0000 7f239d971640 1 --2- 172.21.15.120:0/686511778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580887cfbb0 0x5580887c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.841 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.817+0000 7f239d971640 1 -- 172.21.15.120:0/686511778 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580887d2890 con 0x5580887c49d0 2024-09-19T05:18:47.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.817+0000 7f239d170640 1 --2- 172.21.15.120:0/686511778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580887c52f0 0x5580887c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:47.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.817+0000 7f239e172640 1 --2- 172.21.15.120:0/686511778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580887cfbb0 0x5580887c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:47.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.817+0000 7f239d971640 1 --2- 172.21.15.120:0/686511778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c49d0 0x5580887c6420 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f23940b9560 tx=0x7f23940b8e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b85fe1a45c3c384 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:47.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.817+0000 7f23837fe640 1 -- 172.21.15.120:0/686511778 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2394049040 con 0x5580887c49d0 2024-09-19T05:18:47.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.817+0000 7f23837fe640 1 -- 172.21.15.120:0/686511778 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f23940c5800 con 0x5580887c49d0 2024-09-19T05:18:47.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.817+0000 7f23837fe640 1 -- 172.21.15.120:0/686511778 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23940bcdf0 con 0x5580887c49d0 2024-09-19T05:18:47.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.818+0000 7f23a1fae740 1 -- 172.21.15.120:0/686511778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c49d0 msgr2=0x5580887c6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:47.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.818+0000 7f23a1fae740 1 --2- 172.21.15.120:0/686511778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c49d0 0x5580887c6420 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f23940b9560 tx=0x7f23940b8e30 comp rx=0 tx=0).stop 2024-09-19T05:18:47.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.818+0000 7f23a1fae740 1 -- 172.21.15.120:0/686511778 shutdown_connections 2024-09-19T05:18:47.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.818+0000 7f23a1fae740 1 --2- 172.21.15.120:0/686511778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580887cfbb0 0x5580887c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.818+0000 7f23a1fae740 1 --2- 172.21.15.120:0/686511778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580887c52f0 0x5580887c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.842 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.818+0000 7f23a1fae740 1 --2- 172.21.15.120:0/686511778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c49d0 0x5580887c6420 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.818+0000 7f23a1fae740 1 -- 172.21.15.120:0/686511778 >> 172.21.15.120:0/686511778 conn(0x5580887c0f60 msgr2=0x5580887c7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:47.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.818+0000 7f23a1fae740 1 -- 172.21.15.120:0/686511778 shutdown_connections 2024-09-19T05:18:47.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.818+0000 7f23a1fae740 1 -- 172.21.15.120:0/686511778 wait complete. 2024-09-19T05:18:47.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.818+0000 7f23a1fae740 1 -- start start 2024-09-19T05:18:47.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.818+0000 7f23a1fae740 1 Processor -- start 2024-09-19T05:18:47.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.819+0000 7f23a1fae740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580887c49d0 0x5580887e2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:47.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.819+0000 7f23a1fae740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c52f0 0x5580887e3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:47.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.819+0000 7f23a1fae740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580887cfbb0 0x5580887e3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:47.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.819+0000 7f23a1fae740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5580887e1a80 con 0x5580887c52f0 2024-09-19T05:18:47.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.819+0000 7f23a1fae740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5580887e13b0 con 0x5580887cfbb0 2024-09-19T05:18:47.843 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.819+0000 7f23a1fae740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5580887e2150 con 0x5580887c49d0 2024-09-19T05:18:47.844 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.819+0000 7f23a1fae740 10 client.0 _ll_register_callbacks cb 0x7f239806b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:18:47.844 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T05:18:47.844 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "4e6e3df4-7645-11ef-bceb-c7b262605968", 2024-09-19T05:18:47.844 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 0, 2024-09-19T05:18:47.844 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 24445, 2024-09-19T05:18:47.844 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-09-19T05:18:47.844 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-09-19T05:18:47.844 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-09-19T05:18:47.845 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 76.633404257999999, 2024-09-19T05:18:47.845 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 24, 2024-09-19T05:18:47.845 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 82, 2024-09-19T05:18:47.845 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T05:18:47.845 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 95.874165907000005 2024-09-19T05:18:47.845 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T05:18:47.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.819+0000 7f239d170640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c52f0 0x5580887e3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:47.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.819+0000 7f239d170640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c52f0 0x5580887e3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58482/0 (socket says 172.21.15.120:58482) 2024-09-19T05:18:47.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.819+0000 7f239d170640 1 -- 172.21.15.120:0/2055646705 learned_addr learned my addr 172.21.15.120:0/2055646705 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:47.845 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.819+0000 7f239e172640 1 --2- 172.21.15.120:0/2055646705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580887cfbb0 0x5580887e3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:47.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.819+0000 7f239d971640 1 --2- 172.21.15.120:0/2055646705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580887c49d0 0x5580887e2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:47.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.819+0000 7f239d170640 1 -- 172.21.15.120:0/2055646705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580887c49d0 msgr2=0x5580887e2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:18:47.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.819+0000 7f239d170640 1 --2- 172.21.15.120:0/2055646705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580887c49d0 0x5580887e2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.819+0000 7f239d170640 1 -- 172.21.15.120:0/2055646705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580887cfbb0 msgr2=0x5580887e3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:18:47.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.819+0000 7f239d170640 1 --2- 172.21.15.120:0/2055646705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580887cfbb0 0x5580887e3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.819+0000 7f239d170640 1 -- 172.21.15.120:0/2055646705 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558088848fc0 con 0x5580887c52f0 2024-09-19T05:18:47.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.819+0000 7f239e172640 1 --2- 172.21.15.120:0/2055646705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580887cfbb0 0x5580887e3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:18:47.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.819+0000 7f239d170640 1 --2- 172.21.15.120:0/2055646705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c52f0 0x5580887e3340 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2388001eb0 tx=0x7f2388013690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8b937658d1104b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:47.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.819+0000 7f23817fa640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:18:47.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.819+0000 7f23817fa640 1 -- 172.21.15.120:0/2055646705 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238802d020 con 0x5580887c52f0 2024-09-19T05:18:47.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.819+0000 7f23817fa640 1 -- 172.21.15.120:0/2055646705 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8269+0+0 (secure 0 0 0) 0x7f23880139c0 con 0x5580887c52f0 2024-09-19T05:18:47.846 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.819+0000 7f23a1fae740 1 -- 172.21.15.120:0/2055646705 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23940c5800 con 0x5580887c52f0 2024-09-19T05:18:47.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.820+0000 7f23817fa640 1 -- 172.21.15.120:0/2055646705 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2388038050 con 0x5580887c52f0 2024-09-19T05:18:47.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.820+0000 7f23a1fae740 10 client.15018 fetch_fsmap learned FSMap version 24 2024-09-19T05:18:47.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.820+0000 7f23a1fae740 1 -- 172.21.15.120:0/2055646705 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55808884a240 con 0x5580887c52f0 2024-09-19T05:18:47.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.820+0000 7f23817fa640 1 -- 172.21.15.120:0/2055646705 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f23940c5800 con 0x5580887c52f0 2024-09-19T05:18:47.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.820+0000 7f23817fa640 1 -- 172.21.15.120:0/2055646705 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f238801c400 con 0x5580887c52f0 2024-09-19T05:18:47.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.820+0000 7f23a1fae740 10 client.15018 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:18:47.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.820+0000 7f23a1fae740 10 client.15018 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T05:18:47.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.820+0000 7f23a1fae740 20 client.15018 populate_metadata read hostname 'smithi120' 2024-09-19T05:18:47.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.820+0000 7f23a1fae740 1 --2- 172.21.15.120:0/2055646705 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55808884eeb0 0x55808884dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:47.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.820+0000 7f23a1fae740 4 client.15018 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:18:47.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.820+0000 7f23a1fae740 1 -- 172.21.15.120:0/2055646705 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "status"}) -- 0x558088732b10 con 0x55808884eeb0 2024-09-19T05:18:47.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.820+0000 7f239d971640 1 --2- 172.21.15.120:0/2055646705 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55808884eeb0 0x55808884dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:47.847 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.821+0000 7f239d971640 1 --2- 172.21.15.120:0/2055646705 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55808884eeb0 0x55808884dbc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5df147d39f81a63e server_cookie=7bc58cc4de254726 in_seq=0 out_seq=0 2024-09-19T05:18:47.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.821+0000 7f23817fa640 10 client.15018 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:18:47.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.821+0000 7f23817fa640 1 -- 172.21.15.120:0/2055646705 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x558088732b10 con 0x55808884eeb0 2024-09-19T05:18:47.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.821+0000 7f23817fa640 10 client.15018 handle_command_reply: tid=0 2024-09-19T05:18:47.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.821+0000 7f23a1fae740 1 client.15018 shutdown 2024-09-19T05:18:47.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.821+0000 7f23a1fae740 1 -- 172.21.15.120:0/2055646705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c52f0 msgr2=0x5580887e3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:47.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.821+0000 7f23a1fae740 1 --2- 172.21.15.120:0/2055646705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c52f0 0x5580887e3340 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2388001eb0 tx=0x7f2388013690 comp rx=0 tx=0).stop 2024-09-19T05:18:47.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.821+0000 7f23a1fae740 1 -- 172.21.15.120:0/2055646705 shutdown_connections 2024-09-19T05:18:47.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.821+0000 7f23a1fae740 1 --2- 172.21.15.120:0/2055646705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5580887cfbb0 0x5580887e3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.821+0000 7f23a1fae740 1 --2- 172.21.15.120:0/2055646705 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5580887c52f0 0x5580887e3340 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.821+0000 7f23a1fae740 1 --2- 172.21.15.120:0/2055646705 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55808884eeb0 0x55808884dbc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.821+0000 7f23a1fae740 1 --2- 172.21.15.120:0/2055646705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5580887c49d0 0x5580887e2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.821+0000 7f23817fa640 0 client.15018 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:18:47.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.821+0000 7f23a1fae740 1 -- 172.21.15.120:0/2055646705 >> 172.21.15.120:0/2055646705 conn(0x5580887c0f60 msgr2=0x5580887cafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:47.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.821+0000 7f23a1fae740 1 -- 172.21.15.120:0/2055646705 shutdown_connections 2024-09-19T05:18:47.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.821+0000 7f23a1fae740 1 -- 172.21.15.120:0/2055646705 wait complete. 2024-09-19T05:18:47.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.821+0000 7f23a1fae740 20 client.15018 trim_cache size 0 max 16384 2024-09-19T05:18:47.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.822+0000 7f239fbd5640 1 -- 172.21.15.120:0/1290622293 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f23840a32d0 msgr2=0x7f23840a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:47.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.822+0000 7f239fbd5640 1 --2- 172.21.15.120:0/1290622293 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f23840a32d0 0x7f23840a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f239001f000 tx=0x7f2390018000 comp rx=0 tx=0).stop 2024-09-19T05:18:47.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.822+0000 7f239fbd5640 1 -- 172.21.15.120:0/1290622293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2398100b30 msgr2=0x7f23981a4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:47.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.822+0000 7f239fbd5640 1 --2- 172.21.15.120:0/1290622293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2398100b30 0x7f23981a4760 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2394006010 tx=0x7f2394004270 comp rx=0 tx=0).stop 2024-09-19T05:18:47.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.822+0000 7f239fbd5640 1 -- 172.21.15.120:0/1290622293 shutdown_connections 2024-09-19T05:18:47.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.822+0000 7f239fbd5640 1 --2- 172.21.15.120:0/1290622293 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f23840a32d0 0x7f23840a5790 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.822+0000 7f239fbd5640 1 --2- 172.21.15.120:0/1290622293 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2398105f40 0x7f239819e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.822+0000 7f239fbd5640 1 --2- 172.21.15.120:0/1290622293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2398101450 0x7f23981a4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.822+0000 7f239fbd5640 1 --2- 172.21.15.120:0/1290622293 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2398100b30 0x7f23981a4760 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:47.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.822+0000 7f239fbd5640 1 -- 172.21.15.120:0/1290622293 >> 172.21.15.120:0/1290622293 conn(0x7f23980fc7a0 msgr2=0x7f239810f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:47.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.822+0000 7f239fbd5640 1 -- 172.21.15.120:0/1290622293 shutdown_connections 2024-09-19T05:18:47.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:47.822+0000 7f239fbd5640 1 -- 172.21.15.120:0/1290622293 wait complete. 2024-09-19T05:18:48.531 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T05:18:48.531 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T05:18:48.586 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi120.front.sepia.ceph.com 2024-09-19T05:18:48.587 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T05:18:48.843 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:49.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.399+0000 7fd76003f640 1 -- 172.21.15.120:0/2694878340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd758102e00 msgr2=0x7fd758103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:49.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.399+0000 7fd76003f640 1 --2- 172.21.15.120:0/2694878340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd758102e00 0x7fd758103280 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd748009900 tx=0x7fd74802a410 comp rx=0 tx=0).stop 2024-09-19T05:18:49.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.399+0000 7fd76003f640 1 -- 172.21.15.120:0/2694878340 shutdown_connections 2024-09-19T05:18:49.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.399+0000 7fd76003f640 1 --2- 172.21.15.120:0/2694878340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7581037c0 0x7fd75810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:49.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.399+0000 7fd76003f640 1 --2- 172.21.15.120:0/2694878340 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd758102e00 0x7fd758103280 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:49.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.399+0000 7fd76003f640 1 --2- 172.21.15.120:0/2694878340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd758101c00 0x7fd758102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:49.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.399+0000 7fd76003f640 1 -- 172.21.15.120:0/2694878340 >> 172.21.15.120:0/2694878340 conn(0x7fd7580fd390 msgr2=0x7fd7580ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:49.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.399+0000 7fd76003f640 1 -- 172.21.15.120:0/2694878340 shutdown_connections 2024-09-19T05:18:49.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.399+0000 7fd76003f640 1 -- 172.21.15.120:0/2694878340 wait complete. 2024-09-19T05:18:49.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.400+0000 7fd76003f640 1 Processor -- start 2024-09-19T05:18:49.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.400+0000 7fd76003f640 1 -- start start 2024-09-19T05:18:49.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.400+0000 7fd76003f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd758101c00 0x7fd758075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:49.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.400+0000 7fd76003f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd758102e00 0x7fd7580745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:49.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.400+0000 7fd76003f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7581037c0 0x7fd758074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:49.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.400+0000 7fd76003f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd75810d830 con 0x7fd758101c00 2024-09-19T05:18:49.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.400+0000 7fd76003f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd75810d6b0 con 0x7fd7581037c0 2024-09-19T05:18:49.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.400+0000 7fd76003f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd75810d9b0 con 0x7fd758102e00 2024-09-19T05:18:49.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.400+0000 7fd75dddb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd758101c00 0x7fd758075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:49.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.400+0000 7fd75dddb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd758101c00 0x7fd758075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58488/0 (socket says 172.21.15.120:58488) 2024-09-19T05:18:49.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.400+0000 7fd75dddb640 1 -- 172.21.15.120:0/2229166351 learned_addr learned my addr 172.21.15.120:0/2229166351 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:49.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.400+0000 7fd75d5da640 1 --2- 172.21.15.120:0/2229166351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd758102e00 0x7fd7580745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:49.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.400+0000 7fd75e5dc640 1 --2- 172.21.15.120:0/2229166351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7581037c0 0x7fd758074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:49.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.400+0000 7fd75dddb640 1 -- 172.21.15.120:0/2229166351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd758102e00 msgr2=0x7fd7580745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:49.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.400+0000 7fd75dddb640 1 --2- 172.21.15.120:0/2229166351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd758102e00 0x7fd7580745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:49.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.400+0000 7fd75dddb640 1 -- 172.21.15.120:0/2229166351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7581037c0 msgr2=0x7fd758074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:49.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.400+0000 7fd75dddb640 1 --2- 172.21.15.120:0/2229166351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7581037c0 0x7fd758074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:49.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.400+0000 7fd75dddb640 1 -- 172.21.15.120:0/2229166351 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7580753e0 con 0x7fd758101c00 2024-09-19T05:18:49.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.400+0000 7fd75e5dc640 1 --2- 172.21.15.120:0/2229166351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7581037c0 0x7fd758074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:49.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.401+0000 7fd75dddb640 1 --2- 172.21.15.120:0/2229166351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd758101c00 0x7fd758075f90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd75400b450 tx=0x7fd75400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:49.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.401+0000 7fd74effd640 1 -- 172.21.15.120:0/2229166351 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754015020 con 0x7fd758101c00 2024-09-19T05:18:49.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.401+0000 7fd74effd640 1 -- 172.21.15.120:0/2229166351 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd754011d40 con 0x7fd758101c00 2024-09-19T05:18:49.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.401+0000 7fd76003f640 1 -- 172.21.15.120:0/2229166351 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7581a2100 con 0x7fd758101c00 2024-09-19T05:18:49.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.401+0000 7fd74effd640 1 -- 172.21.15.120:0/2229166351 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75400f340 con 0x7fd758101c00 2024-09-19T05:18:49.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.401+0000 7fd76003f640 1 -- 172.21.15.120:0/2229166351 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7581a2690 con 0x7fd758101c00 2024-09-19T05:18:49.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.402+0000 7fd76003f640 1 -- 172.21.15.120:0/2229166351 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7581090f0 con 0x7fd758101c00 2024-09-19T05:18:49.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.403+0000 7fd74effd640 1 -- 172.21.15.120:0/2229166351 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fd754018020 con 0x7fd758101c00 2024-09-19T05:18:49.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.404+0000 7fd74effd640 1 --2- 172.21.15.120:0/2229166351 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd7440a32d0 0x7fd7440a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:49.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.404+0000 7fd75d5da640 1 --2- 172.21.15.120:0/2229166351 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd7440a32d0 0x7fd7440a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:49.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.404+0000 7fd74effd640 1 -- 172.21.15.120:0/2229166351 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8298+0+0 (secure 0 0 0) 0x7fd7540cf4f0 con 0x7fd758101c00 2024-09-19T05:18:49.409 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.404+0000 7fd75d5da640 1 --2- 172.21.15.120:0/2229166351 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd7440a32d0 0x7fd7440a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd74802a930 tx=0x7fd748000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:49.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.408+0000 7fd74effd640 1 -- 172.21.15.120:0/2229166351 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd75401f020 con 0x7fd758101c00 2024-09-19T05:18:49.569 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:49 smithi120 ceph-mon[30956]: pgmap v312: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T05:18:49.569 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:49 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-19T05:18:49.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.593+0000 7fd76003f640 1 -- 172.21.15.120:0/2229166351 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fd758062630 con 0x7fd7440a32d0 2024-09-19T05:18:49.596 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.595+0000 7fd74effd640 1 -- 172.21.15.120:0/2229166351 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fd758062630 con 0x7fd7440a32d0 2024-09-19T05:18:49.596 INFO:teuthology.orchestra.run.smithi120.stdout:Backend: cephadm 2024-09-19T05:18:49.597 INFO:teuthology.orchestra.run.smithi120.stdout:Available: Yes 2024-09-19T05:18:49.597 INFO:teuthology.orchestra.run.smithi120.stdout:Paused: No 2024-09-19T05:18:49.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.597+0000 7fd76003f640 1 -- 172.21.15.120:0/2229166351 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd7440a32d0 msgr2=0x7fd7440a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:49.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.597+0000 7fd76003f640 1 --2- 172.21.15.120:0/2229166351 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd7440a32d0 0x7fd7440a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd74802a930 tx=0x7fd748000bc0 comp rx=0 tx=0).stop 2024-09-19T05:18:49.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.597+0000 7fd76003f640 1 -- 172.21.15.120:0/2229166351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd758101c00 msgr2=0x7fd758075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:49.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.597+0000 7fd76003f640 1 --2- 172.21.15.120:0/2229166351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd758101c00 0x7fd758075f90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd75400b450 tx=0x7fd75400b910 comp rx=0 tx=0).stop 2024-09-19T05:18:49.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.597+0000 7fd76003f640 1 -- 172.21.15.120:0/2229166351 shutdown_connections 2024-09-19T05:18:49.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.597+0000 7fd76003f640 1 --2- 172.21.15.120:0/2229166351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7581037c0 0x7fd758074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:49.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.597+0000 7fd76003f640 1 --2- 172.21.15.120:0/2229166351 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd7440a32d0 0x7fd7440a5790 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:49.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.597+0000 7fd76003f640 1 --2- 172.21.15.120:0/2229166351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd758102e00 0x7fd7580745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:49.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.597+0000 7fd76003f640 1 --2- 172.21.15.120:0/2229166351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd758101c00 0x7fd758075f90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:49.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.597+0000 7fd76003f640 1 -- 172.21.15.120:0/2229166351 >> 172.21.15.120:0/2229166351 conn(0x7fd7580fd390 msgr2=0x7fd7581062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:49.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.597+0000 7fd76003f640 1 -- 172.21.15.120:0/2229166351 shutdown_connections 2024-09-19T05:18:49.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:49.597+0000 7fd76003f640 1 -- 172.21.15.120:0/2229166351 wait complete. 2024-09-19T05:18:49.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:49 smithi194 ceph-mon[35228]: pgmap v312: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T05:18:49.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:49 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-19T05:18:49.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:49 smithi178 ceph-mon[34347]: pgmap v312: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T05:18:49.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:49 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-19T05:18:50.247 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T05:18:50.495 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:50.616 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:50 smithi120 ceph-mon[30956]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-19T05:18:50.616 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:50 smithi120 ceph-mon[30956]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T05:18:50.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:50 smithi194 ceph-mon[35228]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-19T05:18:50.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:50 smithi194 ceph-mon[35228]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T05:18:50.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:50 smithi178 ceph-mon[34347]: from='mgr.14150 172.21.15.120:0/3151099181' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-19T05:18:50.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:50 smithi178 ceph-mon[34347]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T05:18:50.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.955+0000 7f596d1a2640 1 -- 172.21.15.120:0/2560542449 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5968104e10 msgr2=0x7f5968107200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:50.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.955+0000 7f596d1a2640 1 --2- 172.21.15.120:0/2560542449 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5968104e10 0x7f5968107200 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f595c009900 tx=0x7f595c02a410 comp rx=0 tx=0).stop 2024-09-19T05:18:50.977 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.955+0000 7f596d1a2640 1 -- 172.21.15.120:0/2560542449 shutdown_connections 2024-09-19T05:18:50.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.955+0000 7f596d1a2640 1 --2- 172.21.15.120:0/2560542449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5968107740 0x7f5968109b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:50.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.955+0000 7f596d1a2640 1 --2- 172.21.15.120:0/2560542449 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5968104e10 0x7f5968107200 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:50.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.955+0000 7f596d1a2640 1 --2- 172.21.15.120:0/2560542449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59681024e0 0x7f59681048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:50.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.955+0000 7f596d1a2640 1 -- 172.21.15.120:0/2560542449 >> 172.21.15.120:0/2560542449 conn(0x7f59680fc0e0 msgr2=0x7f59680fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:50.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.955+0000 7f596d1a2640 1 -- 172.21.15.120:0/2560542449 shutdown_connections 2024-09-19T05:18:50.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.955+0000 7f596d1a2640 1 -- 172.21.15.120:0/2560542449 wait complete. 2024-09-19T05:18:50.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.956+0000 7f596d1a2640 1 Processor -- start 2024-09-19T05:18:50.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.956+0000 7f596d1a2640 1 -- start start 2024-09-19T05:18:50.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.956+0000 7f596d1a2640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59681024e0 0x7f5968101e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:50.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.956+0000 7f596d1a2640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5968104e10 0x7f5968100490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:50.978 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.956+0000 7f596d1a2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5968107740 0x7f59681009d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:50.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.956+0000 7f596d1a2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f596810d5f0 con 0x7f5968107740 2024-09-19T05:18:50.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.956+0000 7f596d1a2640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f596810d470 con 0x7f59681024e0 2024-09-19T05:18:50.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.956+0000 7f596d1a2640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f596810d770 con 0x7f5968104e10 2024-09-19T05:18:50.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.956+0000 7f596c9a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5968107740 0x7f59681009d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:50.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.956+0000 7f596c9a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5968107740 0x7f59681009d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58520/0 (socket says 172.21.15.120:58520) 2024-09-19T05:18:50.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.956+0000 7f596c9a1640 1 -- 172.21.15.120:0/4088569367 learned_addr learned my addr 172.21.15.120:0/4088569367 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:50.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.956+0000 7f59677fe640 1 --2- 172.21.15.120:0/4088569367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5968104e10 0x7f5968100490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:50.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.956+0000 7f5967fff640 1 --2- 172.21.15.120:0/4088569367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59681024e0 0x7f5968101e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:50.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.956+0000 7f596c9a1640 1 -- 172.21.15.120:0/4088569367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5968104e10 msgr2=0x7f5968100490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:50.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.956+0000 7f596c9a1640 1 --2- 172.21.15.120:0/4088569367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5968104e10 0x7f5968100490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:50.979 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.956+0000 7f596c9a1640 1 -- 172.21.15.120:0/4088569367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59681024e0 msgr2=0x7f5968101e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:50.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.956+0000 7f596c9a1640 1 --2- 172.21.15.120:0/4088569367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59681024e0 0x7f5968101e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:50.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.956+0000 7f596c9a1640 1 -- 172.21.15.120:0/4088569367 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5968101290 con 0x7f5968107740 2024-09-19T05:18:50.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.956+0000 7f5967fff640 1 --2- 172.21.15.120:0/4088569367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59681024e0 0x7f5968101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:50.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.957+0000 7f596c9a1640 1 --2- 172.21.15.120:0/4088569367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5968107740 0x7f59681009d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f596000cce0 tx=0x7f596000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:50.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.957+0000 7f59657fa640 1 -- 172.21.15.120:0/4088569367 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596000f450 con 0x7f5968107740 2024-09-19T05:18:50.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.957+0000 7f59657fa640 1 -- 172.21.15.120:0/4088569367 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f596000faa0 con 0x7f5968107740 2024-09-19T05:18:50.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.957+0000 7f596d1a2640 1 -- 172.21.15.120:0/4088569367 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59681a1e70 con 0x7f5968107740 2024-09-19T05:18:50.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.957+0000 7f59657fa640 1 -- 172.21.15.120:0/4088569367 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5960018b70 con 0x7f5968107740 2024-09-19T05:18:50.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.957+0000 7f596d1a2640 1 -- 172.21.15.120:0/4088569367 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59681a2350 con 0x7f5968107740 2024-09-19T05:18:50.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.958+0000 7f596d1a2640 1 -- 172.21.15.120:0/4088569367 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59680fdbd0 con 0x7f5968107740 2024-09-19T05:18:50.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.959+0000 7f59657fa640 1 -- 172.21.15.120:0/4088569367 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f5960018d10 con 0x7f5968107740 2024-09-19T05:18:50.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.959+0000 7f59657fa640 1 --2- 172.21.15.120:0/4088569367 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f59500a32d0 0x7f59500a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:50.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.960+0000 7f5967fff640 1 --2- 172.21.15.120:0/4088569367 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f59500a32d0 0x7f59500a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:50.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.960+0000 7f59657fa640 1 -- 172.21.15.120:0/4088569367 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8298+0+0 (secure 0 0 0) 0x7f59600cff30 con 0x7f5968107740 2024-09-19T05:18:50.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.960+0000 7f5967fff640 1 --2- 172.21.15.120:0/4088569367 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f59500a32d0 0x7f59500a5790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5958006fd0 tx=0x7f5958008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:50.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:50.964+0000 7f59657fa640 1 -- 172.21.15.120:0/4088569367 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5960014030 con 0x7f5968107740 2024-09-19T05:18:51.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:51.139+0000 7f596d1a2640 1 -- 172.21.15.120:0/4088569367 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5968062630 con 0x7f59500a32d0 2024-09-19T05:18:51.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:51.151+0000 7f59657fa640 1 -- 172.21.15.120:0/4088569367 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f5968062630 con 0x7f59500a32d0 2024-09-19T05:18:51.153 INFO:teuthology.orchestra.run.smithi120.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T05:18:51.153 INFO:teuthology.orchestra.run.smithi120.stdout:mds.a smithi120 running (93s) 17s ago 92s 14.0M - 19.1.1-361-g2f599a46 d2baa855c067 e341cc103103 2024-09-19T05:18:51.153 INFO:teuthology.orchestra.run.smithi120.stdout:mds.b smithi178 running (90s) 22s ago 90s 20.1M - 19.1.1-361-g2f599a46 d2baa855c067 7e1e4df1a12d 2024-09-19T05:18:51.153 INFO:teuthology.orchestra.run.smithi120.stdout:mds.c smithi194 running (104s) 22s ago 104s 17.8M - 19.1.1-361-g2f599a46 d2baa855c067 c2b87ad7e167 2024-09-19T05:18:51.153 INFO:teuthology.orchestra.run.smithi120.stdout:mds.d smithi120 running (111s) 17s ago 111s 13.5M - 19.1.1-361-g2f599a46 d2baa855c067 d255bfc1aa02 2024-09-19T05:18:51.153 INFO:teuthology.orchestra.run.smithi120.stdout:mds.e smithi178 running (109s) 22s ago 108s 18.5M - 19.1.1-361-g2f599a46 d2baa855c067 55528f7ef26f 2024-09-19T05:18:51.153 INFO:teuthology.orchestra.run.smithi120.stdout:mds.f smithi194 running (106s) 22s ago 106s 18.2M - 19.1.1-361-g2f599a46 d2baa855c067 364681e2b771 2024-09-19T05:18:51.153 INFO:teuthology.orchestra.run.smithi120.stdout:mds.g smithi120 running (96s) 17s ago 96s 14.4M - 19.1.1-361-g2f599a46 d2baa855c067 7ef4a9e45083 2024-09-19T05:18:51.153 INFO:teuthology.orchestra.run.smithi120.stdout:mds.h smithi178 running (101s) 22s ago 101s 18.4M - 19.1.1-361-g2f599a46 d2baa855c067 068f7e61a423 2024-09-19T05:18:51.153 INFO:teuthology.orchestra.run.smithi120.stdout:mds.i smithi194 running (99s) 22s ago 99s 26.6M - 19.1.1-361-g2f599a46 d2baa855c067 c87510e3837e 2024-09-19T05:18:51.153 INFO:teuthology.orchestra.run.smithi120.stdout:mds.j smithi120 running (115s) 17s ago 114s 13.4M - 19.1.1-361-g2f599a46 d2baa855c067 47518e55f388 2024-09-19T05:18:51.154 INFO:teuthology.orchestra.run.smithi120.stdout:mds.k smithi178 running (118s) 22s ago 118s 15.9M - 19.1.1-361-g2f599a46 d2baa855c067 dd4e17833d8b 2024-09-19T05:18:51.154 INFO:teuthology.orchestra.run.smithi120.stdout:mds.l smithi194 running (2m) 22s ago 2m 16.7M - 19.1.1-361-g2f599a46 d2baa855c067 43f3dcfea02e 2024-09-19T05:18:51.154 INFO:teuthology.orchestra.run.smithi120.stdout:mgr.x smithi120 *:9283,8765 running (8m) 17s ago 8m 508M - 19.1.1-361-g2f599a46 d2baa855c067 63d3454a719e 2024-09-19T05:18:51.154 INFO:teuthology.orchestra.run.smithi120.stdout:mgr.y smithi178 *:8443,8765 running (7m) 22s ago 7m 445M - 19.1.1-361-g2f599a46 d2baa855c067 6a555ecaf92f 2024-09-19T05:18:51.154 INFO:teuthology.orchestra.run.smithi120.stdout:mgr.z smithi194 *:8443,8765 running (7m) 22s ago 7m 441M - 19.1.1-361-g2f599a46 d2baa855c067 8c600a6ee54e 2024-09-19T05:18:51.154 INFO:teuthology.orchestra.run.smithi120.stdout:mon.a smithi120 running (8m) 17s ago 8m 53.1M 2048M 19.1.1-361-g2f599a46 d2baa855c067 a28e9bf433a0 2024-09-19T05:18:51.154 INFO:teuthology.orchestra.run.smithi120.stdout:mon.b smithi178 running (7m) 22s ago 7m 40.4M 2048M 19.1.1-361-g2f599a46 d2baa855c067 8be05c7017ea 2024-09-19T05:18:51.154 INFO:teuthology.orchestra.run.smithi120.stdout:mon.c smithi194 running (7m) 22s ago 7m 39.7M 2048M 19.1.1-361-g2f599a46 d2baa855c067 f72c2601b83f 2024-09-19T05:18:51.154 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0 smithi120 running (6m) 17s ago 6m 56.2M 4272M 19.1.1-361-g2f599a46 d2baa855c067 f116ef2b774b 2024-09-19T05:18:51.154 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1 smithi178 running (6m) 22s ago 6m 49.5M 4272M 19.1.1-361-g2f599a46 d2baa855c067 b1cf96166e46 2024-09-19T05:18:51.154 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2 smithi194 running (6m) 22s ago 5m 55.3M 4272M 19.1.1-361-g2f599a46 d2baa855c067 1802400ad3f8 2024-09-19T05:18:51.154 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3 smithi120 running (5m) 17s ago 5m 55.1M 4272M 19.1.1-361-g2f599a46 d2baa855c067 533663586ee2 2024-09-19T05:18:51.154 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4 smithi178 running (5m) 22s ago 5m 45.9M 4272M 19.1.1-361-g2f599a46 d2baa855c067 935fc8d5bf3a 2024-09-19T05:18:51.155 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5 smithi194 running (4m) 22s ago 4m 54.5M 4272M 19.1.1-361-g2f599a46 d2baa855c067 50c87fa44d63 2024-09-19T05:18:51.155 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6 smithi120 running (4m) 17s ago 4m 49.2M 4272M 19.1.1-361-g2f599a46 d2baa855c067 e37d4f8a9368 2024-09-19T05:18:51.155 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7 smithi178 running (3m) 22s ago 3m 47.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 70f8373f693f 2024-09-19T05:18:51.155 INFO:teuthology.orchestra.run.smithi120.stdout:osd.8 smithi194 running (3m) 22s ago 3m 53.1M 4272M 19.1.1-361-g2f599a46 d2baa855c067 ab66dd758acb 2024-09-19T05:18:51.155 INFO:teuthology.orchestra.run.smithi120.stdout:osd.9 smithi120 running (3m) 17s ago 3m 54.1M 4272M 19.1.1-361-g2f599a46 d2baa855c067 3136ecb318b9 2024-09-19T05:18:51.155 INFO:teuthology.orchestra.run.smithi120.stdout:osd.10 smithi178 running (2m) 22s ago 2m 53.7M 4272M 19.1.1-361-g2f599a46 d2baa855c067 69577b5eb050 2024-09-19T05:18:51.155 INFO:teuthology.orchestra.run.smithi120.stdout:osd.11 smithi194 running (2m) 22s ago 2m 50.5M 4272M 19.1.1-361-g2f599a46 d2baa855c067 db651754b57d 2024-09-19T05:18:51.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:51.153+0000 7f596d1a2640 1 -- 172.21.15.120:0/4088569367 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f59500a32d0 msgr2=0x7f59500a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:51.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:51.153+0000 7f596d1a2640 1 --2- 172.21.15.120:0/4088569367 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f59500a32d0 0x7f59500a5790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5958006fd0 tx=0x7f5958008040 comp rx=0 tx=0).stop 2024-09-19T05:18:51.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:51.153+0000 7f596d1a2640 1 -- 172.21.15.120:0/4088569367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5968107740 msgr2=0x7f59681009d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:51.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:51.153+0000 7f596d1a2640 1 --2- 172.21.15.120:0/4088569367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5968107740 0x7f59681009d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f596000cce0 tx=0x7f596000a620 comp rx=0 tx=0).stop 2024-09-19T05:18:51.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:51.153+0000 7f596d1a2640 1 -- 172.21.15.120:0/4088569367 shutdown_connections 2024-09-19T05:18:51.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:51.153+0000 7f596d1a2640 1 --2- 172.21.15.120:0/4088569367 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5968107740 0x7f59681009d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:51.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:51.153+0000 7f596d1a2640 1 --2- 172.21.15.120:0/4088569367 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f59500a32d0 0x7f59500a5790 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:51.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:51.153+0000 7f596d1a2640 1 --2- 172.21.15.120:0/4088569367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5968104e10 0x7f5968100490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:51.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:51.153+0000 7f596d1a2640 1 --2- 172.21.15.120:0/4088569367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59681024e0 0x7f5968101e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:51.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:51.153+0000 7f596d1a2640 1 -- 172.21.15.120:0/4088569367 >> 172.21.15.120:0/4088569367 conn(0x7f59680fc0e0 msgr2=0x7f5968102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:51.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:51.153+0000 7f596d1a2640 1 -- 172.21.15.120:0/4088569367 shutdown_connections 2024-09-19T05:18:51.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:51.153+0000 7f596d1a2640 1 -- 172.21.15.120:0/4088569367 wait complete. 2024-09-19T05:18:51.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:51 smithi120 ceph-mon[30956]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:18:51.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:51 smithi120 ceph-mon[30956]: pgmap v314: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T05:18:51.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:51 smithi120 ceph-mon[30956]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T05:18:51.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:51 smithi194 ceph-mon[35228]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:18:51.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:51 smithi194 ceph-mon[35228]: pgmap v314: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T05:18:51.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:51 smithi194 ceph-mon[35228]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T05:18:51.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:51 smithi178 ceph-mon[34347]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:18:51.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:51 smithi178 ceph-mon[34347]: pgmap v314: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T05:18:51.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:51 smithi178 ceph-mon[34347]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T05:18:51.860 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T05:18:52.105 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:52.526 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:52 smithi120 ceph-mon[30956]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:18:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.603+0000 7fcd9fd49640 1 -- 172.21.15.120:0/747795733 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd980fff10 msgr2=0x7fcd98100310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.604+0000 7fcd9fd49640 1 --2- 172.21.15.120:0/747795733 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd980fff10 0x7fcd98100310 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcd88009cd0 tx=0x7fcd8802a8e0 comp rx=0 tx=0).stop 2024-09-19T05:18:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.604+0000 7fcd9fd49640 1 -- 172.21.15.120:0/747795733 shutdown_connections 2024-09-19T05:18:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.604+0000 7fcd9fd49640 1 --2- 172.21.15.120:0/747795733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd981038b0 0x7fcd9810a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.604+0000 7fcd9fd49640 1 --2- 172.21.15.120:0/747795733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd98102ef0 0x7fcd98103370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.604+0000 7fcd9fd49640 1 --2- 172.21.15.120:0/747795733 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd980fff10 0x7fcd98100310 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.604+0000 7fcd9fd49640 1 -- 172.21.15.120:0/747795733 >> 172.21.15.120:0/747795733 conn(0x7fcd980fba80 msgr2=0x7fcd980fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.604+0000 7fcd9fd49640 1 -- 172.21.15.120:0/747795733 shutdown_connections 2024-09-19T05:18:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.604+0000 7fcd9fd49640 1 -- 172.21.15.120:0/747795733 wait complete. 2024-09-19T05:18:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.604+0000 7fcd9fd49640 1 Processor -- start 2024-09-19T05:18:52.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.604+0000 7fcd9fd49640 1 -- start start 2024-09-19T05:18:52.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.604+0000 7fcd9fd49640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd980fff10 0x7fcd98199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:52.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.604+0000 7fcd9fd49640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd98102ef0 0x7fcd9819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:52.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.604+0000 7fcd9fd49640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd981038b0 0x7fcd981a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:52.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.604+0000 7fcd9fd49640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9810d710 con 0x7fcd98102ef0 2024-09-19T05:18:52.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.604+0000 7fcd9fd49640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9810d590 con 0x7fcd980fff10 2024-09-19T05:18:52.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.604+0000 7fcd9fd49640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9810d890 con 0x7fcd981038b0 2024-09-19T05:18:52.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.605+0000 7fcd9d2e4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd98102ef0 0x7fcd9819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:52.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.605+0000 7fcd9d2e4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd98102ef0 0x7fcd9819a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58530/0 (socket says 172.21.15.120:58530) 2024-09-19T05:18:52.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.605+0000 7fcd9d2e4640 1 -- 172.21.15.120:0/410301522 learned_addr learned my addr 172.21.15.120:0/410301522 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:52.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.605+0000 7fcd9e2e6640 1 --2- 172.21.15.120:0/410301522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd981038b0 0x7fcd981a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:52.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.605+0000 7fcd9dae5640 1 --2- 172.21.15.120:0/410301522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd980fff10 0x7fcd98199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:52.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.605+0000 7fcd9d2e4640 1 -- 172.21.15.120:0/410301522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd981038b0 msgr2=0x7fcd981a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:52.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.605+0000 7fcd9d2e4640 1 --2- 172.21.15.120:0/410301522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd981038b0 0x7fcd981a1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:52.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.605+0000 7fcd9d2e4640 1 -- 172.21.15.120:0/410301522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd980fff10 msgr2=0x7fcd98199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:52.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.605+0000 7fcd9d2e4640 1 --2- 172.21.15.120:0/410301522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd980fff10 0x7fcd98199fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:52.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.605+0000 7fcd9d2e4640 1 -- 172.21.15.120:0/410301522 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd981a1be0 con 0x7fcd98102ef0 2024-09-19T05:18:52.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.605+0000 7fcd9e2e6640 1 --2- 172.21.15.120:0/410301522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd981038b0 0x7fcd981a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:18:52.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.605+0000 7fcd9d2e4640 1 --2- 172.21.15.120:0/410301522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd98102ef0 0x7fcd9819a4f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c00c920 tx=0x7fcd8c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:52.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.605+0000 7fcd96ffd640 1 -- 172.21.15.120:0/410301522 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c007c70 con 0x7fcd98102ef0 2024-09-19T05:18:52.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.605+0000 7fcd96ffd640 1 -- 172.21.15.120:0/410301522 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcd8c007e10 con 0x7fcd98102ef0 2024-09-19T05:18:52.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.605+0000 7fcd9fd49640 1 -- 172.21.15.120:0/410301522 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd981a1ed0 con 0x7fcd98102ef0 2024-09-19T05:18:52.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.605+0000 7fcd96ffd640 1 -- 172.21.15.120:0/410301522 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c018820 con 0x7fcd98102ef0 2024-09-19T05:18:52.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.605+0000 7fcd9fd49640 1 -- 172.21.15.120:0/410301522 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd981a2380 con 0x7fcd98102ef0 2024-09-19T05:18:52.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.606+0000 7fcd9fd49640 1 -- 172.21.15.120:0/410301522 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd981a2610 con 0x7fcd98102ef0 2024-09-19T05:18:52.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.608+0000 7fcd96ffd640 1 -- 172.21.15.120:0/410301522 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fcd8c0189c0 con 0x7fcd98102ef0 2024-09-19T05:18:52.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.609+0000 7fcd96ffd640 1 --2- 172.21.15.120:0/410301522 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fcd800a3300 0x7fcd800a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:52.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.609+0000 7fcd9dae5640 1 --2- 172.21.15.120:0/410301522 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fcd800a3300 0x7fcd800a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:52.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.609+0000 7fcd96ffd640 1 -- 172.21.15.120:0/410301522 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8298+0+0 (secure 0 0 0) 0x7fcd8c0cff10 con 0x7fcd98102ef0 2024-09-19T05:18:52.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.609+0000 7fcd9dae5640 1 --2- 172.21.15.120:0/410301522 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fcd800a3300 0x7fcd800a57c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcd88006010 tx=0x7fcd88000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:52.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.612+0000 7fcd96ffd640 1 -- 172.21.15.120:0/410301522 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcd8c014030 con 0x7fcd98102ef0 2024-09-19T05:18:52.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:52 smithi194 ceph-mon[35228]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:18:52.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:52 smithi178 ceph-mon[34347]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:18:52.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.787+0000 7fcd9fd49640 1 -- 172.21.15.120:0/410301522 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fcd981a27e0 con 0x7fcd800a3300 2024-09-19T05:18:52.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.792+0000 7fcd96ffd640 1 -- 172.21.15.120:0/410301522 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fcd981a27e0 con 0x7fcd800a3300 2024-09-19T05:18:52.794 INFO:teuthology.orchestra.run.smithi120.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T05:18:52.794 INFO:teuthology.orchestra.run.smithi120.stdout:mds.all 12/12 24s ago 2m smithi120=a;smithi120=d;smithi120=g;smithi120=j;smithi178=b;smithi178=e;smithi178=h;smithi178=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l;count:12 2024-09-19T05:18:52.794 INFO:teuthology.orchestra.run.smithi120.stdout:mgr 3/3 24s ago 7m smithi120=x;smithi178=y;smithi194=z;count:3 2024-09-19T05:18:52.794 INFO:teuthology.orchestra.run.smithi120.stdout:mon 3/3 24s ago 7m smithi120:172.21.15.120=a;smithi178:172.21.15.178=b;smithi194:172.21.15.194=c;count:3 2024-09-19T05:18:52.794 INFO:teuthology.orchestra.run.smithi120.stdout:osd 12 24s ago - 2024-09-19T05:18:52.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.794+0000 7fcd9fd49640 1 -- 172.21.15.120:0/410301522 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fcd800a3300 msgr2=0x7fcd800a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:52.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.794+0000 7fcd9fd49640 1 --2- 172.21.15.120:0/410301522 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fcd800a3300 0x7fcd800a57c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcd88006010 tx=0x7fcd88000f40 comp rx=0 tx=0).stop 2024-09-19T05:18:52.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.795+0000 7fcd9fd49640 1 -- 172.21.15.120:0/410301522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd98102ef0 msgr2=0x7fcd9819a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:52.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.795+0000 7fcd9fd49640 1 --2- 172.21.15.120:0/410301522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd98102ef0 0x7fcd9819a4f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c00c920 tx=0x7fcd8c00cde0 comp rx=0 tx=0).stop 2024-09-19T05:18:52.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.795+0000 7fcd9fd49640 1 -- 172.21.15.120:0/410301522 shutdown_connections 2024-09-19T05:18:52.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.795+0000 7fcd9fd49640 1 --2- 172.21.15.120:0/410301522 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fcd800a3300 0x7fcd800a57c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:52.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.795+0000 7fcd9fd49640 1 --2- 172.21.15.120:0/410301522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd981038b0 0x7fcd981a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:52.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.795+0000 7fcd9fd49640 1 --2- 172.21.15.120:0/410301522 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcd98102ef0 0x7fcd9819a4f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:52.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.795+0000 7fcd9fd49640 1 --2- 172.21.15.120:0/410301522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd980fff10 0x7fcd98199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:52.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.795+0000 7fcd9fd49640 1 -- 172.21.15.120:0/410301522 >> 172.21.15.120:0/410301522 conn(0x7fcd980fba80 msgr2=0x7fcd981086c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:52.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.795+0000 7fcd9fd49640 1 -- 172.21.15.120:0/410301522 shutdown_connections 2024-09-19T05:18:52.798 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:52.795+0000 7fcd9fd49640 1 -- 172.21.15.120:0/410301522 wait complete. 2024-09-19T05:18:53.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:53 smithi120 ceph-mon[30956]: pgmap v316: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T05:18:53.434 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T05:18:53.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:53 smithi194 ceph-mon[35228]: pgmap v316: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T05:18:53.679 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:53.691 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:53 smithi178 ceph-mon[34347]: pgmap v316: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T05:18:54.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.085+0000 7f9a77ca3640 1 -- 172.21.15.120:0/4214675566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a70102660 msgr2=0x7f9a70104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:54.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.085+0000 7f9a77ca3640 1 --2- 172.21.15.120:0/4214675566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a70102660 0x7f9a70104a50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c009900 tx=0x7f9a6c02a410 comp rx=0 tx=0).stop 2024-09-19T05:18:54.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.085+0000 7f9a77ca3640 1 -- 172.21.15.120:0/4214675566 shutdown_connections 2024-09-19T05:18:54.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.085+0000 7f9a77ca3640 1 --2- 172.21.15.120:0/4214675566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a701078c0 0x7f9a70109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:54.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.085+0000 7f9a77ca3640 1 --2- 172.21.15.120:0/4214675566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a70104f90 0x7f9a70107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:54.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.085+0000 7f9a77ca3640 1 --2- 172.21.15.120:0/4214675566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a70102660 0x7f9a70104a50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:54.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.085+0000 7f9a77ca3640 1 -- 172.21.15.120:0/4214675566 >> 172.21.15.120:0/4214675566 conn(0x7f9a700fc280 msgr2=0x7f9a700fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:54.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.086+0000 7f9a77ca3640 1 -- 172.21.15.120:0/4214675566 shutdown_connections 2024-09-19T05:18:54.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.086+0000 7f9a77ca3640 1 -- 172.21.15.120:0/4214675566 wait complete. 2024-09-19T05:18:54.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.086+0000 7f9a77ca3640 1 Processor -- start 2024-09-19T05:18:54.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.086+0000 7f9a77ca3640 1 -- start start 2024-09-19T05:18:54.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.086+0000 7f9a77ca3640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a70102660 0x7f9a70197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:54.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.086+0000 7f9a77ca3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a70104f90 0x7f9a70198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:54.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.086+0000 7f9a77ca3640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a701078c0 0x7f9a7019f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:54.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.086+0000 7f9a77ca3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7010d790 con 0x7f9a70104f90 2024-09-19T05:18:54.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.086+0000 7f9a77ca3640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7010d610 con 0x7f9a701078c0 2024-09-19T05:18:54.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.086+0000 7f9a77ca3640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7010d910 con 0x7f9a70102660 2024-09-19T05:18:54.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.086+0000 7f9a7523e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a70104f90 0x7f9a70198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:54.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.086+0000 7f9a7523e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a70104f90 0x7f9a70198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58550/0 (socket says 172.21.15.120:58550) 2024-09-19T05:18:54.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.087+0000 7f9a7523e640 1 -- 172.21.15.120:0/3663020365 learned_addr learned my addr 172.21.15.120:0/3663020365 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:54.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.087+0000 7f9a76240640 1 --2- 172.21.15.120:0/3663020365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a701078c0 0x7f9a7019f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:54.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.087+0000 7f9a75a3f640 1 --2- 172.21.15.120:0/3663020365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a70102660 0x7f9a70197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:54.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.087+0000 7f9a7523e640 1 -- 172.21.15.120:0/3663020365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a70102660 msgr2=0x7f9a70197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:54.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.087+0000 7f9a7523e640 1 --2- 172.21.15.120:0/3663020365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a70102660 0x7f9a70197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:54.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.087+0000 7f9a7523e640 1 -- 172.21.15.120:0/3663020365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a701078c0 msgr2=0x7f9a7019f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:54.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.087+0000 7f9a7523e640 1 --2- 172.21.15.120:0/3663020365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a701078c0 0x7f9a7019f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:54.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.087+0000 7f9a7523e640 1 -- 172.21.15.120:0/3663020365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7019fa70 con 0x7f9a70104f90 2024-09-19T05:18:54.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.087+0000 7f9a75a3f640 1 --2- 172.21.15.120:0/3663020365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a70102660 0x7f9a70197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:18:54.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.087+0000 7f9a7523e640 1 --2- 172.21.15.120:0/3663020365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a70104f90 0x7f9a70198380 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000b450 tx=0x7f9a6000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:54.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.087+0000 7f9a66ffd640 1 -- 172.21.15.120:0/3663020365 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a60015020 con 0x7f9a70104f90 2024-09-19T05:18:54.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.087+0000 7f9a66ffd640 1 -- 172.21.15.120:0/3663020365 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9a60011d40 con 0x7f9a70104f90 2024-09-19T05:18:54.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.087+0000 7f9a77ca3640 1 -- 172.21.15.120:0/3663020365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a7019fd60 con 0x7f9a70104f90 2024-09-19T05:18:54.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.087+0000 7f9a66ffd640 1 -- 172.21.15.120:0/3663020365 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6000f340 con 0x7f9a70104f90 2024-09-19T05:18:54.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.087+0000 7f9a77ca3640 1 -- 172.21.15.120:0/3663020365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a701a02c0 con 0x7f9a70104f90 2024-09-19T05:18:54.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.088+0000 7f9a77ca3640 1 -- 172.21.15.120:0/3663020365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a700fdd70 con 0x7f9a70104f90 2024-09-19T05:18:54.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.089+0000 7f9a66ffd640 1 -- 172.21.15.120:0/3663020365 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f9a60018020 con 0x7f9a70104f90 2024-09-19T05:18:54.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.090+0000 7f9a66ffd640 1 --2- 172.21.15.120:0/3663020365 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f9a5c0a3380 0x7f9a5c0a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:54.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.090+0000 7f9a75a3f640 1 --2- 172.21.15.120:0/3663020365 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f9a5c0a3380 0x7f9a5c0a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:54.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.090+0000 7f9a66ffd640 1 -- 172.21.15.120:0/3663020365 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8298+0+0 (secure 0 0 0) 0x7f9a600cfa10 con 0x7f9a70104f90 2024-09-19T05:18:54.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.091+0000 7f9a75a3f640 1 --2- 172.21.15.120:0/3663020365 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f9a5c0a3380 0x7f9a5c0a5840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c006010 tx=0x7f9a6c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:54.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.093+0000 7f9a66ffd640 1 -- 172.21.15.120:0/3663020365 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9a6001f020 con 0x7f9a70104f90 2024-09-19T05:18:54.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.269+0000 7f9a77ca3640 1 -- 172.21.15.120:0/3663020365 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f9a70062630 con 0x7f9a5c0a3380 2024-09-19T05:18:54.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.270+0000 7f9a66ffd640 1 -- 172.21.15.120:0/3663020365 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f9a70062630 con 0x7f9a5c0a3380 2024-09-19T05:18:54.272 INFO:teuthology.orchestra.run.smithi120.stdout:HOST ADDR LABELS STATUS 2024-09-19T05:18:54.272 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120 172.21.15.120 2024-09-19T05:18:54.272 INFO:teuthology.orchestra.run.smithi120.stdout:smithi178 172.21.15.178 2024-09-19T05:18:54.272 INFO:teuthology.orchestra.run.smithi120.stdout:smithi194 172.21.15.194 2024-09-19T05:18:54.272 INFO:teuthology.orchestra.run.smithi120.stdout:3 hosts in cluster 2024-09-19T05:18:54.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.272+0000 7f9a77ca3640 1 -- 172.21.15.120:0/3663020365 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f9a5c0a3380 msgr2=0x7f9a5c0a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:54.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.272+0000 7f9a77ca3640 1 --2- 172.21.15.120:0/3663020365 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f9a5c0a3380 0x7f9a5c0a5840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c006010 tx=0x7f9a6c000bc0 comp rx=0 tx=0).stop 2024-09-19T05:18:54.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.272+0000 7f9a77ca3640 1 -- 172.21.15.120:0/3663020365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a70104f90 msgr2=0x7f9a70198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:54.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.272+0000 7f9a77ca3640 1 --2- 172.21.15.120:0/3663020365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a70104f90 0x7f9a70198380 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000b450 tx=0x7f9a6000b910 comp rx=0 tx=0).stop 2024-09-19T05:18:54.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.272+0000 7f9a77ca3640 1 -- 172.21.15.120:0/3663020365 shutdown_connections 2024-09-19T05:18:54.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.272+0000 7f9a77ca3640 1 --2- 172.21.15.120:0/3663020365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a701078c0 0x7f9a7019f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:54.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.272+0000 7f9a77ca3640 1 --2- 172.21.15.120:0/3663020365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9a70104f90 0x7f9a70198380 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:54.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.272+0000 7f9a77ca3640 1 --2- 172.21.15.120:0/3663020365 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f9a5c0a3380 0x7f9a5c0a5840 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:54.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.272+0000 7f9a77ca3640 1 --2- 172.21.15.120:0/3663020365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a70102660 0x7f9a70197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:54.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.272+0000 7f9a77ca3640 1 -- 172.21.15.120:0/3663020365 >> 172.21.15.120:0/3663020365 conn(0x7f9a700fc280 msgr2=0x7f9a70103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:54.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.272+0000 7f9a77ca3640 1 -- 172.21.15.120:0/3663020365 shutdown_connections 2024-09-19T05:18:54.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:54.272+0000 7f9a77ca3640 1 -- 172.21.15.120:0/3663020365 wait complete. 2024-09-19T05:18:54.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:54 smithi120 ceph-mon[30956]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:18:54.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:54 smithi194 ceph-mon[35228]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:18:54.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:54 smithi178 ceph-mon[34347]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:18:54.864 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T05:18:55.111 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:55.415 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:55 smithi120 ceph-mon[30956]: pgmap v317: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T05:18:55.415 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:55 smithi120 ceph-mon[30956]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:18:55.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.601+0000 7fcea3bb4640 1 -- 172.21.15.120:0/1146781204 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce9c101c00 msgr2=0x7fce9c102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:55.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.601+0000 7fcea3bb4640 1 --2- 172.21.15.120:0/1146781204 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce9c101c00 0x7fce9c102000 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fce8c009900 tx=0x7fce8c02a410 comp rx=0 tx=0).stop 2024-09-19T05:18:55.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.601+0000 7fcea3bb4640 1 -- 172.21.15.120:0/1146781204 shutdown_connections 2024-09-19T05:18:55.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.601+0000 7fcea3bb4640 1 --2- 172.21.15.120:0/1146781204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce9c1037c0 0x7fce9c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:55.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.601+0000 7fcea3bb4640 1 --2- 172.21.15.120:0/1146781204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce9c102e00 0x7fce9c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:55.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.601+0000 7fcea3bb4640 1 --2- 172.21.15.120:0/1146781204 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce9c101c00 0x7fce9c102000 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:55.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.601+0000 7fcea3bb4640 1 -- 172.21.15.120:0/1146781204 >> 172.21.15.120:0/1146781204 conn(0x7fce9c0fd390 msgr2=0x7fce9c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:55.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.601+0000 7fcea3bb4640 1 -- 172.21.15.120:0/1146781204 shutdown_connections 2024-09-19T05:18:55.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.601+0000 7fcea3bb4640 1 -- 172.21.15.120:0/1146781204 wait complete. 2024-09-19T05:18:55.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.601+0000 7fcea3bb4640 1 Processor -- start 2024-09-19T05:18:55.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.602+0000 7fcea3bb4640 1 -- start start 2024-09-19T05:18:55.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.602+0000 7fcea3bb4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce9c101c00 0x7fce9c197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:55.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.602+0000 7fcea3bb4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce9c102e00 0x7fce9c198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:55.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.602+0000 7fcea3bb4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce9c1037c0 0x7fce9c19f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:55.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.602+0000 7fcea3bb4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c10d810 con 0x7fce9c1037c0 2024-09-19T05:18:55.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.602+0000 7fcea3bb4640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c10d690 con 0x7fce9c101c00 2024-09-19T05:18:55.624 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.602+0000 7fcea3bb4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fce9c10d990 con 0x7fce9c102e00 2024-09-19T05:18:55.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.602+0000 7fcea2151640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce9c1037c0 0x7fce9c19f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:55.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.602+0000 7fcea2151640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce9c1037c0 0x7fce9c19f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37412/0 (socket says 172.21.15.120:37412) 2024-09-19T05:18:55.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.602+0000 7fcea2151640 1 -- 172.21.15.120:0/3440260640 learned_addr learned my addr 172.21.15.120:0/3440260640 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:55.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.602+0000 7fcea114f640 1 --2- 172.21.15.120:0/3440260640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce9c102e00 0x7fce9c198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:55.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.602+0000 7fcea2151640 1 -- 172.21.15.120:0/3440260640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce9c102e00 msgr2=0x7fce9c198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:55.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.602+0000 7fcea1950640 1 --2- 172.21.15.120:0/3440260640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce9c101c00 0x7fce9c197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:55.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.602+0000 7fcea2151640 1 --2- 172.21.15.120:0/3440260640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce9c102e00 0x7fce9c198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:55.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.602+0000 7fcea2151640 1 -- 172.21.15.120:0/3440260640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce9c101c00 msgr2=0x7fce9c197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:55.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.602+0000 7fcea2151640 1 --2- 172.21.15.120:0/3440260640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce9c101c00 0x7fce9c197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:55.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.602+0000 7fcea2151640 1 -- 172.21.15.120:0/3440260640 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce9c19fc10 con 0x7fce9c1037c0 2024-09-19T05:18:55.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.602+0000 7fcea2151640 1 --2- 172.21.15.120:0/3440260640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce9c1037c0 0x7fce9c19f5a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fce9400b970 tx=0x7fce9400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:55.625 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.602+0000 7fce92ffd640 1 -- 172.21.15.120:0/3440260640 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce94019070 con 0x7fce9c1037c0 2024-09-19T05:18:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.602+0000 7fcea3bb4640 1 -- 172.21.15.120:0/3440260640 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce9c19ff00 con 0x7fce9c1037c0 2024-09-19T05:18:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.602+0000 7fce92ffd640 1 -- 172.21.15.120:0/3440260640 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fce94014440 con 0x7fce9c1037c0 2024-09-19T05:18:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.603+0000 7fce92ffd640 1 -- 172.21.15.120:0/3440260640 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce940075d0 con 0x7fce9c1037c0 2024-09-19T05:18:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.603+0000 7fcea3bb4640 1 -- 172.21.15.120:0/3440260640 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce9c1a0430 con 0x7fce9c1037c0 2024-09-19T05:18:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.604+0000 7fcea3bb4640 1 -- 172.21.15.120:0/3440260640 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce9c1090f0 con 0x7fce9c1037c0 2024-09-19T05:18:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.605+0000 7fce92ffd640 1 -- 172.21.15.120:0/3440260640 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fce9401c070 con 0x7fce9c1037c0 2024-09-19T05:18:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.605+0000 7fce92ffd640 1 --2- 172.21.15.120:0/3440260640 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fce880a3300 0x7fce880a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.605+0000 7fcea1950640 1 --2- 172.21.15.120:0/3440260640 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fce880a3300 0x7fce880a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.605+0000 7fce92ffd640 1 -- 172.21.15.120:0/3440260640 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8298+0+0 (secure 0 0 0) 0x7fce940cefa0 con 0x7fce9c1037c0 2024-09-19T05:18:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.606+0000 7fcea1950640 1 --2- 172.21.15.120:0/3440260640 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fce880a3300 0x7fce880a57c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fce8c02a930 tx=0x7fce8c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:55.626 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.609+0000 7fce92ffd640 1 -- 172.21.15.120:0/3440260640 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fce9409bc30 con 0x7fce9c1037c0 2024-09-19T05:18:55.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:55 smithi194 ceph-mon[35228]: pgmap v317: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T05:18:55.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:55 smithi194 ceph-mon[35228]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:18:55.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:55 smithi178 ceph-mon[34347]: pgmap v317: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T05:18:55.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:55 smithi178 ceph-mon[34347]: from='client.15042 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:18:55.783 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.781+0000 7fcea3bb4640 1 -- 172.21.15.120:0/3440260640 --> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fce9c062630 con 0x7fce880a3300 2024-09-19T05:18:55.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.783+0000 7fce92ffd640 1 -- 172.21.15.120:0/3440260640 <== mgr.14150 v2:172.21.15.120:6800/955692128 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fce9c062630 con 0x7fce880a3300 2024-09-19T05:18:55.785 INFO:teuthology.orchestra.run.smithi120.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T05:18:55.785 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400XV400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-19T05:18:55.785 INFO:teuthology.orchestra.run.smithi120.stdout:smithi178 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75130029480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-09-19T05:18:55.785 INFO:teuthology.orchestra.run.smithi120.stdout:smithi194 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6240002A400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T05:18:55.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.785+0000 7fcea3bb4640 1 -- 172.21.15.120:0/3440260640 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fce880a3300 msgr2=0x7fce880a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:55.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.785+0000 7fcea3bb4640 1 --2- 172.21.15.120:0/3440260640 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fce880a3300 0x7fce880a57c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fce8c02a930 tx=0x7fce8c000bc0 comp rx=0 tx=0).stop 2024-09-19T05:18:55.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.785+0000 7fcea3bb4640 1 -- 172.21.15.120:0/3440260640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce9c1037c0 msgr2=0x7fce9c19f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:55.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.785+0000 7fcea3bb4640 1 --2- 172.21.15.120:0/3440260640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce9c1037c0 0x7fce9c19f5a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fce9400b970 tx=0x7fce9400be30 comp rx=0 tx=0).stop 2024-09-19T05:18:55.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.785+0000 7fcea3bb4640 1 -- 172.21.15.120:0/3440260640 shutdown_connections 2024-09-19T05:18:55.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.785+0000 7fcea3bb4640 1 --2- 172.21.15.120:0/3440260640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fce9c1037c0 0x7fce9c19f5a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:55.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.785+0000 7fcea3bb4640 1 --2- 172.21.15.120:0/3440260640 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fce880a3300 0x7fce880a57c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:55.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.785+0000 7fcea3bb4640 1 --2- 172.21.15.120:0/3440260640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce9c102e00 0x7fce9c198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:55.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.785+0000 7fcea3bb4640 1 --2- 172.21.15.120:0/3440260640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce9c101c00 0x7fce9c197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:55.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.785+0000 7fcea3bb4640 1 -- 172.21.15.120:0/3440260640 >> 172.21.15.120:0/3440260640 conn(0x7fce9c0fd390 msgr2=0x7fce9c1062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:55.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.785+0000 7fcea3bb4640 1 -- 172.21.15.120:0/3440260640 shutdown_connections 2024-09-19T05:18:55.788 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:55.785+0000 7fcea3bb4640 1 -- 172.21.15.120:0/3440260640 wait complete. 2024-09-19T05:18:56.455 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T05:18:56.464 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi120.front.sepia.ceph.com 2024-09-19T05:18:56.464 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T05:18:56.717 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:57.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.126+0000 7f44dc6ca640 1 -- 172.21.15.120:0/1063116306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d4102160 msgr2=0x7f44d4102560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:57.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.126+0000 7f44dc6ca640 1 --2- 172.21.15.120:0/1063116306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d4102160 0x7f44d4102560 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f44d0009900 tx=0x7f44d002a410 comp rx=0 tx=0).stop 2024-09-19T05:18:57.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.126+0000 7f44dc6ca640 1 -- 172.21.15.120:0/1063116306 shutdown_connections 2024-09-19T05:18:57.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.126+0000 7f44dc6ca640 1 --2- 172.21.15.120:0/1063116306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44d4101780 0x7f44d4109020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:57.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.126+0000 7f44dc6ca640 1 --2- 172.21.15.120:0/1063116306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44d4100dc0 0x7f44d4101240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:57.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.126+0000 7f44dc6ca640 1 --2- 172.21.15.120:0/1063116306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d4102160 0x7f44d4102560 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:57.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.126+0000 7f44dc6ca640 1 -- 172.21.15.120:0/1063116306 >> 172.21.15.120:0/1063116306 conn(0x7f44d40fba80 msgr2=0x7f44d40fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:57.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.126+0000 7f44dc6ca640 1 -- 172.21.15.120:0/1063116306 shutdown_connections 2024-09-19T05:18:57.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.126+0000 7f44dc6ca640 1 -- 172.21.15.120:0/1063116306 wait complete. 2024-09-19T05:18:57.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.127+0000 7f44dc6ca640 1 Processor -- start 2024-09-19T05:18:57.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.127+0000 7f44dc6ca640 1 -- start start 2024-09-19T05:18:57.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.127+0000 7f44dc6ca640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d4100dc0 0x7f44d419a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:57.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.127+0000 7f44dc6ca640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44d4101780 0x7f44d419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:57.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.127+0000 7f44dc6ca640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44d4102160 0x7f44d41a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:57.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.127+0000 7f44dc6ca640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f44d410c610 con 0x7f44d4100dc0 2024-09-19T05:18:57.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.127+0000 7f44dc6ca640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f44d410c490 con 0x7f44d4101780 2024-09-19T05:18:57.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.127+0000 7f44dc6ca640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f44d410c790 con 0x7f44d4102160 2024-09-19T05:18:57.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.127+0000 7f44da466640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d4100dc0 0x7f44d419a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:57.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.127+0000 7f44da466640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d4100dc0 0x7f44d419a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37432/0 (socket says 172.21.15.120:37432) 2024-09-19T05:18:57.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.127+0000 7f44da466640 1 -- 172.21.15.120:0/2941774113 learned_addr learned my addr 172.21.15.120:0/2941774113 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:57.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.127+0000 7f44d9c65640 1 --2- 172.21.15.120:0/2941774113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44d4101780 0x7f44d419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:57.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.127+0000 7f44dac67640 1 --2- 172.21.15.120:0/2941774113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44d4102160 0x7f44d41a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:57.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.127+0000 7f44da466640 1 -- 172.21.15.120:0/2941774113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44d4102160 msgr2=0x7f44d41a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:57.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.127+0000 7f44da466640 1 --2- 172.21.15.120:0/2941774113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44d4102160 0x7f44d41a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:57.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.127+0000 7f44da466640 1 -- 172.21.15.120:0/2941774113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44d4101780 msgr2=0x7f44d419a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:57.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.127+0000 7f44da466640 1 --2- 172.21.15.120:0/2941774113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44d4101780 0x7f44d419a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:57.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.127+0000 7f44da466640 1 -- 172.21.15.120:0/2941774113 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d41a1ce0 con 0x7f44d4100dc0 2024-09-19T05:18:57.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.128+0000 7f44da466640 1 --2- 172.21.15.120:0/2941774113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d4100dc0 0x7f44d419a0b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f44d0004770 tx=0x7f44d0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:57.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.128+0000 7f44cb7fe640 1 -- 172.21.15.120:0/2941774113 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d003f030 con 0x7f44d4100dc0 2024-09-19T05:18:57.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.128+0000 7f44cb7fe640 1 -- 172.21.15.120:0/2941774113 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f44d0003aa0 con 0x7f44d4100dc0 2024-09-19T05:18:57.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.128+0000 7f44dc6ca640 1 -- 172.21.15.120:0/2941774113 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44d41a1f70 con 0x7f44d4100dc0 2024-09-19T05:18:57.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.128+0000 7f44cb7fe640 1 -- 172.21.15.120:0/2941774113 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d0035070 con 0x7f44d4100dc0 2024-09-19T05:18:57.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.128+0000 7f44dc6ca640 1 -- 172.21.15.120:0/2941774113 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44d41a2370 con 0x7f44d4100dc0 2024-09-19T05:18:57.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.129+0000 7f44dc6ca640 1 -- 172.21.15.120:0/2941774113 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44d41a25a0 con 0x7f44d4100dc0 2024-09-19T05:18:57.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.130+0000 7f44cb7fe640 1 -- 172.21.15.120:0/2941774113 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f44d0042030 con 0x7f44d4100dc0 2024-09-19T05:18:57.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.131+0000 7f44cb7fe640 1 --2- 172.21.15.120:0/2941774113 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f44c00a3300 0x7f44c00a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:57.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.131+0000 7f44cb7fe640 1 -- 172.21.15.120:0/2941774113 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8298+0+0 (secure 0 0 0) 0x7f44d00f0600 con 0x7f44d4100dc0 2024-09-19T05:18:57.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.131+0000 7f44d9c65640 1 --2- 172.21.15.120:0/2941774113 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f44c00a3300 0x7f44c00a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:57.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.131+0000 7f44d9c65640 1 --2- 172.21.15.120:0/2941774113 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f44c00a3300 0x7f44c00a57c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f44d419b5d0 tx=0x7f44c4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:57.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.134+0000 7f44cb7fe640 1 -- 172.21.15.120:0/2941774113 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f44d00bd180 con 0x7f44d4100dc0 2024-09-19T05:18:57.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.342+0000 7f44dc6ca640 1 -- 172.21.15.120:0/2941774113 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f44d41a2890 con 0x7f44d4100dc0 2024-09-19T05:18:57.344 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:57 smithi120 ceph-mon[30956]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:18:57.344 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:57 smithi120 ceph-mon[30956]: pgmap v318: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T05:18:57.344 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.342+0000 7f44cb7fe640 1 -- 172.21.15.120:0/2941774113 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3093 (secure 0 0 0) 0x7f44d00bca80 con 0x7f44d4100dc0 2024-09-19T05:18:57.345 INFO:teuthology.orchestra.run.smithi120.stdout:e24 2024-09-19T05:18:57.345 INFO:teuthology.orchestra.run.smithi120.stdout:btime 2024-09-19T05:17:42:231927+0000 2024-09-19T05:18:57.345 INFO:teuthology.orchestra.run.smithi120.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T05:18:57.345 INFO:teuthology.orchestra.run.smithi120.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T05:18:57.345 INFO:teuthology.orchestra.run.smithi120.stdout:legacy client fscid: 1 2024-09-19T05:18:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:18:57.345 INFO:teuthology.orchestra.run.smithi120.stdout:Filesystem 'cephfs' (1) 2024-09-19T05:18:57.345 INFO:teuthology.orchestra.run.smithi120.stdout:fs_name cephfs 2024-09-19T05:18:57.345 INFO:teuthology.orchestra.run.smithi120.stdout:epoch 24 2024-09-19T05:18:57.345 INFO:teuthology.orchestra.run.smithi120.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T05:18:57.345 INFO:teuthology.orchestra.run.smithi120.stdout:created 2024-09-19T05:17:30.796197+0000 2024-09-19T05:18:57.346 INFO:teuthology.orchestra.run.smithi120.stdout:modified 2024-09-19T05:17:41.861437+0000 2024-09-19T05:18:57.346 INFO:teuthology.orchestra.run.smithi120.stdout:tableserver 0 2024-09-19T05:18:57.346 INFO:teuthology.orchestra.run.smithi120.stdout:root 0 2024-09-19T05:18:57.346 INFO:teuthology.orchestra.run.smithi120.stdout:session_timeout 300 2024-09-19T05:18:57.346 INFO:teuthology.orchestra.run.smithi120.stdout:session_autoclose 300 2024-09-19T05:18:57.346 INFO:teuthology.orchestra.run.smithi120.stdout:max_file_size 1099511627776 2024-09-19T05:18:57.346 INFO:teuthology.orchestra.run.smithi120.stdout:max_xattr_size 65536 2024-09-19T05:18:57.346 INFO:teuthology.orchestra.run.smithi120.stdout:required_client_features {} 2024-09-19T05:18:57.346 INFO:teuthology.orchestra.run.smithi120.stdout:last_failure 0 2024-09-19T05:18:57.346 INFO:teuthology.orchestra.run.smithi120.stdout:last_failure_osd_epoch 0 2024-09-19T05:18:57.346 INFO:teuthology.orchestra.run.smithi120.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T05:18:57.346 INFO:teuthology.orchestra.run.smithi120.stdout:max_mds 3 2024-09-19T05:18:57.346 INFO:teuthology.orchestra.run.smithi120.stdout:in 0,1,2 2024-09-19T05:18:57.346 INFO:teuthology.orchestra.run.smithi120.stdout:up {0=24445,1=24443,2=24430} 2024-09-19T05:18:57.347 INFO:teuthology.orchestra.run.smithi120.stdout:failed 2024-09-19T05:18:57.347 INFO:teuthology.orchestra.run.smithi120.stdout:damaged 2024-09-19T05:18:57.347 INFO:teuthology.orchestra.run.smithi120.stdout:stopped 2024-09-19T05:18:57.347 INFO:teuthology.orchestra.run.smithi120.stdout:data_pools [3] 2024-09-19T05:18:57.347 INFO:teuthology.orchestra.run.smithi120.stdout:metadata_pool 2 2024-09-19T05:18:57.347 INFO:teuthology.orchestra.run.smithi120.stdout:inline_data disabled 2024-09-19T05:18:57.347 INFO:teuthology.orchestra.run.smithi120.stdout:balancer 2024-09-19T05:18:57.347 INFO:teuthology.orchestra.run.smithi120.stdout:bal_rank_mask -1 2024-09-19T05:18:57.347 INFO:teuthology.orchestra.run.smithi120.stdout:standby_count_wanted 0 2024-09-19T05:18:57.347 INFO:teuthology.orchestra.run.smithi120.stdout:qdb_cluster leader: 24445 members: 24430,24443,24445 2024-09-19T05:18:57.347 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.i{0:24445} state up:active seq 6 addr [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T05:18:57.347 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.f{0:24424} state up:standby-replay seq 1 addr [v2:172.21.15.194:6834/3268846994,v1:172.21.15.194:6835/3268846994] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T05:18:57.347 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.b{1:24443} state up:active seq 6 addr [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T05:18:57.347 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.h{1:24419} state up:standby-replay seq 1 addr [v2:172.21.15.178:6836/3960720164,v1:172.21.15.178:6837/3960720164] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T05:18:57.348 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.c{2:24430} state up:active seq 10 addr [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T05:18:57.348 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.e{2:24401} state up:standby-replay seq 1 addr [v2:172.21.15.178:6834/890775592,v1:172.21.15.178:6835/890775592] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T05:18:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:18:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:18:57.348 INFO:teuthology.orchestra.run.smithi120.stdout:Standby daemons: 2024-09-19T05:18:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:18:57.348 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.j{-1:14556} state up:standby seq 1 addr [v2:172.21.15.120:6834/93472898,v1:172.21.15.120:6835/93472898] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T05:18:57.348 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.d{-1:14568} state up:standby seq 1 addr [v2:172.21.15.120:6836/1976835398,v1:172.21.15.120:6837/1976835398] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T05:18:57.348 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.g{-1:14607} state up:standby seq 1 addr [v2:172.21.15.120:6838/2975851469,v1:172.21.15.120:6839/2975851469] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T05:18:57.348 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.a{-1:14619} state up:standby seq 1 addr [v2:172.21.15.120:6840/2837552754,v1:172.21.15.120:6841/2837552754] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T05:18:57.348 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.k{-1:24368} state up:standby seq 1 addr [v2:172.21.15.178:6832/61682954,v1:172.21.15.178:6833/61682954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T05:18:57.348 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.l{-1:24394} state up:standby seq 1 addr [v2:172.21.15.194:6832/1778722040,v1:172.21.15.194:6833/1778722040] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T05:18:57.349 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 24 2024-09-19T05:18:57.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.344+0000 7f44dc6ca640 1 -- 172.21.15.120:0/2941774113 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f44c00a3300 msgr2=0x7f44c00a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:57.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.344+0000 7f44dc6ca640 1 --2- 172.21.15.120:0/2941774113 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f44c00a3300 0x7f44c00a57c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f44d419b5d0 tx=0x7f44c4005f90 comp rx=0 tx=0).stop 2024-09-19T05:18:57.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.344+0000 7f44dc6ca640 1 -- 172.21.15.120:0/2941774113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d4100dc0 msgr2=0x7f44d419a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:57.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.344+0000 7f44dc6ca640 1 --2- 172.21.15.120:0/2941774113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d4100dc0 0x7f44d419a0b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f44d0004770 tx=0x7f44d0004270 comp rx=0 tx=0).stop 2024-09-19T05:18:57.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.345+0000 7f44dc6ca640 1 -- 172.21.15.120:0/2941774113 shutdown_connections 2024-09-19T05:18:57.349 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.345+0000 7f44dc6ca640 1 --2- 172.21.15.120:0/2941774113 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f44c00a3300 0x7f44c00a57c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:57.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.345+0000 7f44dc6ca640 1 --2- 172.21.15.120:0/2941774113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44d4102160 0x7f44d41a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:57.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.345+0000 7f44dc6ca640 1 --2- 172.21.15.120:0/2941774113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44d4101780 0x7f44d419a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:57.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.345+0000 7f44dc6ca640 1 --2- 172.21.15.120:0/2941774113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f44d4100dc0 0x7f44d419a0b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:57.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.345+0000 7f44dc6ca640 1 -- 172.21.15.120:0/2941774113 >> 172.21.15.120:0/2941774113 conn(0x7f44d40fba80 msgr2=0x7f44d40ffd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:57.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.345+0000 7f44dc6ca640 1 -- 172.21.15.120:0/2941774113 shutdown_connections 2024-09-19T05:18:57.350 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:57.345+0000 7f44dc6ca640 1 -- 172.21.15.120:0/2941774113 wait complete. 2024-09-19T05:18:57.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:57 smithi194 ceph-mon[35228]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:18:57.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:57 smithi194 ceph-mon[35228]: pgmap v318: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T05:18:57.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:57 smithi178 ceph-mon[34347]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:18:57.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:57 smithi178 ceph-mon[34347]: pgmap v318: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T05:18:58.019 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T05:18:58.270 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:18:58.526 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:58 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2941774113' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T05:18:58.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:58 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/2941774113' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T05:18:58.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:58 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/2941774113' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T05:18:58.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.741+0000 7fc060560640 1 -- 172.21.15.120:0/469387580 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc058100b10 msgr2=0x7fc058100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:58.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.741+0000 7fc060560640 1 --2- 172.21.15.120:0/469387580 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc058100b10 0x7fc058100f10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc048009900 tx=0x7fc04802a410 comp rx=0 tx=0).stop 2024-09-19T05:18:58.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.741+0000 7fc060560640 1 -- 172.21.15.120:0/469387580 shutdown_connections 2024-09-19T05:18:58.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.741+0000 7fc060560640 1 --2- 172.21.15.120:0/469387580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0581026d0 0x7fc058108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:58.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.741+0000 7fc060560640 1 --2- 172.21.15.120:0/469387580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc058101d10 0x7fc058102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:58.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.741+0000 7fc060560640 1 --2- 172.21.15.120:0/469387580 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc058100b10 0x7fc058100f10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:58.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.741+0000 7fc060560640 1 -- 172.21.15.120:0/469387580 >> 172.21.15.120:0/469387580 conn(0x7fc0580fc2a0 msgr2=0x7fc0580fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:58.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.741+0000 7fc060560640 1 -- 172.21.15.120:0/469387580 shutdown_connections 2024-09-19T05:18:58.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.741+0000 7fc060560640 1 -- 172.21.15.120:0/469387580 wait complete. 2024-09-19T05:18:58.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.741+0000 7fc060560640 1 Processor -- start 2024-09-19T05:18:58.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.742+0000 7fc060560640 1 -- start start 2024-09-19T05:18:58.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.742+0000 7fc060560640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc058100b10 0x7fc05810b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:58.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.742+0000 7fc060560640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc058101d10 0x7fc058109ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:58.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.742+0000 7fc060560640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0581026d0 0x7fc05810a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:58.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.742+0000 7fc060560640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc05810d830 con 0x7fc058100b10 2024-09-19T05:18:58.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.742+0000 7fc060560640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc05810d6b0 con 0x7fc058101d10 2024-09-19T05:18:58.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.742+0000 7fc060560640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc05810d9b0 con 0x7fc0581026d0 2024-09-19T05:18:58.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.742+0000 7fc05e2fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc058100b10 0x7fc05810b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:58.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.742+0000 7fc05e2fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc058100b10 0x7fc05810b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37446/0 (socket says 172.21.15.120:37446) 2024-09-19T05:18:58.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.742+0000 7fc05e2fc640 1 -- 172.21.15.120:0/2381637300 learned_addr learned my addr 172.21.15.120:0/2381637300 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:18:58.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.742+0000 7fc05eafd640 1 --2- 172.21.15.120:0/2381637300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0581026d0 0x7fc05810a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:58.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.742+0000 7fc05e2fc640 1 -- 172.21.15.120:0/2381637300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0581026d0 msgr2=0x7fc05810a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:58.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.742+0000 7fc05e2fc640 1 --2- 172.21.15.120:0/2381637300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0581026d0 0x7fc05810a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:58.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.742+0000 7fc05e2fc640 1 -- 172.21.15.120:0/2381637300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc058101d10 msgr2=0x7fc058109ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:58.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.742+0000 7fc05dafb640 1 --2- 172.21.15.120:0/2381637300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc058101d10 0x7fc058109ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:58.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.742+0000 7fc05e2fc640 1 --2- 172.21.15.120:0/2381637300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc058101d10 0x7fc058109ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:58.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.742+0000 7fc05e2fc640 1 -- 172.21.15.120:0/2381637300 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc05810a8e0 con 0x7fc058100b10 2024-09-19T05:18:58.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.742+0000 7fc05eafd640 1 --2- 172.21.15.120:0/2381637300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0581026d0 0x7fc05810a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:18:58.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.742+0000 7fc05e2fc640 1 --2- 172.21.15.120:0/2381637300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc058100b10 0x7fc05810b490 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc048009230 tx=0x7fc048004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:58.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.742+0000 7fc04f7fe640 1 -- 172.21.15.120:0/2381637300 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04803f030 con 0x7fc058100b10 2024-09-19T05:18:58.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.742+0000 7fc060560640 1 -- 172.21.15.120:0/2381637300 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0581a20f0 con 0x7fc058100b10 2024-09-19T05:18:58.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.742+0000 7fc04f7fe640 1 -- 172.21.15.120:0/2381637300 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc048003cb0 con 0x7fc058100b10 2024-09-19T05:18:58.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.742+0000 7fc04f7fe640 1 -- 172.21.15.120:0/2381637300 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc048035070 con 0x7fc058100b10 2024-09-19T05:18:58.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.743+0000 7fc060560640 1 -- 172.21.15.120:0/2381637300 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0581a2620 con 0x7fc058100b10 2024-09-19T05:18:58.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.744+0000 7fc060560640 1 -- 172.21.15.120:0/2381637300 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc058108040 con 0x7fc058100b10 2024-09-19T05:18:58.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.745+0000 7fc04f7fe640 1 -- 172.21.15.120:0/2381637300 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fc048042030 con 0x7fc058100b10 2024-09-19T05:18:58.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.745+0000 7fc04f7fe640 1 --2- 172.21.15.120:0/2381637300 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fc0440a32d0 0x7fc0440a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:18:58.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.745+0000 7fc05dafb640 1 --2- 172.21.15.120:0/2381637300 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fc0440a32d0 0x7fc0440a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:18:58.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.745+0000 7fc04f7fe640 1 -- 172.21.15.120:0/2381637300 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8298+0+0 (secure 0 0 0) 0x7fc0480f0190 con 0x7fc058100b10 2024-09-19T05:18:58.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.746+0000 7fc05dafb640 1 --2- 172.21.15.120:0/2381637300 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fc0440a32d0 0x7fc0440a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc05810b210 tx=0x7fc054008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:18:58.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.749+0000 7fc04f7fe640 1 -- 172.21.15.120:0/2381637300 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc0480bcd10 con 0x7fc058100b10 2024-09-19T05:18:58.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.918+0000 7fc060560640 1 -- 172.21.15.120:0/2381637300 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fc05802d7c0 con 0x7fc058100b10 2024-09-19T05:18:58.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.919+0000 7fc04f7fe640 1 -- 172.21.15.120:0/2381637300 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v84) ==== 56+0+5380 (secure 0 0 0) 0x7fc0480bc610 con 0x7fc058100b10 2024-09-19T05:18:58.921 INFO:teuthology.orchestra.run.smithi120.stdout:epoch 84 2024-09-19T05:18:58.921 INFO:teuthology.orchestra.run.smithi120.stdout:fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:18:58.921 INFO:teuthology.orchestra.run.smithi120.stdout:created 2024-09-19T05:09:55.847220+0000 2024-09-19T05:18:58.921 INFO:teuthology.orchestra.run.smithi120.stdout:modified 2024-09-19T05:18:50.231286+0000 2024-09-19T05:18:58.921 INFO:teuthology.orchestra.run.smithi120.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T05:18:58.921 INFO:teuthology.orchestra.run.smithi120.stdout:crush_version 26 2024-09-19T05:18:58.921 INFO:teuthology.orchestra.run.smithi120.stdout:full_ratio 0.95 2024-09-19T05:18:58.921 INFO:teuthology.orchestra.run.smithi120.stdout:backfillfull_ratio 0.9 2024-09-19T05:18:58.922 INFO:teuthology.orchestra.run.smithi120.stdout:nearfull_ratio 0.85 2024-09-19T05:18:58.922 INFO:teuthology.orchestra.run.smithi120.stdout:require_min_compat_client luminous 2024-09-19T05:18:58.922 INFO:teuthology.orchestra.run.smithi120.stdout:min_compat_client luminous 2024-09-19T05:18:58.922 INFO:teuthology.orchestra.run.smithi120.stdout:require_osd_release squid 2024-09-19T05:18:58.922 INFO:teuthology.orchestra.run.smithi120.stdout:stretch_mode_enabled false 2024-09-19T05:18:58.922 INFO:teuthology.orchestra.run.smithi120.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T05:18:58.922 INFO:teuthology.orchestra.run.smithi120.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-19T05:18:58.922 INFO:teuthology.orchestra.run.smithi120.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-19T05:18:58.922 INFO:teuthology.orchestra.run.smithi120.stdout:max_osd 12 2024-09-19T05:18:58.922 INFO:teuthology.orchestra.run.smithi120.stdout:osd.0 up in weight 1 up_from 8 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6802/3421474326,v1:172.21.15.120:6803/3421474326] [v2:172.21.15.120:6804/3421474326,v1:172.21.15.120:6805/3421474326] exists,up 18907a03-1f43-419a-acb6-9fa4cf5020d5 2024-09-19T05:18:58.922 INFO:teuthology.orchestra.run.smithi120.stdout:osd.1 up in weight 1 up_from 12 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.178:6800/1195511218,v1:172.21.15.178:6801/1195511218] [v2:172.21.15.178:6802/1195511218,v1:172.21.15.178:6803/1195511218] exists,up d21e029b-8a60-43f9-9ba7-30cdba19ba57 2024-09-19T05:18:58.922 INFO:teuthology.orchestra.run.smithi120.stdout:osd.2 up in weight 1 up_from 17 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6800/3752826560,v1:172.21.15.194:6801/3752826560] [v2:172.21.15.194:6802/3752826560,v1:172.21.15.194:6803/3752826560] exists,up 26ad9c8d-dbaa-46c2-a346-19717d81cc60 2024-09-19T05:18:58.923 INFO:teuthology.orchestra.run.smithi120.stdout:osd.3 up in weight 1 up_from 24 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6810/803566783,v1:172.21.15.120:6811/803566783] [v2:172.21.15.120:6812/803566783,v1:172.21.15.120:6813/803566783] exists,up 7e266576-8a98-40a8-9532-4b6f4611a908 2024-09-19T05:18:58.923 INFO:teuthology.orchestra.run.smithi120.stdout:osd.4 up in weight 1 up_from 32 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.178:6808/541165323,v1:172.21.15.178:6809/541165323] [v2:172.21.15.178:6810/541165323,v1:172.21.15.178:6811/541165323] exists,up c77d05c5-3b8f-4f7b-91f9-833735221684 2024-09-19T05:18:58.923 INFO:teuthology.orchestra.run.smithi120.stdout:osd.5 up in weight 1 up_from 37 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6808/2631415468,v1:172.21.15.194:6809/2631415468] [v2:172.21.15.194:6810/2631415468,v1:172.21.15.194:6811/2631415468] exists,up 5f1c394b-e510-411f-969a-2db2b68cf41a 2024-09-19T05:18:58.923 INFO:teuthology.orchestra.run.smithi120.stdout:osd.6 up in weight 1 up_from 44 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6818/388238976,v1:172.21.15.120:6819/388238976] [v2:172.21.15.120:6820/388238976,v1:172.21.15.120:6821/388238976] exists,up 990af639-099e-49df-a083-05626cee3c3b 2024-09-19T05:18:58.923 INFO:teuthology.orchestra.run.smithi120.stdout:osd.7 up in weight 1 up_from 49 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.178:6816/1912109177,v1:172.21.15.178:6817/1912109177] [v2:172.21.15.178:6818/1912109177,v1:172.21.15.178:6819/1912109177] exists,up 6f4aa6ab-b5f4-4c06-9f14-9a51bc195ca9 2024-09-19T05:18:58.923 INFO:teuthology.orchestra.run.smithi120.stdout:osd.8 up in weight 1 up_from 56 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6816/596878172,v1:172.21.15.194:6817/596878172] [v2:172.21.15.194:6818/596878172,v1:172.21.15.194:6819/596878172] exists,up 707739c9-732a-405c-847a-ce6a06e611b3 2024-09-19T05:18:58.923 INFO:teuthology.orchestra.run.smithi120.stdout:osd.9 up in weight 1 up_from 63 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6826/3257373801,v1:172.21.15.120:6827/3257373801] [v2:172.21.15.120:6828/3257373801,v1:172.21.15.120:6829/3257373801] exists,up 9393b018-c924-4d75-99e5-25433d276567 2024-09-19T05:18:58.923 INFO:teuthology.orchestra.run.smithi120.stdout:osd.10 up in weight 1 up_from 67 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.178:6824/3067822030,v1:172.21.15.178:6825/3067822030] [v2:172.21.15.178:6826/3067822030,v1:172.21.15.178:6827/3067822030] exists,up 45db7f62-87a6-4b2b-a3dc-012e2de505e2 2024-09-19T05:18:58.923 INFO:teuthology.orchestra.run.smithi120.stdout:osd.11 up in weight 1 up_from 74 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6824/2713146974,v1:172.21.15.194:6825/2713146974] [v2:172.21.15.194:6826/2713146974,v1:172.21.15.194:6827/2713146974] exists,up 85ea248c-9a36-41cb-a200-87138fb31602 2024-09-19T05:18:58.923 INFO:teuthology.orchestra.run.smithi120.stdout:pg_upmap_items 2.f [8,11] 2024-09-19T05:18:58.923 INFO:teuthology.orchestra.run.smithi120.stdout:pg_upmap_items 2.13 [2,11] 2024-09-19T05:18:58.923 INFO:teuthology.orchestra.run.smithi120.stdout:pg_upmap_items 3.0 [4,6] 2024-09-19T05:18:58.923 INFO:teuthology.orchestra.run.smithi120.stdout:pg_upmap_items 3.1 [4,9] 2024-09-19T05:18:58.923 INFO:teuthology.orchestra.run.smithi120.stdout:pg_upmap_items 3.1d [5,9] 2024-09-19T05:18:58.924 INFO:teuthology.orchestra.run.smithi120.stdout:pg_upmap_items 3.23 [4,7] 2024-09-19T05:18:58.924 INFO:teuthology.orchestra.run.smithi120.stdout:pg_upmap_items 3.28 [3,8] 2024-09-19T05:18:58.924 INFO:teuthology.orchestra.run.smithi120.stdout:pg_upmap_items 3.2a [3,6] 2024-09-19T05:18:58.924 INFO:teuthology.orchestra.run.smithi120.stdout:pg_upmap_items 3.37 [1,9] 2024-09-19T05:18:58.924 INFO:teuthology.orchestra.run.smithi120.stdout:pg_upmap_items 3.39 [5,8] 2024-09-19T05:18:58.924 INFO:teuthology.orchestra.run.smithi120.stdout:pg_upmap_items 3.3a [4,8] 2024-09-19T05:18:58.924 INFO:teuthology.orchestra.run.smithi120.stdout:blocklist 172.21.15.120:0/3419110398 expires 2024-09-20T05:10:48.027892+0000 2024-09-19T05:18:58.924 INFO:teuthology.orchestra.run.smithi120.stdout:blocklist 172.21.15.120:6801/50152720 expires 2024-09-20T05:10:48.027892+0000 2024-09-19T05:18:58.924 INFO:teuthology.orchestra.run.smithi120.stdout:blocklist 172.21.15.120:0/4177074351 expires 2024-09-20T05:10:48.027892+0000 2024-09-19T05:18:58.924 INFO:teuthology.orchestra.run.smithi120.stdout:blocklist 172.21.15.120:6800/50152720 expires 2024-09-20T05:10:48.027892+0000 2024-09-19T05:18:58.924 INFO:teuthology.orchestra.run.smithi120.stdout:blocklist 172.21.15.120:0/329623296 expires 2024-09-20T05:10:48.027892+0000 2024-09-19T05:18:58.924 INFO:teuthology.orchestra.run.smithi120.stdout:blocklist 172.21.15.120:0/2867300720 expires 2024-09-20T05:10:23.348128+0000 2024-09-19T05:18:58.924 INFO:teuthology.orchestra.run.smithi120.stdout:blocklist 172.21.15.120:0/3592867428 expires 2024-09-20T05:10:23.348128+0000 2024-09-19T05:18:58.925 INFO:teuthology.orchestra.run.smithi120.stdout:blocklist 172.21.15.120:0/4255533863 expires 2024-09-20T05:10:23.348128+0000 2024-09-19T05:18:58.925 INFO:teuthology.orchestra.run.smithi120.stdout:blocklist 172.21.15.120:6801/3412493069 expires 2024-09-20T05:10:23.348128+0000 2024-09-19T05:18:58.925 INFO:teuthology.orchestra.run.smithi120.stdout:blocklist 172.21.15.120:6800/3412493069 expires 2024-09-20T05:10:23.348128+0000 2024-09-19T05:18:58.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.921+0000 7fc060560640 1 -- 172.21.15.120:0/2381637300 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fc0440a32d0 msgr2=0x7fc0440a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:58.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.921+0000 7fc060560640 1 --2- 172.21.15.120:0/2381637300 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fc0440a32d0 0x7fc0440a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc05810b210 tx=0x7fc054008040 comp rx=0 tx=0).stop 2024-09-19T05:18:58.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.921+0000 7fc060560640 1 -- 172.21.15.120:0/2381637300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc058100b10 msgr2=0x7fc05810b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:18:58.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.921+0000 7fc060560640 1 --2- 172.21.15.120:0/2381637300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc058100b10 0x7fc05810b490 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc048009230 tx=0x7fc048004340 comp rx=0 tx=0).stop 2024-09-19T05:18:58.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.921+0000 7fc060560640 1 -- 172.21.15.120:0/2381637300 shutdown_connections 2024-09-19T05:18:58.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.921+0000 7fc060560640 1 --2- 172.21.15.120:0/2381637300 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fc0440a32d0 0x7fc0440a5790 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:58.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.921+0000 7fc060560640 1 --2- 172.21.15.120:0/2381637300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0581026d0 0x7fc05810a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:58.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.921+0000 7fc060560640 1 --2- 172.21.15.120:0/2381637300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc058101d10 0x7fc058109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:58.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.921+0000 7fc060560640 1 --2- 172.21.15.120:0/2381637300 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc058100b10 0x7fc05810b490 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:18:58.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.921+0000 7fc060560640 1 -- 172.21.15.120:0/2381637300 >> 172.21.15.120:0/2381637300 conn(0x7fc0580fc2a0 msgr2=0x7fc058105210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:18:58.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.921+0000 7fc060560640 1 -- 172.21.15.120:0/2381637300 shutdown_connections 2024-09-19T05:18:58.926 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:18:58.921+0000 7fc060560640 1 -- 172.21.15.120:0/2381637300 wait complete. 2024-09-19T05:18:59.516 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:59 smithi120 ceph-mon[30956]: pgmap v319: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T05:18:59.516 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:18:59 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2381637300' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T05:18:59.543 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T05:18:59.554 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:18:59.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:59 smithi194 ceph-mon[35228]: pgmap v319: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T05:18:59.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:18:59 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/2381637300' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T05:18:59.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:59 smithi178 ceph-mon[34347]: pgmap v319: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T05:18:59.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:18:59 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/2381637300' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T05:18:59.801 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:00.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.213+0000 7feed96d4640 1 -- 172.21.15.120:0/801814211 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feed4101de0 msgr2=0x7feed41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:00.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.213+0000 7feed96d4640 1 --2- 172.21.15.120:0/801814211 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feed4101de0 0x7feed41021c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7feec4009900 tx=0x7feec402a410 comp rx=0 tx=0).stop 2024-09-19T05:19:00.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.213+0000 7feed96d4640 1 -- 172.21.15.120:0/801814211 shutdown_connections 2024-09-19T05:19:00.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.213+0000 7feed96d4640 1 --2- 172.21.15.120:0/801814211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feed4106f10 0x7feed410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:00.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.213+0000 7feed96d4640 1 --2- 172.21.15.120:0/801814211 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feed4102790 0x7feed41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:00.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.213+0000 7feed96d4640 1 --2- 172.21.15.120:0/801814211 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feed4101de0 0x7feed41021c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:00.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.213+0000 7feed96d4640 1 -- 172.21.15.120:0/801814211 >> 172.21.15.120:0/801814211 conn(0x7feed40fd8c0 msgr2=0x7feed40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:00.244 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.213+0000 7feed96d4640 1 -- 172.21.15.120:0/801814211 shutdown_connections 2024-09-19T05:19:00.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.213+0000 7feed96d4640 1 -- 172.21.15.120:0/801814211 wait complete. 2024-09-19T05:19:00.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.214+0000 7feed96d4640 1 Processor -- start 2024-09-19T05:19:00.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.214+0000 7feed96d4640 1 -- start start 2024-09-19T05:19:00.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.214+0000 7feed96d4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feed4101de0 0x7feed40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:00.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.214+0000 7feed96d4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feed4102790 0x7feed4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:00.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.214+0000 7feed96d4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feed4106f10 0x7feed4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:00.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.214+0000 7feed96d4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7feed4111ec0 con 0x7feed4101de0 2024-09-19T05:19:00.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.214+0000 7feed96d4640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7feed4111d40 con 0x7feed4106f10 2024-09-19T05:19:00.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.214+0000 7feed96d4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7feed4112040 con 0x7feed4102790 2024-09-19T05:19:00.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.214+0000 7feed2ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feed4101de0 0x7feed40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:00.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.214+0000 7feed2ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feed4101de0 0x7feed40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37454/0 (socket says 172.21.15.120:37454) 2024-09-19T05:19:00.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.214+0000 7feed2ffd640 1 -- 172.21.15.120:0/1966417978 learned_addr learned my addr 172.21.15.120:0/1966417978 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:00.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.215+0000 7feed37fe640 1 --2- 172.21.15.120:0/1966417978 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feed4106f10 0x7feed4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:00.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.215+0000 7feed27fc640 1 --2- 172.21.15.120:0/1966417978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feed4102790 0x7feed4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:00.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.215+0000 7feed2ffd640 1 -- 172.21.15.120:0/1966417978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feed4102790 msgr2=0x7feed4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:00.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.215+0000 7feed2ffd640 1 --2- 172.21.15.120:0/1966417978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feed4102790 0x7feed4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:00.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.215+0000 7feed2ffd640 1 -- 172.21.15.120:0/1966417978 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feed4106f10 msgr2=0x7feed4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:00.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.215+0000 7feed2ffd640 1 --2- 172.21.15.120:0/1966417978 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feed4106f10 0x7feed4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:00.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.215+0000 7feed2ffd640 1 -- 172.21.15.120:0/1966417978 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed41a69e0 con 0x7feed4101de0 2024-09-19T05:19:00.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.215+0000 7feed37fe640 1 --2- 172.21.15.120:0/1966417978 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feed4106f10 0x7feed4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:00.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.215+0000 7feed27fc640 1 --2- 172.21.15.120:0/1966417978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feed4102790 0x7feed4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:00.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.215+0000 7feed2ffd640 1 --2- 172.21.15.120:0/1966417978 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feed4101de0 0x7feed40744f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7feec4006010 tx=0x7feec4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:00.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.215+0000 7feebbfff640 1 -- 172.21.15.120:0/1966417978 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec403f030 con 0x7feed4101de0 2024-09-19T05:19:00.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.215+0000 7feed96d4640 1 -- 172.21.15.120:0/1966417978 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feed41a6c70 con 0x7feed4101de0 2024-09-19T05:19:00.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.215+0000 7feebbfff640 1 -- 172.21.15.120:0/1966417978 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7feec40035f0 con 0x7feed4101de0 2024-09-19T05:19:00.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.215+0000 7feebbfff640 1 -- 172.21.15.120:0/1966417978 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec4035070 con 0x7feed4101de0 2024-09-19T05:19:00.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.215+0000 7feed96d4640 1 -- 172.21.15.120:0/1966417978 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feed41a71a0 con 0x7feed4101de0 2024-09-19T05:19:00.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.216+0000 7feed96d4640 1 -- 172.21.15.120:0/1966417978 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feed4102240 con 0x7feed4101de0 2024-09-19T05:19:00.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.217+0000 7feebbfff640 1 -- 172.21.15.120:0/1966417978 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7feec4003b10 con 0x7feed4101de0 2024-09-19T05:19:00.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.218+0000 7feebbfff640 1 --2- 172.21.15.120:0/1966417978 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7feebc0a3350 0x7feebc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:00.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.218+0000 7feed27fc640 1 --2- 172.21.15.120:0/1966417978 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7feebc0a3350 0x7feebc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:00.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.218+0000 7feebbfff640 1 -- 172.21.15.120:0/1966417978 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8298+0+0 (secure 0 0 0) 0x7feec40f0690 con 0x7feed4101de0 2024-09-19T05:19:00.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.218+0000 7feed27fc640 1 --2- 172.21.15.120:0/1966417978 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7feebc0a3350 0x7feebc0a5810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7feec8006fd0 tx=0x7feec8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:00.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.222+0000 7feebbfff640 1 -- 172.21.15.120:0/1966417978 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feec40bd210 con 0x7feed4101de0 2024-09-19T05:19:00.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.428+0000 7feed96d4640 1 -- 172.21.15.120:0/1966417978 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feed4109b60 con 0x7feed4101de0 2024-09-19T05:19:00.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.429+0000 7feebbfff640 1 -- 172.21.15.120:0/1966417978 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11921 (secure 0 0 0) 0x7feec40bcb10 con 0x7feed4101de0 2024-09-19T05:19:00.431 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:19:00.431 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":24,"btime":"2024-09-19T05:17:42:231927+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/93472898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":93472898},{"type":"v1","addr":"172.21.15.120:6835","nonce":93472898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1976835398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1976835398},{"type":"v1","addr":"172.21.15.120:6837","nonce":1976835398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6839/2975851469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":2975851469},{"type":"v1","addr":"172.21.15.120:6839","nonce":2975851469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6841/2837552754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":2837552754},{"type":"v1","addr":"172.21.15.120:6841","nonce":2837552754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/61682954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":61682954},{"type":"v1","addr":"172.21.15.178:6833","nonce":61682954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1778722040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1778722040},{"type":"v1","addr":"172.21.15.194:6833","nonce":1778722040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:17:30.796197+0000","modified":"2024-09-19T05:17:41.861437+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24445,"mds_1":24443,"mds_2":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24401":{"gid":24401,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/890775592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":890775592},{"type":"v1","addr":"172.21.15.178:6835","nonce":890775592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6837/3960720164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3960720164},{"type":"v1","addr":"172.21.15.178:6837","nonce":3960720164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6835/3268846994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3268846994},{"type":"v1","addr":"172.21.15.194:6835","nonce":3268846994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.194:6837/378729335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":378729335},{"type":"v1","addr":"172.21.15.194:6837","nonce":378729335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.178:6839/3389137566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3389137566},{"type":"v1","addr":"172.21.15.178:6839","nonce":3389137566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6839/3817420679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3817420679},{"type":"v1","addr":"172.21.15.194:6839","nonce":3817420679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24445,"qdb_cluster":[24430,24443,24445]},"id":1}]} 2024-09-19T05:19:00.431 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 24 2024-09-19T05:19:00.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.431+0000 7feed96d4640 1 -- 172.21.15.120:0/1966417978 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7feebc0a3350 msgr2=0x7feebc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:00.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.431+0000 7feed96d4640 1 --2- 172.21.15.120:0/1966417978 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7feebc0a3350 0x7feebc0a5810 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7feec8006fd0 tx=0x7feec8008040 comp rx=0 tx=0).stop 2024-09-19T05:19:00.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.431+0000 7feed96d4640 1 -- 172.21.15.120:0/1966417978 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feed4101de0 msgr2=0x7feed40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:00.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.431+0000 7feed96d4640 1 --2- 172.21.15.120:0/1966417978 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feed4101de0 0x7feed40744f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7feec4006010 tx=0x7feec4004270 comp rx=0 tx=0).stop 2024-09-19T05:19:00.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.431+0000 7feed96d4640 1 -- 172.21.15.120:0/1966417978 shutdown_connections 2024-09-19T05:19:00.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.431+0000 7feed96d4640 1 --2- 172.21.15.120:0/1966417978 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feed4106f10 0x7feed4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:00.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.431+0000 7feed96d4640 1 --2- 172.21.15.120:0/1966417978 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7feebc0a3350 0x7feebc0a5810 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:00.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.431+0000 7feed96d4640 1 --2- 172.21.15.120:0/1966417978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feed4102790 0x7feed4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:00.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.431+0000 7feed96d4640 1 --2- 172.21.15.120:0/1966417978 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7feed4101de0 0x7feed40744f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:00.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.431+0000 7feed96d4640 1 -- 172.21.15.120:0/1966417978 >> 172.21.15.120:0/1966417978 conn(0x7feed40fd8c0 msgr2=0x7feed40fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:00.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.431+0000 7feed96d4640 1 -- 172.21.15.120:0/1966417978 shutdown_connections 2024-09-19T05:19:00.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:00.431+0000 7feed96d4640 1 -- 172.21.15.120:0/1966417978 wait complete. 2024-09-19T05:19:01.136 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:19:01.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:01 smithi120 ceph-mon[30956]: pgmap v320: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T05:19:01.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:01 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1966417978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:19:01.382 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:01.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:01 smithi194 ceph-mon[35228]: pgmap v320: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T05:19:01.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:01 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1966417978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:19:01.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:01 smithi178 ceph-mon[34347]: pgmap v320: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T05:19:01.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:01 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1966417978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:19:01.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.828+0000 7f67b467d640 1 -- 172.21.15.120:0/1934382883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67ac10c2f0 msgr2=0x7f67ac10e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:01.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.828+0000 7f67b467d640 1 --2- 172.21.15.120:0/1934382883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67ac10c2f0 0x7f67ac10e790 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f679c009ca0 tx=0x7f679c02a8e0 comp rx=0 tx=0).stop 2024-09-19T05:19:01.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.828+0000 7f67b467d640 1 -- 172.21.15.120:0/1934382883 shutdown_connections 2024-09-19T05:19:01.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.828+0000 7f67b467d640 1 --2- 172.21.15.120:0/1934382883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67ac10c2f0 0x7f67ac10e790 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:01.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.828+0000 7f67b467d640 1 --2- 172.21.15.120:0/1934382883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67ac1037a0 0x7f67ac10bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:01.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.828+0000 7f67b467d640 1 --2- 172.21.15.120:0/1934382883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f67ac102df0 0x7f67ac1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:01.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.828+0000 7f67b467d640 1 -- 172.21.15.120:0/1934382883 >> 172.21.15.120:0/1934382883 conn(0x7f67ac0fc7d0 msgr2=0x7f67ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:01.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.828+0000 7f67b467d640 1 -- 172.21.15.120:0/1934382883 shutdown_connections 2024-09-19T05:19:01.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.828+0000 7f67b467d640 1 -- 172.21.15.120:0/1934382883 wait complete. 2024-09-19T05:19:01.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.828+0000 7f67b467d640 1 Processor -- start 2024-09-19T05:19:01.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.828+0000 7f67b467d640 1 -- start start 2024-09-19T05:19:01.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.828+0000 7f67b467d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67ac102df0 0x7f67ac1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:01.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.828+0000 7f67b467d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67ac1037a0 0x7f67ac198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:01.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.828+0000 7f67b467d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f67ac10c2f0 0x7f67ac19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:01.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.828+0000 7f67b467d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac112080 con 0x7f67ac1037a0 2024-09-19T05:19:01.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.828+0000 7f67b467d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac111f00 con 0x7f67ac10c2f0 2024-09-19T05:19:01.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.828+0000 7f67b467d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f67ac112200 con 0x7f67ac102df0 2024-09-19T05:19:01.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.829+0000 7f67b1c18640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67ac1037a0 0x7f67ac198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:01.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.829+0000 7f67b1c18640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67ac1037a0 0x7f67ac198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37478/0 (socket says 172.21.15.120:37478) 2024-09-19T05:19:01.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.829+0000 7f67b1c18640 1 -- 172.21.15.120:0/2247473975 learned_addr learned my addr 172.21.15.120:0/2247473975 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:01.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.829+0000 7f67b2419640 1 --2- 172.21.15.120:0/2247473975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67ac102df0 0x7f67ac1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:01.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.829+0000 7f67b2c1a640 1 --2- 172.21.15.120:0/2247473975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f67ac10c2f0 0x7f67ac19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:01.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.829+0000 7f67b1c18640 1 -- 172.21.15.120:0/2247473975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67ac102df0 msgr2=0x7f67ac1985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:01.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.829+0000 7f67b1c18640 1 --2- 172.21.15.120:0/2247473975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67ac102df0 0x7f67ac1985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:01.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.829+0000 7f67b1c18640 1 -- 172.21.15.120:0/2247473975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f67ac10c2f0 msgr2=0x7f67ac19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:01.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.829+0000 7f67b1c18640 1 --2- 172.21.15.120:0/2247473975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f67ac10c2f0 0x7f67ac19ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:01.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.829+0000 7f67b1c18640 1 -- 172.21.15.120:0/2247473975 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67ac19d570 con 0x7f67ac1037a0 2024-09-19T05:19:01.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.829+0000 7f67b1c18640 1 --2- 172.21.15.120:0/2247473975 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67ac1037a0 0x7f67ac198b00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f67a0006fd0 tx=0x7f67a000b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:01.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.829+0000 7f67ab7fe640 1 -- 172.21.15.120:0/2247473975 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a0015020 con 0x7f67ac1037a0 2024-09-19T05:19:01.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.829+0000 7f67b467d640 1 -- 172.21.15.120:0/2247473975 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67ac19d860 con 0x7f67ac1037a0 2024-09-19T05:19:01.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.829+0000 7f67ab7fe640 1 -- 172.21.15.120:0/2247473975 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f67a0011ce0 con 0x7f67ac1037a0 2024-09-19T05:19:01.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.829+0000 7f67ab7fe640 1 -- 172.21.15.120:0/2247473975 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a0010d90 con 0x7f67ac1037a0 2024-09-19T05:19:01.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.829+0000 7f67b467d640 1 -- 172.21.15.120:0/2247473975 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67ac1a5140 con 0x7f67ac1037a0 2024-09-19T05:19:01.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.830+0000 7f67b467d640 1 -- 172.21.15.120:0/2247473975 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67ac1031d0 con 0x7f67ac1037a0 2024-09-19T05:19:01.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.831+0000 7f67ab7fe640 1 -- 172.21.15.120:0/2247473975 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f67a0018020 con 0x7f67ac1037a0 2024-09-19T05:19:01.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.832+0000 7f67ab7fe640 1 --2- 172.21.15.120:0/2247473975 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f67940a32d0 0x7f67940a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:01.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.832+0000 7f67b2419640 1 --2- 172.21.15.120:0/2247473975 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f67940a32d0 0x7f67940a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:01.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.832+0000 7f67ab7fe640 1 -- 172.21.15.120:0/2247473975 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8298+0+0 (secure 0 0 0) 0x7f67a00cf2e0 con 0x7f67ac1037a0 2024-09-19T05:19:01.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.832+0000 7f67b2419640 1 --2- 172.21.15.120:0/2247473975 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f67940a32d0 0x7f67940a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f67a4009990 tx=0x7f67a4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:01.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:01.836+0000 7f67ab7fe640 1 -- 172.21.15.120:0/2247473975 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f67a001f020 con 0x7f67ac1037a0 2024-09-19T05:19:02.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:02.037+0000 7f67b467d640 1 -- 172.21.15.120:0/2247473975 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67ac1072c0 con 0x7f67ac1037a0 2024-09-19T05:19:02.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:02.038+0000 7f67ab7fe640 1 -- 172.21.15.120:0/2247473975 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11921 (secure 0 0 0) 0x7f67a009bf70 con 0x7f67ac1037a0 2024-09-19T05:19:02.040 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:19:02.040 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":24,"btime":"2024-09-19T05:17:42:231927+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/93472898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":93472898},{"type":"v1","addr":"172.21.15.120:6835","nonce":93472898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1976835398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1976835398},{"type":"v1","addr":"172.21.15.120:6837","nonce":1976835398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6839/2975851469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":2975851469},{"type":"v1","addr":"172.21.15.120:6839","nonce":2975851469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6841/2837552754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":2837552754},{"type":"v1","addr":"172.21.15.120:6841","nonce":2837552754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/61682954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":61682954},{"type":"v1","addr":"172.21.15.178:6833","nonce":61682954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1778722040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1778722040},{"type":"v1","addr":"172.21.15.194:6833","nonce":1778722040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:17:30.796197+0000","modified":"2024-09-19T05:17:41.861437+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24445,"mds_1":24443,"mds_2":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24401":{"gid":24401,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/890775592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":890775592},{"type":"v1","addr":"172.21.15.178:6835","nonce":890775592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6837/3960720164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3960720164},{"type":"v1","addr":"172.21.15.178:6837","nonce":3960720164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6835/3268846994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3268846994},{"type":"v1","addr":"172.21.15.194:6835","nonce":3268846994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.194:6837/378729335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":378729335},{"type":"v1","addr":"172.21.15.194:6837","nonce":378729335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.178:6839/3389137566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3389137566},{"type":"v1","addr":"172.21.15.178:6839","nonce":3389137566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6839/3817420679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3817420679},{"type":"v1","addr":"172.21.15.194:6839","nonce":3817420679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24445,"qdb_cluster":[24430,24443,24445]},"id":1}]} 2024-09-19T05:19:02.040 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 24 2024-09-19T05:19:02.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:02.040+0000 7f67b467d640 1 -- 172.21.15.120:0/2247473975 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f67940a32d0 msgr2=0x7f67940a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:02.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:02.040+0000 7f67b467d640 1 --2- 172.21.15.120:0/2247473975 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f67940a32d0 0x7f67940a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f67a4009990 tx=0x7f67a4009110 comp rx=0 tx=0).stop 2024-09-19T05:19:02.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:02.040+0000 7f67b467d640 1 -- 172.21.15.120:0/2247473975 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67ac1037a0 msgr2=0x7f67ac198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:02.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:02.040+0000 7f67b467d640 1 --2- 172.21.15.120:0/2247473975 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67ac1037a0 0x7f67ac198b00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f67a0006fd0 tx=0x7f67a000b820 comp rx=0 tx=0).stop 2024-09-19T05:19:02.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:02.040+0000 7f67b467d640 1 -- 172.21.15.120:0/2247473975 shutdown_connections 2024-09-19T05:19:02.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:02.040+0000 7f67b467d640 1 --2- 172.21.15.120:0/2247473975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f67ac10c2f0 0x7f67ac19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:02.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:02.040+0000 7f67b467d640 1 --2- 172.21.15.120:0/2247473975 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67ac1037a0 0x7f67ac198b00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:02.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:02.040+0000 7f67b467d640 1 --2- 172.21.15.120:0/2247473975 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f67940a32d0 0x7f67940a5790 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:02.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:02.040+0000 7f67b467d640 1 --2- 172.21.15.120:0/2247473975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67ac102df0 0x7f67ac1985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:02.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:02.040+0000 7f67b467d640 1 -- 172.21.15.120:0/2247473975 >> 172.21.15.120:0/2247473975 conn(0x7f67ac0fc7d0 msgr2=0x7f67ac0fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:02.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:02.040+0000 7f67b467d640 1 -- 172.21.15.120:0/2247473975 shutdown_connections 2024-09-19T05:19:02.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:02.040+0000 7f67b467d640 1 -- 172.21.15.120:0/2247473975 wait complete. 2024-09-19T05:19:02.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:02 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2247473975' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:19:02.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:02 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/2247473975' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:19:02.682 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T05:19:02.691 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:02 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/2247473975' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:19:02.927 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:03.332 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:03 smithi120 ceph-mon[30956]: pgmap v321: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 1 B/s, 0 objects/s recovering 2024-09-19T05:19:03.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.410+0000 7fd5e5ecb640 1 -- 172.21.15.120:0/2511915971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5e0101de0 msgr2=0x7fd5e01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:03.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.410+0000 7fd5e5ecb640 1 --2- 172.21.15.120:0/2511915971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5e0101de0 0x7fd5e01021c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0009900 tx=0x7fd5d002a410 comp rx=0 tx=0).stop 2024-09-19T05:19:03.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.410+0000 7fd5e5ecb640 1 -- 172.21.15.120:0/2511915971 shutdown_connections 2024-09-19T05:19:03.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.410+0000 7fd5e5ecb640 1 --2- 172.21.15.120:0/2511915971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5e0106f10 0x7fd5e010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:03.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.410+0000 7fd5e5ecb640 1 --2- 172.21.15.120:0/2511915971 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5e0102790 0x7fd5e01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:03.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.410+0000 7fd5e5ecb640 1 --2- 172.21.15.120:0/2511915971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5e0101de0 0x7fd5e01021c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:03.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.410+0000 7fd5e5ecb640 1 -- 172.21.15.120:0/2511915971 >> 172.21.15.120:0/2511915971 conn(0x7fd5e00fd8c0 msgr2=0x7fd5e00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:03.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.410+0000 7fd5e5ecb640 1 -- 172.21.15.120:0/2511915971 shutdown_connections 2024-09-19T05:19:03.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.410+0000 7fd5e5ecb640 1 -- 172.21.15.120:0/2511915971 wait complete. 2024-09-19T05:19:03.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.411+0000 7fd5e5ecb640 1 Processor -- start 2024-09-19T05:19:03.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.411+0000 7fd5e5ecb640 1 -- start start 2024-09-19T05:19:03.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.411+0000 7fd5e5ecb640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5e0101de0 0x7fd5e0198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:03.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.411+0000 7fd5e5ecb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5e0102790 0x7fd5e0198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:03.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.411+0000 7fd5e5ecb640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5e0106f10 0x7fd5e019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:03.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.411+0000 7fd5e5ecb640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e0111ec0 con 0x7fd5e0102790 2024-09-19T05:19:03.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.411+0000 7fd5e5ecb640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e0111d40 con 0x7fd5e0106f10 2024-09-19T05:19:03.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.411+0000 7fd5e5ecb640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e0112040 con 0x7fd5e0101de0 2024-09-19T05:19:03.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.411+0000 7fd5deffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5e0102790 0x7fd5e0198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:03.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.411+0000 7fd5deffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5e0102790 0x7fd5e0198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37494/0 (socket says 172.21.15.120:37494) 2024-09-19T05:19:03.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.411+0000 7fd5deffd640 1 -- 172.21.15.120:0/1333022493 learned_addr learned my addr 172.21.15.120:0/1333022493 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:03.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.411+0000 7fd5dffff640 1 --2- 172.21.15.120:0/1333022493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5e0106f10 0x7fd5e019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:03.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.412+0000 7fd5df7fe640 1 --2- 172.21.15.120:0/1333022493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5e0101de0 0x7fd5e0198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:03.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.412+0000 7fd5deffd640 1 -- 172.21.15.120:0/1333022493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5e0101de0 msgr2=0x7fd5e0198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:03.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.412+0000 7fd5deffd640 1 --2- 172.21.15.120:0/1333022493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5e0101de0 0x7fd5e0198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:03.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.412+0000 7fd5deffd640 1 -- 172.21.15.120:0/1333022493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5e0106f10 msgr2=0x7fd5e019cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:03.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.412+0000 7fd5deffd640 1 --2- 172.21.15.120:0/1333022493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5e0106f10 0x7fd5e019cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:03.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.412+0000 7fd5deffd640 1 -- 172.21.15.120:0/1333022493 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e019d4d0 con 0x7fd5e0102790 2024-09-19T05:19:03.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.412+0000 7fd5dffff640 1 --2- 172.21.15.120:0/1333022493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5e0106f10 0x7fd5e019cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:03.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.412+0000 7fd5df7fe640 1 --2- 172.21.15.120:0/1333022493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5e0101de0 0x7fd5e0198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:03.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.412+0000 7fd5deffd640 1 --2- 172.21.15.120:0/1333022493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5e0102790 0x7fd5e0198a60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400b4a0 tx=0x7fd5d400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:03.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.412+0000 7fd5dcff9640 1 -- 172.21.15.120:0/1333022493 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4014070 con 0x7fd5e0102790 2024-09-19T05:19:03.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.412+0000 7fd5e5ecb640 1 -- 172.21.15.120:0/1333022493 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e019d7c0 con 0x7fd5e0102790 2024-09-19T05:19:03.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.412+0000 7fd5dcff9640 1 -- 172.21.15.120:0/1333022493 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd5d4010ac0 con 0x7fd5e0102790 2024-09-19T05:19:03.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.412+0000 7fd5dcff9640 1 -- 172.21.15.120:0/1333022493 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4017c30 con 0x7fd5e0102790 2024-09-19T05:19:03.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.412+0000 7fd5e5ecb640 1 -- 172.21.15.120:0/1333022493 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e01a50a0 con 0x7fd5e0102790 2024-09-19T05:19:03.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.413+0000 7fd5e5ecb640 1 -- 172.21.15.120:0/1333022493 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e0102240 con 0x7fd5e0102790 2024-09-19T05:19:03.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.414+0000 7fd5dcff9640 1 -- 172.21.15.120:0/1333022493 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fd5d4017070 con 0x7fd5e0102790 2024-09-19T05:19:03.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.414+0000 7fd5dcff9640 1 --2- 172.21.15.120:0/1333022493 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd5c80a32d0 0x7fd5c80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:03.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.415+0000 7fd5df7fe640 1 --2- 172.21.15.120:0/1333022493 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd5c80a32d0 0x7fd5c80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:03.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.415+0000 7fd5dcff9640 1 -- 172.21.15.120:0/1333022493 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8298+0+0 (secure 0 0 0) 0x7fd5d40cf160 con 0x7fd5e0102790 2024-09-19T05:19:03.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.415+0000 7fd5df7fe640 1 --2- 172.21.15.120:0/1333022493 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd5c80a32d0 0x7fd5c80a5790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0000c00 tx=0x7fd5d0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:03.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.419+0000 7fd5dcff9640 1 -- 172.21.15.120:0/1333022493 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd5d409bdf0 con 0x7fd5e0102790 2024-09-19T05:19:03.587 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.585+0000 7fd5e5ecb640 1 -- 172.21.15.120:0/1333022493 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5e0109b60 con 0x7fd5e0102790 2024-09-19T05:19:03.588 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.587+0000 7fd5dcff9640 1 -- 172.21.15.120:0/1333022493 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+22908 (secure 0 0 0) 0x7fd5d409b6f0 con 0x7fd5e0102790 2024-09-19T05:19:03.589 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:19:03.589 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":84,"fsid":"4e6e3df4-7645-11ef-bceb-c7b262605968","created":"2024-09-19T05:09:55.847220+0000","modified":"2024-09-19T05:18:50.231286+0000","last_up_change":"2024-09-19T05:16:42.808178+0000","last_in_change":"2024-09-19T05:16:18.315940+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:13:02.340027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:17:26.914416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:17:29.112997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"18907a03-1f43-419a-acb6-9fa4cf5020d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6803","nonce":3421474326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6805","nonce":3421474326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6809","nonce":3421474326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6807","nonce":3421474326}]},"public_addr":"172.21.15.120:6803/3421474326","cluster_addr":"172.21.15.120:6805/3421474326","heartbeat_back_addr":"172.21.15.120:6809/3421474326","heartbeat_front_addr":"172.21.15.120:6807/3421474326","state":["exists","up"]},{"osd":1,"uuid":"d21e029b-8a60-43f9-9ba7-30cdba19ba57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6801","nonce":1195511218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6803","nonce":1195511218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6807","nonce":1195511218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6805","nonce":1195511218}]},"public_addr":"172.21.15.178:6801/1195511218","cluster_addr":"172.21.15.178:6803/1195511218","heartbeat_back_addr":"172.21.15.178:6807/1195511218","heartbeat_front_addr":"172.21.15.178:6805/1195511218","state":["exists","up"]},{"osd":2,"uuid":"26ad9c8d-dbaa-46c2-a346-19717d81cc60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6801","nonce":3752826560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6803","nonce":3752826560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6807","nonce":3752826560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6805","nonce":3752826560}]},"public_addr":"172.21.15.194:6801/3752826560","cluster_addr":"172.21.15.194:6803/3752826560","heartbeat_back_addr":"172.21.15.194:6807/3752826560","heartbeat_front_addr":"172.21.15.194:6805/3752826560","state":["exists","up"]},{"osd":3,"uuid":"7e266576-8a98-40a8-9532-4b6f4611a908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6811","nonce":803566783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6813","nonce":803566783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6817","nonce":803566783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6815","nonce":803566783}]},"public_addr":"172.21.15.120:6811/803566783","cluster_addr":"172.21.15.120:6813/803566783","heartbeat_back_addr":"172.21.15.120:6817/803566783","heartbeat_front_addr":"172.21.15.120:6815/803566783","state":["exists","up"]},{"osd":4,"uuid":"c77d05c5-3b8f-4f7b-91f9-833735221684","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6809","nonce":541165323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6811","nonce":541165323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6815","nonce":541165323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6813","nonce":541165323}]},"public_addr":"172.21.15.178:6809/541165323","cluster_addr":"172.21.15.178:6811/541165323","heartbeat_back_addr":"172.21.15.178:6815/541165323","heartbeat_front_addr":"172.21.15.178:6813/541165323","state":["exists","up"]},{"osd":5,"uuid":"5f1c394b-e510-411f-969a-2db2b68cf41a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6809","nonce":2631415468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6811","nonce":2631415468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6815","nonce":2631415468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6813","nonce":2631415468}]},"public_addr":"172.21.15.194:6809/2631415468","cluster_addr":"172.21.15.194:6811/2631415468","heartbeat_back_addr":"172.21.15.194:6815/2631415468","heartbeat_front_addr":"172.21.15.194:6813/2631415468","state":["exists","up"]},{"osd":6,"uuid":"990af639-099e-49df-a083-05626cee3c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6819","nonce":388238976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6821","nonce":388238976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6825","nonce":388238976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6823","nonce":388238976}]},"public_addr":"172.21.15.120:6819/388238976","cluster_addr":"172.21.15.120:6821/388238976","heartbeat_back_addr":"172.21.15.120:6825/388238976","heartbeat_front_addr":"172.21.15.120:6823/388238976","state":["exists","up"]},{"osd":7,"uuid":"6f4aa6ab-b5f4-4c06-9f14-9a51bc195ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6817","nonce":1912109177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6819","nonce":1912109177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6823","nonce":1912109177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6821","nonce":1912109177}]},"public_addr":"172.21.15.178:6817/1912109177","cluster_addr":"172.21.15.178:6819/1912109177","heartbeat_back_addr":"172.21.15.178:6823/1912109177","heartbeat_front_addr":"172.21.15.178:6821/1912109177","state":["exists","up"]},{"osd":8,"uuid":"707739c9-732a-405c-847a-ce6a06e611b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6817","nonce":596878172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6819","nonce":596878172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6823","nonce":596878172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6821","nonce":596878172}]},"public_addr":"172.21.15.194:6817/596878172","cluster_addr":"172.21.15.194:6819/596878172","heartbeat_back_addr":"172.21.15.194:6823/596878172","heartbeat_front_addr":"172.21.15.194:6821/596878172","state":["exists","up"]},{"osd":9,"uuid":"9393b018-c924-4d75-99e5-25433d276567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6827","nonce":3257373801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6829","nonce":3257373801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6833","nonce":3257373801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6831","nonce":3257373801}]},"public_addr":"172.21.15.120:6827/3257373801","cluster_addr":"172.21.15.120:6829/3257373801","heartbeat_back_addr":"172.21.15.120:6833/3257373801","heartbeat_front_addr":"172.21.15.120:6831/3257373801","state":["exists","up"]},{"osd":10,"uuid":"45db7f62-87a6-4b2b-a3dc-012e2de505e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6825","nonce":3067822030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6827","nonce":3067822030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6831","nonce":3067822030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6829","nonce":3067822030}]},"public_addr":"172.21.15.178:6825/3067822030","cluster_addr":"172.21.15.178:6827/3067822030","heartbeat_back_addr":"172.21.15.178:6831/3067822030","heartbeat_front_addr":"172.21.15.178:6829/3067822030","state":["exists","up"]},{"osd":11,"uuid":"85ea248c-9a36-41cb-a200-87138fb31602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6825","nonce":2713146974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6827","nonce":2713146974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6831","nonce":2713146974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6829","nonce":2713146974}]},"public_addr":"172.21.15.194:6825/2713146974","cluster_addr":"172.21.15.194:6827/2713146974","heartbeat_back_addr":"172.21.15.194:6831/2713146974","heartbeat_front_addr":"172.21.15.194:6829/2713146974","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:09.395371+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:33.648930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:58.805048+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:23.621459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:48.553860+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:13.506636+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:38.520376+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:02.695124+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:27.084956+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:50.924128+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:15.396694+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:40.440416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":3,"to":8}]},{"pgid":"3.2a","mappings":[{"from":3,"to":6}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:0/3419110398":"2024-09-20T05:10:48.027892+0000","172.21.15.120:6801/50152720":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/4177074351":"2024-09-20T05:10:48.027892+0000","172.21.15.120:6800/50152720":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/329623296":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/2867300720":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/3592867428":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/4255533863":"2024-09-20T05:10:23.348128+0000","172.21.15.120:6801/3412493069":"2024-09-20T05:10:23.348128+0000","172.21.15.120:6800/3412493069":"2024-09-20T05:10:23.348128+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:19:03.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.589+0000 7fd5e5ecb640 1 -- 172.21.15.120:0/1333022493 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd5c80a32d0 msgr2=0x7fd5c80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:03.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.589+0000 7fd5e5ecb640 1 --2- 172.21.15.120:0/1333022493 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd5c80a32d0 0x7fd5c80a5790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0000c00 tx=0x7fd5d0031400 comp rx=0 tx=0).stop 2024-09-19T05:19:03.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.589+0000 7fd5e5ecb640 1 -- 172.21.15.120:0/1333022493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5e0102790 msgr2=0x7fd5e0198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:03.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.589+0000 7fd5e5ecb640 1 --2- 172.21.15.120:0/1333022493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5e0102790 0x7fd5e0198a60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400b4a0 tx=0x7fd5d400b960 comp rx=0 tx=0).stop 2024-09-19T05:19:03.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.589+0000 7fd5e5ecb640 1 -- 172.21.15.120:0/1333022493 shutdown_connections 2024-09-19T05:19:03.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.589+0000 7fd5e5ecb640 1 --2- 172.21.15.120:0/1333022493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5e0106f10 0x7fd5e019cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:03.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.589+0000 7fd5e5ecb640 1 --2- 172.21.15.120:0/1333022493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5e0102790 0x7fd5e0198a60 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:03.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.589+0000 7fd5e5ecb640 1 --2- 172.21.15.120:0/1333022493 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fd5c80a32d0 0x7fd5c80a5790 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:03.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.589+0000 7fd5e5ecb640 1 --2- 172.21.15.120:0/1333022493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5e0101de0 0x7fd5e0198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:03.591 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.589+0000 7fd5e5ecb640 1 -- 172.21.15.120:0/1333022493 >> 172.21.15.120:0/1333022493 conn(0x7fd5e00fd8c0 msgr2=0x7fd5e00fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:03.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.589+0000 7fd5e5ecb640 1 -- 172.21.15.120:0/1333022493 shutdown_connections 2024-09-19T05:19:03.592 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:03.589+0000 7fd5e5ecb640 1 -- 172.21.15.120:0/1333022493 wait complete. 2024-09-19T05:19:03.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:03 smithi194 ceph-mon[35228]: pgmap v321: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 1 B/s, 0 objects/s recovering 2024-09-19T05:19:03.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:03 smithi178 ceph-mon[34347]: pgmap v321: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 1 B/s, 0 objects/s recovering 2024-09-19T05:19:04.377 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:04 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1333022493' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:19:04.424 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T05:17:30.796197+0000', 'modified': '2024-09-19T05:17:41.861437+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24445, 'mds_1': 24443, 'mds_2': 24430}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24401': {'gid': 24401, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.178:6835/890775592', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6834', 'nonce': 890775592}, {'type': 'v1', 'addr': '172.21.15.178:6835', 'nonce': 890775592}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24419': {'gid': 24419, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.178:6837/3960720164', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6836', 'nonce': 3960720164}, {'type': 'v1', 'addr': '172.21.15.178:6837', 'nonce': 3960720164}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24424': {'gid': 24424, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.194:6835/3268846994', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6834', 'nonce': 3268846994}, {'type': 'v1', 'addr': '172.21.15.194:6835', 'nonce': 3268846994}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.194:6837/378729335', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6836', 'nonce': 378729335}, {'type': 'v1', 'addr': '172.21.15.194:6837', 'nonce': 378729335}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24443': {'gid': 24443, 'name': 'b', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.178:6839/3389137566', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6838', 'nonce': 3389137566}, {'type': 'v1', 'addr': '172.21.15.178:6839', 'nonce': 3389137566}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24445': {'gid': 24445, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.194:6839/3817420679', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6838', 'nonce': 3817420679}, {'type': 'v1', 'addr': '172.21.15.194:6839', 'nonce': 3817420679}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24445, 'qdb_cluster': [24430, 24443, 24445]} 2024-09-19T05:19:04.424 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T05:19:04.424 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T05:19:04.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:04 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1333022493' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:19:04.669 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:04.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:04 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1333022493' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:19:05.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.162+0000 7f58d7036640 1 -- 172.21.15.120:0/2973731528 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58d0106f10 msgr2=0x7f58d010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:05.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.162+0000 7f58d7036640 1 --2- 172.21.15.120:0/2973731528 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58d0106f10 0x7f58d010ea90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f58c8009ca0 tx=0x7f58c802a8c0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.162+0000 7f58d7036640 1 -- 172.21.15.120:0/2973731528 shutdown_connections 2024-09-19T05:19:05.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.162+0000 7f58d7036640 1 --2- 172.21.15.120:0/2973731528 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58d0106f10 0x7f58d010ea90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.162+0000 7f58d7036640 1 --2- 172.21.15.120:0/2973731528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58d0102790 0x7f58d01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.162+0000 7f58d7036640 1 --2- 172.21.15.120:0/2973731528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58d0101de0 0x7f58d01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.162+0000 7f58d7036640 1 -- 172.21.15.120:0/2973731528 >> 172.21.15.120:0/2973731528 conn(0x7f58d00fd8c0 msgr2=0x7f58d00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:05.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.162+0000 7f58d7036640 1 -- 172.21.15.120:0/2973731528 shutdown_connections 2024-09-19T05:19:05.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.162+0000 7f58d7036640 1 -- 172.21.15.120:0/2973731528 wait complete. 2024-09-19T05:19:05.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.163+0000 7f58d7036640 1 Processor -- start 2024-09-19T05:19:05.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.163+0000 7f58d7036640 1 -- start start 2024-09-19T05:19:05.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.163+0000 7f58d7036640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58d0101de0 0x7f58d0198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:05.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.163+0000 7f58d7036640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58d0102790 0x7f58d01989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:05.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.163+0000 7f58d7036640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58d0106f10 0x7f58d019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:05.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.163+0000 7f58d7036640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f58d0111ec0 con 0x7f58d0102790 2024-09-19T05:19:05.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.163+0000 7f58d7036640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f58d0111d40 con 0x7f58d0106f10 2024-09-19T05:19:05.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.163+0000 7f58d7036640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f58d0112040 con 0x7f58d0101de0 2024-09-19T05:19:05.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.163+0000 7f58cffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58d0102790 0x7f58d01989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:05.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.163+0000 7f58cffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58d0102790 0x7f58d01989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49258/0 (socket says 172.21.15.120:49258) 2024-09-19T05:19:05.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.163+0000 7f58cffff640 1 -- 172.21.15.120:0/2772671760 learned_addr learned my addr 172.21.15.120:0/2772671760 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:05.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.163+0000 7f58cffff640 1 -- 172.21.15.120:0/2772671760 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58d0101de0 msgr2=0x7f58d0198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:05.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.163+0000 7f58cffff640 1 --2- 172.21.15.120:0/2772671760 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58d0101de0 0x7f58d0198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.163+0000 7f58cffff640 1 -- 172.21.15.120:0/2772671760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58d0106f10 msgr2=0x7f58d019cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:05.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.163+0000 7f58cffff640 1 --2- 172.21.15.120:0/2772671760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58d0106f10 0x7f58d019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.163+0000 7f58cffff640 1 -- 172.21.15.120:0/2772671760 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d019d430 con 0x7f58d0102790 2024-09-19T05:19:05.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.163+0000 7f58cffff640 1 --2- 172.21.15.120:0/2772671760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58d0102790 0x7f58d01989c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f58bc00b4a0 tx=0x7f58bc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:05.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.163+0000 7f58cdffb640 1 -- 172.21.15.120:0/2772671760 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc014070 con 0x7f58d0102790 2024-09-19T05:19:05.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.164+0000 7f58cdffb640 1 -- 172.21.15.120:0/2772671760 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f58bc010ac0 con 0x7f58d0102790 2024-09-19T05:19:05.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.164+0000 7f58d7036640 1 -- 172.21.15.120:0/2772671760 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d019d720 con 0x7f58d0102790 2024-09-19T05:19:05.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.164+0000 7f58cdffb640 1 -- 172.21.15.120:0/2772671760 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc017c30 con 0x7f58d0102790 2024-09-19T05:19:05.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.164+0000 7f58d7036640 1 -- 172.21.15.120:0/2772671760 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d01a5000 con 0x7f58d0102790 2024-09-19T05:19:05.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.166+0000 7f58cdffb640 1 -- 172.21.15.120:0/2772671760 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f58bc017070 con 0x7f58d0102790 2024-09-19T05:19:05.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.166+0000 7f58d940f740 1 Processor -- start 2024-09-19T05:19:05.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.166+0000 7f58d940f740 1 -- start start 2024-09-19T05:19:05.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.166+0000 7f58cdffb640 1 --2- 172.21.15.120:0/2772671760 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f58c00a32d0 0x7f58c00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:05.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.167+0000 7f58d940f740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d33ed808b0 0x55d33ed80c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:05.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.167+0000 7f58d940f740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed811d0 0x55d33ed8fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:05.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.167+0000 7f58d940f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d33ed8ffc0 0x55d33ed923b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:05.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.167+0000 7f58d55d3640 1 --2- 172.21.15.120:0/2772671760 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f58c00a32d0 0x7f58c00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:05.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.167+0000 7f58d940f740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d33ece7090 con 0x55d33ed811d0 2024-09-19T05:19:05.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.167+0000 7f58d940f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d33ec8ea70 con 0x55d33ed8ffc0 2024-09-19T05:19:05.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.167+0000 7f58d940f740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55d33ece3050 con 0x55d33ed808b0 2024-09-19T05:19:05.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.167+0000 7f58cdffb640 1 -- 172.21.15.120:0/2772671760 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8298+0+0 (secure 0 0 0) 0x7f58bc0ceed0 con 0x7f58d0102790 2024-09-19T05:19:05.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.167+0000 7f58cffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed811d0 0x55d33ed8fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:05.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.167+0000 7f58cffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed811d0 0x55d33ed8fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49262/0 (socket says 172.21.15.120:49262) 2024-09-19T05:19:05.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.167+0000 7f58cffff640 1 -- 172.21.15.120:0/1761808690 learned_addr learned my addr 172.21.15.120:0/1761808690 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:05.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.167+0000 7f58d4dd2640 1 --2- 172.21.15.120:0/1761808690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d33ed808b0 0x55d33ed80c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:05.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.167+0000 7f58d55d3640 1 --2- 172.21.15.120:0/1761808690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d33ed8ffc0 0x55d33ed923b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:05.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.167+0000 7f58cffff640 1 -- 172.21.15.120:0/1761808690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d33ed808b0 msgr2=0x55d33ed80c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:05.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.167+0000 7f58cffff640 1 --2- 172.21.15.120:0/1761808690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d33ed808b0 0x55d33ed80c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.167+0000 7f58cffff640 1 -- 172.21.15.120:0/1761808690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d33ed8ffc0 msgr2=0x55d33ed923b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:05.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.167+0000 7f58cffff640 1 --2- 172.21.15.120:0/1761808690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d33ed8ffc0 0x55d33ed923b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.167+0000 7f58cffff640 1 -- 172.21.15.120:0/1761808690 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d33ec9b130 con 0x55d33ed811d0 2024-09-19T05:19:05.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.167+0000 7f58d55d3640 1 --2- 172.21.15.120:0/2772671760 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f58c00a32d0 0x7f58c00a5790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f58c8004af0 tx=0x7f58c80099e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:05.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.167+0000 7f58cffff640 1 --2- 172.21.15.120:0/1761808690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed811d0 0x55d33ed8fa80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f58bc097dd0 tx=0x7f58bc047e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c1d24cc2a590d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:05.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.167+0000 7f58baffd640 1 -- 172.21.15.120:0/1761808690 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc01e030 con 0x55d33ed811d0 2024-09-19T05:19:05.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.167+0000 7f58baffd640 1 -- 172.21.15.120:0/1761808690 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f58bc09bb00 con 0x55d33ed811d0 2024-09-19T05:19:05.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.167+0000 7f58baffd640 1 -- 172.21.15.120:0/1761808690 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc097a70 con 0x55d33ed811d0 2024-09-19T05:19:05.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.168+0000 7f58d940f740 1 -- 172.21.15.120:0/1761808690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed811d0 msgr2=0x55d33ed8fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:05.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.168+0000 7f58d940f740 1 --2- 172.21.15.120:0/1761808690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed811d0 0x55d33ed8fa80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f58bc097dd0 tx=0x7f58bc047e70 comp rx=0 tx=0).stop 2024-09-19T05:19:05.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.168+0000 7f58d940f740 1 -- 172.21.15.120:0/1761808690 shutdown_connections 2024-09-19T05:19:05.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.168+0000 7f58d940f740 1 --2- 172.21.15.120:0/1761808690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d33ed8ffc0 0x55d33ed923b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.168+0000 7f58d940f740 1 --2- 172.21.15.120:0/1761808690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed811d0 0x55d33ed8fa80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.168+0000 7f58d940f740 1 --2- 172.21.15.120:0/1761808690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d33ed808b0 0x55d33ed80c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.191 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.168+0000 7f58d940f740 1 -- 172.21.15.120:0/1761808690 >> 172.21.15.120:0/1761808690 conn(0x55d33ed7cf60 msgr2=0x55d33ed7d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:05.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.168+0000 7f58d940f740 1 -- 172.21.15.120:0/1761808690 shutdown_connections 2024-09-19T05:19:05.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.168+0000 7f58d940f740 1 -- 172.21.15.120:0/1761808690 wait complete. 2024-09-19T05:19:05.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.168+0000 7f58d940f740 1 -- start start 2024-09-19T05:19:05.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.168+0000 7f58d940f740 1 Processor -- start 2024-09-19T05:19:05.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.169+0000 7f58d940f740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d33ed808b0 0x55d33ed8f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:05.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.169+0000 7f58d940f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d33ed811d0 0x55d33ed8cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:05.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.169+0000 7f58d940f740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed8ffc0 0x55d33ed8d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:05.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.169+0000 7f58d940f740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d33ed92b90 con 0x55d33ed8ffc0 2024-09-19T05:19:05.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.169+0000 7f58d940f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d33eca1f20 con 0x55d33ed811d0 2024-09-19T05:19:05.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.169+0000 7f58d940f740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55d33ed92d10 con 0x55d33ed808b0 2024-09-19T05:19:05.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.169+0000 7f58d940f740 10 client.0 _ll_register_callbacks cb 0x55d33ec6b030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:19:05.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.169+0000 7f58d55d3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed8ffc0 0x55d33ed8d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:05.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.169+0000 7f58d55d3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed8ffc0 0x55d33ed8d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49276/0 (socket says 172.21.15.120:49276) 2024-09-19T05:19:05.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.169+0000 7f58d55d3640 1 -- 172.21.15.120:0/2309474370 learned_addr learned my addr 172.21.15.120:0/2309474370 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:05.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.169+0000 7f58d4dd2640 1 --2- 172.21.15.120:0/2309474370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d33ed808b0 0x55d33ed8f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:05.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.169+0000 7f58cffff640 1 --2- 172.21.15.120:0/2309474370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d33ed811d0 0x55d33ed8cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:05.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.169+0000 7f58d55d3640 1 -- 172.21.15.120:0/2309474370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d33ed808b0 msgr2=0x55d33ed8f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:05.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.169+0000 7f58d55d3640 1 --2- 172.21.15.120:0/2309474370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d33ed808b0 0x55d33ed8f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.169+0000 7f58d55d3640 1 -- 172.21.15.120:0/2309474370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d33ed811d0 msgr2=0x55d33ed8cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:05.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.169+0000 7f58d55d3640 1 --2- 172.21.15.120:0/2309474370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d33ed811d0 0x55d33ed8cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.169+0000 7f58d55d3640 1 -- 172.21.15.120:0/2309474370 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d33ea582b0 con 0x55d33ed8ffc0 2024-09-19T05:19:05.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.169+0000 7f58cffff640 1 --2- 172.21.15.120:0/2309474370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d33ed811d0 0x55d33ed8cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:05.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.170+0000 7f58d55d3640 1 --2- 172.21.15.120:0/2309474370 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed8ffc0 0x55d33ed8d120 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f58c8035000 tx=0x7f58c8031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5a605f85742eac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:05.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.170+0000 7f58affff640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:19:05.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.170+0000 7f58affff640 1 -- 172.21.15.120:0/2309474370 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c80047c0 con 0x55d33ed8ffc0 2024-09-19T05:19:05.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.170+0000 7f58affff640 1 -- 172.21.15.120:0/2309474370 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8298+0+0 (secure 0 0 0) 0x7f58c80305c0 con 0x55d33ed8ffc0 2024-09-19T05:19:05.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.170+0000 7f58d940f740 1 -- 172.21.15.120:0/2309474370 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58bc09bb00 con 0x55d33ed8ffc0 2024-09-19T05:19:05.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.170+0000 7f58affff640 1 -- 172.21.15.120:0/2309474370 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f58c80307c0 con 0x55d33ed8ffc0 2024-09-19T05:19:05.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.170+0000 7f58d940f740 10 client.15090 fetch_fsmap learned FSMap version 24 2024-09-19T05:19:05.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.170+0000 7f58d940f740 1 -- 172.21.15.120:0/2309474370 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d33ed9e520 con 0x55d33ed8ffc0 2024-09-19T05:19:05.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.170+0000 7f58affff640 1 -- 172.21.15.120:0/2309474370 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f58bc09bb00 con 0x55d33ed8ffc0 2024-09-19T05:19:05.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.170+0000 7f58affff640 1 -- 172.21.15.120:0/2309474370 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f58c8052a40 con 0x55d33ed8ffc0 2024-09-19T05:19:05.195 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.170+0000 7f58d940f740 10 client.15090 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:19:05.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.170+0000 7f58d940f740 10 client.15090 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:19:05.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.170+0000 7f58d940f740 20 client.15090 populate_metadata read hostname 'smithi120' 2024-09-19T05:19:05.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.170+0000 7f58d940f740 1 --2- 172.21.15.120:0/2309474370 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55d33eda0c20 0x55d33eda2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:05.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.170+0000 7f58d940f740 4 client.15090 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:19:05.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.170+0000 7f58d940f740 1 -- 172.21.15.120:0/2309474370 --> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d33ecf4600 con 0x55d33eda0c20 2024-09-19T05:19:05.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.171+0000 7f58d4dd2640 1 --2- 172.21.15.120:0/2309474370 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55d33eda0c20 0x55d33eda2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:05.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.171+0000 7f58affff640 10 client.15090 ms_handle_connect on v2:172.21.15.194:6836/378729335 2024-09-19T05:19:05.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.171+0000 7f58d4dd2640 1 --2- 172.21.15.120:0/2309474370 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55d33eda0c20 0x55d33eda2090 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9d1b28144f5e801f server_cookie=eb04dab66b565f76 in_seq=0 out_seq=0 2024-09-19T05:19:05.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.172+0000 7f58affff640 1 -- 172.21.15.120:0/2309474370 <== mds.2 v2:172.21.15.194:6836/378729335 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d33ecf4600 con 0x55d33eda0c20 2024-09-19T05:19:05.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.172+0000 7f58affff640 10 client.15090 handle_command_reply: tid=0 2024-09-19T05:19:05.197 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.172+0000 7f58d940f740 1 client.15090 shutdown 2024-09-19T05:19:05.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.172+0000 7f58d940f740 1 -- 172.21.15.120:0/2309474370 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed8ffc0 msgr2=0x55d33ed8d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:05.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.172+0000 7f58d940f740 1 --2- 172.21.15.120:0/2309474370 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed8ffc0 0x55d33ed8d120 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f58c8035000 tx=0x7f58c8031000 comp rx=0 tx=0).stop 2024-09-19T05:19:05.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.172+0000 7f58d940f740 1 -- 172.21.15.120:0/2309474370 shutdown_connections 2024-09-19T05:19:05.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.172+0000 7f58d940f740 1 --2- 172.21.15.120:0/2309474370 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55d33eda0c20 0x55d33eda2090 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.172+0000 7f58d940f740 1 --2- 172.21.15.120:0/2309474370 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed8ffc0 0x55d33ed8d120 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.172+0000 7f58d940f740 1 --2- 172.21.15.120:0/2309474370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d33ed811d0 0x55d33ed8cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.172+0000 7f58d940f740 1 --2- 172.21.15.120:0/2309474370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d33ed808b0 0x55d33ed8f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.172+0000 7f58affff640 0 client.15090 ms_handle_reset on v2:172.21.15.194:6836/378729335 2024-09-19T05:19:05.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.172+0000 7f58d940f740 1 -- 172.21.15.120:0/2309474370 >> 172.21.15.120:0/2309474370 conn(0x55d33ed7cf60 msgr2=0x55d33ed82cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:05.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.172+0000 7f58d940f740 1 -- 172.21.15.120:0/2309474370 shutdown_connections 2024-09-19T05:19:05.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.172+0000 7f58d940f740 1 -- 172.21.15.120:0/2309474370 wait complete. 2024-09-19T05:19:05.199 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.172+0000 7f58d940f740 20 client.15090 trim_cache size 0 max 16384 2024-09-19T05:19:05.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.190+0000 7f58d940f740 1 Processor -- start 2024-09-19T05:19:05.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.190+0000 7f58d940f740 1 -- start start 2024-09-19T05:19:05.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.190+0000 7f58d940f740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed808b0 0x55d33ed8b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:05.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.190+0000 7f58d940f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d33ed811d0 0x55d33ed8b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:05.205 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.190+0000 7f58d940f740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d33ed8ffc0 0x55d33edaa370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:05.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.190+0000 7f58d940f740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d33eda03d0 con 0x55d33ed808b0 2024-09-19T05:19:05.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.190+0000 7f58d940f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d33eda0aa0 con 0x55d33ed811d0 2024-09-19T05:19:05.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.190+0000 7f58d940f740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55d33eda1170 con 0x55d33ed8ffc0 2024-09-19T05:19:05.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.190+0000 7f58d4dd2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed808b0 0x55d33ed8b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:05.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.190+0000 7f58d4dd2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed808b0 0x55d33ed8b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49288/0 (socket says 172.21.15.120:49288) 2024-09-19T05:19:05.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.190+0000 7f58d4dd2640 1 -- 172.21.15.120:0/286394514 learned_addr learned my addr 172.21.15.120:0/286394514 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:05.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.190+0000 7f58d55d3640 1 --2- 172.21.15.120:0/286394514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d33ed8ffc0 0x55d33edaa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:05.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.190+0000 7f58d4dd2640 1 -- 172.21.15.120:0/286394514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d33ed8ffc0 msgr2=0x55d33edaa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:05.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.190+0000 7f58d4dd2640 1 --2- 172.21.15.120:0/286394514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d33ed8ffc0 0x55d33edaa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.190+0000 7f58d4dd2640 1 -- 172.21.15.120:0/286394514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d33ed811d0 msgr2=0x55d33ed8b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:05.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.190+0000 7f58d4dd2640 1 --2- 172.21.15.120:0/286394514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d33ed811d0 0x55d33ed8b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.206 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.190+0000 7f58d4dd2640 1 -- 172.21.15.120:0/286394514 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d33ed8b130 con 0x55d33ed808b0 2024-09-19T05:19:05.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.190+0000 7f58d55d3640 1 --2- 172.21.15.120:0/286394514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d33ed8ffc0 0x55d33edaa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:05.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.191+0000 7f58d4dd2640 1 --2- 172.21.15.120:0/286394514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed808b0 0x55d33ed8b4b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f58c4000c00 tx=0x7f58c4009110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50521d50bcbe03c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:05.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.191+0000 7f58ba7fc640 1 -- 172.21.15.120:0/286394514 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c4016b20 con 0x55d33ed808b0 2024-09-19T05:19:05.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.191+0000 7f58ba7fc640 1 -- 172.21.15.120:0/286394514 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f58c4016cc0 con 0x55d33ed808b0 2024-09-19T05:19:05.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.191+0000 7f58ba7fc640 1 -- 172.21.15.120:0/286394514 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c4014680 con 0x55d33ed808b0 2024-09-19T05:19:05.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.191+0000 7f58d940f740 1 -- 172.21.15.120:0/286394514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed808b0 msgr2=0x55d33ed8b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:05.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.191+0000 7f58d940f740 1 --2- 172.21.15.120:0/286394514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed808b0 0x55d33ed8b4b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f58c4000c00 tx=0x7f58c4009110 comp rx=0 tx=0).stop 2024-09-19T05:19:05.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.191+0000 7f58d940f740 1 -- 172.21.15.120:0/286394514 shutdown_connections 2024-09-19T05:19:05.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.191+0000 7f58d940f740 1 --2- 172.21.15.120:0/286394514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d33ed8ffc0 0x55d33edaa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.192+0000 7f58d940f740 1 --2- 172.21.15.120:0/286394514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d33ed811d0 0x55d33ed8b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.192+0000 7f58d940f740 1 --2- 172.21.15.120:0/286394514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed808b0 0x55d33ed8b4b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.192+0000 7f58d940f740 1 -- 172.21.15.120:0/286394514 >> 172.21.15.120:0/286394514 conn(0x55d33ed7cf60 msgr2=0x55d33ed9f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:05.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.192+0000 7f58d940f740 1 -- 172.21.15.120:0/286394514 shutdown_connections 2024-09-19T05:19:05.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.192+0000 7f58d940f740 1 -- 172.21.15.120:0/286394514 wait complete. 2024-09-19T05:19:05.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.192+0000 7f58d940f740 1 -- start start 2024-09-19T05:19:05.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.192+0000 7f58d940f740 1 Processor -- start 2024-09-19T05:19:05.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.192+0000 7f58d940f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d33ed808b0 0x55d33edaa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:05.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.192+0000 7f58d940f740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d33ed811d0 0x55d33eda3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:05.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.192+0000 7f58d940f740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed8ffc0 0x55d33eda42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:05.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.192+0000 7f58d940f740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d33eda1f10 con 0x55d33ed8ffc0 2024-09-19T05:19:05.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.192+0000 7f58d940f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d33eda1840 con 0x55d33ed808b0 2024-09-19T05:19:05.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.192+0000 7f58d940f740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55d33eda25e0 con 0x55d33ed811d0 2024-09-19T05:19:05.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.192+0000 7f58d940f740 10 client.0 _ll_register_callbacks cb 0x7f58c8009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:19:05.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.192+0000 7f58d55d3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed8ffc0 0x55d33eda42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:05.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.192+0000 7f58d55d3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed8ffc0 0x55d33eda42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49290/0 (socket says 172.21.15.120:49290) 2024-09-19T05:19:05.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.193+0000 7f58d55d3640 1 -- 172.21.15.120:0/1057051635 learned_addr learned my addr 172.21.15.120:0/1057051635 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:05.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.193+0000 7f58d4dd2640 1 --2- 172.21.15.120:0/1057051635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d33ed808b0 0x55d33edaa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:05.209 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.193+0000 7f58cffff640 1 --2- 172.21.15.120:0/1057051635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d33ed811d0 0x55d33eda3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:05.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.193+0000 7f58d55d3640 1 -- 172.21.15.120:0/1057051635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d33ed811d0 msgr2=0x55d33eda3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:05.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.193+0000 7f58d55d3640 1 --2- 172.21.15.120:0/1057051635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d33ed811d0 0x55d33eda3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.193+0000 7f58d55d3640 1 -- 172.21.15.120:0/1057051635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d33ed808b0 msgr2=0x55d33edaa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:05.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.193+0000 7f58d55d3640 1 --2- 172.21.15.120:0/1057051635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d33ed808b0 0x55d33edaa920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.193+0000 7f58d55d3640 1 -- 172.21.15.120:0/1057051635 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d33eda49a0 con 0x55d33ed8ffc0 2024-09-19T05:19:05.210 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.193+0000 7f58d55d3640 1 --2- 172.21.15.120:0/1057051635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed8ffc0 0x55d33eda42b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f58c8032af0 tx=0x7f58c8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dbb90df135cac72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:05.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.193+0000 7f58affff640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:19:05.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.193+0000 7f58affff640 1 -- 172.21.15.120:0/1057051635 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c802af40 con 0x55d33ed8ffc0 2024-09-19T05:19:05.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.193+0000 7f58affff640 1 -- 172.21.15.120:0/1057051635 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8298+0+0 (secure 0 0 0) 0x7f58c80305c0 con 0x55d33ed8ffc0 2024-09-19T05:19:05.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.193+0000 7f58d940f740 1 -- 172.21.15.120:0/1057051635 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58c4016cc0 con 0x55d33ed8ffc0 2024-09-19T05:19:05.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.193+0000 7f58affff640 1 -- 172.21.15.120:0/1057051635 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f58c8030b70 con 0x55d33ed8ffc0 2024-09-19T05:19:05.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.193+0000 7f58d940f740 10 client.15096 fetch_fsmap learned FSMap version 24 2024-09-19T05:19:05.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.193+0000 7f58d940f740 1 -- 172.21.15.120:0/1057051635 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d33eda92a0 con 0x55d33ed8ffc0 2024-09-19T05:19:05.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.193+0000 7f58affff640 1 -- 172.21.15.120:0/1057051635 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f58c4016cc0 con 0x55d33ed8ffc0 2024-09-19T05:19:05.211 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.194+0000 7f58affff640 1 -- 172.21.15.120:0/1057051635 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f58c8052600 con 0x55d33ed8ffc0 2024-09-19T05:19:05.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.194+0000 7f58d940f740 10 client.15096 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:19:05.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.194+0000 7f58d940f740 10 client.15096 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T05:19:05.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.194+0000 7f58d940f740 20 client.15096 populate_metadata read hostname 'smithi120' 2024-09-19T05:19:05.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.194+0000 7f58d940f740 1 --2- 172.21.15.120:0/1057051635 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55d33ee0fcb0 0x55d33ee0e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:05.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.194+0000 7f58d940f740 4 client.15096 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:19:05.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.194+0000 7f58d940f740 1 -- 172.21.15.120:0/1057051635 --> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] -- command(tid 0: {"prefix": "status"}) -- 0x55d33eceeb10 con 0x55d33ee0fcb0 2024-09-19T05:19:05.212 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.194+0000 7f58d4dd2640 1 --2- 172.21.15.120:0/1057051635 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55d33ee0fcb0 0x55d33ee0e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:05.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.194+0000 7f58d4dd2640 1 --2- 172.21.15.120:0/1057051635 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55d33ee0fcb0 0x55d33ee0e9c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f4a46cf95b4ef9b3 server_cookie=480c9bb5c7543377 in_seq=0 out_seq=0 2024-09-19T05:19:05.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.194+0000 7f58affff640 10 client.15096 ms_handle_connect on v2:172.21.15.194:6836/378729335 2024-09-19T05:19:05.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.195+0000 7f58affff640 1 -- 172.21.15.120:0/1057051635 <== mds.2 v2:172.21.15.194:6836/378729335 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x55d33eceeb10 con 0x55d33ee0fcb0 2024-09-19T05:19:05.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.195+0000 7f58affff640 10 client.15096 handle_command_reply: tid=0 2024-09-19T05:19:05.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.195+0000 7f58d940f740 1 client.15096 shutdown 2024-09-19T05:19:05.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.195+0000 7f58d940f740 1 -- 172.21.15.120:0/1057051635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed8ffc0 msgr2=0x55d33eda42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:05.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.195+0000 7f58d940f740 1 --2- 172.21.15.120:0/1057051635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed8ffc0 0x55d33eda42b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f58c8032af0 tx=0x7f58c8004740 comp rx=0 tx=0).stop 2024-09-19T05:19:05.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.195+0000 7f58d940f740 1 -- 172.21.15.120:0/1057051635 shutdown_connections 2024-09-19T05:19:05.213 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.195+0000 7f58d940f740 1 --2- 172.21.15.120:0/1057051635 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55d33ee0fcb0 0x55d33ee0e9c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.195+0000 7f58d940f740 1 --2- 172.21.15.120:0/1057051635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d33ed8ffc0 0x55d33eda42b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.195+0000 7f58d940f740 1 --2- 172.21.15.120:0/1057051635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d33ed811d0 0x55d33eda3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.195+0000 7f58d940f740 1 --2- 172.21.15.120:0/1057051635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d33ed808b0 0x55d33edaa920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.195+0000 7f58affff640 0 client.15096 ms_handle_reset on v2:172.21.15.194:6836/378729335 2024-09-19T05:19:05.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.195+0000 7f58d940f740 1 -- 172.21.15.120:0/1057051635 >> 172.21.15.120:0/1057051635 conn(0x55d33ed7cf60 msgr2=0x55d33ed8b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:05.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.195+0000 7f58d940f740 1 -- 172.21.15.120:0/1057051635 shutdown_connections 2024-09-19T05:19:05.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.195+0000 7f58d940f740 1 -- 172.21.15.120:0/1057051635 wait complete. 2024-09-19T05:19:05.214 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.195+0000 7f58d940f740 20 client.15096 trim_cache size 0 max 16384 2024-09-19T05:19:05.214 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T05:19:05.215 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "4e6e3df4-7645-11ef-bceb-c7b262605968", 2024-09-19T05:19:05.215 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 2, 2024-09-19T05:19:05.215 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 24430, 2024-09-19T05:19:05.215 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-09-19T05:19:05.215 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-09-19T05:19:05.215 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-09-19T05:19:05.215 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 85.968942493, 2024-09-19T05:19:05.215 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 24, 2024-09-19T05:19:05.215 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 84, 2024-09-19T05:19:05.215 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T05:19:05.215 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 118.168676346 2024-09-19T05:19:05.215 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T05:19:05.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.195+0000 7f58d7036640 1 -- 172.21.15.120:0/2772671760 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f58c00a32d0 msgr2=0x7f58c00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:05.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.195+0000 7f58d7036640 1 --2- 172.21.15.120:0/2772671760 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f58c00a32d0 0x7f58c00a5790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f58c8004af0 tx=0x7f58c80099e0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.195+0000 7f58d7036640 1 -- 172.21.15.120:0/2772671760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58d0102790 msgr2=0x7f58d01989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:05.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.195+0000 7f58d7036640 1 --2- 172.21.15.120:0/2772671760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58d0102790 0x7f58d01989c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f58bc00b4a0 tx=0x7f58bc00b960 comp rx=0 tx=0).stop 2024-09-19T05:19:05.216 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.196+0000 7f58d7036640 1 -- 172.21.15.120:0/2772671760 shutdown_connections 2024-09-19T05:19:05.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.196+0000 7f58d7036640 1 --2- 172.21.15.120:0/2772671760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58d0106f10 0x7f58d019cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.196+0000 7f58d7036640 1 --2- 172.21.15.120:0/2772671760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58d0102790 0x7f58d01989c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.196+0000 7f58d7036640 1 --2- 172.21.15.120:0/2772671760 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f58c00a32d0 0x7f58c00a5790 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.196+0000 7f58d7036640 1 --2- 172.21.15.120:0/2772671760 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58d0101de0 0x7f58d0198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:05.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.196+0000 7f58d7036640 1 -- 172.21.15.120:0/2772671760 >> 172.21.15.120:0/2772671760 conn(0x7f58d00fd8c0 msgr2=0x7f58d00fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:05.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.196+0000 7f58d7036640 1 -- 172.21.15.120:0/2772671760 shutdown_connections 2024-09-19T05:19:05.217 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:05.196+0000 7f58d7036640 1 -- 172.21.15.120:0/2772671760 wait complete. 2024-09-19T05:19:05.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:05 smithi120 ceph-mon[30956]: pgmap v322: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 1 B/s, 0 objects/s recovering 2024-09-19T05:19:05.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:05 smithi194 ceph-mon[35228]: pgmap v322: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 1 B/s, 0 objects/s recovering 2024-09-19T05:19:05.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:05 smithi178 ceph-mon[34347]: pgmap v322: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s; 1 B/s, 0 objects/s recovering 2024-09-19T05:19:05.755 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T05:19:05.998 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:06.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.491+0000 7f016c64b640 1 -- 172.21.15.120:0/3398833906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0164102570 msgr2=0x7f01641029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:06.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.491+0000 7f016c64b640 1 --2- 172.21.15.120:0/3398833906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0164102570 0x7f01641029b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0158009900 tx=0x7f015802a480 comp rx=0 tx=0).stop 2024-09-19T05:19:06.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.491+0000 7f016c64b640 1 -- 172.21.15.120:0/3398833906 shutdown_connections 2024-09-19T05:19:06.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.491+0000 7f016c64b640 1 --2- 172.21.15.120:0/3398833906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0164102ef0 0x7f016410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.491+0000 7f016c64b640 1 --2- 172.21.15.120:0/3398833906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0164102570 0x7f01641029b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.491+0000 7f016c64b640 1 --2- 172.21.15.120:0/3398833906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0164100e20 0x7f0164101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.491+0000 7f016c64b640 1 -- 172.21.15.120:0/3398833906 >> 172.21.15.120:0/3398833906 conn(0x7f01640fc7d0 msgr2=0x7f01640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:06.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.491+0000 7f016c64b640 1 -- 172.21.15.120:0/3398833906 shutdown_connections 2024-09-19T05:19:06.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.491+0000 7f016c64b640 1 -- 172.21.15.120:0/3398833906 wait complete. 2024-09-19T05:19:06.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.492+0000 7f016c64b640 1 Processor -- start 2024-09-19T05:19:06.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.492+0000 7f016c64b640 1 -- start start 2024-09-19T05:19:06.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.492+0000 7f016c64b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0164100e20 0x7f016410e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:06.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.492+0000 7f016c64b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0164102570 0x7f016410e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:06.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.492+0000 7f016c64b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0164102ef0 0x7f016410ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:06.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.492+0000 7f016c64b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0164111f40 con 0x7f0164102ef0 2024-09-19T05:19:06.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.492+0000 7f016c64b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0164111dc0 con 0x7f0164102570 2024-09-19T05:19:06.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.492+0000 7f016c64b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f01641120c0 con 0x7f0164100e20 2024-09-19T05:19:06.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.492+0000 7f016abe8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0164102ef0 0x7f016410ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:06.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.492+0000 7f016abe8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0164102ef0 0x7f016410ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49314/0 (socket says 172.21.15.120:49314) 2024-09-19T05:19:06.501 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.492+0000 7f016abe8640 1 -- 172.21.15.120:0/2403727052 learned_addr learned my addr 172.21.15.120:0/2403727052 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:06.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.492+0000 7f016a3e7640 1 --2- 172.21.15.120:0/2403727052 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0164100e20 0x7f016410e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:06.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.492+0000 7f0169be6640 1 --2- 172.21.15.120:0/2403727052 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0164102570 0x7f016410e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:06.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.492+0000 7f016abe8640 1 -- 172.21.15.120:0/2403727052 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0164100e20 msgr2=0x7f016410e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:06.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.492+0000 7f016abe8640 1 --2- 172.21.15.120:0/2403727052 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0164100e20 0x7f016410e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.492+0000 7f016abe8640 1 -- 172.21.15.120:0/2403727052 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0164102570 msgr2=0x7f016410e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:06.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.492+0000 7f016abe8640 1 --2- 172.21.15.120:0/2403727052 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0164102570 0x7f016410e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.492+0000 7f016abe8640 1 -- 172.21.15.120:0/2403727052 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01641a6890 con 0x7f0164102ef0 2024-09-19T05:19:06.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.492+0000 7f016a3e7640 1 --2- 172.21.15.120:0/2403727052 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0164100e20 0x7f016410e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:19:06.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.492+0000 7f0169be6640 1 --2- 172.21.15.120:0/2403727052 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0164102570 0x7f016410e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:06.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.492+0000 7f016abe8640 1 --2- 172.21.15.120:0/2403727052 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0164102ef0 0x7f016410ec50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f015400c970 tx=0x7f015400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:06.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.493+0000 7f01637fe640 1 -- 172.21.15.120:0/2403727052 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0154007bb0 con 0x7f0164102ef0 2024-09-19T05:19:06.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.493+0000 7f01637fe640 1 -- 172.21.15.120:0/2403727052 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0154007d50 con 0x7f0164102ef0 2024-09-19T05:19:06.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.493+0000 7f016c64b640 1 -- 172.21.15.120:0/2403727052 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01641a6b80 con 0x7f0164102ef0 2024-09-19T05:19:06.502 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.493+0000 7f01637fe640 1 -- 172.21.15.120:0/2403727052 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0154018700 con 0x7f0164102ef0 2024-09-19T05:19:06.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.493+0000 7f016c64b640 1 -- 172.21.15.120:0/2403727052 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01641a7070 con 0x7f0164102ef0 2024-09-19T05:19:06.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.496+0000 7f01637fe640 1 -- 172.21.15.120:0/2403727052 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f015400fa20 con 0x7f0164102ef0 2024-09-19T05:19:06.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.496+0000 7f016ea24740 1 Processor -- start 2024-09-19T05:19:06.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.496+0000 7f016ea24740 1 -- start start 2024-09-19T05:19:06.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.496+0000 7f016ea24740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355189d0 0x565335518db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:06.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.496+0000 7f016ea24740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653355192f0 0x565335523670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:06.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.496+0000 7f016ea24740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565335523bb0 0x565335525fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:06.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.496+0000 7f016ea24740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56533547f090 con 0x5653355189d0 2024-09-19T05:19:06.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.496+0000 7f016ea24740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x565335426a70 con 0x5653355192f0 2024-09-19T05:19:06.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.496+0000 7f016ea24740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56533547b050 con 0x565335523bb0 2024-09-19T05:19:06.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.496+0000 7f0169be6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355189d0 0x565335518db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:06.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.496+0000 7f0169be6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355189d0 0x565335518db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49328/0 (socket says 172.21.15.120:49328) 2024-09-19T05:19:06.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.496+0000 7f0169be6640 1 -- 172.21.15.120:0/2459634955 learned_addr learned my addr 172.21.15.120:0/2459634955 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:06.503 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.496+0000 7f016a3e7640 1 --2- 172.21.15.120:0/2459634955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653355192f0 0x565335523670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:06.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.496+0000 7f01637fe640 1 --2- 172.21.15.120:0/2403727052 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f014c0a32d0 0x7f014c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:06.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.496+0000 7f0169be6640 1 -- 172.21.15.120:0/2459634955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565335523bb0 msgr2=0x565335525fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:06.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.496+0000 7f0169be6640 1 --2- 172.21.15.120:0/2459634955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565335523bb0 0x565335525fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.496+0000 7f0169be6640 1 -- 172.21.15.120:0/2459634955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653355192f0 msgr2=0x565335523670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:06.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.496+0000 7f0169be6640 1 --2- 172.21.15.120:0/2459634955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653355192f0 0x565335523670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.497+0000 7f0169be6640 1 -- 172.21.15.120:0/2459634955 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565335433130 con 0x5653355189d0 2024-09-19T05:19:06.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.497+0000 7f016a3e7640 1 --2- 172.21.15.120:0/2459634955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653355192f0 0x565335523670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:19:06.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.497+0000 7f016abe8640 1 --2- 172.21.15.120:0/2403727052 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f014c0a32d0 0x7f014c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:06.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.497+0000 7f0169be6640 1 --2- 172.21.15.120:0/2459634955 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355189d0 0x565335518db0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0158005c40 tx=0x7f0158005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d88214bea63b2ac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:06.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.497+0000 7f01637fe640 1 -- 172.21.15.120:0/2403727052 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8298+0+0 (secure 0 0 0) 0x7f01540cfbc0 con 0x7f0164102ef0 2024-09-19T05:19:06.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.497+0000 7f0160ff9640 1 -- 172.21.15.120:0/2459634955 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0158035050 con 0x5653355189d0 2024-09-19T05:19:06.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.497+0000 7f0160ff9640 1 -- 172.21.15.120:0/2459634955 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0158031630 con 0x5653355189d0 2024-09-19T05:19:06.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.497+0000 7f0160ff9640 1 -- 172.21.15.120:0/2459634955 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01580046c0 con 0x5653355189d0 2024-09-19T05:19:06.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.497+0000 7f016abe8640 1 --2- 172.21.15.120:0/2403727052 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f014c0a32d0 0x7f014c0a5790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f015400afd0 tx=0x7f01540c6e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:06.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.498+0000 7f016ea24740 1 -- 172.21.15.120:0/2459634955 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355189d0 msgr2=0x565335518db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:06.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.498+0000 7f016ea24740 1 --2- 172.21.15.120:0/2459634955 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355189d0 0x565335518db0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0158005c40 tx=0x7f0158005e50 comp rx=0 tx=0).stop 2024-09-19T05:19:06.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.498+0000 7f016ea24740 1 -- 172.21.15.120:0/2459634955 shutdown_connections 2024-09-19T05:19:06.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.498+0000 7f016ea24740 1 --2- 172.21.15.120:0/2459634955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565335523bb0 0x565335525fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.498+0000 7f016ea24740 1 --2- 172.21.15.120:0/2459634955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653355192f0 0x565335523670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.498+0000 7f016ea24740 1 --2- 172.21.15.120:0/2459634955 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355189d0 0x565335518db0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.498+0000 7f016ea24740 1 -- 172.21.15.120:0/2459634955 >> 172.21.15.120:0/2459634955 conn(0x565335514f60 msgr2=0x565335515340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:06.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.498+0000 7f016ea24740 1 -- 172.21.15.120:0/2459634955 shutdown_connections 2024-09-19T05:19:06.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.498+0000 7f016ea24740 1 -- 172.21.15.120:0/2459634955 wait complete. 2024-09-19T05:19:06.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.498+0000 7f016ea24740 1 -- start start 2024-09-19T05:19:06.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.498+0000 7f016ea24740 1 Processor -- start 2024-09-19T05:19:06.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.499+0000 7f016ea24740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355189d0 0x565335523440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:06.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.499+0000 7f016ea24740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5653355192f0 0x565335520790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:06.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.499+0000 7f016ea24740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565335523bb0 0x565335520cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:06.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.499+0000 7f016ea24740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x565335526780 con 0x5653355189d0 2024-09-19T05:19:06.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.499+0000 7f016ea24740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x565335439f20 con 0x565335523bb0 2024-09-19T05:19:06.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.499+0000 7f016ea24740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x565335526900 con 0x5653355192f0 2024-09-19T05:19:06.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.499+0000 7f016ea24740 10 client.0 _ll_register_callbacks cb 0x565335403030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:19:06.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.499+0000 7f0169be6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355189d0 0x565335523440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:06.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.499+0000 7f0169be6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355189d0 0x565335523440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49330/0 (socket says 172.21.15.120:49330) 2024-09-19T05:19:06.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.499+0000 7f0169be6640 1 -- 172.21.15.120:0/1213877802 learned_addr learned my addr 172.21.15.120:0/1213877802 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:06.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.499+0000 7f016a3e7640 1 --2- 172.21.15.120:0/1213877802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5653355192f0 0x565335520790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:06.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.499+0000 7f0169be6640 1 --2- 172.21.15.120:0/1213877802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565335523bb0 0x565335520cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:06.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.499+0000 7f0169be6640 1 -- 172.21.15.120:0/1213877802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5653355192f0 msgr2=0x565335520790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:06.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.499+0000 7f0169be6640 1 --2- 172.21.15.120:0/1213877802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5653355192f0 0x565335520790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.499+0000 7f0169be6640 1 -- 172.21.15.120:0/1213877802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565335523bb0 msgr2=0x565335520cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:06.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.499+0000 7f0169be6640 1 --2- 172.21.15.120:0/1213877802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565335523bb0 0x565335520cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.499+0000 7f0169be6640 1 -- 172.21.15.120:0/1213877802 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653351f02b0 con 0x5653355189d0 2024-09-19T05:19:06.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.499+0000 7f0169be6640 1 --2- 172.21.15.120:0/1213877802 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355189d0 0x565335523440 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0158009340 tx=0x7f0158009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74f2dcda156c2d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:06.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.499+0000 7f0149ffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:19:06.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.499+0000 7f0149ffb640 1 -- 172.21.15.120:0/1213877802 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0158052060 con 0x5653355189d0 2024-09-19T05:19:06.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.499+0000 7f0149ffb640 1 -- 172.21.15.120:0/1213877802 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8298+0+0 (secure 0 0 0) 0x7f0158004d80 con 0x5653355189d0 2024-09-19T05:19:06.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.500+0000 7f016ea24740 1 -- 172.21.15.120:0/1213877802 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0158031630 con 0x5653355189d0 2024-09-19T05:19:06.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.500+0000 7f0149ffb640 1 -- 172.21.15.120:0/1213877802 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0158048070 con 0x5653355189d0 2024-09-19T05:19:06.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.500+0000 7f016ea24740 10 client.15108 fetch_fsmap learned FSMap version 24 2024-09-19T05:19:06.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.500+0000 7f016ea24740 1 -- 172.21.15.120:0/1213877802 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5653355320c0 con 0x5653355189d0 2024-09-19T05:19:06.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.500+0000 7f0149ffb640 1 -- 172.21.15.120:0/1213877802 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0158031630 con 0x5653355189d0 2024-09-19T05:19:06.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.500+0000 7f0149ffb640 1 -- 172.21.15.120:0/1213877802 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f015803ccd0 con 0x5653355189d0 2024-09-19T05:19:06.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.500+0000 7f016ea24740 10 client.15108 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:19:06.510 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.500+0000 7f016ea24740 10 client.15108 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T05:19:06.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.500+0000 7f016ea24740 20 client.15108 populate_metadata read hostname 'smithi120' 2024-09-19T05:19:06.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.500+0000 7f016ea24740 1 --2- 172.21.15.120:0/1213877802 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x565335534210 0x565335535680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:06.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.500+0000 7f016ea24740 4 client.15108 mds_command: new command op to 24443 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:19:06.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.500+0000 7f016ea24740 1 -- 172.21.15.120:0/1213877802 --> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56533548c600 con 0x565335534210 2024-09-19T05:19:06.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.500+0000 7f016a3e7640 1 --2- 172.21.15.120:0/1213877802 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x565335534210 0x565335535680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:06.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.501+0000 7f0149ffb640 10 client.15108 ms_handle_connect on v2:172.21.15.178:6838/3389137566 2024-09-19T05:19:06.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.501+0000 7f016a3e7640 1 --2- 172.21.15.120:0/1213877802 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x565335534210 0x565335535680 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f96d8e0ba95f0575 server_cookie=d24a36c1c37c8246 in_seq=0 out_seq=0 2024-09-19T05:19:06.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.501+0000 7f0149ffb640 1 -- 172.21.15.120:0/1213877802 <== mds.1 v2:172.21.15.178:6838/3389137566 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56533548c600 con 0x565335534210 2024-09-19T05:19:06.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.501+0000 7f0149ffb640 10 client.15108 handle_command_reply: tid=0 2024-09-19T05:19:06.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.501+0000 7f016ea24740 1 client.15108 shutdown 2024-09-19T05:19:06.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.502+0000 7f016ea24740 1 -- 172.21.15.120:0/1213877802 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355189d0 msgr2=0x565335523440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:06.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.502+0000 7f016ea24740 1 --2- 172.21.15.120:0/1213877802 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355189d0 0x565335523440 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0158009340 tx=0x7f0158009290 comp rx=0 tx=0).stop 2024-09-19T05:19:06.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.502+0000 7f016ea24740 1 -- 172.21.15.120:0/1213877802 shutdown_connections 2024-09-19T05:19:06.511 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.502+0000 7f016ea24740 1 --2- 172.21.15.120:0/1213877802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x565335523bb0 0x565335520cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.502+0000 7f016ea24740 1 --2- 172.21.15.120:0/1213877802 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x565335534210 0x565335535680 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.502+0000 7f016ea24740 1 --2- 172.21.15.120:0/1213877802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5653355192f0 0x565335520790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.502+0000 7f016ea24740 1 --2- 172.21.15.120:0/1213877802 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355189d0 0x565335523440 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.502+0000 7f016ea24740 1 -- 172.21.15.120:0/1213877802 >> 172.21.15.120:0/1213877802 conn(0x565335514f60 msgr2=0x56533551ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:06.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.502+0000 7f0149ffb640 0 client.15108 ms_handle_reset on v2:172.21.15.178:6838/3389137566 2024-09-19T05:19:06.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.502+0000 7f016ea24740 1 -- 172.21.15.120:0/1213877802 shutdown_connections 2024-09-19T05:19:06.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.502+0000 7f016ea24740 1 -- 172.21.15.120:0/1213877802 wait complete. 2024-09-19T05:19:06.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.502+0000 7f016ea24740 20 client.15108 trim_cache size 0 max 16384 2024-09-19T05:19:06.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.519+0000 7f016ea24740 1 Processor -- start 2024-09-19T05:19:06.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.519+0000 7f016ea24740 1 -- start start 2024-09-19T05:19:06.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.519+0000 7f016ea24740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653355189d0 0x5653355348e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:06.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.519+0000 7f016ea24740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355192f0 0x56533551f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:06.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.519+0000 7f016ea24740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565335523bb0 0x56533553d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:06.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.519+0000 7f016ea24740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5653355339c0 con 0x5653355192f0 2024-09-19T05:19:06.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.519+0000 7f016ea24740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x565335534090 con 0x5653355189d0 2024-09-19T05:19:06.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.519+0000 7f016ea24740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x565335534760 con 0x565335523bb0 2024-09-19T05:19:06.522 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016a3e7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355192f0 0x56533551f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:06.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016a3e7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355192f0 0x56533551f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49346/0 (socket says 172.21.15.120:49346) 2024-09-19T05:19:06.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016a3e7640 1 -- 172.21.15.120:0/4096501463 learned_addr learned my addr 172.21.15.120:0/4096501463 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:06.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f0169be6640 1 --2- 172.21.15.120:0/4096501463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653355189d0 0x5653355348e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:06.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016a3e7640 1 -- 172.21.15.120:0/4096501463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565335523bb0 msgr2=0x56533553d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:06.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016a3e7640 1 --2- 172.21.15.120:0/4096501463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565335523bb0 0x56533553d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016a3e7640 1 -- 172.21.15.120:0/4096501463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653355189d0 msgr2=0x5653355348e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:06.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016a3e7640 1 --2- 172.21.15.120:0/4096501463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653355189d0 0x5653355348e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016a3e7640 1 -- 172.21.15.120:0/4096501463 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565335523060 con 0x5653355192f0 2024-09-19T05:19:06.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f0169be6640 1 --2- 172.21.15.120:0/4096501463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653355189d0 0x5653355348e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:06.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016a3e7640 1 --2- 172.21.15.120:0/4096501463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355192f0 0x56533551f060 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f015c0095d0 tx=0x7f015c013990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d98373472413947 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:06.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f014bfff640 1 -- 172.21.15.120:0/4096501463 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015c023030 con 0x5653355192f0 2024-09-19T05:19:06.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f014bfff640 1 -- 172.21.15.120:0/4096501463 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f015c01f3c0 con 0x5653355192f0 2024-09-19T05:19:06.523 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f014bfff640 1 -- 172.21.15.120:0/4096501463 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015c005280 con 0x5653355192f0 2024-09-19T05:19:06.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016ea24740 1 -- 172.21.15.120:0/4096501463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355192f0 msgr2=0x56533551f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:06.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016ea24740 1 --2- 172.21.15.120:0/4096501463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355192f0 0x56533551f060 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f015c0095d0 tx=0x7f015c013990 comp rx=0 tx=0).stop 2024-09-19T05:19:06.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016ea24740 1 -- 172.21.15.120:0/4096501463 shutdown_connections 2024-09-19T05:19:06.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016ea24740 1 --2- 172.21.15.120:0/4096501463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565335523bb0 0x56533553d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016ea24740 1 --2- 172.21.15.120:0/4096501463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355192f0 0x56533551f060 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016ea24740 1 --2- 172.21.15.120:0/4096501463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653355189d0 0x5653355348e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016ea24740 1 -- 172.21.15.120:0/4096501463 >> 172.21.15.120:0/4096501463 conn(0x565335514f60 msgr2=0x56533550fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:06.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016ea24740 1 -- 172.21.15.120:0/4096501463 shutdown_connections 2024-09-19T05:19:06.527 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016ea24740 1 -- 172.21.15.120:0/4096501463 wait complete. 2024-09-19T05:19:06.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016ea24740 1 -- start start 2024-09-19T05:19:06.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016ea24740 1 Processor -- start 2024-09-19T05:19:06.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016ea24740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653355189d0 0x56533553db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:06.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016ea24740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355192f0 0x56533553e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:06.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016ea24740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565335523bb0 0x565335536e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:06.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016ea24740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x565335535500 con 0x5653355192f0 2024-09-19T05:19:06.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016ea24740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x565335534e30 con 0x5653355189d0 2024-09-19T05:19:06.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016ea24740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x565335535bd0 con 0x565335523bb0 2024-09-19T05:19:06.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016ea24740 10 client.0 _ll_register_callbacks cb 0x7f0158032cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:19:06.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.521+0000 7f016a3e7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355192f0 0x56533553e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:06.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.522+0000 7f016a3e7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355192f0 0x56533553e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49356/0 (socket says 172.21.15.120:49356) 2024-09-19T05:19:06.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.522+0000 7f016a3e7640 1 -- 172.21.15.120:0/2089810291 learned_addr learned my addr 172.21.15.120:0/2089810291 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:06.528 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.522+0000 7f0169be6640 1 --2- 172.21.15.120:0/2089810291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653355189d0 0x56533553db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:06.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.522+0000 7f0169be6640 1 --2- 172.21.15.120:0/2089810291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565335523bb0 0x565335536e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:06.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.522+0000 7f016a3e7640 1 -- 172.21.15.120:0/2089810291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565335523bb0 msgr2=0x565335536e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:06.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.522+0000 7f016a3e7640 1 --2- 172.21.15.120:0/2089810291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565335523bb0 0x565335536e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.522+0000 7f016a3e7640 1 -- 172.21.15.120:0/2089810291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653355189d0 msgr2=0x56533553db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:06.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.522+0000 7f016a3e7640 1 --2- 172.21.15.120:0/2089810291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653355189d0 0x56533553db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.522+0000 7f016a3e7640 1 -- 172.21.15.120:0/2089810291 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565335537650 con 0x5653355192f0 2024-09-19T05:19:06.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.522+0000 7f0169be6640 1 --2- 172.21.15.120:0/2089810291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565335523bb0 0x565335536e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:06.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.522+0000 7f016a3e7640 1 --2- 172.21.15.120:0/2089810291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355192f0 0x56533553e050 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f015c025000 tx=0x7f015c004c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2941f14c2b8a5196 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:06.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.522+0000 7f0149ffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:19:06.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.522+0000 7f0149ffb640 1 -- 172.21.15.120:0/2089810291 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f015c035060 con 0x5653355192f0 2024-09-19T05:19:06.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.522+0000 7f0149ffb640 1 -- 172.21.15.120:0/2089810291 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8298+0+0 (secure 0 0 0) 0x7f015c01f770 con 0x5653355192f0 2024-09-19T05:19:06.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.522+0000 7f016ea24740 1 -- 172.21.15.120:0/2089810291 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f015c01f3c0 con 0x5653355192f0 2024-09-19T05:19:06.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.522+0000 7f0149ffb640 1 -- 172.21.15.120:0/2089810291 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f015c023040 con 0x5653355192f0 2024-09-19T05:19:06.529 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.522+0000 7f016ea24740 10 client.15114 fetch_fsmap learned FSMap version 24 2024-09-19T05:19:06.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.522+0000 7f016ea24740 1 -- 172.21.15.120:0/2089810291 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56533553c020 con 0x5653355192f0 2024-09-19T05:19:06.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.522+0000 7f0149ffb640 1 -- 172.21.15.120:0/2089810291 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f015c01f3c0 con 0x5653355192f0 2024-09-19T05:19:06.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.523+0000 7f0149ffb640 1 -- 172.21.15.120:0/2089810291 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f015c02f030 con 0x5653355192f0 2024-09-19T05:19:06.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.523+0000 7f016ea24740 10 client.15114 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:19:06.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.523+0000 7f016ea24740 10 client.15114 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T05:19:06.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.523+0000 7f016ea24740 20 client.15114 populate_metadata read hostname 'smithi120' 2024-09-19T05:19:06.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.523+0000 7f016ea24740 1 --2- 172.21.15.120:0/2089810291 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x5653355a2c90 0x5653355a19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:06.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.523+0000 7f016ea24740 4 client.15114 mds_command: new command op to 24443 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:19:06.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.523+0000 7f016ea24740 1 -- 172.21.15.120:0/2089810291 --> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] -- command(tid 0: {"prefix": "status"}) -- 0x565335486b10 con 0x5653355a2c90 2024-09-19T05:19:06.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.523+0000 7f0169be6640 1 --2- 172.21.15.120:0/2089810291 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x5653355a2c90 0x5653355a19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:06.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.523+0000 7f0149ffb640 10 client.15114 ms_handle_connect on v2:172.21.15.178:6838/3389137566 2024-09-19T05:19:06.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.523+0000 7f0169be6640 1 --2- 172.21.15.120:0/2089810291 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x5653355a2c90 0x5653355a19a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e7740bd3c99c652f server_cookie=84dc8dd3c4568d76 in_seq=0 out_seq=0 2024-09-19T05:19:06.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.523+0000 7f0149ffb640 1 -- 172.21.15.120:0/2089810291 <== mds.1 v2:172.21.15.178:6838/3389137566 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x565335486b10 con 0x5653355a2c90 2024-09-19T05:19:06.530 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.523+0000 7f0149ffb640 10 client.15114 handle_command_reply: tid=0 2024-09-19T05:19:06.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.523+0000 7f016ea24740 1 client.15114 shutdown 2024-09-19T05:19:06.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.524+0000 7f016ea24740 1 -- 172.21.15.120:0/2089810291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355192f0 msgr2=0x56533553e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:06.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.524+0000 7f016ea24740 1 --2- 172.21.15.120:0/2089810291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355192f0 0x56533553e050 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f015c025000 tx=0x7f015c004c90 comp rx=0 tx=0).stop 2024-09-19T05:19:06.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.524+0000 7f016ea24740 1 -- 172.21.15.120:0/2089810291 shutdown_connections 2024-09-19T05:19:06.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.524+0000 7f016ea24740 1 --2- 172.21.15.120:0/2089810291 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x5653355a2c90 0x5653355a19a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.524+0000 7f0149ffb640 0 client.15114 ms_handle_reset on v2:172.21.15.178:6838/3389137566 2024-09-19T05:19:06.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.524+0000 7f016ea24740 1 --2- 172.21.15.120:0/2089810291 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565335523bb0 0x565335536e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.524+0000 7f016ea24740 1 --2- 172.21.15.120:0/2089810291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5653355192f0 0x56533553e050 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.524+0000 7f016ea24740 1 --2- 172.21.15.120:0/2089810291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653355189d0 0x56533553db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.524+0000 7f016ea24740 1 -- 172.21.15.120:0/2089810291 >> 172.21.15.120:0/2089810291 conn(0x565335514f60 msgr2=0x56533551ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:06.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.524+0000 7f016ea24740 1 -- 172.21.15.120:0/2089810291 shutdown_connections 2024-09-19T05:19:06.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.524+0000 7f016ea24740 1 -- 172.21.15.120:0/2089810291 wait complete. 2024-09-19T05:19:06.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.524+0000 7f016ea24740 20 client.15114 trim_cache size 0 max 16384 2024-09-19T05:19:06.532 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T05:19:06.532 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "4e6e3df4-7645-11ef-bceb-c7b262605968", 2024-09-19T05:19:06.532 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 1, 2024-09-19T05:19:06.532 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 24443, 2024-09-19T05:19:06.532 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-09-19T05:19:06.532 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-09-19T05:19:06.532 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-09-19T05:19:06.532 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 88.304381277000005, 2024-09-19T05:19:06.532 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 24, 2024-09-19T05:19:06.532 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 84, 2024-09-19T05:19:06.533 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T05:19:06.533 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 105.763750356 2024-09-19T05:19:06.533 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T05:19:06.533 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.524+0000 7f016c64b640 1 -- 172.21.15.120:0/2403727052 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f014c0a32d0 msgr2=0x7f014c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:06.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.524+0000 7f016c64b640 1 --2- 172.21.15.120:0/2403727052 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f014c0a32d0 0x7f014c0a5790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f015400afd0 tx=0x7f01540c6e10 comp rx=0 tx=0).stop 2024-09-19T05:19:06.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.524+0000 7f016c64b640 1 -- 172.21.15.120:0/2403727052 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0164102ef0 msgr2=0x7f016410ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:06.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.524+0000 7f016c64b640 1 --2- 172.21.15.120:0/2403727052 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0164102ef0 0x7f016410ec50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f015400c970 tx=0x7f015400ce30 comp rx=0 tx=0).stop 2024-09-19T05:19:06.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.524+0000 7f016c64b640 1 -- 172.21.15.120:0/2403727052 shutdown_connections 2024-09-19T05:19:06.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.524+0000 7f016c64b640 1 --2- 172.21.15.120:0/2403727052 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0164102ef0 0x7f016410ec50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.524+0000 7f016c64b640 1 --2- 172.21.15.120:0/2403727052 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0164102570 0x7f016410e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.524+0000 7f016c64b640 1 --2- 172.21.15.120:0/2403727052 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f014c0a32d0 0x7f014c0a5790 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.524+0000 7f016c64b640 1 --2- 172.21.15.120:0/2403727052 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0164100e20 0x7f016410e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:06.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.524+0000 7f016c64b640 1 -- 172.21.15.120:0/2403727052 >> 172.21.15.120:0/2403727052 conn(0x7f01640fc7d0 msgr2=0x7f01640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:06.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.524+0000 7f016c64b640 1 -- 172.21.15.120:0/2403727052 shutdown_connections 2024-09-19T05:19:06.534 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:06.524+0000 7f016c64b640 1 -- 172.21.15.120:0/2403727052 wait complete. 2024-09-19T05:19:07.170 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T05:19:07.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:07 smithi120 ceph-mon[30956]: pgmap v323: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T05:19:07.416 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:07.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:07 smithi194 ceph-mon[35228]: pgmap v323: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T05:19:07.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:07 smithi178 ceph-mon[34347]: pgmap v323: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T05:19:07.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.831+0000 7fa53ec9a640 1 -- 172.21.15.120:0/170036994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa538100a80 msgr2=0x7fa538100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:07.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.831+0000 7fa53ec9a640 1 --2- 172.21.15.120:0/170036994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa538100a80 0x7fa538100ee0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa528009930 tx=0x7fa52802a420 comp rx=0 tx=0).stop 2024-09-19T05:19:07.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.831+0000 7fa53ec9a640 1 -- 172.21.15.120:0/170036994 shutdown_connections 2024-09-19T05:19:07.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.831+0000 7fa53ec9a640 1 --2- 172.21.15.120:0/170036994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa538101420 0x7fa53810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.831+0000 7fa53ec9a640 1 --2- 172.21.15.120:0/170036994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa538100a80 0x7fa538100ee0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.831+0000 7fa53ec9a640 1 --2- 172.21.15.120:0/170036994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa538106a80 0x7fa538106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.831+0000 7fa53ec9a640 1 -- 172.21.15.120:0/170036994 >> 172.21.15.120:0/170036994 conn(0x7fa5380fc7a0 msgr2=0x7fa5380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:07.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.831+0000 7fa53ec9a640 1 -- 172.21.15.120:0/170036994 shutdown_connections 2024-09-19T05:19:07.848 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.831+0000 7fa53ec9a640 1 -- 172.21.15.120:0/170036994 wait complete. 2024-09-19T05:19:07.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.832+0000 7fa53ec9a640 1 Processor -- start 2024-09-19T05:19:07.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.832+0000 7fa53ec9a640 1 -- start start 2024-09-19T05:19:07.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.832+0000 7fa53ec9a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa538100a80 0x7fa5381993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:07.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.832+0000 7fa53ec9a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa538101420 0x7fa5381998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:07.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.832+0000 7fa53ec9a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa538106a80 0x7fa5381a4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:07.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.832+0000 7fa53ec9a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa538110dd0 con 0x7fa538106a80 2024-09-19T05:19:07.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.832+0000 7fa53ec9a640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa538110c50 con 0x7fa538101420 2024-09-19T05:19:07.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.832+0000 7fa53ec9a640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa538110f50 con 0x7fa538100a80 2024-09-19T05:19:07.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.832+0000 7fa53d237640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa538106a80 0x7fa5381a4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:07.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.832+0000 7fa53d237640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa538106a80 0x7fa5381a4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49378/0 (socket says 172.21.15.120:49378) 2024-09-19T05:19:07.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.832+0000 7fa53d237640 1 -- 172.21.15.120:0/1795289957 learned_addr learned my addr 172.21.15.120:0/1795289957 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:07.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.832+0000 7fa52ffff640 1 --2- 172.21.15.120:0/1795289957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa538101420 0x7fa5381998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:07.849 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.832+0000 7fa53d237640 1 -- 172.21.15.120:0/1795289957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa538100a80 msgr2=0x7fa5381993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:07.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.832+0000 7fa53d237640 1 --2- 172.21.15.120:0/1795289957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa538100a80 0x7fa5381993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.832+0000 7fa53d237640 1 -- 172.21.15.120:0/1795289957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa538101420 msgr2=0x7fa5381998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:07.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.832+0000 7fa53d237640 1 --2- 172.21.15.120:0/1795289957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa538101420 0x7fa5381998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.832+0000 7fa53d237640 1 -- 172.21.15.120:0/1795289957 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5381a4960 con 0x7fa538106a80 2024-09-19T05:19:07.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.833+0000 7fa52ffff640 1 --2- 172.21.15.120:0/1795289957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa538101420 0x7fa5381998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:07.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.833+0000 7fa53d237640 1 --2- 172.21.15.120:0/1795289957 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa538106a80 0x7fa5381a4420 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa53000b970 tx=0x7fa53000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:07.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.833+0000 7fa52dffb640 1 -- 172.21.15.120:0/1795289957 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa530019070 con 0x7fa538106a80 2024-09-19T05:19:07.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.833+0000 7fa53ec9a640 1 -- 172.21.15.120:0/1795289957 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5381a4b30 con 0x7fa538106a80 2024-09-19T05:19:07.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.833+0000 7fa52dffb640 1 -- 172.21.15.120:0/1795289957 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa530014440 con 0x7fa538106a80 2024-09-19T05:19:07.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.833+0000 7fa52dffb640 1 -- 172.21.15.120:0/1795289957 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5300075d0 con 0x7fa538106a80 2024-09-19T05:19:07.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.833+0000 7fa53ec9a640 1 -- 172.21.15.120:0/1795289957 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5381a4ff0 con 0x7fa538106a80 2024-09-19T05:19:07.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.835+0000 7fa52dffb640 1 -- 172.21.15.120:0/1795289957 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7fa53001c070 con 0x7fa538106a80 2024-09-19T05:19:07.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.836+0000 7fa541073740 1 Processor -- start 2024-09-19T05:19:07.850 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.836+0000 7fa541073740 1 -- start start 2024-09-19T05:19:07.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.836+0000 7fa52dffb640 1 --2- 172.21.15.120:0/1795289957 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa5200a32d0 0x7fa5200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:07.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.836+0000 7fa541073740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5630339178b0 0x563033917c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:07.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.836+0000 7fa541073740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630339181d0 0x563033926a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:07.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.836+0000 7fa541073740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563033926fc0 0x5630339293b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:07.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.836+0000 7fa541073740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56303387e090 con 0x5630339181d0 2024-09-19T05:19:07.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.836+0000 7fa541073740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x563033825a70 con 0x563033926fc0 2024-09-19T05:19:07.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.836+0000 7fa541073740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56303387a050 con 0x5630339178b0 2024-09-19T05:19:07.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.836+0000 7fa52ffff640 1 --2- 172.21.15.120:0/1795289957 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa5200a32d0 0x7fa5200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:07.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.836+0000 7fa52ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630339181d0 0x563033926a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:07.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.836+0000 7fa52dffb640 1 -- 172.21.15.120:0/1795289957 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8298+0+0 (secure 0 0 0) 0x7fa5300cf050 con 0x7fa538106a80 2024-09-19T05:19:07.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.836+0000 7fa52ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630339181d0 0x563033926a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49390/0 (socket says 172.21.15.120:49390) 2024-09-19T05:19:07.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.836+0000 7fa52ffff640 1 -- 172.21.15.120:0/86692715 learned_addr learned my addr 172.21.15.120:0/86692715 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:07.851 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.836+0000 7fa53d237640 1 --2- 172.21.15.120:0/86692715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563033926fc0 0x5630339293b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:07.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.836+0000 7fa53ca36640 1 --2- 172.21.15.120:0/86692715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5630339178b0 0x563033917c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:07.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.837+0000 7fa52ffff640 1 -- 172.21.15.120:0/86692715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5630339178b0 msgr2=0x563033917c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:07.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.837+0000 7fa52ffff640 1 --2- 172.21.15.120:0/86692715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5630339178b0 0x563033917c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.837+0000 7fa52ffff640 1 -- 172.21.15.120:0/86692715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563033926fc0 msgr2=0x5630339293b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:07.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.837+0000 7fa52ffff640 1 --2- 172.21.15.120:0/86692715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563033926fc0 0x5630339293b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.837+0000 7fa52ffff640 1 -- 172.21.15.120:0/86692715 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563033832130 con 0x5630339181d0 2024-09-19T05:19:07.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.837+0000 7fa53d237640 1 --2- 172.21.15.120:0/86692715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563033926fc0 0x5630339293b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:19:07.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.837+0000 7fa52ffff640 1 --2- 172.21.15.120:0/1795289957 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa5200a32d0 0x7fa5200a5790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa528032fd0 tx=0x7fa528000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:07.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.837+0000 7fa52ffff640 1 --2- 172.21.15.120:0/86692715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630339181d0 0x563033926a80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa528004280 tx=0x7fa528044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1576262529ac4d5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:07.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.837+0000 7fa51effd640 1 -- 172.21.15.120:0/86692715 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52804f070 con 0x5630339181d0 2024-09-19T05:19:07.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.837+0000 7fa51effd640 1 -- 172.21.15.120:0/86692715 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa528004430 con 0x5630339181d0 2024-09-19T05:19:07.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.837+0000 7fa51effd640 1 -- 172.21.15.120:0/86692715 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa528035040 con 0x5630339181d0 2024-09-19T05:19:07.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.838+0000 7fa541073740 1 -- 172.21.15.120:0/86692715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630339181d0 msgr2=0x563033926a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:07.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.838+0000 7fa541073740 1 --2- 172.21.15.120:0/86692715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630339181d0 0x563033926a80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa528004280 tx=0x7fa528044000 comp rx=0 tx=0).stop 2024-09-19T05:19:07.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.838+0000 7fa541073740 1 -- 172.21.15.120:0/86692715 shutdown_connections 2024-09-19T05:19:07.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.838+0000 7fa541073740 1 --2- 172.21.15.120:0/86692715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563033926fc0 0x5630339293b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.838+0000 7fa541073740 1 --2- 172.21.15.120:0/86692715 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630339181d0 0x563033926a80 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.838+0000 7fa541073740 1 --2- 172.21.15.120:0/86692715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5630339178b0 0x563033917c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.838+0000 7fa541073740 1 -- 172.21.15.120:0/86692715 >> 172.21.15.120:0/86692715 conn(0x563033913f60 msgr2=0x563033914340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:07.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.838+0000 7fa541073740 1 -- 172.21.15.120:0/86692715 shutdown_connections 2024-09-19T05:19:07.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.838+0000 7fa541073740 1 -- 172.21.15.120:0/86692715 wait complete. 2024-09-19T05:19:07.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.838+0000 7fa541073740 1 -- start start 2024-09-19T05:19:07.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.838+0000 7fa541073740 1 Processor -- start 2024-09-19T05:19:07.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.839+0000 7fa541073740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630339178b0 0x563033926870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:07.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.839+0000 7fa541073740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5630339181d0 0x563033923bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:07.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.839+0000 7fa541073740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563033926fc0 0x563033924100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:07.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.839+0000 7fa541073740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563033929b90 con 0x5630339178b0 2024-09-19T05:19:07.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.839+0000 7fa541073740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x563033838f20 con 0x563033926fc0 2024-09-19T05:19:07.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.839+0000 7fa541073740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x563033929d10 con 0x5630339181d0 2024-09-19T05:19:07.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.839+0000 7fa541073740 10 client.0 _ll_register_callbacks cb 0x563033802030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:19:07.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.839+0000 7fa53ca36640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630339178b0 0x563033926870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:07.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.839+0000 7fa53ca36640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630339178b0 0x563033926870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49394/0 (socket says 172.21.15.120:49394) 2024-09-19T05:19:07.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.839+0000 7fa53ca36640 1 -- 172.21.15.120:0/2825885032 learned_addr learned my addr 172.21.15.120:0/2825885032 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:07.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.839+0000 7fa52ffff640 1 --2- 172.21.15.120:0/2825885032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5630339181d0 0x563033923bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:07.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.839+0000 7fa53d237640 1 --2- 172.21.15.120:0/2825885032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563033926fc0 0x563033924100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:07.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.839+0000 7fa53ca36640 1 -- 172.21.15.120:0/2825885032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5630339181d0 msgr2=0x563033923bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:07.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.839+0000 7fa53ca36640 1 --2- 172.21.15.120:0/2825885032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5630339181d0 0x563033923bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.839+0000 7fa53ca36640 1 -- 172.21.15.120:0/2825885032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563033926fc0 msgr2=0x563033924100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:07.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.839+0000 7fa53ca36640 1 --2- 172.21.15.120:0/2825885032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563033926fc0 0x563033924100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.839+0000 7fa53ca36640 1 -- 172.21.15.120:0/2825885032 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630335ef2b0 con 0x5630339178b0 2024-09-19T05:19:07.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.839+0000 7fa53ca36640 1 --2- 172.21.15.120:0/2825885032 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630339178b0 0x563033926870 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa53400e270 tx=0x7fa53400e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97b81a3d10d30db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:07.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.839+0000 7fa517fff640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:19:07.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.839+0000 7fa517fff640 1 -- 172.21.15.120:0/2825885032 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa534017070 con 0x5630339178b0 2024-09-19T05:19:07.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.839+0000 7fa517fff640 1 -- 172.21.15.120:0/2825885032 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8298+0+0 (secure 0 0 0) 0x7fa534013680 con 0x5630339178b0 2024-09-19T05:19:07.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.839+0000 7fa541073740 1 -- 172.21.15.120:0/2825885032 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa528004430 con 0x5630339178b0 2024-09-19T05:19:07.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.839+0000 7fa517fff640 1 -- 172.21.15.120:0/2825885032 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa534023050 con 0x5630339178b0 2024-09-19T05:19:07.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.839+0000 7fa541073740 10 client.15126 fetch_fsmap learned FSMap version 24 2024-09-19T05:19:07.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.839+0000 7fa541073740 1 -- 172.21.15.120:0/2825885032 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563033935550 con 0x5630339178b0 2024-09-19T05:19:07.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.840+0000 7fa517fff640 1 -- 172.21.15.120:0/2825885032 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa528004430 con 0x5630339178b0 2024-09-19T05:19:07.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.840+0000 7fa517fff640 1 -- 172.21.15.120:0/2825885032 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa534012930 con 0x5630339178b0 2024-09-19T05:19:07.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.840+0000 7fa541073740 10 client.15126 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:19:07.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.840+0000 7fa541073740 10 client.15126 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T05:19:07.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.840+0000 7fa541073740 20 client.15126 populate_metadata read hostname 'smithi120' 2024-09-19T05:19:07.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.840+0000 7fa541073740 1 --2- 172.21.15.120:0/2825885032 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x563033937b90 0x563033939000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:07.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.840+0000 7fa541073740 4 client.15126 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:19:07.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.840+0000 7fa541073740 1 -- 172.21.15.120:0/2825885032 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56303388b600 con 0x563033937b90 2024-09-19T05:19:07.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.840+0000 7fa52ffff640 1 --2- 172.21.15.120:0/2825885032 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x563033937b90 0x563033939000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:07.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.841+0000 7fa517fff640 10 client.15126 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:19:07.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.841+0000 7fa52ffff640 1 --2- 172.21.15.120:0/2825885032 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x563033937b90 0x563033939000 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39ae7361f1793ecb server_cookie=4149fab3baaee44 in_seq=0 out_seq=0 2024-09-19T05:19:07.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.841+0000 7fa517fff640 1 -- 172.21.15.120:0/2825885032 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56303388b600 con 0x563033937b90 2024-09-19T05:19:07.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.841+0000 7fa517fff640 10 client.15126 handle_command_reply: tid=0 2024-09-19T05:19:07.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.841+0000 7fa541073740 1 client.15126 shutdown 2024-09-19T05:19:07.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.842+0000 7fa541073740 1 -- 172.21.15.120:0/2825885032 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630339178b0 msgr2=0x563033926870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:07.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.842+0000 7fa541073740 1 --2- 172.21.15.120:0/2825885032 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630339178b0 0x563033926870 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa53400e270 tx=0x7fa53400e730 comp rx=0 tx=0).stop 2024-09-19T05:19:07.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.842+0000 7fa541073740 1 -- 172.21.15.120:0/2825885032 shutdown_connections 2024-09-19T05:19:07.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.842+0000 7fa541073740 1 --2- 172.21.15.120:0/2825885032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563033926fc0 0x563033924100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.842+0000 7fa541073740 1 --2- 172.21.15.120:0/2825885032 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x563033937b90 0x563033939000 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.842+0000 7fa541073740 1 --2- 172.21.15.120:0/2825885032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5630339181d0 0x563033923bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.842+0000 7fa517fff640 0 client.15126 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:19:07.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.842+0000 7fa541073740 1 --2- 172.21.15.120:0/2825885032 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630339178b0 0x563033926870 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.842+0000 7fa541073740 1 -- 172.21.15.120:0/2825885032 >> 172.21.15.120:0/2825885032 conn(0x563033913f60 msgr2=0x563033919cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:07.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.842+0000 7fa541073740 1 -- 172.21.15.120:0/2825885032 shutdown_connections 2024-09-19T05:19:07.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.842+0000 7fa541073740 1 -- 172.21.15.120:0/2825885032 wait complete. 2024-09-19T05:19:07.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.842+0000 7fa541073740 20 client.15126 trim_cache size 0 max 16384 2024-09-19T05:19:07.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.859+0000 7fa541073740 1 Processor -- start 2024-09-19T05:19:07.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.859+0000 7fa541073740 1 -- start start 2024-09-19T05:19:07.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.859+0000 7fa541073740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630339178b0 0x5630339374c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:07.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.859+0000 7fa541073740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5630339181d0 0x5630339412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:07.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.859+0000 7fa541073740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563033926fc0 0x563033941820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:07.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.859+0000 7fa541073740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563033937340 con 0x5630339178b0 2024-09-19T05:19:07.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.859+0000 7fa541073740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x563033937a10 con 0x563033926fc0 2024-09-19T05:19:07.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.859+0000 7fa541073740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5630339380e0 con 0x5630339181d0 2024-09-19T05:19:07.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.860+0000 7fa53ca36640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630339178b0 0x5630339374c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:07.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.860+0000 7fa53ca36640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630339178b0 0x5630339374c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49404/0 (socket says 172.21.15.120:49404) 2024-09-19T05:19:07.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.860+0000 7fa53ca36640 1 -- 172.21.15.120:0/49860094 learned_addr learned my addr 172.21.15.120:0/49860094 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:07.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.860+0000 7fa52ffff640 1 --2- 172.21.15.120:0/49860094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5630339181d0 0x5630339412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:07.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.860+0000 7fa53d237640 1 --2- 172.21.15.120:0/49860094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563033926fc0 0x563033941820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:07.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.860+0000 7fa53ca36640 1 -- 172.21.15.120:0/49860094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5630339181d0 msgr2=0x5630339412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:07.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.860+0000 7fa53ca36640 1 --2- 172.21.15.120:0/49860094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5630339181d0 0x5630339412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.860+0000 7fa53ca36640 1 -- 172.21.15.120:0/49860094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563033926fc0 msgr2=0x563033941820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:07.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.860+0000 7fa53ca36640 1 --2- 172.21.15.120:0/49860094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563033926fc0 0x563033941820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.860+0000 7fa53ca36640 1 -- 172.21.15.120:0/49860094 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563033918000 con 0x5630339178b0 2024-09-19T05:19:07.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.860+0000 7fa53d237640 1 --2- 172.21.15.120:0/49860094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563033926fc0 0x563033941820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:07.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.860+0000 7fa53ca36640 1 --2- 172.21.15.120:0/49860094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630339178b0 0x5630339374c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa534000c00 tx=0x7fa534009d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67734e6be877a194 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:07.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.860+0000 7fa51e7fc640 1 -- 172.21.15.120:0/49860094 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53402c070 con 0x5630339178b0 2024-09-19T05:19:07.863 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.860+0000 7fa51e7fc640 1 -- 172.21.15.120:0/49860094 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa534020030 con 0x5630339178b0 2024-09-19T05:19:07.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.860+0000 7fa51e7fc640 1 -- 172.21.15.120:0/49860094 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa534017070 con 0x5630339178b0 2024-09-19T05:19:07.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.861+0000 7fa541073740 1 -- 172.21.15.120:0/49860094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630339178b0 msgr2=0x5630339374c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:07.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.861+0000 7fa541073740 1 --2- 172.21.15.120:0/49860094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630339178b0 0x5630339374c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa534000c00 tx=0x7fa534009d00 comp rx=0 tx=0).stop 2024-09-19T05:19:07.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.861+0000 7fa541073740 1 -- 172.21.15.120:0/49860094 shutdown_connections 2024-09-19T05:19:07.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.861+0000 7fa541073740 1 --2- 172.21.15.120:0/49860094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563033926fc0 0x563033941820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.861+0000 7fa541073740 1 --2- 172.21.15.120:0/49860094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5630339181d0 0x5630339412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.861+0000 7fa541073740 1 --2- 172.21.15.120:0/49860094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5630339178b0 0x5630339374c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.861+0000 7fa541073740 1 -- 172.21.15.120:0/49860094 >> 172.21.15.120:0/49860094 conn(0x563033913f60 msgr2=0x56303391f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:07.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.861+0000 7fa541073740 1 -- 172.21.15.120:0/49860094 shutdown_connections 2024-09-19T05:19:07.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.861+0000 7fa541073740 1 -- 172.21.15.120:0/49860094 wait complete. 2024-09-19T05:19:07.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.861+0000 7fa541073740 1 -- start start 2024-09-19T05:19:07.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.861+0000 7fa541073740 1 Processor -- start 2024-09-19T05:19:07.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.862+0000 7fa541073740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5630339178b0 0x56303393c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:07.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.862+0000 7fa541073740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5630339181d0 0x56303393ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:07.868 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.862+0000 7fa541073740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563033926fc0 0x56303399a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:07.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.862+0000 7fa541073740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x563033938e80 con 0x563033926fc0 2024-09-19T05:19:07.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.862+0000 7fa541073740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5630339387b0 con 0x5630339178b0 2024-09-19T05:19:07.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.862+0000 7fa541073740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x563033939550 con 0x5630339181d0 2024-09-19T05:19:07.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.862+0000 7fa541073740 10 client.0 _ll_register_callbacks cb 0x7fa5340093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:19:07.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.862+0000 7fa53d237640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563033926fc0 0x56303399a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:07.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.862+0000 7fa53d237640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563033926fc0 0x56303399a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49408/0 (socket says 172.21.15.120:49408) 2024-09-19T05:19:07.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.862+0000 7fa53d237640 1 -- 172.21.15.120:0/4165266999 learned_addr learned my addr 172.21.15.120:0/4165266999 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:07.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.862+0000 7fa53ca36640 1 --2- 172.21.15.120:0/4165266999 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5630339178b0 0x56303393c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:07.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.862+0000 7fa52ffff640 1 --2- 172.21.15.120:0/4165266999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5630339181d0 0x56303393ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:07.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.862+0000 7fa53d237640 1 -- 172.21.15.120:0/4165266999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5630339181d0 msgr2=0x56303393ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:07.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.862+0000 7fa53d237640 1 --2- 172.21.15.120:0/4165266999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5630339181d0 0x56303393ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.862+0000 7fa53d237640 1 -- 172.21.15.120:0/4165266999 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5630339178b0 msgr2=0x56303393c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:07.869 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.862+0000 7fa53d237640 1 --2- 172.21.15.120:0/4165266999 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5630339178b0 0x56303393c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.862+0000 7fa53d237640 1 -- 172.21.15.120:0/4165266999 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56303399a970 con 0x563033926fc0 2024-09-19T05:19:07.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.862+0000 7fa52ffff640 1 --2- 172.21.15.120:0/4165266999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5630339181d0 0x56303393ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:19:07.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.862+0000 7fa53d237640 1 --2- 172.21.15.120:0/4165266999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563033926fc0 0x56303399a2d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa53009b520 tx=0x7fa530014960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a990af0f8d6a441a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:07.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.862+0000 7fa517fff640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:19:07.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.862+0000 7fa517fff640 1 -- 172.21.15.120:0/4165266999 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53007d360 con 0x563033926fc0 2024-09-19T05:19:07.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.862+0000 7fa517fff640 1 -- 172.21.15.120:0/4165266999 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8298+0+0 (secure 0 0 0) 0x7fa5300145f0 con 0x563033926fc0 2024-09-19T05:19:07.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.862+0000 7fa541073740 1 -- 172.21.15.120:0/4165266999 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa534020030 con 0x563033926fc0 2024-09-19T05:19:07.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.863+0000 7fa517fff640 1 -- 172.21.15.120:0/4165266999 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fa53009b5e0 con 0x563033926fc0 2024-09-19T05:19:07.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.863+0000 7fa541073740 10 client.15132 fetch_fsmap learned FSMap version 24 2024-09-19T05:19:07.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.863+0000 7fa541073740 1 -- 172.21.15.120:0/4165266999 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5630339a1cd0 con 0x563033926fc0 2024-09-19T05:19:07.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.863+0000 7fa517fff640 1 -- 172.21.15.120:0/4165266999 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa534020030 con 0x563033926fc0 2024-09-19T05:19:07.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.863+0000 7fa517fff640 1 -- 172.21.15.120:0/4165266999 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fa530060b80 con 0x563033926fc0 2024-09-19T05:19:07.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.863+0000 7fa541073740 10 client.15132 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T05:19:07.870 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.863+0000 7fa541073740 10 client.15132 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T05:19:07.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.863+0000 7fa541073740 20 client.15132 populate_metadata read hostname 'smithi120' 2024-09-19T05:19:07.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.863+0000 7fa541073740 1 --2- 172.21.15.120:0/4165266999 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5630339a68b0 0x5630339a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:07.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.863+0000 7fa541073740 4 client.15132 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T05:19:07.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.863+0000 7fa541073740 1 -- 172.21.15.120:0/4165266999 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "status"}) -- 0x563033885b10 con 0x5630339a68b0 2024-09-19T05:19:07.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.863+0000 7fa53ca36640 1 --2- 172.21.15.120:0/4165266999 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5630339a68b0 0x5630339a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:07.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.864+0000 7fa53ca36640 1 --2- 172.21.15.120:0/4165266999 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5630339a68b0 0x5630339a55c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61d22b5ad2f30e3 server_cookie=b09cb8233f8a271d in_seq=0 out_seq=0 2024-09-19T05:19:07.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.864+0000 7fa517fff640 10 client.15132 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:19:07.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.864+0000 7fa517fff640 1 -- 172.21.15.120:0/4165266999 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x563033885b10 con 0x5630339a68b0 2024-09-19T05:19:07.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.864+0000 7fa517fff640 10 client.15132 handle_command_reply: tid=0 2024-09-19T05:19:07.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.864+0000 7fa541073740 1 client.15132 shutdown 2024-09-19T05:19:07.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.864+0000 7fa541073740 1 -- 172.21.15.120:0/4165266999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563033926fc0 msgr2=0x56303399a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:07.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.864+0000 7fa541073740 1 --2- 172.21.15.120:0/4165266999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563033926fc0 0x56303399a2d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa53009b520 tx=0x7fa530014960 comp rx=0 tx=0).stop 2024-09-19T05:19:07.871 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.864+0000 7fa541073740 1 -- 172.21.15.120:0/4165266999 shutdown_connections 2024-09-19T05:19:07.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.864+0000 7fa541073740 1 --2- 172.21.15.120:0/4165266999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x563033926fc0 0x56303399a2d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.864+0000 7fa541073740 1 --2- 172.21.15.120:0/4165266999 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5630339a68b0 0x5630339a55c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.864+0000 7fa541073740 1 --2- 172.21.15.120:0/4165266999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5630339181d0 0x56303393ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.864+0000 7fa517fff640 0 client.15132 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:19:07.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.864+0000 7fa541073740 1 --2- 172.21.15.120:0/4165266999 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5630339178b0 0x56303393c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.864+0000 7fa541073740 1 -- 172.21.15.120:0/4165266999 >> 172.21.15.120:0/4165266999 conn(0x563033913f60 msgr2=0x563033919410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:07.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.864+0000 7fa541073740 1 -- 172.21.15.120:0/4165266999 shutdown_connections 2024-09-19T05:19:07.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.864+0000 7fa541073740 1 -- 172.21.15.120:0/4165266999 wait complete. 2024-09-19T05:19:07.872 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.864+0000 7fa541073740 20 client.15132 trim_cache size 0 max 16384 2024-09-19T05:19:07.872 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T05:19:07.873 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "4e6e3df4-7645-11ef-bceb-c7b262605968", 2024-09-19T05:19:07.873 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 0, 2024-09-19T05:19:07.873 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 24445, 2024-09-19T05:19:07.873 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2024-09-19T05:19:07.873 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2024-09-19T05:19:07.873 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2024-09-19T05:19:07.873 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 96.676332905999999, 2024-09-19T05:19:07.873 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 24, 2024-09-19T05:19:07.873 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 84, 2024-09-19T05:19:07.873 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T05:19:07.873 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 115.917094116 2024-09-19T05:19:07.873 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T05:19:07.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.865+0000 7fa53ec9a640 1 -- 172.21.15.120:0/1795289957 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa5200a32d0 msgr2=0x7fa5200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:07.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.865+0000 7fa53ec9a640 1 --2- 172.21.15.120:0/1795289957 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa5200a32d0 0x7fa5200a5790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa528032fd0 tx=0x7fa528000bc0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.865+0000 7fa53ec9a640 1 -- 172.21.15.120:0/1795289957 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa538106a80 msgr2=0x7fa5381a4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:07.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.865+0000 7fa53ec9a640 1 --2- 172.21.15.120:0/1795289957 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa538106a80 0x7fa5381a4420 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa53000b970 tx=0x7fa53000be30 comp rx=0 tx=0).stop 2024-09-19T05:19:07.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.865+0000 7fa53ec9a640 1 -- 172.21.15.120:0/1795289957 shutdown_connections 2024-09-19T05:19:07.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.865+0000 7fa53ec9a640 1 --2- 172.21.15.120:0/1795289957 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa538106a80 0x7fa5381a4420 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.865+0000 7fa53ec9a640 1 --2- 172.21.15.120:0/1795289957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa538101420 0x7fa5381998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.865+0000 7fa53ec9a640 1 --2- 172.21.15.120:0/1795289957 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fa5200a32d0 0x7fa5200a5790 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.865+0000 7fa53ec9a640 1 --2- 172.21.15.120:0/1795289957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa538100a80 0x7fa5381993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:07.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.865+0000 7fa53ec9a640 1 -- 172.21.15.120:0/1795289957 >> 172.21.15.120:0/1795289957 conn(0x7fa5380fc7a0 msgr2=0x7fa5380fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:07.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.865+0000 7fa53ec9a640 1 -- 172.21.15.120:0/1795289957 shutdown_connections 2024-09-19T05:19:07.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:07.865+0000 7fa53ec9a640 1 -- 172.21.15.120:0/1795289957 wait complete. 2024-09-19T05:19:08.572 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T05:19:08.581 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T05:19:08.581 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T05:19:08.581 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T05:19:08.582 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-19T05:19:08.582 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T05:19:08.583 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi120.front.sepia.ceph.com 2024-09-19T05:19:08.583 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-19T05:19:08.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.682+0000 7f3b017a6640 1 -- 172.21.15.120:0/1822204337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3afc100a60 msgr2=0x7f3afc100e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:08.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.682+0000 7f3b017a6640 1 --2- 172.21.15.120:0/1822204337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3afc100a60 0x7f3afc100e60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3aec009900 tx=0x7f3aec02a3f0 comp rx=0 tx=0).stop 2024-09-19T05:19:08.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.682+0000 7f3b017a6640 1 -- 172.21.15.120:0/1822204337 shutdown_connections 2024-09-19T05:19:08.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.682+0000 7f3b017a6640 1 --2- 172.21.15.120:0/1822204337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3afc102610 0x7f3afc108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:08.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.682+0000 7f3b017a6640 1 --2- 172.21.15.120:0/1822204337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3afc101c50 0x7f3afc1020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:08.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.682+0000 7f3b017a6640 1 --2- 172.21.15.120:0/1822204337 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3afc100a60 0x7f3afc100e60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:08.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.682+0000 7f3b017a6640 1 -- 172.21.15.120:0/1822204337 >> 172.21.15.120:0/1822204337 conn(0x7f3afc0fc1e0 msgr2=0x7f3afc0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:08.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.682+0000 7f3b017a6640 1 -- 172.21.15.120:0/1822204337 shutdown_connections 2024-09-19T05:19:08.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.682+0000 7f3b017a6640 1 -- 172.21.15.120:0/1822204337 wait complete. 2024-09-19T05:19:08.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.683+0000 7f3b017a6640 1 Processor -- start 2024-09-19T05:19:08.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.683+0000 7f3b017a6640 1 -- start start 2024-09-19T05:19:08.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.683+0000 7f3b017a6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3afc100a60 0x7f3afc197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:08.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.683+0000 7f3b017a6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3afc101c50 0x7f3afc198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:08.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.683+0000 7f3b017a6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3afc102610 0x7f3afc19f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:08.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.683+0000 7f3b017a6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc10c640 con 0x7f3afc102610 2024-09-19T05:19:08.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.683+0000 7f3b017a6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc10c4c0 con 0x7f3afc100a60 2024-09-19T05:19:08.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.683+0000 7f3b017a6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3afc10c7c0 con 0x7f3afc101c50 2024-09-19T05:19:08.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.683+0000 7f3afb7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3afc102610 0x7f3afc19f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:08.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.683+0000 7f3afb7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3afc102610 0x7f3afc19f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49428/0 (socket says 172.21.15.120:49428) 2024-09-19T05:19:08.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.683+0000 7f3afb7fe640 1 -- 172.21.15.120:0/1926842464 learned_addr learned my addr 172.21.15.120:0/1926842464 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:08.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.683+0000 7f3afaffd640 1 --2- 172.21.15.120:0/1926842464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3afc100a60 0x7f3afc197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:08.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.683+0000 7f3afb7fe640 1 -- 172.21.15.120:0/1926842464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3afc101c50 msgr2=0x7f3afc198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:08.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.683+0000 7f3afb7fe640 1 --2- 172.21.15.120:0/1926842464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3afc101c50 0x7f3afc198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:08.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.683+0000 7f3afb7fe640 1 -- 172.21.15.120:0/1926842464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3afc100a60 msgr2=0x7f3afc197d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:08.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.683+0000 7f3afb7fe640 1 --2- 172.21.15.120:0/1926842464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3afc100a60 0x7f3afc197d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:08.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.683+0000 7f3afb7fe640 1 -- 172.21.15.120:0/1926842464 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3afc19f930 con 0x7f3afc102610 2024-09-19T05:19:08.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.683+0000 7f3afaffd640 1 --2- 172.21.15.120:0/1926842464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3afc100a60 0x7f3afc197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:08.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.684+0000 7f3afb7fe640 1 --2- 172.21.15.120:0/1926842464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3afc102610 0x7f3afc19f290 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3af400b970 tx=0x7f3af400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:08.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.684+0000 7f3af8ff9640 1 -- 172.21.15.120:0/1926842464 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af4019070 con 0x7f3afc102610 2024-09-19T05:19:08.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.684+0000 7f3af8ff9640 1 -- 172.21.15.120:0/1926842464 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3af4014440 con 0x7f3afc102610 2024-09-19T05:19:08.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.684+0000 7f3b017a6640 1 -- 172.21.15.120:0/1926842464 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3afc19fc20 con 0x7f3afc102610 2024-09-19T05:19:08.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.684+0000 7f3af8ff9640 1 -- 172.21.15.120:0/1926842464 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af40075d0 con 0x7f3afc102610 2024-09-19T05:19:08.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.684+0000 7f3b017a6640 1 -- 172.21.15.120:0/1926842464 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3afc1a01f0 con 0x7f3afc102610 2024-09-19T05:19:08.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.685+0000 7f3b017a6640 1 -- 172.21.15.120:0/1926842464 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3afc1088e0 con 0x7f3afc102610 2024-09-19T05:19:08.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.686+0000 7f3af8ff9640 1 -- 172.21.15.120:0/1926842464 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 17) ==== 138407+0+0 (secure 0 0 0) 0x7f3af401c070 con 0x7f3afc102610 2024-09-19T05:19:08.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.686+0000 7f3af8ff9640 1 --2- 172.21.15.120:0/1926842464 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3ae80a3410 0x7f3ae80a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:08.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.687+0000 7f3af8ff9640 1 -- 172.21.15.120:0/1926842464 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8298+0+0 (secure 0 0 0) 0x7f3af40cf4a0 con 0x7f3afc102610 2024-09-19T05:19:08.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.687+0000 7f3afaffd640 1 --2- 172.21.15.120:0/1926842464 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3ae80a3410 0x7f3ae80a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:08.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.687+0000 7f3afaffd640 1 --2- 172.21.15.120:0/1926842464 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3ae80a3410 0x7f3ae80a58d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3aec005ab0 tx=0x7f3aec000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:08.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.690+0000 7f3af8ff9640 1 -- 172.21.15.120:0/1926842464 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3af409c130 con 0x7f3afc102610 2024-09-19T05:19:08.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:08.900+0000 7f3b017a6640 1 -- 172.21.15.120:0/1926842464 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f3afc02da10 con 0x7f3afc102610 2024-09-19T05:19:09.290 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:09.288+0000 7f3af8ff9640 1 -- 172.21.15.120:0/1926842464 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v18) ==== 92+0+0 (secure 0 0 0) 0x7f3af409ba30 con 0x7f3afc102610 2024-09-19T05:19:09.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:09.291+0000 7f3b017a6640 1 -- 172.21.15.120:0/1926842464 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3ae80a3410 msgr2=0x7f3ae80a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:09.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:09.291+0000 7f3b017a6640 1 --2- 172.21.15.120:0/1926842464 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3ae80a3410 0x7f3ae80a58d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3aec005ab0 tx=0x7f3aec000bc0 comp rx=0 tx=0).stop 2024-09-19T05:19:09.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:09.291+0000 7f3b017a6640 1 -- 172.21.15.120:0/1926842464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3afc102610 msgr2=0x7f3afc19f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:09.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:09.291+0000 7f3b017a6640 1 --2- 172.21.15.120:0/1926842464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3afc102610 0x7f3afc19f290 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3af400b970 tx=0x7f3af400be30 comp rx=0 tx=0).stop 2024-09-19T05:19:09.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:09.292+0000 7f3b017a6640 1 -- 172.21.15.120:0/1926842464 shutdown_connections 2024-09-19T05:19:09.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:09.292+0000 7f3b017a6640 1 --2- 172.21.15.120:0/1926842464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3afc102610 0x7f3afc19f290 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:09.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:09.292+0000 7f3b017a6640 1 --2- 172.21.15.120:0/1926842464 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7f3ae80a3410 0x7f3ae80a58d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:09.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:09.292+0000 7f3b017a6640 1 --2- 172.21.15.120:0/1926842464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3afc101c50 0x7f3afc198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:09.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:09.292+0000 7f3b017a6640 1 --2- 172.21.15.120:0/1926842464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3afc100a60 0x7f3afc197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:09.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:09.292+0000 7f3b017a6640 1 -- 172.21.15.120:0/1926842464 >> 172.21.15.120:0/1926842464 conn(0x7f3afc0fc1e0 msgr2=0x7f3afc0fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:09.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:09.292+0000 7f3b017a6640 1 -- 172.21.15.120:0/1926842464 shutdown_connections 2024-09-19T05:19:09.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:09.292+0000 7f3b017a6640 1 -- 172.21.15.120:0/1926842464 wait complete. 2024-09-19T05:19:09.310 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-19T05:19:09.382 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-19T05:19:09.382 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-19T05:19:09.382 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-09-19T05:19:09.383 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T05:19:09.383 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T05:19:09.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:09.383 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-09-19T05:19:09.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:09.400 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link delete ceph-brx 2024-09-19T05:19:09.467 INFO:teuthology.orchestra.run.smithi120.stderr:Cannot find device "ceph-brx" 2024-09-19T05:19:09.468 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:19:09.469 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-19T05:19:09.469 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-19T05:19:09.469 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T05:19:09.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:09 smithi120 ceph-mon[30956]: pgmap v324: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T05:19:09.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:09 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1926842464' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T05:19:09.626 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:09 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: ignoring --setuser ceph since I am not root 2024-09-19T05:19:09.626 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:09 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: ignoring --setgroup ceph since I am not root 2024-09-19T05:19:09.626 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:09 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:09.443+0000 7f1fac515040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T05:19:09.626 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:09 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:09.503+0000 7f1fac515040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:19:09.647 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:09 smithi194 ceph-mon[35228]: pgmap v324: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T05:19:09.648 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:09 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1926842464' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T05:19:09.648 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:09 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: ignoring --setuser ceph since I am not root 2024-09-19T05:19:09.648 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:09 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: ignoring --setgroup ceph since I am not root 2024-09-19T05:19:09.648 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:09 smithi194 ceph-mgr[37041]: -- 172.21.15.194:0/3005549356 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d8246c10e0 con 0x55d82469e800 2024-09-19T05:19:09.648 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:09 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:19:09.441+0000 7f68db56f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T05:19:09.648 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:09 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:19:09.498+0000 7f68db56f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:19:09.648 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:09 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:19:09.646+0000 7f68db56f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:19:09.649 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:09 smithi178 ceph-mon[34347]: pgmap v324: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T05:19:09.649 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:09 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1926842464' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T05:19:09.649 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:09 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: ignoring --setuser ceph since I am not root 2024-09-19T05:19:09.649 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:09 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: ignoring --setgroup ceph since I am not root 2024-09-19T05:19:09.649 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:09 smithi178 ceph-mgr[35718]: -- 172.21.15.178:0/3745762277 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5563bdbf50e0 con 0x5563bdbd2800 2024-09-19T05:19:09.649 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:09 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:19:09.442+0000 7f163addf040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T05:19:09.649 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:09 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:19:09.499+0000 7f163addf040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T05:19:09.649 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:09 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:19:09.646+0000 7f163addf040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:19:09.774 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:09.905 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:09 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:19:09.712+0000 7f68db56f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:19:09.905 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:09 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:19:09.858+0000 7f68db56f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:19:09.942 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:09 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:19:09.712+0000 7f163addf040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:19:09.942 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:09 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:19:09.857+0000 7f163addf040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:19:10.013 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:09 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:09.658+0000 7f1fac515040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T05:19:10.013 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:09 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:09.737+0000 7f1fac515040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T05:19:10.013 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:09 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:09.898+0000 7f1fac515040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:19:10.279 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:10 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:10.044+0000 7f1fac515040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:19:10.291 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:10 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:19:09.999+0000 7f68db56f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:19:10.291 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:09 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:19:09.997+0000 7f163addf040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T05:19:10.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.277+0000 7fc3c2798640 1 -- 172.21.15.120:0/132653601 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3bc106f20 msgr2=0x7fc3bc10eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:10.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.277+0000 7fc3c2798640 1 --2- 172.21.15.120:0/132653601 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3bc106f20 0x7fc3bc10eaa0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009ca0 tx=0x7fc3b402a8c0 comp rx=0 tx=0).stop 2024-09-19T05:19:10.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.277+0000 7fc3c2798640 1 -- 172.21.15.120:0/132653601 shutdown_connections 2024-09-19T05:19:10.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.277+0000 7fc3c2798640 1 --2- 172.21.15.120:0/132653601 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3bc106f20 0x7fc3bc10eaa0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:10.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.277+0000 7fc3c2798640 1 --2- 172.21.15.120:0/132653601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3bc1027a0 0x7fc3bc1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:10.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.277+0000 7fc3c2798640 1 --2- 172.21.15.120:0/132653601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3bc101df0 0x7fc3bc1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:10.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.277+0000 7fc3c2798640 1 -- 172.21.15.120:0/132653601 >> 172.21.15.120:0/132653601 conn(0x7fc3bc0fd8f0 msgr2=0x7fc3bc0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:10.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.277+0000 7fc3c2798640 1 -- 172.21.15.120:0/132653601 shutdown_connections 2024-09-19T05:19:10.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.277+0000 7fc3c2798640 1 -- 172.21.15.120:0/132653601 wait complete. 2024-09-19T05:19:10.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.278+0000 7fc3c2798640 1 Processor -- start 2024-09-19T05:19:10.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.278+0000 7fc3c2798640 1 -- start start 2024-09-19T05:19:10.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.278+0000 7fc3c2798640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3bc101df0 0x7fc3bc1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:10.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.278+0000 7fc3c2798640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3bc1027a0 0x7fc3bc198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:10.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.278+0000 7fc3c2798640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3bc106f20 0x7fc3bc19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:10.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.278+0000 7fc3c2798640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc111e30 con 0x7fc3bc106f20 2024-09-19T05:19:10.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.278+0000 7fc3c2798640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc111cb0 con 0x7fc3bc101df0 2024-09-19T05:19:10.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.278+0000 7fc3c2798640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc3bc111fb0 con 0x7fc3bc1027a0 2024-09-19T05:19:10.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.279+0000 7fc3c0d35640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3bc106f20 0x7fc3bc19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:10.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.279+0000 7fc3c0d35640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3bc106f20 0x7fc3bc19cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49456/0 (socket says 172.21.15.120:49456) 2024-09-19T05:19:10.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.279+0000 7fc3c0d35640 1 -- 172.21.15.120:0/2889357380 learned_addr learned my addr 172.21.15.120:0/2889357380 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:10.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.279+0000 7fc3bb7fe640 1 --2- 172.21.15.120:0/2889357380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3bc1027a0 0x7fc3bc198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:10.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.279+0000 7fc3bbfff640 1 --2- 172.21.15.120:0/2889357380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3bc101df0 0x7fc3bc1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:10.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.279+0000 7fc3bb7fe640 1 -- 172.21.15.120:0/2889357380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3bc101df0 msgr2=0x7fc3bc1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:10.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.279+0000 7fc3bb7fe640 1 --2- 172.21.15.120:0/2889357380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3bc101df0 0x7fc3bc1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:10.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.279+0000 7fc3bb7fe640 1 -- 172.21.15.120:0/2889357380 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3bc106f20 msgr2=0x7fc3bc19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:10.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.279+0000 7fc3bb7fe640 1 --2- 172.21.15.120:0/2889357380 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3bc106f20 0x7fc3bc19cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:10.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.279+0000 7fc3bb7fe640 1 -- 172.21.15.120:0/2889357380 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3bc19d380 con 0x7fc3bc1027a0 2024-09-19T05:19:10.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.279+0000 7fc3c0d35640 1 --2- 172.21.15.120:0/2889357380 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3bc106f20 0x7fc3bc19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:19:10.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.279+0000 7fc3bb7fe640 1 --2- 172.21.15.120:0/2889357380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3bc1027a0 0x7fc3bc198910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000e9f0 tx=0x7fc3b000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:10.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.279+0000 7fc3b97fa640 1 -- 172.21.15.120:0/2889357380 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b000ccc0 con 0x7fc3bc1027a0 2024-09-19T05:19:10.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.279+0000 7fc3c2798640 1 -- 172.21.15.120:0/2889357380 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3bc19d670 con 0x7fc3bc1027a0 2024-09-19T05:19:10.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.279+0000 7fc3b97fa640 1 -- 172.21.15.120:0/2889357380 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc3b0005020 con 0x7fc3bc1027a0 2024-09-19T05:19:10.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.280+0000 7fc3b97fa640 1 -- 172.21.15.120:0/2889357380 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0004a00 con 0x7fc3bc1027a0 2024-09-19T05:19:10.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.280+0000 7fc3c2798640 1 -- 172.21.15.120:0/2889357380 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3bc1a4f50 con 0x7fc3bc1027a0 2024-09-19T05:19:10.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.281+0000 7fc3c2798640 1 -- 172.21.15.120:0/2889357380 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3bc1021d0 con 0x7fc3bc1027a0 2024-09-19T05:19:10.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.282+0000 7fc3b97fa640 1 -- 172.21.15.120:0/2889357380 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 18) ==== 138424+0+0 (secure 0 0 0) 0x7fc3b0004ba0 con 0x7fc3bc1027a0 2024-09-19T05:19:10.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.282+0000 7fc3b97fa640 1 --2- 172.21.15.120:0/2889357380 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fc3a40a3320 0x7fc3a40a57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:10.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.282+0000 7fc3bbfff640 1 -- 172.21.15.120:0/2889357380 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fc3a40a3320 msgr2=0x7fc3a40a57e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.120:6800/955692128 2024-09-19T05:19:10.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.282+0000 7fc3b97fa640 1 -- 172.21.15.120:0/2889357380 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8298+0+0 (secure 0 0 0) 0x7fc3b00cfa80 con 0x7fc3bc1027a0 2024-09-19T05:19:10.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.282+0000 7fc3bbfff640 1 --2- 172.21.15.120:0/2889357380 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fc3a40a3320 0x7fc3a40a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T05:19:10.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.286+0000 7fc3b97fa640 1 -- 172.21.15.120:0/2889357380 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc3b009c5e0 con 0x7fc3bc1027a0 2024-09-19T05:19:10.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.483+0000 7fc3bbfff640 1 -- 172.21.15.120:0/2889357380 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fc3a40a3320 msgr2=0x7fc3a40a57e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.120:6800/955692128 2024-09-19T05:19:10.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.483+0000 7fc3bbfff640 1 --2- 172.21.15.120:0/2889357380 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fc3a40a3320 0x7fc3a40a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T05:19:10.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.495+0000 7fc3c2798640 1 -- 172.21.15.120:0/2889357380 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc3bc10a160 con 0x7fc3bc1027a0 2024-09-19T05:19:10.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.495+0000 7fc3b97fa640 1 -- 172.21.15.120:0/2889357380 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7fc3b009bee0 con 0x7fc3bc1027a0 2024-09-19T05:19:10.497 INFO:teuthology.orchestra.run.smithi120.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T05:19:10.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.497+0000 7fc3c2798640 1 -- 172.21.15.120:0/2889357380 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fc3a40a3320 msgr2=0x7fc3a40a57e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:19:10.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.497+0000 7fc3c2798640 1 --2- 172.21.15.120:0/2889357380 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fc3a40a3320 0x7fc3a40a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:10.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.497+0000 7fc3c2798640 1 -- 172.21.15.120:0/2889357380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3bc1027a0 msgr2=0x7fc3bc198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:10.499 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.497+0000 7fc3c2798640 1 --2- 172.21.15.120:0/2889357380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3bc1027a0 0x7fc3bc198910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000e9f0 tx=0x7fc3b000eeb0 comp rx=0 tx=0).stop 2024-09-19T05:19:10.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.497+0000 7fc3c2798640 1 -- 172.21.15.120:0/2889357380 shutdown_connections 2024-09-19T05:19:10.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.497+0000 7fc3c2798640 1 --2- 172.21.15.120:0/2889357380 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc3bc106f20 0x7fc3bc19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:10.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.497+0000 7fc3c2798640 1 --2- 172.21.15.120:0/2889357380 >> [v2:172.21.15.120:6800/955692128,v1:172.21.15.120:6801/955692128] conn(0x7fc3a40a3320 0x7fc3a40a57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:10.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.497+0000 7fc3c2798640 1 --2- 172.21.15.120:0/2889357380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3bc1027a0 0x7fc3bc198910 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:10.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.497+0000 7fc3c2798640 1 --2- 172.21.15.120:0/2889357380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3bc101df0 0x7fc3bc1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:10.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.497+0000 7fc3c2798640 1 -- 172.21.15.120:0/2889357380 >> 172.21.15.120:0/2889357380 conn(0x7fc3bc0fd8f0 msgr2=0x7fc3bc0fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:10.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.497+0000 7fc3c2798640 1 -- 172.21.15.120:0/2889357380 shutdown_connections 2024-09-19T05:19:10.500 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:10.497+0000 7fc3c2798640 1 -- 172.21.15.120:0/2889357380 wait complete. 2024-09-19T05:19:10.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:10 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1926842464' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T05:19:10.555 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:10 smithi178 ceph-mon[34347]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T05:19:10.555 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:10 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:19:10.308+0000 7f163addf040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:19:10.555 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:10 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:19:10.369+0000 7f163addf040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:19:10.555 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:10 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:19:10.553+0000 7f163addf040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:19:10.557 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:10 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1926842464' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T05:19:10.557 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:10 smithi194 ceph-mon[35228]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T05:19:10.557 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:10 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:19:10.310+0000 7f68db56f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:19:10.557 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:10 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:19:10.371+0000 7f68db56f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:19:10.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:10 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1926842464' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T05:19:10.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:10 smithi120 ceph-mon[30956]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T05:19:10.625 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:10 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:10.366+0000 7f1fac515040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T05:19:10.625 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:10 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:10.428+0000 7f1fac515040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T05:19:10.898 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:10 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:10.624+0000 7f1fac515040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:19:10.905 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:10 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:19:10.555+0000 7f68db56f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T05:19:11.215 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T05:19:11.215 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T05:19:11.216 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi120.front.sepia.ceph.com 2024-09-19T05:19:11.216 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T05:19:11.216 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T05:19:11.216 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T05:19:11.216 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T05:19:11.216 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T05:19:11.216 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:19:11.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:11.216 DEBUG:teuthology.orchestra.run.smithi120:> ip addr 2024-09-19T05:19:11.233 INFO:teuthology.orchestra.run.smithi120.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T05:19:11.233 INFO:teuthology.orchestra.run.smithi120.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T05:19:11.233 INFO:teuthology.orchestra.run.smithi120.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T05:19:11.233 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:19:11.233 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 ::1/128 scope host 2024-09-19T05:19:11.233 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:19:11.233 INFO:teuthology.orchestra.run.smithi120.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T05:19:11.234 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:26 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:19:11.234 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f0 2024-09-19T05:19:11.234 INFO:teuthology.orchestra.run.smithi120.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T05:19:11.234 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:d8:a1:27 brd ff:ff:ff:ff:ff:ff 2024-09-19T05:19:11.234 INFO:teuthology.orchestra.run.smithi120.stdout: altname enp7s0f1 2024-09-19T05:19:11.234 INFO:teuthology.orchestra.run.smithi120.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T05:19:11.234 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8e brd ff:ff:ff:ff:ff:ff 2024-09-19T05:19:11.234 INFO:teuthology.orchestra.run.smithi120.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T05:19:11.234 INFO:teuthology.orchestra.run.smithi120.stdout: link/ether 0c:c4:7a:8f:47:8f brd ff:ff:ff:ff:ff:ff 2024-09-19T05:19:11.234 INFO:teuthology.orchestra.run.smithi120.stdout: inet 172.21.15.120/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T05:19:11.234 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft 42250sec preferred_lft 42250sec 2024-09-19T05:19:11.234 INFO:teuthology.orchestra.run.smithi120.stdout: inet6 fe80::ec4:7aff:fe8f:478f/64 scope link noprefixroute 2024-09-19T05:19:11.234 INFO:teuthology.orchestra.run.smithi120.stdout: valid_lft forever preferred_lft forever 2024-09-19T05:19:11.235 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T05:19:11.235 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:19:11.235 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-09-19T05:19:11.235 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link add name ceph-brx type bridge 2024-09-19T05:19:11.235 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip addr flush dev ceph-brx 2024-09-19T05:19:11.235 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set ceph-brx up 2024-09-19T05:19:11.235 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T05:19:11.235 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-09-19T05:19:11.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:19:11.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:19:11.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:11.437 DEBUG:teuthology.orchestra.run.smithi120:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T05:19:11.445 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:11 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2889357380' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T05:19:11.465 INFO:teuthology.orchestra.run.smithi120.stdout:1 2024-09-19T05:19:11.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:11.467 DEBUG:teuthology.orchestra.run.smithi120:> route 2024-09-19T05:19:11.534 INFO:teuthology.orchestra.run.smithi120.stdout:Kernel IP routing table 2024-09-19T05:19:11.534 INFO:teuthology.orchestra.run.smithi120.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T05:19:11.534 INFO:teuthology.orchestra.run.smithi120.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T05:19:11.534 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T05:19:11.534 INFO:teuthology.orchestra.run.smithi120.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T05:19:11.536 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:19:11.537 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-09-19T05:19:11.537 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T05:19:11.537 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T05:19:11.537 DEBUG:teuthology.orchestra.run.smithi120:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T05:19:11.537 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-09-19T05:19:11.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:19:11.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:11 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/2889357380' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T05:19:11.656 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:11 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:19:11.439+0000 7f68db56f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:19:11.657 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:11 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:19:11.505+0000 7f68db56f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:19:11.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:11 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/2889357380' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T05:19:11.692 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:11 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:19:11.438+0000 7f163addf040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:19:11.692 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:11 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:19:11.506+0000 7f163addf040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:19:11.758 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:11 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:11.573+0000 7f1fac515040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T05:19:11.758 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:11 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:11.645+0000 7f1fac515040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T05:19:11.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:19:11.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:11.889 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-09-19T05:19:11.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:11.907 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list-id 2024-09-19T05:19:11.963 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:19:11.963 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-09-19T05:19:11.964 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:19:11.964 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T05:19:11.964 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-09-19T05:19:12.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:19:12.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:19:12.083 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T05:19:12.084 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:19:12.084 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-09-19T05:19:12.084 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T05:19:12.084 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T05:19:12.084 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T05:19:12.084 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T05:19:12.084 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T05:19:12.084 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-09-19T05:19:12.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:19:12.203 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:19:12.210 DEBUG:teuthology.orchestra.run.smithi120:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T05:19:12.210 DEBUG:teuthology.orchestra.run.smithi120:> set -e 2024-09-19T05:19:12.210 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set brx.0 up 2024-09-19T05:19:12.210 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T05:19:12.210 DEBUG:teuthology.orchestra.run.smithi120:> ') 2024-09-19T05:19:12.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T05:19:12.282 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:19:12.288 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-09-19T05:19:12.288 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:19:12.288 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T05:19:12.303 INFO:teuthology.orchestra.run.smithi120.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T05:19:12.303 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T05:19:12.304 DEBUG:teuthology.orchestra.run.smithi120:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:19:12.359 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2024-09-19T05:19:12.426 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:19:12.471 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:12 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:19:12.210+0000 7f163addf040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T05:19:12.471 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:12 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:19:12.326+0000 7f163addf040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:19:12.472 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:12 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:19:12.212+0000 7f68db56f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T05:19:12.472 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:12 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:19:12.328+0000 7f68db56f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:19:12.482 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2024-09-19T05:19:12.482 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2024-09-19T05:19:12.482 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2024-09-19T05:19:12.482 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2024-09-19T05:19:12.482 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2024-09-19T05:19:12.482 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2024-09-19T05:19:12.482 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2024-09-19T05:19:12.482 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2024-09-19T05:19:12.482 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2024-09-19T05:19:12.482 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2024-09-19T05:19:12.483 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2024-09-19T05:19:12.483 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/selinux 2024-09-19T05:19:12.483 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:19:12.483 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2024-09-19T05:19:12.483 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2024-09-19T05:19:12.483 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2024-09-19T05:19:12.483 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2024-09-19T05:19:12.483 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2024-09-19T05:19:12.483 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2024-09-19T05:19:12.483 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T05:19:12.483 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T05:19:12.483 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T05:19:12.483 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T05:19:12.483 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2024-09-19T05:19:12.484 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2024-09-19T05:19:12.484 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay 2024-09-19T05:19:12.484 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/572a2f39583509ed8d10f39d38ff723dc5efd92689bb44dd40baf15a34de5298/merged 2024-09-19T05:19:12.484 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/00e43cc2802954e26de05c5b7b449845991447c21bbc095e0454ff37d694dfb5/merged 2024-09-19T05:19:12.484 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/0 2024-09-19T05:19:12.484 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:19:12.484 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/85664d74a4abbba524b54170d32c55a4905ba73412b9eccb65d5a5e064d52a5a/merged 2024-09-19T05:19:12.484 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/72a3471a06f6fdd782a8c139f100bfc7dde608feba64571cf351fbf803127dd2/merged 2024-09-19T05:19:12.484 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/10747ee15f4aed2fd9424e3336c6d31923403715997fb30c1d27227a61f08200/merged 2024-09-19T05:19:12.484 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/c39587d40c5e501c923398a5c24c6206ee2c9f1698afc1c459e479b6c5f97521/merged 2024-09-19T05:19:12.484 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/43fd9512455b518267c2de1e792aac39127d1a99860c62137e51ec7ef45c2316/merged 2024-09-19T05:19:12.484 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/4e158738b1efe209a7a02911d0623e67a219d9e777830297b3691cbfdfe32e02/merged 2024-09-19T05:19:12.484 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/0760f8aea2ef61da638eba2685674ea85d2273385c0309d6d156d78e08ab85e7/merged 2024-09-19T05:19:12.484 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/bfe374ee026d4fd6141884ef8c88164b79eda5cd96e42fd44055ffaa10ceae95/merged 2024-09-19T05:19:12.485 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2024-09-19T05:19:12.485 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:19:12.485 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:19:12.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:12.485 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2024-09-19T05:19:12.538 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T05:19:12.538 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f --client_fs=cephfs) 2024-09-19T05:19:12.581 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2024-09-19T05:19:12.607 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:19:12.663 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2024-09-19T05:19:12.663 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2024-09-19T05:19:12.663 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2024-09-19T05:19:12.663 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2024-09-19T05:19:12.663 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2024-09-19T05:19:12.663 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2024-09-19T05:19:12.663 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2024-09-19T05:19:12.663 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2024-09-19T05:19:12.663 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2024-09-19T05:19:12.663 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2024-09-19T05:19:12.663 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2024-09-19T05:19:12.663 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/selinux 2024-09-19T05:19:12.664 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:19:12.664 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2024-09-19T05:19:12.664 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2024-09-19T05:19:12.664 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2024-09-19T05:19:12.664 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2024-09-19T05:19:12.664 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2024-09-19T05:19:12.664 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2024-09-19T05:19:12.664 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T05:19:12.664 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T05:19:12.664 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T05:19:12.664 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T05:19:12.664 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2024-09-19T05:19:12.664 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2024-09-19T05:19:12.665 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay 2024-09-19T05:19:12.665 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/572a2f39583509ed8d10f39d38ff723dc5efd92689bb44dd40baf15a34de5298/merged 2024-09-19T05:19:12.665 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/00e43cc2802954e26de05c5b7b449845991447c21bbc095e0454ff37d694dfb5/merged 2024-09-19T05:19:12.665 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/0 2024-09-19T05:19:12.665 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:19:12.665 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/85664d74a4abbba524b54170d32c55a4905ba73412b9eccb65d5a5e064d52a5a/merged 2024-09-19T05:19:12.665 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/72a3471a06f6fdd782a8c139f100bfc7dde608feba64571cf351fbf803127dd2/merged 2024-09-19T05:19:12.665 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/10747ee15f4aed2fd9424e3336c6d31923403715997fb30c1d27227a61f08200/merged 2024-09-19T05:19:12.665 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/c39587d40c5e501c923398a5c24c6206ee2c9f1698afc1c459e479b6c5f97521/merged 2024-09-19T05:19:12.665 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/43fd9512455b518267c2de1e792aac39127d1a99860c62137e51ec7ef45c2316/merged 2024-09-19T05:19:12.665 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/4e158738b1efe209a7a02911d0623e67a219d9e777830297b3691cbfdfe32e02/merged 2024-09-19T05:19:12.665 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/0760f8aea2ef61da638eba2685674ea85d2273385c0309d6d156d78e08ab85e7/merged 2024-09-19T05:19:12.665 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/bfe374ee026d4fd6141884ef8c88164b79eda5cd96e42fd44055ffaa10ceae95/merged 2024-09-19T05:19:12.666 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2024-09-19T05:19:12.666 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:19:12.666 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:19:12.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:12.667 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2024-09-19T05:19:12.685 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi120.stderr:2024-09-19T05:19:12.683+0000 7f9d25bf9480 -1 init, newargv = 0x564b23a76b60 newargc=15 2024-09-19T05:19:12.685 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi120.stderr:ceph-fuse[81973]: starting ceph client 2024-09-19T05:19:12.694 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:12 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:12.416+0000 7f1fac515040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T05:19:12.694 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:12 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:12.537+0000 7f1fac515040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T05:19:12.750 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:12 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:19:12.470+0000 7f68db56f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:19:12.750 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:12 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:19:12.531+0000 7f68db56f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:19:12.750 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:12 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:19:12.679+0000 7f68db56f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T05:19:12.750 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:12 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:19:12.748+0000 7f68db56f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:19:12.752 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:12 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:19:12.469+0000 7f163addf040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:19:12.752 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:12 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:19:12.531+0000 7f163addf040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:19:12.752 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:12 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:19:12.681+0000 7f163addf040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T05:19:12.971 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:12 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:12.692+0000 7f1fac515040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T05:19:12.972 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:12 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:12.754+0000 7f1fac515040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T05:19:12.972 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:12 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:12.902+0000 7f1fac515040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T05:19:12.972 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:12 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:12.969+0000 7f1fac515040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:19:13.029 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:12 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:19:12.807+0000 7f68db56f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:19:13.029 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:12 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:19:12.963+0000 7f68db56f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:19:13.029 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:13 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:19:13.027+0000 7f68db56f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:19:13.034 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:12 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:19:12.751+0000 7f163addf040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T05:19:13.034 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:12 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:19:12.811+0000 7f163addf040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:19:13.034 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:12 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:19:12.968+0000 7f163addf040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:19:13.253 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:13 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:13.029+0000 7f1fac515040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T05:19:13.253 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:13 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:13.187+0000 7f1fac515040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T05:19:13.253 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:13 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:13.251+0000 7f1fac515040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:19:13.294 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:13 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:19:13.093+0000 7f68db56f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:19:13.294 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:13 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:19:13.174+0000 7f68db56f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:19:13.294 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:13 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:19:13.233+0000 7f68db56f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:19:13.294 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:13 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:19:13.292+0000 7f68db56f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:19:13.303 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:13 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:19:13.033+0000 7f163addf040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T05:19:13.303 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:13 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:19:13.099+0000 7f163addf040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:19:13.303 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:13 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:19:13.182+0000 7f163addf040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:19:13.303 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:13 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:19:13.241+0000 7f163addf040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:19:13.303 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:13 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:19:13.301+0000 7f163addf040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:19:13.517 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:13 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:13.316+0000 7f1fac515040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T05:19:13.517 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:13 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:13.398+0000 7f1fac515040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T05:19:13.517 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:13 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:13.457+0000 7f1fac515040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T05:19:13.517 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:13 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:13.515+0000 7f1fac515040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T05:19:13.801 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2024-09-19T05:19:13.828 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:19:13.885 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2024-09-19T05:19:13.885 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2024-09-19T05:19:13.885 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2024-09-19T05:19:13.885 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2024-09-19T05:19:13.885 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2024-09-19T05:19:13.885 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2024-09-19T05:19:13.885 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2024-09-19T05:19:13.885 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2024-09-19T05:19:13.885 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2024-09-19T05:19:13.886 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2024-09-19T05:19:13.886 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2024-09-19T05:19:13.886 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/selinux 2024-09-19T05:19:13.886 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:19:13.886 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2024-09-19T05:19:13.886 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2024-09-19T05:19:13.886 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2024-09-19T05:19:13.886 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2024-09-19T05:19:13.886 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2024-09-19T05:19:13.886 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2024-09-19T05:19:13.886 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T05:19:13.886 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T05:19:13.886 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T05:19:13.886 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T05:19:13.887 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2024-09-19T05:19:13.887 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2024-09-19T05:19:13.887 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay 2024-09-19T05:19:13.887 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/572a2f39583509ed8d10f39d38ff723dc5efd92689bb44dd40baf15a34de5298/merged 2024-09-19T05:19:13.887 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/00e43cc2802954e26de05c5b7b449845991447c21bbc095e0454ff37d694dfb5/merged 2024-09-19T05:19:13.887 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/0 2024-09-19T05:19:13.887 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:19:13.887 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/85664d74a4abbba524b54170d32c55a4905ba73412b9eccb65d5a5e064d52a5a/merged 2024-09-19T05:19:13.887 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/72a3471a06f6fdd782a8c139f100bfc7dde608feba64571cf351fbf803127dd2/merged 2024-09-19T05:19:13.887 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/10747ee15f4aed2fd9424e3336c6d31923403715997fb30c1d27227a61f08200/merged 2024-09-19T05:19:13.887 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/c39587d40c5e501c923398a5c24c6206ee2c9f1698afc1c459e479b6c5f97521/merged 2024-09-19T05:19:13.887 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/43fd9512455b518267c2de1e792aac39127d1a99860c62137e51ec7ef45c2316/merged 2024-09-19T05:19:13.887 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/4e158738b1efe209a7a02911d0623e67a219d9e777830297b3691cbfdfe32e02/merged 2024-09-19T05:19:13.887 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/0760f8aea2ef61da638eba2685674ea85d2273385c0309d6d156d78e08ab85e7/merged 2024-09-19T05:19:13.888 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/bfe374ee026d4fd6141884ef8c88164b79eda5cd96e42fd44055ffaa10ceae95/merged 2024-09-19T05:19:13.888 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2024-09-19T05:19:13.888 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:19:13.888 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:19:13.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:13.888 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2024-09-19T05:19:14.375 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi120.stderr:ceph-fuse[81973]: starting fuse 2024-09-19T05:19:14.405 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:19:14 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z[37037]: 2024-09-19T05:19:14.075+0000 7f68db56f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:19:14.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:14 smithi194 ceph-mon[35228]: Standby manager daemon z restarted 2024-09-19T05:19:14.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:14 smithi194 ceph-mon[35228]: Standby manager daemon z started 2024-09-19T05:19:14.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:14 smithi194 ceph-mon[35228]: from='mgr.? 172.21.15.194:0/481503131' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T05:19:14.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:14 smithi194 ceph-mon[35228]: from='mgr.? 172.21.15.194:0/481503131' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:19:14.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:14 smithi194 ceph-mon[35228]: from='mgr.? 172.21.15.194:0/481503131' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T05:19:14.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:14 smithi194 ceph-mon[35228]: from='mgr.? 172.21.15.194:0/481503131' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:19:14.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:14 smithi194 ceph-mon[35228]: Standby manager daemon y restarted 2024-09-19T05:19:14.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:14 smithi194 ceph-mon[35228]: Standby manager daemon y started 2024-09-19T05:19:14.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:14 smithi194 ceph-mon[35228]: from='mgr.? 172.21.15.178:0/239063110' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T05:19:14.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:14 smithi194 ceph-mon[35228]: from='mgr.? 172.21.15.178:0/239063110' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:19:14.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:14 smithi194 ceph-mon[35228]: from='mgr.? 172.21.15.178:0/239063110' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T05:19:14.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:14 smithi194 ceph-mon[35228]: from='mgr.? 172.21.15.178:0/239063110' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:19:14.442 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:19:14 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y[35714]: 2024-09-19T05:19:14.084+0000 7f163addf040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:19:14.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:14 smithi178 ceph-mon[34347]: Standby manager daemon z restarted 2024-09-19T05:19:14.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:14 smithi178 ceph-mon[34347]: Standby manager daemon z started 2024-09-19T05:19:14.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:14 smithi178 ceph-mon[34347]: from='mgr.? 172.21.15.194:0/481503131' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T05:19:14.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:14 smithi178 ceph-mon[34347]: from='mgr.? 172.21.15.194:0/481503131' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:19:14.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:14 smithi178 ceph-mon[34347]: from='mgr.? 172.21.15.194:0/481503131' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T05:19:14.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:14 smithi178 ceph-mon[34347]: from='mgr.? 172.21.15.194:0/481503131' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:19:14.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:14 smithi178 ceph-mon[34347]: Standby manager daemon y restarted 2024-09-19T05:19:14.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:14 smithi178 ceph-mon[34347]: Standby manager daemon y started 2024-09-19T05:19:14.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:14 smithi178 ceph-mon[34347]: from='mgr.? 172.21.15.178:0/239063110' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T05:19:14.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:14 smithi178 ceph-mon[34347]: from='mgr.? 172.21.15.178:0/239063110' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:19:14.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:14 smithi178 ceph-mon[34347]: from='mgr.? 172.21.15.178:0/239063110' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T05:19:14.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:14 smithi178 ceph-mon[34347]: from='mgr.? 172.21.15.178:0/239063110' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:19:14.562 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:14 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:14.312+0000 7f1fac515040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T05:19:14.562 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:14 smithi120 ceph-mon[30956]: Standby manager daemon z restarted 2024-09-19T05:19:14.562 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:14 smithi120 ceph-mon[30956]: Standby manager daemon z started 2024-09-19T05:19:14.562 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:14 smithi120 ceph-mon[30956]: from='mgr.? 172.21.15.194:0/481503131' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T05:19:14.562 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:14 smithi120 ceph-mon[30956]: from='mgr.? 172.21.15.194:0/481503131' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:19:14.563 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:14 smithi120 ceph-mon[30956]: from='mgr.? 172.21.15.194:0/481503131' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T05:19:14.563 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:14 smithi120 ceph-mon[30956]: from='mgr.? 172.21.15.194:0/481503131' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:19:14.563 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:14 smithi120 ceph-mon[30956]: Standby manager daemon y restarted 2024-09-19T05:19:14.563 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:14 smithi120 ceph-mon[30956]: Standby manager daemon y started 2024-09-19T05:19:14.563 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:14 smithi120 ceph-mon[30956]: from='mgr.? 172.21.15.178:0/239063110' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T05:19:14.563 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:14 smithi120 ceph-mon[30956]: from='mgr.? 172.21.15.178:0/239063110' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T05:19:14.563 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:14 smithi120 ceph-mon[30956]: from='mgr.? 172.21.15.178:0/239063110' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T05:19:14.563 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:14 smithi120 ceph-mon[30956]: from='mgr.? 172.21.15.178:0/239063110' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T05:19:14.875 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:14 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:14.560+0000 7f1f14663640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T05:19:14.875 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:14 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:14.560+0000 7f1f14663640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T05:19:14.876 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:14 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:14.560+0000 7f1f14663640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T05:19:14.876 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:14 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:14.560+0000 7f1f14663640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T05:19:14.876 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:14 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:14.560+0000 7f1f14663640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T05:19:14.876 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:14 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:14.561+0000 7f1f17669640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T05:19:14.876 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:14 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:14.561+0000 7f1f17669640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T05:19:14.876 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:14 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:14.561+0000 7f1f17669640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T05:19:14.876 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:14 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:14.561+0000 7f1f17669640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T05:19:14.876 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:14 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:14.561+0000 7f1f17669640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T05:19:15.043 DEBUG:teuthology.orchestra.run.smithi120:> sudo modprobe fuse 2024-09-19T05:19:15.069 DEBUG:teuthology.orchestra.run.smithi120:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T05:19:15.126 INFO:teuthology.orchestra.run.smithi120.stdout:/proc 2024-09-19T05:19:15.126 INFO:teuthology.orchestra.run.smithi120.stdout:/sys 2024-09-19T05:19:15.127 INFO:teuthology.orchestra.run.smithi120.stdout:/dev 2024-09-19T05:19:15.127 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/security 2024-09-19T05:19:15.127 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/shm 2024-09-19T05:19:15.127 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/pts 2024-09-19T05:19:15.127 INFO:teuthology.orchestra.run.smithi120.stdout:/run 2024-09-19T05:19:15.127 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/cgroup 2024-09-19T05:19:15.127 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/pstore 2024-09-19T05:19:15.127 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/bpf 2024-09-19T05:19:15.127 INFO:teuthology.orchestra.run.smithi120.stdout:/ 2024-09-19T05:19:15.127 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/selinux 2024-09-19T05:19:15.127 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:19:15.127 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/mqueue 2024-09-19T05:19:15.127 INFO:teuthology.orchestra.run.smithi120.stdout:/dev/hugepages 2024-09-19T05:19:15.128 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/debug 2024-09-19T05:19:15.128 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/tracing 2024-09-19T05:19:15.128 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/fs/fuse/connections 2024-09-19T05:19:15.128 INFO:teuthology.orchestra.run.smithi120.stdout:/sys/kernel/config 2024-09-19T05:19:15.128 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T05:19:15.128 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T05:19:15.128 INFO:teuthology.orchestra.run.smithi120.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T05:19:15.128 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T05:19:15.128 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/1000 2024-09-19T05:19:15.128 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/ceph 2024-09-19T05:19:15.128 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay 2024-09-19T05:19:15.128 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/572a2f39583509ed8d10f39d38ff723dc5efd92689bb44dd40baf15a34de5298/merged 2024-09-19T05:19:15.128 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/00e43cc2802954e26de05c5b7b449845991447c21bbc095e0454ff37d694dfb5/merged 2024-09-19T05:19:15.129 INFO:teuthology.orchestra.run.smithi120.stdout:/run/user/0 2024-09-19T05:19:15.129 INFO:teuthology.orchestra.run.smithi120.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T05:19:15.129 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/85664d74a4abbba524b54170d32c55a4905ba73412b9eccb65d5a5e064d52a5a/merged 2024-09-19T05:19:15.129 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/72a3471a06f6fdd782a8c139f100bfc7dde608feba64571cf351fbf803127dd2/merged 2024-09-19T05:19:15.129 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/10747ee15f4aed2fd9424e3336c6d31923403715997fb30c1d27227a61f08200/merged 2024-09-19T05:19:15.129 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/c39587d40c5e501c923398a5c24c6206ee2c9f1698afc1c459e479b6c5f97521/merged 2024-09-19T05:19:15.129 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/43fd9512455b518267c2de1e792aac39127d1a99860c62137e51ec7ef45c2316/merged 2024-09-19T05:19:15.129 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/4e158738b1efe209a7a02911d0623e67a219d9e777830297b3691cbfdfe32e02/merged 2024-09-19T05:19:15.129 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/0760f8aea2ef61da638eba2685674ea85d2273385c0309d6d156d78e08ab85e7/merged 2024-09-19T05:19:15.129 INFO:teuthology.orchestra.run.smithi120.stdout:/var/lib/containers/storage/overlay/bfe374ee026d4fd6141884ef8c88164b79eda5cd96e42fd44055ffaa10ceae95/merged 2024-09-19T05:19:15.129 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns 2024-09-19T05:19:15.129 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:19:15.129 INFO:teuthology.orchestra.run.smithi120.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:19:15.129 INFO:teuthology.orchestra.run.smithi120.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-19T05:19:15.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:15.130 DEBUG:teuthology.orchestra.run.smithi120:> ls /sys/fs/fuse/connections 2024-09-19T05:19:15.187 INFO:teuthology.orchestra.run.smithi120.stdout:120 2024-09-19T05:19:15.187 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-19T05:19:15.187 DEBUG:teuthology.orchestra.run.smithi120:> sudo stdin-killer -- python3 -c ' 2024-09-19T05:19:15.187 DEBUG:teuthology.orchestra.run.smithi120:> import glob 2024-09-19T05:19:15.187 DEBUG:teuthology.orchestra.run.smithi120:> import re 2024-09-19T05:19:15.187 DEBUG:teuthology.orchestra.run.smithi120:> import os 2024-09-19T05:19:15.187 DEBUG:teuthology.orchestra.run.smithi120:> import subprocess 2024-09-19T05:19:15.188 DEBUG:teuthology.orchestra.run.smithi120:> 2024-09-19T05:19:15.188 DEBUG:teuthology.orchestra.run.smithi120:> def _find_admin_socket(client_name): 2024-09-19T05:19:15.188 DEBUG:teuthology.orchestra.run.smithi120:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T05:19:15.188 DEBUG:teuthology.orchestra.run.smithi120:> files = glob.glob(asok_path) 2024-09-19T05:19:15.188 DEBUG:teuthology.orchestra.run.smithi120:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T05:19:15.188 DEBUG:teuthology.orchestra.run.smithi120:> 2024-09-19T05:19:15.188 DEBUG:teuthology.orchestra.run.smithi120:> # Given a non-glob path, it better be there 2024-09-19T05:19:15.188 DEBUG:teuthology.orchestra.run.smithi120:> if "*" not in asok_path: 2024-09-19T05:19:15.188 DEBUG:teuthology.orchestra.run.smithi120:> assert(len(files) == 1) 2024-09-19T05:19:15.188 DEBUG:teuthology.orchestra.run.smithi120:> return files[0] 2024-09-19T05:19:15.188 DEBUG:teuthology.orchestra.run.smithi120:> 2024-09-19T05:19:15.188 DEBUG:teuthology.orchestra.run.smithi120:> for f in files: 2024-09-19T05:19:15.188 DEBUG:teuthology.orchestra.run.smithi120:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T05:19:15.188 DEBUG:teuthology.orchestra.run.smithi120:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T05:19:15.189 DEBUG:teuthology.orchestra.run.smithi120:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T05:19:15.189 DEBUG:teuthology.orchestra.run.smithi120:> contents = proc_f.read() 2024-09-19T05:19:15.189 DEBUG:teuthology.orchestra.run.smithi120:> if mountpoint in contents: 2024-09-19T05:19:15.189 DEBUG:teuthology.orchestra.run.smithi120:> return f 2024-09-19T05:19:15.189 DEBUG:teuthology.orchestra.run.smithi120:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T05:19:15.189 DEBUG:teuthology.orchestra.run.smithi120:> 2024-09-19T05:19:15.189 DEBUG:teuthology.orchestra.run.smithi120:> print(_find_admin_socket("client.0")) 2024-09-19T05:19:15.189 DEBUG:teuthology.orchestra.run.smithi120:> ' 2024-09-19T05:19:15.307 INFO:teuthology.orchestra.run.smithi120.stdout:/var/run/ceph/ceph-client.0.81973.asok 2024-09-19T05:19:15.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T05:19:15.316 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-19T05:19:15.316 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: Active manager daemon x restarted 2024-09-19T05:19:15.316 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: Activating manager daemon x 2024-09-19T05:19:15.316 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T05:19:15.317 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: mgrmap e20: x(active, starting, since 0.0111039s), standbys: y, z 2024-09-19T05:19:15.317 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:19:15.317 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:19:15.317 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:19:15.317 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T05:19:15.317 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T05:19:15.317 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T05:19:15.317 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T05:19:15.317 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T05:19:15.317 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T05:19:15.317 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T05:19:15.317 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T05:19:15.318 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T05:19:15.318 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T05:19:15.318 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T05:19:15.318 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T05:19:15.318 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T05:19:15.318 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T05:19:15.318 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T05:19:15.318 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:19:15.318 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:19:15.318 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:19:15.318 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:19:15.318 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:19:15.318 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:19:15.319 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:19:15.319 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:19:15.319 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:19:15.319 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:19:15.319 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:19:15.319 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:19:15.319 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T05:19:15.319 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T05:19:15.319 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T05:19:15.319 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: Manager daemon x is now available 2024-09-19T05:19:15.319 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:19:15.319 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T05:19:15.319 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T05:19:15.320 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.81973.asok 2024-09-19T05:19:15.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:15.321 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.81973.asok status 2024-09-19T05:19:15.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-19T05:19:15.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: Active manager daemon x restarted 2024-09-19T05:19:15.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: Activating manager daemon x 2024-09-19T05:19:15.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T05:19:15.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: mgrmap e20: x(active, starting, since 0.0111039s), standbys: y, z 2024-09-19T05:19:15.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:19:15.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:19:15.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:19:15.408 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T05:19:15.408 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T05:19:15.408 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T05:19:15.408 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T05:19:15.408 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T05:19:15.408 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T05:19:15.408 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T05:19:15.408 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T05:19:15.408 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T05:19:15.408 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T05:19:15.408 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T05:19:15.408 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T05:19:15.408 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T05:19:15.409 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T05:19:15.409 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T05:19:15.409 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:19:15.409 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:19:15.409 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:19:15.409 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:19:15.409 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:19:15.409 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:19:15.409 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:19:15.409 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:19:15.409 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:19:15.409 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:19:15.409 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:19:15.410 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:19:15.410 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T05:19:15.410 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T05:19:15.410 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T05:19:15.410 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: Manager daemon x is now available 2024-09-19T05:19:15.410 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:19:15.412 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T05:19:15.412 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:15 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T05:19:15.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-19T05:19:15.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: Active manager daemon x restarted 2024-09-19T05:19:15.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: Activating manager daemon x 2024-09-19T05:19:15.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T05:19:15.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: mgrmap e20: x(active, starting, since 0.0111039s), standbys: y, z 2024-09-19T05:19:15.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T05:19:15.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T05:19:15.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T05:19:15.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T05:19:15.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T05:19:15.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T05:19:15.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T05:19:15.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T05:19:15.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T05:19:15.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T05:19:15.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T05:19:15.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T05:19:15.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T05:19:15.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T05:19:15.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T05:19:15.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T05:19:15.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T05:19:15.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T05:19:15.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T05:19:15.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T05:19:15.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T05:19:15.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T05:19:15.445 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T05:19:15.445 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T05:19:15.445 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T05:19:15.445 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T05:19:15.445 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T05:19:15.445 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T05:19:15.445 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T05:19:15.445 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T05:19:15.445 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T05:19:15.445 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T05:19:15.445 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T05:19:15.445 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: Manager daemon x is now available 2024-09-19T05:19:15.445 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:19:15.445 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T05:19:15.446 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:15 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T05:19:15.454 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T05:19:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "metadata": { 2024-09-19T05:19:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T05:19:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T05:19:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "entity_id": "0", 2024-09-19T05:19:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "hostname": "smithi120", 2024-09-19T05:19:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T05:19:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "pid": "81973", 2024-09-19T05:19:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "root": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f" 2024-09-19T05:19:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:19:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_count": 0, 2024-09-19T05:19:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "dentry_pinned_count": 0, 2024-09-19T05:19:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 15168, 2024-09-19T05:19:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "inst": { 2024-09-19T05:19:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "name": { 2024-09-19T05:19:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "client", 2024-09-19T05:19:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "num": 15168 2024-09-19T05:19:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:19:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2024-09-19T05:19:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-19T05:19:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:19:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2086768678 2024-09-19T05:19:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:19:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:19:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": { 2024-09-19T05:19:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-19T05:19:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "192.168.0.1:0", 2024-09-19T05:19:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2086768678 2024-09-19T05:19:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:19:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "inst_str": "client.15168 192.168.0.1:0/2086768678", 2024-09-19T05:19:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "addr_str": "192.168.0.1:0/2086768678", 2024-09-19T05:19:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "inode_count": 5, 2024-09-19T05:19:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_epoch": 24, 2024-09-19T05:19:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch": 84, 2024-09-19T05:19:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_epoch_barrier": 0, 2024-09-19T05:19:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "blocklisted": false, 2024-09-19T05:19:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs" 2024-09-19T05:19:15.457 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T05:19:15.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:15.463 DEBUG:teuthology.orchestra.run.smithi120:> stat --file-system '--printf=%T 2024-09-19T05:19:15.463 DEBUG:teuthology.orchestra.run.smithi120:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T05:19:15.479 INFO:teuthology.orchestra.run.smithi120.stdout:fuseblk 2024-09-19T05:19:15.479 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T05:19:15.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:19:15.480 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T05:19:15.548 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T05:19:15.557 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T05:19:15.557 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi120.front.sepia.ceph.com 2024-09-19T05:19:15.557 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-19T05:19:15.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.688+0000 7f7d8175f640 1 -- 172.21.15.120:0/3094766996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d7c1025c0 msgr2=0x7f7d7c1049b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:15.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.688+0000 7f7d8175f640 1 --2- 172.21.15.120:0/3094766996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d7c1025c0 0x7f7d7c1049b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c009900 tx=0x7f7d6c02a410 comp rx=0 tx=0).stop 2024-09-19T05:19:15.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.688+0000 7f7d8175f640 1 -- 172.21.15.120:0/3094766996 shutdown_connections 2024-09-19T05:19:15.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.688+0000 7f7d8175f640 1 --2- 172.21.15.120:0/3094766996 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d7c107820 0x7f7d7c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:15.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.688+0000 7f7d8175f640 1 --2- 172.21.15.120:0/3094766996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d7c104ef0 0x7f7d7c1072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:15.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.688+0000 7f7d8175f640 1 --2- 172.21.15.120:0/3094766996 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d7c1025c0 0x7f7d7c1049b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:15.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.688+0000 7f7d8175f640 1 -- 172.21.15.120:0/3094766996 >> 172.21.15.120:0/3094766996 conn(0x7f7d7c0fc1e0 msgr2=0x7f7d7c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:15.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.688+0000 7f7d8175f640 1 -- 172.21.15.120:0/3094766996 shutdown_connections 2024-09-19T05:19:15.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.688+0000 7f7d8175f640 1 -- 172.21.15.120:0/3094766996 wait complete. 2024-09-19T05:19:15.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.689+0000 7f7d8175f640 1 Processor -- start 2024-09-19T05:19:15.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.689+0000 7f7d8175f640 1 -- start start 2024-09-19T05:19:15.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.689+0000 7f7d8175f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d7c1025c0 0x7f7d7c101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:15.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.689+0000 7f7d8175f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d7c104ef0 0x7f7d7c100570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:15.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.689+0000 7f7d8175f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d7c107820 0x7f7d7c100ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:15.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.689+0000 7f7d8175f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7c10d6b0 con 0x7f7d7c1025c0 2024-09-19T05:19:15.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.689+0000 7f7d8175f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7c10d530 con 0x7f7d7c107820 2024-09-19T05:19:15.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.689+0000 7f7d8175f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7c10d830 con 0x7f7d7c104ef0 2024-09-19T05:19:15.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.689+0000 7f7d7affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d7c1025c0 0x7f7d7c101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:15.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.689+0000 7f7d7b7fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d7c107820 0x7f7d7c100ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:15.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.689+0000 7f7d7affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d7c1025c0 0x7f7d7c101f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48438/0 (socket says 172.21.15.120:48438) 2024-09-19T05:19:15.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.689+0000 7f7d7affd640 1 -- 172.21.15.120:0/1856111234 learned_addr learned my addr 172.21.15.120:0/1856111234 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:15.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.690+0000 7f7d7a7fc640 1 --2- 172.21.15.120:0/1856111234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d7c104ef0 0x7f7d7c100570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:15.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.690+0000 7f7d7affd640 1 -- 172.21.15.120:0/1856111234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d7c104ef0 msgr2=0x7f7d7c100570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:15.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.690+0000 7f7d7affd640 1 --2- 172.21.15.120:0/1856111234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d7c104ef0 0x7f7d7c100570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:15.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.690+0000 7f7d7affd640 1 -- 172.21.15.120:0/1856111234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d7c107820 msgr2=0x7f7d7c100ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:15.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.690+0000 7f7d7affd640 1 --2- 172.21.15.120:0/1856111234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d7c107820 0x7f7d7c100ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:15.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.690+0000 7f7d7affd640 1 -- 172.21.15.120:0/1856111234 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d7c101340 con 0x7f7d7c1025c0 2024-09-19T05:19:15.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.690+0000 7f7d7a7fc640 1 --2- 172.21.15.120:0/1856111234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d7c104ef0 0x7f7d7c100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:19:15.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.690+0000 7f7d7b7fe640 1 --2- 172.21.15.120:0/1856111234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d7c107820 0x7f7d7c100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:19:15.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.690+0000 7f7d7affd640 1 --2- 172.21.15.120:0/1856111234 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d7c1025c0 0x7f7d7c101f30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c004770 tx=0x7f7d6c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:15.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.690+0000 7f7d63fff640 1 -- 172.21.15.120:0/1856111234 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c03f030 con 0x7f7d7c1025c0 2024-09-19T05:19:15.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.690+0000 7f7d8175f640 1 -- 172.21.15.120:0/1856111234 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d7c1a1e50 con 0x7f7d7c1025c0 2024-09-19T05:19:15.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.690+0000 7f7d63fff640 1 -- 172.21.15.120:0/1856111234 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7d6c003cb0 con 0x7f7d7c1025c0 2024-09-19T05:19:15.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.690+0000 7f7d63fff640 1 -- 172.21.15.120:0/1856111234 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c035070 con 0x7f7d7c1025c0 2024-09-19T05:19:15.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.690+0000 7f7d8175f640 1 -- 172.21.15.120:0/1856111234 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d7c1a22b0 con 0x7f7d7c1025c0 2024-09-19T05:19:15.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.691+0000 7f7d8175f640 1 -- 172.21.15.120:0/1856111234 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d7c0fdcd0 con 0x7f7d7c1025c0 2024-09-19T05:19:15.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.693+0000 7f7d63fff640 1 -- 172.21.15.120:0/1856111234 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f7d6c042030 con 0x7f7d7c1025c0 2024-09-19T05:19:15.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.694+0000 7f7d63fff640 1 --2- 172.21.15.120:0/1856111234 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f7d640a3100 0x7f7d640a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:15.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.694+0000 7f7d7a7fc640 1 --2- 172.21.15.120:0/1856111234 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f7d640a3100 0x7f7d640a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:15.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.694+0000 7f7d63fff640 1 -- 172.21.15.120:0/1856111234 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f7d6c0eff80 con 0x7f7d7c1025c0 2024-09-19T05:19:15.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.694+0000 7f7d7a7fc640 1 --2- 172.21.15.120:0/1856111234 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f7d640a3100 0x7f7d640a55c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7d700058c0 tx=0x7f7d70005850 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:15.704 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.702+0000 7f7d63fff640 1 -- 172.21.15.120:0/1856111234 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7d6c0bce20 con 0x7f7d7c1025c0 2024-09-19T05:19:15.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:15.910+0000 7f7d8175f640 1 -- 172.21.15.120:0/1856111234 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f7d7c062ef0 con 0x7f7d7c1025c0 2024-09-19T05:19:16.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.325+0000 7f7d63fff640 1 -- 172.21.15.120:0/1856111234 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v25) ==== 117+0+0 (secure 0 0 0) 0x7f7d6c0bc720 con 0x7f7d7c1025c0 2024-09-19T05:19:16.329 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:15.882+0000 7f1effd40640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:05:19:15] ENGINE Error in HTTPServer.serve 2024-09-19T05:19:16.330 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: Traceback (most recent call last): 2024-09-19T05:19:16.330 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T05:19:16.330 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: self._connections.run(self.expiration_interval) 2024-09-19T05:19:16.330 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T05:19:16.330 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: self._run(expiration_interval) 2024-09-19T05:19:16.330 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T05:19:16.330 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T05:19:16.330 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T05:19:16.330 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T05:19:16.330 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T05:19:16.330 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: s = self.context.wrap_socket( 2024-09-19T05:19:16.330 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T05:19:16.330 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: return self.sslsocket_class._create( 2024-09-19T05:19:16.331 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T05:19:16.331 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: self.do_handshake() 2024-09-19T05:19:16.331 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T05:19:16.331 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: self._sslobj.do_handshake() 2024-09-19T05:19:16.331 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T05:19:16.331 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:19:15 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:19:16.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.329+0000 7f7d8175f640 1 -- 172.21.15.120:0/1856111234 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f7d640a3100 msgr2=0x7f7d640a55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:16.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.329+0000 7f7d8175f640 1 --2- 172.21.15.120:0/1856111234 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f7d640a3100 0x7f7d640a55c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7d700058c0 tx=0x7f7d70005850 comp rx=0 tx=0).stop 2024-09-19T05:19:16.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.329+0000 7f7d8175f640 1 -- 172.21.15.120:0/1856111234 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d7c1025c0 msgr2=0x7f7d7c101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:16.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.329+0000 7f7d8175f640 1 --2- 172.21.15.120:0/1856111234 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d7c1025c0 0x7f7d7c101f30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c004770 tx=0x7f7d6c0042f0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.329+0000 7f7d8175f640 1 -- 172.21.15.120:0/1856111234 shutdown_connections 2024-09-19T05:19:16.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.329+0000 7f7d8175f640 1 --2- 172.21.15.120:0/1856111234 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f7d640a3100 0x7f7d640a55c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.329+0000 7f7d8175f640 1 --2- 172.21.15.120:0/1856111234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d7c107820 0x7f7d7c100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.329+0000 7f7d8175f640 1 --2- 172.21.15.120:0/1856111234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d7c104ef0 0x7f7d7c100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.329+0000 7f7d8175f640 1 --2- 172.21.15.120:0/1856111234 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7d7c1025c0 0x7f7d7c101f30 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.329+0000 7f7d8175f640 1 -- 172.21.15.120:0/1856111234 >> 172.21.15.120:0/1856111234 conn(0x7f7d7c0fc1e0 msgr2=0x7f7d7c102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:16.332 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.329+0000 7f7d8175f640 1 -- 172.21.15.120:0/1856111234 shutdown_connections 2024-09-19T05:19:16.333 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.329+0000 7f7d8175f640 1 -- 172.21.15.120:0/1856111234 wait complete. 2024-09-19T05:19:16.345 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T05:19:16.355 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-19T05:19:16.366 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:19:16.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.469+0000 7f99e514b640 1 -- 172.21.15.120:0/1305315513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99e0102590 msgr2=0x7f99e0104980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:16.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.469+0000 7f99e514b640 1 --2- 172.21.15.120:0/1305315513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99e0102590 0x7f99e0104980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f99c8009860 tx=0x7f99c802a340 comp rx=0 tx=0).stop 2024-09-19T05:19:16.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.469+0000 7f99e514b640 1 -- 172.21.15.120:0/1305315513 shutdown_connections 2024-09-19T05:19:16.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.469+0000 7f99e514b640 1 --2- 172.21.15.120:0/1305315513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99e01077f0 0x7f99e0109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.469+0000 7f99e514b640 1 --2- 172.21.15.120:0/1305315513 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99e0104ec0 0x7f99e01072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.469+0000 7f99e514b640 1 --2- 172.21.15.120:0/1305315513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99e0102590 0x7f99e0104980 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.469+0000 7f99e514b640 1 -- 172.21.15.120:0/1305315513 >> 172.21.15.120:0/1305315513 conn(0x7f99e00fc170 msgr2=0x7f99e00fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:16.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.469+0000 7f99e514b640 1 -- 172.21.15.120:0/1305315513 shutdown_connections 2024-09-19T05:19:16.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.469+0000 7f99e514b640 1 -- 172.21.15.120:0/1305315513 wait complete. 2024-09-19T05:19:16.472 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.470+0000 7f99e514b640 1 Processor -- start 2024-09-19T05:19:16.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.470+0000 7f99e514b640 1 -- start start 2024-09-19T05:19:16.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.470+0000 7f99e514b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99e0102590 0x7f99e0101f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:16.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.470+0000 7f99e514b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99e0104ec0 0x7f99e0100540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:16.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.470+0000 7f99e514b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99e01077f0 0x7f99e0100a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:16.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.470+0000 7f99e514b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f99e010d6b0 con 0x7f99e0104ec0 2024-09-19T05:19:16.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.470+0000 7f99e514b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f99e010d530 con 0x7f99e0102590 2024-09-19T05:19:16.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.470+0000 7f99e514b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f99e010d830 con 0x7f99e01077f0 2024-09-19T05:19:16.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.470+0000 7f99de59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99e0104ec0 0x7f99e0100540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:16.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.470+0000 7f99ded9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99e0102590 0x7f99e0101f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:16.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.470+0000 7f99ded9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99e0102590 0x7f99e0101f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:39534/0 (socket says 172.21.15.120:39534) 2024-09-19T05:19:16.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.470+0000 7f99ded9d640 1 -- 172.21.15.120:0/4191499059 learned_addr learned my addr 172.21.15.120:0/4191499059 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:16.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.470+0000 7f99df59e640 1 --2- 172.21.15.120:0/4191499059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99e01077f0 0x7f99e0100a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:16.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.470+0000 7f99ded9d640 1 -- 172.21.15.120:0/4191499059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99e01077f0 msgr2=0x7f99e0100a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:16.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.470+0000 7f99ded9d640 1 --2- 172.21.15.120:0/4191499059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99e01077f0 0x7f99e0100a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.470+0000 7f99ded9d640 1 -- 172.21.15.120:0/4191499059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99e0104ec0 msgr2=0x7f99e0100540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:16.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.470+0000 7f99ded9d640 1 --2- 172.21.15.120:0/4191499059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99e0104ec0 0x7f99e0100540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.470+0000 7f99ded9d640 1 -- 172.21.15.120:0/4191499059 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99e0101310 con 0x7f99e0102590 2024-09-19T05:19:16.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.471+0000 7f99ded9d640 1 --2- 172.21.15.120:0/4191499059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99e0102590 0x7f99e0101f00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f99c8005940 tx=0x7f99c8030e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:16.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.471+0000 7f99d7fff640 1 -- 172.21.15.120:0/4191499059 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8037050 con 0x7f99e0102590 2024-09-19T05:19:16.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.471+0000 7f99e514b640 1 -- 172.21.15.120:0/4191499059 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99e01a1e90 con 0x7f99e0102590 2024-09-19T05:19:16.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.471+0000 7f99d7fff640 1 -- 172.21.15.120:0/4191499059 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f99c8043070 con 0x7f99e0102590 2024-09-19T05:19:16.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.471+0000 7f99d7fff640 1 -- 172.21.15.120:0/4191499059 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8003cd0 con 0x7f99e0102590 2024-09-19T05:19:16.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.471+0000 7f99e514b640 1 -- 172.21.15.120:0/4191499059 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99e01a22a0 con 0x7f99e0102590 2024-09-19T05:19:16.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.472+0000 7f99e514b640 1 -- 172.21.15.120:0/4191499059 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99e00fdc60 con 0x7f99e0102590 2024-09-19T05:19:16.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.473+0000 7f99d7fff640 1 -- 172.21.15.120:0/4191499059 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f99c8004040 con 0x7f99e0102590 2024-09-19T05:19:16.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.474+0000 7f99d7fff640 1 --2- 172.21.15.120:0/4191499059 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f99cc0a3050 0x7f99cc0a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:16.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.474+0000 7f99de59c640 1 --2- 172.21.15.120:0/4191499059 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f99cc0a3050 0x7f99cc0a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:16.476 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.474+0000 7f99d7fff640 1 -- 172.21.15.120:0/4191499059 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f99c80efa70 con 0x7f99e0102590 2024-09-19T05:19:16.477 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.474+0000 7f99de59c640 1 --2- 172.21.15.120:0/4191499059 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f99cc0a3050 0x7f99cc0a5510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f99e0101c70 tx=0x7f99d0009260 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:16.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.477+0000 7f99d7fff640 1 -- 172.21.15.120:0/4191499059 <== mon.2 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f99c804c020 con 0x7f99e0102590 2024-09-19T05:19:16.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:16 smithi120 ceph-mon[30956]: mgrmap e21: x(active, since 1.01752s), standbys: y, z 2024-09-19T05:19:16.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:16 smithi120 ceph-mon[30956]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:16 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1856111234' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T05:19:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:16 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:16 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:16 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:16 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:16.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:16 smithi194 ceph-mon[35228]: mgrmap e21: x(active, since 1.01752s), standbys: y, z 2024-09-19T05:19:16.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:16 smithi194 ceph-mon[35228]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:16.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:16 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1856111234' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T05:19:16.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:16 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:16.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:16 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:16.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:16 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:16.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:16 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:16.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:16 smithi178 ceph-mon[34347]: mgrmap e21: x(active, since 1.01752s), standbys: y, z 2024-09-19T05:19:16.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:16 smithi178 ceph-mon[34347]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:16.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:16 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1856111234' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-19T05:19:16.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:16 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:16.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:16 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:16.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:16 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:16.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:16 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:16.693 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.691+0000 7f99e514b640 1 -- 172.21.15.120:0/4191499059 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99e002da10 con 0x7f99e0102590 2024-09-19T05:19:16.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.692+0000 7f99d7fff640 1 -- 172.21.15.120:0/4191499059 <== mon.2 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+23352 (secure 0 0 0) 0x7f99c80bc8d0 con 0x7f99e0102590 2024-09-19T05:19:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:19:16.695 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":85,"fsid":"4e6e3df4-7645-11ef-bceb-c7b262605968","created":"2024-09-19T05:09:55.847220+0000","modified":"2024-09-19T05:19:14.314890+0000","last_up_change":"2024-09-19T05:16:42.808178+0000","last_in_change":"2024-09-19T05:16:18.315940+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:13:02.340027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:17:26.914416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:17:29.112997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"18907a03-1f43-419a-acb6-9fa4cf5020d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6803","nonce":3421474326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6805","nonce":3421474326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6809","nonce":3421474326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6807","nonce":3421474326}]},"public_addr":"172.21.15.120:6803/3421474326","cluster_addr":"172.21.15.120:6805/3421474326","heartbeat_back_addr":"172.21.15.120:6809/3421474326","heartbeat_front_addr":"172.21.15.120:6807/3421474326","state":["exists","up"]},{"osd":1,"uuid":"d21e029b-8a60-43f9-9ba7-30cdba19ba57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6801","nonce":1195511218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6803","nonce":1195511218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6807","nonce":1195511218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6805","nonce":1195511218}]},"public_addr":"172.21.15.178:6801/1195511218","cluster_addr":"172.21.15.178:6803/1195511218","heartbeat_back_addr":"172.21.15.178:6807/1195511218","heartbeat_front_addr":"172.21.15.178:6805/1195511218","state":["exists","up"]},{"osd":2,"uuid":"26ad9c8d-dbaa-46c2-a346-19717d81cc60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6801","nonce":3752826560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6803","nonce":3752826560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6807","nonce":3752826560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6805","nonce":3752826560}]},"public_addr":"172.21.15.194:6801/3752826560","cluster_addr":"172.21.15.194:6803/3752826560","heartbeat_back_addr":"172.21.15.194:6807/3752826560","heartbeat_front_addr":"172.21.15.194:6805/3752826560","state":["exists","up"]},{"osd":3,"uuid":"7e266576-8a98-40a8-9532-4b6f4611a908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6811","nonce":803566783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6813","nonce":803566783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6817","nonce":803566783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6815","nonce":803566783}]},"public_addr":"172.21.15.120:6811/803566783","cluster_addr":"172.21.15.120:6813/803566783","heartbeat_back_addr":"172.21.15.120:6817/803566783","heartbeat_front_addr":"172.21.15.120:6815/803566783","state":["exists","up"]},{"osd":4,"uuid":"c77d05c5-3b8f-4f7b-91f9-833735221684","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6809","nonce":541165323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6811","nonce":541165323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6815","nonce":541165323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6813","nonce":541165323}]},"public_addr":"172.21.15.178:6809/541165323","cluster_addr":"172.21.15.178:6811/541165323","heartbeat_back_addr":"172.21.15.178:6815/541165323","heartbeat_front_addr":"172.21.15.178:6813/541165323","state":["exists","up"]},{"osd":5,"uuid":"5f1c394b-e510-411f-969a-2db2b68cf41a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6809","nonce":2631415468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6811","nonce":2631415468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6815","nonce":2631415468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6813","nonce":2631415468}]},"public_addr":"172.21.15.194:6809/2631415468","cluster_addr":"172.21.15.194:6811/2631415468","heartbeat_back_addr":"172.21.15.194:6815/2631415468","heartbeat_front_addr":"172.21.15.194:6813/2631415468","state":["exists","up"]},{"osd":6,"uuid":"990af639-099e-49df-a083-05626cee3c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6819","nonce":388238976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6821","nonce":388238976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6825","nonce":388238976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6823","nonce":388238976}]},"public_addr":"172.21.15.120:6819/388238976","cluster_addr":"172.21.15.120:6821/388238976","heartbeat_back_addr":"172.21.15.120:6825/388238976","heartbeat_front_addr":"172.21.15.120:6823/388238976","state":["exists","up"]},{"osd":7,"uuid":"6f4aa6ab-b5f4-4c06-9f14-9a51bc195ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6817","nonce":1912109177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6819","nonce":1912109177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6823","nonce":1912109177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6821","nonce":1912109177}]},"public_addr":"172.21.15.178:6817/1912109177","cluster_addr":"172.21.15.178:6819/1912109177","heartbeat_back_addr":"172.21.15.178:6823/1912109177","heartbeat_front_addr":"172.21.15.178:6821/1912109177","state":["exists","up"]},{"osd":8,"uuid":"707739c9-732a-405c-847a-ce6a06e611b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6817","nonce":596878172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6819","nonce":596878172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6823","nonce":596878172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6821","nonce":596878172}]},"public_addr":"172.21.15.194:6817/596878172","cluster_addr":"172.21.15.194:6819/596878172","heartbeat_back_addr":"172.21.15.194:6823/596878172","heartbeat_front_addr":"172.21.15.194:6821/596878172","state":["exists","up"]},{"osd":9,"uuid":"9393b018-c924-4d75-99e5-25433d276567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6827","nonce":3257373801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6829","nonce":3257373801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6833","nonce":3257373801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6831","nonce":3257373801}]},"public_addr":"172.21.15.120:6827/3257373801","cluster_addr":"172.21.15.120:6829/3257373801","heartbeat_back_addr":"172.21.15.120:6833/3257373801","heartbeat_front_addr":"172.21.15.120:6831/3257373801","state":["exists","up"]},{"osd":10,"uuid":"45db7f62-87a6-4b2b-a3dc-012e2de505e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6825","nonce":3067822030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6827","nonce":3067822030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6831","nonce":3067822030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6829","nonce":3067822030}]},"public_addr":"172.21.15.178:6825/3067822030","cluster_addr":"172.21.15.178:6827/3067822030","heartbeat_back_addr":"172.21.15.178:6831/3067822030","heartbeat_front_addr":"172.21.15.178:6829/3067822030","state":["exists","up"]},{"osd":11,"uuid":"85ea248c-9a36-41cb-a200-87138fb31602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6825","nonce":2713146974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6827","nonce":2713146974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6831","nonce":2713146974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6829","nonce":2713146974}]},"public_addr":"172.21.15.194:6825/2713146974","cluster_addr":"172.21.15.194:6827/2713146974","heartbeat_back_addr":"172.21.15.194:6831/2713146974","heartbeat_front_addr":"172.21.15.194:6829/2713146974","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:09.395371+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:33.648930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:58.805048+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:23.621459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:48.553860+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:13.506636+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:38.520376+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:02.695124+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:27.084956+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:50.924128+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:15.396694+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:40.440416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":3,"to":8}]},{"pgid":"3.2a","mappings":[{"from":3,"to":6}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:0/316867529":"2024-09-20T05:19:14.314860+0000","172.21.15.120:0/1091097763":"2024-09-20T05:19:14.314860+0000","172.21.15.120:6801/955692128":"2024-09-20T05:19:14.314860+0000","172.21.15.120:6800/3412493069":"2024-09-20T05:10:23.348128+0000","172.21.15.120:6801/3412493069":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/4255533863":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/3592867428":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/2867300720":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/3049956965":"2024-09-20T05:19:14.314860+0000","172.21.15.120:0/4177074351":"2024-09-20T05:10:48.027892+0000","172.21.15.120:6800/50152720":"2024-09-20T05:10:48.027892+0000","172.21.15.120:6801/50152720":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/329623296":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/3419110398":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/3080806681":"2024-09-20T05:19:14.314860+0000","172.21.15.120:0/1358819866":"2024-09-20T05:19:14.314860+0000","172.21.15.120:6800/955692128":"2024-09-20T05:19:14.314860+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:19:16.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.694+0000 7f99e514b640 1 -- 172.21.15.120:0/4191499059 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f99cc0a3050 msgr2=0x7f99cc0a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:16.696 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.694+0000 7f99e514b640 1 --2- 172.21.15.120:0/4191499059 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f99cc0a3050 0x7f99cc0a5510 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f99e0101c70 tx=0x7f99d0009260 comp rx=0 tx=0).stop 2024-09-19T05:19:16.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.694+0000 7f99e514b640 1 -- 172.21.15.120:0/4191499059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99e0102590 msgr2=0x7f99e0101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:16.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.694+0000 7f99e514b640 1 --2- 172.21.15.120:0/4191499059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99e0102590 0x7f99e0101f00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f99c8005940 tx=0x7f99c8030e00 comp rx=0 tx=0).stop 2024-09-19T05:19:16.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.695+0000 7f99e514b640 1 -- 172.21.15.120:0/4191499059 shutdown_connections 2024-09-19T05:19:16.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.695+0000 7f99e514b640 1 --2- 172.21.15.120:0/4191499059 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f99cc0a3050 0x7f99cc0a5510 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.695+0000 7f99e514b640 1 --2- 172.21.15.120:0/4191499059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99e01077f0 0x7f99e0100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.695+0000 7f99e514b640 1 --2- 172.21.15.120:0/4191499059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99e0104ec0 0x7f99e0100540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.695+0000 7f99e514b640 1 --2- 172.21.15.120:0/4191499059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99e0102590 0x7f99e0101f00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.695+0000 7f99e514b640 1 -- 172.21.15.120:0/4191499059 >> 172.21.15.120:0/4191499059 conn(0x7f99e00fc170 msgr2=0x7f99e0102f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:16.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.695+0000 7f99e514b640 1 -- 172.21.15.120:0/4191499059 shutdown_connections 2024-09-19T05:19:16.697 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.695+0000 7f99e514b640 1 -- 172.21.15.120:0/4191499059 wait complete. 2024-09-19T05:19:16.709 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T05:13:02.340027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T05:17:26.914416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T05:17:29.112997+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T05:19:16.709 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T05:19:16.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.815+0000 7f17423a6640 1 -- 172.21.15.120:0/3086289590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f173c1025c0 msgr2=0x7f173c108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:16.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.815+0000 7f17423a6640 1 --2- 172.21.15.120:0/3086289590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f173c1025c0 0x7f173c108e50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1734009ca0 tx=0x7f173402a8c0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.815+0000 7f17423a6640 1 -- 172.21.15.120:0/3086289590 shutdown_connections 2024-09-19T05:19:16.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.815+0000 7f17423a6640 1 --2- 172.21.15.120:0/3086289590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f173c1025c0 0x7f173c108e50 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.815+0000 7f17423a6640 1 --2- 172.21.15.120:0/3086289590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f173c101c00 0x7f173c102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.815+0000 7f17423a6640 1 --2- 172.21.15.120:0/3086289590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f173c100a10 0x7f173c100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.815+0000 7f17423a6640 1 -- 172.21.15.120:0/3086289590 >> 172.21.15.120:0/3086289590 conn(0x7f173c0fc1b0 msgr2=0x7f173c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:16.820 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.815+0000 7f17423a6640 1 -- 172.21.15.120:0/3086289590 shutdown_connections 2024-09-19T05:19:16.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.815+0000 7f17423a6640 1 -- 172.21.15.120:0/3086289590 wait complete. 2024-09-19T05:19:16.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.815+0000 7f17423a6640 1 Processor -- start 2024-09-19T05:19:16.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.815+0000 7f17423a6640 1 -- start start 2024-09-19T05:19:16.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.815+0000 7f17423a6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f173c100a10 0x7f173c196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:16.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.815+0000 7f17423a6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f173c101c00 0x7f173c1971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:16.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.815+0000 7f17423a6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f173c1025c0 0x7f173c19e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:16.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.815+0000 7f17423a6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f173c10c540 con 0x7f173c100a10 2024-09-19T05:19:16.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.815+0000 7f17423a6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f173c10c3c0 con 0x7f173c1025c0 2024-09-19T05:19:16.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.815+0000 7f17423a6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f173c10c6c0 con 0x7f173c101c00 2024-09-19T05:19:16.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.815+0000 7f173bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f173c100a10 0x7f173c196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:16.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.816+0000 7f173bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f173c100a10 0x7f173c196c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48498/0 (socket says 172.21.15.120:48498) 2024-09-19T05:19:16.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.816+0000 7f173bfff640 1 -- 172.21.15.120:0/1514077266 learned_addr learned my addr 172.21.15.120:0/1514077266 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:16.821 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.816+0000 7f1733fff640 1 --2- 172.21.15.120:0/1514077266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f173c101c00 0x7f173c1971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:16.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.816+0000 7f1740943640 1 --2- 172.21.15.120:0/1514077266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f173c1025c0 0x7f173c19e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:16.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.816+0000 7f173bfff640 1 -- 172.21.15.120:0/1514077266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f173c101c00 msgr2=0x7f173c1971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:16.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.816+0000 7f173bfff640 1 --2- 172.21.15.120:0/1514077266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f173c101c00 0x7f173c1971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.816+0000 7f173bfff640 1 -- 172.21.15.120:0/1514077266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f173c1025c0 msgr2=0x7f173c19e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:16.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.816+0000 7f173bfff640 1 --2- 172.21.15.120:0/1514077266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f173c1025c0 0x7f173c19e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:16.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.816+0000 7f173bfff640 1 -- 172.21.15.120:0/1514077266 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f173c19e890 con 0x7f173c100a10 2024-09-19T05:19:16.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.816+0000 7f1740943640 1 --2- 172.21.15.120:0/1514077266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f173c1025c0 0x7f173c19e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:19:16.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.816+0000 7f173bfff640 1 --2- 172.21.15.120:0/1514077266 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f173c100a10 0x7f173c196c80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f172c00e9c0 tx=0x7f172c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:16.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.816+0000 7f1739ffb640 1 -- 172.21.15.120:0/1514077266 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c00cd80 con 0x7f173c100a10 2024-09-19T05:19:16.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.816+0000 7f17423a6640 1 -- 172.21.15.120:0/1514077266 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f173c19eb80 con 0x7f173c100a10 2024-09-19T05:19:16.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.816+0000 7f1739ffb640 1 -- 172.21.15.120:0/1514077266 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f172c0035f0 con 0x7f173c100a10 2024-09-19T05:19:16.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.816+0000 7f1739ffb640 1 -- 172.21.15.120:0/1514077266 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f172c010690 con 0x7f173c100a10 2024-09-19T05:19:16.822 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.816+0000 7f17423a6640 1 -- 172.21.15.120:0/1514077266 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f173c19f080 con 0x7f173c100a10 2024-09-19T05:19:16.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.817+0000 7f17423a6640 1 -- 172.21.15.120:0/1514077266 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f173c107df0 con 0x7f173c100a10 2024-09-19T05:19:16.823 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.819+0000 7f1739ffb640 1 -- 172.21.15.120:0/1514077266 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f172c0037a0 con 0x7f173c100a10 2024-09-19T05:19:16.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.819+0000 7f1739ffb640 1 --2- 172.21.15.120:0/1514077266 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f17280a3050 0x7f17280a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:16.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.819+0000 7f1733fff640 1 --2- 172.21.15.120:0/1514077266 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f17280a3050 0x7f17280a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:16.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.819+0000 7f1739ffb640 1 -- 172.21.15.120:0/1514077266 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f172c0cfcf0 con 0x7f173c100a10 2024-09-19T05:19:16.824 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.820+0000 7f1733fff640 1 --2- 172.21.15.120:0/1514077266 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f17280a3050 0x7f17280a5510 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1724009bd0 tx=0x7f1724005f90 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:16.825 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:16.823+0000 7f1739ffb640 1 -- 172.21.15.120:0/1514077266 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f172c09cb90 con 0x7f173c100a10 2024-09-19T05:19:17.005 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.003+0000 7f17423a6640 1 -- 172.21.15.120:0/1514077266 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f173c062e90 con 0x7f173c100a10 2024-09-19T05:19:17.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.004+0000 7f1739ffb640 1 -- 172.21.15.120:0/1514077266 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) ==== 93+0+10 (secure 0 0 0) 0x7f172c09c490 con 0x7f173c100a10 2024-09-19T05:19:17.006 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-09-19T05:19:17.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.006+0000 7f17423a6640 1 -- 172.21.15.120:0/1514077266 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f17280a3050 msgr2=0x7f17280a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:17.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.006+0000 7f17423a6640 1 --2- 172.21.15.120:0/1514077266 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f17280a3050 0x7f17280a5510 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1724009bd0 tx=0x7f1724005f90 comp rx=0 tx=0).stop 2024-09-19T05:19:17.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.007+0000 7f17423a6640 1 -- 172.21.15.120:0/1514077266 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f173c100a10 msgr2=0x7f173c196c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:17.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.007+0000 7f17423a6640 1 --2- 172.21.15.120:0/1514077266 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f173c100a10 0x7f173c196c80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f172c00e9c0 tx=0x7f172c00ee80 comp rx=0 tx=0).stop 2024-09-19T05:19:17.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.007+0000 7f17423a6640 1 -- 172.21.15.120:0/1514077266 shutdown_connections 2024-09-19T05:19:17.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.007+0000 7f17423a6640 1 --2- 172.21.15.120:0/1514077266 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f17280a3050 0x7f17280a5510 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.007+0000 7f17423a6640 1 --2- 172.21.15.120:0/1514077266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f173c1025c0 0x7f173c19e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.007+0000 7f17423a6640 1 --2- 172.21.15.120:0/1514077266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f173c101c00 0x7f173c1971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.007+0000 7f17423a6640 1 --2- 172.21.15.120:0/1514077266 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f173c100a10 0x7f173c196c80 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.007+0000 7f17423a6640 1 -- 172.21.15.120:0/1514077266 >> 172.21.15.120:0/1514077266 conn(0x7f173c0fc1b0 msgr2=0x7f173c104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:17.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.007+0000 7f17423a6640 1 -- 172.21.15.120:0/1514077266 shutdown_connections 2024-09-19T05:19:17.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.007+0000 7f17423a6640 1 -- 172.21.15.120:0/1514077266 wait complete. 2024-09-19T05:19:17.022 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T05:19:17.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.129+0000 7f0424db7640 1 -- 172.21.15.120:0/2724666778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0420100a00 msgr2=0x7f0420100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:17.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.129+0000 7f0424db7640 1 --2- 172.21.15.120:0/2724666778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0420100a00 0x7f0420100e00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0410009900 tx=0x7f041002a410 comp rx=0 tx=0).stop 2024-09-19T05:19:17.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.130+0000 7f0424db7640 1 -- 172.21.15.120:0/2724666778 shutdown_connections 2024-09-19T05:19:17.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.130+0000 7f0424db7640 1 --2- 172.21.15.120:0/2724666778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04201025b0 0x7f0420108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.130+0000 7f0424db7640 1 --2- 172.21.15.120:0/2724666778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0420101bf0 0x7f0420102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.130+0000 7f0424db7640 1 --2- 172.21.15.120:0/2724666778 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0420100a00 0x7f0420100e00 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.130+0000 7f0424db7640 1 -- 172.21.15.120:0/2724666778 >> 172.21.15.120:0/2724666778 conn(0x7f04200fc140 msgr2=0x7f04200fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:17.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.130+0000 7f0424db7640 1 -- 172.21.15.120:0/2724666778 shutdown_connections 2024-09-19T05:19:17.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.130+0000 7f0424db7640 1 -- 172.21.15.120:0/2724666778 wait complete. 2024-09-19T05:19:17.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.130+0000 7f0424db7640 1 Processor -- start 2024-09-19T05:19:17.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.130+0000 7f0424db7640 1 -- start start 2024-09-19T05:19:17.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.130+0000 7f0424db7640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0420100a00 0x7f0420197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:17.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.131+0000 7f0424db7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0420101bf0 0x7f0420198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:17.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.131+0000 7f0424db7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04201025b0 0x7f042019f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:17.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.131+0000 7f0424db7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f042010c530 con 0x7f04201025b0 2024-09-19T05:19:17.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.131+0000 7f0424db7640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f042010c3b0 con 0x7f0420100a00 2024-09-19T05:19:17.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.131+0000 7f0424db7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f042010c6b0 con 0x7f0420101bf0 2024-09-19T05:19:17.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.131+0000 7f041ed9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04201025b0 0x7f042019f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:17.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.131+0000 7f041dd9b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0420101bf0 0x7f0420198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:17.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.131+0000 7f041dd9b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0420101bf0 0x7f0420198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:34376/0 (socket says 172.21.15.120:34376) 2024-09-19T05:19:17.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.131+0000 7f041ed9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04201025b0 0x7f042019f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48518/0 (socket says 172.21.15.120:48518) 2024-09-19T05:19:17.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.131+0000 7f041dd9b640 1 -- 172.21.15.120:0/2477299399 learned_addr learned my addr 172.21.15.120:0/2477299399 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:17.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.131+0000 7f041e59c640 1 --2- 172.21.15.120:0/2477299399 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0420100a00 0x7f0420197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:17.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.131+0000 7f041dd9b640 1 -- 172.21.15.120:0/2477299399 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0420100a00 msgr2=0x7f0420197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:17.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.131+0000 7f041dd9b640 1 --2- 172.21.15.120:0/2477299399 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0420100a00 0x7f0420197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.131+0000 7f041dd9b640 1 -- 172.21.15.120:0/2477299399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04201025b0 msgr2=0x7f042019f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:17.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.131+0000 7f041dd9b640 1 --2- 172.21.15.120:0/2477299399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04201025b0 0x7f042019f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.131+0000 7f041dd9b640 1 -- 172.21.15.120:0/2477299399 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f042019fa00 con 0x7f0420101bf0 2024-09-19T05:19:17.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.131+0000 7f041dd9b640 1 --2- 172.21.15.120:0/2477299399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0420101bf0 0x7f0420198320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f041400e9f0 tx=0x7f041400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:17.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.131+0000 7f040f7fe640 1 -- 172.21.15.120:0/2477299399 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f041400cd80 con 0x7f0420101bf0 2024-09-19T05:19:17.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.131+0000 7f0424db7640 1 -- 172.21.15.120:0/2477299399 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f042019fcf0 con 0x7f0420101bf0 2024-09-19T05:19:17.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.131+0000 7f040f7fe640 1 -- 172.21.15.120:0/2477299399 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f04140054d0 con 0x7f0420101bf0 2024-09-19T05:19:17.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.131+0000 7f040f7fe640 1 -- 172.21.15.120:0/2477299399 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0414010490 con 0x7f0420101bf0 2024-09-19T05:19:17.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.131+0000 7f0424db7640 1 -- 172.21.15.120:0/2477299399 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04201a0190 con 0x7f0420101bf0 2024-09-19T05:19:17.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.133+0000 7f0424db7640 1 -- 172.21.15.120:0/2477299399 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04201a0420 con 0x7f0420101bf0 2024-09-19T05:19:17.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.133+0000 7f040f7fe640 1 -- 172.21.15.120:0/2477299399 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f0414005020 con 0x7f0420101bf0 2024-09-19T05:19:17.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.134+0000 7f040f7fe640 1 --2- 172.21.15.120:0/2477299399 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f04080a3050 0x7f04080a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:17.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.134+0000 7f040f7fe640 1 -- 172.21.15.120:0/2477299399 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f04140cfa30 con 0x7f0420101bf0 2024-09-19T05:19:17.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.134+0000 7f041e59c640 1 --2- 172.21.15.120:0/2477299399 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f04080a3050 0x7f04080a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:17.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.135+0000 7f041e59c640 1 --2- 172.21.15.120:0/2477299399 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f04080a3050 0x7f04080a5510 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0410004770 tx=0x7f0410000bc0 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:17.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.138+0000 7f040f7fe640 1 -- 172.21.15.120:0/2477299399 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f041409c890 con 0x7f0420101bf0 2024-09-19T05:19:17.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.303+0000 7f040f7fe640 1 -- 172.21.15.120:0/2477299399 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mgrmap(e 22) ==== 138476+0+0 (secure 0 0 0) 0x7f0414098800 con 0x7f0420101bf0 2024-09-19T05:19:17.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.321+0000 7f0424db7640 1 -- 172.21.15.120:0/2477299399 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0420108a60 con 0x7f0420101bf0 2024-09-19T05:19:17.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.322+0000 7f040f7fe640 1 -- 172.21.15.120:0/2477299399 <== mon.1 v2:172.21.15.194:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) ==== 104+0+11 (secure 0 0 0) 0x7f0414093e20 con 0x7f0420101bf0 2024-09-19T05:19:17.323 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-09-19T05:19:17.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.324+0000 7f0424db7640 1 -- 172.21.15.120:0/2477299399 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f04080a3050 msgr2=0x7f04080a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:17.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.324+0000 7f0424db7640 1 --2- 172.21.15.120:0/2477299399 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f04080a3050 0x7f04080a5510 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0410004770 tx=0x7f0410000bc0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.324+0000 7f0424db7640 1 -- 172.21.15.120:0/2477299399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0420101bf0 msgr2=0x7f0420198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:17.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.324+0000 7f0424db7640 1 --2- 172.21.15.120:0/2477299399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0420101bf0 0x7f0420198320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f041400e9f0 tx=0x7f041400edf0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.324+0000 7f0424db7640 1 -- 172.21.15.120:0/2477299399 shutdown_connections 2024-09-19T05:19:17.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.324+0000 7f0424db7640 1 --2- 172.21.15.120:0/2477299399 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f04080a3050 0x7f04080a5510 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.326 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.324+0000 7f0424db7640 1 --2- 172.21.15.120:0/2477299399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04201025b0 0x7f042019f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.324+0000 7f0424db7640 1 --2- 172.21.15.120:0/2477299399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0420101bf0 0x7f0420198320 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.324+0000 7f0424db7640 1 --2- 172.21.15.120:0/2477299399 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0420100a00 0x7f0420197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.324+0000 7f0424db7640 1 -- 172.21.15.120:0/2477299399 >> 172.21.15.120:0/2477299399 conn(0x7f04200fc140 msgr2=0x7f04200fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:17.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.324+0000 7f0424db7640 1 -- 172.21.15.120:0/2477299399 shutdown_connections 2024-09-19T05:19:17.327 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.324+0000 7f0424db7640 1 -- 172.21.15.120:0/2477299399 wait complete. 2024-09-19T05:19:17.339 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T05:19:17.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.445+0000 7fdbd4e53640 1 -- 172.21.15.120:0/4230216916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdbd0101bf0 msgr2=0x7fdbd0102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:17.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.445+0000 7fdbd4e53640 1 --2- 172.21.15.120:0/4230216916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdbd0101bf0 0x7fdbd0102070 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4009900 tx=0x7fdbc402a410 comp rx=0 tx=0).stop 2024-09-19T05:19:17.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.445+0000 7fdbd4e53640 1 -- 172.21.15.120:0/4230216916 shutdown_connections 2024-09-19T05:19:17.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.445+0000 7fdbd4e53640 1 --2- 172.21.15.120:0/4230216916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbd01025b0 0x7fdbd0108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.445+0000 7fdbd4e53640 1 --2- 172.21.15.120:0/4230216916 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdbd0101bf0 0x7fdbd0102070 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.445+0000 7fdbd4e53640 1 --2- 172.21.15.120:0/4230216916 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbd0100a00 0x7fdbd0100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.447 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.445+0000 7fdbd4e53640 1 -- 172.21.15.120:0/4230216916 >> 172.21.15.120:0/4230216916 conn(0x7fdbd00fc140 msgr2=0x7fdbd00fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:17.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.445+0000 7fdbd4e53640 1 -- 172.21.15.120:0/4230216916 shutdown_connections 2024-09-19T05:19:17.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.445+0000 7fdbd4e53640 1 -- 172.21.15.120:0/4230216916 wait complete. 2024-09-19T05:19:17.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.446+0000 7fdbd4e53640 1 Processor -- start 2024-09-19T05:19:17.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.446+0000 7fdbd4e53640 1 -- start start 2024-09-19T05:19:17.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.446+0000 7fdbd4e53640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbd0100a00 0x7fdbd0069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:17.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.446+0000 7fdbd4e53640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbd0101bf0 0x7fdbd019cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:17.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.446+0000 7fdbd4e53640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdbd01025b0 0x7fdbd019f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:17.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.446+0000 7fdbd4e53640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd010c510 con 0x7fdbd01025b0 2024-09-19T05:19:17.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.446+0000 7fdbd4e53640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd010c390 con 0x7fdbd0101bf0 2024-09-19T05:19:17.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.446+0000 7fdbd4e53640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd010c690 con 0x7fdbd0100a00 2024-09-19T05:19:17.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.446+0000 7fdbced9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdbd01025b0 0x7fdbd019f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:17.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.446+0000 7fdbce59c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbd0100a00 0x7fdbd0069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:17.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.446+0000 7fdbced9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdbd01025b0 0x7fdbd019f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48546/0 (socket says 172.21.15.120:48546) 2024-09-19T05:19:17.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.446+0000 7fdbce59c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbd0100a00 0x7fdbd0069ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:34392/0 (socket says 172.21.15.120:34392) 2024-09-19T05:19:17.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.446+0000 7fdbced9d640 1 -- 172.21.15.120:0/1078560448 learned_addr learned my addr 172.21.15.120:0/1078560448 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:17.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.446+0000 7fdbcdd9b640 1 --2- 172.21.15.120:0/1078560448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbd0101bf0 0x7fdbd019cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:17.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.446+0000 7fdbced9d640 1 -- 172.21.15.120:0/1078560448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbd0100a00 msgr2=0x7fdbd0069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:17.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.446+0000 7fdbced9d640 1 --2- 172.21.15.120:0/1078560448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbd0100a00 0x7fdbd0069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.446+0000 7fdbced9d640 1 -- 172.21.15.120:0/1078560448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbd0101bf0 msgr2=0x7fdbd019cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:17.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.446+0000 7fdbced9d640 1 --2- 172.21.15.120:0/1078560448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbd0101bf0 0x7fdbd019cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.446+0000 7fdbced9d640 1 -- 172.21.15.120:0/1078560448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd019fa30 con 0x7fdbd01025b0 2024-09-19T05:19:17.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.446+0000 7fdbced9d640 1 --2- 172.21.15.120:0/1078560448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdbd01025b0 0x7fdbd019f120 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800eb10 tx=0x7fdbc800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:17.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.447+0000 7fdbbf7fe640 1 -- 172.21.15.120:0/1078560448 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8004b20 con 0x7fdbd01025b0 2024-09-19T05:19:17.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.447+0000 7fdbd4e53640 1 -- 172.21.15.120:0/1078560448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbd019fcc0 con 0x7fdbd01025b0 2024-09-19T05:19:17.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.447+0000 7fdbbf7fe640 1 -- 172.21.15.120:0/1078560448 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fdbc8004cc0 con 0x7fdbd01025b0 2024-09-19T05:19:17.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.447+0000 7fdbbf7fe640 1 -- 172.21.15.120:0/1078560448 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8010690 con 0x7fdbd01025b0 2024-09-19T05:19:17.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.447+0000 7fdbd4e53640 1 -- 172.21.15.120:0/1078560448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbd01a0190 con 0x7fdbd01025b0 2024-09-19T05:19:17.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.448+0000 7fdbd4e53640 1 -- 172.21.15.120:0/1078560448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbd0107f30 con 0x7fdbd01025b0 2024-09-19T05:19:17.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.449+0000 7fdbbf7fe640 1 -- 172.21.15.120:0/1078560448 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 22) ==== 138476+0+0 (secure 0 0 0) 0x7fdbc8005000 con 0x7fdbd01025b0 2024-09-19T05:19:17.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.450+0000 7fdbbf7fe640 1 --2- 172.21.15.120:0/1078560448 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fdbb80a33c0 0x7fdbb80a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:17.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.450+0000 7fdbce59c640 1 --2- 172.21.15.120:0/1078560448 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fdbb80a33c0 0x7fdbb80a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:17.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.450+0000 7fdbbf7fe640 1 -- 172.21.15.120:0/1078560448 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fdbc80d04c0 con 0x7fdbd01025b0 2024-09-19T05:19:17.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.450+0000 7fdbce59c640 1 --2- 172.21.15.120:0/1078560448 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fdbb80a33c0 0x7fdbb80a5880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0101a50 tx=0x7fdbc0005f90 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:17.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.454+0000 7fdbbf7fe640 1 -- 172.21.15.120:0/1078560448 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdbc8054210 con 0x7fdbd01025b0 2024-09-19T05:19:17.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: [19/Sep/2024:05:19:15] ENGINE Bus STARTING 2024-09-19T05:19:17.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: [19/Sep/2024:05:19:15] ENGINE Serving on https://172.21.15.120:7150 2024-09-19T05:19:17.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: [19/Sep/2024:05:19:15] ENGINE Error in HTTPServer.serve 2024-09-19T05:19:17.626 INFO:journalctl@ceph.mon.a.smithi120.stdout: Traceback (most recent call last): 2024-09-19T05:19:17.626 INFO:journalctl@ceph.mon.a.smithi120.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T05:19:17.626 INFO:journalctl@ceph.mon.a.smithi120.stdout: self._connections.run(self.expiration_interval) 2024-09-19T05:19:17.626 INFO:journalctl@ceph.mon.a.smithi120.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T05:19:17.626 INFO:journalctl@ceph.mon.a.smithi120.stdout: self._run(expiration_interval) 2024-09-19T05:19:17.626 INFO:journalctl@ceph.mon.a.smithi120.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T05:19:17.626 INFO:journalctl@ceph.mon.a.smithi120.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T05:19:17.627 INFO:journalctl@ceph.mon.a.smithi120.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T05:19:17.627 INFO:journalctl@ceph.mon.a.smithi120.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T05:19:17.627 INFO:journalctl@ceph.mon.a.smithi120.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T05:19:17.627 INFO:journalctl@ceph.mon.a.smithi120.stdout: s = self.context.wrap_socket( 2024-09-19T05:19:17.627 INFO:journalctl@ceph.mon.a.smithi120.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T05:19:17.627 INFO:journalctl@ceph.mon.a.smithi120.stdout: return self.sslsocket_class._create( 2024-09-19T05:19:17.627 INFO:journalctl@ceph.mon.a.smithi120.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T05:19:17.627 INFO:journalctl@ceph.mon.a.smithi120.stdout: self.do_handshake() 2024-09-19T05:19:17.628 INFO:journalctl@ceph.mon.a.smithi120.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T05:19:17.628 INFO:journalctl@ceph.mon.a.smithi120.stdout: self._sslobj.do_handshake() 2024-09-19T05:19:17.628 INFO:journalctl@ceph.mon.a.smithi120.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T05:19:17.628 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: [19/Sep/2024:05:19:15] ENGINE Serving on http://172.21.15.120:8765 2024-09-19T05:19:17.628 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: [19/Sep/2024:05:19:15] ENGINE Bus STARTED 2024-09-19T05:19:17.628 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1856111234' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T05:19:17.628 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:17.628 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:19:17.628 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:17.628 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:17.628 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/4191499059' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:19:17.629 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:17.629 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:17.629 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1514077266' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T05:19:17.629 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:17.629 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.629 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:17.629 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.629 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.629 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.629 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.629 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.629 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.629 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.630 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:17.630 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:17.630 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.630 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.630 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.630 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.630 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:19:17.630 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:19:17.630 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-09-19T05:19:17.630 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:17 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2477299399' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T05:19:17.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.646+0000 7fdbd4e53640 1 -- 172.21.15.120:0/1078560448 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdbd002d9e0 con 0x7fdbd01025b0 2024-09-19T05:19:17.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.646+0000 7fdbbf7fe640 1 -- 172.21.15.120:0/1078560448 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) ==== 100+0+11 (secure 0 0 0) 0x7fdbc809ce50 con 0x7fdbd01025b0 2024-09-19T05:19:17.648 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-09-19T05:19:17.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.649+0000 7fdbd4e53640 1 -- 172.21.15.120:0/1078560448 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fdbb80a33c0 msgr2=0x7fdbb80a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:17.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.649+0000 7fdbd4e53640 1 --2- 172.21.15.120:0/1078560448 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fdbb80a33c0 0x7fdbb80a5880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0101a50 tx=0x7fdbc0005f90 comp rx=0 tx=0).stop 2024-09-19T05:19:17.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.649+0000 7fdbd4e53640 1 -- 172.21.15.120:0/1078560448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdbd01025b0 msgr2=0x7fdbd019f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:17.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.649+0000 7fdbd4e53640 1 --2- 172.21.15.120:0/1078560448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdbd01025b0 0x7fdbd019f120 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdbc800eb10 tx=0x7fdbc800c2d0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.649+0000 7fdbd4e53640 1 -- 172.21.15.120:0/1078560448 shutdown_connections 2024-09-19T05:19:17.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.649+0000 7fdbd4e53640 1 --2- 172.21.15.120:0/1078560448 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fdbb80a33c0 0x7fdbb80a5880 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.649+0000 7fdbd4e53640 1 --2- 172.21.15.120:0/1078560448 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdbd01025b0 0x7fdbd019f120 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.649+0000 7fdbd4e53640 1 --2- 172.21.15.120:0/1078560448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbd0101bf0 0x7fdbd019cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.649+0000 7fdbd4e53640 1 --2- 172.21.15.120:0/1078560448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbd0100a00 0x7fdbd0069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:17.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.649+0000 7fdbd4e53640 1 -- 172.21.15.120:0/1078560448 >> 172.21.15.120:0/1078560448 conn(0x7fdbd00fc140 msgr2=0x7fdbd0105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:17.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.649+0000 7fdbd4e53640 1 -- 172.21.15.120:0/1078560448 shutdown_connections 2024-09-19T05:19:17.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:17.649+0000 7fdbd4e53640 1 -- 172.21.15.120:0/1078560448 wait complete. 2024-09-19T05:19:17.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: [19/Sep/2024:05:19:15] ENGINE Bus STARTING 2024-09-19T05:19:17.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: [19/Sep/2024:05:19:15] ENGINE Serving on https://172.21.15.120:7150 2024-09-19T05:19:17.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: [19/Sep/2024:05:19:15] ENGINE Error in HTTPServer.serve 2024-09-19T05:19:17.656 INFO:journalctl@ceph.mon.c.smithi194.stdout: Traceback (most recent call last): 2024-09-19T05:19:17.656 INFO:journalctl@ceph.mon.c.smithi194.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T05:19:17.656 INFO:journalctl@ceph.mon.c.smithi194.stdout: self._connections.run(self.expiration_interval) 2024-09-19T05:19:17.656 INFO:journalctl@ceph.mon.c.smithi194.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T05:19:17.656 INFO:journalctl@ceph.mon.c.smithi194.stdout: self._run(expiration_interval) 2024-09-19T05:19:17.656 INFO:journalctl@ceph.mon.c.smithi194.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T05:19:17.656 INFO:journalctl@ceph.mon.c.smithi194.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T05:19:17.656 INFO:journalctl@ceph.mon.c.smithi194.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T05:19:17.656 INFO:journalctl@ceph.mon.c.smithi194.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T05:19:17.657 INFO:journalctl@ceph.mon.c.smithi194.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T05:19:17.657 INFO:journalctl@ceph.mon.c.smithi194.stdout: s = self.context.wrap_socket( 2024-09-19T05:19:17.657 INFO:journalctl@ceph.mon.c.smithi194.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T05:19:17.657 INFO:journalctl@ceph.mon.c.smithi194.stdout: return self.sslsocket_class._create( 2024-09-19T05:19:17.657 INFO:journalctl@ceph.mon.c.smithi194.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T05:19:17.657 INFO:journalctl@ceph.mon.c.smithi194.stdout: self.do_handshake() 2024-09-19T05:19:17.657 INFO:journalctl@ceph.mon.c.smithi194.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T05:19:17.657 INFO:journalctl@ceph.mon.c.smithi194.stdout: self._sslobj.do_handshake() 2024-09-19T05:19:17.657 INFO:journalctl@ceph.mon.c.smithi194.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T05:19:17.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: [19/Sep/2024:05:19:15] ENGINE Serving on http://172.21.15.120:8765 2024-09-19T05:19:17.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: [19/Sep/2024:05:19:15] ENGINE Bus STARTED 2024-09-19T05:19:17.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1856111234' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T05:19:17.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:17.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:19:17.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:17.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:17.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/4191499059' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:19:17.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:17.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:17.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1514077266' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T05:19:17.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:17.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:17.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.658 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.659 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.659 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.659 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.659 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:17.659 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:17.659 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.659 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.659 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.659 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.659 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:19:17.659 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:19:17.659 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-09-19T05:19:17.659 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:17 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/2477299399' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T05:19:17.662 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-19T05:19:17.663 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:19:17.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: [19/Sep/2024:05:19:15] ENGINE Bus STARTING 2024-09-19T05:19:17.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: [19/Sep/2024:05:19:15] ENGINE Serving on https://172.21.15.120:7150 2024-09-19T05:19:17.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: [19/Sep/2024:05:19:15] ENGINE Error in HTTPServer.serve 2024-09-19T05:19:17.692 INFO:journalctl@ceph.mon.b.smithi178.stdout: Traceback (most recent call last): 2024-09-19T05:19:17.692 INFO:journalctl@ceph.mon.b.smithi178.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T05:19:17.692 INFO:journalctl@ceph.mon.b.smithi178.stdout: self._connections.run(self.expiration_interval) 2024-09-19T05:19:17.692 INFO:journalctl@ceph.mon.b.smithi178.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T05:19:17.693 INFO:journalctl@ceph.mon.b.smithi178.stdout: self._run(expiration_interval) 2024-09-19T05:19:17.693 INFO:journalctl@ceph.mon.b.smithi178.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T05:19:17.693 INFO:journalctl@ceph.mon.b.smithi178.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T05:19:17.693 INFO:journalctl@ceph.mon.b.smithi178.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T05:19:17.693 INFO:journalctl@ceph.mon.b.smithi178.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T05:19:17.693 INFO:journalctl@ceph.mon.b.smithi178.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T05:19:17.693 INFO:journalctl@ceph.mon.b.smithi178.stdout: s = self.context.wrap_socket( 2024-09-19T05:19:17.693 INFO:journalctl@ceph.mon.b.smithi178.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T05:19:17.693 INFO:journalctl@ceph.mon.b.smithi178.stdout: return self.sslsocket_class._create( 2024-09-19T05:19:17.693 INFO:journalctl@ceph.mon.b.smithi178.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T05:19:17.693 INFO:journalctl@ceph.mon.b.smithi178.stdout: self.do_handshake() 2024-09-19T05:19:17.693 INFO:journalctl@ceph.mon.b.smithi178.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T05:19:17.693 INFO:journalctl@ceph.mon.b.smithi178.stdout: self._sslobj.do_handshake() 2024-09-19T05:19:17.694 INFO:journalctl@ceph.mon.b.smithi178.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T05:19:17.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: [19/Sep/2024:05:19:15] ENGINE Serving on http://172.21.15.120:8765 2024-09-19T05:19:17.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: [19/Sep/2024:05:19:15] ENGINE Bus STARTED 2024-09-19T05:19:17.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1856111234' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-19T05:19:17.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:17.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:19:17.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:17.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:17.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/4191499059' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:19:17.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:17.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:17.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1514077266' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T05:19:17.695 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:17.695 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.695 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:17.695 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.695 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.695 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.695 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.695 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.695 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.695 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.695 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:17.695 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:17.696 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.696 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.696 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.696 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:19:17.696 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:19:17.696 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:19:17.696 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-09-19T05:19:17.696 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:17 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/2477299399' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T05:19:17.921 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:18.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.423+0000 7f69e2ef6640 1 -- 172.21.15.120:0/3181573212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69dc101420 msgr2=0x7f69dc10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:18.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.423+0000 7f69e2ef6640 1 --2- 172.21.15.120:0/3181573212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69dc101420 0x7f69dc10d950 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009cd0 tx=0x7f69d402c7c0 comp rx=0 tx=0).stop 2024-09-19T05:19:18.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.423+0000 7f69e2ef6640 1 -- 172.21.15.120:0/3181573212 shutdown_connections 2024-09-19T05:19:18.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.423+0000 7f69e2ef6640 1 --2- 172.21.15.120:0/3181573212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69dc101420 0x7f69dc10d950 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:18.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.423+0000 7f69e2ef6640 1 --2- 172.21.15.120:0/3181573212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69dc100a80 0x7f69dc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:18.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.423+0000 7f69e2ef6640 1 --2- 172.21.15.120:0/3181573212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69dc106a80 0x7f69dc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:18.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.423+0000 7f69e2ef6640 1 -- 172.21.15.120:0/3181573212 >> 172.21.15.120:0/3181573212 conn(0x7f69dc0fc7a0 msgr2=0x7f69dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:18.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.423+0000 7f69e2ef6640 1 -- 172.21.15.120:0/3181573212 shutdown_connections 2024-09-19T05:19:18.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.423+0000 7f69e2ef6640 1 -- 172.21.15.120:0/3181573212 wait complete. 2024-09-19T05:19:18.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.424+0000 7f69e2ef6640 1 Processor -- start 2024-09-19T05:19:18.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.424+0000 7f69e2ef6640 1 -- start start 2024-09-19T05:19:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.424+0000 7f69e2ef6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69dc100a80 0x7f69dc196170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.424+0000 7f69e2ef6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69dc101420 0x7f69dc1966b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.424+0000 7f69e2ef6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69dc106a80 0x7f69dc19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.424+0000 7f69e2ef6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f69dc10fbd0 con 0x7f69dc106a80 2024-09-19T05:19:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.424+0000 7f69e2ef6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f69dc10fa50 con 0x7f69dc100a80 2024-09-19T05:19:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.424+0000 7f69e2ef6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f69dc10fd50 con 0x7f69dc101420 2024-09-19T05:19:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.424+0000 7f69e1493640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69dc106a80 0x7f69dc19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.424+0000 7f69e1493640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69dc106a80 0x7f69dc19aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48558/0 (socket says 172.21.15.120:48558) 2024-09-19T05:19:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.424+0000 7f69e1493640 1 -- 172.21.15.120:0/3497581310 learned_addr learned my addr 172.21.15.120:0/3497581310 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.424+0000 7f69dbfff640 1 --2- 172.21.15.120:0/3497581310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69dc101420 0x7f69dc1966b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.424+0000 7f69e0c92640 1 --2- 172.21.15.120:0/3497581310 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69dc100a80 0x7f69dc196170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:18.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.425+0000 7f69e1493640 1 -- 172.21.15.120:0/3497581310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69dc101420 msgr2=0x7f69dc1966b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.425+0000 7f69e1493640 1 --2- 172.21.15.120:0/3497581310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69dc101420 0x7f69dc1966b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.425+0000 7f69e1493640 1 -- 172.21.15.120:0/3497581310 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69dc100a80 msgr2=0x7f69dc196170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.425+0000 7f69e1493640 1 --2- 172.21.15.120:0/3497581310 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69dc100a80 0x7f69dc196170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.425+0000 7f69e1493640 1 -- 172.21.15.120:0/3497581310 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69dc19b120 con 0x7f69dc106a80 2024-09-19T05:19:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.425+0000 7f69e0c92640 1 --2- 172.21.15.120:0/3497581310 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69dc100a80 0x7f69dc196170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:19:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.425+0000 7f69dbfff640 1 --2- 172.21.15.120:0/3497581310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69dc101420 0x7f69dc1966b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:19:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.425+0000 7f69e1493640 1 --2- 172.21.15.120:0/3497581310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69dc106a80 0x7f69dc19aa40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f69d4005cc0 tx=0x7f69d4035c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.425+0000 7f69d9ffb640 1 -- 172.21.15.120:0/3497581310 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d4039050 con 0x7f69dc106a80 2024-09-19T05:19:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.425+0000 7f69d9ffb640 1 -- 172.21.15.120:0/3497581310 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f69d4045070 con 0x7f69dc106a80 2024-09-19T05:19:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.425+0000 7f69e2ef6640 1 -- 172.21.15.120:0/3497581310 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69dc19b3b0 con 0x7f69dc106a80 2024-09-19T05:19:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.425+0000 7f69d9ffb640 1 -- 172.21.15.120:0/3497581310 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d40044e0 con 0x7f69dc106a80 2024-09-19T05:19:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.425+0000 7f69e2ef6640 1 -- 172.21.15.120:0/3497581310 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69dc1a2cf0 con 0x7f69dc106a80 2024-09-19T05:19:18.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.426+0000 7f69e2ef6640 1 -- 172.21.15.120:0/3497581310 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69dc100ee0 con 0x7f69dc106a80 2024-09-19T05:19:18.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.427+0000 7f69d9ffb640 1 -- 172.21.15.120:0/3497581310 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 22) ==== 138476+0+0 (secure 0 0 0) 0x7f69d4004680 con 0x7f69dc106a80 2024-09-19T05:19:18.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.428+0000 7f69d9ffb640 1 --2- 172.21.15.120:0/3497581310 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f69cc0a3430 0x7f69cc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:18.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.428+0000 7f69e0c92640 1 --2- 172.21.15.120:0/3497581310 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f69cc0a3430 0x7f69cc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:18.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.428+0000 7f69d9ffb640 1 -- 172.21.15.120:0/3497581310 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f69d40f27d0 con 0x7f69dc106a80 2024-09-19T05:19:18.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.428+0000 7f69e0c92640 1 --2- 172.21.15.120:0/3497581310 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f69cc0a3430 0x7f69cc0a58f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f69d0009f40 tx=0x7f69d0005f90 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:18.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.432+0000 7f69d9ffb640 1 -- 172.21.15.120:0/3497581310 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f69d40bf270 con 0x7f69dc106a80 2024-09-19T05:19:18.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:18 smithi120 ceph-mon[30956]: Adjusting osd_memory_target on smithi178 to 176.0M 2024-09-19T05:19:18.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:18 smithi120 ceph-mon[30956]: Unable to set osd_memory_target on smithi178 to 184549478: error parsing value: Value '184549478' is below minimum 939524096 2024-09-19T05:19:18.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:18 smithi120 ceph-mon[30956]: Adjusting osd_memory_target on smithi194 to 176.0M 2024-09-19T05:19:18.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:18 smithi120 ceph-mon[30956]: Unable to set osd_memory_target on smithi194 to 184584601: error parsing value: Value '184584601' is below minimum 939524096 2024-09-19T05:19:18.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:18 smithi120 ceph-mon[30956]: Adjusting osd_memory_target on smithi120 to 176.0M 2024-09-19T05:19:18.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:18 smithi120 ceph-mon[30956]: Unable to set osd_memory_target on smithi120 to 184562380: error parsing value: Value '184562380' is below minimum 939524096 2024-09-19T05:19:18.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:18 smithi120 ceph-mon[30956]: Updating smithi120:/etc/ceph/ceph.conf 2024-09-19T05:19:18.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:18 smithi120 ceph-mon[30956]: Updating smithi178:/etc/ceph/ceph.conf 2024-09-19T05:19:18.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:18 smithi120 ceph-mon[30956]: Updating smithi194:/etc/ceph/ceph.conf 2024-09-19T05:19:18.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:18 smithi120 ceph-mon[30956]: Updating smithi178:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:19:18.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:18 smithi120 ceph-mon[30956]: Updating smithi194:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:19:18.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:18 smithi120 ceph-mon[30956]: Updating smithi120:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:19:18.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:18 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1078560448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T05:19:18.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:18 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:18.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:18 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:18.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:18 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:18.627 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:18 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:18.627 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:18 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:18.627 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:18 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:18.627 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:18 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:18.627 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:18 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:19:18.627 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:18 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:19:18.627 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:18 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:19:18.627 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:18 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:18.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.635+0000 7f69e2ef6640 1 -- 172.21.15.120:0/3497581310 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69dc109010 con 0x7f69dc106a80 2024-09-19T05:19:18.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.635+0000 7f69d9ffb640 1 -- 172.21.15.120:0/3497581310 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11921 (secure 0 0 0) 0x7f69d40beb70 con 0x7f69dc106a80 2024-09-19T05:19:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:19:18.638 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":25,"btime":"2024-09-19T05:19:16:322502+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/93472898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":93472898},{"type":"v1","addr":"172.21.15.120:6835","nonce":93472898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1976835398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1976835398},{"type":"v1","addr":"172.21.15.120:6837","nonce":1976835398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6839/2975851469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":2975851469},{"type":"v1","addr":"172.21.15.120:6839","nonce":2975851469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6841/2837552754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":2837552754},{"type":"v1","addr":"172.21.15.120:6841","nonce":2837552754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/61682954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":61682954},{"type":"v1","addr":"172.21.15.178:6833","nonce":61682954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1778722040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1778722040},{"type":"v1","addr":"172.21.15.194:6833","nonce":1778722040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:17:30.796197+0000","modified":"2024-09-19T05:19:15.911765+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24445,"mds_1":24443,"mds_2":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24401":{"gid":24401,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/890775592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":890775592},{"type":"v1","addr":"172.21.15.178:6835","nonce":890775592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6837/3960720164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3960720164},{"type":"v1","addr":"172.21.15.178:6837","nonce":3960720164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6835/3268846994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3268846994},{"type":"v1","addr":"172.21.15.194:6835","nonce":3268846994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.194:6837/378729335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":378729335},{"type":"v1","addr":"172.21.15.194:6837","nonce":378729335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.178:6839/3389137566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3389137566},{"type":"v1","addr":"172.21.15.178:6839","nonce":3389137566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6839/3817420679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3817420679},{"type":"v1","addr":"172.21.15.194:6839","nonce":3817420679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24445,"qdb_cluster":[24445,24443,24430]},"id":1}]} 2024-09-19T05:19:18.638 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 25 2024-09-19T05:19:18.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.637+0000 7f69e2ef6640 1 -- 172.21.15.120:0/3497581310 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f69cc0a3430 msgr2=0x7f69cc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:18.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.637+0000 7f69e2ef6640 1 --2- 172.21.15.120:0/3497581310 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f69cc0a3430 0x7f69cc0a58f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f69d0009f40 tx=0x7f69d0005f90 comp rx=0 tx=0).stop 2024-09-19T05:19:18.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.637+0000 7f69e2ef6640 1 -- 172.21.15.120:0/3497581310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69dc106a80 msgr2=0x7f69dc19aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:18.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.637+0000 7f69e2ef6640 1 --2- 172.21.15.120:0/3497581310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69dc106a80 0x7f69dc19aa40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f69d4005cc0 tx=0x7f69d4035c80 comp rx=0 tx=0).stop 2024-09-19T05:19:18.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.638+0000 7f69e2ef6640 1 -- 172.21.15.120:0/3497581310 shutdown_connections 2024-09-19T05:19:18.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.638+0000 7f69e2ef6640 1 --2- 172.21.15.120:0/3497581310 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f69cc0a3430 0x7f69cc0a58f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:18.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.638+0000 7f69e2ef6640 1 --2- 172.21.15.120:0/3497581310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f69dc106a80 0x7f69dc19aa40 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:18.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.638+0000 7f69e2ef6640 1 --2- 172.21.15.120:0/3497581310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69dc101420 0x7f69dc1966b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:18.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.638+0000 7f69e2ef6640 1 --2- 172.21.15.120:0/3497581310 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69dc100a80 0x7f69dc196170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:18.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.638+0000 7f69e2ef6640 1 -- 172.21.15.120:0/3497581310 >> 172.21.15.120:0/3497581310 conn(0x7f69dc0fc7a0 msgr2=0x7f69dc0fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:18.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.638+0000 7f69e2ef6640 1 -- 172.21.15.120:0/3497581310 shutdown_connections 2024-09-19T05:19:18.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:18.638+0000 7f69e2ef6640 1 -- 172.21.15.120:0/3497581310 wait complete. 2024-09-19T05:19:18.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:18 smithi194 ceph-mon[35228]: Adjusting osd_memory_target on smithi178 to 176.0M 2024-09-19T05:19:18.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:18 smithi194 ceph-mon[35228]: Unable to set osd_memory_target on smithi178 to 184549478: error parsing value: Value '184549478' is below minimum 939524096 2024-09-19T05:19:18.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:18 smithi194 ceph-mon[35228]: Adjusting osd_memory_target on smithi194 to 176.0M 2024-09-19T05:19:18.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:18 smithi194 ceph-mon[35228]: Unable to set osd_memory_target on smithi194 to 184584601: error parsing value: Value '184584601' is below minimum 939524096 2024-09-19T05:19:18.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:18 smithi194 ceph-mon[35228]: Adjusting osd_memory_target on smithi120 to 176.0M 2024-09-19T05:19:18.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:18 smithi194 ceph-mon[35228]: Unable to set osd_memory_target on smithi120 to 184562380: error parsing value: Value '184562380' is below minimum 939524096 2024-09-19T05:19:18.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:18 smithi194 ceph-mon[35228]: Updating smithi120:/etc/ceph/ceph.conf 2024-09-19T05:19:18.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:18 smithi194 ceph-mon[35228]: Updating smithi178:/etc/ceph/ceph.conf 2024-09-19T05:19:18.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:18 smithi194 ceph-mon[35228]: Updating smithi194:/etc/ceph/ceph.conf 2024-09-19T05:19:18.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:18 smithi194 ceph-mon[35228]: Updating smithi178:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:19:18.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:18 smithi194 ceph-mon[35228]: Updating smithi194:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:19:18.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:18 smithi194 ceph-mon[35228]: Updating smithi120:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:19:18.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:18 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1078560448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T05:19:18.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:18 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:18.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:18 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:18.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:18 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:18.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:18 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:18.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:18 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:18.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:18 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:18.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:18 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:18.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:18 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:19:18.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:18 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:19:18.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:18 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:19:18.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:18 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:18.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:18 smithi178 ceph-mon[34347]: Adjusting osd_memory_target on smithi178 to 176.0M 2024-09-19T05:19:18.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:18 smithi178 ceph-mon[34347]: Unable to set osd_memory_target on smithi178 to 184549478: error parsing value: Value '184549478' is below minimum 939524096 2024-09-19T05:19:18.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:18 smithi178 ceph-mon[34347]: Adjusting osd_memory_target on smithi194 to 176.0M 2024-09-19T05:19:18.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:18 smithi178 ceph-mon[34347]: Unable to set osd_memory_target on smithi194 to 184584601: error parsing value: Value '184584601' is below minimum 939524096 2024-09-19T05:19:18.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:18 smithi178 ceph-mon[34347]: Adjusting osd_memory_target on smithi120 to 176.0M 2024-09-19T05:19:18.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:18 smithi178 ceph-mon[34347]: Unable to set osd_memory_target on smithi120 to 184562380: error parsing value: Value '184562380' is below minimum 939524096 2024-09-19T05:19:18.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:18 smithi178 ceph-mon[34347]: Updating smithi120:/etc/ceph/ceph.conf 2024-09-19T05:19:18.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:18 smithi178 ceph-mon[34347]: Updating smithi178:/etc/ceph/ceph.conf 2024-09-19T05:19:18.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:18 smithi178 ceph-mon[34347]: Updating smithi194:/etc/ceph/ceph.conf 2024-09-19T05:19:18.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:18 smithi178 ceph-mon[34347]: Updating smithi178:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:19:18.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:18 smithi178 ceph-mon[34347]: Updating smithi194:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:19:18.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:18 smithi178 ceph-mon[34347]: Updating smithi120:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T05:19:18.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:18 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1078560448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T05:19:18.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:18 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:18.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:18 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:18.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:18 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:18.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:18 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:18.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:18 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:18.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:18 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:18.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:18 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:18.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:18 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:19:18.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:18 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:19:18.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:18 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:19:18.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:18 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:19.585 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-19T05:19:19.586 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-19T05:19:19.586 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:19:19.609 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:19 smithi120 ceph-mon[30956]: Updating smithi178:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:19:19.609 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:19 smithi120 ceph-mon[30956]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:19:19.609 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:19 smithi120 ceph-mon[30956]: Updating smithi120:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:19:19.609 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:19 smithi120 ceph-mon[30956]: Updating smithi178:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:19:19.609 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:19 smithi120 ceph-mon[30956]: Updating smithi194:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:19:19.609 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:19 smithi120 ceph-mon[30956]: Updating smithi120:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:19:19.609 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:19 smithi120 ceph-mon[30956]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:19.609 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:19 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/3497581310' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:19:19.609 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:19 smithi120 ceph-mon[30956]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-09-19T05:19:19.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:19 smithi194 ceph-mon[35228]: Updating smithi178:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:19:19.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:19 smithi194 ceph-mon[35228]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:19:19.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:19 smithi194 ceph-mon[35228]: Updating smithi120:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:19:19.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:19 smithi194 ceph-mon[35228]: Updating smithi178:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:19:19.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:19 smithi194 ceph-mon[35228]: Updating smithi194:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:19:19.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:19 smithi194 ceph-mon[35228]: Updating smithi120:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:19:19.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:19 smithi194 ceph-mon[35228]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:19.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:19 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/3497581310' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:19:19.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:19 smithi194 ceph-mon[35228]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-09-19T05:19:19.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.685+0000 7f3444480640 1 -- 172.21.15.120:0/2407373444 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f343c102420 msgr2=0x7f343c10e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.685+0000 7f3444480640 1 --2- 172.21.15.120:0/2407373444 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f343c102420 0x7f343c10e950 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3434009930 tx=0x7f343402a420 comp rx=0 tx=0).stop 2024-09-19T05:19:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.685+0000 7f3444480640 1 -- 172.21.15.120:0/2407373444 shutdown_connections 2024-09-19T05:19:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.686+0000 7f3444480640 1 --2- 172.21.15.120:0/2407373444 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f343c102420 0x7f343c10e950 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.686+0000 7f3444480640 1 --2- 172.21.15.120:0/2407373444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f343c101a80 0x7f343c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.686+0000 7f3444480640 1 --2- 172.21.15.120:0/2407373444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f343c107a90 0x7f343c107e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.686+0000 7f3444480640 1 -- 172.21.15.120:0/2407373444 >> 172.21.15.120:0/2407373444 conn(0x7f343c0fd7c0 msgr2=0x7f343c0ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.686+0000 7f3444480640 1 -- 172.21.15.120:0/2407373444 shutdown_connections 2024-09-19T05:19:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.686+0000 7f3444480640 1 -- 172.21.15.120:0/2407373444 wait complete. 2024-09-19T05:19:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.686+0000 7f3444480640 1 Processor -- start 2024-09-19T05:19:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.686+0000 7f3444480640 1 -- start start 2024-09-19T05:19:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.686+0000 7f3444480640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f343c101a80 0x7f343c1982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.686+0000 7f3444480640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f343c102420 0x7f343c198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.686+0000 7f3444480640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f343c107a90 0x7f343c19cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.686+0000 7f3444480640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f343c111d80 con 0x7f343c102420 2024-09-19T05:19:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.686+0000 7f3444480640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f343c111c00 con 0x7f343c101a80 2024-09-19T05:19:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.686+0000 7f3444480640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f343c111f00 con 0x7f343c107a90 2024-09-19T05:19:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.686+0000 7f3441a1b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f343c102420 0x7f343c198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.687+0000 7f3441a1b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f343c102420 0x7f343c198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48568/0 (socket says 172.21.15.120:48568) 2024-09-19T05:19:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.687+0000 7f3441a1b640 1 -- 172.21.15.120:0/3238726456 learned_addr learned my addr 172.21.15.120:0/3238726456 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.687+0000 7f344221c640 1 --2- 172.21.15.120:0/3238726456 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f343c101a80 0x7f343c1982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.687+0000 7f3442a1d640 1 --2- 172.21.15.120:0/3238726456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f343c107a90 0x7f343c19cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.687+0000 7f3441a1b640 1 -- 172.21.15.120:0/3238726456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f343c107a90 msgr2=0x7f343c19cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.687+0000 7f3441a1b640 1 --2- 172.21.15.120:0/3238726456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f343c107a90 0x7f343c19cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.687+0000 7f3441a1b640 1 -- 172.21.15.120:0/3238726456 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f343c101a80 msgr2=0x7f343c1982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:19.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.687+0000 7f3441a1b640 1 --2- 172.21.15.120:0/3238726456 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f343c101a80 0x7f343c1982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:19.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.687+0000 7f3441a1b640 1 -- 172.21.15.120:0/3238726456 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343c19d2c0 con 0x7f343c102420 2024-09-19T05:19:19.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.687+0000 7f3442a1d640 1 --2- 172.21.15.120:0/3238726456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f343c107a90 0x7f343c19cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:19:19.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.687+0000 7f3441a1b640 1 --2- 172.21.15.120:0/3238726456 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f343c102420 0x7f343c198810 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f343000d950 tx=0x7f343000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:19.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.687+0000 7f343b7fe640 1 -- 172.21.15.120:0/3238726456 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3430017070 con 0x7f343c102420 2024-09-19T05:19:19.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.687+0000 7f343b7fe640 1 -- 172.21.15.120:0/3238726456 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3430009c30 con 0x7f343c102420 2024-09-19T05:19:19.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.687+0000 7f3444480640 1 -- 172.21.15.120:0/3238726456 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f343c19d5b0 con 0x7f343c102420 2024-09-19T05:19:19.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.687+0000 7f343b7fe640 1 -- 172.21.15.120:0/3238726456 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f343000f620 con 0x7f343c102420 2024-09-19T05:19:19.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.687+0000 7f3444480640 1 -- 172.21.15.120:0/3238726456 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f343c1a4e40 con 0x7f343c102420 2024-09-19T05:19:19.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.688+0000 7f3444480640 1 -- 172.21.15.120:0/3238726456 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f343c101ee0 con 0x7f343c102420 2024-09-19T05:19:19.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:19 smithi178 ceph-mon[34347]: Updating smithi178:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:19:19.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:19 smithi178 ceph-mon[34347]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:19:19.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:19 smithi178 ceph-mon[34347]: Updating smithi120:/etc/ceph/ceph.client.admin.keyring 2024-09-19T05:19:19.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:19 smithi178 ceph-mon[34347]: Updating smithi178:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:19:19.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:19 smithi178 ceph-mon[34347]: Updating smithi194:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:19:19.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:19 smithi178 ceph-mon[34347]: Updating smithi120:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T05:19:19.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:19 smithi178 ceph-mon[34347]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:19.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:19 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/3497581310' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:19:19.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:19 smithi178 ceph-mon[34347]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-09-19T05:19:19.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.689+0000 7f343b7fe640 1 -- 172.21.15.120:0/3238726456 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f34300109a0 con 0x7f343c102420 2024-09-19T05:19:19.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.690+0000 7f343b7fe640 1 --2- 172.21.15.120:0/3238726456 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f34240a3450 0x7f34240a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:19.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.690+0000 7f344221c640 1 --2- 172.21.15.120:0/3238726456 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f34240a3450 0x7f34240a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:19.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.690+0000 7f343b7fe640 1 -- 172.21.15.120:0/3238726456 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f34300cfb40 con 0x7f343c102420 2024-09-19T05:19:19.694 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.690+0000 7f344221c640 1 --2- 172.21.15.120:0/3238726456 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f34240a3450 0x7f34240a5910 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f342c005fd0 tx=0x7f342c009680 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:19.695 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.694+0000 7f343b7fe640 1 -- 172.21.15.120:0/3238726456 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3430009de0 con 0x7f343c102420 2024-09-19T05:19:19.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.858+0000 7f3444480640 1 -- 172.21.15.120:0/3238726456 --> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f343c062630 con 0x7f34240a3450 2024-09-19T05:19:19.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.865+0000 7f343b7fe640 1 -- 172.21.15.120:0/3238726456 <== mgr.15156 v2:172.21.15.120:6800/1306632207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257851 (secure 0 0 0) 0x7f343c062630 con 0x7f34240a3450 2024-09-19T05:19:19.871 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:19:19.873 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-19T05:19:19.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.868+0000 7f3444480640 1 -- 172.21.15.120:0/3238726456 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f34240a3450 msgr2=0x7f34240a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:19.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.868+0000 7f3444480640 1 --2- 172.21.15.120:0/3238726456 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f34240a3450 0x7f34240a5910 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f342c005fd0 tx=0x7f342c009680 comp rx=0 tx=0).stop 2024-09-19T05:19:19.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.868+0000 7f3444480640 1 -- 172.21.15.120:0/3238726456 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f343c102420 msgr2=0x7f343c198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:19.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.868+0000 7f3444480640 1 --2- 172.21.15.120:0/3238726456 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f343c102420 0x7f343c198810 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f343000d950 tx=0x7f343000de10 comp rx=0 tx=0).stop 2024-09-19T05:19:19.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.868+0000 7f3444480640 1 -- 172.21.15.120:0/3238726456 shutdown_connections 2024-09-19T05:19:19.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.868+0000 7f3444480640 1 --2- 172.21.15.120:0/3238726456 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f34240a3450 0x7f34240a5910 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:19.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.868+0000 7f3444480640 1 --2- 172.21.15.120:0/3238726456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f343c107a90 0x7f343c19cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:19.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.868+0000 7f3444480640 1 --2- 172.21.15.120:0/3238726456 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f343c102420 0x7f343c198810 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:19.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.868+0000 7f3444480640 1 --2- 172.21.15.120:0/3238726456 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f343c101a80 0x7f343c1982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:19.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.868+0000 7f3444480640 1 -- 172.21.15.120:0/3238726456 >> 172.21.15.120:0/3238726456 conn(0x7f343c0fd7c0 msgr2=0x7f343c0fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:19.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.868+0000 7f3444480640 1 -- 172.21.15.120:0/3238726456 shutdown_connections 2024-09-19T05:19:19.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:19.868+0000 7f3444480640 1 -- 172.21.15.120:0/3238726456 wait complete. 2024-09-19T05:19:19.881 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-19T05:19:18.331898+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1183894,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":827,"num_read_kb":566,"num_write":472,"num_write_kb":4369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180792,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":865,"ondisk_log_size":865,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":396828,"kb_used_data":14204,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124544996,"statfs":{"total":1151940427776,"available":1151534075904,"internally_reserved":0,"allocated":14544896,"data_stored":8534415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":391492923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.992150"},"pg_stats":[{"pgid":"3.3f","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.370162+0000","last_change":"2024-09-19T05:17:30.200993+0000","last_active":"2024-09-19T05:19:14.370162+0000","last_peered":"2024-09-19T05:19:14.370162+0000","last_clean":"2024-09-19T05:19:14.370162+0000","last_became_active":"2024-09-19T05:17:30.200587+0000","last_became_peered":"2024-09-19T05:17:30.200587+0000","last_unstale":"2024-09-19T05:19:14.370162+0000","last_undegraded":"2024-09-19T05:19:14.370162+0000","last_fullsized":"2024-09-19T05:19:14.370162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:24.484844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.373616+0000","last_change":"2024-09-19T05:17:30.207784+0000","last_active":"2024-09-19T05:19:14.373616+0000","last_peered":"2024-09-19T05:19:14.373616+0000","last_clean":"2024-09-19T05:19:14.373616+0000","last_became_active":"2024-09-19T05:17:30.207485+0000","last_became_peered":"2024-09-19T05:17:30.207485+0000","last_unstale":"2024-09-19T05:19:14.373616+0000","last_undegraded":"2024-09-19T05:19:14.373616+0000","last_fullsized":"2024-09-19T05:19:14.373616+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:07.864813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.378421+0000","last_change":"2024-09-19T05:17:30.203861+0000","last_active":"2024-09-19T05:19:14.378421+0000","last_peered":"2024-09-19T05:19:14.378421+0000","last_clean":"2024-09-19T05:19:14.378421+0000","last_became_active":"2024-09-19T05:17:30.203541+0000","last_became_peered":"2024-09-19T05:17:30.203541+0000","last_unstale":"2024-09-19T05:19:14.378421+0000","last_undegraded":"2024-09-19T05:19:14.378421+0000","last_fullsized":"2024-09-19T05:19:14.378421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:33:44.840055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.364039+0000","last_change":"2024-09-19T05:17:30.214534+0000","last_active":"2024-09-19T05:19:14.364039+0000","last_peered":"2024-09-19T05:19:14.364039+0000","last_clean":"2024-09-19T05:19:14.364039+0000","last_became_active":"2024-09-19T05:17:30.213840+0000","last_became_peered":"2024-09-19T05:17:30.213840+0000","last_unstale":"2024-09-19T05:19:14.364039+0000","last_undegraded":"2024-09-19T05:19:14.364039+0000","last_fullsized":"2024-09-19T05:19:14.364039+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:03.673488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.366156+0000","last_change":"2024-09-19T05:17:30.201451+0000","last_active":"2024-09-19T05:19:14.366156+0000","last_peered":"2024-09-19T05:19:14.366156+0000","last_clean":"2024-09-19T05:19:14.366156+0000","last_became_active":"2024-09-19T05:17:30.201092+0000","last_became_peered":"2024-09-19T05:17:30.201092+0000","last_unstale":"2024-09-19T05:19:14.366156+0000","last_undegraded":"2024-09-19T05:19:14.366156+0000","last_fullsized":"2024-09-19T05:19:14.366156+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:18.958271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.369658+0000","last_change":"2024-09-19T05:17:49.506669+0000","last_active":"2024-09-19T05:19:14.369658+0000","last_peered":"2024-09-19T05:19:14.369658+0000","last_clean":"2024-09-19T05:19:14.369658+0000","last_became_active":"2024-09-19T05:17:49.506331+0000","last_became_peered":"2024-09-19T05:17:49.506331+0000","last_unstale":"2024-09-19T05:19:14.369658+0000","last_undegraded":"2024-09-19T05:19:14.369658+0000","last_fullsized":"2024-09-19T05:19:14.369658+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:23.460781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.369954+0000","last_change":"2024-09-19T05:17:49.506866+0000","last_active":"2024-09-19T05:19:14.369954+0000","last_peered":"2024-09-19T05:19:14.369954+0000","last_clean":"2024-09-19T05:19:14.369954+0000","last_became_active":"2024-09-19T05:17:49.506386+0000","last_became_peered":"2024-09-19T05:17:49.506386+0000","last_unstale":"2024-09-19T05:19:14.369954+0000","last_undegraded":"2024-09-19T05:19:14.369954+0000","last_fullsized":"2024-09-19T05:19:14.369954+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:17.060301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.370952+0000","last_change":"2024-09-19T05:17:30.210132+0000","last_active":"2024-09-19T05:19:14.370952+0000","last_peered":"2024-09-19T05:19:14.370952+0000","last_clean":"2024-09-19T05:19:14.370952+0000","last_became_active":"2024-09-19T05:17:30.209240+0000","last_became_peered":"2024-09-19T05:17:30.209240+0000","last_unstale":"2024-09-19T05:19:14.370952+0000","last_undegraded":"2024-09-19T05:19:14.370952+0000","last_fullsized":"2024-09-19T05:19:14.370952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:08:26.999751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.373235+0000","last_change":"2024-09-19T05:17:49.259291+0000","last_active":"2024-09-19T05:19:14.373235+0000","last_peered":"2024-09-19T05:19:14.373235+0000","last_clean":"2024-09-19T05:19:14.373235+0000","last_became_active":"2024-09-19T05:17:49.258948+0000","last_became_peered":"2024-09-19T05:17:49.258948+0000","last_unstale":"2024-09-19T05:19:14.373235+0000","last_undegraded":"2024-09-19T05:19:14.373235+0000","last_fullsized":"2024-09-19T05:19:14.373235+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:51.082539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,11],"acting":[9,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.366652+0000","last_change":"2024-09-19T05:17:30.205429+0000","last_active":"2024-09-19T05:19:14.366652+0000","last_peered":"2024-09-19T05:19:14.366652+0000","last_clean":"2024-09-19T05:19:14.366652+0000","last_became_active":"2024-09-19T05:17:30.205094+0000","last_became_peered":"2024-09-19T05:17:30.205094+0000","last_unstale":"2024-09-19T05:19:14.366652+0000","last_undegraded":"2024-09-19T05:19:14.366652+0000","last_fullsized":"2024-09-19T05:19:14.366652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:22.149473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.366517+0000","last_change":"2024-09-19T05:17:30.213050+0000","last_active":"2024-09-19T05:19:14.366517+0000","last_peered":"2024-09-19T05:19:14.366517+0000","last_clean":"2024-09-19T05:19:14.366517+0000","last_became_active":"2024-09-19T05:17:30.211812+0000","last_became_peered":"2024-09-19T05:17:30.211812+0000","last_unstale":"2024-09-19T05:19:14.366517+0000","last_undegraded":"2024-09-19T05:19:14.366517+0000","last_fullsized":"2024-09-19T05:19:14.366517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:31.734317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.363598+0000","last_change":"2024-09-19T05:17:30.212049+0000","last_active":"2024-09-19T05:19:14.363598+0000","last_peered":"2024-09-19T05:19:14.363598+0000","last_clean":"2024-09-19T05:19:14.363598+0000","last_became_active":"2024-09-19T05:17:30.211684+0000","last_became_peered":"2024-09-19T05:17:30.211684+0000","last_unstale":"2024-09-19T05:19:14.363598+0000","last_undegraded":"2024-09-19T05:19:14.363598+0000","last_fullsized":"2024-09-19T05:19:14.363598+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:24.781815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.370902+0000","last_change":"2024-09-19T05:17:30.191898+0000","last_active":"2024-09-19T05:19:14.370902+0000","last_peered":"2024-09-19T05:19:14.370902+0000","last_clean":"2024-09-19T05:19:14.370902+0000","last_became_active":"2024-09-19T05:17:30.191204+0000","last_became_peered":"2024-09-19T05:17:30.191204+0000","last_unstale":"2024-09-19T05:19:14.370902+0000","last_undegraded":"2024-09-19T05:19:14.370902+0000","last_fullsized":"2024-09-19T05:19:14.370902+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:19.043363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.380427+0000","last_change":"2024-09-19T05:17:30.201754+0000","last_active":"2024-09-19T05:19:14.380427+0000","last_peered":"2024-09-19T05:19:14.380427+0000","last_clean":"2024-09-19T05:19:14.380427+0000","last_became_active":"2024-09-19T05:17:30.201439+0000","last_became_peered":"2024-09-19T05:17:30.201439+0000","last_unstale":"2024-09-19T05:19:14.380427+0000","last_undegraded":"2024-09-19T05:19:14.380427+0000","last_fullsized":"2024-09-19T05:19:14.380427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:28.896899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.380449+0000","last_change":"2024-09-19T05:17:30.202618+0000","last_active":"2024-09-19T05:19:14.380449+0000","last_peered":"2024-09-19T05:19:14.380449+0000","last_clean":"2024-09-19T05:19:14.380449+0000","last_became_active":"2024-09-19T05:17:30.202292+0000","last_became_peered":"2024-09-19T05:17:30.202292+0000","last_unstale":"2024-09-19T05:19:14.380449+0000","last_undegraded":"2024-09-19T05:19:14.380449+0000","last_fullsized":"2024-09-19T05:19:14.380449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:54.206467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.379528+0000","last_change":"2024-09-19T05:17:30.209411+0000","last_active":"2024-09-19T05:19:14.379528+0000","last_peered":"2024-09-19T05:19:14.379528+0000","last_clean":"2024-09-19T05:19:14.379528+0000","last_became_active":"2024-09-19T05:17:30.208525+0000","last_became_peered":"2024-09-19T05:17:30.208525+0000","last_unstale":"2024-09-19T05:19:14.379528+0000","last_undegraded":"2024-09-19T05:19:14.379528+0000","last_fullsized":"2024-09-19T05:19:14.379528+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:12:16.616413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.372583+0000","last_change":"2024-09-19T05:17:30.203552+0000","last_active":"2024-09-19T05:19:14.372583+0000","last_peered":"2024-09-19T05:19:14.372583+0000","last_clean":"2024-09-19T05:19:14.372583+0000","last_became_active":"2024-09-19T05:17:30.203212+0000","last_became_peered":"2024-09-19T05:17:30.203212+0000","last_unstale":"2024-09-19T05:19:14.372583+0000","last_undegraded":"2024-09-19T05:19:14.372583+0000","last_fullsized":"2024-09-19T05:19:14.372583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:38:50.948373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.373959+0000","last_change":"2024-09-19T05:17:30.201540+0000","last_active":"2024-09-19T05:19:14.373959+0000","last_peered":"2024-09-19T05:19:14.373959+0000","last_clean":"2024-09-19T05:19:14.373959+0000","last_became_active":"2024-09-19T05:17:30.201222+0000","last_became_peered":"2024-09-19T05:17:30.201222+0000","last_unstale":"2024-09-19T05:19:14.373959+0000","last_undegraded":"2024-09-19T05:19:14.373959+0000","last_fullsized":"2024-09-19T05:19:14.373959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:09.583473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.371510+0000","last_change":"2024-09-19T05:17:30.205962+0000","last_active":"2024-09-19T05:19:14.371510+0000","last_peered":"2024-09-19T05:19:14.371510+0000","last_clean":"2024-09-19T05:19:14.371510+0000","last_became_active":"2024-09-19T05:17:30.205632+0000","last_became_peered":"2024-09-19T05:17:30.205632+0000","last_unstale":"2024-09-19T05:19:14.371510+0000","last_undegraded":"2024-09-19T05:19:14.371510+0000","last_fullsized":"2024-09-19T05:19:14.371510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:07.767502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.368765+0000","last_change":"2024-09-19T05:17:30.208546+0000","last_active":"2024-09-19T05:19:14.368765+0000","last_peered":"2024-09-19T05:19:14.368765+0000","last_clean":"2024-09-19T05:19:14.368765+0000","last_became_active":"2024-09-19T05:17:30.208220+0000","last_became_peered":"2024-09-19T05:17:30.208220+0000","last_unstale":"2024-09-19T05:19:14.368765+0000","last_undegraded":"2024-09-19T05:19:14.368765+0000","last_fullsized":"2024-09-19T05:19:14.368765+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:46:32.360282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.381277+0000","last_change":"2024-09-19T05:17:30.204653+0000","last_active":"2024-09-19T05:19:14.381277+0000","last_peered":"2024-09-19T05:19:14.381277+0000","last_clean":"2024-09-19T05:19:14.381277+0000","last_became_active":"2024-09-19T05:17:30.204335+0000","last_became_peered":"2024-09-19T05:17:30.204335+0000","last_unstale":"2024-09-19T05:19:14.381277+0000","last_undegraded":"2024-09-19T05:19:14.381277+0000","last_fullsized":"2024-09-19T05:19:14.381277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:48.661902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.369702+0000","last_change":"2024-09-19T05:17:49.261216+0000","last_active":"2024-09-19T05:19:14.369702+0000","last_peered":"2024-09-19T05:19:14.369702+0000","last_clean":"2024-09-19T05:19:14.369702+0000","last_became_active":"2024-09-19T05:17:49.260691+0000","last_became_peered":"2024-09-19T05:17:49.260691+0000","last_unstale":"2024-09-19T05:19:14.369702+0000","last_undegraded":"2024-09-19T05:19:14.369702+0000","last_fullsized":"2024-09-19T05:19:14.369702+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:35.937669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,6],"acting":[1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.369686+0000","last_change":"2024-09-19T05:17:30.201935+0000","last_active":"2024-09-19T05:19:14.369686+0000","last_peered":"2024-09-19T05:19:14.369686+0000","last_clean":"2024-09-19T05:19:14.369686+0000","last_became_active":"2024-09-19T05:17:30.201524+0000","last_became_peered":"2024-09-19T05:17:30.201524+0000","last_unstale":"2024-09-19T05:19:14.369686+0000","last_undegraded":"2024-09-19T05:19:14.369686+0000","last_fullsized":"2024-09-19T05:19:14.369686+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:34.018339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.368920+0000","last_change":"2024-09-19T05:17:49.506519+0000","last_active":"2024-09-19T05:19:14.368920+0000","last_peered":"2024-09-19T05:19:14.368920+0000","last_clean":"2024-09-19T05:19:14.368920+0000","last_became_active":"2024-09-19T05:17:49.506016+0000","last_became_peered":"2024-09-19T05:17:49.506016+0000","last_unstale":"2024-09-19T05:19:14.368920+0000","last_undegraded":"2024-09-19T05:19:14.368920+0000","last_fullsized":"2024-09-19T05:19:14.368920+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:31.064318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,8],"acting":[5,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.367932+0000","last_change":"2024-09-19T05:17:30.205459+0000","last_active":"2024-09-19T05:19:14.367932+0000","last_peered":"2024-09-19T05:19:14.367932+0000","last_clean":"2024-09-19T05:19:14.367932+0000","last_became_active":"2024-09-19T05:17:30.205100+0000","last_became_peered":"2024-09-19T05:17:30.205100+0000","last_unstale":"2024-09-19T05:19:14.367932+0000","last_undegraded":"2024-09-19T05:19:14.367932+0000","last_fullsized":"2024-09-19T05:19:14.367932+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:35.246931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.363472+0000","last_change":"2024-09-19T05:17:30.202812+0000","last_active":"2024-09-19T05:19:14.363472+0000","last_peered":"2024-09-19T05:19:14.363472+0000","last_clean":"2024-09-19T05:19:14.363472+0000","last_became_active":"2024-09-19T05:17:30.202477+0000","last_became_peered":"2024-09-19T05:17:30.202477+0000","last_unstale":"2024-09-19T05:19:14.363472+0000","last_undegraded":"2024-09-19T05:19:14.363472+0000","last_fullsized":"2024-09-19T05:19:14.363472+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:24.253576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.368403+0000","last_change":"2024-09-19T05:17:30.206546+0000","last_active":"2024-09-19T05:19:14.368403+0000","last_peered":"2024-09-19T05:19:14.368403+0000","last_clean":"2024-09-19T05:19:14.368403+0000","last_became_active":"2024-09-19T05:17:30.206186+0000","last_became_peered":"2024-09-19T05:17:30.206186+0000","last_unstale":"2024-09-19T05:19:14.368403+0000","last_undegraded":"2024-09-19T05:19:14.368403+0000","last_fullsized":"2024-09-19T05:19:14.368403+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:30.589196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.380979+0000","last_change":"2024-09-19T05:17:30.213894+0000","last_active":"2024-09-19T05:19:14.380979+0000","last_peered":"2024-09-19T05:19:14.380979+0000","last_clean":"2024-09-19T05:19:14.380979+0000","last_became_active":"2024-09-19T05:17:30.213586+0000","last_became_peered":"2024-09-19T05:17:30.213586+0000","last_unstale":"2024-09-19T05:19:14.380979+0000","last_undegraded":"2024-09-19T05:19:14.380979+0000","last_fullsized":"2024-09-19T05:19:14.380979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:46.215816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.378292+0000","last_change":"2024-09-19T05:17:49.262965+0000","last_active":"2024-09-19T05:19:14.378292+0000","last_peered":"2024-09-19T05:19:14.378292+0000","last_clean":"2024-09-19T05:19:14.378292+0000","last_became_active":"2024-09-19T05:17:49.262651+0000","last_became_peered":"2024-09-19T05:17:49.262651+0000","last_unstale":"2024-09-19T05:19:14.378292+0000","last_undegraded":"2024-09-19T05:19:14.378292+0000","last_fullsized":"2024-09-19T05:19:14.378292+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:57.601031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.370960+0000","last_change":"2024-09-19T05:17:30.204302+0000","last_active":"2024-09-19T05:19:14.370960+0000","last_peered":"2024-09-19T05:19:14.370960+0000","last_clean":"2024-09-19T05:19:14.370960+0000","last_became_active":"2024-09-19T05:17:30.203981+0000","last_became_peered":"2024-09-19T05:17:30.203981+0000","last_unstale":"2024-09-19T05:19:14.370960+0000","last_undegraded":"2024-09-19T05:19:14.370960+0000","last_fullsized":"2024-09-19T05:19:14.370960+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:59.130439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.362907+0000","last_change":"2024-09-19T05:17:30.210610+0000","last_active":"2024-09-19T05:19:14.362907+0000","last_peered":"2024-09-19T05:19:14.362907+0000","last_clean":"2024-09-19T05:19:14.362907+0000","last_became_active":"2024-09-19T05:17:30.210231+0000","last_became_peered":"2024-09-19T05:17:30.210231+0000","last_unstale":"2024-09-19T05:19:14.362907+0000","last_undegraded":"2024-09-19T05:19:14.362907+0000","last_fullsized":"2024-09-19T05:19:14.362907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:37:41.885822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.367323+0000","last_change":"2024-09-19T05:17:30.210755+0000","last_active":"2024-09-19T05:19:14.367323+0000","last_peered":"2024-09-19T05:19:14.367323+0000","last_clean":"2024-09-19T05:19:14.367323+0000","last_became_active":"2024-09-19T05:17:30.210383+0000","last_became_peered":"2024-09-19T05:17:30.210383+0000","last_unstale":"2024-09-19T05:19:14.367323+0000","last_undegraded":"2024-09-19T05:19:14.367323+0000","last_fullsized":"2024-09-19T05:19:14.367323+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:11.259830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.366895+0000","last_change":"2024-09-19T05:17:30.206345+0000","last_active":"2024-09-19T05:19:14.366895+0000","last_peered":"2024-09-19T05:19:14.366895+0000","last_clean":"2024-09-19T05:19:14.366895+0000","last_became_active":"2024-09-19T05:17:30.205988+0000","last_became_peered":"2024-09-19T05:17:30.205988+0000","last_unstale":"2024-09-19T05:19:14.366895+0000","last_undegraded":"2024-09-19T05:19:14.366895+0000","last_fullsized":"2024-09-19T05:19:14.366895+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:57.538280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"85'8","reported_seq":134,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.567917+0000","last_change":"2024-09-19T05:17:28.183851+0000","last_active":"2024-09-19T05:19:14.567917+0000","last_peered":"2024-09-19T05:19:14.567917+0000","last_clean":"2024-09-19T05:19:14.567917+0000","last_became_active":"2024-09-19T05:17:28.183472+0000","last_became_peered":"2024-09-19T05:17:28.183472+0000","last_unstale":"2024-09-19T05:19:14.567917+0000","last_undegraded":"2024-09-19T05:19:14.567917+0000","last_fullsized":"2024-09-19T05:19:14.567917+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:22.942306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1903,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":3,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.361590+0000","last_change":"2024-09-19T05:17:30.208784+0000","last_active":"2024-09-19T05:19:14.361590+0000","last_peered":"2024-09-19T05:19:14.361590+0000","last_clean":"2024-09-19T05:19:14.361590+0000","last_became_active":"2024-09-19T05:17:30.208232+0000","last_became_peered":"2024-09-19T05:17:30.208232+0000","last_unstale":"2024-09-19T05:19:14.361590+0000","last_undegraded":"2024-09-19T05:19:14.361590+0000","last_fullsized":"2024-09-19T05:19:14.361590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:07.670401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.328791+0000","last_change":"2024-09-19T05:17:28.181480+0000","last_active":"2024-09-19T05:19:14.328791+0000","last_peered":"2024-09-19T05:19:14.328791+0000","last_clean":"2024-09-19T05:19:14.328791+0000","last_became_active":"2024-09-19T05:17:28.181169+0000","last_became_peered":"2024-09-19T05:17:28.181169+0000","last_unstale":"2024-09-19T05:19:14.328791+0000","last_undegraded":"2024-09-19T05:19:14.328791+0000","last_fullsized":"2024-09-19T05:19:14.328791+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:09.590408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.319464+0000","last_change":"2024-09-19T05:17:28.180636+0000","last_active":"2024-09-19T05:19:14.319464+0000","last_peered":"2024-09-19T05:19:14.319464+0000","last_clean":"2024-09-19T05:19:14.319464+0000","last_became_active":"2024-09-19T05:17:28.180298+0000","last_became_peered":"2024-09-19T05:17:28.180298+0000","last_unstale":"2024-09-19T05:19:14.319464+0000","last_undegraded":"2024-09-19T05:19:14.319464+0000","last_fullsized":"2024-09-19T05:19:14.319464+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:06.361677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.373807+0000","last_change":"2024-09-19T05:17:30.199091+0000","last_active":"2024-09-19T05:19:14.373807+0000","last_peered":"2024-09-19T05:19:14.373807+0000","last_clean":"2024-09-19T05:19:14.373807+0000","last_became_active":"2024-09-19T05:17:30.198805+0000","last_became_peered":"2024-09-19T05:17:30.198805+0000","last_unstale":"2024-09-19T05:19:14.373807+0000","last_undegraded":"2024-09-19T05:19:14.373807+0000","last_fullsized":"2024-09-19T05:19:14.373807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:27.906713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.324437+0000","last_change":"2024-09-19T05:17:28.182281+0000","last_active":"2024-09-19T05:19:14.324437+0000","last_peered":"2024-09-19T05:19:14.324437+0000","last_clean":"2024-09-19T05:19:14.324437+0000","last_became_active":"2024-09-19T05:17:28.181939+0000","last_became_peered":"2024-09-19T05:17:28.181939+0000","last_unstale":"2024-09-19T05:19:14.324437+0000","last_undegraded":"2024-09-19T05:19:14.324437+0000","last_fullsized":"2024-09-19T05:19:14.324437+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:12.057601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.378802+0000","last_change":"2024-09-19T05:17:30.198849+0000","last_active":"2024-09-19T05:19:14.378802+0000","last_peered":"2024-09-19T05:19:14.378802+0000","last_clean":"2024-09-19T05:19:14.378802+0000","last_became_active":"2024-09-19T05:17:30.198473+0000","last_became_peered":"2024-09-19T05:17:30.198473+0000","last_unstale":"2024-09-19T05:19:14.378802+0000","last_undegraded":"2024-09-19T05:19:14.378802+0000","last_fullsized":"2024-09-19T05:19:14.378802+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:20.591516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":127,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.329041+0000","last_change":"2024-09-19T05:17:28.181393+0000","last_active":"2024-09-19T05:19:14.329041+0000","last_peered":"2024-09-19T05:19:14.329041+0000","last_clean":"2024-09-19T05:19:14.329041+0000","last_became_active":"2024-09-19T05:17:28.181069+0000","last_became_peered":"2024-09-19T05:17:28.181069+0000","last_unstale":"2024-09-19T05:19:14.329041+0000","last_undegraded":"2024-09-19T05:19:14.329041+0000","last_fullsized":"2024-09-19T05:19:14.329041+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:15.684564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.367286+0000","last_change":"2024-09-19T05:17:30.204968+0000","last_active":"2024-09-19T05:19:14.367286+0000","last_peered":"2024-09-19T05:19:14.367286+0000","last_clean":"2024-09-19T05:19:14.367286+0000","last_became_active":"2024-09-19T05:17:30.204613+0000","last_became_peered":"2024-09-19T05:17:30.204613+0000","last_unstale":"2024-09-19T05:19:14.367286+0000","last_undegraded":"2024-09-19T05:19:14.367286+0000","last_fullsized":"2024-09-19T05:19:14.367286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:14.836220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.334835+0000","last_change":"2024-09-19T05:17:28.185554+0000","last_active":"2024-09-19T05:19:14.334835+0000","last_peered":"2024-09-19T05:19:14.334835+0000","last_clean":"2024-09-19T05:19:14.334835+0000","last_became_active":"2024-09-19T05:17:28.185198+0000","last_became_peered":"2024-09-19T05:17:28.185198+0000","last_unstale":"2024-09-19T05:19:14.334835+0000","last_undegraded":"2024-09-19T05:19:14.334835+0000","last_fullsized":"2024-09-19T05:19:14.334835+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:59.753359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.381217+0000","last_change":"2024-09-19T05:17:30.207418+0000","last_active":"2024-09-19T05:19:14.381217+0000","last_peered":"2024-09-19T05:19:14.381217+0000","last_clean":"2024-09-19T05:19:14.381217+0000","last_became_active":"2024-09-19T05:17:30.207079+0000","last_became_peered":"2024-09-19T05:17:30.207079+0000","last_unstale":"2024-09-19T05:19:14.381217+0000","last_undegraded":"2024-09-19T05:19:14.381217+0000","last_fullsized":"2024-09-19T05:19:14.381217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:40:49.564649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.324446+0000","last_change":"2024-09-19T05:17:28.204988+0000","last_active":"2024-09-19T05:19:14.324446+0000","last_peered":"2024-09-19T05:19:14.324446+0000","last_clean":"2024-09-19T05:19:14.324446+0000","last_became_active":"2024-09-19T05:17:28.204607+0000","last_became_peered":"2024-09-19T05:17:28.204607+0000","last_unstale":"2024-09-19T05:19:14.324446+0000","last_undegraded":"2024-09-19T05:19:14.324446+0000","last_fullsized":"2024-09-19T05:19:14.324446+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:17.914720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.360899+0000","last_change":"2024-09-19T05:17:30.207876+0000","last_active":"2024-09-19T05:19:14.360899+0000","last_peered":"2024-09-19T05:19:14.360899+0000","last_clean":"2024-09-19T05:19:14.360899+0000","last_became_active":"2024-09-19T05:17:30.207561+0000","last_became_peered":"2024-09-19T05:17:30.207561+0000","last_unstale":"2024-09-19T05:19:14.360899+0000","last_undegraded":"2024-09-19T05:19:14.360899+0000","last_fullsized":"2024-09-19T05:19:14.360899+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:26.696949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'35","reported_seq":263,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.565678+0000","last_change":"2024-09-19T05:17:28.185152+0000","last_active":"2024-09-19T05:19:14.565678+0000","last_peered":"2024-09-19T05:19:14.565678+0000","last_clean":"2024-09-19T05:19:14.565678+0000","last_became_active":"2024-09-19T05:17:28.184792+0000","last_became_peered":"2024-09-19T05:17:28.184792+0000","last_unstale":"2024-09-19T05:19:14.565678+0000","last_undegraded":"2024-09-19T05:19:14.565678+0000","last_fullsized":"2024-09-19T05:19:14.565678+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:04.647138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62697,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":200,"num_read_kb":159,"num_write":36,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.366762+0000","last_change":"2024-09-19T05:17:30.209768+0000","last_active":"2024-09-19T05:19:14.366762+0000","last_peered":"2024-09-19T05:19:14.366762+0000","last_clean":"2024-09-19T05:19:14.366762+0000","last_became_active":"2024-09-19T05:17:30.209399+0000","last_became_peered":"2024-09-19T05:17:30.209399+0000","last_unstale":"2024-09-19T05:19:14.366762+0000","last_undegraded":"2024-09-19T05:19:14.366762+0000","last_fullsized":"2024-09-19T05:19:14.366762+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:58.664138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.336911+0000","last_change":"2024-09-19T05:17:49.269241+0000","last_active":"2024-09-19T05:19:14.336911+0000","last_peered":"2024-09-19T05:19:14.336911+0000","last_clean":"2024-09-19T05:19:14.336911+0000","last_became_active":"2024-09-19T05:17:49.259494+0000","last_became_peered":"2024-09-19T05:17:49.259494+0000","last_unstale":"2024-09-19T05:19:14.336911+0000","last_undegraded":"2024-09-19T05:19:14.336911+0000","last_fullsized":"2024-09-19T05:19:14.336911+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:59.866742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.371429+0000","last_change":"2024-09-19T05:17:30.204554+0000","last_active":"2024-09-19T05:19:14.371429+0000","last_peered":"2024-09-19T05:19:14.371429+0000","last_clean":"2024-09-19T05:19:14.371429+0000","last_became_active":"2024-09-19T05:17:30.203166+0000","last_became_peered":"2024-09-19T05:17:30.203166+0000","last_unstale":"2024-09-19T05:19:14.371429+0000","last_undegraded":"2024-09-19T05:19:14.371429+0000","last_fullsized":"2024-09-19T05:19:14.371429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:23.517869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.324236+0000","last_change":"2024-09-19T05:17:28.183800+0000","last_active":"2024-09-19T05:19:14.324236+0000","last_peered":"2024-09-19T05:19:14.324236+0000","last_clean":"2024-09-19T05:19:14.324236+0000","last_became_active":"2024-09-19T05:17:28.182819+0000","last_became_peered":"2024-09-19T05:17:28.182819+0000","last_unstale":"2024-09-19T05:19:14.324236+0000","last_undegraded":"2024-09-19T05:19:14.324236+0000","last_fullsized":"2024-09-19T05:19:14.324236+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:44:52.215544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.371794+0000","last_change":"2024-09-19T05:17:30.214723+0000","last_active":"2024-09-19T05:19:14.371794+0000","last_peered":"2024-09-19T05:19:14.371794+0000","last_clean":"2024-09-19T05:19:14.371794+0000","last_became_active":"2024-09-19T05:17:30.214343+0000","last_became_peered":"2024-09-19T05:17:30.214343+0000","last_unstale":"2024-09-19T05:19:14.371794+0000","last_undegraded":"2024-09-19T05:19:14.371794+0000","last_fullsized":"2024-09-19T05:19:14.371794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:13.008151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":131,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.397070+0000","last_change":"2024-09-19T05:17:28.183130+0000","last_active":"2024-09-19T05:19:14.397070+0000","last_peered":"2024-09-19T05:19:14.397070+0000","last_clean":"2024-09-19T05:19:14.397070+0000","last_became_active":"2024-09-19T05:17:28.182834+0000","last_became_peered":"2024-09-19T05:17:28.182834+0000","last_unstale":"2024-09-19T05:19:14.397070+0000","last_undegraded":"2024-09-19T05:19:14.397070+0000","last_fullsized":"2024-09-19T05:19:14.397070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:48.683776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1476,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":4,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.358821+0000","last_change":"2024-09-19T05:17:30.212438+0000","last_active":"2024-09-19T05:19:14.358821+0000","last_peered":"2024-09-19T05:19:14.358821+0000","last_clean":"2024-09-19T05:19:14.358821+0000","last_became_active":"2024-09-19T05:17:30.209321+0000","last_became_peered":"2024-09-19T05:17:30.209321+0000","last_unstale":"2024-09-19T05:19:14.358821+0000","last_undegraded":"2024-09-19T05:19:14.358821+0000","last_fullsized":"2024-09-19T05:19:14.358821+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:42.772116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.341323+0000","last_change":"2024-09-19T05:17:28.204665+0000","last_active":"2024-09-19T05:19:14.341323+0000","last_peered":"2024-09-19T05:19:14.341323+0000","last_clean":"2024-09-19T05:19:14.341323+0000","last_became_active":"2024-09-19T05:17:28.204309+0000","last_became_peered":"2024-09-19T05:17:28.204309+0000","last_unstale":"2024-09-19T05:19:14.341323+0000","last_undegraded":"2024-09-19T05:19:14.341323+0000","last_fullsized":"2024-09-19T05:19:14.341323+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:26.372762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.357482+0000","last_change":"2024-09-19T05:17:30.208518+0000","last_active":"2024-09-19T05:19:14.357482+0000","last_peered":"2024-09-19T05:19:14.357482+0000","last_clean":"2024-09-19T05:19:14.357482+0000","last_became_active":"2024-09-19T05:17:30.208172+0000","last_became_peered":"2024-09-19T05:17:30.208172+0000","last_unstale":"2024-09-19T05:19:14.357482+0000","last_undegraded":"2024-09-19T05:19:14.357482+0000","last_fullsized":"2024-09-19T05:19:14.357482+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:40:25.754925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.339207+0000","last_change":"2024-09-19T05:18:50.249627+0000","last_active":"2024-09-19T05:19:14.339207+0000","last_peered":"2024-09-19T05:19:14.339207+0000","last_clean":"2024-09-19T05:19:14.339207+0000","last_became_active":"2024-09-19T05:18:50.245759+0000","last_became_peered":"2024-09-19T05:18:50.245759+0000","last_unstale":"2024-09-19T05:19:14.339207+0000","last_undegraded":"2024-09-19T05:19:14.339207+0000","last_fullsized":"2024-09-19T05:19:14.339207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:45:59.039812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.364525+0000","last_change":"2024-09-19T05:17:30.207002+0000","last_active":"2024-09-19T05:19:14.364525+0000","last_peered":"2024-09-19T05:19:14.364525+0000","last_clean":"2024-09-19T05:19:14.364525+0000","last_became_active":"2024-09-19T05:17:30.205750+0000","last_became_peered":"2024-09-19T05:17:30.205750+0000","last_unstale":"2024-09-19T05:19:14.364525+0000","last_undegraded":"2024-09-19T05:19:14.364525+0000","last_fullsized":"2024-09-19T05:19:14.364525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:25:18.716206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.319837+0000","last_change":"2024-09-19T05:17:28.184071+0000","last_active":"2024-09-19T05:19:14.319837+0000","last_peered":"2024-09-19T05:19:14.319837+0000","last_clean":"2024-09-19T05:19:14.319837+0000","last_became_active":"2024-09-19T05:17:28.183708+0000","last_became_peered":"2024-09-19T05:17:28.183708+0000","last_unstale":"2024-09-19T05:19:14.319837+0000","last_undegraded":"2024-09-19T05:19:14.319837+0000","last_fullsized":"2024-09-19T05:19:14.319837+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:57:23.831000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.366633+0000","last_change":"2024-09-19T05:17:30.211919+0000","last_active":"2024-09-19T05:19:14.366633+0000","last_peered":"2024-09-19T05:19:14.366633+0000","last_clean":"2024-09-19T05:19:14.366633+0000","last_became_active":"2024-09-19T05:17:30.210639+0000","last_became_peered":"2024-09-19T05:17:30.210639+0000","last_unstale":"2024-09-19T05:19:14.366633+0000","last_undegraded":"2024-09-19T05:19:14.366633+0000","last_fullsized":"2024-09-19T05:19:14.366633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:25.231732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'39","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.533319+0000","last_change":"2024-09-19T05:17:28.179372+0000","last_active":"2024-09-19T05:19:14.533319+0000","last_peered":"2024-09-19T05:19:14.533319+0000","last_clean":"2024-09-19T05:19:14.533319+0000","last_became_active":"2024-09-19T05:17:28.178792+0000","last_became_peered":"2024-09-19T05:17:28.178792+0000","last_unstale":"2024-09-19T05:19:14.533319+0000","last_undegraded":"2024-09-19T05:19:14.533319+0000","last_fullsized":"2024-09-19T05:19:14.533319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:54.705552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.358807+0000","last_change":"2024-09-19T05:17:30.208201+0000","last_active":"2024-09-19T05:19:14.358807+0000","last_peered":"2024-09-19T05:19:14.358807+0000","last_clean":"2024-09-19T05:19:14.358807+0000","last_became_active":"2024-09-19T05:17:30.207865+0000","last_became_peered":"2024-09-19T05:17:30.207865+0000","last_unstale":"2024-09-19T05:19:14.358807+0000","last_undegraded":"2024-09-19T05:19:14.358807+0000","last_fullsized":"2024-09-19T05:19:14.358807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:35.954759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.331163+0000","last_change":"2024-09-19T05:17:28.543685+0000","last_active":"2024-09-19T05:19:14.331163+0000","last_peered":"2024-09-19T05:19:14.331163+0000","last_clean":"2024-09-19T05:19:14.331163+0000","last_became_active":"2024-09-19T05:17:28.543292+0000","last_became_peered":"2024-09-19T05:17:28.543292+0000","last_unstale":"2024-09-19T05:19:14.331163+0000","last_undegraded":"2024-09-19T05:19:14.331163+0000","last_fullsized":"2024-09-19T05:19:14.331163+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:55:14.348544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.362322+0000","last_change":"2024-09-19T05:17:30.212449+0000","last_active":"2024-09-19T05:19:14.362322+0000","last_peered":"2024-09-19T05:19:14.362322+0000","last_clean":"2024-09-19T05:19:14.362322+0000","last_became_active":"2024-09-19T05:17:30.211265+0000","last_became_peered":"2024-09-19T05:17:30.211265+0000","last_unstale":"2024-09-19T05:19:14.362322+0000","last_undegraded":"2024-09-19T05:19:14.362322+0000","last_fullsized":"2024-09-19T05:19:14.362322+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:27.687687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":353,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.333999+0000","last_change":"2024-09-19T05:16:20.361975+0000","last_active":"2024-09-19T05:19:14.333999+0000","last_peered":"2024-09-19T05:19:14.333999+0000","last_clean":"2024-09-19T05:19:14.333999+0000","last_became_active":"2024-09-19T05:16:20.361553+0000","last_became_peered":"2024-09-19T05:16:20.361553+0000","last_unstale":"2024-09-19T05:19:14.333999+0000","last_undegraded":"2024-09-19T05:19:14.333999+0000","last_fullsized":"2024-09-19T05:19:14.333999+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:13:02.674575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:13:02.674575+0000","last_clean_scrub_stamp":"2024-09-19T05:13:02.674575+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:48.711411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.320831+0000","last_change":"2024-09-19T05:17:28.180486+0000","last_active":"2024-09-19T05:19:14.320831+0000","last_peered":"2024-09-19T05:19:14.320831+0000","last_clean":"2024-09-19T05:19:14.320831+0000","last_became_active":"2024-09-19T05:17:28.180147+0000","last_became_peered":"2024-09-19T05:17:28.180147+0000","last_unstale":"2024-09-19T05:19:14.320831+0000","last_undegraded":"2024-09-19T05:19:14.320831+0000","last_fullsized":"2024-09-19T05:19:14.320831+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:57.820328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.372815+0000","last_change":"2024-09-19T05:17:30.205560+0000","last_active":"2024-09-19T05:19:14.372815+0000","last_peered":"2024-09-19T05:19:14.372815+0000","last_clean":"2024-09-19T05:19:14.372815+0000","last_became_active":"2024-09-19T05:17:30.205269+0000","last_became_peered":"2024-09-19T05:17:30.205269+0000","last_unstale":"2024-09-19T05:19:14.372815+0000","last_undegraded":"2024-09-19T05:19:14.372815+0000","last_fullsized":"2024-09-19T05:19:14.372815+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:22.904616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.333965+0000","last_change":"2024-09-19T05:17:28.181845+0000","last_active":"2024-09-19T05:19:14.333965+0000","last_peered":"2024-09-19T05:19:14.333965+0000","last_clean":"2024-09-19T05:19:14.333965+0000","last_became_active":"2024-09-19T05:17:28.181549+0000","last_became_peered":"2024-09-19T05:17:28.181549+0000","last_unstale":"2024-09-19T05:19:14.333965+0000","last_undegraded":"2024-09-19T05:19:14.333965+0000","last_fullsized":"2024-09-19T05:19:14.333965+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:01.222364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.364544+0000","last_change":"2024-09-19T05:17:49.259631+0000","last_active":"2024-09-19T05:19:14.364544+0000","last_peered":"2024-09-19T05:19:14.364544+0000","last_clean":"2024-09-19T05:19:14.364544+0000","last_became_active":"2024-09-19T05:17:49.259240+0000","last_became_peered":"2024-09-19T05:17:49.259240+0000","last_unstale":"2024-09-19T05:19:14.364544+0000","last_undegraded":"2024-09-19T05:19:14.364544+0000","last_fullsized":"2024-09-19T05:19:14.364544+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:22.533248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":128,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.380727+0000","last_change":"2024-09-19T05:17:28.204924+0000","last_active":"2024-09-19T05:19:14.380727+0000","last_peered":"2024-09-19T05:19:14.380727+0000","last_clean":"2024-09-19T05:19:14.380727+0000","last_became_active":"2024-09-19T05:17:28.204602+0000","last_became_peered":"2024-09-19T05:17:28.204602+0000","last_unstale":"2024-09-19T05:19:14.380727+0000","last_undegraded":"2024-09-19T05:19:14.380727+0000","last_fullsized":"2024-09-19T05:19:14.380727+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:13.303939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.369736+0000","last_change":"2024-09-19T05:17:49.259147+0000","last_active":"2024-09-19T05:19:14.369736+0000","last_peered":"2024-09-19T05:19:14.369736+0000","last_clean":"2024-09-19T05:19:14.369736+0000","last_became_active":"2024-09-19T05:17:49.258666+0000","last_became_peered":"2024-09-19T05:17:49.258666+0000","last_unstale":"2024-09-19T05:19:14.369736+0000","last_undegraded":"2024-09-19T05:19:14.369736+0000","last_fullsized":"2024-09-19T05:19:14.369736+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:54.802994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.334811+0000","last_change":"2024-09-19T05:17:28.182456+0000","last_active":"2024-09-19T05:19:14.334811+0000","last_peered":"2024-09-19T05:19:14.334811+0000","last_clean":"2024-09-19T05:19:14.334811+0000","last_became_active":"2024-09-19T05:17:28.182075+0000","last_became_peered":"2024-09-19T05:17:28.182075+0000","last_unstale":"2024-09-19T05:19:14.334811+0000","last_undegraded":"2024-09-19T05:19:14.334811+0000","last_fullsized":"2024-09-19T05:19:14.334811+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:42.771641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.370955+0000","last_change":"2024-09-19T05:17:30.204300+0000","last_active":"2024-09-19T05:19:14.370955+0000","last_peered":"2024-09-19T05:19:14.370955+0000","last_clean":"2024-09-19T05:19:14.370955+0000","last_became_active":"2024-09-19T05:17:30.203840+0000","last_became_peered":"2024-09-19T05:17:30.203840+0000","last_unstale":"2024-09-19T05:19:14.370955+0000","last_undegraded":"2024-09-19T05:19:14.370955+0000","last_fullsized":"2024-09-19T05:19:14.370955+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:48.363862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.335586+0000","last_change":"2024-09-19T05:17:28.204474+0000","last_active":"2024-09-19T05:19:14.335586+0000","last_peered":"2024-09-19T05:19:14.335586+0000","last_clean":"2024-09-19T05:19:14.335586+0000","last_became_active":"2024-09-19T05:17:28.204143+0000","last_became_peered":"2024-09-19T05:17:28.204143+0000","last_unstale":"2024-09-19T05:19:14.335586+0000","last_undegraded":"2024-09-19T05:19:14.335586+0000","last_fullsized":"2024-09-19T05:19:14.335586+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:46.647789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'5","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.372421+0000","last_change":"2024-09-19T05:17:30.198791+0000","last_active":"2024-09-19T05:19:14.372421+0000","last_peered":"2024-09-19T05:19:14.372421+0000","last_clean":"2024-09-19T05:19:14.372421+0000","last_became_active":"2024-09-19T05:17:30.198399+0000","last_became_peered":"2024-09-19T05:17:30.198399+0000","last_unstale":"2024-09-19T05:19:14.372421+0000","last_undegraded":"2024-09-19T05:19:14.372421+0000","last_fullsized":"2024-09-19T05:19:14.372421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:46.676625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.341887+0000","last_change":"2024-09-19T05:17:28.204690+0000","last_active":"2024-09-19T05:19:14.341887+0000","last_peered":"2024-09-19T05:19:14.341887+0000","last_clean":"2024-09-19T05:19:14.341887+0000","last_became_active":"2024-09-19T05:17:28.204377+0000","last_became_peered":"2024-09-19T05:17:28.204377+0000","last_unstale":"2024-09-19T05:19:14.341887+0000","last_undegraded":"2024-09-19T05:19:14.341887+0000","last_fullsized":"2024-09-19T05:19:14.341887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:29:20.583163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.366587+0000","last_change":"2024-09-19T05:17:30.200584+0000","last_active":"2024-09-19T05:19:14.366587+0000","last_peered":"2024-09-19T05:19:14.366587+0000","last_clean":"2024-09-19T05:19:14.366587+0000","last_became_active":"2024-09-19T05:17:30.200270+0000","last_became_peered":"2024-09-19T05:17:30.200270+0000","last_unstale":"2024-09-19T05:19:14.366587+0000","last_undegraded":"2024-09-19T05:19:14.366587+0000","last_fullsized":"2024-09-19T05:19:14.366587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:24:43.493332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'47","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.539433+0000","last_change":"2024-09-19T05:17:28.181020+0000","last_active":"2024-09-19T05:19:14.539433+0000","last_peered":"2024-09-19T05:19:14.539433+0000","last_clean":"2024-09-19T05:19:14.539433+0000","last_became_active":"2024-09-19T05:17:28.180298+0000","last_became_peered":"2024-09-19T05:17:28.180298+0000","last_unstale":"2024-09-19T05:19:14.539433+0000","last_undegraded":"2024-09-19T05:19:14.539433+0000","last_fullsized":"2024-09-19T05:19:14.539433+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:32.931699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":84,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.364959+0000","last_change":"2024-09-19T05:17:30.209632+0000","last_active":"2024-09-19T05:19:14.364959+0000","last_peered":"2024-09-19T05:19:14.364959+0000","last_clean":"2024-09-19T05:19:14.364959+0000","last_became_active":"2024-09-19T05:17:30.209334+0000","last_became_peered":"2024-09-19T05:17:30.209334+0000","last_unstale":"2024-09-19T05:19:14.364959+0000","last_undegraded":"2024-09-19T05:19:14.364959+0000","last_fullsized":"2024-09-19T05:19:14.364959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:21.159099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.321036+0000","last_change":"2024-09-19T05:17:28.543802+0000","last_active":"2024-09-19T05:19:14.321036+0000","last_peered":"2024-09-19T05:19:14.321036+0000","last_clean":"2024-09-19T05:19:14.321036+0000","last_became_active":"2024-09-19T05:17:28.543503+0000","last_became_peered":"2024-09-19T05:17:28.543503+0000","last_unstale":"2024-09-19T05:19:14.321036+0000","last_undegraded":"2024-09-19T05:19:14.321036+0000","last_fullsized":"2024-09-19T05:19:14.321036+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:13.764141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.380774+0000","last_change":"2024-09-19T05:17:30.206755+0000","last_active":"2024-09-19T05:19:14.380774+0000","last_peered":"2024-09-19T05:19:14.380774+0000","last_clean":"2024-09-19T05:19:14.380774+0000","last_became_active":"2024-09-19T05:17:30.205757+0000","last_became_peered":"2024-09-19T05:17:30.205757+0000","last_unstale":"2024-09-19T05:19:14.380774+0000","last_undegraded":"2024-09-19T05:19:14.380774+0000","last_fullsized":"2024-09-19T05:19:14.380774+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:16.281294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.330553+0000","last_change":"2024-09-19T05:17:28.204819+0000","last_active":"2024-09-19T05:19:14.330553+0000","last_peered":"2024-09-19T05:19:14.330553+0000","last_clean":"2024-09-19T05:19:14.330553+0000","last_became_active":"2024-09-19T05:17:28.204445+0000","last_became_peered":"2024-09-19T05:17:28.204445+0000","last_unstale":"2024-09-19T05:19:14.330553+0000","last_undegraded":"2024-09-19T05:19:14.330553+0000","last_fullsized":"2024-09-19T05:19:14.330553+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:26.473654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.352435+0000","last_change":"2024-09-19T05:17:30.201331+0000","last_active":"2024-09-19T05:19:14.352435+0000","last_peered":"2024-09-19T05:19:14.352435+0000","last_clean":"2024-09-19T05:19:14.352435+0000","last_became_active":"2024-09-19T05:17:30.200992+0000","last_became_peered":"2024-09-19T05:17:30.200992+0000","last_unstale":"2024-09-19T05:19:14.352435+0000","last_undegraded":"2024-09-19T05:19:14.352435+0000","last_fullsized":"2024-09-19T05:19:14.352435+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:17.033786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.334852+0000","last_change":"2024-09-19T05:17:28.180149+0000","last_active":"2024-09-19T05:19:14.334852+0000","last_peered":"2024-09-19T05:19:14.334852+0000","last_clean":"2024-09-19T05:19:14.334852+0000","last_became_active":"2024-09-19T05:17:28.179767+0000","last_became_peered":"2024-09-19T05:17:28.179767+0000","last_unstale":"2024-09-19T05:19:14.334852+0000","last_undegraded":"2024-09-19T05:19:14.334852+0000","last_fullsized":"2024-09-19T05:19:14.334852+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:25.074252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.370057+0000","last_change":"2024-09-19T05:17:30.204533+0000","last_active":"2024-09-19T05:19:14.370057+0000","last_peered":"2024-09-19T05:19:14.370057+0000","last_clean":"2024-09-19T05:19:14.370057+0000","last_became_active":"2024-09-19T05:17:30.204224+0000","last_became_peered":"2024-09-19T05:17:30.204224+0000","last_unstale":"2024-09-19T05:19:14.370057+0000","last_undegraded":"2024-09-19T05:19:14.370057+0000","last_fullsized":"2024-09-19T05:19:14.370057+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:11.021297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'2","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.331076+0000","last_change":"2024-09-19T05:17:28.187544+0000","last_active":"2024-09-19T05:19:14.331076+0000","last_peered":"2024-09-19T05:19:14.331076+0000","last_clean":"2024-09-19T05:19:14.331076+0000","last_became_active":"2024-09-19T05:17:28.187068+0000","last_became_peered":"2024-09-19T05:17:28.187068+0000","last_unstale":"2024-09-19T05:19:14.331076+0000","last_undegraded":"2024-09-19T05:19:14.331076+0000","last_fullsized":"2024-09-19T05:19:14.331076+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:01.151721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.377889+0000","last_change":"2024-09-19T05:17:30.209549+0000","last_active":"2024-09-19T05:19:14.377889+0000","last_peered":"2024-09-19T05:19:14.377889+0000","last_clean":"2024-09-19T05:19:14.377889+0000","last_became_active":"2024-09-19T05:17:30.209225+0000","last_became_peered":"2024-09-19T05:17:30.209225+0000","last_unstale":"2024-09-19T05:19:14.377889+0000","last_undegraded":"2024-09-19T05:19:14.377889+0000","last_fullsized":"2024-09-19T05:19:14.377889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:38.023351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.341376+0000","last_change":"2024-09-19T05:17:28.186601+0000","last_active":"2024-09-19T05:19:14.341376+0000","last_peered":"2024-09-19T05:19:14.341376+0000","last_clean":"2024-09-19T05:19:14.341376+0000","last_became_active":"2024-09-19T05:17:28.186236+0000","last_became_peered":"2024-09-19T05:17:28.186236+0000","last_unstale":"2024-09-19T05:19:14.341376+0000","last_undegraded":"2024-09-19T05:19:14.341376+0000","last_fullsized":"2024-09-19T05:19:14.341376+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:08.527906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.369719+0000","last_change":"2024-09-19T05:17:30.203633+0000","last_active":"2024-09-19T05:19:14.369719+0000","last_peered":"2024-09-19T05:19:14.369719+0000","last_clean":"2024-09-19T05:19:14.369719+0000","last_became_active":"2024-09-19T05:17:30.203313+0000","last_became_peered":"2024-09-19T05:17:30.203313+0000","last_unstale":"2024-09-19T05:19:14.369719+0000","last_undegraded":"2024-09-19T05:19:14.369719+0000","last_fullsized":"2024-09-19T05:19:14.369719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:40.442434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.375755+0000","last_change":"2024-09-19T05:17:49.260345+0000","last_active":"2024-09-19T05:19:14.375755+0000","last_peered":"2024-09-19T05:19:14.375755+0000","last_clean":"2024-09-19T05:19:14.375755+0000","last_became_active":"2024-09-19T05:17:49.259938+0000","last_became_peered":"2024-09-19T05:17:49.259938+0000","last_unstale":"2024-09-19T05:19:14.375755+0000","last_undegraded":"2024-09-19T05:19:14.375755+0000","last_fullsized":"2024-09-19T05:19:14.375755+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:01.904276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.343919+0000","last_change":"2024-09-19T05:17:28.182014+0000","last_active":"2024-09-19T05:19:14.343919+0000","last_peered":"2024-09-19T05:19:14.343919+0000","last_clean":"2024-09-19T05:19:14.343919+0000","last_became_active":"2024-09-19T05:17:28.181666+0000","last_became_peered":"2024-09-19T05:17:28.181666+0000","last_unstale":"2024-09-19T05:19:14.343919+0000","last_undegraded":"2024-09-19T05:19:14.343919+0000","last_fullsized":"2024-09-19T05:19:14.343919+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:00:57.069618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.369617+0000","last_change":"2024-09-19T05:17:30.206428+0000","last_active":"2024-09-19T05:19:14.369617+0000","last_peered":"2024-09-19T05:19:14.369617+0000","last_clean":"2024-09-19T05:19:14.369617+0000","last_became_active":"2024-09-19T05:17:30.205818+0000","last_became_peered":"2024-09-19T05:17:30.205818+0000","last_unstale":"2024-09-19T05:19:14.369617+0000","last_undegraded":"2024-09-19T05:19:14.369617+0000","last_fullsized":"2024-09-19T05:19:14.369617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:26.059019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.341632+0000","last_change":"2024-09-19T05:17:28.185596+0000","last_active":"2024-09-19T05:19:14.341632+0000","last_peered":"2024-09-19T05:19:14.341632+0000","last_clean":"2024-09-19T05:19:14.341632+0000","last_became_active":"2024-09-19T05:17:28.185278+0000","last_became_peered":"2024-09-19T05:17:28.185278+0000","last_unstale":"2024-09-19T05:19:14.341632+0000","last_undegraded":"2024-09-19T05:19:14.341632+0000","last_fullsized":"2024-09-19T05:19:14.341632+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:40.440874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.379737+0000","last_change":"2024-09-19T05:17:30.200409+0000","last_active":"2024-09-19T05:19:14.379737+0000","last_peered":"2024-09-19T05:19:14.379737+0000","last_clean":"2024-09-19T05:19:14.379737+0000","last_became_active":"2024-09-19T05:17:30.200120+0000","last_became_peered":"2024-09-19T05:17:30.200120+0000","last_unstale":"2024-09-19T05:19:14.379737+0000","last_undegraded":"2024-09-19T05:19:14.379737+0000","last_fullsized":"2024-09-19T05:19:14.379737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:12.396655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.334449+0000","last_change":"2024-09-19T05:17:28.205371+0000","last_active":"2024-09-19T05:19:14.334449+0000","last_peered":"2024-09-19T05:19:14.334449+0000","last_clean":"2024-09-19T05:19:14.334449+0000","last_became_active":"2024-09-19T05:17:28.205026+0000","last_became_peered":"2024-09-19T05:17:28.205026+0000","last_unstale":"2024-09-19T05:19:14.334449+0000","last_undegraded":"2024-09-19T05:19:14.334449+0000","last_fullsized":"2024-09-19T05:19:14.334449+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:59.518580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.370652+0000","last_change":"2024-09-19T05:17:30.206862+0000","last_active":"2024-09-19T05:19:14.370652+0000","last_peered":"2024-09-19T05:19:14.370652+0000","last_clean":"2024-09-19T05:19:14.370652+0000","last_became_active":"2024-09-19T05:17:30.206072+0000","last_became_peered":"2024-09-19T05:17:30.206072+0000","last_unstale":"2024-09-19T05:19:14.370652+0000","last_undegraded":"2024-09-19T05:19:14.370652+0000","last_fullsized":"2024-09-19T05:19:14.370652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:47.810496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.335963+0000","last_change":"2024-09-19T05:17:28.181895+0000","last_active":"2024-09-19T05:19:14.335963+0000","last_peered":"2024-09-19T05:19:14.335963+0000","last_clean":"2024-09-19T05:19:14.335963+0000","last_became_active":"2024-09-19T05:17:28.181499+0000","last_became_peered":"2024-09-19T05:17:28.181499+0000","last_unstale":"2024-09-19T05:19:14.335963+0000","last_undegraded":"2024-09-19T05:19:14.335963+0000","last_fullsized":"2024-09-19T05:19:14.335963+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:29.722921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":593292,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":691,"num_read_kb":447,"num_write":289,"num_write_kb":1429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":56,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2015232,"data_stored":1779876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579938,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":950272,"data_stored":459705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41108,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704044,"statfs":{"total":95995035648,"available":95952941056,"internally_reserved":0,"allocated":1638400,"data_stored":1113460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939692,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36668,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708484,"statfs":{"total":95995035648,"available":95957487616,"internally_reserved":0,"allocated":1351680,"data_stored":853101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168625,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":954368,"data_stored":459783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397557,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28540,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716612,"statfs":{"total":95995035648,"available":95965810688,"internally_reserved":0,"allocated":1552384,"data_stored":1053513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561082,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":946176,"data_stored":459274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790014,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32904,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712248,"statfs":{"total":95995035648,"available":95961341952,"internally_reserved":0,"allocated":1699840,"data_stored":1183909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953540,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":950272,"data_stored":460599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215177,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32640,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712512,"statfs":{"total":95995035648,"available":95961612288,"internally_reserved":0,"allocated":1490944,"data_stored":984401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444110,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1032192,"data_stored":524361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607635,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1011712,"data_stored":521764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":966656,"data_stored":460545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":241664,"data_stored":196763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:19:19.887 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:19:20.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.017+0000 7f5a501b7640 1 -- 172.21.15.120:0/3760654738 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a48101330 msgr2=0x7f5a4810d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:20.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.017+0000 7f5a501b7640 1 --2- 172.21.15.120:0/3760654738 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a48101330 0x7f5a4810d860 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5a40009930 tx=0x7f5a4002a420 comp rx=0 tx=0).stop 2024-09-19T05:19:20.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.017+0000 7f5a501b7640 1 -- 172.21.15.120:0/3760654738 shutdown_connections 2024-09-19T05:19:20.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.017+0000 7f5a501b7640 1 --2- 172.21.15.120:0/3760654738 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a48101330 0x7f5a4810d860 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.017+0000 7f5a501b7640 1 --2- 172.21.15.120:0/3760654738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a48100990 0x7f5a48100df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.017+0000 7f5a501b7640 1 --2- 172.21.15.120:0/3760654738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a481069a0 0x7f5a48106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.017+0000 7f5a501b7640 1 -- 172.21.15.120:0/3760654738 >> 172.21.15.120:0/3760654738 conn(0x7f5a480fc6d0 msgr2=0x7f5a480feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:20.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.017+0000 7f5a501b7640 1 -- 172.21.15.120:0/3760654738 shutdown_connections 2024-09-19T05:19:20.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.017+0000 7f5a501b7640 1 -- 172.21.15.120:0/3760654738 wait complete. 2024-09-19T05:19:20.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.018+0000 7f5a501b7640 1 Processor -- start 2024-09-19T05:19:20.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.018+0000 7f5a501b7640 1 -- start start 2024-09-19T05:19:20.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.018+0000 7f5a501b7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a48100990 0x7f5a481990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:20.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.018+0000 7f5a501b7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a48101330 0x7f5a48199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:20.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.018+0000 7f5a501b7640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a481069a0 0x7f5a481a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:20.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.018+0000 7f5a501b7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5a48110c90 con 0x7f5a48100990 2024-09-19T05:19:20.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.018+0000 7f5a501b7640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5a48110b10 con 0x7f5a481069a0 2024-09-19T05:19:20.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.018+0000 7f5a501b7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5a48110e10 con 0x7f5a48101330 2024-09-19T05:19:20.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.018+0000 7f5a4df53640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a48100990 0x7f5a481990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:20.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.018+0000 7f5a4df53640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a48100990 0x7f5a481990c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48592/0 (socket says 172.21.15.120:48592) 2024-09-19T05:19:20.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.018+0000 7f5a4df53640 1 -- 172.21.15.120:0/2989928079 learned_addr learned my addr 172.21.15.120:0/2989928079 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:20.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.018+0000 7f5a4e754640 1 --2- 172.21.15.120:0/2989928079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a481069a0 0x7f5a481a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:20.024 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.018+0000 7f5a4d752640 1 --2- 172.21.15.120:0/2989928079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a48101330 0x7f5a48199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:20.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.019+0000 7f5a4df53640 1 -- 172.21.15.120:0/2989928079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a48101330 msgr2=0x7f5a48199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:20.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.019+0000 7f5a4df53640 1 --2- 172.21.15.120:0/2989928079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a48101330 0x7f5a48199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.019+0000 7f5a4df53640 1 -- 172.21.15.120:0/2989928079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a481069a0 msgr2=0x7f5a481a4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:20.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.019+0000 7f5a4df53640 1 --2- 172.21.15.120:0/2989928079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a481069a0 0x7f5a481a4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.019+0000 7f5a4df53640 1 -- 172.21.15.120:0/2989928079 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a481a4680 con 0x7f5a48100990 2024-09-19T05:19:20.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.019+0000 7f5a4e754640 1 --2- 172.21.15.120:0/2989928079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a481069a0 0x7f5a481a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:19:20.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.019+0000 7f5a4df53640 1 --2- 172.21.15.120:0/2989928079 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a48100990 0x7f5a481990c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5a4400d950 tx=0x7f5a4400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:20.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.019+0000 7f5a3effd640 1 -- 172.21.15.120:0/2989928079 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a44017070 con 0x7f5a48100990 2024-09-19T05:19:20.025 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.019+0000 7f5a3effd640 1 -- 172.21.15.120:0/2989928079 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5a44009c30 con 0x7f5a48100990 2024-09-19T05:19:20.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.019+0000 7f5a501b7640 1 -- 172.21.15.120:0/2989928079 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a481a4850 con 0x7f5a48100990 2024-09-19T05:19:20.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.019+0000 7f5a3effd640 1 -- 172.21.15.120:0/2989928079 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4400f620 con 0x7f5a48100990 2024-09-19T05:19:20.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.019+0000 7f5a501b7640 1 -- 172.21.15.120:0/2989928079 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a481a4d70 con 0x7f5a48100990 2024-09-19T05:19:20.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.020+0000 7f5a501b7640 1 -- 172.21.15.120:0/2989928079 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a48100df0 con 0x7f5a48100990 2024-09-19T05:19:20.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.021+0000 7f5a3effd640 1 -- 172.21.15.120:0/2989928079 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f5a440109a0 con 0x7f5a48100990 2024-09-19T05:19:20.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.022+0000 7f5a3effd640 1 --2- 172.21.15.120:0/2989928079 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f5a300a3450 0x7f5a300a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:20.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.022+0000 7f5a4d752640 1 --2- 172.21.15.120:0/2989928079 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f5a300a3450 0x7f5a300a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:20.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.022+0000 7f5a3effd640 1 -- 172.21.15.120:0/2989928079 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f5a440cfae0 con 0x7f5a48100990 2024-09-19T05:19:20.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.022+0000 7f5a4d752640 1 --2- 172.21.15.120:0/2989928079 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f5a300a3450 0x7f5a300a5910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5a4806af50 tx=0x7f5a380075b0 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:20.028 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.026+0000 7f5a3effd640 1 -- 172.21.15.120:0/2989928079 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5a44009de0 con 0x7f5a48100990 2024-09-19T05:19:20.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.190+0000 7f5a501b7640 1 -- 172.21.15.120:0/2989928079 --> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5a48062630 con 0x7f5a300a3450 2024-09-19T05:19:20.198 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.196+0000 7f5a3effd640 1 -- 172.21.15.120:0/2989928079 <== mgr.15156 v2:172.21.15.120:6800/1306632207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257851 (secure 0 0 0) 0x7f5a48062630 con 0x7f5a300a3450 2024-09-19T05:19:20.203 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:19:20.205 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-19T05:19:20.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.199+0000 7f5a501b7640 1 -- 172.21.15.120:0/2989928079 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f5a300a3450 msgr2=0x7f5a300a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:20.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.199+0000 7f5a501b7640 1 --2- 172.21.15.120:0/2989928079 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f5a300a3450 0x7f5a300a5910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5a4806af50 tx=0x7f5a380075b0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.199+0000 7f5a501b7640 1 -- 172.21.15.120:0/2989928079 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a48100990 msgr2=0x7f5a481990c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:20.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.199+0000 7f5a501b7640 1 --2- 172.21.15.120:0/2989928079 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a48100990 0x7f5a481990c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5a4400d950 tx=0x7f5a4400de10 comp rx=0 tx=0).stop 2024-09-19T05:19:20.207 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.199+0000 7f5a501b7640 1 -- 172.21.15.120:0/2989928079 shutdown_connections 2024-09-19T05:19:20.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.199+0000 7f5a501b7640 1 --2- 172.21.15.120:0/2989928079 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f5a300a3450 0x7f5a300a5910 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.199+0000 7f5a501b7640 1 --2- 172.21.15.120:0/2989928079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a481069a0 0x7f5a481a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.199+0000 7f5a501b7640 1 --2- 172.21.15.120:0/2989928079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a48101330 0x7f5a48199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.199+0000 7f5a501b7640 1 --2- 172.21.15.120:0/2989928079 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a48100990 0x7f5a481990c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.199+0000 7f5a501b7640 1 -- 172.21.15.120:0/2989928079 >> 172.21.15.120:0/2989928079 conn(0x7f5a480fc6d0 msgr2=0x7f5a480fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:20.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.199+0000 7f5a501b7640 1 -- 172.21.15.120:0/2989928079 shutdown_connections 2024-09-19T05:19:20.208 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.199+0000 7f5a501b7640 1 -- 172.21.15.120:0/2989928079 wait complete. 2024-09-19T05:19:20.212 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-19T05:19:18.331898+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1183894,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":827,"num_read_kb":566,"num_write":472,"num_write_kb":4369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180792,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":865,"ondisk_log_size":865,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":396828,"kb_used_data":14204,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124544996,"statfs":{"total":1151940427776,"available":1151534075904,"internally_reserved":0,"allocated":14544896,"data_stored":8534415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":391492923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.992150"},"pg_stats":[{"pgid":"3.3f","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.370162+0000","last_change":"2024-09-19T05:17:30.200993+0000","last_active":"2024-09-19T05:19:14.370162+0000","last_peered":"2024-09-19T05:19:14.370162+0000","last_clean":"2024-09-19T05:19:14.370162+0000","last_became_active":"2024-09-19T05:17:30.200587+0000","last_became_peered":"2024-09-19T05:17:30.200587+0000","last_unstale":"2024-09-19T05:19:14.370162+0000","last_undegraded":"2024-09-19T05:19:14.370162+0000","last_fullsized":"2024-09-19T05:19:14.370162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:24.484844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.373616+0000","last_change":"2024-09-19T05:17:30.207784+0000","last_active":"2024-09-19T05:19:14.373616+0000","last_peered":"2024-09-19T05:19:14.373616+0000","last_clean":"2024-09-19T05:19:14.373616+0000","last_became_active":"2024-09-19T05:17:30.207485+0000","last_became_peered":"2024-09-19T05:17:30.207485+0000","last_unstale":"2024-09-19T05:19:14.373616+0000","last_undegraded":"2024-09-19T05:19:14.373616+0000","last_fullsized":"2024-09-19T05:19:14.373616+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:07.864813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.378421+0000","last_change":"2024-09-19T05:17:30.203861+0000","last_active":"2024-09-19T05:19:14.378421+0000","last_peered":"2024-09-19T05:19:14.378421+0000","last_clean":"2024-09-19T05:19:14.378421+0000","last_became_active":"2024-09-19T05:17:30.203541+0000","last_became_peered":"2024-09-19T05:17:30.203541+0000","last_unstale":"2024-09-19T05:19:14.378421+0000","last_undegraded":"2024-09-19T05:19:14.378421+0000","last_fullsized":"2024-09-19T05:19:14.378421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:33:44.840055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.364039+0000","last_change":"2024-09-19T05:17:30.214534+0000","last_active":"2024-09-19T05:19:14.364039+0000","last_peered":"2024-09-19T05:19:14.364039+0000","last_clean":"2024-09-19T05:19:14.364039+0000","last_became_active":"2024-09-19T05:17:30.213840+0000","last_became_peered":"2024-09-19T05:17:30.213840+0000","last_unstale":"2024-09-19T05:19:14.364039+0000","last_undegraded":"2024-09-19T05:19:14.364039+0000","last_fullsized":"2024-09-19T05:19:14.364039+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:03.673488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.366156+0000","last_change":"2024-09-19T05:17:30.201451+0000","last_active":"2024-09-19T05:19:14.366156+0000","last_peered":"2024-09-19T05:19:14.366156+0000","last_clean":"2024-09-19T05:19:14.366156+0000","last_became_active":"2024-09-19T05:17:30.201092+0000","last_became_peered":"2024-09-19T05:17:30.201092+0000","last_unstale":"2024-09-19T05:19:14.366156+0000","last_undegraded":"2024-09-19T05:19:14.366156+0000","last_fullsized":"2024-09-19T05:19:14.366156+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:18.958271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.369658+0000","last_change":"2024-09-19T05:17:49.506669+0000","last_active":"2024-09-19T05:19:14.369658+0000","last_peered":"2024-09-19T05:19:14.369658+0000","last_clean":"2024-09-19T05:19:14.369658+0000","last_became_active":"2024-09-19T05:17:49.506331+0000","last_became_peered":"2024-09-19T05:17:49.506331+0000","last_unstale":"2024-09-19T05:19:14.369658+0000","last_undegraded":"2024-09-19T05:19:14.369658+0000","last_fullsized":"2024-09-19T05:19:14.369658+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:23.460781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.369954+0000","last_change":"2024-09-19T05:17:49.506866+0000","last_active":"2024-09-19T05:19:14.369954+0000","last_peered":"2024-09-19T05:19:14.369954+0000","last_clean":"2024-09-19T05:19:14.369954+0000","last_became_active":"2024-09-19T05:17:49.506386+0000","last_became_peered":"2024-09-19T05:17:49.506386+0000","last_unstale":"2024-09-19T05:19:14.369954+0000","last_undegraded":"2024-09-19T05:19:14.369954+0000","last_fullsized":"2024-09-19T05:19:14.369954+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:17.060301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.370952+0000","last_change":"2024-09-19T05:17:30.210132+0000","last_active":"2024-09-19T05:19:14.370952+0000","last_peered":"2024-09-19T05:19:14.370952+0000","last_clean":"2024-09-19T05:19:14.370952+0000","last_became_active":"2024-09-19T05:17:30.209240+0000","last_became_peered":"2024-09-19T05:17:30.209240+0000","last_unstale":"2024-09-19T05:19:14.370952+0000","last_undegraded":"2024-09-19T05:19:14.370952+0000","last_fullsized":"2024-09-19T05:19:14.370952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:08:26.999751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.373235+0000","last_change":"2024-09-19T05:17:49.259291+0000","last_active":"2024-09-19T05:19:14.373235+0000","last_peered":"2024-09-19T05:19:14.373235+0000","last_clean":"2024-09-19T05:19:14.373235+0000","last_became_active":"2024-09-19T05:17:49.258948+0000","last_became_peered":"2024-09-19T05:17:49.258948+0000","last_unstale":"2024-09-19T05:19:14.373235+0000","last_undegraded":"2024-09-19T05:19:14.373235+0000","last_fullsized":"2024-09-19T05:19:14.373235+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:51.082539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,11],"acting":[9,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.366652+0000","last_change":"2024-09-19T05:17:30.205429+0000","last_active":"2024-09-19T05:19:14.366652+0000","last_peered":"2024-09-19T05:19:14.366652+0000","last_clean":"2024-09-19T05:19:14.366652+0000","last_became_active":"2024-09-19T05:17:30.205094+0000","last_became_peered":"2024-09-19T05:17:30.205094+0000","last_unstale":"2024-09-19T05:19:14.366652+0000","last_undegraded":"2024-09-19T05:19:14.366652+0000","last_fullsized":"2024-09-19T05:19:14.366652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:22.149473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.366517+0000","last_change":"2024-09-19T05:17:30.213050+0000","last_active":"2024-09-19T05:19:14.366517+0000","last_peered":"2024-09-19T05:19:14.366517+0000","last_clean":"2024-09-19T05:19:14.366517+0000","last_became_active":"2024-09-19T05:17:30.211812+0000","last_became_peered":"2024-09-19T05:17:30.211812+0000","last_unstale":"2024-09-19T05:19:14.366517+0000","last_undegraded":"2024-09-19T05:19:14.366517+0000","last_fullsized":"2024-09-19T05:19:14.366517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:31.734317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.363598+0000","last_change":"2024-09-19T05:17:30.212049+0000","last_active":"2024-09-19T05:19:14.363598+0000","last_peered":"2024-09-19T05:19:14.363598+0000","last_clean":"2024-09-19T05:19:14.363598+0000","last_became_active":"2024-09-19T05:17:30.211684+0000","last_became_peered":"2024-09-19T05:17:30.211684+0000","last_unstale":"2024-09-19T05:19:14.363598+0000","last_undegraded":"2024-09-19T05:19:14.363598+0000","last_fullsized":"2024-09-19T05:19:14.363598+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:24.781815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.370902+0000","last_change":"2024-09-19T05:17:30.191898+0000","last_active":"2024-09-19T05:19:14.370902+0000","last_peered":"2024-09-19T05:19:14.370902+0000","last_clean":"2024-09-19T05:19:14.370902+0000","last_became_active":"2024-09-19T05:17:30.191204+0000","last_became_peered":"2024-09-19T05:17:30.191204+0000","last_unstale":"2024-09-19T05:19:14.370902+0000","last_undegraded":"2024-09-19T05:19:14.370902+0000","last_fullsized":"2024-09-19T05:19:14.370902+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:19.043363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.380427+0000","last_change":"2024-09-19T05:17:30.201754+0000","last_active":"2024-09-19T05:19:14.380427+0000","last_peered":"2024-09-19T05:19:14.380427+0000","last_clean":"2024-09-19T05:19:14.380427+0000","last_became_active":"2024-09-19T05:17:30.201439+0000","last_became_peered":"2024-09-19T05:17:30.201439+0000","last_unstale":"2024-09-19T05:19:14.380427+0000","last_undegraded":"2024-09-19T05:19:14.380427+0000","last_fullsized":"2024-09-19T05:19:14.380427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:28.896899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.380449+0000","last_change":"2024-09-19T05:17:30.202618+0000","last_active":"2024-09-19T05:19:14.380449+0000","last_peered":"2024-09-19T05:19:14.380449+0000","last_clean":"2024-09-19T05:19:14.380449+0000","last_became_active":"2024-09-19T05:17:30.202292+0000","last_became_peered":"2024-09-19T05:17:30.202292+0000","last_unstale":"2024-09-19T05:19:14.380449+0000","last_undegraded":"2024-09-19T05:19:14.380449+0000","last_fullsized":"2024-09-19T05:19:14.380449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:54.206467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.379528+0000","last_change":"2024-09-19T05:17:30.209411+0000","last_active":"2024-09-19T05:19:14.379528+0000","last_peered":"2024-09-19T05:19:14.379528+0000","last_clean":"2024-09-19T05:19:14.379528+0000","last_became_active":"2024-09-19T05:17:30.208525+0000","last_became_peered":"2024-09-19T05:17:30.208525+0000","last_unstale":"2024-09-19T05:19:14.379528+0000","last_undegraded":"2024-09-19T05:19:14.379528+0000","last_fullsized":"2024-09-19T05:19:14.379528+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:12:16.616413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.372583+0000","last_change":"2024-09-19T05:17:30.203552+0000","last_active":"2024-09-19T05:19:14.372583+0000","last_peered":"2024-09-19T05:19:14.372583+0000","last_clean":"2024-09-19T05:19:14.372583+0000","last_became_active":"2024-09-19T05:17:30.203212+0000","last_became_peered":"2024-09-19T05:17:30.203212+0000","last_unstale":"2024-09-19T05:19:14.372583+0000","last_undegraded":"2024-09-19T05:19:14.372583+0000","last_fullsized":"2024-09-19T05:19:14.372583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:38:50.948373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.373959+0000","last_change":"2024-09-19T05:17:30.201540+0000","last_active":"2024-09-19T05:19:14.373959+0000","last_peered":"2024-09-19T05:19:14.373959+0000","last_clean":"2024-09-19T05:19:14.373959+0000","last_became_active":"2024-09-19T05:17:30.201222+0000","last_became_peered":"2024-09-19T05:17:30.201222+0000","last_unstale":"2024-09-19T05:19:14.373959+0000","last_undegraded":"2024-09-19T05:19:14.373959+0000","last_fullsized":"2024-09-19T05:19:14.373959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:09.583473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.371510+0000","last_change":"2024-09-19T05:17:30.205962+0000","last_active":"2024-09-19T05:19:14.371510+0000","last_peered":"2024-09-19T05:19:14.371510+0000","last_clean":"2024-09-19T05:19:14.371510+0000","last_became_active":"2024-09-19T05:17:30.205632+0000","last_became_peered":"2024-09-19T05:17:30.205632+0000","last_unstale":"2024-09-19T05:19:14.371510+0000","last_undegraded":"2024-09-19T05:19:14.371510+0000","last_fullsized":"2024-09-19T05:19:14.371510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:07.767502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.368765+0000","last_change":"2024-09-19T05:17:30.208546+0000","last_active":"2024-09-19T05:19:14.368765+0000","last_peered":"2024-09-19T05:19:14.368765+0000","last_clean":"2024-09-19T05:19:14.368765+0000","last_became_active":"2024-09-19T05:17:30.208220+0000","last_became_peered":"2024-09-19T05:17:30.208220+0000","last_unstale":"2024-09-19T05:19:14.368765+0000","last_undegraded":"2024-09-19T05:19:14.368765+0000","last_fullsized":"2024-09-19T05:19:14.368765+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:46:32.360282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.381277+0000","last_change":"2024-09-19T05:17:30.204653+0000","last_active":"2024-09-19T05:19:14.381277+0000","last_peered":"2024-09-19T05:19:14.381277+0000","last_clean":"2024-09-19T05:19:14.381277+0000","last_became_active":"2024-09-19T05:17:30.204335+0000","last_became_peered":"2024-09-19T05:17:30.204335+0000","last_unstale":"2024-09-19T05:19:14.381277+0000","last_undegraded":"2024-09-19T05:19:14.381277+0000","last_fullsized":"2024-09-19T05:19:14.381277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:48.661902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.369702+0000","last_change":"2024-09-19T05:17:49.261216+0000","last_active":"2024-09-19T05:19:14.369702+0000","last_peered":"2024-09-19T05:19:14.369702+0000","last_clean":"2024-09-19T05:19:14.369702+0000","last_became_active":"2024-09-19T05:17:49.260691+0000","last_became_peered":"2024-09-19T05:17:49.260691+0000","last_unstale":"2024-09-19T05:19:14.369702+0000","last_undegraded":"2024-09-19T05:19:14.369702+0000","last_fullsized":"2024-09-19T05:19:14.369702+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:35.937669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,6],"acting":[1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.369686+0000","last_change":"2024-09-19T05:17:30.201935+0000","last_active":"2024-09-19T05:19:14.369686+0000","last_peered":"2024-09-19T05:19:14.369686+0000","last_clean":"2024-09-19T05:19:14.369686+0000","last_became_active":"2024-09-19T05:17:30.201524+0000","last_became_peered":"2024-09-19T05:17:30.201524+0000","last_unstale":"2024-09-19T05:19:14.369686+0000","last_undegraded":"2024-09-19T05:19:14.369686+0000","last_fullsized":"2024-09-19T05:19:14.369686+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:34.018339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.368920+0000","last_change":"2024-09-19T05:17:49.506519+0000","last_active":"2024-09-19T05:19:14.368920+0000","last_peered":"2024-09-19T05:19:14.368920+0000","last_clean":"2024-09-19T05:19:14.368920+0000","last_became_active":"2024-09-19T05:17:49.506016+0000","last_became_peered":"2024-09-19T05:17:49.506016+0000","last_unstale":"2024-09-19T05:19:14.368920+0000","last_undegraded":"2024-09-19T05:19:14.368920+0000","last_fullsized":"2024-09-19T05:19:14.368920+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:31.064318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,8],"acting":[5,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.367932+0000","last_change":"2024-09-19T05:17:30.205459+0000","last_active":"2024-09-19T05:19:14.367932+0000","last_peered":"2024-09-19T05:19:14.367932+0000","last_clean":"2024-09-19T05:19:14.367932+0000","last_became_active":"2024-09-19T05:17:30.205100+0000","last_became_peered":"2024-09-19T05:17:30.205100+0000","last_unstale":"2024-09-19T05:19:14.367932+0000","last_undegraded":"2024-09-19T05:19:14.367932+0000","last_fullsized":"2024-09-19T05:19:14.367932+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:35.246931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.363472+0000","last_change":"2024-09-19T05:17:30.202812+0000","last_active":"2024-09-19T05:19:14.363472+0000","last_peered":"2024-09-19T05:19:14.363472+0000","last_clean":"2024-09-19T05:19:14.363472+0000","last_became_active":"2024-09-19T05:17:30.202477+0000","last_became_peered":"2024-09-19T05:17:30.202477+0000","last_unstale":"2024-09-19T05:19:14.363472+0000","last_undegraded":"2024-09-19T05:19:14.363472+0000","last_fullsized":"2024-09-19T05:19:14.363472+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:24.253576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.368403+0000","last_change":"2024-09-19T05:17:30.206546+0000","last_active":"2024-09-19T05:19:14.368403+0000","last_peered":"2024-09-19T05:19:14.368403+0000","last_clean":"2024-09-19T05:19:14.368403+0000","last_became_active":"2024-09-19T05:17:30.206186+0000","last_became_peered":"2024-09-19T05:17:30.206186+0000","last_unstale":"2024-09-19T05:19:14.368403+0000","last_undegraded":"2024-09-19T05:19:14.368403+0000","last_fullsized":"2024-09-19T05:19:14.368403+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:30.589196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.380979+0000","last_change":"2024-09-19T05:17:30.213894+0000","last_active":"2024-09-19T05:19:14.380979+0000","last_peered":"2024-09-19T05:19:14.380979+0000","last_clean":"2024-09-19T05:19:14.380979+0000","last_became_active":"2024-09-19T05:17:30.213586+0000","last_became_peered":"2024-09-19T05:17:30.213586+0000","last_unstale":"2024-09-19T05:19:14.380979+0000","last_undegraded":"2024-09-19T05:19:14.380979+0000","last_fullsized":"2024-09-19T05:19:14.380979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:46.215816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.378292+0000","last_change":"2024-09-19T05:17:49.262965+0000","last_active":"2024-09-19T05:19:14.378292+0000","last_peered":"2024-09-19T05:19:14.378292+0000","last_clean":"2024-09-19T05:19:14.378292+0000","last_became_active":"2024-09-19T05:17:49.262651+0000","last_became_peered":"2024-09-19T05:17:49.262651+0000","last_unstale":"2024-09-19T05:19:14.378292+0000","last_undegraded":"2024-09-19T05:19:14.378292+0000","last_fullsized":"2024-09-19T05:19:14.378292+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:57.601031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.370960+0000","last_change":"2024-09-19T05:17:30.204302+0000","last_active":"2024-09-19T05:19:14.370960+0000","last_peered":"2024-09-19T05:19:14.370960+0000","last_clean":"2024-09-19T05:19:14.370960+0000","last_became_active":"2024-09-19T05:17:30.203981+0000","last_became_peered":"2024-09-19T05:17:30.203981+0000","last_unstale":"2024-09-19T05:19:14.370960+0000","last_undegraded":"2024-09-19T05:19:14.370960+0000","last_fullsized":"2024-09-19T05:19:14.370960+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:59.130439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.362907+0000","last_change":"2024-09-19T05:17:30.210610+0000","last_active":"2024-09-19T05:19:14.362907+0000","last_peered":"2024-09-19T05:19:14.362907+0000","last_clean":"2024-09-19T05:19:14.362907+0000","last_became_active":"2024-09-19T05:17:30.210231+0000","last_became_peered":"2024-09-19T05:17:30.210231+0000","last_unstale":"2024-09-19T05:19:14.362907+0000","last_undegraded":"2024-09-19T05:19:14.362907+0000","last_fullsized":"2024-09-19T05:19:14.362907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:37:41.885822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.367323+0000","last_change":"2024-09-19T05:17:30.210755+0000","last_active":"2024-09-19T05:19:14.367323+0000","last_peered":"2024-09-19T05:19:14.367323+0000","last_clean":"2024-09-19T05:19:14.367323+0000","last_became_active":"2024-09-19T05:17:30.210383+0000","last_became_peered":"2024-09-19T05:17:30.210383+0000","last_unstale":"2024-09-19T05:19:14.367323+0000","last_undegraded":"2024-09-19T05:19:14.367323+0000","last_fullsized":"2024-09-19T05:19:14.367323+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:11.259830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.366895+0000","last_change":"2024-09-19T05:17:30.206345+0000","last_active":"2024-09-19T05:19:14.366895+0000","last_peered":"2024-09-19T05:19:14.366895+0000","last_clean":"2024-09-19T05:19:14.366895+0000","last_became_active":"2024-09-19T05:17:30.205988+0000","last_became_peered":"2024-09-19T05:17:30.205988+0000","last_unstale":"2024-09-19T05:19:14.366895+0000","last_undegraded":"2024-09-19T05:19:14.366895+0000","last_fullsized":"2024-09-19T05:19:14.366895+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:57.538280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"85'8","reported_seq":134,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.567917+0000","last_change":"2024-09-19T05:17:28.183851+0000","last_active":"2024-09-19T05:19:14.567917+0000","last_peered":"2024-09-19T05:19:14.567917+0000","last_clean":"2024-09-19T05:19:14.567917+0000","last_became_active":"2024-09-19T05:17:28.183472+0000","last_became_peered":"2024-09-19T05:17:28.183472+0000","last_unstale":"2024-09-19T05:19:14.567917+0000","last_undegraded":"2024-09-19T05:19:14.567917+0000","last_fullsized":"2024-09-19T05:19:14.567917+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:22.942306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1903,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":3,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.361590+0000","last_change":"2024-09-19T05:17:30.208784+0000","last_active":"2024-09-19T05:19:14.361590+0000","last_peered":"2024-09-19T05:19:14.361590+0000","last_clean":"2024-09-19T05:19:14.361590+0000","last_became_active":"2024-09-19T05:17:30.208232+0000","last_became_peered":"2024-09-19T05:17:30.208232+0000","last_unstale":"2024-09-19T05:19:14.361590+0000","last_undegraded":"2024-09-19T05:19:14.361590+0000","last_fullsized":"2024-09-19T05:19:14.361590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:07.670401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.328791+0000","last_change":"2024-09-19T05:17:28.181480+0000","last_active":"2024-09-19T05:19:14.328791+0000","last_peered":"2024-09-19T05:19:14.328791+0000","last_clean":"2024-09-19T05:19:14.328791+0000","last_became_active":"2024-09-19T05:17:28.181169+0000","last_became_peered":"2024-09-19T05:17:28.181169+0000","last_unstale":"2024-09-19T05:19:14.328791+0000","last_undegraded":"2024-09-19T05:19:14.328791+0000","last_fullsized":"2024-09-19T05:19:14.328791+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:09.590408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.319464+0000","last_change":"2024-09-19T05:17:28.180636+0000","last_active":"2024-09-19T05:19:14.319464+0000","last_peered":"2024-09-19T05:19:14.319464+0000","last_clean":"2024-09-19T05:19:14.319464+0000","last_became_active":"2024-09-19T05:17:28.180298+0000","last_became_peered":"2024-09-19T05:17:28.180298+0000","last_unstale":"2024-09-19T05:19:14.319464+0000","last_undegraded":"2024-09-19T05:19:14.319464+0000","last_fullsized":"2024-09-19T05:19:14.319464+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:06.361677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.373807+0000","last_change":"2024-09-19T05:17:30.199091+0000","last_active":"2024-09-19T05:19:14.373807+0000","last_peered":"2024-09-19T05:19:14.373807+0000","last_clean":"2024-09-19T05:19:14.373807+0000","last_became_active":"2024-09-19T05:17:30.198805+0000","last_became_peered":"2024-09-19T05:17:30.198805+0000","last_unstale":"2024-09-19T05:19:14.373807+0000","last_undegraded":"2024-09-19T05:19:14.373807+0000","last_fullsized":"2024-09-19T05:19:14.373807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:27.906713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.324437+0000","last_change":"2024-09-19T05:17:28.182281+0000","last_active":"2024-09-19T05:19:14.324437+0000","last_peered":"2024-09-19T05:19:14.324437+0000","last_clean":"2024-09-19T05:19:14.324437+0000","last_became_active":"2024-09-19T05:17:28.181939+0000","last_became_peered":"2024-09-19T05:17:28.181939+0000","last_unstale":"2024-09-19T05:19:14.324437+0000","last_undegraded":"2024-09-19T05:19:14.324437+0000","last_fullsized":"2024-09-19T05:19:14.324437+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:12.057601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.378802+0000","last_change":"2024-09-19T05:17:30.198849+0000","last_active":"2024-09-19T05:19:14.378802+0000","last_peered":"2024-09-19T05:19:14.378802+0000","last_clean":"2024-09-19T05:19:14.378802+0000","last_became_active":"2024-09-19T05:17:30.198473+0000","last_became_peered":"2024-09-19T05:17:30.198473+0000","last_unstale":"2024-09-19T05:19:14.378802+0000","last_undegraded":"2024-09-19T05:19:14.378802+0000","last_fullsized":"2024-09-19T05:19:14.378802+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:20.591516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":127,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.329041+0000","last_change":"2024-09-19T05:17:28.181393+0000","last_active":"2024-09-19T05:19:14.329041+0000","last_peered":"2024-09-19T05:19:14.329041+0000","last_clean":"2024-09-19T05:19:14.329041+0000","last_became_active":"2024-09-19T05:17:28.181069+0000","last_became_peered":"2024-09-19T05:17:28.181069+0000","last_unstale":"2024-09-19T05:19:14.329041+0000","last_undegraded":"2024-09-19T05:19:14.329041+0000","last_fullsized":"2024-09-19T05:19:14.329041+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:15.684564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.367286+0000","last_change":"2024-09-19T05:17:30.204968+0000","last_active":"2024-09-19T05:19:14.367286+0000","last_peered":"2024-09-19T05:19:14.367286+0000","last_clean":"2024-09-19T05:19:14.367286+0000","last_became_active":"2024-09-19T05:17:30.204613+0000","last_became_peered":"2024-09-19T05:17:30.204613+0000","last_unstale":"2024-09-19T05:19:14.367286+0000","last_undegraded":"2024-09-19T05:19:14.367286+0000","last_fullsized":"2024-09-19T05:19:14.367286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:14.836220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.334835+0000","last_change":"2024-09-19T05:17:28.185554+0000","last_active":"2024-09-19T05:19:14.334835+0000","last_peered":"2024-09-19T05:19:14.334835+0000","last_clean":"2024-09-19T05:19:14.334835+0000","last_became_active":"2024-09-19T05:17:28.185198+0000","last_became_peered":"2024-09-19T05:17:28.185198+0000","last_unstale":"2024-09-19T05:19:14.334835+0000","last_undegraded":"2024-09-19T05:19:14.334835+0000","last_fullsized":"2024-09-19T05:19:14.334835+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:59.753359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.381217+0000","last_change":"2024-09-19T05:17:30.207418+0000","last_active":"2024-09-19T05:19:14.381217+0000","last_peered":"2024-09-19T05:19:14.381217+0000","last_clean":"2024-09-19T05:19:14.381217+0000","last_became_active":"2024-09-19T05:17:30.207079+0000","last_became_peered":"2024-09-19T05:17:30.207079+0000","last_unstale":"2024-09-19T05:19:14.381217+0000","last_undegraded":"2024-09-19T05:19:14.381217+0000","last_fullsized":"2024-09-19T05:19:14.381217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:40:49.564649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.324446+0000","last_change":"2024-09-19T05:17:28.204988+0000","last_active":"2024-09-19T05:19:14.324446+0000","last_peered":"2024-09-19T05:19:14.324446+0000","last_clean":"2024-09-19T05:19:14.324446+0000","last_became_active":"2024-09-19T05:17:28.204607+0000","last_became_peered":"2024-09-19T05:17:28.204607+0000","last_unstale":"2024-09-19T05:19:14.324446+0000","last_undegraded":"2024-09-19T05:19:14.324446+0000","last_fullsized":"2024-09-19T05:19:14.324446+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:17.914720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.360899+0000","last_change":"2024-09-19T05:17:30.207876+0000","last_active":"2024-09-19T05:19:14.360899+0000","last_peered":"2024-09-19T05:19:14.360899+0000","last_clean":"2024-09-19T05:19:14.360899+0000","last_became_active":"2024-09-19T05:17:30.207561+0000","last_became_peered":"2024-09-19T05:17:30.207561+0000","last_unstale":"2024-09-19T05:19:14.360899+0000","last_undegraded":"2024-09-19T05:19:14.360899+0000","last_fullsized":"2024-09-19T05:19:14.360899+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:26.696949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'35","reported_seq":263,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.565678+0000","last_change":"2024-09-19T05:17:28.185152+0000","last_active":"2024-09-19T05:19:14.565678+0000","last_peered":"2024-09-19T05:19:14.565678+0000","last_clean":"2024-09-19T05:19:14.565678+0000","last_became_active":"2024-09-19T05:17:28.184792+0000","last_became_peered":"2024-09-19T05:17:28.184792+0000","last_unstale":"2024-09-19T05:19:14.565678+0000","last_undegraded":"2024-09-19T05:19:14.565678+0000","last_fullsized":"2024-09-19T05:19:14.565678+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:04.647138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62697,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":200,"num_read_kb":159,"num_write":36,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.366762+0000","last_change":"2024-09-19T05:17:30.209768+0000","last_active":"2024-09-19T05:19:14.366762+0000","last_peered":"2024-09-19T05:19:14.366762+0000","last_clean":"2024-09-19T05:19:14.366762+0000","last_became_active":"2024-09-19T05:17:30.209399+0000","last_became_peered":"2024-09-19T05:17:30.209399+0000","last_unstale":"2024-09-19T05:19:14.366762+0000","last_undegraded":"2024-09-19T05:19:14.366762+0000","last_fullsized":"2024-09-19T05:19:14.366762+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:58.664138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.336911+0000","last_change":"2024-09-19T05:17:49.269241+0000","last_active":"2024-09-19T05:19:14.336911+0000","last_peered":"2024-09-19T05:19:14.336911+0000","last_clean":"2024-09-19T05:19:14.336911+0000","last_became_active":"2024-09-19T05:17:49.259494+0000","last_became_peered":"2024-09-19T05:17:49.259494+0000","last_unstale":"2024-09-19T05:19:14.336911+0000","last_undegraded":"2024-09-19T05:19:14.336911+0000","last_fullsized":"2024-09-19T05:19:14.336911+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:59.866742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.371429+0000","last_change":"2024-09-19T05:17:30.204554+0000","last_active":"2024-09-19T05:19:14.371429+0000","last_peered":"2024-09-19T05:19:14.371429+0000","last_clean":"2024-09-19T05:19:14.371429+0000","last_became_active":"2024-09-19T05:17:30.203166+0000","last_became_peered":"2024-09-19T05:17:30.203166+0000","last_unstale":"2024-09-19T05:19:14.371429+0000","last_undegraded":"2024-09-19T05:19:14.371429+0000","last_fullsized":"2024-09-19T05:19:14.371429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:23.517869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.324236+0000","last_change":"2024-09-19T05:17:28.183800+0000","last_active":"2024-09-19T05:19:14.324236+0000","last_peered":"2024-09-19T05:19:14.324236+0000","last_clean":"2024-09-19T05:19:14.324236+0000","last_became_active":"2024-09-19T05:17:28.182819+0000","last_became_peered":"2024-09-19T05:17:28.182819+0000","last_unstale":"2024-09-19T05:19:14.324236+0000","last_undegraded":"2024-09-19T05:19:14.324236+0000","last_fullsized":"2024-09-19T05:19:14.324236+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:44:52.215544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.371794+0000","last_change":"2024-09-19T05:17:30.214723+0000","last_active":"2024-09-19T05:19:14.371794+0000","last_peered":"2024-09-19T05:19:14.371794+0000","last_clean":"2024-09-19T05:19:14.371794+0000","last_became_active":"2024-09-19T05:17:30.214343+0000","last_became_peered":"2024-09-19T05:17:30.214343+0000","last_unstale":"2024-09-19T05:19:14.371794+0000","last_undegraded":"2024-09-19T05:19:14.371794+0000","last_fullsized":"2024-09-19T05:19:14.371794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:13.008151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":131,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.397070+0000","last_change":"2024-09-19T05:17:28.183130+0000","last_active":"2024-09-19T05:19:14.397070+0000","last_peered":"2024-09-19T05:19:14.397070+0000","last_clean":"2024-09-19T05:19:14.397070+0000","last_became_active":"2024-09-19T05:17:28.182834+0000","last_became_peered":"2024-09-19T05:17:28.182834+0000","last_unstale":"2024-09-19T05:19:14.397070+0000","last_undegraded":"2024-09-19T05:19:14.397070+0000","last_fullsized":"2024-09-19T05:19:14.397070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:48.683776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1476,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":4,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.358821+0000","last_change":"2024-09-19T05:17:30.212438+0000","last_active":"2024-09-19T05:19:14.358821+0000","last_peered":"2024-09-19T05:19:14.358821+0000","last_clean":"2024-09-19T05:19:14.358821+0000","last_became_active":"2024-09-19T05:17:30.209321+0000","last_became_peered":"2024-09-19T05:17:30.209321+0000","last_unstale":"2024-09-19T05:19:14.358821+0000","last_undegraded":"2024-09-19T05:19:14.358821+0000","last_fullsized":"2024-09-19T05:19:14.358821+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:42.772116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.341323+0000","last_change":"2024-09-19T05:17:28.204665+0000","last_active":"2024-09-19T05:19:14.341323+0000","last_peered":"2024-09-19T05:19:14.341323+0000","last_clean":"2024-09-19T05:19:14.341323+0000","last_became_active":"2024-09-19T05:17:28.204309+0000","last_became_peered":"2024-09-19T05:17:28.204309+0000","last_unstale":"2024-09-19T05:19:14.341323+0000","last_undegraded":"2024-09-19T05:19:14.341323+0000","last_fullsized":"2024-09-19T05:19:14.341323+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:26.372762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.357482+0000","last_change":"2024-09-19T05:17:30.208518+0000","last_active":"2024-09-19T05:19:14.357482+0000","last_peered":"2024-09-19T05:19:14.357482+0000","last_clean":"2024-09-19T05:19:14.357482+0000","last_became_active":"2024-09-19T05:17:30.208172+0000","last_became_peered":"2024-09-19T05:17:30.208172+0000","last_unstale":"2024-09-19T05:19:14.357482+0000","last_undegraded":"2024-09-19T05:19:14.357482+0000","last_fullsized":"2024-09-19T05:19:14.357482+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:40:25.754925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.339207+0000","last_change":"2024-09-19T05:18:50.249627+0000","last_active":"2024-09-19T05:19:14.339207+0000","last_peered":"2024-09-19T05:19:14.339207+0000","last_clean":"2024-09-19T05:19:14.339207+0000","last_became_active":"2024-09-19T05:18:50.245759+0000","last_became_peered":"2024-09-19T05:18:50.245759+0000","last_unstale":"2024-09-19T05:19:14.339207+0000","last_undegraded":"2024-09-19T05:19:14.339207+0000","last_fullsized":"2024-09-19T05:19:14.339207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:45:59.039812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.364525+0000","last_change":"2024-09-19T05:17:30.207002+0000","last_active":"2024-09-19T05:19:14.364525+0000","last_peered":"2024-09-19T05:19:14.364525+0000","last_clean":"2024-09-19T05:19:14.364525+0000","last_became_active":"2024-09-19T05:17:30.205750+0000","last_became_peered":"2024-09-19T05:17:30.205750+0000","last_unstale":"2024-09-19T05:19:14.364525+0000","last_undegraded":"2024-09-19T05:19:14.364525+0000","last_fullsized":"2024-09-19T05:19:14.364525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:25:18.716206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.319837+0000","last_change":"2024-09-19T05:17:28.184071+0000","last_active":"2024-09-19T05:19:14.319837+0000","last_peered":"2024-09-19T05:19:14.319837+0000","last_clean":"2024-09-19T05:19:14.319837+0000","last_became_active":"2024-09-19T05:17:28.183708+0000","last_became_peered":"2024-09-19T05:17:28.183708+0000","last_unstale":"2024-09-19T05:19:14.319837+0000","last_undegraded":"2024-09-19T05:19:14.319837+0000","last_fullsized":"2024-09-19T05:19:14.319837+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:57:23.831000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.366633+0000","last_change":"2024-09-19T05:17:30.211919+0000","last_active":"2024-09-19T05:19:14.366633+0000","last_peered":"2024-09-19T05:19:14.366633+0000","last_clean":"2024-09-19T05:19:14.366633+0000","last_became_active":"2024-09-19T05:17:30.210639+0000","last_became_peered":"2024-09-19T05:17:30.210639+0000","last_unstale":"2024-09-19T05:19:14.366633+0000","last_undegraded":"2024-09-19T05:19:14.366633+0000","last_fullsized":"2024-09-19T05:19:14.366633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:25.231732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'39","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.533319+0000","last_change":"2024-09-19T05:17:28.179372+0000","last_active":"2024-09-19T05:19:14.533319+0000","last_peered":"2024-09-19T05:19:14.533319+0000","last_clean":"2024-09-19T05:19:14.533319+0000","last_became_active":"2024-09-19T05:17:28.178792+0000","last_became_peered":"2024-09-19T05:17:28.178792+0000","last_unstale":"2024-09-19T05:19:14.533319+0000","last_undegraded":"2024-09-19T05:19:14.533319+0000","last_fullsized":"2024-09-19T05:19:14.533319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:54.705552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.358807+0000","last_change":"2024-09-19T05:17:30.208201+0000","last_active":"2024-09-19T05:19:14.358807+0000","last_peered":"2024-09-19T05:19:14.358807+0000","last_clean":"2024-09-19T05:19:14.358807+0000","last_became_active":"2024-09-19T05:17:30.207865+0000","last_became_peered":"2024-09-19T05:17:30.207865+0000","last_unstale":"2024-09-19T05:19:14.358807+0000","last_undegraded":"2024-09-19T05:19:14.358807+0000","last_fullsized":"2024-09-19T05:19:14.358807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:35.954759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.331163+0000","last_change":"2024-09-19T05:17:28.543685+0000","last_active":"2024-09-19T05:19:14.331163+0000","last_peered":"2024-09-19T05:19:14.331163+0000","last_clean":"2024-09-19T05:19:14.331163+0000","last_became_active":"2024-09-19T05:17:28.543292+0000","last_became_peered":"2024-09-19T05:17:28.543292+0000","last_unstale":"2024-09-19T05:19:14.331163+0000","last_undegraded":"2024-09-19T05:19:14.331163+0000","last_fullsized":"2024-09-19T05:19:14.331163+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:55:14.348544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.362322+0000","last_change":"2024-09-19T05:17:30.212449+0000","last_active":"2024-09-19T05:19:14.362322+0000","last_peered":"2024-09-19T05:19:14.362322+0000","last_clean":"2024-09-19T05:19:14.362322+0000","last_became_active":"2024-09-19T05:17:30.211265+0000","last_became_peered":"2024-09-19T05:17:30.211265+0000","last_unstale":"2024-09-19T05:19:14.362322+0000","last_undegraded":"2024-09-19T05:19:14.362322+0000","last_fullsized":"2024-09-19T05:19:14.362322+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:27.687687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":353,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.333999+0000","last_change":"2024-09-19T05:16:20.361975+0000","last_active":"2024-09-19T05:19:14.333999+0000","last_peered":"2024-09-19T05:19:14.333999+0000","last_clean":"2024-09-19T05:19:14.333999+0000","last_became_active":"2024-09-19T05:16:20.361553+0000","last_became_peered":"2024-09-19T05:16:20.361553+0000","last_unstale":"2024-09-19T05:19:14.333999+0000","last_undegraded":"2024-09-19T05:19:14.333999+0000","last_fullsized":"2024-09-19T05:19:14.333999+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:13:02.674575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:13:02.674575+0000","last_clean_scrub_stamp":"2024-09-19T05:13:02.674575+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:48.711411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.320831+0000","last_change":"2024-09-19T05:17:28.180486+0000","last_active":"2024-09-19T05:19:14.320831+0000","last_peered":"2024-09-19T05:19:14.320831+0000","last_clean":"2024-09-19T05:19:14.320831+0000","last_became_active":"2024-09-19T05:17:28.180147+0000","last_became_peered":"2024-09-19T05:17:28.180147+0000","last_unstale":"2024-09-19T05:19:14.320831+0000","last_undegraded":"2024-09-19T05:19:14.320831+0000","last_fullsized":"2024-09-19T05:19:14.320831+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:57.820328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.372815+0000","last_change":"2024-09-19T05:17:30.205560+0000","last_active":"2024-09-19T05:19:14.372815+0000","last_peered":"2024-09-19T05:19:14.372815+0000","last_clean":"2024-09-19T05:19:14.372815+0000","last_became_active":"2024-09-19T05:17:30.205269+0000","last_became_peered":"2024-09-19T05:17:30.205269+0000","last_unstale":"2024-09-19T05:19:14.372815+0000","last_undegraded":"2024-09-19T05:19:14.372815+0000","last_fullsized":"2024-09-19T05:19:14.372815+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:22.904616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.333965+0000","last_change":"2024-09-19T05:17:28.181845+0000","last_active":"2024-09-19T05:19:14.333965+0000","last_peered":"2024-09-19T05:19:14.333965+0000","last_clean":"2024-09-19T05:19:14.333965+0000","last_became_active":"2024-09-19T05:17:28.181549+0000","last_became_peered":"2024-09-19T05:17:28.181549+0000","last_unstale":"2024-09-19T05:19:14.333965+0000","last_undegraded":"2024-09-19T05:19:14.333965+0000","last_fullsized":"2024-09-19T05:19:14.333965+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:01.222364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.364544+0000","last_change":"2024-09-19T05:17:49.259631+0000","last_active":"2024-09-19T05:19:14.364544+0000","last_peered":"2024-09-19T05:19:14.364544+0000","last_clean":"2024-09-19T05:19:14.364544+0000","last_became_active":"2024-09-19T05:17:49.259240+0000","last_became_peered":"2024-09-19T05:17:49.259240+0000","last_unstale":"2024-09-19T05:19:14.364544+0000","last_undegraded":"2024-09-19T05:19:14.364544+0000","last_fullsized":"2024-09-19T05:19:14.364544+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:22.533248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":128,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.380727+0000","last_change":"2024-09-19T05:17:28.204924+0000","last_active":"2024-09-19T05:19:14.380727+0000","last_peered":"2024-09-19T05:19:14.380727+0000","last_clean":"2024-09-19T05:19:14.380727+0000","last_became_active":"2024-09-19T05:17:28.204602+0000","last_became_peered":"2024-09-19T05:17:28.204602+0000","last_unstale":"2024-09-19T05:19:14.380727+0000","last_undegraded":"2024-09-19T05:19:14.380727+0000","last_fullsized":"2024-09-19T05:19:14.380727+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:13.303939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.369736+0000","last_change":"2024-09-19T05:17:49.259147+0000","last_active":"2024-09-19T05:19:14.369736+0000","last_peered":"2024-09-19T05:19:14.369736+0000","last_clean":"2024-09-19T05:19:14.369736+0000","last_became_active":"2024-09-19T05:17:49.258666+0000","last_became_peered":"2024-09-19T05:17:49.258666+0000","last_unstale":"2024-09-19T05:19:14.369736+0000","last_undegraded":"2024-09-19T05:19:14.369736+0000","last_fullsized":"2024-09-19T05:19:14.369736+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:54.802994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.334811+0000","last_change":"2024-09-19T05:17:28.182456+0000","last_active":"2024-09-19T05:19:14.334811+0000","last_peered":"2024-09-19T05:19:14.334811+0000","last_clean":"2024-09-19T05:19:14.334811+0000","last_became_active":"2024-09-19T05:17:28.182075+0000","last_became_peered":"2024-09-19T05:17:28.182075+0000","last_unstale":"2024-09-19T05:19:14.334811+0000","last_undegraded":"2024-09-19T05:19:14.334811+0000","last_fullsized":"2024-09-19T05:19:14.334811+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:42.771641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.370955+0000","last_change":"2024-09-19T05:17:30.204300+0000","last_active":"2024-09-19T05:19:14.370955+0000","last_peered":"2024-09-19T05:19:14.370955+0000","last_clean":"2024-09-19T05:19:14.370955+0000","last_became_active":"2024-09-19T05:17:30.203840+0000","last_became_peered":"2024-09-19T05:17:30.203840+0000","last_unstale":"2024-09-19T05:19:14.370955+0000","last_undegraded":"2024-09-19T05:19:14.370955+0000","last_fullsized":"2024-09-19T05:19:14.370955+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:48.363862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.335586+0000","last_change":"2024-09-19T05:17:28.204474+0000","last_active":"2024-09-19T05:19:14.335586+0000","last_peered":"2024-09-19T05:19:14.335586+0000","last_clean":"2024-09-19T05:19:14.335586+0000","last_became_active":"2024-09-19T05:17:28.204143+0000","last_became_peered":"2024-09-19T05:17:28.204143+0000","last_unstale":"2024-09-19T05:19:14.335586+0000","last_undegraded":"2024-09-19T05:19:14.335586+0000","last_fullsized":"2024-09-19T05:19:14.335586+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:46.647789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'5","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.372421+0000","last_change":"2024-09-19T05:17:30.198791+0000","last_active":"2024-09-19T05:19:14.372421+0000","last_peered":"2024-09-19T05:19:14.372421+0000","last_clean":"2024-09-19T05:19:14.372421+0000","last_became_active":"2024-09-19T05:17:30.198399+0000","last_became_peered":"2024-09-19T05:17:30.198399+0000","last_unstale":"2024-09-19T05:19:14.372421+0000","last_undegraded":"2024-09-19T05:19:14.372421+0000","last_fullsized":"2024-09-19T05:19:14.372421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:46.676625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.341887+0000","last_change":"2024-09-19T05:17:28.204690+0000","last_active":"2024-09-19T05:19:14.341887+0000","last_peered":"2024-09-19T05:19:14.341887+0000","last_clean":"2024-09-19T05:19:14.341887+0000","last_became_active":"2024-09-19T05:17:28.204377+0000","last_became_peered":"2024-09-19T05:17:28.204377+0000","last_unstale":"2024-09-19T05:19:14.341887+0000","last_undegraded":"2024-09-19T05:19:14.341887+0000","last_fullsized":"2024-09-19T05:19:14.341887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:29:20.583163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.366587+0000","last_change":"2024-09-19T05:17:30.200584+0000","last_active":"2024-09-19T05:19:14.366587+0000","last_peered":"2024-09-19T05:19:14.366587+0000","last_clean":"2024-09-19T05:19:14.366587+0000","last_became_active":"2024-09-19T05:17:30.200270+0000","last_became_peered":"2024-09-19T05:17:30.200270+0000","last_unstale":"2024-09-19T05:19:14.366587+0000","last_undegraded":"2024-09-19T05:19:14.366587+0000","last_fullsized":"2024-09-19T05:19:14.366587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:24:43.493332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'47","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.539433+0000","last_change":"2024-09-19T05:17:28.181020+0000","last_active":"2024-09-19T05:19:14.539433+0000","last_peered":"2024-09-19T05:19:14.539433+0000","last_clean":"2024-09-19T05:19:14.539433+0000","last_became_active":"2024-09-19T05:17:28.180298+0000","last_became_peered":"2024-09-19T05:17:28.180298+0000","last_unstale":"2024-09-19T05:19:14.539433+0000","last_undegraded":"2024-09-19T05:19:14.539433+0000","last_fullsized":"2024-09-19T05:19:14.539433+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:32.931699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":84,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.364959+0000","last_change":"2024-09-19T05:17:30.209632+0000","last_active":"2024-09-19T05:19:14.364959+0000","last_peered":"2024-09-19T05:19:14.364959+0000","last_clean":"2024-09-19T05:19:14.364959+0000","last_became_active":"2024-09-19T05:17:30.209334+0000","last_became_peered":"2024-09-19T05:17:30.209334+0000","last_unstale":"2024-09-19T05:19:14.364959+0000","last_undegraded":"2024-09-19T05:19:14.364959+0000","last_fullsized":"2024-09-19T05:19:14.364959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:21.159099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.321036+0000","last_change":"2024-09-19T05:17:28.543802+0000","last_active":"2024-09-19T05:19:14.321036+0000","last_peered":"2024-09-19T05:19:14.321036+0000","last_clean":"2024-09-19T05:19:14.321036+0000","last_became_active":"2024-09-19T05:17:28.543503+0000","last_became_peered":"2024-09-19T05:17:28.543503+0000","last_unstale":"2024-09-19T05:19:14.321036+0000","last_undegraded":"2024-09-19T05:19:14.321036+0000","last_fullsized":"2024-09-19T05:19:14.321036+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:13.764141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.380774+0000","last_change":"2024-09-19T05:17:30.206755+0000","last_active":"2024-09-19T05:19:14.380774+0000","last_peered":"2024-09-19T05:19:14.380774+0000","last_clean":"2024-09-19T05:19:14.380774+0000","last_became_active":"2024-09-19T05:17:30.205757+0000","last_became_peered":"2024-09-19T05:17:30.205757+0000","last_unstale":"2024-09-19T05:19:14.380774+0000","last_undegraded":"2024-09-19T05:19:14.380774+0000","last_fullsized":"2024-09-19T05:19:14.380774+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:16.281294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.330553+0000","last_change":"2024-09-19T05:17:28.204819+0000","last_active":"2024-09-19T05:19:14.330553+0000","last_peered":"2024-09-19T05:19:14.330553+0000","last_clean":"2024-09-19T05:19:14.330553+0000","last_became_active":"2024-09-19T05:17:28.204445+0000","last_became_peered":"2024-09-19T05:17:28.204445+0000","last_unstale":"2024-09-19T05:19:14.330553+0000","last_undegraded":"2024-09-19T05:19:14.330553+0000","last_fullsized":"2024-09-19T05:19:14.330553+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:26.473654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.352435+0000","last_change":"2024-09-19T05:17:30.201331+0000","last_active":"2024-09-19T05:19:14.352435+0000","last_peered":"2024-09-19T05:19:14.352435+0000","last_clean":"2024-09-19T05:19:14.352435+0000","last_became_active":"2024-09-19T05:17:30.200992+0000","last_became_peered":"2024-09-19T05:17:30.200992+0000","last_unstale":"2024-09-19T05:19:14.352435+0000","last_undegraded":"2024-09-19T05:19:14.352435+0000","last_fullsized":"2024-09-19T05:19:14.352435+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:17.033786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.334852+0000","last_change":"2024-09-19T05:17:28.180149+0000","last_active":"2024-09-19T05:19:14.334852+0000","last_peered":"2024-09-19T05:19:14.334852+0000","last_clean":"2024-09-19T05:19:14.334852+0000","last_became_active":"2024-09-19T05:17:28.179767+0000","last_became_peered":"2024-09-19T05:17:28.179767+0000","last_unstale":"2024-09-19T05:19:14.334852+0000","last_undegraded":"2024-09-19T05:19:14.334852+0000","last_fullsized":"2024-09-19T05:19:14.334852+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:25.074252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.370057+0000","last_change":"2024-09-19T05:17:30.204533+0000","last_active":"2024-09-19T05:19:14.370057+0000","last_peered":"2024-09-19T05:19:14.370057+0000","last_clean":"2024-09-19T05:19:14.370057+0000","last_became_active":"2024-09-19T05:17:30.204224+0000","last_became_peered":"2024-09-19T05:17:30.204224+0000","last_unstale":"2024-09-19T05:19:14.370057+0000","last_undegraded":"2024-09-19T05:19:14.370057+0000","last_fullsized":"2024-09-19T05:19:14.370057+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:11.021297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'2","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.331076+0000","last_change":"2024-09-19T05:17:28.187544+0000","last_active":"2024-09-19T05:19:14.331076+0000","last_peered":"2024-09-19T05:19:14.331076+0000","last_clean":"2024-09-19T05:19:14.331076+0000","last_became_active":"2024-09-19T05:17:28.187068+0000","last_became_peered":"2024-09-19T05:17:28.187068+0000","last_unstale":"2024-09-19T05:19:14.331076+0000","last_undegraded":"2024-09-19T05:19:14.331076+0000","last_fullsized":"2024-09-19T05:19:14.331076+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:01.151721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.377889+0000","last_change":"2024-09-19T05:17:30.209549+0000","last_active":"2024-09-19T05:19:14.377889+0000","last_peered":"2024-09-19T05:19:14.377889+0000","last_clean":"2024-09-19T05:19:14.377889+0000","last_became_active":"2024-09-19T05:17:30.209225+0000","last_became_peered":"2024-09-19T05:17:30.209225+0000","last_unstale":"2024-09-19T05:19:14.377889+0000","last_undegraded":"2024-09-19T05:19:14.377889+0000","last_fullsized":"2024-09-19T05:19:14.377889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:38.023351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.341376+0000","last_change":"2024-09-19T05:17:28.186601+0000","last_active":"2024-09-19T05:19:14.341376+0000","last_peered":"2024-09-19T05:19:14.341376+0000","last_clean":"2024-09-19T05:19:14.341376+0000","last_became_active":"2024-09-19T05:17:28.186236+0000","last_became_peered":"2024-09-19T05:17:28.186236+0000","last_unstale":"2024-09-19T05:19:14.341376+0000","last_undegraded":"2024-09-19T05:19:14.341376+0000","last_fullsized":"2024-09-19T05:19:14.341376+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:08.527906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.369719+0000","last_change":"2024-09-19T05:17:30.203633+0000","last_active":"2024-09-19T05:19:14.369719+0000","last_peered":"2024-09-19T05:19:14.369719+0000","last_clean":"2024-09-19T05:19:14.369719+0000","last_became_active":"2024-09-19T05:17:30.203313+0000","last_became_peered":"2024-09-19T05:17:30.203313+0000","last_unstale":"2024-09-19T05:19:14.369719+0000","last_undegraded":"2024-09-19T05:19:14.369719+0000","last_fullsized":"2024-09-19T05:19:14.369719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:40.442434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.375755+0000","last_change":"2024-09-19T05:17:49.260345+0000","last_active":"2024-09-19T05:19:14.375755+0000","last_peered":"2024-09-19T05:19:14.375755+0000","last_clean":"2024-09-19T05:19:14.375755+0000","last_became_active":"2024-09-19T05:17:49.259938+0000","last_became_peered":"2024-09-19T05:17:49.259938+0000","last_unstale":"2024-09-19T05:19:14.375755+0000","last_undegraded":"2024-09-19T05:19:14.375755+0000","last_fullsized":"2024-09-19T05:19:14.375755+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:01.904276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.343919+0000","last_change":"2024-09-19T05:17:28.182014+0000","last_active":"2024-09-19T05:19:14.343919+0000","last_peered":"2024-09-19T05:19:14.343919+0000","last_clean":"2024-09-19T05:19:14.343919+0000","last_became_active":"2024-09-19T05:17:28.181666+0000","last_became_peered":"2024-09-19T05:17:28.181666+0000","last_unstale":"2024-09-19T05:19:14.343919+0000","last_undegraded":"2024-09-19T05:19:14.343919+0000","last_fullsized":"2024-09-19T05:19:14.343919+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:00:57.069618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.369617+0000","last_change":"2024-09-19T05:17:30.206428+0000","last_active":"2024-09-19T05:19:14.369617+0000","last_peered":"2024-09-19T05:19:14.369617+0000","last_clean":"2024-09-19T05:19:14.369617+0000","last_became_active":"2024-09-19T05:17:30.205818+0000","last_became_peered":"2024-09-19T05:17:30.205818+0000","last_unstale":"2024-09-19T05:19:14.369617+0000","last_undegraded":"2024-09-19T05:19:14.369617+0000","last_fullsized":"2024-09-19T05:19:14.369617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:26.059019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.341632+0000","last_change":"2024-09-19T05:17:28.185596+0000","last_active":"2024-09-19T05:19:14.341632+0000","last_peered":"2024-09-19T05:19:14.341632+0000","last_clean":"2024-09-19T05:19:14.341632+0000","last_became_active":"2024-09-19T05:17:28.185278+0000","last_became_peered":"2024-09-19T05:17:28.185278+0000","last_unstale":"2024-09-19T05:19:14.341632+0000","last_undegraded":"2024-09-19T05:19:14.341632+0000","last_fullsized":"2024-09-19T05:19:14.341632+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:40.440874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.379737+0000","last_change":"2024-09-19T05:17:30.200409+0000","last_active":"2024-09-19T05:19:14.379737+0000","last_peered":"2024-09-19T05:19:14.379737+0000","last_clean":"2024-09-19T05:19:14.379737+0000","last_became_active":"2024-09-19T05:17:30.200120+0000","last_became_peered":"2024-09-19T05:17:30.200120+0000","last_unstale":"2024-09-19T05:19:14.379737+0000","last_undegraded":"2024-09-19T05:19:14.379737+0000","last_fullsized":"2024-09-19T05:19:14.379737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:12.396655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.334449+0000","last_change":"2024-09-19T05:17:28.205371+0000","last_active":"2024-09-19T05:19:14.334449+0000","last_peered":"2024-09-19T05:19:14.334449+0000","last_clean":"2024-09-19T05:19:14.334449+0000","last_became_active":"2024-09-19T05:17:28.205026+0000","last_became_peered":"2024-09-19T05:17:28.205026+0000","last_unstale":"2024-09-19T05:19:14.334449+0000","last_undegraded":"2024-09-19T05:19:14.334449+0000","last_fullsized":"2024-09-19T05:19:14.334449+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:59.518580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.370652+0000","last_change":"2024-09-19T05:17:30.206862+0000","last_active":"2024-09-19T05:19:14.370652+0000","last_peered":"2024-09-19T05:19:14.370652+0000","last_clean":"2024-09-19T05:19:14.370652+0000","last_became_active":"2024-09-19T05:17:30.206072+0000","last_became_peered":"2024-09-19T05:17:30.206072+0000","last_unstale":"2024-09-19T05:19:14.370652+0000","last_undegraded":"2024-09-19T05:19:14.370652+0000","last_fullsized":"2024-09-19T05:19:14.370652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:47.810496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.335963+0000","last_change":"2024-09-19T05:17:28.181895+0000","last_active":"2024-09-19T05:19:14.335963+0000","last_peered":"2024-09-19T05:19:14.335963+0000","last_clean":"2024-09-19T05:19:14.335963+0000","last_became_active":"2024-09-19T05:17:28.181499+0000","last_became_peered":"2024-09-19T05:17:28.181499+0000","last_unstale":"2024-09-19T05:19:14.335963+0000","last_undegraded":"2024-09-19T05:19:14.335963+0000","last_fullsized":"2024-09-19T05:19:14.335963+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:29.722921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":593292,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":691,"num_read_kb":447,"num_write":289,"num_write_kb":1429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":56,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2015232,"data_stored":1779876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579938,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":950272,"data_stored":459705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41108,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704044,"statfs":{"total":95995035648,"available":95952941056,"internally_reserved":0,"allocated":1638400,"data_stored":1113460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939692,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36668,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708484,"statfs":{"total":95995035648,"available":95957487616,"internally_reserved":0,"allocated":1351680,"data_stored":853101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168625,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":954368,"data_stored":459783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397557,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28540,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716612,"statfs":{"total":95995035648,"available":95965810688,"internally_reserved":0,"allocated":1552384,"data_stored":1053513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561082,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":946176,"data_stored":459274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790014,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32904,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712248,"statfs":{"total":95995035648,"available":95961341952,"internally_reserved":0,"allocated":1699840,"data_stored":1183909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953540,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":950272,"data_stored":460599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215177,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32640,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712512,"statfs":{"total":95995035648,"available":95961612288,"internally_reserved":0,"allocated":1490944,"data_stored":984401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444110,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1032192,"data_stored":524361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607635,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1011712,"data_stored":521764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":966656,"data_stored":460545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":241664,"data_stored":196763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:19:20.216 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-19T05:19:20.216 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T05:19:20.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.351+0000 7fb12f2d0640 1 -- 172.21.15.120:0/2413075315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1281009a0 msgr2=0x7fb128100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:20.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.351+0000 7fb12f2d0640 1 --2- 172.21.15.120:0/2413075315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1281009a0 0x7fb128100e00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb118009930 tx=0x7fb11802a420 comp rx=0 tx=0).stop 2024-09-19T05:19:20.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.352+0000 7fb12f2d0640 1 -- 172.21.15.120:0/2413075315 shutdown_connections 2024-09-19T05:19:20.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.352+0000 7fb12f2d0640 1 --2- 172.21.15.120:0/2413075315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb128101340 0x7fb12810d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.352+0000 7fb12f2d0640 1 --2- 172.21.15.120:0/2413075315 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1281009a0 0x7fb128100e00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.352+0000 7fb12f2d0640 1 --2- 172.21.15.120:0/2413075315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1281069b0 0x7fb128106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.352+0000 7fb12f2d0640 1 -- 172.21.15.120:0/2413075315 >> 172.21.15.120:0/2413075315 conn(0x7fb1280fc6c0 msgr2=0x7fb1280feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:20.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.352+0000 7fb12f2d0640 1 -- 172.21.15.120:0/2413075315 shutdown_connections 2024-09-19T05:19:20.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.352+0000 7fb12f2d0640 1 -- 172.21.15.120:0/2413075315 wait complete. 2024-09-19T05:19:20.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.352+0000 7fb12f2d0640 1 Processor -- start 2024-09-19T05:19:20.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.352+0000 7fb12f2d0640 1 -- start start 2024-09-19T05:19:20.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.352+0000 7fb12f2d0640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1281009a0 0x7fb1281991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:20.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.352+0000 7fb12f2d0640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb128101340 0x7fb128199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:20.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.352+0000 7fb12f2d0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1281069b0 0x7fb1281a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:20.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.352+0000 7fb12f2d0640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb128110c70 con 0x7fb1281069b0 2024-09-19T05:19:20.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.352+0000 7fb12f2d0640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb128110af0 con 0x7fb1281009a0 2024-09-19T05:19:20.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.352+0000 7fb12f2d0640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb128110df0 con 0x7fb128101340 2024-09-19T05:19:20.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.353+0000 7fb12d86d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1281069b0 0x7fb1281a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:20.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.353+0000 7fb12d86d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1281069b0 0x7fb1281a4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48610/0 (socket says 172.21.15.120:48610) 2024-09-19T05:19:20.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.353+0000 7fb12d86d640 1 -- 172.21.15.120:0/1154007180 learned_addr learned my addr 172.21.15.120:0/1154007180 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:20.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.353+0000 7fb12c86b640 1 --2- 172.21.15.120:0/1154007180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb128101340 0x7fb128199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:20.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.353+0000 7fb12d06c640 1 --2- 172.21.15.120:0/1154007180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1281009a0 0x7fb1281991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:20.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.353+0000 7fb12d86d640 1 -- 172.21.15.120:0/1154007180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb128101340 msgr2=0x7fb128199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:20.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.353+0000 7fb12d86d640 1 --2- 172.21.15.120:0/1154007180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb128101340 0x7fb128199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.353+0000 7fb12d86d640 1 -- 172.21.15.120:0/1154007180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1281009a0 msgr2=0x7fb1281991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:20.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.353+0000 7fb12d86d640 1 --2- 172.21.15.120:0/1154007180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1281009a0 0x7fb1281991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.353+0000 7fb12d86d640 1 -- 172.21.15.120:0/1154007180 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1281a4780 con 0x7fb1281069b0 2024-09-19T05:19:20.361 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.353+0000 7fb12d86d640 1 --2- 172.21.15.120:0/1154007180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1281069b0 0x7fb1281a4240 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb12000eaa0 tx=0x7fb12000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:20.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.353+0000 7fb11e7fc640 1 -- 172.21.15.120:0/1154007180 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12000cdb0 con 0x7fb1281069b0 2024-09-19T05:19:20.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.353+0000 7fb12f2d0640 1 -- 172.21.15.120:0/1154007180 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1281a4950 con 0x7fb1281069b0 2024-09-19T05:19:20.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.353+0000 7fb11e7fc640 1 -- 172.21.15.120:0/1154007180 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb120005020 con 0x7fb1281069b0 2024-09-19T05:19:20.362 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.353+0000 7fb11e7fc640 1 -- 172.21.15.120:0/1154007180 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1200116d0 con 0x7fb1281069b0 2024-09-19T05:19:20.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.353+0000 7fb12f2d0640 1 -- 172.21.15.120:0/1154007180 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1281a4e20 con 0x7fb1281069b0 2024-09-19T05:19:20.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.354+0000 7fb12f2d0640 1 -- 172.21.15.120:0/1154007180 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb128100e00 con 0x7fb1281069b0 2024-09-19T05:19:20.363 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.355+0000 7fb11e7fc640 1 -- 172.21.15.120:0/1154007180 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7fb1200051d0 con 0x7fb1281069b0 2024-09-19T05:19:20.364 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.356+0000 7fb11e7fc640 1 --2- 172.21.15.120:0/1154007180 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fb1140a3450 0x7fb1140a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:20.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.356+0000 7fb12d06c640 1 --2- 172.21.15.120:0/1154007180 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fb1140a3450 0x7fb1140a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:20.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.356+0000 7fb11e7fc640 1 -- 172.21.15.120:0/1154007180 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fb1200d0060 con 0x7fb1281069b0 2024-09-19T05:19:20.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.356+0000 7fb12d06c640 1 --2- 172.21.15.120:0/1154007180 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fb1140a3450 0x7fb1140a5910 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb12400bb60 tx=0x7fb12400b390 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:20.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.360+0000 7fb11e7fc640 1 -- 172.21.15.120:0/1154007180 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb120016030 con 0x7fb1281069b0 2024-09-19T05:19:20.525 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.524+0000 7fb12f2d0640 1 -- 172.21.15.120:0/1154007180 --> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb128062630 con 0x7fb1140a3450 2024-09-19T05:19:20.531 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.530+0000 7fb11e7fc640 1 -- 172.21.15.120:0/1154007180 <== mgr.15156 v2:172.21.15.120:6800/1306632207 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257851 (secure 0 0 0) 0x7fb128062630 con 0x7fb1140a3450 2024-09-19T05:19:20.534 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:19:20.536 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2024-09-19T05:19:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.532+0000 7fb12f2d0640 1 -- 172.21.15.120:0/1154007180 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fb1140a3450 msgr2=0x7fb1140a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.532+0000 7fb12f2d0640 1 --2- 172.21.15.120:0/1154007180 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fb1140a3450 0x7fb1140a5910 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb12400bb60 tx=0x7fb12400b390 comp rx=0 tx=0).stop 2024-09-19T05:19:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.532+0000 7fb12f2d0640 1 -- 172.21.15.120:0/1154007180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1281069b0 msgr2=0x7fb1281a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.532+0000 7fb12f2d0640 1 --2- 172.21.15.120:0/1154007180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1281069b0 0x7fb1281a4240 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb12000eaa0 tx=0x7fb12000ef60 comp rx=0 tx=0).stop 2024-09-19T05:19:20.539 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.533+0000 7fb12f2d0640 1 -- 172.21.15.120:0/1154007180 shutdown_connections 2024-09-19T05:19:20.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.533+0000 7fb12f2d0640 1 --2- 172.21.15.120:0/1154007180 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fb1140a3450 0x7fb1140a5910 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.533+0000 7fb12f2d0640 1 --2- 172.21.15.120:0/1154007180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb1281069b0 0x7fb1281a4240 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.533+0000 7fb12f2d0640 1 --2- 172.21.15.120:0/1154007180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb128101340 0x7fb128199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.533+0000 7fb12f2d0640 1 --2- 172.21.15.120:0/1154007180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1281009a0 0x7fb1281991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:20.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.533+0000 7fb12f2d0640 1 -- 172.21.15.120:0/1154007180 >> 172.21.15.120:0/1154007180 conn(0x7fb1280fc6c0 msgr2=0x7fb1280fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:20.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.533+0000 7fb12f2d0640 1 -- 172.21.15.120:0/1154007180 shutdown_connections 2024-09-19T05:19:20.540 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:20.533+0000 7fb12f2d0640 1 -- 172.21.15.120:0/1154007180 wait complete. 2024-09-19T05:19:20.545 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2024-09-19T05:19:20.332265+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1183894,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":827,"num_read_kb":566,"num_write":472,"num_write_kb":4369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180792,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":865,"ondisk_log_size":865,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":396828,"kb_used_data":14204,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124544996,"statfs":{"total":1151940427776,"available":1151534075904,"internally_reserved":0,"allocated":14544896,"data_stored":8534415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":391492923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.992517"},"pg_stats":[{"pgid":"3.3f","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.370162+0000","last_change":"2024-09-19T05:17:30.200993+0000","last_active":"2024-09-19T05:19:14.370162+0000","last_peered":"2024-09-19T05:19:14.370162+0000","last_clean":"2024-09-19T05:19:14.370162+0000","last_became_active":"2024-09-19T05:17:30.200587+0000","last_became_peered":"2024-09-19T05:17:30.200587+0000","last_unstale":"2024-09-19T05:19:14.370162+0000","last_undegraded":"2024-09-19T05:19:14.370162+0000","last_fullsized":"2024-09-19T05:19:14.370162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:45:24.484844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.373616+0000","last_change":"2024-09-19T05:17:30.207784+0000","last_active":"2024-09-19T05:19:14.373616+0000","last_peered":"2024-09-19T05:19:14.373616+0000","last_clean":"2024-09-19T05:19:14.373616+0000","last_became_active":"2024-09-19T05:17:30.207485+0000","last_became_peered":"2024-09-19T05:17:30.207485+0000","last_unstale":"2024-09-19T05:19:14.373616+0000","last_undegraded":"2024-09-19T05:19:14.373616+0000","last_fullsized":"2024-09-19T05:19:14.373616+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:07.864813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.378421+0000","last_change":"2024-09-19T05:17:30.203861+0000","last_active":"2024-09-19T05:19:14.378421+0000","last_peered":"2024-09-19T05:19:14.378421+0000","last_clean":"2024-09-19T05:19:14.378421+0000","last_became_active":"2024-09-19T05:17:30.203541+0000","last_became_peered":"2024-09-19T05:17:30.203541+0000","last_unstale":"2024-09-19T05:19:14.378421+0000","last_undegraded":"2024-09-19T05:19:14.378421+0000","last_fullsized":"2024-09-19T05:19:14.378421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:33:44.840055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.364039+0000","last_change":"2024-09-19T05:17:30.214534+0000","last_active":"2024-09-19T05:19:14.364039+0000","last_peered":"2024-09-19T05:19:14.364039+0000","last_clean":"2024-09-19T05:19:14.364039+0000","last_became_active":"2024-09-19T05:17:30.213840+0000","last_became_peered":"2024-09-19T05:17:30.213840+0000","last_unstale":"2024-09-19T05:19:14.364039+0000","last_undegraded":"2024-09-19T05:19:14.364039+0000","last_fullsized":"2024-09-19T05:19:14.364039+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:03.673488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.366156+0000","last_change":"2024-09-19T05:17:30.201451+0000","last_active":"2024-09-19T05:19:14.366156+0000","last_peered":"2024-09-19T05:19:14.366156+0000","last_clean":"2024-09-19T05:19:14.366156+0000","last_became_active":"2024-09-19T05:17:30.201092+0000","last_became_peered":"2024-09-19T05:17:30.201092+0000","last_unstale":"2024-09-19T05:19:14.366156+0000","last_undegraded":"2024-09-19T05:19:14.366156+0000","last_fullsized":"2024-09-19T05:19:14.366156+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:19:18.958271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.369658+0000","last_change":"2024-09-19T05:17:49.506669+0000","last_active":"2024-09-19T05:19:14.369658+0000","last_peered":"2024-09-19T05:19:14.369658+0000","last_clean":"2024-09-19T05:19:14.369658+0000","last_became_active":"2024-09-19T05:17:49.506331+0000","last_became_peered":"2024-09-19T05:17:49.506331+0000","last_unstale":"2024-09-19T05:19:14.369658+0000","last_undegraded":"2024-09-19T05:19:14.369658+0000","last_fullsized":"2024-09-19T05:19:14.369658+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:23.460781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.369954+0000","last_change":"2024-09-19T05:17:49.506866+0000","last_active":"2024-09-19T05:19:14.369954+0000","last_peered":"2024-09-19T05:19:14.369954+0000","last_clean":"2024-09-19T05:19:14.369954+0000","last_became_active":"2024-09-19T05:17:49.506386+0000","last_became_peered":"2024-09-19T05:17:49.506386+0000","last_unstale":"2024-09-19T05:19:14.369954+0000","last_undegraded":"2024-09-19T05:19:14.369954+0000","last_fullsized":"2024-09-19T05:19:14.369954+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:04:17.060301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.370952+0000","last_change":"2024-09-19T05:17:30.210132+0000","last_active":"2024-09-19T05:19:14.370952+0000","last_peered":"2024-09-19T05:19:14.370952+0000","last_clean":"2024-09-19T05:19:14.370952+0000","last_became_active":"2024-09-19T05:17:30.209240+0000","last_became_peered":"2024-09-19T05:17:30.209240+0000","last_unstale":"2024-09-19T05:19:14.370952+0000","last_undegraded":"2024-09-19T05:19:14.370952+0000","last_fullsized":"2024-09-19T05:19:14.370952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:08:26.999751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.373235+0000","last_change":"2024-09-19T05:17:49.259291+0000","last_active":"2024-09-19T05:19:14.373235+0000","last_peered":"2024-09-19T05:19:14.373235+0000","last_clean":"2024-09-19T05:19:14.373235+0000","last_became_active":"2024-09-19T05:17:49.258948+0000","last_became_peered":"2024-09-19T05:17:49.258948+0000","last_unstale":"2024-09-19T05:19:14.373235+0000","last_undegraded":"2024-09-19T05:19:14.373235+0000","last_fullsized":"2024-09-19T05:19:14.373235+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:55:51.082539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,11],"acting":[9,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.366652+0000","last_change":"2024-09-19T05:17:30.205429+0000","last_active":"2024-09-19T05:19:14.366652+0000","last_peered":"2024-09-19T05:19:14.366652+0000","last_clean":"2024-09-19T05:19:14.366652+0000","last_became_active":"2024-09-19T05:17:30.205094+0000","last_became_peered":"2024-09-19T05:17:30.205094+0000","last_unstale":"2024-09-19T05:19:14.366652+0000","last_undegraded":"2024-09-19T05:19:14.366652+0000","last_fullsized":"2024-09-19T05:19:14.366652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:22.149473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.366517+0000","last_change":"2024-09-19T05:17:30.213050+0000","last_active":"2024-09-19T05:19:14.366517+0000","last_peered":"2024-09-19T05:19:14.366517+0000","last_clean":"2024-09-19T05:19:14.366517+0000","last_became_active":"2024-09-19T05:17:30.211812+0000","last_became_peered":"2024-09-19T05:17:30.211812+0000","last_unstale":"2024-09-19T05:19:14.366517+0000","last_undegraded":"2024-09-19T05:19:14.366517+0000","last_fullsized":"2024-09-19T05:19:14.366517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:31.734317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.363598+0000","last_change":"2024-09-19T05:17:30.212049+0000","last_active":"2024-09-19T05:19:14.363598+0000","last_peered":"2024-09-19T05:19:14.363598+0000","last_clean":"2024-09-19T05:19:14.363598+0000","last_became_active":"2024-09-19T05:17:30.211684+0000","last_became_peered":"2024-09-19T05:17:30.211684+0000","last_unstale":"2024-09-19T05:19:14.363598+0000","last_undegraded":"2024-09-19T05:19:14.363598+0000","last_fullsized":"2024-09-19T05:19:14.363598+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:17:24.781815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.370902+0000","last_change":"2024-09-19T05:17:30.191898+0000","last_active":"2024-09-19T05:19:14.370902+0000","last_peered":"2024-09-19T05:19:14.370902+0000","last_clean":"2024-09-19T05:19:14.370902+0000","last_became_active":"2024-09-19T05:17:30.191204+0000","last_became_peered":"2024-09-19T05:17:30.191204+0000","last_unstale":"2024-09-19T05:19:14.370902+0000","last_undegraded":"2024-09-19T05:19:14.370902+0000","last_fullsized":"2024-09-19T05:19:14.370902+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:19.043363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.380427+0000","last_change":"2024-09-19T05:17:30.201754+0000","last_active":"2024-09-19T05:19:14.380427+0000","last_peered":"2024-09-19T05:19:14.380427+0000","last_clean":"2024-09-19T05:19:14.380427+0000","last_became_active":"2024-09-19T05:17:30.201439+0000","last_became_peered":"2024-09-19T05:17:30.201439+0000","last_unstale":"2024-09-19T05:19:14.380427+0000","last_undegraded":"2024-09-19T05:19:14.380427+0000","last_fullsized":"2024-09-19T05:19:14.380427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:28.896899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.380449+0000","last_change":"2024-09-19T05:17:30.202618+0000","last_active":"2024-09-19T05:19:14.380449+0000","last_peered":"2024-09-19T05:19:14.380449+0000","last_clean":"2024-09-19T05:19:14.380449+0000","last_became_active":"2024-09-19T05:17:30.202292+0000","last_became_peered":"2024-09-19T05:17:30.202292+0000","last_unstale":"2024-09-19T05:19:14.380449+0000","last_undegraded":"2024-09-19T05:19:14.380449+0000","last_fullsized":"2024-09-19T05:19:14.380449+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:54.206467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.379528+0000","last_change":"2024-09-19T05:17:30.209411+0000","last_active":"2024-09-19T05:19:14.379528+0000","last_peered":"2024-09-19T05:19:14.379528+0000","last_clean":"2024-09-19T05:19:14.379528+0000","last_became_active":"2024-09-19T05:17:30.208525+0000","last_became_peered":"2024-09-19T05:17:30.208525+0000","last_unstale":"2024-09-19T05:19:14.379528+0000","last_undegraded":"2024-09-19T05:19:14.379528+0000","last_fullsized":"2024-09-19T05:19:14.379528+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:12:16.616413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.372583+0000","last_change":"2024-09-19T05:17:30.203552+0000","last_active":"2024-09-19T05:19:14.372583+0000","last_peered":"2024-09-19T05:19:14.372583+0000","last_clean":"2024-09-19T05:19:14.372583+0000","last_became_active":"2024-09-19T05:17:30.203212+0000","last_became_peered":"2024-09-19T05:17:30.203212+0000","last_unstale":"2024-09-19T05:19:14.372583+0000","last_undegraded":"2024-09-19T05:19:14.372583+0000","last_fullsized":"2024-09-19T05:19:14.372583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:38:50.948373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.373959+0000","last_change":"2024-09-19T05:17:30.201540+0000","last_active":"2024-09-19T05:19:14.373959+0000","last_peered":"2024-09-19T05:19:14.373959+0000","last_clean":"2024-09-19T05:19:14.373959+0000","last_became_active":"2024-09-19T05:17:30.201222+0000","last_became_peered":"2024-09-19T05:17:30.201222+0000","last_unstale":"2024-09-19T05:19:14.373959+0000","last_undegraded":"2024-09-19T05:19:14.373959+0000","last_fullsized":"2024-09-19T05:19:14.373959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:31:09.583473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.371510+0000","last_change":"2024-09-19T05:17:30.205962+0000","last_active":"2024-09-19T05:19:14.371510+0000","last_peered":"2024-09-19T05:19:14.371510+0000","last_clean":"2024-09-19T05:19:14.371510+0000","last_became_active":"2024-09-19T05:17:30.205632+0000","last_became_peered":"2024-09-19T05:17:30.205632+0000","last_unstale":"2024-09-19T05:19:14.371510+0000","last_undegraded":"2024-09-19T05:19:14.371510+0000","last_fullsized":"2024-09-19T05:19:14.371510+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:07.767502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.368765+0000","last_change":"2024-09-19T05:17:30.208546+0000","last_active":"2024-09-19T05:19:14.368765+0000","last_peered":"2024-09-19T05:19:14.368765+0000","last_clean":"2024-09-19T05:19:14.368765+0000","last_became_active":"2024-09-19T05:17:30.208220+0000","last_became_peered":"2024-09-19T05:17:30.208220+0000","last_unstale":"2024-09-19T05:19:14.368765+0000","last_undegraded":"2024-09-19T05:19:14.368765+0000","last_fullsized":"2024-09-19T05:19:14.368765+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:46:32.360282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.381277+0000","last_change":"2024-09-19T05:17:30.204653+0000","last_active":"2024-09-19T05:19:14.381277+0000","last_peered":"2024-09-19T05:19:14.381277+0000","last_clean":"2024-09-19T05:19:14.381277+0000","last_became_active":"2024-09-19T05:17:30.204335+0000","last_became_peered":"2024-09-19T05:17:30.204335+0000","last_unstale":"2024-09-19T05:19:14.381277+0000","last_undegraded":"2024-09-19T05:19:14.381277+0000","last_fullsized":"2024-09-19T05:19:14.381277+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:48.661902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.369702+0000","last_change":"2024-09-19T05:17:49.261216+0000","last_active":"2024-09-19T05:19:14.369702+0000","last_peered":"2024-09-19T05:19:14.369702+0000","last_clean":"2024-09-19T05:19:14.369702+0000","last_became_active":"2024-09-19T05:17:49.260691+0000","last_became_peered":"2024-09-19T05:17:49.260691+0000","last_unstale":"2024-09-19T05:19:14.369702+0000","last_undegraded":"2024-09-19T05:19:14.369702+0000","last_fullsized":"2024-09-19T05:19:14.369702+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:35.937669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,6],"acting":[1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.369686+0000","last_change":"2024-09-19T05:17:30.201935+0000","last_active":"2024-09-19T05:19:14.369686+0000","last_peered":"2024-09-19T05:19:14.369686+0000","last_clean":"2024-09-19T05:19:14.369686+0000","last_became_active":"2024-09-19T05:17:30.201524+0000","last_became_peered":"2024-09-19T05:17:30.201524+0000","last_unstale":"2024-09-19T05:19:14.369686+0000","last_undegraded":"2024-09-19T05:19:14.369686+0000","last_fullsized":"2024-09-19T05:19:14.369686+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:34.018339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.368920+0000","last_change":"2024-09-19T05:17:49.506519+0000","last_active":"2024-09-19T05:19:14.368920+0000","last_peered":"2024-09-19T05:19:14.368920+0000","last_clean":"2024-09-19T05:19:14.368920+0000","last_became_active":"2024-09-19T05:17:49.506016+0000","last_became_peered":"2024-09-19T05:17:49.506016+0000","last_unstale":"2024-09-19T05:19:14.368920+0000","last_undegraded":"2024-09-19T05:19:14.368920+0000","last_fullsized":"2024-09-19T05:19:14.368920+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:31.064318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,8],"acting":[5,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.367932+0000","last_change":"2024-09-19T05:17:30.205459+0000","last_active":"2024-09-19T05:19:14.367932+0000","last_peered":"2024-09-19T05:19:14.367932+0000","last_clean":"2024-09-19T05:19:14.367932+0000","last_became_active":"2024-09-19T05:17:30.205100+0000","last_became_peered":"2024-09-19T05:17:30.205100+0000","last_unstale":"2024-09-19T05:19:14.367932+0000","last_undegraded":"2024-09-19T05:19:14.367932+0000","last_fullsized":"2024-09-19T05:19:14.367932+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:35.246931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.363472+0000","last_change":"2024-09-19T05:17:30.202812+0000","last_active":"2024-09-19T05:19:14.363472+0000","last_peered":"2024-09-19T05:19:14.363472+0000","last_clean":"2024-09-19T05:19:14.363472+0000","last_became_active":"2024-09-19T05:17:30.202477+0000","last_became_peered":"2024-09-19T05:17:30.202477+0000","last_unstale":"2024-09-19T05:19:14.363472+0000","last_undegraded":"2024-09-19T05:19:14.363472+0000","last_fullsized":"2024-09-19T05:19:14.363472+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:20:24.253576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.368403+0000","last_change":"2024-09-19T05:17:30.206546+0000","last_active":"2024-09-19T05:19:14.368403+0000","last_peered":"2024-09-19T05:19:14.368403+0000","last_clean":"2024-09-19T05:19:14.368403+0000","last_became_active":"2024-09-19T05:17:30.206186+0000","last_became_peered":"2024-09-19T05:17:30.206186+0000","last_unstale":"2024-09-19T05:19:14.368403+0000","last_undegraded":"2024-09-19T05:19:14.368403+0000","last_fullsized":"2024-09-19T05:19:14.368403+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:30.589196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.380979+0000","last_change":"2024-09-19T05:17:30.213894+0000","last_active":"2024-09-19T05:19:14.380979+0000","last_peered":"2024-09-19T05:19:14.380979+0000","last_clean":"2024-09-19T05:19:14.380979+0000","last_became_active":"2024-09-19T05:17:30.213586+0000","last_became_peered":"2024-09-19T05:17:30.213586+0000","last_unstale":"2024-09-19T05:19:14.380979+0000","last_undegraded":"2024-09-19T05:19:14.380979+0000","last_fullsized":"2024-09-19T05:19:14.380979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:46.215816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.378292+0000","last_change":"2024-09-19T05:17:49.262965+0000","last_active":"2024-09-19T05:19:14.378292+0000","last_peered":"2024-09-19T05:19:14.378292+0000","last_clean":"2024-09-19T05:19:14.378292+0000","last_became_active":"2024-09-19T05:17:49.262651+0000","last_became_peered":"2024-09-19T05:17:49.262651+0000","last_unstale":"2024-09-19T05:19:14.378292+0000","last_undegraded":"2024-09-19T05:19:14.378292+0000","last_fullsized":"2024-09-19T05:19:14.378292+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:57.601031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,7],"acting":[0,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.370960+0000","last_change":"2024-09-19T05:17:30.204302+0000","last_active":"2024-09-19T05:19:14.370960+0000","last_peered":"2024-09-19T05:19:14.370960+0000","last_clean":"2024-09-19T05:19:14.370960+0000","last_became_active":"2024-09-19T05:17:30.203981+0000","last_became_peered":"2024-09-19T05:17:30.203981+0000","last_unstale":"2024-09-19T05:19:14.370960+0000","last_undegraded":"2024-09-19T05:19:14.370960+0000","last_fullsized":"2024-09-19T05:19:14.370960+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:07:59.130439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.362907+0000","last_change":"2024-09-19T05:17:30.210610+0000","last_active":"2024-09-19T05:19:14.362907+0000","last_peered":"2024-09-19T05:19:14.362907+0000","last_clean":"2024-09-19T05:19:14.362907+0000","last_became_active":"2024-09-19T05:17:30.210231+0000","last_became_peered":"2024-09-19T05:17:30.210231+0000","last_unstale":"2024-09-19T05:19:14.362907+0000","last_undegraded":"2024-09-19T05:19:14.362907+0000","last_fullsized":"2024-09-19T05:19:14.362907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:37:41.885822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.367323+0000","last_change":"2024-09-19T05:17:30.210755+0000","last_active":"2024-09-19T05:19:14.367323+0000","last_peered":"2024-09-19T05:19:14.367323+0000","last_clean":"2024-09-19T05:19:14.367323+0000","last_became_active":"2024-09-19T05:17:30.210383+0000","last_became_peered":"2024-09-19T05:17:30.210383+0000","last_unstale":"2024-09-19T05:19:14.367323+0000","last_undegraded":"2024-09-19T05:19:14.367323+0000","last_fullsized":"2024-09-19T05:19:14.367323+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:11.259830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.366895+0000","last_change":"2024-09-19T05:17:30.206345+0000","last_active":"2024-09-19T05:19:14.366895+0000","last_peered":"2024-09-19T05:19:14.366895+0000","last_clean":"2024-09-19T05:19:14.366895+0000","last_became_active":"2024-09-19T05:17:30.205988+0000","last_became_peered":"2024-09-19T05:17:30.205988+0000","last_unstale":"2024-09-19T05:19:14.366895+0000","last_undegraded":"2024-09-19T05:19:14.366895+0000","last_fullsized":"2024-09-19T05:19:14.366895+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:57.538280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"85'8","reported_seq":134,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.567917+0000","last_change":"2024-09-19T05:17:28.183851+0000","last_active":"2024-09-19T05:19:14.567917+0000","last_peered":"2024-09-19T05:19:14.567917+0000","last_clean":"2024-09-19T05:19:14.567917+0000","last_became_active":"2024-09-19T05:17:28.183472+0000","last_became_peered":"2024-09-19T05:17:28.183472+0000","last_unstale":"2024-09-19T05:19:14.567917+0000","last_undegraded":"2024-09-19T05:19:14.567917+0000","last_fullsized":"2024-09-19T05:19:14.567917+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:56:22.942306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1903,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":3,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.361590+0000","last_change":"2024-09-19T05:17:30.208784+0000","last_active":"2024-09-19T05:19:14.361590+0000","last_peered":"2024-09-19T05:19:14.361590+0000","last_clean":"2024-09-19T05:19:14.361590+0000","last_became_active":"2024-09-19T05:17:30.208232+0000","last_became_peered":"2024-09-19T05:17:30.208232+0000","last_unstale":"2024-09-19T05:19:14.361590+0000","last_undegraded":"2024-09-19T05:19:14.361590+0000","last_fullsized":"2024-09-19T05:19:14.361590+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:07.670401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.328791+0000","last_change":"2024-09-19T05:17:28.181480+0000","last_active":"2024-09-19T05:19:14.328791+0000","last_peered":"2024-09-19T05:19:14.328791+0000","last_clean":"2024-09-19T05:19:14.328791+0000","last_became_active":"2024-09-19T05:17:28.181169+0000","last_became_peered":"2024-09-19T05:17:28.181169+0000","last_unstale":"2024-09-19T05:19:14.328791+0000","last_undegraded":"2024-09-19T05:19:14.328791+0000","last_fullsized":"2024-09-19T05:19:14.328791+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:09.590408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.319464+0000","last_change":"2024-09-19T05:17:28.180636+0000","last_active":"2024-09-19T05:19:14.319464+0000","last_peered":"2024-09-19T05:19:14.319464+0000","last_clean":"2024-09-19T05:19:14.319464+0000","last_became_active":"2024-09-19T05:17:28.180298+0000","last_became_peered":"2024-09-19T05:17:28.180298+0000","last_unstale":"2024-09-19T05:19:14.319464+0000","last_undegraded":"2024-09-19T05:19:14.319464+0000","last_fullsized":"2024-09-19T05:19:14.319464+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:06.361677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.373807+0000","last_change":"2024-09-19T05:17:30.199091+0000","last_active":"2024-09-19T05:19:14.373807+0000","last_peered":"2024-09-19T05:19:14.373807+0000","last_clean":"2024-09-19T05:19:14.373807+0000","last_became_active":"2024-09-19T05:17:30.198805+0000","last_became_peered":"2024-09-19T05:17:30.198805+0000","last_unstale":"2024-09-19T05:19:14.373807+0000","last_undegraded":"2024-09-19T05:19:14.373807+0000","last_fullsized":"2024-09-19T05:19:14.373807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:27.906713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.324437+0000","last_change":"2024-09-19T05:17:28.182281+0000","last_active":"2024-09-19T05:19:14.324437+0000","last_peered":"2024-09-19T05:19:14.324437+0000","last_clean":"2024-09-19T05:19:14.324437+0000","last_became_active":"2024-09-19T05:17:28.181939+0000","last_became_peered":"2024-09-19T05:17:28.181939+0000","last_unstale":"2024-09-19T05:19:14.324437+0000","last_undegraded":"2024-09-19T05:19:14.324437+0000","last_fullsized":"2024-09-19T05:19:14.324437+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:12.057601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.378802+0000","last_change":"2024-09-19T05:17:30.198849+0000","last_active":"2024-09-19T05:19:14.378802+0000","last_peered":"2024-09-19T05:19:14.378802+0000","last_clean":"2024-09-19T05:19:14.378802+0000","last_became_active":"2024-09-19T05:17:30.198473+0000","last_became_peered":"2024-09-19T05:17:30.198473+0000","last_unstale":"2024-09-19T05:19:14.378802+0000","last_undegraded":"2024-09-19T05:19:14.378802+0000","last_fullsized":"2024-09-19T05:19:14.378802+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:20.591516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":127,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.329041+0000","last_change":"2024-09-19T05:17:28.181393+0000","last_active":"2024-09-19T05:19:14.329041+0000","last_peered":"2024-09-19T05:19:14.329041+0000","last_clean":"2024-09-19T05:19:14.329041+0000","last_became_active":"2024-09-19T05:17:28.181069+0000","last_became_peered":"2024-09-19T05:17:28.181069+0000","last_unstale":"2024-09-19T05:19:14.329041+0000","last_undegraded":"2024-09-19T05:19:14.329041+0000","last_fullsized":"2024-09-19T05:19:14.329041+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:15.684564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.367286+0000","last_change":"2024-09-19T05:17:30.204968+0000","last_active":"2024-09-19T05:19:14.367286+0000","last_peered":"2024-09-19T05:19:14.367286+0000","last_clean":"2024-09-19T05:19:14.367286+0000","last_became_active":"2024-09-19T05:17:30.204613+0000","last_became_peered":"2024-09-19T05:17:30.204613+0000","last_unstale":"2024-09-19T05:19:14.367286+0000","last_undegraded":"2024-09-19T05:19:14.367286+0000","last_fullsized":"2024-09-19T05:19:14.367286+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:14.836220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.334835+0000","last_change":"2024-09-19T05:17:28.185554+0000","last_active":"2024-09-19T05:19:14.334835+0000","last_peered":"2024-09-19T05:19:14.334835+0000","last_clean":"2024-09-19T05:19:14.334835+0000","last_became_active":"2024-09-19T05:17:28.185198+0000","last_became_peered":"2024-09-19T05:17:28.185198+0000","last_unstale":"2024-09-19T05:19:14.334835+0000","last_undegraded":"2024-09-19T05:19:14.334835+0000","last_fullsized":"2024-09-19T05:19:14.334835+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:59.753359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.381217+0000","last_change":"2024-09-19T05:17:30.207418+0000","last_active":"2024-09-19T05:19:14.381217+0000","last_peered":"2024-09-19T05:19:14.381217+0000","last_clean":"2024-09-19T05:19:14.381217+0000","last_became_active":"2024-09-19T05:17:30.207079+0000","last_became_peered":"2024-09-19T05:17:30.207079+0000","last_unstale":"2024-09-19T05:19:14.381217+0000","last_undegraded":"2024-09-19T05:19:14.381217+0000","last_fullsized":"2024-09-19T05:19:14.381217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:40:49.564649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.324446+0000","last_change":"2024-09-19T05:17:28.204988+0000","last_active":"2024-09-19T05:19:14.324446+0000","last_peered":"2024-09-19T05:19:14.324446+0000","last_clean":"2024-09-19T05:19:14.324446+0000","last_became_active":"2024-09-19T05:17:28.204607+0000","last_became_peered":"2024-09-19T05:17:28.204607+0000","last_unstale":"2024-09-19T05:19:14.324446+0000","last_undegraded":"2024-09-19T05:19:14.324446+0000","last_fullsized":"2024-09-19T05:19:14.324446+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:36:17.914720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.360899+0000","last_change":"2024-09-19T05:17:30.207876+0000","last_active":"2024-09-19T05:19:14.360899+0000","last_peered":"2024-09-19T05:19:14.360899+0000","last_clean":"2024-09-19T05:19:14.360899+0000","last_became_active":"2024-09-19T05:17:30.207561+0000","last_became_peered":"2024-09-19T05:17:30.207561+0000","last_unstale":"2024-09-19T05:19:14.360899+0000","last_undegraded":"2024-09-19T05:19:14.360899+0000","last_fullsized":"2024-09-19T05:19:14.360899+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:26.696949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'35","reported_seq":263,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.565678+0000","last_change":"2024-09-19T05:17:28.185152+0000","last_active":"2024-09-19T05:19:14.565678+0000","last_peered":"2024-09-19T05:19:14.565678+0000","last_clean":"2024-09-19T05:19:14.565678+0000","last_became_active":"2024-09-19T05:17:28.184792+0000","last_became_peered":"2024-09-19T05:17:28.184792+0000","last_unstale":"2024-09-19T05:19:14.565678+0000","last_undegraded":"2024-09-19T05:19:14.565678+0000","last_fullsized":"2024-09-19T05:19:14.565678+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:04.647138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62697,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":200,"num_read_kb":159,"num_write":36,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.366762+0000","last_change":"2024-09-19T05:17:30.209768+0000","last_active":"2024-09-19T05:19:14.366762+0000","last_peered":"2024-09-19T05:19:14.366762+0000","last_clean":"2024-09-19T05:19:14.366762+0000","last_became_active":"2024-09-19T05:17:30.209399+0000","last_became_peered":"2024-09-19T05:17:30.209399+0000","last_unstale":"2024-09-19T05:19:14.366762+0000","last_undegraded":"2024-09-19T05:19:14.366762+0000","last_fullsized":"2024-09-19T05:19:14.366762+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:58.664138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.336911+0000","last_change":"2024-09-19T05:17:49.269241+0000","last_active":"2024-09-19T05:19:14.336911+0000","last_peered":"2024-09-19T05:19:14.336911+0000","last_clean":"2024-09-19T05:19:14.336911+0000","last_became_active":"2024-09-19T05:17:49.259494+0000","last_became_peered":"2024-09-19T05:17:49.259494+0000","last_unstale":"2024-09-19T05:19:14.336911+0000","last_undegraded":"2024-09-19T05:19:14.336911+0000","last_fullsized":"2024-09-19T05:19:14.336911+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:59.866742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.371429+0000","last_change":"2024-09-19T05:17:30.204554+0000","last_active":"2024-09-19T05:19:14.371429+0000","last_peered":"2024-09-19T05:19:14.371429+0000","last_clean":"2024-09-19T05:19:14.371429+0000","last_became_active":"2024-09-19T05:17:30.203166+0000","last_became_peered":"2024-09-19T05:17:30.203166+0000","last_unstale":"2024-09-19T05:19:14.371429+0000","last_undegraded":"2024-09-19T05:19:14.371429+0000","last_fullsized":"2024-09-19T05:19:14.371429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:23.517869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.324236+0000","last_change":"2024-09-19T05:17:28.183800+0000","last_active":"2024-09-19T05:19:14.324236+0000","last_peered":"2024-09-19T05:19:14.324236+0000","last_clean":"2024-09-19T05:19:14.324236+0000","last_became_active":"2024-09-19T05:17:28.182819+0000","last_became_peered":"2024-09-19T05:17:28.182819+0000","last_unstale":"2024-09-19T05:19:14.324236+0000","last_undegraded":"2024-09-19T05:19:14.324236+0000","last_fullsized":"2024-09-19T05:19:14.324236+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:44:52.215544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.371794+0000","last_change":"2024-09-19T05:17:30.214723+0000","last_active":"2024-09-19T05:19:14.371794+0000","last_peered":"2024-09-19T05:19:14.371794+0000","last_clean":"2024-09-19T05:19:14.371794+0000","last_became_active":"2024-09-19T05:17:30.214343+0000","last_became_peered":"2024-09-19T05:17:30.214343+0000","last_unstale":"2024-09-19T05:19:14.371794+0000","last_undegraded":"2024-09-19T05:19:14.371794+0000","last_fullsized":"2024-09-19T05:19:14.371794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:13.008151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":131,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.397070+0000","last_change":"2024-09-19T05:17:28.183130+0000","last_active":"2024-09-19T05:19:14.397070+0000","last_peered":"2024-09-19T05:19:14.397070+0000","last_clean":"2024-09-19T05:19:14.397070+0000","last_became_active":"2024-09-19T05:17:28.182834+0000","last_became_peered":"2024-09-19T05:17:28.182834+0000","last_unstale":"2024-09-19T05:19:14.397070+0000","last_undegraded":"2024-09-19T05:19:14.397070+0000","last_fullsized":"2024-09-19T05:19:14.397070+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:28:48.683776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1476,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":4,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.358821+0000","last_change":"2024-09-19T05:17:30.212438+0000","last_active":"2024-09-19T05:19:14.358821+0000","last_peered":"2024-09-19T05:19:14.358821+0000","last_clean":"2024-09-19T05:19:14.358821+0000","last_became_active":"2024-09-19T05:17:30.209321+0000","last_became_peered":"2024-09-19T05:17:30.209321+0000","last_unstale":"2024-09-19T05:19:14.358821+0000","last_undegraded":"2024-09-19T05:19:14.358821+0000","last_fullsized":"2024-09-19T05:19:14.358821+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:42.772116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.341323+0000","last_change":"2024-09-19T05:17:28.204665+0000","last_active":"2024-09-19T05:19:14.341323+0000","last_peered":"2024-09-19T05:19:14.341323+0000","last_clean":"2024-09-19T05:19:14.341323+0000","last_became_active":"2024-09-19T05:17:28.204309+0000","last_became_peered":"2024-09-19T05:17:28.204309+0000","last_unstale":"2024-09-19T05:19:14.341323+0000","last_undegraded":"2024-09-19T05:19:14.341323+0000","last_fullsized":"2024-09-19T05:19:14.341323+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:26.372762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.357482+0000","last_change":"2024-09-19T05:17:30.208518+0000","last_active":"2024-09-19T05:19:14.357482+0000","last_peered":"2024-09-19T05:19:14.357482+0000","last_clean":"2024-09-19T05:19:14.357482+0000","last_became_active":"2024-09-19T05:17:30.208172+0000","last_became_peered":"2024-09-19T05:17:30.208172+0000","last_unstale":"2024-09-19T05:19:14.357482+0000","last_undegraded":"2024-09-19T05:19:14.357482+0000","last_fullsized":"2024-09-19T05:19:14.357482+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:40:25.754925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.339207+0000","last_change":"2024-09-19T05:18:50.249627+0000","last_active":"2024-09-19T05:19:14.339207+0000","last_peered":"2024-09-19T05:19:14.339207+0000","last_clean":"2024-09-19T05:19:14.339207+0000","last_became_active":"2024-09-19T05:18:50.245759+0000","last_became_peered":"2024-09-19T05:18:50.245759+0000","last_unstale":"2024-09-19T05:19:14.339207+0000","last_undegraded":"2024-09-19T05:19:14.339207+0000","last_fullsized":"2024-09-19T05:19:14.339207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:45:59.039812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.364525+0000","last_change":"2024-09-19T05:17:30.207002+0000","last_active":"2024-09-19T05:19:14.364525+0000","last_peered":"2024-09-19T05:19:14.364525+0000","last_clean":"2024-09-19T05:19:14.364525+0000","last_became_active":"2024-09-19T05:17:30.205750+0000","last_became_peered":"2024-09-19T05:17:30.205750+0000","last_unstale":"2024-09-19T05:19:14.364525+0000","last_undegraded":"2024-09-19T05:19:14.364525+0000","last_fullsized":"2024-09-19T05:19:14.364525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:25:18.716206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.319837+0000","last_change":"2024-09-19T05:17:28.184071+0000","last_active":"2024-09-19T05:19:14.319837+0000","last_peered":"2024-09-19T05:19:14.319837+0000","last_clean":"2024-09-19T05:19:14.319837+0000","last_became_active":"2024-09-19T05:17:28.183708+0000","last_became_peered":"2024-09-19T05:17:28.183708+0000","last_unstale":"2024-09-19T05:19:14.319837+0000","last_undegraded":"2024-09-19T05:19:14.319837+0000","last_fullsized":"2024-09-19T05:19:14.319837+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:57:23.831000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.366633+0000","last_change":"2024-09-19T05:17:30.211919+0000","last_active":"2024-09-19T05:19:14.366633+0000","last_peered":"2024-09-19T05:19:14.366633+0000","last_clean":"2024-09-19T05:19:14.366633+0000","last_became_active":"2024-09-19T05:17:30.210639+0000","last_became_peered":"2024-09-19T05:17:30.210639+0000","last_unstale":"2024-09-19T05:19:14.366633+0000","last_undegraded":"2024-09-19T05:19:14.366633+0000","last_fullsized":"2024-09-19T05:19:14.366633+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:25.231732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'39","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.533319+0000","last_change":"2024-09-19T05:17:28.179372+0000","last_active":"2024-09-19T05:19:14.533319+0000","last_peered":"2024-09-19T05:19:14.533319+0000","last_clean":"2024-09-19T05:19:14.533319+0000","last_became_active":"2024-09-19T05:17:28.178792+0000","last_became_peered":"2024-09-19T05:17:28.178792+0000","last_unstale":"2024-09-19T05:19:14.533319+0000","last_undegraded":"2024-09-19T05:19:14.533319+0000","last_fullsized":"2024-09-19T05:19:14.533319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:54.705552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.358807+0000","last_change":"2024-09-19T05:17:30.208201+0000","last_active":"2024-09-19T05:19:14.358807+0000","last_peered":"2024-09-19T05:19:14.358807+0000","last_clean":"2024-09-19T05:19:14.358807+0000","last_became_active":"2024-09-19T05:17:30.207865+0000","last_became_peered":"2024-09-19T05:17:30.207865+0000","last_unstale":"2024-09-19T05:19:14.358807+0000","last_undegraded":"2024-09-19T05:19:14.358807+0000","last_fullsized":"2024-09-19T05:19:14.358807+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:12:35.954759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.331163+0000","last_change":"2024-09-19T05:17:28.543685+0000","last_active":"2024-09-19T05:19:14.331163+0000","last_peered":"2024-09-19T05:19:14.331163+0000","last_clean":"2024-09-19T05:19:14.331163+0000","last_became_active":"2024-09-19T05:17:28.543292+0000","last_became_peered":"2024-09-19T05:17:28.543292+0000","last_unstale":"2024-09-19T05:19:14.331163+0000","last_undegraded":"2024-09-19T05:19:14.331163+0000","last_fullsized":"2024-09-19T05:19:14.331163+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:55:14.348544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.362322+0000","last_change":"2024-09-19T05:17:30.212449+0000","last_active":"2024-09-19T05:19:14.362322+0000","last_peered":"2024-09-19T05:19:14.362322+0000","last_clean":"2024-09-19T05:19:14.362322+0000","last_became_active":"2024-09-19T05:17:30.211265+0000","last_became_peered":"2024-09-19T05:17:30.211265+0000","last_unstale":"2024-09-19T05:19:14.362322+0000","last_undegraded":"2024-09-19T05:19:14.362322+0000","last_fullsized":"2024-09-19T05:19:14.362322+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:27.687687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":353,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.333999+0000","last_change":"2024-09-19T05:16:20.361975+0000","last_active":"2024-09-19T05:19:14.333999+0000","last_peered":"2024-09-19T05:19:14.333999+0000","last_clean":"2024-09-19T05:19:14.333999+0000","last_became_active":"2024-09-19T05:16:20.361553+0000","last_became_peered":"2024-09-19T05:16:20.361553+0000","last_unstale":"2024-09-19T05:19:14.333999+0000","last_undegraded":"2024-09-19T05:19:14.333999+0000","last_fullsized":"2024-09-19T05:19:14.333999+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:13:02.674575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:13:02.674575+0000","last_clean_scrub_stamp":"2024-09-19T05:13:02.674575+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:09:48.711411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.320831+0000","last_change":"2024-09-19T05:17:28.180486+0000","last_active":"2024-09-19T05:19:14.320831+0000","last_peered":"2024-09-19T05:19:14.320831+0000","last_clean":"2024-09-19T05:19:14.320831+0000","last_became_active":"2024-09-19T05:17:28.180147+0000","last_became_peered":"2024-09-19T05:17:28.180147+0000","last_unstale":"2024-09-19T05:19:14.320831+0000","last_undegraded":"2024-09-19T05:19:14.320831+0000","last_fullsized":"2024-09-19T05:19:14.320831+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:57.820328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.372815+0000","last_change":"2024-09-19T05:17:30.205560+0000","last_active":"2024-09-19T05:19:14.372815+0000","last_peered":"2024-09-19T05:19:14.372815+0000","last_clean":"2024-09-19T05:19:14.372815+0000","last_became_active":"2024-09-19T05:17:30.205269+0000","last_became_peered":"2024-09-19T05:17:30.205269+0000","last_unstale":"2024-09-19T05:19:14.372815+0000","last_undegraded":"2024-09-19T05:19:14.372815+0000","last_fullsized":"2024-09-19T05:19:14.372815+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:22.904616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.333965+0000","last_change":"2024-09-19T05:17:28.181845+0000","last_active":"2024-09-19T05:19:14.333965+0000","last_peered":"2024-09-19T05:19:14.333965+0000","last_clean":"2024-09-19T05:19:14.333965+0000","last_became_active":"2024-09-19T05:17:28.181549+0000","last_became_peered":"2024-09-19T05:17:28.181549+0000","last_unstale":"2024-09-19T05:19:14.333965+0000","last_undegraded":"2024-09-19T05:19:14.333965+0000","last_fullsized":"2024-09-19T05:19:14.333965+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:01.222364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.364544+0000","last_change":"2024-09-19T05:17:49.259631+0000","last_active":"2024-09-19T05:19:14.364544+0000","last_peered":"2024-09-19T05:19:14.364544+0000","last_clean":"2024-09-19T05:19:14.364544+0000","last_became_active":"2024-09-19T05:17:49.259240+0000","last_became_peered":"2024-09-19T05:17:49.259240+0000","last_unstale":"2024-09-19T05:19:14.364544+0000","last_undegraded":"2024-09-19T05:19:14.364544+0000","last_fullsized":"2024-09-19T05:19:14.364544+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:22.533248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":128,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.380727+0000","last_change":"2024-09-19T05:17:28.204924+0000","last_active":"2024-09-19T05:19:14.380727+0000","last_peered":"2024-09-19T05:19:14.380727+0000","last_clean":"2024-09-19T05:19:14.380727+0000","last_became_active":"2024-09-19T05:17:28.204602+0000","last_became_peered":"2024-09-19T05:17:28.204602+0000","last_unstale":"2024-09-19T05:19:14.380727+0000","last_undegraded":"2024-09-19T05:19:14.380727+0000","last_fullsized":"2024-09-19T05:19:14.380727+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:13.303939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.369736+0000","last_change":"2024-09-19T05:17:49.259147+0000","last_active":"2024-09-19T05:19:14.369736+0000","last_peered":"2024-09-19T05:19:14.369736+0000","last_clean":"2024-09-19T05:19:14.369736+0000","last_became_active":"2024-09-19T05:17:49.258666+0000","last_became_peered":"2024-09-19T05:17:49.258666+0000","last_unstale":"2024-09-19T05:19:14.369736+0000","last_undegraded":"2024-09-19T05:19:14.369736+0000","last_fullsized":"2024-09-19T05:19:14.369736+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:54.802994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.334811+0000","last_change":"2024-09-19T05:17:28.182456+0000","last_active":"2024-09-19T05:19:14.334811+0000","last_peered":"2024-09-19T05:19:14.334811+0000","last_clean":"2024-09-19T05:19:14.334811+0000","last_became_active":"2024-09-19T05:17:28.182075+0000","last_became_peered":"2024-09-19T05:17:28.182075+0000","last_unstale":"2024-09-19T05:19:14.334811+0000","last_undegraded":"2024-09-19T05:19:14.334811+0000","last_fullsized":"2024-09-19T05:19:14.334811+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:42.771641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.370955+0000","last_change":"2024-09-19T05:17:30.204300+0000","last_active":"2024-09-19T05:19:14.370955+0000","last_peered":"2024-09-19T05:19:14.370955+0000","last_clean":"2024-09-19T05:19:14.370955+0000","last_became_active":"2024-09-19T05:17:30.203840+0000","last_became_peered":"2024-09-19T05:17:30.203840+0000","last_unstale":"2024-09-19T05:19:14.370955+0000","last_undegraded":"2024-09-19T05:19:14.370955+0000","last_fullsized":"2024-09-19T05:19:14.370955+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:48.363862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.335586+0000","last_change":"2024-09-19T05:17:28.204474+0000","last_active":"2024-09-19T05:19:14.335586+0000","last_peered":"2024-09-19T05:19:14.335586+0000","last_clean":"2024-09-19T05:19:14.335586+0000","last_became_active":"2024-09-19T05:17:28.204143+0000","last_became_peered":"2024-09-19T05:17:28.204143+0000","last_unstale":"2024-09-19T05:19:14.335586+0000","last_undegraded":"2024-09-19T05:19:14.335586+0000","last_fullsized":"2024-09-19T05:19:14.335586+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:46.647789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'5","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.372421+0000","last_change":"2024-09-19T05:17:30.198791+0000","last_active":"2024-09-19T05:19:14.372421+0000","last_peered":"2024-09-19T05:19:14.372421+0000","last_clean":"2024-09-19T05:19:14.372421+0000","last_became_active":"2024-09-19T05:17:30.198399+0000","last_became_peered":"2024-09-19T05:17:30.198399+0000","last_unstale":"2024-09-19T05:19:14.372421+0000","last_undegraded":"2024-09-19T05:19:14.372421+0000","last_fullsized":"2024-09-19T05:19:14.372421+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:46.676625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.341887+0000","last_change":"2024-09-19T05:17:28.204690+0000","last_active":"2024-09-19T05:19:14.341887+0000","last_peered":"2024-09-19T05:19:14.341887+0000","last_clean":"2024-09-19T05:19:14.341887+0000","last_became_active":"2024-09-19T05:17:28.204377+0000","last_became_peered":"2024-09-19T05:17:28.204377+0000","last_unstale":"2024-09-19T05:19:14.341887+0000","last_undegraded":"2024-09-19T05:19:14.341887+0000","last_fullsized":"2024-09-19T05:19:14.341887+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:29:20.583163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.366587+0000","last_change":"2024-09-19T05:17:30.200584+0000","last_active":"2024-09-19T05:19:14.366587+0000","last_peered":"2024-09-19T05:19:14.366587+0000","last_clean":"2024-09-19T05:19:14.366587+0000","last_became_active":"2024-09-19T05:17:30.200270+0000","last_became_peered":"2024-09-19T05:17:30.200270+0000","last_unstale":"2024-09-19T05:19:14.366587+0000","last_undegraded":"2024-09-19T05:19:14.366587+0000","last_fullsized":"2024-09-19T05:19:14.366587+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:24:43.493332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'47","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.539433+0000","last_change":"2024-09-19T05:17:28.181020+0000","last_active":"2024-09-19T05:19:14.539433+0000","last_peered":"2024-09-19T05:19:14.539433+0000","last_clean":"2024-09-19T05:19:14.539433+0000","last_became_active":"2024-09-19T05:17:28.180298+0000","last_became_peered":"2024-09-19T05:17:28.180298+0000","last_unstale":"2024-09-19T05:19:14.539433+0000","last_undegraded":"2024-09-19T05:19:14.539433+0000","last_fullsized":"2024-09-19T05:19:14.539433+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:32.931699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":84,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.364959+0000","last_change":"2024-09-19T05:17:30.209632+0000","last_active":"2024-09-19T05:19:14.364959+0000","last_peered":"2024-09-19T05:19:14.364959+0000","last_clean":"2024-09-19T05:19:14.364959+0000","last_became_active":"2024-09-19T05:17:30.209334+0000","last_became_peered":"2024-09-19T05:17:30.209334+0000","last_unstale":"2024-09-19T05:19:14.364959+0000","last_undegraded":"2024-09-19T05:19:14.364959+0000","last_fullsized":"2024-09-19T05:19:14.364959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:45:21.159099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.321036+0000","last_change":"2024-09-19T05:17:28.543802+0000","last_active":"2024-09-19T05:19:14.321036+0000","last_peered":"2024-09-19T05:19:14.321036+0000","last_clean":"2024-09-19T05:19:14.321036+0000","last_became_active":"2024-09-19T05:17:28.543503+0000","last_became_peered":"2024-09-19T05:17:28.543503+0000","last_unstale":"2024-09-19T05:19:14.321036+0000","last_undegraded":"2024-09-19T05:19:14.321036+0000","last_fullsized":"2024-09-19T05:19:14.321036+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:13.764141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.380774+0000","last_change":"2024-09-19T05:17:30.206755+0000","last_active":"2024-09-19T05:19:14.380774+0000","last_peered":"2024-09-19T05:19:14.380774+0000","last_clean":"2024-09-19T05:19:14.380774+0000","last_became_active":"2024-09-19T05:17:30.205757+0000","last_became_peered":"2024-09-19T05:17:30.205757+0000","last_unstale":"2024-09-19T05:19:14.380774+0000","last_undegraded":"2024-09-19T05:19:14.380774+0000","last_fullsized":"2024-09-19T05:19:14.380774+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:16.281294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.330553+0000","last_change":"2024-09-19T05:17:28.204819+0000","last_active":"2024-09-19T05:19:14.330553+0000","last_peered":"2024-09-19T05:19:14.330553+0000","last_clean":"2024-09-19T05:19:14.330553+0000","last_became_active":"2024-09-19T05:17:28.204445+0000","last_became_peered":"2024-09-19T05:17:28.204445+0000","last_unstale":"2024-09-19T05:19:14.330553+0000","last_undegraded":"2024-09-19T05:19:14.330553+0000","last_fullsized":"2024-09-19T05:19:14.330553+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:26.473654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.352435+0000","last_change":"2024-09-19T05:17:30.201331+0000","last_active":"2024-09-19T05:19:14.352435+0000","last_peered":"2024-09-19T05:19:14.352435+0000","last_clean":"2024-09-19T05:19:14.352435+0000","last_became_active":"2024-09-19T05:17:30.200992+0000","last_became_peered":"2024-09-19T05:17:30.200992+0000","last_unstale":"2024-09-19T05:19:14.352435+0000","last_undegraded":"2024-09-19T05:19:14.352435+0000","last_fullsized":"2024-09-19T05:19:14.352435+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:17.033786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.334852+0000","last_change":"2024-09-19T05:17:28.180149+0000","last_active":"2024-09-19T05:19:14.334852+0000","last_peered":"2024-09-19T05:19:14.334852+0000","last_clean":"2024-09-19T05:19:14.334852+0000","last_became_active":"2024-09-19T05:17:28.179767+0000","last_became_peered":"2024-09-19T05:17:28.179767+0000","last_unstale":"2024-09-19T05:19:14.334852+0000","last_undegraded":"2024-09-19T05:19:14.334852+0000","last_fullsized":"2024-09-19T05:19:14.334852+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:25.074252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.370057+0000","last_change":"2024-09-19T05:17:30.204533+0000","last_active":"2024-09-19T05:19:14.370057+0000","last_peered":"2024-09-19T05:19:14.370057+0000","last_clean":"2024-09-19T05:19:14.370057+0000","last_became_active":"2024-09-19T05:17:30.204224+0000","last_became_peered":"2024-09-19T05:17:30.204224+0000","last_unstale":"2024-09-19T05:19:14.370057+0000","last_undegraded":"2024-09-19T05:19:14.370057+0000","last_fullsized":"2024-09-19T05:19:14.370057+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:11.021297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'2","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.331076+0000","last_change":"2024-09-19T05:17:28.187544+0000","last_active":"2024-09-19T05:19:14.331076+0000","last_peered":"2024-09-19T05:19:14.331076+0000","last_clean":"2024-09-19T05:19:14.331076+0000","last_became_active":"2024-09-19T05:17:28.187068+0000","last_became_peered":"2024-09-19T05:17:28.187068+0000","last_unstale":"2024-09-19T05:19:14.331076+0000","last_undegraded":"2024-09-19T05:19:14.331076+0000","last_fullsized":"2024-09-19T05:19:14.331076+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:01.151721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.377889+0000","last_change":"2024-09-19T05:17:30.209549+0000","last_active":"2024-09-19T05:19:14.377889+0000","last_peered":"2024-09-19T05:19:14.377889+0000","last_clean":"2024-09-19T05:19:14.377889+0000","last_became_active":"2024-09-19T05:17:30.209225+0000","last_became_peered":"2024-09-19T05:17:30.209225+0000","last_unstale":"2024-09-19T05:19:14.377889+0000","last_undegraded":"2024-09-19T05:19:14.377889+0000","last_fullsized":"2024-09-19T05:19:14.377889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:38.023351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.341376+0000","last_change":"2024-09-19T05:17:28.186601+0000","last_active":"2024-09-19T05:19:14.341376+0000","last_peered":"2024-09-19T05:19:14.341376+0000","last_clean":"2024-09-19T05:19:14.341376+0000","last_became_active":"2024-09-19T05:17:28.186236+0000","last_became_peered":"2024-09-19T05:17:28.186236+0000","last_unstale":"2024-09-19T05:19:14.341376+0000","last_undegraded":"2024-09-19T05:19:14.341376+0000","last_fullsized":"2024-09-19T05:19:14.341376+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:08.527906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.369719+0000","last_change":"2024-09-19T05:17:30.203633+0000","last_active":"2024-09-19T05:19:14.369719+0000","last_peered":"2024-09-19T05:19:14.369719+0000","last_clean":"2024-09-19T05:19:14.369719+0000","last_became_active":"2024-09-19T05:17:30.203313+0000","last_became_peered":"2024-09-19T05:17:30.203313+0000","last_unstale":"2024-09-19T05:19:14.369719+0000","last_undegraded":"2024-09-19T05:19:14.369719+0000","last_fullsized":"2024-09-19T05:19:14.369719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:40.442434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.375755+0000","last_change":"2024-09-19T05:17:49.260345+0000","last_active":"2024-09-19T05:19:14.375755+0000","last_peered":"2024-09-19T05:19:14.375755+0000","last_clean":"2024-09-19T05:19:14.375755+0000","last_became_active":"2024-09-19T05:17:49.259938+0000","last_became_peered":"2024-09-19T05:17:49.259938+0000","last_unstale":"2024-09-19T05:19:14.375755+0000","last_undegraded":"2024-09-19T05:19:14.375755+0000","last_fullsized":"2024-09-19T05:19:14.375755+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:01.904276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.343919+0000","last_change":"2024-09-19T05:17:28.182014+0000","last_active":"2024-09-19T05:19:14.343919+0000","last_peered":"2024-09-19T05:19:14.343919+0000","last_clean":"2024-09-19T05:19:14.343919+0000","last_became_active":"2024-09-19T05:17:28.181666+0000","last_became_peered":"2024-09-19T05:17:28.181666+0000","last_unstale":"2024-09-19T05:19:14.343919+0000","last_undegraded":"2024-09-19T05:19:14.343919+0000","last_fullsized":"2024-09-19T05:19:14.343919+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:00:57.069618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.369617+0000","last_change":"2024-09-19T05:17:30.206428+0000","last_active":"2024-09-19T05:19:14.369617+0000","last_peered":"2024-09-19T05:19:14.369617+0000","last_clean":"2024-09-19T05:19:14.369617+0000","last_became_active":"2024-09-19T05:17:30.205818+0000","last_became_peered":"2024-09-19T05:17:30.205818+0000","last_unstale":"2024-09-19T05:19:14.369617+0000","last_undegraded":"2024-09-19T05:19:14.369617+0000","last_fullsized":"2024-09-19T05:19:14.369617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:26.059019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.341632+0000","last_change":"2024-09-19T05:17:28.185596+0000","last_active":"2024-09-19T05:19:14.341632+0000","last_peered":"2024-09-19T05:19:14.341632+0000","last_clean":"2024-09-19T05:19:14.341632+0000","last_became_active":"2024-09-19T05:17:28.185278+0000","last_became_peered":"2024-09-19T05:17:28.185278+0000","last_unstale":"2024-09-19T05:19:14.341632+0000","last_undegraded":"2024-09-19T05:19:14.341632+0000","last_fullsized":"2024-09-19T05:19:14.341632+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:35:40.440874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.379737+0000","last_change":"2024-09-19T05:17:30.200409+0000","last_active":"2024-09-19T05:19:14.379737+0000","last_peered":"2024-09-19T05:19:14.379737+0000","last_clean":"2024-09-19T05:19:14.379737+0000","last_became_active":"2024-09-19T05:17:30.200120+0000","last_became_peered":"2024-09-19T05:17:30.200120+0000","last_unstale":"2024-09-19T05:19:14.379737+0000","last_undegraded":"2024-09-19T05:19:14.379737+0000","last_fullsized":"2024-09-19T05:19:14.379737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:12.396655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.334449+0000","last_change":"2024-09-19T05:17:28.205371+0000","last_active":"2024-09-19T05:19:14.334449+0000","last_peered":"2024-09-19T05:19:14.334449+0000","last_clean":"2024-09-19T05:19:14.334449+0000","last_became_active":"2024-09-19T05:17:28.205026+0000","last_became_peered":"2024-09-19T05:17:28.205026+0000","last_unstale":"2024-09-19T05:19:14.334449+0000","last_undegraded":"2024-09-19T05:19:14.334449+0000","last_fullsized":"2024-09-19T05:19:14.334449+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:25:59.518580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":28,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.370652+0000","last_change":"2024-09-19T05:17:30.206862+0000","last_active":"2024-09-19T05:19:14.370652+0000","last_peered":"2024-09-19T05:19:14.370652+0000","last_clean":"2024-09-19T05:19:14.370652+0000","last_became_active":"2024-09-19T05:17:30.206072+0000","last_became_peered":"2024-09-19T05:17:30.206072+0000","last_unstale":"2024-09-19T05:19:14.370652+0000","last_undegraded":"2024-09-19T05:19:14.370652+0000","last_fullsized":"2024-09-19T05:19:14.370652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:29.170271+0000","last_clean_scrub_stamp":"2024-09-19T05:17:29.170271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:47.810496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-19T05:19:14.335963+0000","last_change":"2024-09-19T05:17:28.181895+0000","last_active":"2024-09-19T05:19:14.335963+0000","last_peered":"2024-09-19T05:19:14.335963+0000","last_clean":"2024-09-19T05:19:14.335963+0000","last_became_active":"2024-09-19T05:17:28.181499+0000","last_became_peered":"2024-09-19T05:17:28.181499+0000","last_unstale":"2024-09-19T05:19:14.335963+0000","last_undegraded":"2024-09-19T05:19:14.335963+0000","last_fullsized":"2024-09-19T05:19:14.335963+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T05:17:27.158185+0000","last_clean_scrub_stamp":"2024-09-19T05:17:27.158185+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:29.722921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":593292,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":691,"num_read_kb":447,"num_write":289,"num_write_kb":1429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":56,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2015232,"data_stored":1779876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579938,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":950272,"data_stored":459705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":41108,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704044,"statfs":{"total":95995035648,"available":95952941056,"internally_reserved":0,"allocated":1638400,"data_stored":1113460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939692,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36668,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708484,"statfs":{"total":95995035648,"available":95957487616,"internally_reserved":0,"allocated":1351680,"data_stored":853101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168625,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":954368,"data_stored":459783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397557,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28540,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716612,"statfs":{"total":95995035648,"available":95965810688,"internally_reserved":0,"allocated":1552384,"data_stored":1053513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561082,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":946176,"data_stored":459274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790014,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32904,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712248,"statfs":{"total":95995035648,"available":95961341952,"internally_reserved":0,"allocated":1699840,"data_stored":1183909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953540,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":950272,"data_stored":460599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215177,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32640,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712512,"statfs":{"total":95995035648,"available":95961612288,"internally_reserved":0,"allocated":1490944,"data_stored":984401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444110,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1032192,"data_stored":524361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607635,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1011712,"data_stored":521764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":966656,"data_stored":460545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":62697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":241664,"data_stored":196763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T05:19:20.549 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:19:20.829 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:21.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.254+0000 7f1faa34b640 1 -- 172.21.15.120:0/4212133058 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fa4100e20 msgr2=0x7f1fa4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:21.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.254+0000 7f1faa34b640 1 --2- 172.21.15.120:0/4212133058 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fa4100e20 0x7f1fa4101200 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1f94009900 tx=0x7f1f9402a480 comp rx=0 tx=0).stop 2024-09-19T05:19:21.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.254+0000 7f1faa34b640 1 -- 172.21.15.120:0/4212133058 shutdown_connections 2024-09-19T05:19:21.256 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.254+0000 7f1faa34b640 1 --2- 172.21.15.120:0/4212133058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fa4102ef0 0x7f1fa410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.254+0000 7f1faa34b640 1 --2- 172.21.15.120:0/4212133058 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fa4102570 0x7f1fa41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.254+0000 7f1faa34b640 1 --2- 172.21.15.120:0/4212133058 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fa4100e20 0x7f1fa4101200 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.254+0000 7f1faa34b640 1 -- 172.21.15.120:0/4212133058 >> 172.21.15.120:0/4212133058 conn(0x7f1fa40fc7d0 msgr2=0x7f1fa40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:21.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.254+0000 7f1faa34b640 1 -- 172.21.15.120:0/4212133058 shutdown_connections 2024-09-19T05:19:21.257 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.254+0000 7f1faa34b640 1 -- 172.21.15.120:0/4212133058 wait complete. 2024-09-19T05:19:21.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.255+0000 7f1faa34b640 1 Processor -- start 2024-09-19T05:19:21.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.255+0000 7f1faa34b640 1 -- start start 2024-09-19T05:19:21.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.256+0000 7f1faa34b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fa4100e20 0x7f1fa4197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:21.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.256+0000 7f1faa34b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fa4102570 0x7f1fa41978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:21.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.256+0000 7f1faa34b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fa4102ef0 0x7f1fa419bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:21.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.256+0000 7f1faa34b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa4110e50 con 0x7f1fa4102570 2024-09-19T05:19:21.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.256+0000 7f1faa34b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa4110cd0 con 0x7f1fa4100e20 2024-09-19T05:19:21.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.256+0000 7f1faa34b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa4110fd0 con 0x7f1fa4102ef0 2024-09-19T05:19:21.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.256+0000 7f1fa37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fa4102570 0x7f1fa41978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:21.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.256+0000 7f1fa37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fa4102570 0x7f1fa41978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48620/0 (socket says 172.21.15.120:48620) 2024-09-19T05:19:21.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.256+0000 7f1fa37fe640 1 -- 172.21.15.120:0/4148130501 learned_addr learned my addr 172.21.15.120:0/4148130501 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:21.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.256+0000 7f1fa88e8640 1 --2- 172.21.15.120:0/4148130501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fa4102ef0 0x7f1fa419bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:21.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.256+0000 7f1fa3fff640 1 --2- 172.21.15.120:0/4148130501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fa4100e20 0x7f1fa4197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:21.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.256+0000 7f1fa37fe640 1 -- 172.21.15.120:0/4148130501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fa4102ef0 msgr2=0x7f1fa419bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:21.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.256+0000 7f1fa37fe640 1 --2- 172.21.15.120:0/4148130501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fa4102ef0 0x7f1fa419bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.256+0000 7f1fa37fe640 1 -- 172.21.15.120:0/4148130501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fa4100e20 msgr2=0x7f1fa4197370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:21.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.256+0000 7f1fa37fe640 1 --2- 172.21.15.120:0/4148130501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fa4100e20 0x7f1fa4197370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.256+0000 7f1fa37fe640 1 -- 172.21.15.120:0/4148130501 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa419c320 con 0x7f1fa4102570 2024-09-19T05:19:21.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.256+0000 7f1fa88e8640 1 --2- 172.21.15.120:0/4148130501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fa4102ef0 0x7f1fa419bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:19:21.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.256+0000 7f1fa37fe640 1 --2- 172.21.15.120:0/4148130501 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fa4102570 0x7f1fa41978b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800b4a0 tx=0x7f1f9800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:21.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.257+0000 7f1fa17fa640 1 -- 172.21.15.120:0/4148130501 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f98014070 con 0x7f1fa4102570 2024-09-19T05:19:21.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.257+0000 7f1fa17fa640 1 -- 172.21.15.120:0/4148130501 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1f98010ac0 con 0x7f1fa4102570 2024-09-19T05:19:21.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.257+0000 7f1faa34b640 1 -- 172.21.15.120:0/4148130501 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fa419c610 con 0x7f1fa4102570 2024-09-19T05:19:21.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.257+0000 7f1fa17fa640 1 -- 172.21.15.120:0/4148130501 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f98017c30 con 0x7f1fa4102570 2024-09-19T05:19:21.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.257+0000 7f1faa34b640 1 -- 172.21.15.120:0/4148130501 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fa4069f70 con 0x7f1fa4102570 2024-09-19T05:19:21.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.258+0000 7f1faa34b640 1 -- 172.21.15.120:0/4148130501 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fa4101200 con 0x7f1fa4102570 2024-09-19T05:19:21.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.259+0000 7f1fa17fa640 1 -- 172.21.15.120:0/4148130501 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f1f98017070 con 0x7f1fa4102570 2024-09-19T05:19:21.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.260+0000 7f1fa17fa640 1 --2- 172.21.15.120:0/4148130501 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1f8c0a34c0 0x7f1f8c0a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:21.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.260+0000 7f1fa3fff640 1 --2- 172.21.15.120:0/4148130501 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1f8c0a34c0 0x7f1f8c0a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:21.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.260+0000 7f1fa17fa640 1 -- 172.21.15.120:0/4148130501 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f1f980cf430 con 0x7f1fa4102570 2024-09-19T05:19:21.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.260+0000 7f1fa3fff640 1 --2- 172.21.15.120:0/4148130501 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1f8c0a34c0 0x7f1f8c0a5980 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1f94009230 tx=0x7f1f9403c040 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:21.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.267+0000 7f1fa17fa640 1 -- 172.21.15.120:0/4148130501 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1f9809b710 con 0x7f1fa4102570 2024-09-19T05:19:21.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.469+0000 7f1faa34b640 1 -- 172.21.15.120:0/4148130501 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1fa41986d0 con 0x7f1fa4102570 2024-09-19T05:19:21.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.469+0000 7f1fa17fa640 1 -- 172.21.15.120:0/4148130501 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11921 (secure 0 0 0) 0x7f1fa41986d0 con 0x7f1fa4102570 2024-09-19T05:19:21.471 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:19:21.472 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":25,"btime":"2024-09-19T05:19:16:322502+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/93472898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":93472898},{"type":"v1","addr":"172.21.15.120:6835","nonce":93472898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1976835398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1976835398},{"type":"v1","addr":"172.21.15.120:6837","nonce":1976835398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6839/2975851469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":2975851469},{"type":"v1","addr":"172.21.15.120:6839","nonce":2975851469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6841/2837552754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":2837552754},{"type":"v1","addr":"172.21.15.120:6841","nonce":2837552754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/61682954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":61682954},{"type":"v1","addr":"172.21.15.178:6833","nonce":61682954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1778722040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1778722040},{"type":"v1","addr":"172.21.15.194:6833","nonce":1778722040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:17:30.796197+0000","modified":"2024-09-19T05:19:15.911765+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24445,"mds_1":24443,"mds_2":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24401":{"gid":24401,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/890775592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":890775592},{"type":"v1","addr":"172.21.15.178:6835","nonce":890775592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6837/3960720164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3960720164},{"type":"v1","addr":"172.21.15.178:6837","nonce":3960720164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6835/3268846994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3268846994},{"type":"v1","addr":"172.21.15.194:6835","nonce":3268846994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.194:6837/378729335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":378729335},{"type":"v1","addr":"172.21.15.194:6837","nonce":378729335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.178:6839/3389137566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3389137566},{"type":"v1","addr":"172.21.15.178:6839","nonce":3389137566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6839/3817420679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3817420679},{"type":"v1","addr":"172.21.15.194:6839","nonce":3817420679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24445,"qdb_cluster":[24445,24443,24430]},"id":1}]} 2024-09-19T05:19:21.472 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 25 2024-09-19T05:19:21.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.472+0000 7f1faa34b640 1 -- 172.21.15.120:0/4148130501 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1f8c0a34c0 msgr2=0x7f1f8c0a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:21.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.472+0000 7f1faa34b640 1 --2- 172.21.15.120:0/4148130501 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1f8c0a34c0 0x7f1f8c0a5980 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1f94009230 tx=0x7f1f9403c040 comp rx=0 tx=0).stop 2024-09-19T05:19:21.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.472+0000 7f1faa34b640 1 -- 172.21.15.120:0/4148130501 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fa4102570 msgr2=0x7f1fa41978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:21.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.472+0000 7f1faa34b640 1 --2- 172.21.15.120:0/4148130501 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fa4102570 0x7f1fa41978b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800b4a0 tx=0x7f1f9800b960 comp rx=0 tx=0).stop 2024-09-19T05:19:21.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.472+0000 7f1faa34b640 1 -- 172.21.15.120:0/4148130501 shutdown_connections 2024-09-19T05:19:21.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.472+0000 7f1faa34b640 1 --2- 172.21.15.120:0/4148130501 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1f8c0a34c0 0x7f1f8c0a5980 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.472+0000 7f1faa34b640 1 --2- 172.21.15.120:0/4148130501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fa4102ef0 0x7f1fa419bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.472+0000 7f1faa34b640 1 --2- 172.21.15.120:0/4148130501 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1fa4102570 0x7f1fa41978b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.472+0000 7f1faa34b640 1 --2- 172.21.15.120:0/4148130501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fa4100e20 0x7f1fa4197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:21.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.472+0000 7f1faa34b640 1 -- 172.21.15.120:0/4148130501 >> 172.21.15.120:0/4148130501 conn(0x7f1fa40fc7d0 msgr2=0x7f1fa40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:21.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.472+0000 7f1faa34b640 1 -- 172.21.15.120:0/4148130501 shutdown_connections 2024-09-19T05:19:21.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:21.472+0000 7f1faa34b640 1 -- 172.21.15.120:0/4148130501 wait complete. 2024-09-19T05:19:21.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:21 smithi120 ceph-mon[30956]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:19:21.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:21 smithi120 ceph-mon[30956]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:19:21.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:21 smithi120 ceph-mon[30956]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:21.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:21 smithi194 ceph-mon[35228]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:19:21.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:21 smithi194 ceph-mon[35228]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:19:21.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:21 smithi194 ceph-mon[35228]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:21.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:21 smithi178 ceph-mon[34347]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:19:21.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:21 smithi178 ceph-mon[34347]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:19:21.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:21 smithi178 ceph-mon[34347]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T05:19:22.200 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T05:19:22.451 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:22.550 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:22 smithi120 ceph-mon[30956]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:19:22.550 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:22 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/4148130501' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:19:22.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:22 smithi194 ceph-mon[35228]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:19:22.657 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:22 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/4148130501' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:19:22.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:22 smithi178 ceph-mon[34347]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T05:19:22.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:22 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/4148130501' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:19:22.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.914+0000 7f1bb5c17640 1 -- 172.21.15.120:0/4004500753 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bb0102dc0 msgr2=0x7f1bb01031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:22.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.914+0000 7f1bb5c17640 1 --2- 172.21.15.120:0/4004500753 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bb0102dc0 0x7f1bb01031a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0009ca0 tx=0x7f1ba002a950 comp rx=0 tx=0).stop 2024-09-19T05:19:22.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.914+0000 7f1bb5c17640 1 -- 172.21.15.120:0/4004500753 shutdown_connections 2024-09-19T05:19:22.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.914+0000 7f1bb5c17640 1 --2- 172.21.15.120:0/4004500753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bb010c1a0 0x7f1bb010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:22.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.914+0000 7f1bb5c17640 1 --2- 172.21.15.120:0/4004500753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bb01036e0 0x7f1bb010bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:22.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.914+0000 7f1bb5c17640 1 --2- 172.21.15.120:0/4004500753 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bb0102dc0 0x7f1bb01031a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:22.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.914+0000 7f1bb5c17640 1 -- 172.21.15.120:0/4004500753 >> 172.21.15.120:0/4004500753 conn(0x7f1bb00fc7a0 msgr2=0x7f1bb00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:22.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.914+0000 7f1bb5c17640 1 -- 172.21.15.120:0/4004500753 shutdown_connections 2024-09-19T05:19:22.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.914+0000 7f1bb5c17640 1 -- 172.21.15.120:0/4004500753 wait complete. 2024-09-19T05:19:22.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.915+0000 7f1bb5c17640 1 Processor -- start 2024-09-19T05:19:22.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.915+0000 7f1bb5c17640 1 -- start start 2024-09-19T05:19:22.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.915+0000 7f1bb5c17640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bb0102dc0 0x7f1bb0100a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:22.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.915+0000 7f1bb5c17640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bb01036e0 0x7f1bb0100f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:22.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.915+0000 7f1bb5c17640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bb010c1a0 0x7f1bb01014a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:22.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.915+0000 7f1bb5c17640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb0111e20 con 0x7f1bb010c1a0 2024-09-19T05:19:22.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.915+0000 7f1bb5c17640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb0111ca0 con 0x7f1bb01036e0 2024-09-19T05:19:22.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.915+0000 7f1bb5c17640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb0111fa0 con 0x7f1bb0102dc0 2024-09-19T05:19:22.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.915+0000 7f1baffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bb010c1a0 0x7f1bb01014a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:22.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.915+0000 7f1baf7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bb0102dc0 0x7f1bb0100a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:22.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.915+0000 7f1baffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bb010c1a0 0x7f1bb01014a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48636/0 (socket says 172.21.15.120:48636) 2024-09-19T05:19:22.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.915+0000 7f1baffff640 1 -- 172.21.15.120:0/3459881809 learned_addr learned my addr 172.21.15.120:0/3459881809 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:22.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.916+0000 7f1baeffd640 1 --2- 172.21.15.120:0/3459881809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bb01036e0 0x7f1bb0100f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:22.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.916+0000 7f1baffff640 1 -- 172.21.15.120:0/3459881809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bb0102dc0 msgr2=0x7f1bb0100a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:22.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.916+0000 7f1baffff640 1 --2- 172.21.15.120:0/3459881809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bb0102dc0 0x7f1bb0100a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:22.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.916+0000 7f1baffff640 1 -- 172.21.15.120:0/3459881809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bb01036e0 msgr2=0x7f1bb0100f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:22.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.916+0000 7f1baffff640 1 --2- 172.21.15.120:0/3459881809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bb01036e0 0x7f1bb0100f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:22.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.916+0000 7f1baffff640 1 -- 172.21.15.120:0/3459881809 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb01a6860 con 0x7f1bb010c1a0 2024-09-19T05:19:22.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.916+0000 7f1baffff640 1 --2- 172.21.15.120:0/3459881809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bb010c1a0 0x7f1bb01014a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1ba800d750 tx=0x7f1ba800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:22.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.916+0000 7f1bacff9640 1 -- 172.21.15.120:0/3459881809 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8017070 con 0x7f1bb010c1a0 2024-09-19T05:19:22.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.916+0000 7f1bb5c17640 1 -- 172.21.15.120:0/3459881809 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb01a6b50 con 0x7f1bb010c1a0 2024-09-19T05:19:22.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.916+0000 7f1bacff9640 1 -- 172.21.15.120:0/3459881809 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1ba80054d0 con 0x7f1bb010c1a0 2024-09-19T05:19:22.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.916+0000 7f1bacff9640 1 -- 172.21.15.120:0/3459881809 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8004c60 con 0x7f1bb010c1a0 2024-09-19T05:19:22.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.916+0000 7f1bb5c17640 1 -- 172.21.15.120:0/3459881809 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb01a7090 con 0x7f1bb010c1a0 2024-09-19T05:19:22.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.917+0000 7f1bb5c17640 1 -- 172.21.15.120:0/3459881809 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bb01031a0 con 0x7f1bb010c1a0 2024-09-19T05:19:22.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.918+0000 7f1bacff9640 1 -- 172.21.15.120:0/3459881809 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f1ba8004e00 con 0x7f1bb010c1a0 2024-09-19T05:19:22.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.919+0000 7f1bacff9640 1 --2- 172.21.15.120:0/3459881809 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1b980a34c0 0x7f1b980a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:22.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.919+0000 7f1baf7fe640 1 --2- 172.21.15.120:0/3459881809 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1b980a34c0 0x7f1b980a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:22.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.919+0000 7f1bacff9640 1 -- 172.21.15.120:0/3459881809 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f1ba80cf710 con 0x7f1bb010c1a0 2024-09-19T05:19:22.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.920+0000 7f1baf7fe640 1 --2- 172.21.15.120:0/3459881809 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1b980a34c0 0x7f1b980a5980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0004ad0 tx=0x7f1ba0004a60 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:22.925 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:22.923+0000 7f1bacff9640 1 -- 172.21.15.120:0/3459881809 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1ba809b8e0 con 0x7f1bb010c1a0 2024-09-19T05:19:23.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:23.090+0000 7f1bb5c17640 1 -- 172.21.15.120:0/3459881809 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1bb0107240 con 0x7f1bb010c1a0 2024-09-19T05:19:23.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:23.092+0000 7f1bacff9640 1 -- 172.21.15.120:0/3459881809 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+23352 (secure 0 0 0) 0x7f1ba809fbe0 con 0x7f1bb010c1a0 2024-09-19T05:19:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:19:23.094 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":85,"fsid":"4e6e3df4-7645-11ef-bceb-c7b262605968","created":"2024-09-19T05:09:55.847220+0000","modified":"2024-09-19T05:19:14.314890+0000","last_up_change":"2024-09-19T05:16:42.808178+0000","last_in_change":"2024-09-19T05:16:18.315940+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:13:02.340027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:17:26.914416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:17:29.112997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"18907a03-1f43-419a-acb6-9fa4cf5020d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6803","nonce":3421474326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6805","nonce":3421474326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6809","nonce":3421474326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6807","nonce":3421474326}]},"public_addr":"172.21.15.120:6803/3421474326","cluster_addr":"172.21.15.120:6805/3421474326","heartbeat_back_addr":"172.21.15.120:6809/3421474326","heartbeat_front_addr":"172.21.15.120:6807/3421474326","state":["exists","up"]},{"osd":1,"uuid":"d21e029b-8a60-43f9-9ba7-30cdba19ba57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6801","nonce":1195511218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6803","nonce":1195511218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6807","nonce":1195511218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6805","nonce":1195511218}]},"public_addr":"172.21.15.178:6801/1195511218","cluster_addr":"172.21.15.178:6803/1195511218","heartbeat_back_addr":"172.21.15.178:6807/1195511218","heartbeat_front_addr":"172.21.15.178:6805/1195511218","state":["exists","up"]},{"osd":2,"uuid":"26ad9c8d-dbaa-46c2-a346-19717d81cc60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6801","nonce":3752826560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6803","nonce":3752826560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6807","nonce":3752826560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6805","nonce":3752826560}]},"public_addr":"172.21.15.194:6801/3752826560","cluster_addr":"172.21.15.194:6803/3752826560","heartbeat_back_addr":"172.21.15.194:6807/3752826560","heartbeat_front_addr":"172.21.15.194:6805/3752826560","state":["exists","up"]},{"osd":3,"uuid":"7e266576-8a98-40a8-9532-4b6f4611a908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6811","nonce":803566783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6813","nonce":803566783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6817","nonce":803566783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6815","nonce":803566783}]},"public_addr":"172.21.15.120:6811/803566783","cluster_addr":"172.21.15.120:6813/803566783","heartbeat_back_addr":"172.21.15.120:6817/803566783","heartbeat_front_addr":"172.21.15.120:6815/803566783","state":["exists","up"]},{"osd":4,"uuid":"c77d05c5-3b8f-4f7b-91f9-833735221684","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6809","nonce":541165323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6811","nonce":541165323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6815","nonce":541165323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6813","nonce":541165323}]},"public_addr":"172.21.15.178:6809/541165323","cluster_addr":"172.21.15.178:6811/541165323","heartbeat_back_addr":"172.21.15.178:6815/541165323","heartbeat_front_addr":"172.21.15.178:6813/541165323","state":["exists","up"]},{"osd":5,"uuid":"5f1c394b-e510-411f-969a-2db2b68cf41a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6809","nonce":2631415468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6811","nonce":2631415468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6815","nonce":2631415468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6813","nonce":2631415468}]},"public_addr":"172.21.15.194:6809/2631415468","cluster_addr":"172.21.15.194:6811/2631415468","heartbeat_back_addr":"172.21.15.194:6815/2631415468","heartbeat_front_addr":"172.21.15.194:6813/2631415468","state":["exists","up"]},{"osd":6,"uuid":"990af639-099e-49df-a083-05626cee3c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6819","nonce":388238976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6821","nonce":388238976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6825","nonce":388238976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6823","nonce":388238976}]},"public_addr":"172.21.15.120:6819/388238976","cluster_addr":"172.21.15.120:6821/388238976","heartbeat_back_addr":"172.21.15.120:6825/388238976","heartbeat_front_addr":"172.21.15.120:6823/388238976","state":["exists","up"]},{"osd":7,"uuid":"6f4aa6ab-b5f4-4c06-9f14-9a51bc195ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6817","nonce":1912109177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6819","nonce":1912109177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6823","nonce":1912109177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6821","nonce":1912109177}]},"public_addr":"172.21.15.178:6817/1912109177","cluster_addr":"172.21.15.178:6819/1912109177","heartbeat_back_addr":"172.21.15.178:6823/1912109177","heartbeat_front_addr":"172.21.15.178:6821/1912109177","state":["exists","up"]},{"osd":8,"uuid":"707739c9-732a-405c-847a-ce6a06e611b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6817","nonce":596878172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6819","nonce":596878172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6823","nonce":596878172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6821","nonce":596878172}]},"public_addr":"172.21.15.194:6817/596878172","cluster_addr":"172.21.15.194:6819/596878172","heartbeat_back_addr":"172.21.15.194:6823/596878172","heartbeat_front_addr":"172.21.15.194:6821/596878172","state":["exists","up"]},{"osd":9,"uuid":"9393b018-c924-4d75-99e5-25433d276567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6827","nonce":3257373801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6829","nonce":3257373801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6833","nonce":3257373801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6831","nonce":3257373801}]},"public_addr":"172.21.15.120:6827/3257373801","cluster_addr":"172.21.15.120:6829/3257373801","heartbeat_back_addr":"172.21.15.120:6833/3257373801","heartbeat_front_addr":"172.21.15.120:6831/3257373801","state":["exists","up"]},{"osd":10,"uuid":"45db7f62-87a6-4b2b-a3dc-012e2de505e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6825","nonce":3067822030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6827","nonce":3067822030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6831","nonce":3067822030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6829","nonce":3067822030}]},"public_addr":"172.21.15.178:6825/3067822030","cluster_addr":"172.21.15.178:6827/3067822030","heartbeat_back_addr":"172.21.15.178:6831/3067822030","heartbeat_front_addr":"172.21.15.178:6829/3067822030","state":["exists","up"]},{"osd":11,"uuid":"85ea248c-9a36-41cb-a200-87138fb31602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6825","nonce":2713146974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6827","nonce":2713146974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6831","nonce":2713146974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6829","nonce":2713146974}]},"public_addr":"172.21.15.194:6825/2713146974","cluster_addr":"172.21.15.194:6827/2713146974","heartbeat_back_addr":"172.21.15.194:6831/2713146974","heartbeat_front_addr":"172.21.15.194:6829/2713146974","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:09.395371+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:33.648930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:58.805048+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:23.621459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:48.553860+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:13.506636+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:38.520376+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:02.695124+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:27.084956+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:50.924128+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:15.396694+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:40.440416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":3,"to":8}]},{"pgid":"3.2a","mappings":[{"from":3,"to":6}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:0/316867529":"2024-09-20T05:19:14.314860+0000","172.21.15.120:0/1091097763":"2024-09-20T05:19:14.314860+0000","172.21.15.120:6801/955692128":"2024-09-20T05:19:14.314860+0000","172.21.15.120:6800/3412493069":"2024-09-20T05:10:23.348128+0000","172.21.15.120:6801/3412493069":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/4255533863":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/3592867428":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/2867300720":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/3049956965":"2024-09-20T05:19:14.314860+0000","172.21.15.120:0/4177074351":"2024-09-20T05:10:48.027892+0000","172.21.15.120:6800/50152720":"2024-09-20T05:10:48.027892+0000","172.21.15.120:6801/50152720":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/329623296":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/3419110398":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/3080806681":"2024-09-20T05:19:14.314860+0000","172.21.15.120:0/1358819866":"2024-09-20T05:19:14.314860+0000","172.21.15.120:6800/955692128":"2024-09-20T05:19:14.314860+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:19:23.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:23.094+0000 7f1bb5c17640 1 -- 172.21.15.120:0/3459881809 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1b980a34c0 msgr2=0x7f1b980a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:23.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:23.094+0000 7f1bb5c17640 1 --2- 172.21.15.120:0/3459881809 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1b980a34c0 0x7f1b980a5980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0004ad0 tx=0x7f1ba0004a60 comp rx=0 tx=0).stop 2024-09-19T05:19:23.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:23.094+0000 7f1bb5c17640 1 -- 172.21.15.120:0/3459881809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bb010c1a0 msgr2=0x7f1bb01014a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:23.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:23.094+0000 7f1bb5c17640 1 --2- 172.21.15.120:0/3459881809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bb010c1a0 0x7f1bb01014a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1ba800d750 tx=0x7f1ba800dc10 comp rx=0 tx=0).stop 2024-09-19T05:19:23.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:23.094+0000 7f1bb5c17640 1 -- 172.21.15.120:0/3459881809 shutdown_connections 2024-09-19T05:19:23.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:23.094+0000 7f1bb5c17640 1 --2- 172.21.15.120:0/3459881809 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1b980a34c0 0x7f1b980a5980 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:23.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:23.094+0000 7f1bb5c17640 1 --2- 172.21.15.120:0/3459881809 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1bb010c1a0 0x7f1bb01014a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:23.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:23.094+0000 7f1bb5c17640 1 --2- 172.21.15.120:0/3459881809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bb01036e0 0x7f1bb0100f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:23.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:23.094+0000 7f1bb5c17640 1 --2- 172.21.15.120:0/3459881809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bb0102dc0 0x7f1bb0100a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:23.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:23.094+0000 7f1bb5c17640 1 -- 172.21.15.120:0/3459881809 >> 172.21.15.120:0/3459881809 conn(0x7f1bb00fc7a0 msgr2=0x7f1bb00fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:23.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:23.095+0000 7f1bb5c17640 1 -- 172.21.15.120:0/3459881809 shutdown_connections 2024-09-19T05:19:23.097 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:23.095+0000 7f1bb5c17640 1 -- 172.21.15.120:0/3459881809 wait complete. 2024-09-19T05:19:23.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:23 smithi120 ceph-mon[30956]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 878 B/s wr, 22 op/s 2024-09-19T05:19:23.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:23 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/3459881809' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:19:23.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:23 smithi194 ceph-mon[35228]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 878 B/s wr, 22 op/s 2024-09-19T05:19:23.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:23 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/3459881809' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:19:23.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:23 smithi178 ceph-mon[34347]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 878 B/s wr, 22 op/s 2024-09-19T05:19:23.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:23 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/3459881809' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:19:23.877 DEBUG:tasks.fwd_scrub:Yielding 2024-09-19T05:19:23.877 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T05:19:24.653 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T05:19:24.654 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi120.front.sepia.ceph.com 2024-09-19T05:19:24.654 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-19T05:19:24.654 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-19T05:19:24.655 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T05:19:24.655 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T05:19:24.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.769+0000 7ffb50d91640 1 -- 172.21.15.120:0/1502278182 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb4c10c0d0 msgr2=0x7ffb4c10e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:24.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.769+0000 7ffb50d91640 1 --2- 172.21.15.120:0/1502278182 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb4c10c0d0 0x7ffb4c10e550 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009ca0 tx=0x7ffb4402a950 comp rx=0 tx=0).stop 2024-09-19T05:19:24.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.769+0000 7ffb50d91640 1 -- 172.21.15.120:0/1502278182 shutdown_connections 2024-09-19T05:19:24.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.769+0000 7ffb50d91640 1 --2- 172.21.15.120:0/1502278182 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb4c10c0d0 0x7ffb4c10e550 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:24.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.769+0000 7ffb50d91640 1 --2- 172.21.15.120:0/1502278182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb4c1035a0 0x7ffb4c10ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:24.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.769+0000 7ffb50d91640 1 --2- 172.21.15.120:0/1502278182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb4c102c80 0x7ffb4c103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:24.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.769+0000 7ffb50d91640 1 -- 172.21.15.120:0/1502278182 >> 172.21.15.120:0/1502278182 conn(0x7ffb4c077990 msgr2=0x7ffb4c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:24.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.769+0000 7ffb50d91640 1 -- 172.21.15.120:0/1502278182 shutdown_connections 2024-09-19T05:19:24.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.769+0000 7ffb50d91640 1 -- 172.21.15.120:0/1502278182 wait complete. 2024-09-19T05:19:24.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.770+0000 7ffb50d91640 1 Processor -- start 2024-09-19T05:19:24.774 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.770+0000 7ffb50d91640 1 -- start start 2024-09-19T05:19:24.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.770+0000 7ffb50d91640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb4c102c80 0x7ffb4c1008d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:24.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.770+0000 7ffb50d91640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb4c1035a0 0x7ffb4c100e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:24.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.770+0000 7ffb50d91640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb4c10c0d0 0x7ffb4c101350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:24.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.770+0000 7ffb50d91640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4c111d60 con 0x7ffb4c1035a0 2024-09-19T05:19:24.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.770+0000 7ffb50d91640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4c111be0 con 0x7ffb4c10c0d0 2024-09-19T05:19:24.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.770+0000 7ffb50d91640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4c111ee0 con 0x7ffb4c102c80 2024-09-19T05:19:24.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.770+0000 7ffb49d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb4c1035a0 0x7ffb4c100e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:24.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.770+0000 7ffb49d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb4c1035a0 0x7ffb4c100e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48646/0 (socket says 172.21.15.120:48646) 2024-09-19T05:19:24.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.770+0000 7ffb49d9b640 1 -- 172.21.15.120:0/4129056742 learned_addr learned my addr 172.21.15.120:0/4129056742 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:24.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.770+0000 7ffb4a59c640 1 --2- 172.21.15.120:0/4129056742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb4c102c80 0x7ffb4c1008d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:24.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.770+0000 7ffb4ad9d640 1 --2- 172.21.15.120:0/4129056742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb4c10c0d0 0x7ffb4c101350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:24.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.771+0000 7ffb49d9b640 1 -- 172.21.15.120:0/4129056742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb4c102c80 msgr2=0x7ffb4c1008d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:24.775 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.771+0000 7ffb49d9b640 1 --2- 172.21.15.120:0/4129056742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb4c102c80 0x7ffb4c1008d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:24.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.771+0000 7ffb49d9b640 1 -- 172.21.15.120:0/4129056742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb4c10c0d0 msgr2=0x7ffb4c101350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:24.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.771+0000 7ffb49d9b640 1 --2- 172.21.15.120:0/4129056742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb4c10c0d0 0x7ffb4c101350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:24.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.771+0000 7ffb49d9b640 1 -- 172.21.15.120:0/4129056742 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb4c1a6710 con 0x7ffb4c1035a0 2024-09-19T05:19:24.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.771+0000 7ffb49d9b640 1 --2- 172.21.15.120:0/4129056742 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb4c1035a0 0x7ffb4c100e10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000d740 tx=0x7ffb4000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:24.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.771+0000 7ffb3b7fe640 1 -- 172.21.15.120:0/4129056742 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb40017070 con 0x7ffb4c1035a0 2024-09-19T05:19:24.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.771+0000 7ffb3b7fe640 1 -- 172.21.15.120:0/4129056742 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffb4000de50 con 0x7ffb4c1035a0 2024-09-19T05:19:24.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.771+0000 7ffb50d91640 1 -- 172.21.15.120:0/4129056742 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb4c1a6a00 con 0x7ffb4c1035a0 2024-09-19T05:19:24.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.771+0000 7ffb3b7fe640 1 -- 172.21.15.120:0/4129056742 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4000f620 con 0x7ffb4c1035a0 2024-09-19T05:19:24.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.771+0000 7ffb50d91640 1 -- 172.21.15.120:0/4129056742 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb4c1a6f50 con 0x7ffb4c1035a0 2024-09-19T05:19:24.776 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.772+0000 7ffb50d91640 1 -- 172.21.15.120:0/4129056742 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb4c103060 con 0x7ffb4c1035a0 2024-09-19T05:19:24.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.774+0000 7ffb3b7fe640 1 -- 172.21.15.120:0/4129056742 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7ffb40009c30 con 0x7ffb4c1035a0 2024-09-19T05:19:24.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.775+0000 7ffb3b7fe640 1 --2- 172.21.15.120:0/4129056742 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ffb340a3500 0x7ffb340a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:24.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.775+0000 7ffb3b7fe640 1 -- 172.21.15.120:0/4129056742 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7ffb400cf960 con 0x7ffb4c1035a0 2024-09-19T05:19:24.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.775+0000 7ffb4a59c640 1 --2- 172.21.15.120:0/4129056742 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ffb340a3500 0x7ffb340a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:24.777 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.775+0000 7ffb4a59c640 1 --2- 172.21.15.120:0/4129056742 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ffb340a3500 0x7ffb340a59c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c005fd0 tx=0x7ffb3c00b390 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:24.779 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.778+0000 7ffb3b7fe640 1 -- 172.21.15.120:0/4129056742 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffb4009bb30 con 0x7ffb4c1035a0 2024-09-19T05:19:24.928 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:24.969 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.967+0000 7ffb50d91640 1 -- 172.21.15.120:0/4129056742 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7ffb4c101e00 con 0x7ffb4c1035a0 2024-09-19T05:19:24.972 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.971+0000 7ffb3b7fe640 1 -- 172.21.15.120:0/4129056742 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v32)=0 v32) ==== 129+0+0 (secure 0 0 0) 0x7ffb4009fe30 con 0x7ffb4c1035a0 2024-09-19T05:19:24.975 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.973+0000 7ffb50d91640 1 -- 172.21.15.120:0/4129056742 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ffb340a3500 msgr2=0x7ffb340a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:24.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.973+0000 7ffb50d91640 1 --2- 172.21.15.120:0/4129056742 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ffb340a3500 0x7ffb340a59c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c005fd0 tx=0x7ffb3c00b390 comp rx=0 tx=0).stop 2024-09-19T05:19:24.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.973+0000 7ffb50d91640 1 -- 172.21.15.120:0/4129056742 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb4c1035a0 msgr2=0x7ffb4c100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:24.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.973+0000 7ffb50d91640 1 --2- 172.21.15.120:0/4129056742 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb4c1035a0 0x7ffb4c100e10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000d740 tx=0x7ffb4000dc00 comp rx=0 tx=0).stop 2024-09-19T05:19:24.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.973+0000 7ffb50d91640 1 -- 172.21.15.120:0/4129056742 shutdown_connections 2024-09-19T05:19:24.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.973+0000 7ffb50d91640 1 --2- 172.21.15.120:0/4129056742 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ffb340a3500 0x7ffb340a59c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:24.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.973+0000 7ffb50d91640 1 --2- 172.21.15.120:0/4129056742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb4c10c0d0 0x7ffb4c101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:24.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.973+0000 7ffb50d91640 1 --2- 172.21.15.120:0/4129056742 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffb4c1035a0 0x7ffb4c100e10 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:24.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.973+0000 7ffb50d91640 1 --2- 172.21.15.120:0/4129056742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb4c102c80 0x7ffb4c1008d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:24.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.973+0000 7ffb50d91640 1 -- 172.21.15.120:0/4129056742 >> 172.21.15.120:0/4129056742 conn(0x7ffb4c077990 msgr2=0x7ffb4c0fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:24.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.973+0000 7ffb50d91640 1 -- 172.21.15.120:0/4129056742 shutdown_connections 2024-09-19T05:19:24.976 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:24.973+0000 7ffb50d91640 1 -- 172.21.15.120:0/4129056742 wait complete. 2024-09-19T05:19:24.987 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-19T05:19:25.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.090+0000 7faf19f2c640 1 -- 172.21.15.120:0/1503898799 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf14108110 msgr2=0x7faf1410ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:25.095 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.090+0000 7faf19f2c640 1 --2- 172.21.15.120:0/1503898799 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf14108110 0x7faf1410ea60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7faf0c009cd0 tx=0x7faf0c02a8e0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.090+0000 7faf19f2c640 1 -- 172.21.15.120:0/1503898799 shutdown_connections 2024-09-19T05:19:25.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.090+0000 7faf19f2c640 1 --2- 172.21.15.120:0/1503898799 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf14108110 0x7faf1410ea60 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.096 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.090+0000 7faf19f2c640 1 --2- 172.21.15.120:0/1503898799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf14101200 0x7faf141079b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.090+0000 7faf19f2c640 1 --2- 172.21.15.120:0/1503898799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf14100850 0x7faf14100c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.090+0000 7faf19f2c640 1 -- 172.21.15.120:0/1503898799 >> 172.21.15.120:0/1503898799 conn(0x7faf14075db0 msgr2=0x7faf140761c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:25.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.090+0000 7faf19f2c640 1 -- 172.21.15.120:0/1503898799 shutdown_connections 2024-09-19T05:19:25.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.090+0000 7faf19f2c640 1 -- 172.21.15.120:0/1503898799 wait complete. 2024-09-19T05:19:25.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.091+0000 7faf19f2c640 1 Processor -- start 2024-09-19T05:19:25.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.091+0000 7faf19f2c640 1 -- start start 2024-09-19T05:19:25.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.091+0000 7faf19f2c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf14100850 0x7faf141017c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.091+0000 7faf19f2c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf14108110 0x7faf14101d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.091+0000 7faf19f2c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf14102240 0x7faf141a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.091+0000 7faf19f2c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7faf14111d80 con 0x7faf14102240 2024-09-19T05:19:25.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.091+0000 7faf19f2c640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7faf14111c00 con 0x7faf14108110 2024-09-19T05:19:25.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.091+0000 7faf19f2c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7faf14111f00 con 0x7faf14100850 2024-09-19T05:19:25.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.091+0000 7faf13fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf14102240 0x7faf141a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.091+0000 7faf13fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf14102240 0x7faf141a6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52860/0 (socket says 172.21.15.120:52860) 2024-09-19T05:19:25.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.091+0000 7faf13fff640 1 -- 172.21.15.120:0/1646412622 learned_addr learned my addr 172.21.15.120:0/1646412622 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:25.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.091+0000 7faf137fe640 1 --2- 172.21.15.120:0/1646412622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf14100850 0x7faf141017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.091+0000 7faf12ffd640 1 --2- 172.21.15.120:0/1646412622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf14108110 0x7faf14101d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.091+0000 7faf13fff640 1 -- 172.21.15.120:0/1646412622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf14100850 msgr2=0x7faf141017c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:25.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.091+0000 7faf13fff640 1 --2- 172.21.15.120:0/1646412622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf14100850 0x7faf141017c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.091+0000 7faf13fff640 1 -- 172.21.15.120:0/1646412622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf14108110 msgr2=0x7faf14101d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:25.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.091+0000 7faf13fff640 1 --2- 172.21.15.120:0/1646412622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf14108110 0x7faf14101d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.091+0000 7faf13fff640 1 -- 172.21.15.120:0/1646412622 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf141a6a70 con 0x7faf14102240 2024-09-19T05:19:25.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.092+0000 7faf13fff640 1 --2- 172.21.15.120:0/1646412622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf14102240 0x7faf141a6370 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faf0c005cc0 tx=0x7faf0c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:25.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.092+0000 7faf10ff9640 1 -- 172.21.15.120:0/1646412622 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c004450 con 0x7faf14102240 2024-09-19T05:19:25.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.092+0000 7faf19f2c640 1 -- 172.21.15.120:0/1646412622 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf141a6d00 con 0x7faf14102240 2024-09-19T05:19:25.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.092+0000 7faf10ff9640 1 -- 172.21.15.120:0/1646412622 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7faf0c031c90 con 0x7faf14102240 2024-09-19T05:19:25.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.092+0000 7faf10ff9640 1 -- 172.21.15.120:0/1646412622 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c030e70 con 0x7faf14102240 2024-09-19T05:19:25.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.092+0000 7faf19f2c640 1 -- 172.21.15.120:0/1646412622 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf141a72a0 con 0x7faf14102240 2024-09-19T05:19:25.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.093+0000 7faf19f2c640 1 -- 172.21.15.120:0/1646412622 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf14069cc0 con 0x7faf14102240 2024-09-19T05:19:25.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.094+0000 7faf10ff9640 1 -- 172.21.15.120:0/1646412622 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7faf0c0045f0 con 0x7faf14102240 2024-09-19T05:19:25.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.095+0000 7faf10ff9640 1 --2- 172.21.15.120:0/1646412622 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7faefc0a3530 0x7faefc0a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.095+0000 7faf10ff9640 1 -- 172.21.15.120:0/1646412622 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7faf0c02e030 con 0x7faf14102240 2024-09-19T05:19:25.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.095+0000 7faf137fe640 1 --2- 172.21.15.120:0/1646412622 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7faefc0a3530 0x7faefc0a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.095+0000 7faf137fe640 1 --2- 172.21.15.120:0/1646412622 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7faefc0a3530 0x7faefc0a59f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faf0400abe0 tx=0x7faf0400a2d0 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:25.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.099+0000 7faf10ff9640 1 -- 172.21.15.120:0/1646412622 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faf0c04b060 con 0x7faf14102240 2024-09-19T05:19:25.280 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.278+0000 7faf19f2c640 1 -- 172.21.15.120:0/1646412622 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7faf14101200 con 0x7faf14102240 2024-09-19T05:19:25.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.284+0000 7faf10ff9640 1 -- 172.21.15.120:0/1646412622 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v33)=0 v33) ==== 138+0+0 (secure 0 0 0) 0x7faf0c0bde50 con 0x7faf14102240 2024-09-19T05:19:25.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.286+0000 7faf19f2c640 1 -- 172.21.15.120:0/1646412622 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7faefc0a3530 msgr2=0x7faefc0a59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:25.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.286+0000 7faf19f2c640 1 --2- 172.21.15.120:0/1646412622 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7faefc0a3530 0x7faefc0a59f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faf0400abe0 tx=0x7faf0400a2d0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.288 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.286+0000 7faf19f2c640 1 -- 172.21.15.120:0/1646412622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf14102240 msgr2=0x7faf141a6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:25.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.286+0000 7faf19f2c640 1 --2- 172.21.15.120:0/1646412622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf14102240 0x7faf141a6370 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faf0c005cc0 tx=0x7faf0c003c20 comp rx=0 tx=0).stop 2024-09-19T05:19:25.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.286+0000 7faf19f2c640 1 -- 172.21.15.120:0/1646412622 shutdown_connections 2024-09-19T05:19:25.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.286+0000 7faf19f2c640 1 --2- 172.21.15.120:0/1646412622 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7faefc0a3530 0x7faefc0a59f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.286+0000 7faf19f2c640 1 --2- 172.21.15.120:0/1646412622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faf14102240 0x7faf141a6370 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.286+0000 7faf19f2c640 1 --2- 172.21.15.120:0/1646412622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf14108110 0x7faf14101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.286+0000 7faf19f2c640 1 --2- 172.21.15.120:0/1646412622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf14100850 0x7faf141017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.286+0000 7faf19f2c640 1 -- 172.21.15.120:0/1646412622 >> 172.21.15.120:0/1646412622 conn(0x7faf14075db0 msgr2=0x7faf14105b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:25.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.287+0000 7faf19f2c640 1 -- 172.21.15.120:0/1646412622 shutdown_connections 2024-09-19T05:19:25.289 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.287+0000 7faf19f2c640 1 -- 172.21.15.120:0/1646412622 wait complete. 2024-09-19T05:19:25.301 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-19T05:19:25.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.419+0000 7fa179e53640 1 -- 172.21.15.120:0/1628231951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa174102c80 msgr2=0x7fa174103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:25.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.419+0000 7fa179e53640 1 --2- 172.21.15.120:0/1628231951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa174102c80 0x7fa174103060 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa164009900 tx=0x7fa16402a480 comp rx=0 tx=0).stop 2024-09-19T05:19:25.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.419+0000 7fa179e53640 1 -- 172.21.15.120:0/1628231951 shutdown_connections 2024-09-19T05:19:25.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.419+0000 7fa179e53640 1 --2- 172.21.15.120:0/1628231951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa17410c0d0 0x7fa17410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.419+0000 7fa179e53640 1 --2- 172.21.15.120:0/1628231951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1741035a0 0x7fa17410ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.419+0000 7fa179e53640 1 --2- 172.21.15.120:0/1628231951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa174102c80 0x7fa174103060 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.419+0000 7fa179e53640 1 -- 172.21.15.120:0/1628231951 >> 172.21.15.120:0/1628231951 conn(0x7fa174077990 msgr2=0x7fa1740fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:25.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.419+0000 7fa179e53640 1 -- 172.21.15.120:0/1628231951 shutdown_connections 2024-09-19T05:19:25.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.419+0000 7fa179e53640 1 -- 172.21.15.120:0/1628231951 wait complete. 2024-09-19T05:19:25.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.420+0000 7fa179e53640 1 Processor -- start 2024-09-19T05:19:25.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.420+0000 7fa179e53640 1 -- start start 2024-09-19T05:19:25.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.420+0000 7fa179e53640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa174102c80 0x7fa174198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.420+0000 7fa179e53640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1741035a0 0x7fa1741987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.420+0000 7fa179e53640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa17410c0d0 0x7fa17419cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.420+0000 7fa179e53640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa174111d60 con 0x7fa174102c80 2024-09-19T05:19:25.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.420+0000 7fa179e53640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa174111be0 con 0x7fa17410c0d0 2024-09-19T05:19:25.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.420+0000 7fa179e53640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa174111ee0 con 0x7fa1741035a0 2024-09-19T05:19:25.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.420+0000 7fa1737fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa174102c80 0x7fa174198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.420+0000 7fa1737fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa174102c80 0x7fa174198260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52864/0 (socket says 172.21.15.120:52864) 2024-09-19T05:19:25.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.420+0000 7fa1737fe640 1 -- 172.21.15.120:0/2931590153 learned_addr learned my addr 172.21.15.120:0/2931590153 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:25.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.420+0000 7fa172ffd640 1 --2- 172.21.15.120:0/2931590153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1741035a0 0x7fa1741987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.420+0000 7fa173fff640 1 --2- 172.21.15.120:0/2931590153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa17410c0d0 0x7fa17419cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.421+0000 7fa1737fe640 1 -- 172.21.15.120:0/2931590153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1741035a0 msgr2=0x7fa1741987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:25.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.421+0000 7fa1737fe640 1 --2- 172.21.15.120:0/2931590153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1741035a0 0x7fa1741987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.421+0000 7fa1737fe640 1 -- 172.21.15.120:0/2931590153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa17410c0d0 msgr2=0x7fa17419cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:25.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.421+0000 7fa1737fe640 1 --2- 172.21.15.120:0/2931590153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa17410c0d0 0x7fa17419cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.421+0000 7fa1737fe640 1 -- 172.21.15.120:0/2931590153 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17419d250 con 0x7fa174102c80 2024-09-19T05:19:25.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.421+0000 7fa1737fe640 1 --2- 172.21.15.120:0/2931590153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa174102c80 0x7fa174198260 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa164005940 tx=0x7fa1640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:25.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.421+0000 7fa170ff9640 1 -- 172.21.15.120:0/2931590153 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa16403f030 con 0x7fa174102c80 2024-09-19T05:19:25.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.421+0000 7fa170ff9640 1 -- 172.21.15.120:0/2931590153 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa164003cb0 con 0x7fa174102c80 2024-09-19T05:19:25.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.421+0000 7fa179e53640 1 -- 172.21.15.120:0/2931590153 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa17419d4e0 con 0x7fa174102c80 2024-09-19T05:19:25.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.421+0000 7fa170ff9640 1 -- 172.21.15.120:0/2931590153 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa164035070 con 0x7fa174102c80 2024-09-19T05:19:25.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.421+0000 7fa179e53640 1 -- 172.21.15.120:0/2931590153 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1741a4dd0 con 0x7fa174102c80 2024-09-19T05:19:25.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.422+0000 7fa179e53640 1 -- 172.21.15.120:0/2931590153 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa174103060 con 0x7fa174102c80 2024-09-19T05:19:25.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.424+0000 7fa170ff9640 1 -- 172.21.15.120:0/2931590153 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7fa164042030 con 0x7fa174102c80 2024-09-19T05:19:25.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.425+0000 7fa170ff9640 1 --2- 172.21.15.120:0/2931590153 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fa15c0a3580 0x7fa15c0a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.425+0000 7fa172ffd640 1 --2- 172.21.15.120:0/2931590153 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fa15c0a3580 0x7fa15c0a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.425+0000 7fa170ff9640 1 -- 172.21.15.120:0/2931590153 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fa1640f0590 con 0x7fa174102c80 2024-09-19T05:19:25.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.425+0000 7fa172ffd640 1 --2- 172.21.15.120:0/2931590153 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fa15c0a3580 0x7fa15c0a5a40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa17410e500 tx=0x7fa168005f90 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:25.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.429+0000 7fa170ff9640 1 -- 172.21.15.120:0/2931590153 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa1640bc760 con 0x7fa174102c80 2024-09-19T05:19:25.444 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:25 smithi120 ceph-mon[30956]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 683 B/s wr, 17 op/s 2024-09-19T05:19:25.444 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:25 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/4129056742' entity='client.admin' 2024-09-19T05:19:25.445 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:25 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:19:25.445 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:25 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:19:25.445 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:25 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:19:25.445 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:25 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:25.445 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:25 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1646412622' entity='client.admin' 2024-09-19T05:19:25.445 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:25 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:19:25.445 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:25 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:19:25.445 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:25 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:19:25.445 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:25 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:25.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.439+0000 7f931daff640 1 -- 172.21.15.120:0/1390545072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9318101df0 msgr2=0x7f93181021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:25.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.439+0000 7f931daff640 1 --2- 172.21.15.120:0/1390545072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9318101df0 0x7f93181021d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9308009900 tx=0x7f930802a410 comp rx=0 tx=0).stop 2024-09-19T05:19:25.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.439+0000 7f931daff640 1 -- 172.21.15.120:0/1390545072 shutdown_connections 2024-09-19T05:19:25.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.439+0000 7f931daff640 1 --2- 172.21.15.120:0/1390545072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9318106f20 0x7f931810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.439+0000 7f931daff640 1 --2- 172.21.15.120:0/1390545072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93181027a0 0x7f93181067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.439+0000 7f931daff640 1 --2- 172.21.15.120:0/1390545072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9318101df0 0x7f93181021d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.439+0000 7f931daff640 1 -- 172.21.15.120:0/1390545072 >> 172.21.15.120:0/1390545072 conn(0x7f93180fd8f0 msgr2=0x7f93180ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:25.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.439+0000 7f931daff640 1 -- 172.21.15.120:0/1390545072 shutdown_connections 2024-09-19T05:19:25.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.439+0000 7f931daff640 1 -- 172.21.15.120:0/1390545072 wait complete. 2024-09-19T05:19:25.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.440+0000 7f931daff640 1 Processor -- start 2024-09-19T05:19:25.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.440+0000 7f931daff640 1 -- start start 2024-09-19T05:19:25.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.441+0000 7f931daff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9318101df0 0x7f9318198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.441+0000 7f931daff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93181027a0 0x7f9318198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.441+0000 7f931daff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9318106f20 0x7f931819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.441+0000 7f931daff640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9318111e30 con 0x7f9318101df0 2024-09-19T05:19:25.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.441+0000 7f931daff640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9318111cb0 con 0x7f93181027a0 2024-09-19T05:19:25.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.441+0000 7f931daff640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9318111fb0 con 0x7f9318106f20 2024-09-19T05:19:25.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.441+0000 7f93177fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9318101df0 0x7f9318198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.441+0000 7f93177fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9318101df0 0x7f9318198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52880/0 (socket says 172.21.15.120:52880) 2024-09-19T05:19:25.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.441+0000 7f93177fe640 1 -- 172.21.15.120:0/761986860 learned_addr learned my addr 172.21.15.120:0/761986860 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:25.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.441+0000 7f9317fff640 1 --2- 172.21.15.120:0/761986860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9318106f20 0x7f931819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.441+0000 7f9316ffd640 1 --2- 172.21.15.120:0/761986860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93181027a0 0x7f9318198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.441+0000 7f93177fe640 1 -- 172.21.15.120:0/761986860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9318106f20 msgr2=0x7f931819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:25.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.441+0000 7f93177fe640 1 --2- 172.21.15.120:0/761986860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9318106f20 0x7f931819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.441+0000 7f93177fe640 1 -- 172.21.15.120:0/761986860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93181027a0 msgr2=0x7f9318198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:25.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.441+0000 7f93177fe640 1 --2- 172.21.15.120:0/761986860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93181027a0 0x7f9318198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.441+0000 7f93177fe640 1 -- 172.21.15.120:0/761986860 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931819d3c0 con 0x7f9318101df0 2024-09-19T05:19:25.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.441+0000 7f9316ffd640 1 --2- 172.21.15.120:0/761986860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93181027a0 0x7f9318198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:19:25.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.442+0000 7f93177fe640 1 --2- 172.21.15.120:0/761986860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9318101df0 0x7f9318198410 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9308005940 tx=0x7f93080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:25.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.442+0000 7f9314ff9640 1 -- 172.21.15.120:0/761986860 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930803f030 con 0x7f9318101df0 2024-09-19T05:19:25.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.442+0000 7f931daff640 1 -- 172.21.15.120:0/761986860 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f931819d650 con 0x7f9318101df0 2024-09-19T05:19:25.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.442+0000 7f9314ff9640 1 -- 172.21.15.120:0/761986860 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9308003cb0 con 0x7f9318101df0 2024-09-19T05:19:25.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.442+0000 7f9314ff9640 1 -- 172.21.15.120:0/761986860 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9308035070 con 0x7f9318101df0 2024-09-19T05:19:25.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.442+0000 7f931daff640 1 -- 172.21.15.120:0/761986860 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93181a4f90 con 0x7f9318101df0 2024-09-19T05:19:25.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.445+0000 7f9314ff9640 1 -- 172.21.15.120:0/761986860 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f9308042030 con 0x7f9318101df0 2024-09-19T05:19:25.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.445+0000 7f9314ff9640 1 --2- 172.21.15.120:0/761986860 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f93000a3440 0x7f93000a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.445+0000 7f931fed8740 1 Processor -- start 2024-09-19T05:19:25.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.445+0000 7f931fed8740 1 -- start start 2024-09-19T05:19:25.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.445+0000 7f9314ff9640 1 -- 172.21.15.120:0/761986860 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f93080f06d0 con 0x7f9318101df0 2024-09-19T05:19:25.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.445+0000 7f9316ffd640 1 --2- 172.21.15.120:0/761986860 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f93000a3440 0x7f93000a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.446+0000 7f931fed8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564720ffb60 0x5564720fff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.446+0000 7f931fed8740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556472100480 0x55647210a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.446+0000 7f931fed8740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55647210ad40 0x55647210d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.446+0000 7f931fed8740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556472065280 con 0x55647210ad40 2024-09-19T05:19:25.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.446+0000 7f931fed8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55647200cb10 con 0x5564720ffb60 2024-09-19T05:19:25.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.446+0000 7f931fed8740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x556472061240 con 0x556472100480 2024-09-19T05:19:25.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.446+0000 7f9317fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55647210ad40 0x55647210d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.446+0000 7f9317fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55647210ad40 0x55647210d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52882/0 (socket says 172.21.15.120:52882) 2024-09-19T05:19:25.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.446+0000 7f9317fff640 1 -- 172.21.15.120:0/3831705570 learned_addr learned my addr 172.21.15.120:0/3831705570 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:25.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.446+0000 7f93177fe640 1 --2- 172.21.15.120:0/3831705570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564720ffb60 0x5564720fff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.446+0000 7f9316ffd640 1 --2- 172.21.15.120:0/3831705570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556472100480 0x55647210a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.446+0000 7f9316ffd640 1 --2- 172.21.15.120:0/761986860 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f93000a3440 0x7f93000a5900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f930c0058c0 tx=0x7f930c00f730 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:25.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.446+0000 7f9317fff640 1 -- 172.21.15.120:0/3831705570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556472100480 msgr2=0x55647210a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:25.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.446+0000 7f9317fff640 1 --2- 172.21.15.120:0/3831705570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556472100480 0x55647210a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.446+0000 7f9317fff640 1 -- 172.21.15.120:0/3831705570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564720ffb60 msgr2=0x5564720fff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:25.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.446+0000 7f9317fff640 1 --2- 172.21.15.120:0/3831705570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564720ffb60 0x5564720fff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.446+0000 7f9317fff640 1 -- 172.21.15.120:0/3831705570 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564720191f0 con 0x55647210ad40 2024-09-19T05:19:25.457 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.446+0000 7f9317fff640 1 --2- 172.21.15.120:0/3831705570 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55647210ad40 0x55647210d130 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9310009f50 tx=0x7f93100118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354ddc364032453b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:25.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.447+0000 7f92fdffb640 1 -- 172.21.15.120:0/3831705570 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9310004d20 con 0x55647210ad40 2024-09-19T05:19:25.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.447+0000 7f92fdffb640 1 -- 172.21.15.120:0/3831705570 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9310004050 con 0x55647210ad40 2024-09-19T05:19:25.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.447+0000 7f92fdffb640 1 -- 172.21.15.120:0/3831705570 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9310005280 con 0x55647210ad40 2024-09-19T05:19:25.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.447+0000 7f931fed8740 1 -- 172.21.15.120:0/3831705570 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55647210ad40 msgr2=0x55647210d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:25.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.447+0000 7f931fed8740 1 --2- 172.21.15.120:0/3831705570 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55647210ad40 0x55647210d130 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9310009f50 tx=0x7f93100118d0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.447+0000 7f931fed8740 1 -- 172.21.15.120:0/3831705570 shutdown_connections 2024-09-19T05:19:25.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.447+0000 7f931fed8740 1 --2- 172.21.15.120:0/3831705570 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55647210ad40 0x55647210d130 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.447+0000 7f931fed8740 1 --2- 172.21.15.120:0/3831705570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556472100480 0x55647210a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.447+0000 7f931fed8740 1 --2- 172.21.15.120:0/3831705570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5564720ffb60 0x5564720fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.447+0000 7f931fed8740 1 -- 172.21.15.120:0/3831705570 >> 172.21.15.120:0/3831705570 conn(0x5564720fc0f0 msgr2=0x5564720fc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:25.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.448+0000 7f931fed8740 1 -- 172.21.15.120:0/3831705570 shutdown_connections 2024-09-19T05:19:25.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.448+0000 7f931fed8740 1 -- 172.21.15.120:0/3831705570 wait complete. 2024-09-19T05:19:25.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.448+0000 7f931fed8740 1 -- start start 2024-09-19T05:19:25.458 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.448+0000 7f931fed8740 1 Processor -- start 2024-09-19T05:19:25.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.448+0000 7f931fed8740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564720ffb60 0x556472107ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.448+0000 7f931fed8740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556472100480 0x5564721080e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.448+0000 7f931fed8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55647210ad40 0x556472108620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.448+0000 7f931fed8740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556472111d20 con 0x556472100480 2024-09-19T05:19:25.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.448+0000 7f931fed8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55647201ff10 con 0x55647210ad40 2024-09-19T05:19:25.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.448+0000 7f931fed8740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x556472111ea0 con 0x5564720ffb60 2024-09-19T05:19:25.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.448+0000 7f931fed8740 10 client.0 _ll_register_callbacks cb 0x556471fe8a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:19:25.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.449+0000 7f9316ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556472100480 0x5564721080e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.449+0000 7f9317fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55647210ad40 0x556472108620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.449+0000 7f9316ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556472100480 0x5564721080e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52894/0 (socket says 172.21.15.120:52894) 2024-09-19T05:19:25.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.449+0000 7f9316ffd640 1 -- 172.21.15.120:0/3241707057 learned_addr learned my addr 172.21.15.120:0/3241707057 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:25.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.449+0000 7f93177fe640 1 --2- 172.21.15.120:0/3241707057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564720ffb60 0x556472107ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.449+0000 7f93177fe640 1 -- 172.21.15.120:0/3241707057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55647210ad40 msgr2=0x556472108620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:25.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.449+0000 7f93177fe640 1 --2- 172.21.15.120:0/3241707057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55647210ad40 0x556472108620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.449+0000 7f93177fe640 1 -- 172.21.15.120:0/3241707057 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556472100480 msgr2=0x5564721080e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:25.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.449+0000 7f93177fe640 1 --2- 172.21.15.120:0/3241707057 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556472100480 0x5564721080e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.449+0000 7f93177fe640 1 -- 172.21.15.120:0/3241707057 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556471dd66a0 con 0x5564720ffb60 2024-09-19T05:19:25.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.449+0000 7f9317fff640 1 --2- 172.21.15.120:0/3241707057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55647210ad40 0x556472108620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:19:25.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.449+0000 7f9316ffd640 1 --2- 172.21.15.120:0/3241707057 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556472100480 0x5564721080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:19:25.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.449+0000 7f93177fe640 1 --2- 172.21.15.120:0/3241707057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564720ffb60 0x556472107ba0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f93080edd10 tx=0x7f93080bc5c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11569920d36479fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:25.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.449+0000 7f92f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:19:25.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.449+0000 7f92f6ffd640 1 -- 172.21.15.120:0/3241707057 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9308049050 con 0x5564720ffb60 2024-09-19T05:19:25.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.449+0000 7f92f6ffd640 1 -- 172.21.15.120:0/3241707057 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f93080bca50 con 0x5564720ffb60 2024-09-19T05:19:25.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.449+0000 7f931fed8740 1 -- 172.21.15.120:0/3241707057 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9310004050 con 0x5564720ffb60 2024-09-19T05:19:25.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.449+0000 7f92f6ffd640 1 -- 172.21.15.120:0/3241707057 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9308005d50 con 0x5564720ffb60 2024-09-19T05:19:25.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.449+0000 7f931fed8740 10 client.24883 fetch_fsmap learned FSMap version 25 2024-09-19T05:19:25.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.449+0000 7f931fed8740 1 -- 172.21.15.120:0/3241707057 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556472111d20 con 0x5564720ffb60 2024-09-19T05:19:25.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.450+0000 7f92f6ffd640 1 -- 172.21.15.120:0/3241707057 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9310004050 con 0x5564720ffb60 2024-09-19T05:19:25.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.450+0000 7f92f6ffd640 1 -- 172.21.15.120:0/3241707057 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f93080c4fd0 con 0x5564720ffb60 2024-09-19T05:19:25.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.450+0000 7f931fed8740 10 client.24883 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:19:25.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.450+0000 7f931fed8740 10 client.24883 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:19:25.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.450+0000 7f931fed8740 20 client.24883 populate_metadata read hostname 'smithi120' 2024-09-19T05:19:25.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.450+0000 7f931fed8740 1 --2- 172.21.15.120:0/3241707057 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55647211ed00 0x556472121160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.450+0000 7f931fed8740 4 client.24883 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:19:25.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.450+0000 7f931fed8740 1 -- 172.21.15.120:0/3241707057 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564720727f0 con 0x55647211ed00 2024-09-19T05:19:25.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.450+0000 7f9316ffd640 1 --2- 172.21.15.120:0/3241707057 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55647211ed00 0x556472121160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.451+0000 7f92f6ffd640 10 client.24883 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:19:25.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.451+0000 7f9316ffd640 1 --2- 172.21.15.120:0/3241707057 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55647211ed00 0x556472121160 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c313cdfd8639dea server_cookie=78da3f589d829ef0 in_seq=0 out_seq=0 2024-09-19T05:19:25.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.452+0000 7f92f6ffd640 1 -- 172.21.15.120:0/3241707057 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5564720727f0 con 0x55647211ed00 2024-09-19T05:19:25.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.452+0000 7f92f6ffd640 10 client.24883 handle_command_reply: tid=0 2024-09-19T05:19:25.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.452+0000 7f931fed8740 1 client.24883 shutdown 2024-09-19T05:19:25.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.452+0000 7f931fed8740 1 -- 172.21.15.120:0/3241707057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564720ffb60 msgr2=0x556472107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:25.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.452+0000 7f931fed8740 1 --2- 172.21.15.120:0/3241707057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564720ffb60 0x556472107ba0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f93080edd10 tx=0x7f93080bc5c0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.452+0000 7f931fed8740 1 -- 172.21.15.120:0/3241707057 shutdown_connections 2024-09-19T05:19:25.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.452+0000 7f931fed8740 1 --2- 172.21.15.120:0/3241707057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55647210ad40 0x556472108620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.452+0000 7f931fed8740 1 --2- 172.21.15.120:0/3241707057 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556472100480 0x5564721080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.452+0000 7f931fed8740 1 --2- 172.21.15.120:0/3241707057 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55647211ed00 0x556472121160 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.452+0000 7f92f6ffd640 0 client.24883 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:19:25.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.452+0000 7f931fed8740 1 --2- 172.21.15.120:0/3241707057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564720ffb60 0x556472107ba0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.452+0000 7f931fed8740 1 -- 172.21.15.120:0/3241707057 >> 172.21.15.120:0/3241707057 conn(0x5564720fc0f0 msgr2=0x5564720fb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:25.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.452+0000 7f931fed8740 1 -- 172.21.15.120:0/3241707057 shutdown_connections 2024-09-19T05:19:25.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.452+0000 7f931fed8740 1 -- 172.21.15.120:0/3241707057 wait complete. 2024-09-19T05:19:25.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.452+0000 7f931fed8740 20 client.24883 trim_cache size 0 max 16384 2024-09-19T05:19:25.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.471+0000 7f931fed8740 1 Processor -- start 2024-09-19T05:19:25.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.471+0000 7f931fed8740 1 -- start start 2024-09-19T05:19:25.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.471+0000 7f931fed8740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564720ffb60 0x556472109a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.471+0000 7f931fed8740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556472100480 0x556472126a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.471+0000 7f931fed8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55647210ad40 0x556472126fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.471+0000 7f931fed8740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f93181adf90 con 0x5564720ffb60 2024-09-19T05:19:25.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.471+0000 7f931fed8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f93181ab860 con 0x55647210ad40 2024-09-19T05:19:25.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.471+0000 7f931fed8740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f93181a96b0 con 0x556472100480 2024-09-19T05:19:25.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.471+0000 7f93177fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564720ffb60 0x556472109a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.471+0000 7f93177fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564720ffb60 0x556472109a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52902/0 (socket says 172.21.15.120:52902) 2024-09-19T05:19:25.474 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.471+0000 7f93177fe640 1 -- 172.21.15.120:0/427637183 learned_addr learned my addr 172.21.15.120:0/427637183 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:25.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.472+0000 7f9316ffd640 1 --2- 172.21.15.120:0/427637183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556472100480 0x556472126a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.472+0000 7f9317fff640 1 --2- 172.21.15.120:0/427637183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55647210ad40 0x556472126fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.472+0000 7f93177fe640 1 -- 172.21.15.120:0/427637183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556472100480 msgr2=0x556472126a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:25.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.472+0000 7f93177fe640 1 --2- 172.21.15.120:0/427637183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556472100480 0x556472126a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.472+0000 7f93177fe640 1 -- 172.21.15.120:0/427637183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55647210ad40 msgr2=0x556472126fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:25.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.472+0000 7f93177fe640 1 --2- 172.21.15.120:0/427637183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55647210ad40 0x556472126fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.472+0000 7f93177fe640 1 -- 172.21.15.120:0/427637183 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564721217e0 con 0x5564720ffb60 2024-09-19T05:19:25.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.472+0000 7f9316ffd640 1 --2- 172.21.15.120:0/427637183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556472100480 0x556472126a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:19:25.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.472+0000 7f93177fe640 1 --2- 172.21.15.120:0/427637183 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564720ffb60 0x556472109a00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f93080b8c50 tx=0x7f93080bc6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c70ad1e1928a6c57 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:25.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.472+0000 7f92fd7fa640 1 -- 172.21.15.120:0/427637183 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9308049070 con 0x5564720ffb60 2024-09-19T05:19:25.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.472+0000 7f92fd7fa640 1 -- 172.21.15.120:0/427637183 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f930803b460 con 0x5564720ffb60 2024-09-19T05:19:25.475 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.472+0000 7f92fd7fa640 1 -- 172.21.15.120:0/427637183 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9308003e60 con 0x5564720ffb60 2024-09-19T05:19:25.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.473+0000 7f931fed8740 1 -- 172.21.15.120:0/427637183 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564720ffb60 msgr2=0x556472109a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:25.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.473+0000 7f931fed8740 1 --2- 172.21.15.120:0/427637183 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564720ffb60 0x556472109a00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f93080b8c50 tx=0x7f93080bc6f0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.473+0000 7f931fed8740 1 -- 172.21.15.120:0/427637183 shutdown_connections 2024-09-19T05:19:25.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.473+0000 7f931fed8740 1 --2- 172.21.15.120:0/427637183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55647210ad40 0x556472126fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.473+0000 7f931fed8740 1 --2- 172.21.15.120:0/427637183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556472100480 0x556472126a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.473+0000 7f931fed8740 1 --2- 172.21.15.120:0/427637183 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5564720ffb60 0x556472109a00 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.478 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.473+0000 7f931fed8740 1 -- 172.21.15.120:0/427637183 >> 172.21.15.120:0/427637183 conn(0x5564720fc0f0 msgr2=0x5564721092f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:25.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.473+0000 7f931fed8740 1 -- 172.21.15.120:0/427637183 shutdown_connections 2024-09-19T05:19:25.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.473+0000 7f931fed8740 1 -- 172.21.15.120:0/427637183 wait complete. 2024-09-19T05:19:25.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.473+0000 7f931fed8740 1 -- start start 2024-09-19T05:19:25.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.474+0000 7f931fed8740 1 Processor -- start 2024-09-19T05:19:25.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.474+0000 7f931fed8740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564720ffb60 0x556472117a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.474+0000 7f931fed8740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556472100480 0x556472104a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.474+0000 7f931fed8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55647210ad40 0x5564721051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.474+0000 7f931fed8740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f93181a9d20 con 0x556472100480 2024-09-19T05:19:25.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.474+0000 7f931fed8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f93181ab190 con 0x55647210ad40 2024-09-19T05:19:25.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.474+0000 7f931fed8740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f93181aa3f0 con 0x5564720ffb60 2024-09-19T05:19:25.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.474+0000 7f9316ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556472100480 0x556472104a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.474+0000 7f9316ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556472100480 0x556472104a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52910/0 (socket says 172.21.15.120:52910) 2024-09-19T05:19:25.479 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.474+0000 7f9316ffd640 1 -- 172.21.15.120:0/1905329462 learned_addr learned my addr 172.21.15.120:0/1905329462 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:25.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.474+0000 7f931fed8740 10 client.0 _ll_register_callbacks cb 0x7f9308004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:19:25.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.474+0000 7f93177fe640 1 --2- 172.21.15.120:0/1905329462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564720ffb60 0x556472117a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.474+0000 7f9317fff640 1 --2- 172.21.15.120:0/1905329462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55647210ad40 0x5564721051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.475+0000 7f9316ffd640 1 -- 172.21.15.120:0/1905329462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564720ffb60 msgr2=0x556472117a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:25.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.475+0000 7f9316ffd640 1 --2- 172.21.15.120:0/1905329462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564720ffb60 0x556472117a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.475+0000 7f9316ffd640 1 -- 172.21.15.120:0/1905329462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55647210ad40 msgr2=0x5564721051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:25.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.475+0000 7f9316ffd640 1 --2- 172.21.15.120:0/1905329462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55647210ad40 0x5564721051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.475+0000 7f9316ffd640 1 -- 172.21.15.120:0/1905329462 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556472188a40 con 0x556472100480 2024-09-19T05:19:25.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.475+0000 7f9317fff640 1 --2- 172.21.15.120:0/1905329462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55647210ad40 0x5564721051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:19:25.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.475+0000 7f9316ffd640 1 --2- 172.21.15.120:0/1905329462 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556472100480 0x556472104a80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f930c012690 tx=0x7f930c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adcbb9befcf32dac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:25.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.475+0000 7f92f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:19:25.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.475+0000 7f92f6ffd640 1 -- 172.21.15.120:0/1905329462 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930c0297c0 con 0x556472100480 2024-09-19T05:19:25.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.475+0000 7f92f6ffd640 1 -- 172.21.15.120:0/1905329462 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f930c029960 con 0x556472100480 2024-09-19T05:19:25.480 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.475+0000 7f931fed8740 1 -- 172.21.15.120:0/1905329462 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55647206cd00 con 0x556472100480 2024-09-19T05:19:25.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.475+0000 7f92f6ffd640 1 -- 172.21.15.120:0/1905329462 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f930c039050 con 0x556472100480 2024-09-19T05:19:25.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.475+0000 7f931fed8740 10 client.15306 fetch_fsmap learned FSMap version 25 2024-09-19T05:19:25.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.475+0000 7f931fed8740 1 -- 172.21.15.120:0/1905329462 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556472189c70 con 0x556472100480 2024-09-19T05:19:25.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.475+0000 7f92f6ffd640 1 -- 172.21.15.120:0/1905329462 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55647206cd00 con 0x556472100480 2024-09-19T05:19:25.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.476+0000 7f92f6ffd640 1 -- 172.21.15.120:0/1905329462 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f930c01d400 con 0x556472100480 2024-09-19T05:19:25.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.476+0000 7f931fed8740 10 client.15306 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:19:25.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.476+0000 7f931fed8740 10 client.15306 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:19:25.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.476+0000 7f931fed8740 20 client.15306 populate_metadata read hostname 'smithi120' 2024-09-19T05:19:25.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.476+0000 7f931fed8740 1 --2- 172.21.15.120:0/1905329462 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55647218a420 0x55647218c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.476+0000 7f931fed8740 4 client.15306 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T05:19:25.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.476+0000 7f931fed8740 1 -- 172.21.15.120:0/1905329462 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556471fe9110 con 0x55647218a420 2024-09-19T05:19:25.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.476+0000 7f93177fe640 1 --2- 172.21.15.120:0/1905329462 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55647218a420 0x55647218c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.476+0000 7f92f6ffd640 10 client.15306 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:19:25.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.476+0000 7f93177fe640 1 --2- 172.21.15.120:0/1905329462 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55647218a420 0x55647218c840 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=842e4bb1e62008ef server_cookie=5104f76c760d6491 in_seq=0 out_seq=0 2024-09-19T05:19:25.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.477+0000 7f92f6ffd640 1 -- 172.21.15.120:0/1905329462 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556471fe9110 con 0x55647218a420 2024-09-19T05:19:25.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.477+0000 7f92f6ffd640 10 client.15306 handle_command_reply: tid=0 2024-09-19T05:19:25.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.477+0000 7f931fed8740 1 client.15306 shutdown 2024-09-19T05:19:25.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.477+0000 7f931fed8740 1 -- 172.21.15.120:0/1905329462 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556472100480 msgr2=0x556472104a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:25.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.478+0000 7f931fed8740 1 --2- 172.21.15.120:0/1905329462 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556472100480 0x556472104a80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f930c012690 tx=0x7f930c004730 comp rx=0 tx=0).stop 2024-09-19T05:19:25.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.478+0000 7f931fed8740 1 -- 172.21.15.120:0/1905329462 shutdown_connections 2024-09-19T05:19:25.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.478+0000 7f931fed8740 1 --2- 172.21.15.120:0/1905329462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55647210ad40 0x5564721051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.478+0000 7f931fed8740 1 --2- 172.21.15.120:0/1905329462 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556472100480 0x556472104a80 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.478+0000 7f931fed8740 1 --2- 172.21.15.120:0/1905329462 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55647218a420 0x55647218c840 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.478+0000 7f931fed8740 1 --2- 172.21.15.120:0/1905329462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5564720ffb60 0x556472117a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.478+0000 7f92f6ffd640 0 client.15306 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:19:25.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.478+0000 7f931fed8740 1 -- 172.21.15.120:0/1905329462 >> 172.21.15.120:0/1905329462 conn(0x5564720fc0f0 msgr2=0x556472101dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:25.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.478+0000 7f931fed8740 1 -- 172.21.15.120:0/1905329462 shutdown_connections 2024-09-19T05:19:25.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.478+0000 7f931fed8740 1 -- 172.21.15.120:0/1905329462 wait complete. 2024-09-19T05:19:25.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.478+0000 7f931fed8740 20 client.15306 trim_cache size 0 max 16384 2024-09-19T05:19:25.484 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T05:19:25.484 INFO:teuthology.orchestra.run.smithi120.stdout: "return_code": 0, 2024-09-19T05:19:25.484 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_tag": "57dd2b09-b9b1-438e-adad-f835a4f3e818", 2024-09-19T05:19:25.484 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": "asynchronous" 2024-09-19T05:19:25.484 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T05:19:25.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.479+0000 7f931daff640 1 -- 172.21.15.120:0/761986860 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f93000a3440 msgr2=0x7f93000a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:25.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.479+0000 7f931daff640 1 --2- 172.21.15.120:0/761986860 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f93000a3440 0x7f93000a5900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f930c0058c0 tx=0x7f930c00f730 comp rx=0 tx=0).stop 2024-09-19T05:19:25.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.479+0000 7f931daff640 1 -- 172.21.15.120:0/761986860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9318101df0 msgr2=0x7f9318198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:25.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.479+0000 7f931daff640 1 --2- 172.21.15.120:0/761986860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9318101df0 0x7f9318198410 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9308005940 tx=0x7f93080042f0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.479+0000 7f931daff640 1 -- 172.21.15.120:0/761986860 shutdown_connections 2024-09-19T05:19:25.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.479+0000 7f931daff640 1 --2- 172.21.15.120:0/761986860 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f93000a3440 0x7f93000a5900 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.479+0000 7f931daff640 1 --2- 172.21.15.120:0/761986860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9318106f20 0x7f931819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.485 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.479+0000 7f931daff640 1 --2- 172.21.15.120:0/761986860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93181027a0 0x7f9318198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.479+0000 7f931daff640 1 --2- 172.21.15.120:0/761986860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9318101df0 0x7f9318198410 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.479+0000 7f931daff640 1 -- 172.21.15.120:0/761986860 >> 172.21.15.120:0/761986860 conn(0x7f93180fd8f0 msgr2=0x7f93180fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:25.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.479+0000 7f931daff640 1 -- 172.21.15.120:0/761986860 shutdown_connections 2024-09-19T05:19:25.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.479+0000 7f931daff640 1 -- 172.21.15.120:0/761986860 wait complete. 2024-09-19T05:19:25.623 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.622+0000 7fa179e53640 1 -- 172.21.15.120:0/2931590153 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fa174107140 con 0x7fa174102c80 2024-09-19T05:19:25.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.628+0000 7fa170ff9640 1 -- 172.21.15.120:0/2931590153 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v34)=0 v34) ==== 133+0+0 (secure 0 0 0) 0x7fa1640c0a60 con 0x7fa174102c80 2024-09-19T05:19:25.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.631+0000 7fa179e53640 1 -- 172.21.15.120:0/2931590153 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fa15c0a3580 msgr2=0x7fa15c0a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:25.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.631+0000 7fa179e53640 1 --2- 172.21.15.120:0/2931590153 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fa15c0a3580 0x7fa15c0a5a40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa17410e500 tx=0x7fa168005f90 comp rx=0 tx=0).stop 2024-09-19T05:19:25.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.631+0000 7fa179e53640 1 -- 172.21.15.120:0/2931590153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa174102c80 msgr2=0x7fa174198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:25.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.631+0000 7fa179e53640 1 --2- 172.21.15.120:0/2931590153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa174102c80 0x7fa174198260 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa164005940 tx=0x7fa1640042f0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.631+0000 7fa179e53640 1 -- 172.21.15.120:0/2931590153 shutdown_connections 2024-09-19T05:19:25.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.631+0000 7fa179e53640 1 --2- 172.21.15.120:0/2931590153 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fa15c0a3580 0x7fa15c0a5a40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.631+0000 7fa179e53640 1 --2- 172.21.15.120:0/2931590153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa17410c0d0 0x7fa17419cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.631+0000 7fa179e53640 1 --2- 172.21.15.120:0/2931590153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1741035a0 0x7fa1741987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.631+0000 7fa179e53640 1 --2- 172.21.15.120:0/2931590153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa174102c80 0x7fa174198260 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.631+0000 7fa179e53640 1 -- 172.21.15.120:0/2931590153 >> 172.21.15.120:0/2931590153 conn(0x7fa174077990 msgr2=0x7fa1740fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:25.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.631+0000 7fa179e53640 1 -- 172.21.15.120:0/2931590153 shutdown_connections 2024-09-19T05:19:25.634 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.631+0000 7fa179e53640 1 -- 172.21.15.120:0/2931590153 wait complete. 2024-09-19T05:19:25.646 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-19T05:19:25.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:25 smithi194 ceph-mon[35228]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 683 B/s wr, 17 op/s 2024-09-19T05:19:25.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:25 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/4129056742' entity='client.admin' 2024-09-19T05:19:25.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:25 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:19:25.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:25 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:19:25.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:25 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:19:25.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:25 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:25.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:25 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1646412622' entity='client.admin' 2024-09-19T05:19:25.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:25 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:19:25.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:25 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:19:25.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:25 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:19:25.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:25 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:25.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:25 smithi178 ceph-mon[34347]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 683 B/s wr, 17 op/s 2024-09-19T05:19:25.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:25 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/4129056742' entity='client.admin' 2024-09-19T05:19:25.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:25 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:19:25.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:25 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:19:25.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:25 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:19:25.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:25 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:25.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:25 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1646412622' entity='client.admin' 2024-09-19T05:19:25.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:25 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:19:25.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:25 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:19:25.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:25 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:19:25.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:25 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:25.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.751+0000 7f26bbf86640 1 -- 172.21.15.120:0/3518115411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26b410c110 msgr2=0x7f26b410e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:25.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.751+0000 7f26bbf86640 1 --2- 172.21.15.120:0/3518115411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26b410c110 0x7f26b410e560 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f26ac009ca0 tx=0x7f26ac02a8c0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.751+0000 7f26bbf86640 1 -- 172.21.15.120:0/3518115411 shutdown_connections 2024-09-19T05:19:25.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.751+0000 7f26bbf86640 1 --2- 172.21.15.120:0/3518115411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26b410c110 0x7f26b410e560 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.751+0000 7f26bbf86640 1 --2- 172.21.15.120:0/3518115411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26b41035c0 0x7f26b410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.751+0000 7f26bbf86640 1 --2- 172.21.15.120:0/3518115411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26b4102c10 0x7f26b4102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.751+0000 7f26bbf86640 1 -- 172.21.15.120:0/3518115411 >> 172.21.15.120:0/3518115411 conn(0x7f26b40fc6f0 msgr2=0x7f26b40feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:25.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.751+0000 7f26bbf86640 1 -- 172.21.15.120:0/3518115411 shutdown_connections 2024-09-19T05:19:25.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.751+0000 7f26bbf86640 1 -- 172.21.15.120:0/3518115411 wait complete. 2024-09-19T05:19:25.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.751+0000 7f26bbf86640 1 Processor -- start 2024-09-19T05:19:25.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.751+0000 7f26bbf86640 1 -- start start 2024-09-19T05:19:25.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.752+0000 7f26bbf86640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26b4102c10 0x7f26b41008f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.752+0000 7f26bbf86640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26b41035c0 0x7f26b4100e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.752+0000 7f26bbf86640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26b410c110 0x7f26b4101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.752+0000 7f26bbf86640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f26b4111d70 con 0x7f26b41035c0 2024-09-19T05:19:25.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.752+0000 7f26bbf86640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f26b4111bf0 con 0x7f26b4102c10 2024-09-19T05:19:25.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.752+0000 7f26bbf86640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f26b4111ef0 con 0x7f26b410c110 2024-09-19T05:19:25.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.752+0000 7f26b9521640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26b41035c0 0x7f26b4100e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.752+0000 7f26b9521640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26b41035c0 0x7f26b4100e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52928/0 (socket says 172.21.15.120:52928) 2024-09-19T05:19:25.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.752+0000 7f26b9521640 1 -- 172.21.15.120:0/2965998719 learned_addr learned my addr 172.21.15.120:0/2965998719 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:25.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.752+0000 7f26ba523640 1 --2- 172.21.15.120:0/2965998719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26b410c110 0x7f26b4101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.752+0000 7f26b9d22640 1 --2- 172.21.15.120:0/2965998719 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26b4102c10 0x7f26b41008f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.752+0000 7f26b9521640 1 -- 172.21.15.120:0/2965998719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26b410c110 msgr2=0x7f26b4101370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:25.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.752+0000 7f26b9521640 1 --2- 172.21.15.120:0/2965998719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26b410c110 0x7f26b4101370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.752+0000 7f26b9521640 1 -- 172.21.15.120:0/2965998719 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26b4102c10 msgr2=0x7f26b41008f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:25.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.752+0000 7f26b9521640 1 --2- 172.21.15.120:0/2965998719 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26b4102c10 0x7f26b41008f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:25.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.752+0000 7f26b9521640 1 -- 172.21.15.120:0/2965998719 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b41a66e0 con 0x7f26b41035c0 2024-09-19T05:19:25.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.752+0000 7f26b9d22640 1 --2- 172.21.15.120:0/2965998719 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26b4102c10 0x7f26b41008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:19:25.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.752+0000 7f26b9521640 1 --2- 172.21.15.120:0/2965998719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26b41035c0 0x7f26b4100e30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f26a400d950 tx=0x7f26a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:25.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.752+0000 7f26aaffd640 1 -- 172.21.15.120:0/2965998719 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a4017070 con 0x7f26b41035c0 2024-09-19T05:19:25.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.752+0000 7f26aaffd640 1 -- 172.21.15.120:0/2965998719 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f26a4009c30 con 0x7f26b41035c0 2024-09-19T05:19:25.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.752+0000 7f26aaffd640 1 -- 172.21.15.120:0/2965998719 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a400f620 con 0x7f26b41035c0 2024-09-19T05:19:25.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.752+0000 7f26bbf86640 1 -- 172.21.15.120:0/2965998719 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26b41a69d0 con 0x7f26b41035c0 2024-09-19T05:19:25.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.753+0000 7f26bbf86640 1 -- 172.21.15.120:0/2965998719 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b41a6f70 con 0x7f26b41035c0 2024-09-19T05:19:25.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.754+0000 7f26bbf86640 1 -- 172.21.15.120:0/2965998719 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26b4102ff0 con 0x7f26b41035c0 2024-09-19T05:19:25.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.755+0000 7f26aaffd640 1 -- 172.21.15.120:0/2965998719 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f26a40109a0 con 0x7f26b41035c0 2024-09-19T05:19:25.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.756+0000 7f26aaffd640 1 --2- 172.21.15.120:0/2965998719 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f26a00a3580 0x7f26a00a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:25.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.756+0000 7f26b9d22640 1 --2- 172.21.15.120:0/2965998719 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f26a00a3580 0x7f26a00a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:25.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.756+0000 7f26aaffd640 1 -- 172.21.15.120:0/2965998719 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f26a40cfa20 con 0x7f26b41035c0 2024-09-19T05:19:25.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.756+0000 7f26b9d22640 1 --2- 172.21.15.120:0/2965998719 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f26a00a3580 0x7f26a00a5a40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f26b0009c20 tx=0x7f26b0005f90 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:25.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.763+0000 7f26aaffd640 1 -- 172.21.15.120:0/2965998719 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f26a4009de0 con 0x7f26b41035c0 2024-09-19T05:19:25.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:25.960+0000 7f26bbf86640 1 -- 172.21.15.120:0/2965998719 --> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f26b4062630 con 0x7f26a00a3580 2024-09-19T05:19:26.029 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.027+0000 7f26aaffd640 1 -- 172.21.15.120:0/2965998719 <== mgr.15156 v2:172.21.15.120:6800/1306632207 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f26b4062630 con 0x7f26a00a3580 2024-09-19T05:19:26.029 INFO:teuthology.orchestra.run.smithi120.stdout:Schedule set for path / 2024-09-19T05:19:26.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.029+0000 7f26bbf86640 1 -- 172.21.15.120:0/2965998719 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f26a00a3580 msgr2=0x7f26a00a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:26.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.029+0000 7f26bbf86640 1 --2- 172.21.15.120:0/2965998719 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f26a00a3580 0x7f26a00a5a40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f26b0009c20 tx=0x7f26b0005f90 comp rx=0 tx=0).stop 2024-09-19T05:19:26.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.029+0000 7f26bbf86640 1 -- 172.21.15.120:0/2965998719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26b41035c0 msgr2=0x7f26b4100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:26.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.029+0000 7f26bbf86640 1 --2- 172.21.15.120:0/2965998719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26b41035c0 0x7f26b4100e30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f26a400d950 tx=0x7f26a400de10 comp rx=0 tx=0).stop 2024-09-19T05:19:26.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.029+0000 7f26bbf86640 1 -- 172.21.15.120:0/2965998719 shutdown_connections 2024-09-19T05:19:26.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.029+0000 7f26bbf86640 1 --2- 172.21.15.120:0/2965998719 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f26a00a3580 0x7f26a00a5a40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.029+0000 7f26bbf86640 1 --2- 172.21.15.120:0/2965998719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26b410c110 0x7f26b4101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.029+0000 7f26bbf86640 1 --2- 172.21.15.120:0/2965998719 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f26b41035c0 0x7f26b4100e30 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.029+0000 7f26bbf86640 1 --2- 172.21.15.120:0/2965998719 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26b4102c10 0x7f26b41008f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.029+0000 7f26bbf86640 1 -- 172.21.15.120:0/2965998719 >> 172.21.15.120:0/2965998719 conn(0x7f26b40fc6f0 msgr2=0x7f26b40fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:26.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.030+0000 7f26bbf86640 1 -- 172.21.15.120:0/2965998719 shutdown_connections 2024-09-19T05:19:26.032 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.030+0000 7f26bbf86640 1 -- 172.21.15.120:0/2965998719 wait complete. 2024-09-19T05:19:26.042 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-19T05:19:26.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.146+0000 7f585fc9b640 1 -- 172.21.15.120:0/4134503452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58581069c0 msgr2=0x7f5858106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:26.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.146+0000 7f585fc9b640 1 --2- 172.21.15.120:0/4134503452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58581069c0 0x7f5858106da0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5848009930 tx=0x7f584802a420 comp rx=0 tx=0).stop 2024-09-19T05:19:26.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.146+0000 7f585fc9b640 1 -- 172.21.15.120:0/4134503452 shutdown_connections 2024-09-19T05:19:26.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.146+0000 7f585fc9b640 1 --2- 172.21.15.120:0/4134503452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5858101350 0x7f585810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.146+0000 7f585fc9b640 1 --2- 172.21.15.120:0/4134503452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58581009b0 0x7f5858100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.146+0000 7f585fc9b640 1 --2- 172.21.15.120:0/4134503452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58581069c0 0x7f5858106da0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.146+0000 7f585fc9b640 1 -- 172.21.15.120:0/4134503452 >> 172.21.15.120:0/4134503452 conn(0x7f5858077990 msgr2=0x7f58580fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:26.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.146+0000 7f585fc9b640 1 -- 172.21.15.120:0/4134503452 shutdown_connections 2024-09-19T05:19:26.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.146+0000 7f585fc9b640 1 -- 172.21.15.120:0/4134503452 wait complete. 2024-09-19T05:19:26.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.147+0000 7f585fc9b640 1 Processor -- start 2024-09-19T05:19:26.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.147+0000 7f585fc9b640 1 -- start start 2024-09-19T05:19:26.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.147+0000 7f585fc9b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58581009b0 0x7f58581982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:26.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.147+0000 7f585fc9b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5858101350 0x7f5858198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:26.151 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.147+0000 7f585fc9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58581069c0 0x7f585819cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:26.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.147+0000 7f585fc9b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5858110cb0 con 0x7f58581069c0 2024-09-19T05:19:26.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.147+0000 7f585fc9b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5858110b30 con 0x7f5858101350 2024-09-19T05:19:26.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.147+0000 7f585fc9b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5858110e30 con 0x7f58581009b0 2024-09-19T05:19:26.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.147+0000 7f585e238640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58581069c0 0x7f585819cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:26.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.147+0000 7f585e238640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58581069c0 0x7f585819cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52944/0 (socket says 172.21.15.120:52944) 2024-09-19T05:19:26.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.147+0000 7f585e238640 1 -- 172.21.15.120:0/1927738582 learned_addr learned my addr 172.21.15.120:0/1927738582 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:26.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.147+0000 7f585da37640 1 --2- 172.21.15.120:0/1927738582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58581009b0 0x7f58581982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:26.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.147+0000 7f585d236640 1 --2- 172.21.15.120:0/1927738582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5858101350 0x7f5858198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:26.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.147+0000 7f585e238640 1 -- 172.21.15.120:0/1927738582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58581009b0 msgr2=0x7f58581982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:26.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.147+0000 7f585e238640 1 --2- 172.21.15.120:0/1927738582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58581009b0 0x7f58581982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.147+0000 7f585e238640 1 -- 172.21.15.120:0/1927738582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5858101350 msgr2=0x7f5858198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:26.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.147+0000 7f585e238640 1 --2- 172.21.15.120:0/1927738582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5858101350 0x7f5858198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.147+0000 7f585e238640 1 -- 172.21.15.120:0/1927738582 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f585819d2c0 con 0x7f58581069c0 2024-09-19T05:19:26.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.147+0000 7f585d236640 1 --2- 172.21.15.120:0/1927738582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5858101350 0x7f5858198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:26.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.147+0000 7f585da37640 1 --2- 172.21.15.120:0/1927738582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58581009b0 0x7f58581982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:19:26.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.148+0000 7f585e238640 1 --2- 172.21.15.120:0/1927738582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58581069c0 0x7f585819cb90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f585000eaa0 tx=0x7f585000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:26.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.148+0000 7f584effd640 1 -- 172.21.15.120:0/1927738582 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585000cdb0 con 0x7f58581069c0 2024-09-19T05:19:26.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.148+0000 7f584effd640 1 -- 172.21.15.120:0/1927738582 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5850005020 con 0x7f58581069c0 2024-09-19T05:19:26.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.148+0000 7f585fc9b640 1 -- 172.21.15.120:0/1927738582 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f585819d5b0 con 0x7f58581069c0 2024-09-19T05:19:26.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.148+0000 7f584effd640 1 -- 172.21.15.120:0/1927738582 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58500116d0 con 0x7f58581069c0 2024-09-19T05:19:26.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.148+0000 7f585fc9b640 1 -- 172.21.15.120:0/1927738582 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58581a4e40 con 0x7f58581069c0 2024-09-19T05:19:26.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.149+0000 7f585fc9b640 1 -- 172.21.15.120:0/1927738582 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5858100e10 con 0x7f58581069c0 2024-09-19T05:19:26.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.150+0000 7f584effd640 1 -- 172.21.15.120:0/1927738582 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f58500051d0 con 0x7f58581069c0 2024-09-19T05:19:26.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.150+0000 7f584effd640 1 --2- 172.21.15.120:0/1927738582 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f58440a3500 0x7f58440a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:26.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.151+0000 7f585da37640 1 --2- 172.21.15.120:0/1927738582 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f58440a3500 0x7f58440a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:26.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.151+0000 7f584effd640 1 -- 172.21.15.120:0/1927738582 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f58500d0120 con 0x7f58581069c0 2024-09-19T05:19:26.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.151+0000 7f585da37640 1 --2- 172.21.15.120:0/1927738582 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f58440a3500 0x7f58440a59c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5848000c00 tx=0x7f5848009610 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:26.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.155+0000 7f584effd640 1 -- 172.21.15.120:0/1927738582 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5850016030 con 0x7f58581069c0 2024-09-19T05:19:26.267 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T05:19:26.354 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.353+0000 7f585fc9b640 1 -- 172.21.15.120:0/1927738582 --> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f58580fefb0 con 0x7f58440a3500 2024-09-19T05:19:26.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.420+0000 7f584effd640 1 -- 172.21.15.120:0/1927738582 <== mgr.15156 v2:172.21.15.120:6800/1306632207 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f58580fefb0 con 0x7f58440a3500 2024-09-19T05:19:26.422 INFO:teuthology.orchestra.run.smithi120.stdout:Retention added to path / 2024-09-19T05:19:26.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.422+0000 7f585fc9b640 1 -- 172.21.15.120:0/1927738582 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f58440a3500 msgr2=0x7f58440a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:26.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.422+0000 7f585fc9b640 1 --2- 172.21.15.120:0/1927738582 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f58440a3500 0x7f58440a59c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5848000c00 tx=0x7f5848009610 comp rx=0 tx=0).stop 2024-09-19T05:19:26.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.422+0000 7f585fc9b640 1 -- 172.21.15.120:0/1927738582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58581069c0 msgr2=0x7f585819cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:26.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.422+0000 7f585fc9b640 1 --2- 172.21.15.120:0/1927738582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58581069c0 0x7f585819cb90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f585000eaa0 tx=0x7f585000ef60 comp rx=0 tx=0).stop 2024-09-19T05:19:26.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.422+0000 7f585fc9b640 1 -- 172.21.15.120:0/1927738582 shutdown_connections 2024-09-19T05:19:26.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.422+0000 7f585fc9b640 1 --2- 172.21.15.120:0/1927738582 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f58440a3500 0x7f58440a59c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.422+0000 7f585fc9b640 1 --2- 172.21.15.120:0/1927738582 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f58581069c0 0x7f585819cb90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.422+0000 7f585fc9b640 1 --2- 172.21.15.120:0/1927738582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5858101350 0x7f5858198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.422+0000 7f585fc9b640 1 --2- 172.21.15.120:0/1927738582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58581009b0 0x7f58581982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.422+0000 7f585fc9b640 1 -- 172.21.15.120:0/1927738582 >> 172.21.15.120:0/1927738582 conn(0x7f5858077990 msgr2=0x7f5858104c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:26.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.422+0000 7f585fc9b640 1 -- 172.21.15.120:0/1927738582 shutdown_connections 2024-09-19T05:19:26.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.422+0000 7f585fc9b640 1 -- 172.21.15.120:0/1927738582 wait complete. 2024-09-19T05:19:26.435 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T05:19:26.535 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:26.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.543+0000 7f5d7956d640 1 -- 172.21.15.120:0/466037006 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d741009d0 msgr2=0x7f5d74100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:26.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.543+0000 7f5d7956d640 1 --2- 172.21.15.120:0/466037006 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d741009d0 0x7f5d74100e30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009930 tx=0x7f5d6802a420 comp rx=0 tx=0).stop 2024-09-19T05:19:26.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.543+0000 7f5d7956d640 1 -- 172.21.15.120:0/466037006 shutdown_connections 2024-09-19T05:19:26.545 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.543+0000 7f5d7956d640 1 --2- 172.21.15.120:0/466037006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d74101370 0x7f5d7410d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.543+0000 7f5d7956d640 1 --2- 172.21.15.120:0/466037006 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d741009d0 0x7f5d74100e30 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.543+0000 7f5d7956d640 1 --2- 172.21.15.120:0/466037006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d741069e0 0x7f5d74106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.543+0000 7f5d7956d640 1 -- 172.21.15.120:0/466037006 >> 172.21.15.120:0/466037006 conn(0x7f5d740fc6b0 msgr2=0x7f5d740fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:26.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.543+0000 7f5d7956d640 1 -- 172.21.15.120:0/466037006 shutdown_connections 2024-09-19T05:19:26.546 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.543+0000 7f5d7956d640 1 -- 172.21.15.120:0/466037006 wait complete. 2024-09-19T05:19:26.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.544+0000 7f5d7956d640 1 Processor -- start 2024-09-19T05:19:26.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.544+0000 7f5d7956d640 1 -- start start 2024-09-19T05:19:26.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.544+0000 7f5d7956d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d741009d0 0x7f5d741971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:26.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.544+0000 7f5d7956d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d74101370 0x7f5d74197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:26.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.544+0000 7f5d7956d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d741069e0 0x7f5d7419ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:26.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.545+0000 7f5d7956d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5d74110cd0 con 0x7f5d741069e0 2024-09-19T05:19:26.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.545+0000 7f5d7956d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5d74110b50 con 0x7f5d74101370 2024-09-19T05:19:26.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.545+0000 7f5d7956d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5d74110e50 con 0x7f5d741009d0 2024-09-19T05:19:26.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.545+0000 7f5d737fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d741069e0 0x7f5d7419ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:26.548 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.545+0000 7f5d737fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d741069e0 0x7f5d7419ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52968/0 (socket says 172.21.15.120:52968) 2024-09-19T05:19:26.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.545+0000 7f5d737fe640 1 -- 172.21.15.120:0/538093794 learned_addr learned my addr 172.21.15.120:0/538093794 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:26.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.545+0000 7f5d72ffd640 1 --2- 172.21.15.120:0/538093794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d741009d0 0x7f5d741971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:26.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.545+0000 7f5d727fc640 1 --2- 172.21.15.120:0/538093794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d74101370 0x7f5d74197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:26.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.545+0000 7f5d737fe640 1 -- 172.21.15.120:0/538093794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d741009d0 msgr2=0x7f5d741971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:26.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.545+0000 7f5d737fe640 1 --2- 172.21.15.120:0/538093794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d741009d0 0x7f5d741971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.545+0000 7f5d737fe640 1 -- 172.21.15.120:0/538093794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d74101370 msgr2=0x7f5d74197700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:26.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.545+0000 7f5d737fe640 1 --2- 172.21.15.120:0/538093794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d74101370 0x7f5d74197700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.545+0000 7f5d737fe640 1 -- 172.21.15.120:0/538093794 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d7419c1b0 con 0x7f5d741069e0 2024-09-19T05:19:26.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.545+0000 7f5d737fe640 1 --2- 172.21.15.120:0/538093794 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d741069e0 0x7f5d7419ba80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009fd0 tx=0x7f5d6c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:26.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.545+0000 7f5d5bfff640 1 -- 172.21.15.120:0/538093794 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c017070 con 0x7f5d741069e0 2024-09-19T05:19:26.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.546+0000 7f5d7956d640 1 -- 172.21.15.120:0/538093794 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d7419c4a0 con 0x7f5d741069e0 2024-09-19T05:19:26.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.546+0000 7f5d5bfff640 1 -- 172.21.15.120:0/538093794 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5d6c003e20 con 0x7f5d741069e0 2024-09-19T05:19:26.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.546+0000 7f5d5bfff640 1 -- 172.21.15.120:0/538093794 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c010460 con 0x7f5d741069e0 2024-09-19T05:19:26.549 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.546+0000 7f5d7956d640 1 -- 172.21.15.120:0/538093794 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d7406a0c0 con 0x7f5d741069e0 2024-09-19T05:19:26.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.547+0000 7f5d7956d640 1 -- 172.21.15.120:0/538093794 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d74102110 con 0x7f5d741069e0 2024-09-19T05:19:26.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.548+0000 7f5d5bfff640 1 -- 172.21.15.120:0/538093794 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f5d6c003970 con 0x7f5d741069e0 2024-09-19T05:19:26.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.549+0000 7f5d5bfff640 1 --2- 172.21.15.120:0/538093794 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f5d5c0a3500 0x7f5d5c0a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:26.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.549+0000 7f5d72ffd640 1 --2- 172.21.15.120:0/538093794 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f5d5c0a3500 0x7f5d5c0a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:26.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.549+0000 7f5d5bfff640 1 -- 172.21.15.120:0/538093794 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f5d6c0cfc80 con 0x7f5d741069e0 2024-09-19T05:19:26.551 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.549+0000 7f5d72ffd640 1 --2- 172.21.15.120:0/538093794 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f5d5c0a3500 0x7f5d5c0a59c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5d64009b50 tx=0x7f5d64010040 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:26.555 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.553+0000 7f5d5bfff640 1 -- 172.21.15.120:0/538093794 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5d6c09be50 con 0x7f5d741069e0 2024-09-19T05:19:26.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.770+0000 7f5d7956d640 1 -- 172.21.15.120:0/538093794 --> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f5d7406a3e0 con 0x7f5d5c0a3500 2024-09-19T05:19:26.778 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.776+0000 7f5d5bfff640 1 -- 172.21.15.120:0/538093794 <== mgr.15156 v2:172.21.15.120:6800/1306632207 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f5d7406a3e0 con 0x7f5d5c0a3500 2024-09-19T05:19:26.778 INFO:teuthology.orchestra.run.smithi120.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T05:19:25", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-19T05:19:26.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.779+0000 7f5d7956d640 1 -- 172.21.15.120:0/538093794 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f5d5c0a3500 msgr2=0x7f5d5c0a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:26.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.779+0000 7f5d7956d640 1 --2- 172.21.15.120:0/538093794 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f5d5c0a3500 0x7f5d5c0a59c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5d64009b50 tx=0x7f5d64010040 comp rx=0 tx=0).stop 2024-09-19T05:19:26.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.779+0000 7f5d7956d640 1 -- 172.21.15.120:0/538093794 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d741069e0 msgr2=0x7f5d7419ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:26.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.779+0000 7f5d7956d640 1 --2- 172.21.15.120:0/538093794 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d741069e0 0x7f5d7419ba80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009fd0 tx=0x7f5d6c00b260 comp rx=0 tx=0).stop 2024-09-19T05:19:26.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.779+0000 7f5d7956d640 1 -- 172.21.15.120:0/538093794 shutdown_connections 2024-09-19T05:19:26.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.779+0000 7f5d7956d640 1 --2- 172.21.15.120:0/538093794 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f5d5c0a3500 0x7f5d5c0a59c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.779+0000 7f5d7956d640 1 --2- 172.21.15.120:0/538093794 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5d741069e0 0x7f5d7419ba80 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.779+0000 7f5d7956d640 1 --2- 172.21.15.120:0/538093794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d74101370 0x7f5d74197700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.779+0000 7f5d7956d640 1 --2- 172.21.15.120:0/538093794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d741009d0 0x7f5d741971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.779+0000 7f5d7956d640 1 -- 172.21.15.120:0/538093794 >> 172.21.15.120:0/538093794 conn(0x7f5d740fc6b0 msgr2=0x7f5d740fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:26.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.779+0000 7f5d7956d640 1 -- 172.21.15.120:0/538093794 shutdown_connections 2024-09-19T05:19:26.781 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.779+0000 7f5d7956d640 1 -- 172.21.15.120:0/538093794 wait complete. 2024-09-19T05:19:26.790 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:26 smithi120 ceph-mon[30956]: scrub queued for path: / 2024-09-19T05:19:26.790 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:26 smithi120 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T05:19:26.790 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:26 smithi120 ceph-mon[30956]: scrub summary: active paths [/] 2024-09-19T05:19:26.790 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:26 smithi120 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T05:19:26.790 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:26 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2931590153' entity='client.admin' 2024-09-19T05:19:26.790 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:26 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:19:26.791 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:26 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:19:26.791 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:26 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:19:26.791 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:26 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:26.791 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:26 smithi120 ceph-mon[30956]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:26.791 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:26 smithi120 ceph-mon[30956]: pgmap v9: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 558 B/s wr, 17 op/s 2024-09-19T05:19:26.792 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T05:19:26.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:26 smithi194 ceph-mon[35228]: scrub queued for path: / 2024-09-19T05:19:26.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:26 smithi194 ceph-mon[35228]: scrub summary: idle+waiting paths [/] 2024-09-19T05:19:26.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:26 smithi194 ceph-mon[35228]: scrub summary: active paths [/] 2024-09-19T05:19:26.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:26 smithi194 ceph-mon[35228]: scrub summary: idle+waiting paths [/] 2024-09-19T05:19:26.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:26 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/2931590153' entity='client.admin' 2024-09-19T05:19:26.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:26 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:19:26.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:26 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:19:26.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:26 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:19:26.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:26 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:26.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:26 smithi194 ceph-mon[35228]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:26.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:26 smithi194 ceph-mon[35228]: pgmap v9: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 558 B/s wr, 17 op/s 2024-09-19T05:19:26.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.904+0000 7f148de27640 1 -- 172.21.15.120:0/3133543221 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14881069c0 msgr2=0x7f1488106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:26.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.904+0000 7f148de27640 1 --2- 172.21.15.120:0/3133543221 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14881069c0 0x7f1488106da0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1478009900 tx=0x7f147802a410 comp rx=0 tx=0).stop 2024-09-19T05:19:26.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.905+0000 7f148de27640 1 -- 172.21.15.120:0/3133543221 shutdown_connections 2024-09-19T05:19:26.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.905+0000 7f148de27640 1 --2- 172.21.15.120:0/3133543221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1488101350 0x7f14880698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.905+0000 7f148de27640 1 --2- 172.21.15.120:0/3133543221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14881009b0 0x7f1488100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.905+0000 7f148de27640 1 --2- 172.21.15.120:0/3133543221 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14881069c0 0x7f1488106da0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.909 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.905+0000 7f148de27640 1 -- 172.21.15.120:0/3133543221 >> 172.21.15.120:0/3133543221 conn(0x7f1488077990 msgr2=0x7f14880fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:26.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.905+0000 7f148de27640 1 -- 172.21.15.120:0/3133543221 shutdown_connections 2024-09-19T05:19:26.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.905+0000 7f148de27640 1 -- 172.21.15.120:0/3133543221 wait complete. 2024-09-19T05:19:26.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.905+0000 7f148de27640 1 Processor -- start 2024-09-19T05:19:26.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.905+0000 7f148de27640 1 -- start start 2024-09-19T05:19:26.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.906+0000 7f148de27640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14881009b0 0x7f148819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:26.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.906+0000 7f148de27640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1488101350 0x7f148819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:26.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.906+0000 7f148de27640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14881069c0 0x7f148819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:26.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.906+0000 7f148de27640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1488114020 con 0x7f1488101350 2024-09-19T05:19:26.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.906+0000 7f148de27640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1488113ea0 con 0x7f14881009b0 2024-09-19T05:19:26.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.906+0000 7f148de27640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f14881141a0 con 0x7f14881069c0 2024-09-19T05:19:26.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.906+0000 7f1486ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1488101350 0x7f148819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:26.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.906+0000 7f1486ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1488101350 0x7f148819ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52976/0 (socket says 172.21.15.120:52976) 2024-09-19T05:19:26.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.906+0000 7f1486ffd640 1 -- 172.21.15.120:0/1201976643 learned_addr learned my addr 172.21.15.120:0/1201976643 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:26.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.906+0000 7f1487fff640 1 --2- 172.21.15.120:0/1201976643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14881069c0 0x7f148819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:26.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.906+0000 7f14877fe640 1 --2- 172.21.15.120:0/1201976643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14881009b0 0x7f148819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:26.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.906+0000 7f1486ffd640 1 -- 172.21.15.120:0/1201976643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14881069c0 msgr2=0x7f148819eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:26.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.906+0000 7f1486ffd640 1 --2- 172.21.15.120:0/1201976643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14881069c0 0x7f148819eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.906+0000 7f1486ffd640 1 -- 172.21.15.120:0/1201976643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14881009b0 msgr2=0x7f148819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:26.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.906+0000 7f1486ffd640 1 --2- 172.21.15.120:0/1201976643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14881009b0 0x7f148819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:26.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.906+0000 7f1486ffd640 1 -- 172.21.15.120:0/1201976643 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148819f5f0 con 0x7f1488101350 2024-09-19T05:19:26.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.906+0000 7f14877fe640 1 --2- 172.21.15.120:0/1201976643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14881009b0 0x7f148819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:26.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.906+0000 7f1486ffd640 1 --2- 172.21.15.120:0/1201976643 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1488101350 0x7f148819ab40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f147c00b4a0 tx=0x7f147c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:26.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.906+0000 7f1484ff9640 1 -- 172.21.15.120:0/1201976643 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c014070 con 0x7f1488101350 2024-09-19T05:19:26.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.906+0000 7f1484ff9640 1 -- 172.21.15.120:0/1201976643 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f147c010ac0 con 0x7f1488101350 2024-09-19T05:19:26.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.906+0000 7f148de27640 1 -- 172.21.15.120:0/1201976643 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f148819f8e0 con 0x7f1488101350 2024-09-19T05:19:26.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.906+0000 7f1484ff9640 1 -- 172.21.15.120:0/1201976643 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c017c30 con 0x7f1488101350 2024-09-19T05:19:26.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.906+0000 7f148de27640 1 -- 172.21.15.120:0/1201976643 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14881a7170 con 0x7f1488101350 2024-09-19T05:19:26.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.907+0000 7f148de27640 1 -- 172.21.15.120:0/1201976643 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1488069920 con 0x7f1488101350 2024-09-19T05:19:26.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.909+0000 7f1484ff9640 1 -- 172.21.15.120:0/1201976643 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f147c017070 con 0x7f1488101350 2024-09-19T05:19:26.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.909+0000 7f1484ff9640 1 --2- 172.21.15.120:0/1201976643 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f14700a3500 0x7f14700a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:26.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.909+0000 7f14877fe640 1 --2- 172.21.15.120:0/1201976643 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f14700a3500 0x7f14700a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:26.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.909+0000 7f1484ff9640 1 -- 172.21.15.120:0/1201976643 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f147c0cf510 con 0x7f1488101350 2024-09-19T05:19:26.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.910+0000 7f14877fe640 1 --2- 172.21.15.120:0/1201976643 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f14700a3500 0x7f14700a59c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1478000c00 tx=0x7f1478031400 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:26.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:26.912+0000 7f1484ff9640 1 -- 172.21.15.120:0/1201976643 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f147c09be40 con 0x7f1488101350 2024-09-19T05:19:26.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:26 smithi178 ceph-mon[34347]: scrub queued for path: / 2024-09-19T05:19:26.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:26 smithi178 ceph-mon[34347]: scrub summary: idle+waiting paths [/] 2024-09-19T05:19:26.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:26 smithi178 ceph-mon[34347]: scrub summary: active paths [/] 2024-09-19T05:19:26.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:26 smithi178 ceph-mon[34347]: scrub summary: idle+waiting paths [/] 2024-09-19T05:19:26.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:26 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/2931590153' entity='client.admin' 2024-09-19T05:19:26.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:26 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:19:26.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:26 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:19:26.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:26 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:19:26.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:26 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:19:26.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:26 smithi178 ceph-mon[34347]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:26.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:26 smithi178 ceph-mon[34347]: pgmap v9: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 558 B/s wr, 17 op/s 2024-09-19T05:19:27.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.058+0000 7fa67edd8640 1 -- 172.21.15.120:0/892672847 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa678100e20 msgr2=0x7fa678101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:27.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.058+0000 7fa67edd8640 1 --2- 172.21.15.120:0/892672847 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa678100e20 0x7fa678101200 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa66c009900 tx=0x7fa66c02a480 comp rx=0 tx=0).stop 2024-09-19T05:19:27.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.058+0000 7fa67edd8640 1 -- 172.21.15.120:0/892672847 shutdown_connections 2024-09-19T05:19:27.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.058+0000 7fa67edd8640 1 --2- 172.21.15.120:0/892672847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa678102ef0 0x7fa67810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.058+0000 7fa67edd8640 1 --2- 172.21.15.120:0/892672847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa678102570 0x7fa6781029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.058+0000 7fa67edd8640 1 --2- 172.21.15.120:0/892672847 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa678100e20 0x7fa678101200 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.058+0000 7fa67edd8640 1 -- 172.21.15.120:0/892672847 >> 172.21.15.120:0/892672847 conn(0x7fa6780fc7d0 msgr2=0x7fa6780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:27.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.058+0000 7fa67edd8640 1 -- 172.21.15.120:0/892672847 shutdown_connections 2024-09-19T05:19:27.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.058+0000 7fa67edd8640 1 -- 172.21.15.120:0/892672847 wait complete. 2024-09-19T05:19:27.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.059+0000 7fa67edd8640 1 Processor -- start 2024-09-19T05:19:27.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.059+0000 7fa67edd8640 1 -- start start 2024-09-19T05:19:27.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.059+0000 7fa67edd8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa678100e20 0x7fa6781992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:27.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.059+0000 7fa67edd8640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa678102570 0x7fa678199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:27.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.059+0000 7fa67edd8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa678102ef0 0x7fa6781a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:27.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.059+0000 7fa67edd8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa678110e50 con 0x7fa678100e20 2024-09-19T05:19:27.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.059+0000 7fa67edd8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa678110cd0 con 0x7fa678102ef0 2024-09-19T05:19:27.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.059+0000 7fa67edd8640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa678110fd0 con 0x7fa678102570 2024-09-19T05:19:27.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.059+0000 7fa67cb74640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa678100e20 0x7fa6781992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:27.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.059+0000 7fa67cb74640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa678100e20 0x7fa6781992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52990/0 (socket says 172.21.15.120:52990) 2024-09-19T05:19:27.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.059+0000 7fa67cb74640 1 -- 172.21.15.120:0/1371298596 learned_addr learned my addr 172.21.15.120:0/1371298596 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:27.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.060+0000 7fa677fff640 1 --2- 172.21.15.120:0/1371298596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa678102570 0x7fa678199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:27.071 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.060+0000 7fa67d375640 1 --2- 172.21.15.120:0/1371298596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa678102ef0 0x7fa6781a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:27.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.060+0000 7fa67cb74640 1 -- 172.21.15.120:0/1371298596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa678102570 msgr2=0x7fa678199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:27.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.060+0000 7fa67cb74640 1 --2- 172.21.15.120:0/1371298596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa678102570 0x7fa678199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.060+0000 7fa67cb74640 1 -- 172.21.15.120:0/1371298596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa678102ef0 msgr2=0x7fa6781a4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:27.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.060+0000 7fa67cb74640 1 --2- 172.21.15.120:0/1371298596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa678102ef0 0x7fa6781a4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.060+0000 7fa67cb74640 1 -- 172.21.15.120:0/1371298596 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6781a48a0 con 0x7fa678100e20 2024-09-19T05:19:27.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.060+0000 7fa67d375640 1 --2- 172.21.15.120:0/1371298596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa678102ef0 0x7fa6781a4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:27.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.060+0000 7fa677fff640 1 --2- 172.21.15.120:0/1371298596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa678102570 0x7fa678199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:19:27.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.060+0000 7fa67cb74640 1 --2- 172.21.15.120:0/1371298596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa678100e20 0x7fa6781992e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa66c006010 tx=0x7fa66c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:27.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.060+0000 7fa675ffb640 1 -- 172.21.15.120:0/1371298596 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c03f070 con 0x7fa678100e20 2024-09-19T05:19:27.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.060+0000 7fa67edd8640 1 -- 172.21.15.120:0/1371298596 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6781a4a70 con 0x7fa678100e20 2024-09-19T05:19:27.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.060+0000 7fa675ffb640 1 -- 172.21.15.120:0/1371298596 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa66c003aa0 con 0x7fa678100e20 2024-09-19T05:19:27.072 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.060+0000 7fa675ffb640 1 -- 172.21.15.120:0/1371298596 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c035030 con 0x7fa678100e20 2024-09-19T05:19:27.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.060+0000 7fa67edd8640 1 -- 172.21.15.120:0/1371298596 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6781a4f20 con 0x7fa678100e20 2024-09-19T05:19:27.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.063+0000 7fa675ffb640 1 -- 172.21.15.120:0/1371298596 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7fa66c042070 con 0x7fa678100e20 2024-09-19T05:19:27.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.063+0000 7fa6811b1740 1 Processor -- start 2024-09-19T05:19:27.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.063+0000 7fa6811b1740 1 -- start start 2024-09-19T05:19:27.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.063+0000 7fa6811b1740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d3274a0 0x55561d327880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:27.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.063+0000 7fa6811b1740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55561d327dc0 0x55561d332140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:27.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.063+0000 7fa6811b1740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55561d332680 0x55561d334a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:27.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.063+0000 7fa6811b1740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55561d28d2e0 con 0x55561d3274a0 2024-09-19T05:19:27.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.063+0000 7fa6811b1740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55561d234ce0 con 0x55561d327dc0 2024-09-19T05:19:27.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.063+0000 7fa6811b1740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55561d2892a0 con 0x55561d332680 2024-09-19T05:19:27.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.063+0000 7fa675ffb640 1 --2- 172.21.15.120:0/1371298596 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fa6680a3440 0x7fa6680a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:27.073 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.063+0000 7fa67d375640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d3274a0 0x55561d327880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:27.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.064+0000 7fa67d375640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d3274a0 0x55561d327880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52994/0 (socket says 172.21.15.120:52994) 2024-09-19T05:19:27.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.064+0000 7fa67d375640 1 -- 172.21.15.120:0/551998578 learned_addr learned my addr 172.21.15.120:0/551998578 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:27.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.064+0000 7fa67cb74640 1 --2- 172.21.15.120:0/551998578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55561d327dc0 0x55561d332140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:27.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.064+0000 7fa677fff640 1 --2- 172.21.15.120:0/551998578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55561d332680 0x55561d334a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:27.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.064+0000 7fa67d375640 1 --2- 172.21.15.120:0/1371298596 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fa6680a3440 0x7fa6680a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:27.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.064+0000 7fa67d375640 1 -- 172.21.15.120:0/551998578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55561d332680 msgr2=0x55561d334a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:27.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.064+0000 7fa67d375640 1 --2- 172.21.15.120:0/551998578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55561d332680 0x55561d334a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.064+0000 7fa67d375640 1 -- 172.21.15.120:0/551998578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55561d327dc0 msgr2=0x55561d332140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:27.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.064+0000 7fa67d375640 1 --2- 172.21.15.120:0/551998578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55561d327dc0 0x55561d332140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.064+0000 7fa675ffb640 1 -- 172.21.15.120:0/1371298596 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fa66c0f0130 con 0x7fa678100e20 2024-09-19T05:19:27.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.064+0000 7fa67d375640 1 -- 172.21.15.120:0/551998578 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55561d219440 con 0x55561d3274a0 2024-09-19T05:19:27.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.064+0000 7fa67cb74640 1 --2- 172.21.15.120:0/551998578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55561d327dc0 0x55561d332140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:27.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.064+0000 7fa67d375640 1 --2- 172.21.15.120:0/551998578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d3274a0 0x55561d327880 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa6700149a0 tx=0x7fa670014e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd746e3f1815d081 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:27.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.064+0000 7fa662ffd640 1 -- 172.21.15.120:0/551998578 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa670021070 con 0x55561d3274a0 2024-09-19T05:19:27.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.064+0000 7fa662ffd640 1 -- 172.21.15.120:0/551998578 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa670013460 con 0x55561d3274a0 2024-09-19T05:19:27.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.064+0000 7fa662ffd640 1 -- 172.21.15.120:0/551998578 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67000f630 con 0x55561d3274a0 2024-09-19T05:19:27.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.065+0000 7fa6811b1740 1 -- 172.21.15.120:0/551998578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d3274a0 msgr2=0x55561d327880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:27.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.065+0000 7fa6811b1740 1 --2- 172.21.15.120:0/551998578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d3274a0 0x55561d327880 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa6700149a0 tx=0x7fa670014e60 comp rx=0 tx=0).stop 2024-09-19T05:19:27.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.065+0000 7fa67d375640 1 --2- 172.21.15.120:0/1371298596 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fa6680a3440 0x7fa6680a5900 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa67001e000 tx=0x7fa670019000 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:27.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.065+0000 7fa6811b1740 1 -- 172.21.15.120:0/551998578 shutdown_connections 2024-09-19T05:19:27.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.065+0000 7fa6811b1740 1 --2- 172.21.15.120:0/551998578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55561d332680 0x55561d334a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.065+0000 7fa6811b1740 1 --2- 172.21.15.120:0/551998578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55561d327dc0 0x55561d332140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.065+0000 7fa6811b1740 1 --2- 172.21.15.120:0/551998578 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d3274a0 0x55561d327880 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.065+0000 7fa6811b1740 1 -- 172.21.15.120:0/551998578 >> 172.21.15.120:0/551998578 conn(0x55561d323a30 msgr2=0x55561d323e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:27.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.065+0000 7fa6811b1740 1 -- 172.21.15.120:0/551998578 shutdown_connections 2024-09-19T05:19:27.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.065+0000 7fa6811b1740 1 -- 172.21.15.120:0/551998578 wait complete. 2024-09-19T05:19:27.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.066+0000 7fa6811b1740 1 -- start start 2024-09-19T05:19:27.075 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.066+0000 7fa6811b1740 1 Processor -- start 2024-09-19T05:19:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.066+0000 7fa6811b1740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55561d3274a0 0x55561d331f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.066+0000 7fa6811b1740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55561d327dc0 0x55561d32f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.066+0000 7fa6811b1740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d332680 0x55561d32f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.066+0000 7fa6811b1740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55561d335250 con 0x55561d332680 2024-09-19T05:19:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.066+0000 7fa6811b1740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55561d248050 con 0x55561d327dc0 2024-09-19T05:19:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.066+0000 7fa6811b1740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55561d3353d0 con 0x55561d3274a0 2024-09-19T05:19:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.066+0000 7fa6811b1740 10 client.0 _ll_register_callbacks cb 0x55561d288160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:19:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.066+0000 7fa67d375640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d332680 0x55561d32f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.066+0000 7fa67d375640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d332680 0x55561d32f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53002/0 (socket says 172.21.15.120:53002) 2024-09-19T05:19:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.066+0000 7fa67d375640 1 -- 172.21.15.120:0/2392456166 learned_addr learned my addr 172.21.15.120:0/2392456166 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.066+0000 7fa67cb74640 1 --2- 172.21.15.120:0/2392456166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55561d3274a0 0x55561d331f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:27.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.066+0000 7fa677fff640 1 --2- 172.21.15.120:0/2392456166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55561d327dc0 0x55561d32f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.067+0000 7fa67d375640 1 -- 172.21.15.120:0/2392456166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55561d3274a0 msgr2=0x55561d331f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.067+0000 7fa67d375640 1 --2- 172.21.15.120:0/2392456166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55561d3274a0 0x55561d331f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.067+0000 7fa67d375640 1 -- 172.21.15.120:0/2392456166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55561d327dc0 msgr2=0x55561d32f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.067+0000 7fa67d375640 1 --2- 172.21.15.120:0/2392456166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55561d327dc0 0x55561d32f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.067+0000 7fa67d375640 1 -- 172.21.15.120:0/2392456166 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55561cffe3c0 con 0x55561d332680 2024-09-19T05:19:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.067+0000 7fa67d375640 1 --2- 172.21.15.120:0/2392456166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d332680 0x55561d32f760 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa670013e50 tx=0x7fa670008380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf4ce95c47dfce8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.067+0000 7fa657fff640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:19:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.067+0000 7fa657fff640 1 -- 172.21.15.120:0/2392456166 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa670034060 con 0x55561d332680 2024-09-19T05:19:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.067+0000 7fa657fff640 1 -- 172.21.15.120:0/2392456166 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fa670013820 con 0x55561d332680 2024-09-19T05:19:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.067+0000 7fa6811b1740 1 -- 172.21.15.120:0/2392456166 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa670013460 con 0x55561d332680 2024-09-19T05:19:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.067+0000 7fa657fff640 1 -- 172.21.15.120:0/2392456166 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa670021050 con 0x55561d332680 2024-09-19T05:19:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.067+0000 7fa6811b1740 10 client.15342 fetch_fsmap learned FSMap version 25 2024-09-19T05:19:27.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.067+0000 7fa6811b1740 1 -- 172.21.15.120:0/2392456166 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55561d340b80 con 0x55561d332680 2024-09-19T05:19:27.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.067+0000 7fa657fff640 1 -- 172.21.15.120:0/2392456166 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa670013460 con 0x55561d332680 2024-09-19T05:19:27.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.068+0000 7fa657fff640 1 -- 172.21.15.120:0/2392456166 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa67000f7b0 con 0x55561d332680 2024-09-19T05:19:27.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.068+0000 7fa6811b1740 10 client.15342 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:19:27.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.068+0000 7fa6811b1740 10 client.15342 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:19:27.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.068+0000 7fa6811b1740 20 client.15342 populate_metadata read hostname 'smithi120' 2024-09-19T05:19:27.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.068+0000 7fa6811b1740 1 --2- 172.21.15.120:0/2392456166 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55561d341f30 0x55561d344320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:27.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.068+0000 7fa6811b1740 4 client.15342 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:19:27.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.068+0000 7fa6811b1740 1 -- 172.21.15.120:0/2392456166 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55561d29a850 con 0x55561d341f30 2024-09-19T05:19:27.078 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.068+0000 7fa67cb74640 1 --2- 172.21.15.120:0/2392456166 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55561d341f30 0x55561d344320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:27.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.069+0000 7fa67cb74640 1 --2- 172.21.15.120:0/2392456166 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55561d341f30 0x55561d344320 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=990b9639ab3b834c server_cookie=d0a976b908c06300 in_seq=0 out_seq=0 2024-09-19T05:19:27.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.069+0000 7fa657fff640 10 client.15342 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:19:27.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.070+0000 7fa657fff640 1 -- 172.21.15.120:0/2392456166 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55561d29a850 con 0x55561d341f30 2024-09-19T05:19:27.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.070+0000 7fa657fff640 10 client.15342 handle_command_reply: tid=0 2024-09-19T05:19:27.079 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.070+0000 7fa6811b1740 1 client.15342 shutdown 2024-09-19T05:19:27.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.070+0000 7fa6811b1740 1 -- 172.21.15.120:0/2392456166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d332680 msgr2=0x55561d32f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:27.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.070+0000 7fa6811b1740 1 --2- 172.21.15.120:0/2392456166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d332680 0x55561d32f760 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa670013e50 tx=0x7fa670008380 comp rx=0 tx=0).stop 2024-09-19T05:19:27.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.070+0000 7fa6811b1740 1 -- 172.21.15.120:0/2392456166 shutdown_connections 2024-09-19T05:19:27.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.070+0000 7fa6811b1740 1 --2- 172.21.15.120:0/2392456166 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d332680 0x55561d32f760 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.070+0000 7fa6811b1740 1 --2- 172.21.15.120:0/2392456166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55561d327dc0 0x55561d32f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.070+0000 7fa6811b1740 1 --2- 172.21.15.120:0/2392456166 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55561d341f30 0x55561d344320 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.070+0000 7fa657fff640 0 client.15342 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:19:27.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.070+0000 7fa6811b1740 1 --2- 172.21.15.120:0/2392456166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55561d3274a0 0x55561d331f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.070+0000 7fa6811b1740 1 -- 172.21.15.120:0/2392456166 >> 172.21.15.120:0/2392456166 conn(0x55561d323a30 msgr2=0x55561d322b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:27.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.070+0000 7fa6811b1740 1 -- 172.21.15.120:0/2392456166 shutdown_connections 2024-09-19T05:19:27.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.070+0000 7fa6811b1740 1 -- 172.21.15.120:0/2392456166 wait complete. 2024-09-19T05:19:27.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.070+0000 7fa6811b1740 20 client.15342 trim_cache size 0 max 16384 2024-09-19T05:19:27.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.087+0000 7fa6811b1740 1 Processor -- start 2024-09-19T05:19:27.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.087+0000 7fa6811b1740 1 -- start start 2024-09-19T05:19:27.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.087+0000 7fa6811b1740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d3274a0 0x55561d331190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:27.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.087+0000 7fa6811b1740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55561d327dc0 0x55561d349af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:27.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.087+0000 7fa6811b1740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55561d332680 0x55561d34a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:27.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.087+0000 7fa6811b1740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa6781b0170 con 0x55561d3274a0 2024-09-19T05:19:27.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.087+0000 7fa6811b1740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa6781ada40 con 0x55561d327dc0 2024-09-19T05:19:27.091 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.087+0000 7fa6811b1740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa6781ab890 con 0x55561d332680 2024-09-19T05:19:27.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.087+0000 7fa67cb74640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d3274a0 0x55561d331190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:27.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.087+0000 7fa67cb74640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d3274a0 0x55561d331190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53016/0 (socket says 172.21.15.120:53016) 2024-09-19T05:19:27.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.087+0000 7fa67cb74640 1 -- 172.21.15.120:0/1795866180 learned_addr learned my addr 172.21.15.120:0/1795866180 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:27.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.087+0000 7fa67d375640 1 --2- 172.21.15.120:0/1795866180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55561d332680 0x55561d34a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:27.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.087+0000 7fa67cb74640 1 -- 172.21.15.120:0/1795866180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55561d332680 msgr2=0x55561d34a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:27.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.087+0000 7fa677fff640 1 --2- 172.21.15.120:0/1795866180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55561d327dc0 0x55561d349af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:27.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.087+0000 7fa67cb74640 1 --2- 172.21.15.120:0/1795866180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55561d332680 0x55561d34a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.087+0000 7fa67cb74640 1 -- 172.21.15.120:0/1795866180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55561d327dc0 msgr2=0x55561d349af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:27.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.087+0000 7fa67cb74640 1 --2- 172.21.15.120:0/1795866180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55561d327dc0 0x55561d349af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.087+0000 7fa67cb74640 1 -- 172.21.15.120:0/1795866180 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55561d32d770 con 0x55561d3274a0 2024-09-19T05:19:27.092 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.088+0000 7fa677fff640 1 --2- 172.21.15.120:0/1795866180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55561d327dc0 0x55561d349af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:27.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.088+0000 7fa67cb74640 1 --2- 172.21.15.120:0/1795866180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d3274a0 0x55561d331190 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa66c031fd0 tx=0x7fa66c0368f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc80825e4003852 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:27.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.088+0000 7fa6627fc640 1 -- 172.21.15.120:0/1795866180 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c049040 con 0x55561d3274a0 2024-09-19T05:19:27.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.088+0000 7fa6627fc640 1 -- 172.21.15.120:0/1795866180 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa66c0bc2f0 con 0x55561d3274a0 2024-09-19T05:19:27.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.088+0000 7fa6627fc640 1 -- 172.21.15.120:0/1795866180 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c0b6e60 con 0x55561d3274a0 2024-09-19T05:19:27.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.088+0000 7fa6811b1740 1 -- 172.21.15.120:0/1795866180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d3274a0 msgr2=0x55561d331190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:27.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.088+0000 7fa6811b1740 1 --2- 172.21.15.120:0/1795866180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d3274a0 0x55561d331190 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa66c031fd0 tx=0x7fa66c0368f0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.089+0000 7fa6811b1740 1 -- 172.21.15.120:0/1795866180 shutdown_connections 2024-09-19T05:19:27.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.089+0000 7fa6811b1740 1 --2- 172.21.15.120:0/1795866180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55561d332680 0x55561d34a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.089+0000 7fa6811b1740 1 --2- 172.21.15.120:0/1795866180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55561d327dc0 0x55561d349af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.093 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.089+0000 7fa6811b1740 1 --2- 172.21.15.120:0/1795866180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d3274a0 0x55561d331190 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.089+0000 7fa6811b1740 1 -- 172.21.15.120:0/1795866180 >> 172.21.15.120:0/1795866180 conn(0x55561d323a30 msgr2=0x55561d330a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:27.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.089+0000 7fa6811b1740 1 -- 172.21.15.120:0/1795866180 shutdown_connections 2024-09-19T05:19:27.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.089+0000 7fa6811b1740 1 -- 172.21.15.120:0/1795866180 wait complete. 2024-09-19T05:19:27.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.089+0000 7fa6811b1740 1 -- start start 2024-09-19T05:19:27.094 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.089+0000 7fa6811b1740 1 Processor -- start 2024-09-19T05:19:27.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.089+0000 7fa6811b1740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55561d3274a0 0x55561d33aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:27.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.089+0000 7fa6811b1740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55561d327dc0 0x55561d338210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:27.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.089+0000 7fa6811b1740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d332680 0x55561d3389a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:27.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.089+0000 7fa6811b1740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa6781abf00 con 0x55561d332680 2024-09-19T05:19:27.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.089+0000 7fa6811b1740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa6781ad370 con 0x55561d327dc0 2024-09-19T05:19:27.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.089+0000 7fa6811b1740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa6781ac5d0 con 0x55561d3274a0 2024-09-19T05:19:27.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.089+0000 7fa6811b1740 10 client.0 _ll_register_callbacks cb 0x7fa67001f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:19:27.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.090+0000 7fa67d375640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d332680 0x55561d3389a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:27.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.090+0000 7fa67d375640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d332680 0x55561d3389a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53024/0 (socket says 172.21.15.120:53024) 2024-09-19T05:19:27.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.090+0000 7fa67d375640 1 -- 172.21.15.120:0/609760810 learned_addr learned my addr 172.21.15.120:0/609760810 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:27.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.090+0000 7fa67cb74640 1 --2- 172.21.15.120:0/609760810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55561d3274a0 0x55561d33aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:27.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.090+0000 7fa677fff640 1 --2- 172.21.15.120:0/609760810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55561d327dc0 0x55561d338210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:27.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.090+0000 7fa67d375640 1 -- 172.21.15.120:0/609760810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55561d3274a0 msgr2=0x55561d33aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:27.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.090+0000 7fa67d375640 1 --2- 172.21.15.120:0/609760810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55561d3274a0 0x55561d33aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.090+0000 7fa67d375640 1 -- 172.21.15.120:0/609760810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55561d327dc0 msgr2=0x55561d338210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:27.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.090+0000 7fa67d375640 1 --2- 172.21.15.120:0/609760810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55561d327dc0 0x55561d338210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.090+0000 7fa67d375640 1 -- 172.21.15.120:0/609760810 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55561d3abad0 con 0x55561d332680 2024-09-19T05:19:27.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.090+0000 7fa67cb74640 1 --2- 172.21.15.120:0/609760810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55561d3274a0 0x55561d33aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:19:27.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.090+0000 7fa67d375640 1 --2- 172.21.15.120:0/609760810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d332680 0x55561d3389a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa67002f490 tx=0x7fa670008cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b5a4c683d38dd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:27.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.090+0000 7fa657fff640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:19:27.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.090+0000 7fa657fff640 1 -- 172.21.15.120:0/609760810 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa670034070 con 0x55561d332680 2024-09-19T05:19:27.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.090+0000 7fa657fff640 1 -- 172.21.15.120:0/609760810 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fa670013f10 con 0x55561d332680 2024-09-19T05:19:27.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.090+0000 7fa6811b1740 1 -- 172.21.15.120:0/609760810 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa66c0bc2f0 con 0x55561d332680 2024-09-19T05:19:27.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.091+0000 7fa657fff640 1 -- 172.21.15.120:0/609760810 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa670047050 con 0x55561d332680 2024-09-19T05:19:27.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.091+0000 7fa6811b1740 10 client.15348 fetch_fsmap learned FSMap version 25 2024-09-19T05:19:27.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.091+0000 7fa6811b1740 1 -- 172.21.15.120:0/609760810 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55561d3acba0 con 0x55561d332680 2024-09-19T05:19:27.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.091+0000 7fa657fff640 1 -- 172.21.15.120:0/609760810 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa66c0bc2f0 con 0x55561d332680 2024-09-19T05:19:27.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.091+0000 7fa657fff640 1 -- 172.21.15.120:0/609760810 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa670014110 con 0x55561d332680 2024-09-19T05:19:27.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.091+0000 7fa6811b1740 10 client.15348 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:19:27.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.091+0000 7fa6811b1740 10 client.15348 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:19:27.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.091+0000 7fa6811b1740 20 client.15348 populate_metadata read hostname 'smithi120' 2024-09-19T05:19:27.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.091+0000 7fa6811b1740 1 --2- 172.21.15.120:0/609760810 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55561d3ad260 0x55561d3af650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:27.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.091+0000 7fa6811b1740 4 client.15348 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:19:27.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.091+0000 7fa6811b1740 1 -- 172.21.15.120:0/609760810 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55561d32faf0 con 0x55561d3ad260 2024-09-19T05:19:27.100 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.091+0000 7fa67cb74640 1 --2- 172.21.15.120:0/609760810 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55561d3ad260 0x55561d3af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:27.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.092+0000 7fa67cb74640 1 --2- 172.21.15.120:0/609760810 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55561d3ad260 0x55561d3af650 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40a2342f2f986b7b server_cookie=7ae9d4272f29503e in_seq=0 out_seq=0 2024-09-19T05:19:27.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.092+0000 7fa657fff640 10 client.15348 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:19:27.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.092+0000 7fa657fff640 1 -- 172.21.15.120:0/609760810 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55561d32faf0 con 0x55561d3ad260 2024-09-19T05:19:27.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.092+0000 7fa657fff640 10 client.15348 handle_command_reply: tid=0 2024-09-19T05:19:27.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.092+0000 7fa6811b1740 1 client.15348 shutdown 2024-09-19T05:19:27.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.092+0000 7fa6811b1740 1 -- 172.21.15.120:0/609760810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d332680 msgr2=0x55561d3389a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:27.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.092+0000 7fa6811b1740 1 --2- 172.21.15.120:0/609760810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d332680 0x55561d3389a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa67002f490 tx=0x7fa670008cd0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.092+0000 7fa6811b1740 1 -- 172.21.15.120:0/609760810 shutdown_connections 2024-09-19T05:19:27.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.092+0000 7fa6811b1740 1 --2- 172.21.15.120:0/609760810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55561d332680 0x55561d3389a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.092+0000 7fa6811b1740 1 --2- 172.21.15.120:0/609760810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55561d327dc0 0x55561d338210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.092+0000 7fa6811b1740 1 --2- 172.21.15.120:0/609760810 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55561d3ad260 0x55561d3af650 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.092+0000 7fa657fff640 0 client.15348 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:19:27.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.092+0000 7fa6811b1740 1 --2- 172.21.15.120:0/609760810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55561d3274a0 0x55561d33aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.092+0000 7fa6811b1740 1 -- 172.21.15.120:0/609760810 >> 172.21.15.120:0/609760810 conn(0x55561d323a30 msgr2=0x55561d3312a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:27.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.092+0000 7fa6811b1740 1 -- 172.21.15.120:0/609760810 shutdown_connections 2024-09-19T05:19:27.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.092+0000 7fa6811b1740 1 -- 172.21.15.120:0/609760810 wait complete. 2024-09-19T05:19:27.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.092+0000 7fa6811b1740 20 client.15348 trim_cache size 0 max 16384 2024-09-19T05:19:27.102 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T05:19:27.102 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T05:19:27.102 INFO:teuthology.orchestra.run.smithi120.stdout: "scrubs": { 2024-09-19T05:19:27.102 INFO:teuthology.orchestra.run.smithi120.stdout: "57dd2b09-b9b1-438e-adad-f835a4f3e818": { 2024-09-19T05:19:27.102 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/", 2024-09-19T05:19:27.102 INFO:teuthology.orchestra.run.smithi120.stdout: "tag": "57dd2b09-b9b1-438e-adad-f835a4f3e818", 2024-09-19T05:19:27.103 INFO:teuthology.orchestra.run.smithi120.stdout: "options": "recursive,force" 2024-09-19T05:19:27.103 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:19:27.103 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:19:27.103 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T05:19:27.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.093+0000 7fa67edd8640 1 -- 172.21.15.120:0/1371298596 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fa6680a3440 msgr2=0x7fa6680a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:27.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.093+0000 7fa67edd8640 1 --2- 172.21.15.120:0/1371298596 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fa6680a3440 0x7fa6680a5900 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa67001e000 tx=0x7fa670019000 comp rx=0 tx=0).stop 2024-09-19T05:19:27.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.093+0000 7fa67edd8640 1 -- 172.21.15.120:0/1371298596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa678100e20 msgr2=0x7fa6781992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:27.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.093+0000 7fa67edd8640 1 --2- 172.21.15.120:0/1371298596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa678100e20 0x7fa6781992e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa66c006010 tx=0x7fa66c0042f0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.093+0000 7fa67edd8640 1 -- 172.21.15.120:0/1371298596 shutdown_connections 2024-09-19T05:19:27.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.093+0000 7fa67edd8640 1 --2- 172.21.15.120:0/1371298596 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fa6680a3440 0x7fa6680a5900 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.093+0000 7fa67edd8640 1 --2- 172.21.15.120:0/1371298596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa678102ef0 0x7fa6781a4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.093+0000 7fa67edd8640 1 --2- 172.21.15.120:0/1371298596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa678102570 0x7fa678199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.093+0000 7fa67edd8640 1 --2- 172.21.15.120:0/1371298596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa678100e20 0x7fa6781992e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.093+0000 7fa67edd8640 1 -- 172.21.15.120:0/1371298596 >> 172.21.15.120:0/1371298596 conn(0x7fa6780fc7d0 msgr2=0x7fa6780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:27.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.093+0000 7fa67edd8640 1 -- 172.21.15.120:0/1371298596 shutdown_connections 2024-09-19T05:19:27.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.093+0000 7fa67edd8640 1 -- 172.21.15.120:0/1371298596 wait complete. 2024-09-19T05:19:27.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.113+0000 7f148de27640 1 -- 172.21.15.120:0/1201976643 --> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f148810f020 con 0x7f14700a3500 2024-09-19T05:19:27.122 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.120+0000 7f1484ff9640 1 -- 172.21.15.120:0/1201976643 <== mgr.15156 v2:172.21.15.120:6800/1306632207 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f148810f020 con 0x7f14700a3500 2024-09-19T05:19:27.122 INFO:teuthology.orchestra.run.smithi120.stdout:/ 1m 6m3h 2024-09-19T05:19:27.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.122+0000 7f148de27640 1 -- 172.21.15.120:0/1201976643 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f14700a3500 msgr2=0x7f14700a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:27.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.122+0000 7f148de27640 1 --2- 172.21.15.120:0/1201976643 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f14700a3500 0x7f14700a59c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1478000c00 tx=0x7f1478031400 comp rx=0 tx=0).stop 2024-09-19T05:19:27.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.122+0000 7f148de27640 1 -- 172.21.15.120:0/1201976643 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1488101350 msgr2=0x7f148819ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:27.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.122+0000 7f148de27640 1 --2- 172.21.15.120:0/1201976643 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1488101350 0x7f148819ab40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f147c00b4a0 tx=0x7f147c00b960 comp rx=0 tx=0).stop 2024-09-19T05:19:27.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.122+0000 7f148de27640 1 -- 172.21.15.120:0/1201976643 shutdown_connections 2024-09-19T05:19:27.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.122+0000 7f148de27640 1 --2- 172.21.15.120:0/1201976643 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f14700a3500 0x7f14700a59c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.122+0000 7f148de27640 1 --2- 172.21.15.120:0/1201976643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14881069c0 0x7f148819eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.122+0000 7f148de27640 1 --2- 172.21.15.120:0/1201976643 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1488101350 0x7f148819ab40 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.122+0000 7f148de27640 1 --2- 172.21.15.120:0/1201976643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14881009b0 0x7f148819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:27.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.122+0000 7f148de27640 1 -- 172.21.15.120:0/1201976643 >> 172.21.15.120:0/1201976643 conn(0x7f1488077990 msgr2=0x7f148810e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:27.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.123+0000 7f148de27640 1 -- 172.21.15.120:0/1201976643 shutdown_connections 2024-09-19T05:19:27.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:27.123+0000 7f148de27640 1 -- 172.21.15.120:0/1201976643 wait complete. 2024-09-19T05:19:27.136 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-19T05:19:27.163 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-19T05:19:27.173 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-19T05:19:27.203 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi120.front.sepia.ceph.com 2024-09-19T05:19:27.203 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-19T05:19:27.206 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T05:19:27.220 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T05:19:27.220 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T05:19:27.220 INFO:tasks.workunit:timeout=3h 2024-09-19T05:19:27.220 INFO:tasks.workunit:cleanup=True 2024-09-19T05:19:27.221 DEBUG:teuthology.orchestra.run.smithi120:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T05:19:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T05:19:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-19T05:19:27.237 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 78h/120d Inode: 1 Links: 2 2024-09-19T05:19:27.237 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T05:19:27.237 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-19T05:19:27.237 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-19 05:17:45.562650871 +0000 2024-09-19T05:19:27.237 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-19 05:17:45.562650871 +0000 2024-09-19T05:19:27.237 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-19 05:19:15.544090192 +0000 2024-09-19T05:19:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2024-09-19T05:19:27.238 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T05:19:27.238 DEBUG:teuthology.orchestra.run.smithi120:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T05:19:27.311 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T05:19:27.366 INFO:tasks.workunit.client.0.smithi120.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T05:19:27.898 INFO:tasks.cephfs.filesystem:scrub status for tag:57dd2b09-b9b1-438e-adad-f835a4f3e818 - {'path': '/', 'tag': '57dd2b09-b9b1-438e-adad-f835a4f3e818', 'options': 'recursive,force'} 2024-09-19T05:19:27.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:27 smithi194 ceph-mon[35228]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:27.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:27 smithi194 ceph-mon[35228]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:27.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:27 smithi194 ceph-mon[35228]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:27.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:27 smithi178 ceph-mon[34347]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:27.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:27 smithi178 ceph-mon[34347]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:27.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:27 smithi178 ceph-mon[34347]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:28.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:27 smithi120 ceph-mon[30956]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:28.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:27 smithi120 ceph-mon[30956]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:28.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:27 smithi120 ceph-mon[30956]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:19:28.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:28 smithi178 ceph-mon[34347]: pgmap v10: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 511 B/s wr, 15 op/s 2024-09-19T05:19:29.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:28 smithi120 ceph-mon[30956]: pgmap v10: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 511 B/s wr, 15 op/s 2024-09-19T05:19:29.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:28 smithi194 ceph-mon[35228]: pgmap v10: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 511 B/s wr, 15 op/s 2024-09-19T05:19:30.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:30 smithi178 ceph-mon[34347]: pgmap v11: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 KiB/s wr, 43 op/s 2024-09-19T05:19:30.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:30 smithi120 ceph-mon[30956]: pgmap v11: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 KiB/s wr, 43 op/s 2024-09-19T05:19:30.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:30 smithi194 ceph-mon[35228]: pgmap v11: 97 pgs: 97 active+clean; 1.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 KiB/s wr, 43 op/s 2024-09-19T05:19:32.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:32 smithi178 ceph-mon[34347]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-09-19T05:19:32.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:32 smithi120 ceph-mon[30956]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-09-19T05:19:32.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:32 smithi194 ceph-mon[35228]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 50 op/s 2024-09-19T05:19:34.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:34 smithi178 ceph-mon[34347]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 77 KiB/s wr, 37 op/s 2024-09-19T05:19:34.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:34 smithi120 ceph-mon[30956]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 77 KiB/s wr, 37 op/s 2024-09-19T05:19:34.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:34 smithi194 ceph-mon[35228]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 77 KiB/s wr, 37 op/s 2024-09-19T05:19:36.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:36 smithi178 ceph-mon[34347]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 39 op/s 2024-09-19T05:19:36.746 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:36 smithi120 ceph-mon[30956]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 39 op/s 2024-09-19T05:19:36.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:36 smithi194 ceph-mon[35228]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 39 op/s 2024-09-19T05:19:37.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:37 smithi178 ceph-mon[34347]: scrub summary: idle 2024-09-19T05:19:37.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:37 smithi120 ceph-mon[30956]: scrub summary: idle 2024-09-19T05:19:37.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:37 smithi194 ceph-mon[35228]: scrub summary: idle 2024-09-19T05:19:38.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:38 smithi178 ceph-mon[34347]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 77 KiB/s wr, 37 op/s 2024-09-19T05:19:38.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:38 smithi120 ceph-mon[30956]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 77 KiB/s wr, 37 op/s 2024-09-19T05:19:38.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:38 smithi194 ceph-mon[35228]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 77 KiB/s wr, 37 op/s 2024-09-19T05:19:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.342+0000 7f86d3c23640 1 -- 172.21.15.120:0/1416623498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86cc101ad0 msgr2=0x7f86cc101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.342+0000 7f86d3c23640 1 --2- 172.21.15.120:0/1416623498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86cc101ad0 0x7f86cc101f30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f86bc009930 tx=0x7f86bc02a420 comp rx=0 tx=0).stop 2024-09-19T05:19:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.342+0000 7f86d3c23640 1 -- 172.21.15.120:0/1416623498 shutdown_connections 2024-09-19T05:19:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.342+0000 7f86d3c23640 1 --2- 172.21.15.120:0/1416623498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86cc102470 0x7f86cc10e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.342+0000 7f86d3c23640 1 --2- 172.21.15.120:0/1416623498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86cc101ad0 0x7f86cc101f30 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.342+0000 7f86d3c23640 1 --2- 172.21.15.120:0/1416623498 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86cc107b70 0x7f86cc107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.342+0000 7f86d3c23640 1 -- 172.21.15.120:0/1416623498 >> 172.21.15.120:0/1416623498 conn(0x7f86cc0fd7d0 msgr2=0x7f86cc0ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.343+0000 7f86d3c23640 1 -- 172.21.15.120:0/1416623498 shutdown_connections 2024-09-19T05:19:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.343+0000 7f86d3c23640 1 -- 172.21.15.120:0/1416623498 wait complete. 2024-09-19T05:19:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.343+0000 7f86d3c23640 1 Processor -- start 2024-09-19T05:19:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.343+0000 7f86d3c23640 1 -- start start 2024-09-19T05:19:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.343+0000 7f86d3c23640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86cc101ad0 0x7f86cc1982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.343+0000 7f86d3c23640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86cc102470 0x7f86cc198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.343+0000 7f86d3c23640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86cc107b70 0x7f86cc19cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.343+0000 7f86d3c23640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc111de0 con 0x7f86cc101ad0 2024-09-19T05:19:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.343+0000 7f86d3c23640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc111c60 con 0x7f86cc107b70 2024-09-19T05:19:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.343+0000 7f86d3c23640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc111f60 con 0x7f86cc102470 2024-09-19T05:19:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.343+0000 7f86d19bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86cc101ad0 0x7f86cc1982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.343+0000 7f86d19bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86cc101ad0 0x7f86cc1982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46654/0 (socket says 172.21.15.120:46654) 2024-09-19T05:19:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.344+0000 7f86d19bf640 1 -- 172.21.15.120:0/2480238936 learned_addr learned my addr 172.21.15.120:0/2480238936 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.344+0000 7f86d21c0640 1 --2- 172.21.15.120:0/2480238936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86cc107b70 0x7f86cc19cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.344+0000 7f86d11be640 1 --2- 172.21.15.120:0/2480238936 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86cc102470 0x7f86cc198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.344+0000 7f86d19bf640 1 -- 172.21.15.120:0/2480238936 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86cc102470 msgr2=0x7f86cc198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.344+0000 7f86d19bf640 1 --2- 172.21.15.120:0/2480238936 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86cc102470 0x7f86cc198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.344+0000 7f86d19bf640 1 -- 172.21.15.120:0/2480238936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86cc107b70 msgr2=0x7f86cc19cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.344+0000 7f86d19bf640 1 --2- 172.21.15.120:0/2480238936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86cc107b70 0x7f86cc19cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.344+0000 7f86d19bf640 1 -- 172.21.15.120:0/2480238936 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86cc19d2b0 con 0x7f86cc101ad0 2024-09-19T05:19:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.344+0000 7f86d19bf640 1 --2- 172.21.15.120:0/2480238936 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86cc101ad0 0x7f86cc1982c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f86c800e9f0 tx=0x7f86c800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.344+0000 7f86c2ffd640 1 -- 172.21.15.120:0/2480238936 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c800cd80 con 0x7f86cc101ad0 2024-09-19T05:19:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.344+0000 7f86c2ffd640 1 -- 172.21.15.120:0/2480238936 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f86c80108e0 con 0x7f86cc101ad0 2024-09-19T05:19:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.344+0000 7f86d3c23640 1 -- 172.21.15.120:0/2480238936 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86cc19d5a0 con 0x7f86cc101ad0 2024-09-19T05:19:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.344+0000 7f86c2ffd640 1 -- 172.21.15.120:0/2480238936 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c8018920 con 0x7f86cc101ad0 2024-09-19T05:19:40.349 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.344+0000 7f86d3c23640 1 -- 172.21.15.120:0/2480238936 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86cc1a4e30 con 0x7f86cc101ad0 2024-09-19T05:19:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.347+0000 7f86c2ffd640 1 -- 172.21.15.120:0/2480238936 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f86c8010a90 con 0x7f86cc101ad0 2024-09-19T05:19:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.347+0000 7f86d69bb740 1 Processor -- start 2024-09-19T05:19:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.347+0000 7f86d69bb740 1 -- start start 2024-09-19T05:19:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.348+0000 7f86d69bb740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd626daf0 0x555bd626ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.348+0000 7f86d69bb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555bd626e410 0x555bd6278770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.348+0000 7f86d69bb740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555bd6278cb0 0x555bd627b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.348+0000 7f86d69bb740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x555bd61d22f0 con 0x555bd626daf0 2024-09-19T05:19:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.348+0000 7f86d69bb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x555bd617a270 con 0x555bd626e410 2024-09-19T05:19:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.348+0000 7f86d69bb740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x555bd61ce2b0 con 0x555bd6278cb0 2024-09-19T05:19:40.356 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.348+0000 7f86d21c0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd626daf0 0x555bd626ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.348+0000 7f86c2ffd640 1 --2- 172.21.15.120:0/2480238936 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f86b80a3580 0x7f86b80a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.348+0000 7f86d21c0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd626daf0 0x555bd626ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46662/0 (socket says 172.21.15.120:46662) 2024-09-19T05:19:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.348+0000 7f86d21c0640 1 -- 172.21.15.120:0/925559403 learned_addr learned my addr 172.21.15.120:0/925559403 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.348+0000 7f86d19bf640 1 --2- 172.21.15.120:0/925559403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555bd626e410 0x555bd6278770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.348+0000 7f86d11be640 1 --2- 172.21.15.120:0/925559403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555bd6278cb0 0x555bd627b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.348+0000 7f86d21c0640 1 --2- 172.21.15.120:0/2480238936 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f86b80a3580 0x7f86b80a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.348+0000 7f86c2ffd640 1 -- 172.21.15.120:0/2480238936 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f86c80d01a0 con 0x7f86cc101ad0 2024-09-19T05:19:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.348+0000 7f86d21c0640 1 -- 172.21.15.120:0/925559403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555bd6278cb0 msgr2=0x555bd627b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.348+0000 7f86d21c0640 1 --2- 172.21.15.120:0/925559403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555bd6278cb0 0x555bd627b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.348+0000 7f86d21c0640 1 -- 172.21.15.120:0/925559403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555bd626e410 msgr2=0x555bd6278770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.348+0000 7f86d21c0640 1 --2- 172.21.15.120:0/925559403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555bd626e410 0x555bd6278770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.348+0000 7f86d21c0640 1 -- 172.21.15.120:0/925559403 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bd6179340 con 0x555bd626daf0 2024-09-19T05:19:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.348+0000 7f86d21c0640 1 --2- 172.21.15.120:0/925559403 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd626daf0 0x555bd626ded0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f86c4013e70 tx=0x7f86c40117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeaa64bfaed2e4cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.348+0000 7f86d21c0640 1 --2- 172.21.15.120:0/2480238936 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f86b80a3580 0x7f86b80a5a40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f86c4011cb0 tx=0x7f86c401d000 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.349+0000 7f86b7fff640 1 -- 172.21.15.120:0/925559403 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c400dbd0 con 0x555bd626daf0 2024-09-19T05:19:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.349+0000 7f86b7fff640 1 -- 172.21.15.120:0/925559403 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f86c4003e20 con 0x555bd626daf0 2024-09-19T05:19:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.349+0000 7f86b7fff640 1 -- 172.21.15.120:0/925559403 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c4004620 con 0x555bd626daf0 2024-09-19T05:19:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.349+0000 7f86d69bb740 1 -- 172.21.15.120:0/925559403 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd626daf0 msgr2=0x555bd626ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.349+0000 7f86d69bb740 1 --2- 172.21.15.120:0/925559403 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd626daf0 0x555bd626ded0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f86c4013e70 tx=0x7f86c40117b0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.349+0000 7f86d69bb740 1 -- 172.21.15.120:0/925559403 shutdown_connections 2024-09-19T05:19:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.349+0000 7f86d69bb740 1 --2- 172.21.15.120:0/925559403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555bd6278cb0 0x555bd627b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.349+0000 7f86d69bb740 1 --2- 172.21.15.120:0/925559403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555bd626e410 0x555bd6278770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.349+0000 7f86d69bb740 1 --2- 172.21.15.120:0/925559403 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd626daf0 0x555bd626ded0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.349+0000 7f86d69bb740 1 -- 172.21.15.120:0/925559403 >> 172.21.15.120:0/925559403 conn(0x555bd626a060 msgr2=0x555bd626a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.350+0000 7f86d69bb740 1 -- 172.21.15.120:0/925559403 shutdown_connections 2024-09-19T05:19:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.350+0000 7f86d69bb740 1 -- 172.21.15.120:0/925559403 wait complete. 2024-09-19T05:19:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.350+0000 7f86d69bb740 1 -- start start 2024-09-19T05:19:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.350+0000 7f86d69bb740 1 Processor -- start 2024-09-19T05:19:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.350+0000 7f86d69bb740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd626daf0 0x555bd6275ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.350+0000 7f86d69bb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555bd626e410 0x555bd62760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.350+0000 7f86d69bb740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555bd6278cb0 0x555bd6276620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.350+0000 7f86d69bb740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x555bd627b820 con 0x555bd626daf0 2024-09-19T05:19:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.350+0000 7f86d69bb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x555bd615b290 con 0x555bd626e410 2024-09-19T05:19:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.350+0000 7f86d69bb740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x555bd627b9a0 con 0x555bd6278cb0 2024-09-19T05:19:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.350+0000 7f86d69bb740 10 client.0 _ll_register_callbacks cb 0x555bd618c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:19:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.351+0000 7f86d19bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd626daf0 0x555bd6275ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.351+0000 7f86d19bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd626daf0 0x555bd6275ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46678/0 (socket says 172.21.15.120:46678) 2024-09-19T05:19:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.351+0000 7f86d19bf640 1 -- 172.21.15.120:0/865966260 learned_addr learned my addr 172.21.15.120:0/865966260 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.351+0000 7f86d11be640 1 --2- 172.21.15.120:0/865966260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555bd626e410 0x555bd62760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.351+0000 7f86d21c0640 1 --2- 172.21.15.120:0/865966260 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555bd6278cb0 0x555bd6276620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.351+0000 7f86d19bf640 1 -- 172.21.15.120:0/865966260 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555bd6278cb0 msgr2=0x555bd6276620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.351+0000 7f86d19bf640 1 --2- 172.21.15.120:0/865966260 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555bd6278cb0 0x555bd6276620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.351+0000 7f86d19bf640 1 -- 172.21.15.120:0/865966260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555bd626e410 msgr2=0x555bd62760e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.351+0000 7f86d19bf640 1 --2- 172.21.15.120:0/865966260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555bd626e410 0x555bd62760e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.351+0000 7f86d19bf640 1 -- 172.21.15.120:0/865966260 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bd5ee5210 con 0x555bd626daf0 2024-09-19T05:19:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.351+0000 7f86d19bf640 1 --2- 172.21.15.120:0/865966260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd626daf0 0x555bd6275ba0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f86c809bfc0 tx=0x7f86c806bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e7fb5112ab716a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.351+0000 7f86b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:19:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.351+0000 7f86b57fa640 1 -- 172.21.15.120:0/865966260 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c8026040 con 0x555bd626daf0 2024-09-19T05:19:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.351+0000 7f86b57fa640 1 -- 172.21.15.120:0/865966260 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f86c80bc2b0 con 0x555bd626daf0 2024-09-19T05:19:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.351+0000 7f86d69bb740 1 -- 172.21.15.120:0/865966260 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86c4003e20 con 0x555bd626daf0 2024-09-19T05:19:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.351+0000 7f86b57fa640 1 -- 172.21.15.120:0/865966260 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f86c80cdca0 con 0x555bd626daf0 2024-09-19T05:19:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.351+0000 7f86d69bb740 10 client.15360 fetch_fsmap learned FSMap version 25 2024-09-19T05:19:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.351+0000 7f86d69bb740 1 -- 172.21.15.120:0/865966260 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555bd5fb1620 con 0x555bd626daf0 2024-09-19T05:19:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.351+0000 7f86b57fa640 1 -- 172.21.15.120:0/865966260 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f86c4003e20 con 0x555bd626daf0 2024-09-19T05:19:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.352+0000 7f86b57fa640 1 -- 172.21.15.120:0/865966260 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f86c8010430 con 0x555bd626daf0 2024-09-19T05:19:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.352+0000 7f86d69bb740 10 client.15360 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:19:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.352+0000 7f86d69bb740 10 client.15360 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:19:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.352+0000 7f86d69bb740 20 client.15360 populate_metadata read hostname 'smithi120' 2024-09-19T05:19:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.352+0000 7f86d69bb740 1 --2- 172.21.15.120:0/865966260 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x555bd6288ba0 0x555bd628af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.352+0000 7f86d69bb740 4 client.15360 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:19:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.352+0000 7f86d69bb740 1 -- 172.21.15.120:0/865966260 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555bd61dfa20 con 0x555bd6288ba0 2024-09-19T05:19:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.352+0000 7f86d11be640 1 --2- 172.21.15.120:0/865966260 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x555bd6288ba0 0x555bd628af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.353+0000 7f86b57fa640 10 client.15360 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:19:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.353+0000 7f86d11be640 1 --2- 172.21.15.120:0/865966260 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x555bd6288ba0 0x555bd628af90 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cc347841e0d9416 server_cookie=96edb9c046c79981 in_seq=0 out_seq=0 2024-09-19T05:19:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.353+0000 7f86b57fa640 1 -- 172.21.15.120:0/865966260 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555bd61dfa20 con 0x555bd6288ba0 2024-09-19T05:19:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.353+0000 7f86b57fa640 10 client.15360 handle_command_reply: tid=0 2024-09-19T05:19:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.353+0000 7f86d69bb740 1 client.15360 shutdown 2024-09-19T05:19:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.353+0000 7f86d69bb740 1 -- 172.21.15.120:0/865966260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd626daf0 msgr2=0x555bd6275ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.353+0000 7f86d69bb740 1 --2- 172.21.15.120:0/865966260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd626daf0 0x555bd6275ba0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f86c809bfc0 tx=0x7f86c806bfa0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.353+0000 7f86d69bb740 1 -- 172.21.15.120:0/865966260 shutdown_connections 2024-09-19T05:19:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.353+0000 7f86d69bb740 1 --2- 172.21.15.120:0/865966260 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x555bd6288ba0 0x555bd628af90 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.353+0000 7f86d69bb740 1 --2- 172.21.15.120:0/865966260 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555bd6278cb0 0x555bd6276620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.353+0000 7f86d69bb740 1 --2- 172.21.15.120:0/865966260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555bd626e410 0x555bd62760e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.353+0000 7f86d69bb740 1 --2- 172.21.15.120:0/865966260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd626daf0 0x555bd6275ba0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.353+0000 7f86b57fa640 0 client.15360 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:19:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.353+0000 7f86d69bb740 1 -- 172.21.15.120:0/865966260 >> 172.21.15.120:0/865966260 conn(0x555bd626a060 msgr2=0x555bd626fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.354+0000 7f86d69bb740 1 -- 172.21.15.120:0/865966260 shutdown_connections 2024-09-19T05:19:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.354+0000 7f86d69bb740 1 -- 172.21.15.120:0/865966260 wait complete. 2024-09-19T05:19:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.354+0000 7f86d69bb740 20 client.15360 trim_cache size 0 max 16384 2024-09-19T05:19:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.368+0000 7f86d69bb740 1 Processor -- start 2024-09-19T05:19:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.368+0000 7f86d69bb740 1 -- start start 2024-09-19T05:19:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.368+0000 7f86d69bb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555bd626daf0 0x555bd6270560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.368+0000 7f86d69bb740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555bd626e410 0x555bd6276450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.368+0000 7f86d69bb740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd6278cb0 0x555bd62908c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.368+0000 7f86d69bb740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc1b0180 con 0x555bd6278cb0 2024-09-19T05:19:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.368+0000 7f86d69bb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc1ada50 con 0x555bd626daf0 2024-09-19T05:19:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.368+0000 7f86d69bb740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc1ab8a0 con 0x555bd626e410 2024-09-19T05:19:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.368+0000 7f86d21c0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd6278cb0 0x555bd62908c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.368+0000 7f86d21c0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd6278cb0 0x555bd62908c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46682/0 (socket says 172.21.15.120:46682) 2024-09-19T05:19:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.368+0000 7f86d21c0640 1 -- 172.21.15.120:0/3660763592 learned_addr learned my addr 172.21.15.120:0/3660763592 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.368+0000 7f86d19bf640 1 --2- 172.21.15.120:0/3660763592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555bd626daf0 0x555bd6270560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.368+0000 7f86d11be640 1 --2- 172.21.15.120:0/3660763592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555bd626e410 0x555bd6276450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.368+0000 7f86d21c0640 1 -- 172.21.15.120:0/3660763592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555bd626e410 msgr2=0x555bd6276450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.368+0000 7f86d21c0640 1 --2- 172.21.15.120:0/3660763592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555bd626e410 0x555bd6276450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.368+0000 7f86d21c0640 1 -- 172.21.15.120:0/3660763592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555bd626daf0 msgr2=0x555bd6270560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.368+0000 7f86d21c0640 1 --2- 172.21.15.120:0/3660763592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555bd626daf0 0x555bd6270560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.368+0000 7f86d21c0640 1 -- 172.21.15.120:0/3660763592 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bd626b110 con 0x555bd6278cb0 2024-09-19T05:19:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.368+0000 7f86d11be640 1 --2- 172.21.15.120:0/3660763592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555bd626e410 0x555bd6276450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.369+0000 7f86d21c0640 1 --2- 172.21.15.120:0/3660763592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd6278cb0 0x555bd62908c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f86c4020040 tx=0x7f86c400a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48cd0542f4f61fa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.369+0000 7f86b77fe640 1 -- 172.21.15.120:0/3660763592 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c402e030 con 0x555bd6278cb0 2024-09-19T05:19:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.369+0000 7f86b77fe640 1 -- 172.21.15.120:0/3660763592 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f86c4013820 con 0x555bd6278cb0 2024-09-19T05:19:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.369+0000 7f86b77fe640 1 -- 172.21.15.120:0/3660763592 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c40042b0 con 0x555bd6278cb0 2024-09-19T05:19:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.369+0000 7f86d69bb740 1 -- 172.21.15.120:0/3660763592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd6278cb0 msgr2=0x555bd62908c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.369+0000 7f86d69bb740 1 --2- 172.21.15.120:0/3660763592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd6278cb0 0x555bd62908c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f86c4020040 tx=0x7f86c400a6d0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.369+0000 7f86d69bb740 1 -- 172.21.15.120:0/3660763592 shutdown_connections 2024-09-19T05:19:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.369+0000 7f86d69bb740 1 --2- 172.21.15.120:0/3660763592 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd6278cb0 0x555bd62908c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.369+0000 7f86d69bb740 1 --2- 172.21.15.120:0/3660763592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555bd626e410 0x555bd6276450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.369+0000 7f86d69bb740 1 --2- 172.21.15.120:0/3660763592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555bd626daf0 0x555bd6270560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.369+0000 7f86d69bb740 1 -- 172.21.15.120:0/3660763592 >> 172.21.15.120:0/3660763592 conn(0x555bd626a060 msgr2=0x555bd6277c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.370+0000 7f86d69bb740 1 -- 172.21.15.120:0/3660763592 shutdown_connections 2024-09-19T05:19:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.370+0000 7f86d69bb740 1 -- 172.21.15.120:0/3660763592 wait complete. 2024-09-19T05:19:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.370+0000 7f86d69bb740 1 -- start start 2024-09-19T05:19:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.370+0000 7f86d69bb740 1 Processor -- start 2024-09-19T05:19:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.370+0000 7f86d69bb740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd626daf0 0x555bd627c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.370+0000 7f86d69bb740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555bd626e410 0x555bd627cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.370+0000 7f86d69bb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555bd6278cb0 0x555bd627d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.370+0000 7f86d69bb740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc1abf10 con 0x555bd626daf0 2024-09-19T05:19:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.370+0000 7f86d69bb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc1ad380 con 0x555bd6278cb0 2024-09-19T05:19:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.370+0000 7f86d69bb740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc1ac5e0 con 0x555bd626e410 2024-09-19T05:19:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.370+0000 7f86d69bb740 10 client.0 _ll_register_callbacks cb 0x7f86c800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:19:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.370+0000 7f86d19bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd626daf0 0x555bd627c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.370+0000 7f86d19bf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd626daf0 0x555bd627c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46690/0 (socket says 172.21.15.120:46690) 2024-09-19T05:19:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.370+0000 7f86d19bf640 1 -- 172.21.15.120:0/2413277502 learned_addr learned my addr 172.21.15.120:0/2413277502 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.370+0000 7f86d21c0640 1 --2- 172.21.15.120:0/2413277502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555bd6278cb0 0x555bd627d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.371+0000 7f86d11be640 1 --2- 172.21.15.120:0/2413277502 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555bd626e410 0x555bd627cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.371+0000 7f86d19bf640 1 -- 172.21.15.120:0/2413277502 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555bd626e410 msgr2=0x555bd627cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.371+0000 7f86d19bf640 1 --2- 172.21.15.120:0/2413277502 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555bd626e410 0x555bd627cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.371+0000 7f86d19bf640 1 -- 172.21.15.120:0/2413277502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555bd6278cb0 msgr2=0x555bd627d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.371+0000 7f86d19bf640 1 --2- 172.21.15.120:0/2413277502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555bd6278cb0 0x555bd627d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.371+0000 7f86d19bf640 1 -- 172.21.15.120:0/2413277502 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bd62652d0 con 0x555bd626daf0 2024-09-19T05:19:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.371+0000 7f86d11be640 1 --2- 172.21.15.120:0/2413277502 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555bd626e410 0x555bd627cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.371+0000 7f86d19bf640 1 --2- 172.21.15.120:0/2413277502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd626daf0 0x555bd627c9b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f86c80a50f0 tx=0x7f86c809bb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40bea8cb477df4b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.371+0000 7f86b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:19:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.371+0000 7f86b57fa640 1 -- 172.21.15.120:0/2413277502 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c80cdca0 con 0x555bd626daf0 2024-09-19T05:19:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.371+0000 7f86b57fa640 1 -- 172.21.15.120:0/2413277502 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f86c80a00f0 con 0x555bd626daf0 2024-09-19T05:19:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.371+0000 7f86d69bb740 1 -- 172.21.15.120:0/2413277502 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86c4013820 con 0x555bd626daf0 2024-09-19T05:19:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.371+0000 7f86b57fa640 1 -- 172.21.15.120:0/2413277502 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f86c80b52b0 con 0x555bd626daf0 2024-09-19T05:19:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.371+0000 7f86d69bb740 10 client.15366 fetch_fsmap learned FSMap version 25 2024-09-19T05:19:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.371+0000 7f86d69bb740 1 -- 172.21.15.120:0/2413277502 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555bd62f3950 con 0x555bd626daf0 2024-09-19T05:19:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.371+0000 7f86b57fa640 1 -- 172.21.15.120:0/2413277502 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f86c4013820 con 0x555bd626daf0 2024-09-19T05:19:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.371+0000 7f86b57fa640 1 -- 172.21.15.120:0/2413277502 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f86c80a02f0 con 0x555bd626daf0 2024-09-19T05:19:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.372+0000 7f86d69bb740 10 client.15366 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:19:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.372+0000 7f86d69bb740 10 client.15366 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:19:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.372+0000 7f86d69bb740 20 client.15366 populate_metadata read hostname 'smithi120' 2024-09-19T05:19:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.372+0000 7f86d69bb740 1 --2- 172.21.15.120:0/2413277502 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x555bd62f3f60 0x555bd62f6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.372+0000 7f86d69bb740 4 client.15366 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:19:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.372+0000 7f86d69bb740 1 -- 172.21.15.120:0/2413277502 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555bd61d9d70 con 0x555bd62f3f60 2024-09-19T05:19:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.372+0000 7f86d11be640 1 --2- 172.21.15.120:0/2413277502 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x555bd62f3f60 0x555bd62f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.372+0000 7f86b57fa640 10 client.15366 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:19:40.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.372+0000 7f86d11be640 1 --2- 172.21.15.120:0/2413277502 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x555bd62f3f60 0x555bd62f6380 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61cf9ec40443dd3b server_cookie=65790623c321a117 in_seq=0 out_seq=0 2024-09-19T05:19:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.383+0000 7f86b57fa640 1 -- 172.21.15.120:0/2413277502 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555bd61d9d70 con 0x555bd62f3f60 2024-09-19T05:19:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.383+0000 7f86b57fa640 10 client.15366 handle_command_reply: tid=0 2024-09-19T05:19:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.383+0000 7f86d69bb740 1 client.15366 shutdown 2024-09-19T05:19:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.383+0000 7f86d69bb740 1 -- 172.21.15.120:0/2413277502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd626daf0 msgr2=0x555bd627c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.383+0000 7f86d69bb740 1 --2- 172.21.15.120:0/2413277502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd626daf0 0x555bd627c9b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f86c80a50f0 tx=0x7f86c809bb00 comp rx=0 tx=0).stop 2024-09-19T05:19:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.383+0000 7f86d69bb740 1 -- 172.21.15.120:0/2413277502 shutdown_connections 2024-09-19T05:19:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.383+0000 7f86d69bb740 1 --2- 172.21.15.120:0/2413277502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555bd6278cb0 0x555bd627d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.383+0000 7f86d69bb740 1 --2- 172.21.15.120:0/2413277502 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x555bd62f3f60 0x555bd62f6380 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.383+0000 7f86d69bb740 1 --2- 172.21.15.120:0/2413277502 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555bd626e410 0x555bd627cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.383+0000 7f86d69bb740 1 --2- 172.21.15.120:0/2413277502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555bd626daf0 0x555bd627c9b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.383+0000 7f86b57fa640 0 client.15366 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:19:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.383+0000 7f86d69bb740 1 -- 172.21.15.120:0/2413277502 >> 172.21.15.120:0/2413277502 conn(0x555bd626a060 msgr2=0x555bd62689a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.383+0000 7f86d69bb740 1 -- 172.21.15.120:0/2413277502 shutdown_connections 2024-09-19T05:19:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.383+0000 7f86d69bb740 1 -- 172.21.15.120:0/2413277502 wait complete. 2024-09-19T05:19:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.384+0000 7f86d69bb740 20 client.15366 trim_cache size 0 max 16384 2024-09-19T05:19:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:19:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:19:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:19:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:19:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.384+0000 7f86d3c23640 1 -- 172.21.15.120:0/2480238936 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f86b80a3580 msgr2=0x7f86b80a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.384+0000 7f86d3c23640 1 --2- 172.21.15.120:0/2480238936 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f86b80a3580 0x7f86b80a5a40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f86c4011cb0 tx=0x7f86c401d000 comp rx=0 tx=0).stop 2024-09-19T05:19:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.384+0000 7f86d3c23640 1 -- 172.21.15.120:0/2480238936 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86cc101ad0 msgr2=0x7f86cc1982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.384+0000 7f86d3c23640 1 --2- 172.21.15.120:0/2480238936 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86cc101ad0 0x7f86cc1982c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f86c800e9f0 tx=0x7f86c800eeb0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.384+0000 7f86d3c23640 1 -- 172.21.15.120:0/2480238936 shutdown_connections 2024-09-19T05:19:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.384+0000 7f86d3c23640 1 --2- 172.21.15.120:0/2480238936 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f86b80a3580 0x7f86b80a5a40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.384+0000 7f86d3c23640 1 --2- 172.21.15.120:0/2480238936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86cc107b70 0x7f86cc19cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.384+0000 7f86d3c23640 1 --2- 172.21.15.120:0/2480238936 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86cc102470 0x7f86cc198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.384+0000 7f86d3c23640 1 --2- 172.21.15.120:0/2480238936 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86cc101ad0 0x7f86cc1982c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.384+0000 7f86d3c23640 1 -- 172.21.15.120:0/2480238936 >> 172.21.15.120:0/2480238936 conn(0x7f86cc0fd7d0 msgr2=0x7f86cc0fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.384+0000 7f86d3c23640 1 -- 172.21.15.120:0/2480238936 shutdown_connections 2024-09-19T05:19:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:40.384+0000 7f86d3c23640 1 -- 172.21.15.120:0/2480238936 wait complete. 2024-09-19T05:19:40.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:40 smithi178 ceph-mon[34347]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 77 KiB/s wr, 37 op/s 2024-09-19T05:19:40.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:40 smithi120 ceph-mon[30956]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 77 KiB/s wr, 37 op/s 2024-09-19T05:19:40.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:40 smithi194 ceph-mon[35228]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 77 KiB/s wr, 37 op/s 2024-09-19T05:19:42.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:42 smithi178 ceph-mon[34347]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-19T05:19:42.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:42 smithi120 ceph-mon[30956]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-19T05:19:42.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:42 smithi194 ceph-mon[35228]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-09-19T05:19:44.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:44 smithi178 ceph-mon[34347]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-19T05:19:44.709 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:44 smithi194 ceph-mon[35228]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-19T05:19:44.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:44 smithi120 ceph-mon[30956]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-19T05:19:46.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:46 smithi178 ceph-mon[34347]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-09-19T05:19:46.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:46 smithi120 ceph-mon[30956]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-09-19T05:19:46.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:46 smithi194 ceph-mon[35228]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.2 KiB/s wr, 12 op/s 2024-09-19T05:19:48.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:48 smithi178 ceph-mon[34347]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-19T05:19:48.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:48 smithi120 ceph-mon[30956]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-19T05:19:48.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:48 smithi194 ceph-mon[35228]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-19T05:19:50.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:50 smithi178 ceph-mon[34347]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-19T05:19:50.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:50 smithi120 ceph-mon[30956]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-19T05:19:50.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:50 smithi194 ceph-mon[35228]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-19T05:19:52.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:52 smithi178 ceph-mon[34347]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-09-19T05:19:52.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:52 smithi120 ceph-mon[30956]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-09-19T05:19:52.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:52 smithi194 ceph-mon[35228]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-09-19T05:19:53.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.474+0000 7f8c63331640 1 -- 172.21.15.120:0/4092879526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c5c1069c0 msgr2=0x7f8c5c106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:53.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.474+0000 7f8c63331640 1 --2- 172.21.15.120:0/4092879526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c5c1069c0 0x7f8c5c106da0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c009930 tx=0x7f8c4c02a420 comp rx=0 tx=0).stop 2024-09-19T05:19:53.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.475+0000 7f8c63331640 1 -- 172.21.15.120:0/4092879526 shutdown_connections 2024-09-19T05:19:53.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.475+0000 7f8c63331640 1 --2- 172.21.15.120:0/4092879526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c5c101350 0x7f8c5c10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.475+0000 7f8c63331640 1 --2- 172.21.15.120:0/4092879526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c5c1009b0 0x7f8c5c100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.475+0000 7f8c63331640 1 --2- 172.21.15.120:0/4092879526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c5c1069c0 0x7f8c5c106da0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.475+0000 7f8c63331640 1 -- 172.21.15.120:0/4092879526 >> 172.21.15.120:0/4092879526 conn(0x7f8c5c077990 msgr2=0x7f8c5c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.475+0000 7f8c63331640 1 -- 172.21.15.120:0/4092879526 shutdown_connections 2024-09-19T05:19:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.475+0000 7f8c63331640 1 -- 172.21.15.120:0/4092879526 wait complete. 2024-09-19T05:19:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.475+0000 7f8c63331640 1 Processor -- start 2024-09-19T05:19:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.475+0000 7f8c63331640 1 -- start start 2024-09-19T05:19:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.475+0000 7f8c63331640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c5c1009b0 0x7f8c5c198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.475+0000 7f8c63331640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c5c101350 0x7f8c5c198790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.475+0000 7f8c63331640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c5c1069c0 0x7f8c5c19cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.475+0000 7f8c63331640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c110c70 con 0x7f8c5c101350 2024-09-19T05:19:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.475+0000 7f8c63331640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c110af0 con 0x7f8c5c1009b0 2024-09-19T05:19:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.475+0000 7f8c63331640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c110df0 con 0x7f8c5c1069c0 2024-09-19T05:19:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.476+0000 7f8c608cc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c5c101350 0x7f8c5c198790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.476+0000 7f8c608cc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c5c101350 0x7f8c5c198790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35852/0 (socket says 172.21.15.120:35852) 2024-09-19T05:19:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.476+0000 7f8c608cc640 1 -- 172.21.15.120:0/3992171509 learned_addr learned my addr 172.21.15.120:0/3992171509 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.476+0000 7f8c610cd640 1 --2- 172.21.15.120:0/3992171509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c5c1009b0 0x7f8c5c198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.476+0000 7f8c618ce640 1 --2- 172.21.15.120:0/3992171509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c5c1069c0 0x7f8c5c19cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.476+0000 7f8c608cc640 1 -- 172.21.15.120:0/3992171509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c5c1069c0 msgr2=0x7f8c5c19cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.476+0000 7f8c608cc640 1 --2- 172.21.15.120:0/3992171509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c5c1069c0 0x7f8c5c19cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.476+0000 7f8c608cc640 1 -- 172.21.15.120:0/3992171509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c5c1009b0 msgr2=0x7f8c5c198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.476+0000 7f8c608cc640 1 --2- 172.21.15.120:0/3992171509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c5c1009b0 0x7f8c5c198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.476+0000 7f8c608cc640 1 -- 172.21.15.120:0/3992171509 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c5c19d240 con 0x7f8c5c101350 2024-09-19T05:19:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.476+0000 7f8c618ce640 1 --2- 172.21.15.120:0/3992171509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c5c1069c0 0x7f8c5c19cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:19:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.476+0000 7f8c610cd640 1 --2- 172.21.15.120:0/3992171509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c5c1009b0 0x7f8c5c198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:19:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.476+0000 7f8c608cc640 1 --2- 172.21.15.120:0/3992171509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c5c101350 0x7f8c5c198790 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800c920 tx=0x7f8c5800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.476+0000 7f8c527fc640 1 -- 172.21.15.120:0/3992171509 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58007c70 con 0x7f8c5c101350 2024-09-19T05:19:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.476+0000 7f8c527fc640 1 -- 172.21.15.120:0/3992171509 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8c58007e10 con 0x7f8c5c101350 2024-09-19T05:19:53.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.476+0000 7f8c527fc640 1 -- 172.21.15.120:0/3992171509 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58018820 con 0x7f8c5c101350 2024-09-19T05:19:53.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.476+0000 7f8c63331640 1 -- 172.21.15.120:0/3992171509 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c5c19d530 con 0x7f8c5c101350 2024-09-19T05:19:53.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.476+0000 7f8c63331640 1 -- 172.21.15.120:0/3992171509 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c5c1a4dc0 con 0x7f8c5c101350 2024-09-19T05:19:53.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.479+0000 7f8c527fc640 1 -- 172.21.15.120:0/3992171509 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f8c580189c0 con 0x7f8c5c101350 2024-09-19T05:19:53.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.479+0000 7f8c660cd740 1 Processor -- start 2024-09-19T05:19:53.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.479+0000 7f8c660cd740 1 -- start start 2024-09-19T05:19:53.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.479+0000 7f8c660cd740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633253d7f00 0x5633253d82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:53.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.479+0000 7f8c660cd740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5633253d8820 0x5633253e2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:53.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.479+0000 7f8c660cd740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253e30c0 0x5633253e54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:53.489 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.479+0000 7f8c660cd740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5633253382f0 con 0x5633253e30c0 2024-09-19T05:19:53.490 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.479+0000 7f8c660cd740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5633252e0270 con 0x5633253d8820 2024-09-19T05:19:53.490 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.479+0000 7f8c660cd740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5633253342b0 con 0x5633253d7f00 2024-09-19T05:19:53.490 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.480+0000 7f8c608cc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253e30c0 0x5633253e54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:53.490 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.480+0000 7f8c610cd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5633253d8820 0x5633253e2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:53.490 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.480+0000 7f8c610cd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5633253d8820 0x5633253e2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:52630/0 (socket says 172.21.15.120:52630) 2024-09-19T05:19:53.490 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.480+0000 7f8c608cc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253e30c0 0x5633253e54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35862/0 (socket says 172.21.15.120:35862) 2024-09-19T05:19:53.490 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.480+0000 7f8c610cd640 1 -- 172.21.15.120:0/2894708278 learned_addr learned my addr 172.21.15.120:0/2894708278 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:53.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.480+0000 7f8c618ce640 1 --2- 172.21.15.120:0/2894708278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633253d7f00 0x5633253d82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:53.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.480+0000 7f8c527fc640 1 --2- 172.21.15.120:0/3992171509 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f8c480a3580 0x7f8c480a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:53.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.480+0000 7f8c618ce640 1 --2- 172.21.15.120:0/3992171509 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f8c480a3580 0x7f8c480a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:53.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.480+0000 7f8c527fc640 1 -- 172.21.15.120:0/3992171509 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f8c580d0090 con 0x7f8c5c101350 2024-09-19T05:19:53.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.480+0000 7f8c610cd640 1 -- 172.21.15.120:0/2894708278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633253d7f00 msgr2=0x5633253d82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:53.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.480+0000 7f8c610cd640 1 --2- 172.21.15.120:0/2894708278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633253d7f00 0x5633253d82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.480+0000 7f8c610cd640 1 -- 172.21.15.120:0/2894708278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253e30c0 msgr2=0x5633253e54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:53.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.480+0000 7f8c610cd640 1 --2- 172.21.15.120:0/2894708278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253e30c0 0x5633253e54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.480+0000 7f8c610cd640 1 -- 172.21.15.120:0/2894708278 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633252df340 con 0x5633253d8820 2024-09-19T05:19:53.491 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.480+0000 7f8c608cc640 1 --2- 172.21.15.120:0/2894708278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253e30c0 0x5633253e54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:19:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.480+0000 7f8c618ce640 1 --2- 172.21.15.120:0/3992171509 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f8c480a3580 0x7f8c480a5a40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c54005fd0 tx=0x7f8c54004ab0 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.480+0000 7f8c610cd640 1 --2- 172.21.15.120:0/2894708278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5633253d8820 0x5633253e2b80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c031440 tx=0x7f8c4c032e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17930b3a0f404699 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.481+0000 7f8c477fe640 1 -- 172.21.15.120:0/2894708278 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c03f070 con 0x5633253d8820 2024-09-19T05:19:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.481+0000 7f8c477fe640 1 -- 172.21.15.120:0/2894708278 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8c4c031760 con 0x5633253d8820 2024-09-19T05:19:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.481+0000 7f8c477fe640 1 -- 172.21.15.120:0/2894708278 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c035070 con 0x5633253d8820 2024-09-19T05:19:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.481+0000 7f8c660cd740 1 -- 172.21.15.120:0/2894708278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5633253d8820 msgr2=0x5633253e2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.481+0000 7f8c660cd740 1 --2- 172.21.15.120:0/2894708278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5633253d8820 0x5633253e2b80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c031440 tx=0x7f8c4c032e70 comp rx=0 tx=0).stop 2024-09-19T05:19:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.481+0000 7f8c660cd740 1 -- 172.21.15.120:0/2894708278 shutdown_connections 2024-09-19T05:19:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.481+0000 7f8c660cd740 1 --2- 172.21.15.120:0/2894708278 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253e30c0 0x5633253e54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.481+0000 7f8c660cd740 1 --2- 172.21.15.120:0/2894708278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5633253d8820 0x5633253e2b80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.481+0000 7f8c660cd740 1 --2- 172.21.15.120:0/2894708278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633253d7f00 0x5633253d82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.481+0000 7f8c660cd740 1 -- 172.21.15.120:0/2894708278 >> 172.21.15.120:0/2894708278 conn(0x5633253d4470 msgr2=0x5633253d4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:53.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.481+0000 7f8c660cd740 1 -- 172.21.15.120:0/2894708278 shutdown_connections 2024-09-19T05:19:53.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.481+0000 7f8c660cd740 1 -- 172.21.15.120:0/2894708278 wait complete. 2024-09-19T05:19:53.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.482+0000 7f8c660cd740 1 -- start start 2024-09-19T05:19:53.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.482+0000 7f8c660cd740 1 Processor -- start 2024-09-19T05:19:53.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.482+0000 7f8c660cd740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5633253d7f00 0x5633253dff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:53.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.482+0000 7f8c660cd740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253d8820 0x5633253e04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:53.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.482+0000 7f8c660cd740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633253e30c0 0x5633253e09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:53.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.482+0000 7f8c660cd740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5633253e5c90 con 0x5633253d8820 2024-09-19T05:19:53.493 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.482+0000 7f8c660cd740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5633252c1290 con 0x5633253d7f00 2024-09-19T05:19:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.482+0000 7f8c660cd740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5633253e5e10 con 0x5633253e30c0 2024-09-19T05:19:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.482+0000 7f8c660cd740 10 client.0 _ll_register_callbacks cb 0x5633252f2140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:19:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.482+0000 7f8c608cc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253d8820 0x5633253e04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.482+0000 7f8c608cc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253d8820 0x5633253e04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35870/0 (socket says 172.21.15.120:35870) 2024-09-19T05:19:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.482+0000 7f8c608cc640 1 -- 172.21.15.120:0/3848298960 learned_addr learned my addr 172.21.15.120:0/3848298960 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.482+0000 7f8c610cd640 1 --2- 172.21.15.120:0/3848298960 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5633253d7f00 0x5633253dff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.483+0000 7f8c618ce640 1 --2- 172.21.15.120:0/3848298960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633253e30c0 0x5633253e09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.483+0000 7f8c608cc640 1 -- 172.21.15.120:0/3848298960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633253e30c0 msgr2=0x5633253e09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.483+0000 7f8c608cc640 1 --2- 172.21.15.120:0/3848298960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633253e30c0 0x5633253e09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.483+0000 7f8c608cc640 1 -- 172.21.15.120:0/3848298960 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5633253d7f00 msgr2=0x5633253dff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.483+0000 7f8c608cc640 1 --2- 172.21.15.120:0/3848298960 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5633253d7f00 0x5633253dff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.483+0000 7f8c608cc640 1 -- 172.21.15.120:0/3848298960 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56332504b210 con 0x5633253d8820 2024-09-19T05:19:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.483+0000 7f8c618ce640 1 --2- 172.21.15.120:0/3848298960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633253e30c0 0x5633253e09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:19:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.483+0000 7f8c610cd640 1 --2- 172.21.15.120:0/3848298960 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5633253d7f00 0x5633253dff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:19:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.483+0000 7f8c608cc640 1 --2- 172.21.15.120:0/3848298960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253d8820 0x5633253e04a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8c580cd760 tx=0x7f8c5800a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff74941eff828621 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.483+0000 7f8c44ff9640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:19:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.483+0000 7f8c44ff9640 1 -- 172.21.15.120:0/3848298960 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c580bc2b0 con 0x5633253d8820 2024-09-19T05:19:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.483+0000 7f8c44ff9640 1 -- 172.21.15.120:0/3848298960 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f8c580cd980 con 0x5633253d8820 2024-09-19T05:19:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.483+0000 7f8c660cd740 1 -- 172.21.15.120:0/3848298960 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c4c031760 con 0x5633253d8820 2024-09-19T05:19:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.483+0000 7f8c44ff9640 1 -- 172.21.15.120:0/3848298960 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8c5800fb00 con 0x5633253d8820 2024-09-19T05:19:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.483+0000 7f8c660cd740 10 client.15378 fetch_fsmap learned FSMap version 25 2024-09-19T05:19:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.483+0000 7f8c660cd740 1 -- 172.21.15.120:0/3848298960 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563325117620 con 0x5633253d8820 2024-09-19T05:19:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.483+0000 7f8c44ff9640 1 -- 172.21.15.120:0/3848298960 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8c4c031760 con 0x5633253d8820 2024-09-19T05:19:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.484+0000 7f8c44ff9640 1 -- 172.21.15.120:0/3848298960 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8c580a0120 con 0x5633253d8820 2024-09-19T05:19:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.484+0000 7f8c660cd740 10 client.15378 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:19:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.484+0000 7f8c660cd740 10 client.15378 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:19:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.484+0000 7f8c660cd740 20 client.15378 populate_metadata read hostname 'smithi120' 2024-09-19T05:19:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.484+0000 7f8c660cd740 1 --2- 172.21.15.120:0/3848298960 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5633253f2fe0 0x5633253f53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.484+0000 7f8c660cd740 4 client.15378 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:19:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.484+0000 7f8c660cd740 1 -- 172.21.15.120:0/3848298960 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563325345a20 con 0x5633253f2fe0 2024-09-19T05:19:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.484+0000 7f8c610cd640 1 --2- 172.21.15.120:0/3848298960 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5633253f2fe0 0x5633253f53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.484+0000 7f8c44ff9640 10 client.15378 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:19:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.484+0000 7f8c610cd640 1 --2- 172.21.15.120:0/3848298960 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5633253f2fe0 0x5633253f53d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50f90455d5349c84 server_cookie=58e1ee054e1d419 in_seq=0 out_seq=0 2024-09-19T05:19:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.485+0000 7f8c44ff9640 1 -- 172.21.15.120:0/3848298960 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563325345a20 con 0x5633253f2fe0 2024-09-19T05:19:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.485+0000 7f8c44ff9640 10 client.15378 handle_command_reply: tid=0 2024-09-19T05:19:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.485+0000 7f8c660cd740 1 client.15378 shutdown 2024-09-19T05:19:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.485+0000 7f8c660cd740 1 -- 172.21.15.120:0/3848298960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253d8820 msgr2=0x5633253e04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.485+0000 7f8c660cd740 1 --2- 172.21.15.120:0/3848298960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253d8820 0x5633253e04a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8c580cd760 tx=0x7f8c5800a560 comp rx=0 tx=0).stop 2024-09-19T05:19:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.485+0000 7f8c660cd740 1 -- 172.21.15.120:0/3848298960 shutdown_connections 2024-09-19T05:19:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.485+0000 7f8c660cd740 1 --2- 172.21.15.120:0/3848298960 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5633253f2fe0 0x5633253f53d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.485+0000 7f8c660cd740 1 --2- 172.21.15.120:0/3848298960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633253e30c0 0x5633253e09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.485+0000 7f8c660cd740 1 --2- 172.21.15.120:0/3848298960 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253d8820 0x5633253e04a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.485+0000 7f8c44ff9640 0 client.15378 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:19:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.485+0000 7f8c660cd740 1 --2- 172.21.15.120:0/3848298960 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5633253d7f00 0x5633253dff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.485+0000 7f8c660cd740 1 -- 172.21.15.120:0/3848298960 >> 172.21.15.120:0/3848298960 conn(0x5633253d4470 msgr2=0x5633253cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.485+0000 7f8c660cd740 1 -- 172.21.15.120:0/3848298960 shutdown_connections 2024-09-19T05:19:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.485+0000 7f8c660cd740 1 -- 172.21.15.120:0/3848298960 wait complete. 2024-09-19T05:19:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.486+0000 7f8c660cd740 20 client.15378 trim_cache size 0 max 16384 2024-09-19T05:19:53.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.499+0000 7f8c660cd740 1 Processor -- start 2024-09-19T05:19:53.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.500+0000 7f8c660cd740 1 -- start start 2024-09-19T05:19:53.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.500+0000 7f8c660cd740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253d7f00 0x5633253facc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.500+0000 7f8c660cd740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5633253d8820 0x5633253fb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.500+0000 7f8c660cd740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633253e30c0 0x5633253dd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.500+0000 7f8c660cd740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c1adda0 con 0x5633253d7f00 2024-09-19T05:19:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.500+0000 7f8c660cd740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c1ab670 con 0x5633253d8820 2024-09-19T05:19:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.500+0000 7f8c660cd740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c1a94c0 con 0x5633253e30c0 2024-09-19T05:19:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.500+0000 7f8c610cd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253d7f00 0x5633253facc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.500+0000 7f8c610cd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253d7f00 0x5633253facc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35874/0 (socket says 172.21.15.120:35874) 2024-09-19T05:19:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.500+0000 7f8c610cd640 1 -- 172.21.15.120:0/3331155165 learned_addr learned my addr 172.21.15.120:0/3331155165 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.500+0000 7f8c618ce640 1 --2- 172.21.15.120:0/3331155165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633253e30c0 0x5633253dd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.500+0000 7f8c608cc640 1 --2- 172.21.15.120:0/3331155165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5633253d8820 0x5633253fb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.500+0000 7f8c610cd640 1 -- 172.21.15.120:0/3331155165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633253e30c0 msgr2=0x5633253dd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.500+0000 7f8c610cd640 1 --2- 172.21.15.120:0/3331155165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633253e30c0 0x5633253dd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.500+0000 7f8c610cd640 1 -- 172.21.15.120:0/3331155165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5633253d8820 msgr2=0x5633253fb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.500+0000 7f8c610cd640 1 --2- 172.21.15.120:0/3331155165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5633253d8820 0x5633253fb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.500+0000 7f8c610cd640 1 -- 172.21.15.120:0/3331155165 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633253d8650 con 0x5633253d7f00 2024-09-19T05:19:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.500+0000 7f8c610cd640 1 --2- 172.21.15.120:0/3331155165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253d7f00 0x5633253facc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c005ec0 tx=0x7f8c4c02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0923c547f2c600 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.501+0000 7f8c46ffd640 1 -- 172.21.15.120:0/3331155165 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c03f040 con 0x5633253d7f00 2024-09-19T05:19:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.501+0000 7f8c46ffd640 1 -- 172.21.15.120:0/3331155165 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8c4c031680 con 0x5633253d7f00 2024-09-19T05:19:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.501+0000 7f8c46ffd640 1 -- 172.21.15.120:0/3331155165 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c035040 con 0x5633253d7f00 2024-09-19T05:19:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.501+0000 7f8c660cd740 1 -- 172.21.15.120:0/3331155165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253d7f00 msgr2=0x5633253facc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.501+0000 7f8c660cd740 1 --2- 172.21.15.120:0/3331155165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253d7f00 0x5633253facc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c005ec0 tx=0x7f8c4c02a420 comp rx=0 tx=0).stop 2024-09-19T05:19:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.501+0000 7f8c660cd740 1 -- 172.21.15.120:0/3331155165 shutdown_connections 2024-09-19T05:19:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.501+0000 7f8c660cd740 1 --2- 172.21.15.120:0/3331155165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633253e30c0 0x5633253dd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.501+0000 7f8c660cd740 1 --2- 172.21.15.120:0/3331155165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5633253d8820 0x5633253fb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.501+0000 7f8c660cd740 1 --2- 172.21.15.120:0/3331155165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253d7f00 0x5633253facc0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.501+0000 7f8c660cd740 1 -- 172.21.15.120:0/3331155165 >> 172.21.15.120:0/3331155165 conn(0x5633253d4470 msgr2=0x5633253e1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.501+0000 7f8c660cd740 1 -- 172.21.15.120:0/3331155165 shutdown_connections 2024-09-19T05:19:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.501+0000 7f8c660cd740 1 -- 172.21.15.120:0/3331155165 wait complete. 2024-09-19T05:19:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.502+0000 7f8c660cd740 1 -- start start 2024-09-19T05:19:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.502+0000 7f8c660cd740 1 Processor -- start 2024-09-19T05:19:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.502+0000 7f8c660cd740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633253d7f00 0x5633253eb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.502+0000 7f8c660cd740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253d8820 0x5633253eb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.502+0000 7f8c660cd740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5633253e30c0 0x5633253e6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.502+0000 7f8c660cd740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c1a9b30 con 0x5633253d8820 2024-09-19T05:19:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.502+0000 7f8c660cd740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c1aafa0 con 0x5633253e30c0 2024-09-19T05:19:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.502+0000 7f8c660cd740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5c1aa200 con 0x5633253d7f00 2024-09-19T05:19:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.502+0000 7f8c660cd740 10 client.0 _ll_register_callbacks cb 0x7f8c5800c870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:19:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.502+0000 7f8c608cc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253d8820 0x5633253eb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:53.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.502+0000 7f8c608cc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253d8820 0x5633253eb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35876/0 (socket says 172.21.15.120:35876) 2024-09-19T05:19:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.502+0000 7f8c608cc640 1 -- 172.21.15.120:0/328564066 learned_addr learned my addr 172.21.15.120:0/328564066 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.502+0000 7f8c618ce640 1 --2- 172.21.15.120:0/328564066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5633253e30c0 0x5633253e6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.503+0000 7f8c608cc640 1 -- 172.21.15.120:0/328564066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633253d7f00 msgr2=0x5633253eb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.503+0000 7f8c610cd640 1 --2- 172.21.15.120:0/328564066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633253d7f00 0x5633253eb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.503+0000 7f8c608cc640 1 --2- 172.21.15.120:0/328564066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633253d7f00 0x5633253eb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.503+0000 7f8c608cc640 1 -- 172.21.15.120:0/328564066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5633253e30c0 msgr2=0x5633253e6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.503+0000 7f8c608cc640 1 --2- 172.21.15.120:0/328564066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5633253e30c0 0x5633253e6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.503+0000 7f8c608cc640 1 -- 172.21.15.120:0/328564066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633253ebce0 con 0x5633253d8820 2024-09-19T05:19:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.503+0000 7f8c608cc640 1 --2- 172.21.15.120:0/328564066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253d8820 0x5633253eb5f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8c580cdd90 tx=0x7f8c58007730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88050000607498b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.503+0000 7f8c44ff9640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:19:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.503+0000 7f8c44ff9640 1 -- 172.21.15.120:0/328564066 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58098450 con 0x5633253d8820 2024-09-19T05:19:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.503+0000 7f8c44ff9640 1 -- 172.21.15.120:0/328564066 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f8c5809b600 con 0x5633253d8820 2024-09-19T05:19:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.503+0000 7f8c660cd740 1 -- 172.21.15.120:0/328564066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c4c031680 con 0x5633253d8820 2024-09-19T05:19:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.503+0000 7f8c44ff9640 1 -- 172.21.15.120:0/328564066 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8c580cdb80 con 0x5633253d8820 2024-09-19T05:19:53.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.503+0000 7f8c660cd740 10 client.15384 fetch_fsmap learned FSMap version 25 2024-09-19T05:19:53.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.503+0000 7f8c660cd740 1 -- 172.21.15.120:0/328564066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56332545e2a0 con 0x5633253d8820 2024-09-19T05:19:53.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.503+0000 7f8c44ff9640 1 -- 172.21.15.120:0/328564066 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8c4c031680 con 0x5633253d8820 2024-09-19T05:19:53.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.503+0000 7f8c44ff9640 1 -- 172.21.15.120:0/328564066 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8c5809b070 con 0x5633253d8820 2024-09-19T05:19:53.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.503+0000 7f8c660cd740 10 client.15384 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:19:53.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.503+0000 7f8c660cd740 10 client.15384 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:19:53.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.503+0000 7f8c660cd740 20 client.15384 populate_metadata read hostname 'smithi120' 2024-09-19T05:19:53.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.503+0000 7f8c660cd740 1 --2- 172.21.15.120:0/328564066 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56332545ea20 0x563325460e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:53.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.503+0000 7f8c660cd740 4 client.15384 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:19:53.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.503+0000 7f8c660cd740 1 -- 172.21.15.120:0/328564066 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56332533fd70 con 0x56332545ea20 2024-09-19T05:19:53.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.504+0000 7f8c610cd640 1 --2- 172.21.15.120:0/328564066 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56332545ea20 0x563325460e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:53.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.504+0000 7f8c610cd640 1 --2- 172.21.15.120:0/328564066 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56332545ea20 0x563325460e40 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f81709738082234 server_cookie=38e51223aa806811 in_seq=0 out_seq=0 2024-09-19T05:19:53.510 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.504+0000 7f8c44ff9640 10 client.15384 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:19:53.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.507+0000 7f8c44ff9640 1 -- 172.21.15.120:0/328564066 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56332533fd70 con 0x56332545ea20 2024-09-19T05:19:53.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.507+0000 7f8c44ff9640 10 client.15384 handle_command_reply: tid=0 2024-09-19T05:19:53.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.507+0000 7f8c660cd740 1 client.15384 shutdown 2024-09-19T05:19:53.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.508+0000 7f8c660cd740 1 -- 172.21.15.120:0/328564066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253d8820 msgr2=0x5633253eb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:53.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.508+0000 7f8c660cd740 1 --2- 172.21.15.120:0/328564066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253d8820 0x5633253eb5f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8c580cdd90 tx=0x7f8c58007730 comp rx=0 tx=0).stop 2024-09-19T05:19:53.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.508+0000 7f8c660cd740 1 -- 172.21.15.120:0/328564066 shutdown_connections 2024-09-19T05:19:53.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.508+0000 7f8c660cd740 1 --2- 172.21.15.120:0/328564066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5633253e30c0 0x5633253e6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.508+0000 7f8c660cd740 1 --2- 172.21.15.120:0/328564066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5633253d8820 0x5633253eb5f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.508+0000 7f8c660cd740 1 --2- 172.21.15.120:0/328564066 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56332545ea20 0x563325460e40 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.508+0000 7f8c660cd740 1 --2- 172.21.15.120:0/328564066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633253d7f00 0x5633253eb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.508+0000 7f8c44ff9640 0 client.15384 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:19:53.512 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.508+0000 7f8c660cd740 1 -- 172.21.15.120:0/328564066 >> 172.21.15.120:0/328564066 conn(0x5633253d4470 msgr2=0x5633253dff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.508+0000 7f8c660cd740 1 -- 172.21.15.120:0/328564066 shutdown_connections 2024-09-19T05:19:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.508+0000 7f8c660cd740 1 -- 172.21.15.120:0/328564066 wait complete. 2024-09-19T05:19:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.508+0000 7f8c660cd740 20 client.15384 trim_cache size 0 max 16384 2024-09-19T05:19:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:19:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:19:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:19:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:19:53.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.508+0000 7f8c63331640 1 -- 172.21.15.120:0/3992171509 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f8c480a3580 msgr2=0x7f8c480a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:53.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.508+0000 7f8c63331640 1 --2- 172.21.15.120:0/3992171509 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f8c480a3580 0x7f8c480a5a40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c54005fd0 tx=0x7f8c54004ab0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.508+0000 7f8c63331640 1 -- 172.21.15.120:0/3992171509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c5c101350 msgr2=0x7f8c5c198790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:53.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.508+0000 7f8c63331640 1 --2- 172.21.15.120:0/3992171509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c5c101350 0x7f8c5c198790 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800c920 tx=0x7f8c5800cde0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.508+0000 7f8c63331640 1 -- 172.21.15.120:0/3992171509 shutdown_connections 2024-09-19T05:19:53.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.508+0000 7f8c63331640 1 --2- 172.21.15.120:0/3992171509 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f8c480a3580 0x7f8c480a5a40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.508+0000 7f8c63331640 1 --2- 172.21.15.120:0/3992171509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c5c1069c0 0x7f8c5c19cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.508+0000 7f8c63331640 1 --2- 172.21.15.120:0/3992171509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8c5c101350 0x7f8c5c198790 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.508+0000 7f8c63331640 1 --2- 172.21.15.120:0/3992171509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c5c1009b0 0x7f8c5c198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:53.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.508+0000 7f8c63331640 1 -- 172.21.15.120:0/3992171509 >> 172.21.15.120:0/3992171509 conn(0x7f8c5c077990 msgr2=0x7f8c5c0699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:53.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.508+0000 7f8c63331640 1 -- 172.21.15.120:0/3992171509 shutdown_connections 2024-09-19T05:19:53.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:19:53.509+0000 7f8c63331640 1 -- 172.21.15.120:0/3992171509 wait complete. 2024-09-19T05:19:54.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:54 smithi178 ceph-mon[34347]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-19T05:19:54.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:54 smithi120 ceph-mon[30956]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-19T05:19:54.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:54 smithi194 ceph-mon[35228]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-19T05:19:56.677 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:56 smithi120 ceph-mon[30956]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-19T05:19:56.691 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:56 smithi178 ceph-mon[34347]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-19T05:19:56.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:56 smithi194 ceph-mon[35228]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-09-19T05:19:57.900 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T05:19:58.186 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:19:58.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:19:58 smithi120 ceph-mon[30956]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T05:19:58.691 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:19:58 smithi178 ceph-mon[34347]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T05:19:58.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.749+0000 7f4ebca69640 1 -- 172.21.15.120:0/1922733626 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4eb8100e20 msgr2=0x7f4eb8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:58.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.749+0000 7f4ebca69640 1 --2- 172.21.15.120:0/1922733626 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4eb8100e20 0x7f4eb8101200 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009900 tx=0x7f4ea802a480 comp rx=0 tx=0).stop 2024-09-19T05:19:58.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.749+0000 7f4ebca69640 1 -- 172.21.15.120:0/1922733626 shutdown_connections 2024-09-19T05:19:58.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.749+0000 7f4ebca69640 1 --2- 172.21.15.120:0/1922733626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4eb8102ef0 0x7f4eb810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.750+0000 7f4ebca69640 1 --2- 172.21.15.120:0/1922733626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4eb8102570 0x7f4eb81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.750+0000 7f4ebca69640 1 --2- 172.21.15.120:0/1922733626 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4eb8100e20 0x7f4eb8101200 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.750+0000 7f4ebca69640 1 -- 172.21.15.120:0/1922733626 >> 172.21.15.120:0/1922733626 conn(0x7f4eb80fc7d0 msgr2=0x7f4eb80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:58.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.750+0000 7f4ebca69640 1 -- 172.21.15.120:0/1922733626 shutdown_connections 2024-09-19T05:19:58.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.750+0000 7f4ebca69640 1 -- 172.21.15.120:0/1922733626 wait complete. 2024-09-19T05:19:58.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.751+0000 7f4ebca69640 1 Processor -- start 2024-09-19T05:19:58.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.751+0000 7f4ebca69640 1 -- start start 2024-09-19T05:19:58.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.751+0000 7f4ebca69640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4eb8100e20 0x7f4eb81983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:58.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.751+0000 7f4eb659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4eb8100e20 0x7f4eb81983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:58.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.751+0000 7f4eb659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4eb8100e20 0x7f4eb81983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55868/0 (socket says 172.21.15.120:55868) 2024-09-19T05:19:58.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.751+0000 7f4ebca69640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4eb8102570 0x7f4eb81988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:58.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.751+0000 7f4eb659c640 1 -- 172.21.15.120:0/982997485 learned_addr learned my addr 172.21.15.120:0/982997485 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:58.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.751+0000 7f4ebca69640 1 --2- 172.21.15.120:0/982997485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4eb8102ef0 0x7f4eb819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:58.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.752+0000 7f4ebca69640 1 -- 172.21.15.120:0/982997485 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb8110e30 con 0x7f4eb8100e20 2024-09-19T05:19:58.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.752+0000 7f4eb5d9b640 1 --2- 172.21.15.120:0/982997485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4eb8102570 0x7f4eb81988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:58.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.752+0000 7f4ebca69640 1 -- 172.21.15.120:0/982997485 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb8110cb0 con 0x7f4eb8102570 2024-09-19T05:19:58.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.752+0000 7f4ebca69640 1 -- 172.21.15.120:0/982997485 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb8110fb0 con 0x7f4eb8102ef0 2024-09-19T05:19:58.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.752+0000 7f4eb6d9d640 1 --2- 172.21.15.120:0/982997485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4eb8102ef0 0x7f4eb819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:58.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.752+0000 7f4eb5d9b640 1 -- 172.21.15.120:0/982997485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4eb8102ef0 msgr2=0x7f4eb819cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:58.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.752+0000 7f4eb5d9b640 1 --2- 172.21.15.120:0/982997485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4eb8102ef0 0x7f4eb819cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.752+0000 7f4eb5d9b640 1 -- 172.21.15.120:0/982997485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4eb8100e20 msgr2=0x7f4eb81983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:58.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.752+0000 7f4eb5d9b640 1 --2- 172.21.15.120:0/982997485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4eb8100e20 0x7f4eb81983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.752+0000 7f4eb5d9b640 1 -- 172.21.15.120:0/982997485 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb819d360 con 0x7f4eb8102570 2024-09-19T05:19:58.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.752+0000 7f4eb659c640 1 --2- 172.21.15.120:0/982997485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4eb8100e20 0x7f4eb81983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:19:58.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.753+0000 7f4eb5d9b640 1 --2- 172.21.15.120:0/982997485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4eb8102570 0x7f4eb81988f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4eac009bc0 tx=0x7f4eac00b690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:58.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.753+0000 7f4ea77fe640 1 -- 172.21.15.120:0/982997485 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eac01e070 con 0x7f4eb8102570 2024-09-19T05:19:58.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.753+0000 7f4ea77fe640 1 -- 172.21.15.120:0/982997485 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4eac0198c0 con 0x7f4eb8102570 2024-09-19T05:19:58.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.753+0000 7f4ea77fe640 1 -- 172.21.15.120:0/982997485 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eac018730 con 0x7f4eb8102570 2024-09-19T05:19:58.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.753+0000 7f4ebca69640 1 -- 172.21.15.120:0/982997485 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eb819d650 con 0x7f4eb8102570 2024-09-19T05:19:58.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.754+0000 7f4ebca69640 1 -- 172.21.15.120:0/982997485 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eb8103680 con 0x7f4eb8102570 2024-09-19T05:19:58.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.756+0000 7f4ea77fe640 1 -- 172.21.15.120:0/982997485 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f4eac021070 con 0x7f4eb8102570 2024-09-19T05:19:58.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.756+0000 7f4ea77fe640 1 --2- 172.21.15.120:0/982997485 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f4ea00a3610 0x7f4ea00a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:58.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.757+0000 7f4ea77fe640 1 -- 172.21.15.120:0/982997485 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f4eac0cf970 con 0x7f4eb8102570 2024-09-19T05:19:58.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.757+0000 7f4eb659c640 1 --2- 172.21.15.120:0/982997485 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f4ea00a3610 0x7f4ea00a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:58.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.757+0000 7f4ebee42740 1 Processor -- start 2024-09-19T05:19:58.761 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.757+0000 7f4ebee42740 1 -- start start 2024-09-19T05:19:58.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.757+0000 7f4ebee42740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a9284a0 0x55608a928880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:58.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.757+0000 7f4ebee42740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55608a928dc0 0x55608a933140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:58.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.757+0000 7f4ebee42740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55608a933680 0x55608a935a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:58.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.757+0000 7f4ebee42740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55608a88e2e0 con 0x55608a928dc0 2024-09-19T05:19:58.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.757+0000 7f4ebee42740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55608a835ce0 con 0x55608a9284a0 2024-09-19T05:19:58.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.757+0000 7f4ebee42740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55608a88a2a0 con 0x55608a933680 2024-09-19T05:19:58.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.758+0000 7f4eb659c640 1 --2- 172.21.15.120:0/982997485 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f4ea00a3610 0x7f4ea00a5ad0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80096c0 tx=0x7f4ea8005a20 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:58.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.758+0000 7f4eb659c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a9284a0 0x55608a928880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:58.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.758+0000 7f4eb659c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a9284a0 0x55608a928880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:37092/0 (socket says 172.21.15.120:37092) 2024-09-19T05:19:58.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.758+0000 7f4eb659c640 1 -- 172.21.15.120:0/2372365130 learned_addr learned my addr 172.21.15.120:0/2372365130 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:58.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.758+0000 7f4eb5d9b640 1 --2- 172.21.15.120:0/2372365130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55608a928dc0 0x55608a933140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:58.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.758+0000 7f4eb6d9d640 1 --2- 172.21.15.120:0/2372365130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55608a933680 0x55608a935a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:58.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.758+0000 7f4eb659c640 1 -- 172.21.15.120:0/2372365130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55608a933680 msgr2=0x55608a935a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:58.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.758+0000 7f4eb659c640 1 --2- 172.21.15.120:0/2372365130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55608a933680 0x55608a935a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.758+0000 7f4eb659c640 1 -- 172.21.15.120:0/2372365130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55608a928dc0 msgr2=0x55608a933140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:58.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.758+0000 7f4eb659c640 1 --2- 172.21.15.120:0/2372365130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55608a928dc0 0x55608a933140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.758+0000 7f4eb659c640 1 -- 172.21.15.120:0/2372365130 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55608a81a440 con 0x55608a9284a0 2024-09-19T05:19:58.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.758+0000 7f4eb659c640 1 --2- 172.21.15.120:0/2372365130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a9284a0 0x55608a928880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009a20 tx=0x7f4ea803d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5d08e5c672595fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:58.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.759+0000 7f4ea4ff9640 1 -- 172.21.15.120:0/2372365130 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea804d070 con 0x55608a9284a0 2024-09-19T05:19:58.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.759+0000 7f4ea4ff9640 1 -- 172.21.15.120:0/2372365130 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4ea8004760 con 0x55608a9284a0 2024-09-19T05:19:58.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.759+0000 7f4ea4ff9640 1 -- 172.21.15.120:0/2372365130 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8035040 con 0x55608a9284a0 2024-09-19T05:19:58.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.760+0000 7f4ebee42740 1 -- 172.21.15.120:0/2372365130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a9284a0 msgr2=0x55608a928880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:58.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.760+0000 7f4ebee42740 1 --2- 172.21.15.120:0/2372365130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a9284a0 0x55608a928880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009a20 tx=0x7f4ea803d000 comp rx=0 tx=0).stop 2024-09-19T05:19:58.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.760+0000 7f4ebee42740 1 -- 172.21.15.120:0/2372365130 shutdown_connections 2024-09-19T05:19:58.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.760+0000 7f4ebee42740 1 --2- 172.21.15.120:0/2372365130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55608a933680 0x55608a935a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.768 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.760+0000 7f4ebee42740 1 --2- 172.21.15.120:0/2372365130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55608a928dc0 0x55608a933140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.760+0000 7f4ebee42740 1 --2- 172.21.15.120:0/2372365130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a9284a0 0x55608a928880 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.760+0000 7f4ebee42740 1 -- 172.21.15.120:0/2372365130 >> 172.21.15.120:0/2372365130 conn(0x55608a924a30 msgr2=0x55608a924e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:58.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.760+0000 7f4ebee42740 1 -- 172.21.15.120:0/2372365130 shutdown_connections 2024-09-19T05:19:58.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.760+0000 7f4ebee42740 1 -- 172.21.15.120:0/2372365130 wait complete. 2024-09-19T05:19:58.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.761+0000 7f4ebee42740 1 -- start start 2024-09-19T05:19:58.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.761+0000 7f4ebee42740 1 Processor -- start 2024-09-19T05:19:58.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.761+0000 7f4ebee42740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55608a9284a0 0x55608a932f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:58.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.761+0000 7f4ebee42740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a928dc0 0x55608a930240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:58.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.761+0000 7f4ebee42740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55608a933680 0x55608a930780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:58.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.761+0000 7f4ebee42740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55608a936250 con 0x55608a9284a0 2024-09-19T05:19:58.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.761+0000 7f4ebee42740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55608a849050 con 0x55608a928dc0 2024-09-19T05:19:58.769 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.761+0000 7f4ebee42740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55608a9363d0 con 0x55608a933680 2024-09-19T05:19:58.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.761+0000 7f4ebee42740 10 client.0 _ll_register_callbacks cb 0x55608a889160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:19:58.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.761+0000 7f4eb659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55608a9284a0 0x55608a932f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:58.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.761+0000 7f4eb5d9b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a928dc0 0x55608a930240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:58.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.761+0000 7f4eb659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55608a9284a0 0x55608a932f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55878/0 (socket says 172.21.15.120:55878) 2024-09-19T05:19:58.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.761+0000 7f4eb659c640 1 -- 172.21.15.120:0/2327511624 learned_addr learned my addr 172.21.15.120:0/2327511624 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:58.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.762+0000 7f4eb6d9d640 1 --2- 172.21.15.120:0/2327511624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55608a933680 0x55608a930780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:58.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.762+0000 7f4eb5d9b640 1 -- 172.21.15.120:0/2327511624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55608a933680 msgr2=0x55608a930780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:58.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.762+0000 7f4eb5d9b640 1 --2- 172.21.15.120:0/2327511624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55608a933680 0x55608a930780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.762+0000 7f4eb5d9b640 1 -- 172.21.15.120:0/2327511624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55608a9284a0 msgr2=0x55608a932f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:58.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.762+0000 7f4eb5d9b640 1 --2- 172.21.15.120:0/2327511624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55608a9284a0 0x55608a932f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.762+0000 7f4eb5d9b640 1 -- 172.21.15.120:0/2327511624 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55608a5ff3c0 con 0x55608a928dc0 2024-09-19T05:19:58.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.762+0000 7f4eb5d9b640 1 --2- 172.21.15.120:0/2327511624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a928dc0 0x55608a930240 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4eac0ccf50 tx=0x7f4eac019e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8e5259d147ef0d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:58.770 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.762+0000 7f4e9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:19:58.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.762+0000 7f4e9dffb640 1 -- 172.21.15.120:0/2327511624 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eac0a46a0 con 0x55608a928dc0 2024-09-19T05:19:58.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.762+0000 7f4e9dffb640 1 -- 172.21.15.120:0/2327511624 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f4eac0cd200 con 0x55608a928dc0 2024-09-19T05:19:58.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.762+0000 7f4ebee42740 1 -- 172.21.15.120:0/2327511624 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ea8004760 con 0x55608a928dc0 2024-09-19T05:19:58.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.763+0000 7f4e9dffb640 1 -- 172.21.15.120:0/2327511624 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4eac0cd400 con 0x55608a928dc0 2024-09-19T05:19:58.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.763+0000 7f4ebee42740 10 client.24890 fetch_fsmap learned FSMap version 25 2024-09-19T05:19:58.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.763+0000 7f4ebee42740 1 -- 172.21.15.120:0/2327511624 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55608a941bd0 con 0x55608a928dc0 2024-09-19T05:19:58.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.763+0000 7f4e9dffb640 1 -- 172.21.15.120:0/2327511624 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4ea8004760 con 0x55608a928dc0 2024-09-19T05:19:58.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.763+0000 7f4e9dffb640 1 -- 172.21.15.120:0/2327511624 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4eac097830 con 0x55608a928dc0 2024-09-19T05:19:58.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.763+0000 7f4ebee42740 10 client.24890 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:19:58.771 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.763+0000 7f4ebee42740 10 client.24890 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:19:58.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.763+0000 7f4ebee42740 20 client.24890 populate_metadata read hostname 'smithi120' 2024-09-19T05:19:58.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.763+0000 7f4ebee42740 1 --2- 172.21.15.120:0/2327511624 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55608a942fe0 0x55608a945480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:58.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.763+0000 7f4ebee42740 4 client.24890 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:19:58.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.763+0000 7f4ebee42740 1 -- 172.21.15.120:0/2327511624 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55608a89b850 con 0x55608a942fe0 2024-09-19T05:19:58.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.763+0000 7f4eb659c640 1 --2- 172.21.15.120:0/2327511624 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55608a942fe0 0x55608a945480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:58.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.764+0000 7f4e9dffb640 10 client.24890 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:19:58.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.764+0000 7f4eb659c640 1 --2- 172.21.15.120:0/2327511624 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55608a942fe0 0x55608a945480 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2fdc3715860fc39 server_cookie=8fb074ab54b7db02 in_seq=0 out_seq=0 2024-09-19T05:19:58.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.765+0000 7f4e9dffb640 1 -- 172.21.15.120:0/2327511624 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55608a89b850 con 0x55608a942fe0 2024-09-19T05:19:58.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.765+0000 7f4e9dffb640 10 client.24890 handle_command_reply: tid=0 2024-09-19T05:19:58.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.765+0000 7f4ebee42740 1 client.24890 shutdown 2024-09-19T05:19:58.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.765+0000 7f4ebee42740 1 -- 172.21.15.120:0/2327511624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a928dc0 msgr2=0x55608a930240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:58.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.765+0000 7f4ebee42740 1 --2- 172.21.15.120:0/2327511624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a928dc0 0x55608a930240 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4eac0ccf50 tx=0x7f4eac019e00 comp rx=0 tx=0).stop 2024-09-19T05:19:58.772 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.765+0000 7f4ebee42740 1 -- 172.21.15.120:0/2327511624 shutdown_connections 2024-09-19T05:19:58.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.765+0000 7f4ebee42740 1 --2- 172.21.15.120:0/2327511624 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55608a942fe0 0x55608a945480 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.765+0000 7f4ebee42740 1 --2- 172.21.15.120:0/2327511624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55608a933680 0x55608a930780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.765+0000 7f4ebee42740 1 --2- 172.21.15.120:0/2327511624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a928dc0 0x55608a930240 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.765+0000 7f4e9dffb640 0 client.24890 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:19:58.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.765+0000 7f4ebee42740 1 --2- 172.21.15.120:0/2327511624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55608a9284a0 0x55608a932f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.765+0000 7f4ebee42740 1 -- 172.21.15.120:0/2327511624 >> 172.21.15.120:0/2327511624 conn(0x55608a924a30 msgr2=0x55608a92a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:58.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.765+0000 7f4ebee42740 1 -- 172.21.15.120:0/2327511624 shutdown_connections 2024-09-19T05:19:58.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.765+0000 7f4ebee42740 1 -- 172.21.15.120:0/2327511624 wait complete. 2024-09-19T05:19:58.773 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.765+0000 7f4ebee42740 20 client.24890 trim_cache size 0 max 16384 2024-09-19T05:19:58.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.782+0000 7f4ebee42740 1 Processor -- start 2024-09-19T05:19:58.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.782+0000 7f4ebee42740 1 -- start start 2024-09-19T05:19:58.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.782+0000 7f4ebee42740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a9284a0 0x55608a93f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:58.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.783+0000 7f4ebee42740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55608a928dc0 0x55608a94ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:58.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.783+0000 7f4ebee42740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55608a933680 0x55608a94b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:58.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.783+0000 7f4ebee42740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb81b66f0 con 0x55608a928dc0 2024-09-19T05:19:58.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.783+0000 7f4ebee42740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb81b3fc0 con 0x55608a9284a0 2024-09-19T05:19:58.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.783+0000 7f4ebee42740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb81b1e10 con 0x55608a933680 2024-09-19T05:19:58.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.783+0000 7f4eb5d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55608a928dc0 0x55608a94ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:58.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.783+0000 7f4eb659c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a9284a0 0x55608a93f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:58.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.783+0000 7f4eb659c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a9284a0 0x55608a93f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:37110/0 (socket says 172.21.15.120:37110) 2024-09-19T05:19:58.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.783+0000 7f4eb659c640 1 -- 172.21.15.120:0/1220510656 learned_addr learned my addr 172.21.15.120:0/1220510656 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:58.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.783+0000 7f4eb6d9d640 1 --2- 172.21.15.120:0/1220510656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55608a933680 0x55608a94b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:58.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.783+0000 7f4eb659c640 1 -- 172.21.15.120:0/1220510656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55608a933680 msgr2=0x55608a94b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:58.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.783+0000 7f4eb659c640 1 --2- 172.21.15.120:0/1220510656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55608a933680 0x55608a94b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.783+0000 7f4eb659c640 1 -- 172.21.15.120:0/1220510656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55608a928dc0 msgr2=0x55608a94ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:58.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.783+0000 7f4eb659c640 1 --2- 172.21.15.120:0/1220510656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55608a928dc0 0x55608a94ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.783+0000 7f4eb659c640 1 -- 172.21.15.120:0/1220510656 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55608a928290 con 0x55608a9284a0 2024-09-19T05:19:58.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.783+0000 7f4eb6d9d640 1 --2- 172.21.15.120:0/1220510656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55608a933680 0x55608a94b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:58.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.783+0000 7f4eb5d9b640 1 --2- 172.21.15.120:0/1220510656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55608a928dc0 0x55608a94ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:19:58.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.784+0000 7f4eb659c640 1 --2- 172.21.15.120:0/1220510656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a9284a0 0x55608a93f4b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8006010 tx=0x7f4ea802a480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7ad6cd836d6b79f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:58.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.784+0000 7f4e9ffff640 1 -- 172.21.15.120:0/1220510656 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8040040 con 0x55608a9284a0 2024-09-19T05:19:58.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.784+0000 7f4e9ffff640 1 -- 172.21.15.120:0/1220510656 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4ea8004c90 con 0x55608a9284a0 2024-09-19T05:19:58.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.784+0000 7f4e9ffff640 1 -- 172.21.15.120:0/1220510656 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea804d040 con 0x55608a9284a0 2024-09-19T05:19:58.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.785+0000 7f4ebee42740 1 -- 172.21.15.120:0/1220510656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a9284a0 msgr2=0x55608a93f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:58.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.785+0000 7f4ebee42740 1 --2- 172.21.15.120:0/1220510656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a9284a0 0x55608a93f4b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8006010 tx=0x7f4ea802a480 comp rx=0 tx=0).stop 2024-09-19T05:19:58.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.785+0000 7f4ebee42740 1 -- 172.21.15.120:0/1220510656 shutdown_connections 2024-09-19T05:19:58.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.785+0000 7f4ebee42740 1 --2- 172.21.15.120:0/1220510656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55608a933680 0x55608a94b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.785+0000 7f4ebee42740 1 --2- 172.21.15.120:0/1220510656 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55608a928dc0 0x55608a94ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.785+0000 7f4ebee42740 1 --2- 172.21.15.120:0/1220510656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a9284a0 0x55608a93f4b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.785+0000 7f4ebee42740 1 -- 172.21.15.120:0/1220510656 >> 172.21.15.120:0/1220510656 conn(0x55608a924a30 msgr2=0x55608a92b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:58.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.785+0000 7f4ebee42740 1 -- 172.21.15.120:0/1220510656 shutdown_connections 2024-09-19T05:19:58.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.785+0000 7f4ebee42740 1 -- 172.21.15.120:0/1220510656 wait complete. 2024-09-19T05:19:58.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.785+0000 7f4ebee42740 1 -- start start 2024-09-19T05:19:58.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.785+0000 7f4ebee42740 1 Processor -- start 2024-09-19T05:19:58.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.786+0000 7f4ebee42740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55608a9284a0 0x55608a936d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:58.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.786+0000 7f4ebee42740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55608a928dc0 0x55608a9372a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:58.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.786+0000 7f4ebee42740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a933680 0x55608a9a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:58.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.786+0000 7f4eb5d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55608a928dc0 0x55608a9372a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:58.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.786+0000 7f4eb5d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55608a928dc0 0x55608a9372a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55890/0 (socket says 172.21.15.120:55890) 2024-09-19T05:19:58.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.786+0000 7f4eb5d9b640 1 -- 172.21.15.120:0/4060627136 learned_addr learned my addr 172.21.15.120:0/4060627136 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:19:58.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.786+0000 7f4ebee42740 1 -- 172.21.15.120:0/4060627136 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb81b2480 con 0x55608a928dc0 2024-09-19T05:19:58.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.786+0000 7f4ebee42740 1 -- 172.21.15.120:0/4060627136 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb81b38f0 con 0x55608a933680 2024-09-19T05:19:58.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.786+0000 7f4ebee42740 1 -- 172.21.15.120:0/4060627136 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb81b2b50 con 0x55608a9284a0 2024-09-19T05:19:58.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.786+0000 7f4eb659c640 1 --2- 172.21.15.120:0/4060627136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55608a9284a0 0x55608a936d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:58.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.786+0000 7f4eb6d9d640 1 --2- 172.21.15.120:0/4060627136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a933680 0x55608a9a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:58.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.786+0000 7f4eb659c640 1 -- 172.21.15.120:0/4060627136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a933680 msgr2=0x55608a9a5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:58.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.786+0000 7f4eb659c640 1 --2- 172.21.15.120:0/4060627136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a933680 0x55608a9a5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.786+0000 7f4eb659c640 1 -- 172.21.15.120:0/4060627136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55608a928dc0 msgr2=0x55608a9372a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:19:58.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.786+0000 7f4eb659c640 1 --2- 172.21.15.120:0/4060627136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55608a928dc0 0x55608a9372a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.786+0000 7f4eb659c640 1 -- 172.21.15.120:0/4060627136 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55608a9a6380 con 0x55608a9284a0 2024-09-19T05:19:58.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.786+0000 7f4ebee42740 10 client.0 _ll_register_callbacks cb 0x7f4eac09b620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:19:58.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.786+0000 7f4eb6d9d640 1 --2- 172.21.15.120:0/4060627136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a933680 0x55608a9a5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:19:58.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.786+0000 7f4eb5d9b640 1 --2- 172.21.15.120:0/4060627136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55608a928dc0 0x55608a9372a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:19:58.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.787+0000 7f4ebee42740 1 -- 172.21.15.120:0/4060627136 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ea8004c90 con 0x55608a9284a0 2024-09-19T05:19:58.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.787+0000 7f4eb659c640 1 --2- 172.21.15.120:0/4060627136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55608a9284a0 0x55608a936d60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8031920 tx=0x7f4ea8005070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c287453173856b30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:19:58.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.787+0000 7f4e9dffb640 10 client.24958 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:19:58.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.787+0000 7f4e9dffb640 1 -- 172.21.15.120:0/4060627136 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea804d070 con 0x55608a9284a0 2024-09-19T05:19:58.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.787+0000 7f4e9dffb640 1 -- 172.21.15.120:0/4060627136 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f4ea80035f0 con 0x55608a9284a0 2024-09-19T05:19:58.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.787+0000 7f4e9dffb640 1 -- 172.21.15.120:0/4060627136 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4ea8035040 con 0x55608a9284a0 2024-09-19T05:19:58.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.787+0000 7f4ebee42740 10 client.24958 fetch_fsmap learned FSMap version 25 2024-09-19T05:19:58.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.787+0000 7f4ebee42740 1 -- 172.21.15.120:0/4060627136 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55608a9ad460 con 0x55608a9284a0 2024-09-19T05:19:58.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.788+0000 7f4e9dffb640 1 -- 172.21.15.120:0/4060627136 <== mon.1 v2:172.21.15.194:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4ea8003830 con 0x55608a9284a0 2024-09-19T05:19:58.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.788+0000 7f4ebee42740 10 client.24958 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:19:58.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.788+0000 7f4ebee42740 10 client.24958 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:19:58.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.788+0000 7f4ebee42740 20 client.24958 populate_metadata read hostname 'smithi120' 2024-09-19T05:19:58.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.788+0000 7f4ebee42740 1 --2- 172.21.15.120:0/4060627136 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55608a9ad460 0x55608a9af850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:19:58.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.788+0000 7f4ebee42740 4 client.24958 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:19:58.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.788+0000 7f4ebee42740 1 -- 172.21.15.120:0/4060627136 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55608a895d60 con 0x55608a9ad460 2024-09-19T05:19:58.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.788+0000 7f4eb5d9b640 1 --2- 172.21.15.120:0/4060627136 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55608a9ad460 0x55608a9af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:19:58.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.789+0000 7f4eb5d9b640 1 --2- 172.21.15.120:0/4060627136 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55608a9ad460 0x55608a9af850 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=466f3ecbc94b982b server_cookie=10a40429bd8b04dd in_seq=0 out_seq=0 2024-09-19T05:19:58.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.789+0000 7f4e9dffb640 10 client.24958 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:19:58.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.789+0000 7f4e9dffb640 1 -- 172.21.15.120:0/4060627136 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55608a895d60 con 0x55608a9ad460 2024-09-19T05:19:58.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.789+0000 7f4e9dffb640 10 client.24958 handle_command_reply: tid=0 2024-09-19T05:19:58.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.789+0000 7f4ebee42740 1 client.24958 shutdown 2024-09-19T05:19:58.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.789+0000 7f4ebee42740 1 -- 172.21.15.120:0/4060627136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55608a9284a0 msgr2=0x55608a936d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:58.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.789+0000 7f4ebee42740 1 --2- 172.21.15.120:0/4060627136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55608a9284a0 0x55608a936d60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8031920 tx=0x7f4ea8005070 comp rx=0 tx=0).stop 2024-09-19T05:19:58.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.789+0000 7f4ebee42740 1 -- 172.21.15.120:0/4060627136 shutdown_connections 2024-09-19T05:19:58.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.789+0000 7f4ebee42740 1 --2- 172.21.15.120:0/4060627136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55608a933680 0x55608a9a5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.789+0000 7f4ebee42740 1 --2- 172.21.15.120:0/4060627136 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55608a928dc0 0x55608a9372a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.789+0000 7f4ebee42740 1 --2- 172.21.15.120:0/4060627136 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55608a9ad460 0x55608a9af850 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.789+0000 7f4ebee42740 1 --2- 172.21.15.120:0/4060627136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55608a9284a0 0x55608a936d60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.789+0000 7f4e9dffb640 0 client.24958 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:19:58.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.789+0000 7f4ebee42740 1 -- 172.21.15.120:0/4060627136 >> 172.21.15.120:0/4060627136 conn(0x55608a924a30 msgr2=0x55608a931aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:58.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.790+0000 7f4ebee42740 1 -- 172.21.15.120:0/4060627136 shutdown_connections 2024-09-19T05:19:58.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.790+0000 7f4ebee42740 1 -- 172.21.15.120:0/4060627136 wait complete. 2024-09-19T05:19:58.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.790+0000 7f4ebee42740 20 client.24958 trim_cache size 0 max 16384 2024-09-19T05:19:58.797 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T05:19:58.798 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "no active scrubs running", 2024-09-19T05:19:58.798 INFO:teuthology.orchestra.run.smithi120.stdout: "scrubs": {} 2024-09-19T05:19:58.798 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T05:19:58.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.790+0000 7f4ebca69640 1 -- 172.21.15.120:0/982997485 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f4ea00a3610 msgr2=0x7f4ea00a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:58.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.790+0000 7f4ebca69640 1 --2- 172.21.15.120:0/982997485 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f4ea00a3610 0x7f4ea00a5ad0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80096c0 tx=0x7f4ea8005a20 comp rx=0 tx=0).stop 2024-09-19T05:19:58.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.791+0000 7f4ebca69640 1 -- 172.21.15.120:0/982997485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4eb8102570 msgr2=0x7f4eb81988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:19:58.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.791+0000 7f4ebca69640 1 --2- 172.21.15.120:0/982997485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4eb8102570 0x7f4eb81988f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4eac009bc0 tx=0x7f4eac00b690 comp rx=0 tx=0).stop 2024-09-19T05:19:58.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.791+0000 7f4ebca69640 1 -- 172.21.15.120:0/982997485 shutdown_connections 2024-09-19T05:19:58.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.791+0000 7f4ebca69640 1 --2- 172.21.15.120:0/982997485 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f4ea00a3610 0x7f4ea00a5ad0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.791+0000 7f4ebca69640 1 --2- 172.21.15.120:0/982997485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4eb8102ef0 0x7f4eb819cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.791+0000 7f4ebca69640 1 --2- 172.21.15.120:0/982997485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4eb8102570 0x7f4eb81988f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.799 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.791+0000 7f4ebca69640 1 --2- 172.21.15.120:0/982997485 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4eb8100e20 0x7f4eb81983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:19:58.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.791+0000 7f4ebca69640 1 -- 172.21.15.120:0/982997485 >> 172.21.15.120:0/982997485 conn(0x7f4eb80fc7d0 msgr2=0x7f4eb806a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:19:58.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.791+0000 7f4ebca69640 1 -- 172.21.15.120:0/982997485 shutdown_connections 2024-09-19T05:19:58.800 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:19:58.791+0000 7f4ebca69640 1 -- 172.21.15.120:0/982997485 wait complete. 2024-09-19T05:19:58.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:19:58 smithi194 ceph-mon[35228]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T05:19:59.588 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T05:19:59.588 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:19:59.875 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:00.307 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:00 smithi120 ceph-mon[30956]: overall HEALTH_OK 2024-09-19T05:20:00.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:00 smithi194 ceph-mon[35228]: overall HEALTH_OK 2024-09-19T05:20:00.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.411+0000 7f68b9e34640 1 -- 172.21.15.120:0/211137695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68b4102ef0 msgr2=0x7f68b410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:00.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.411+0000 7f68b9e34640 1 --2- 172.21.15.120:0/211137695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68b4102ef0 0x7f68b410da40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009ca0 tx=0x7f68ac02a950 comp rx=0 tx=0).stop 2024-09-19T05:20:00.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.411+0000 7f68b9e34640 1 -- 172.21.15.120:0/211137695 shutdown_connections 2024-09-19T05:20:00.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.411+0000 7f68b9e34640 1 --2- 172.21.15.120:0/211137695 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68b4102ef0 0x7f68b410da40 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:00.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.411+0000 7f68b9e34640 1 --2- 172.21.15.120:0/211137695 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b4102570 0x7f68b41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:00.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.411+0000 7f68b9e34640 1 --2- 172.21.15.120:0/211137695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68b4100e20 0x7f68b4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:00.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.411+0000 7f68b9e34640 1 -- 172.21.15.120:0/211137695 >> 172.21.15.120:0/211137695 conn(0x7f68b40fc7d0 msgr2=0x7f68b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:00.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.411+0000 7f68b9e34640 1 -- 172.21.15.120:0/211137695 shutdown_connections 2024-09-19T05:20:00.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.411+0000 7f68b9e34640 1 -- 172.21.15.120:0/211137695 wait complete. 2024-09-19T05:20:00.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.412+0000 7f68b9e34640 1 Processor -- start 2024-09-19T05:20:00.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.412+0000 7f68b9e34640 1 -- start start 2024-09-19T05:20:00.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.412+0000 7f68b9e34640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b4100e20 0x7f68b4199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:00.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.412+0000 7f68b9e34640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68b4102570 0x7f68b41997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:00.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.412+0000 7f68b9e34640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68b4102ef0 0x7f68b41a42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:00.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.413+0000 7f68b9e34640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f68b4110e30 con 0x7f68b4102570 2024-09-19T05:20:00.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.413+0000 7f68b9e34640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f68b4110cb0 con 0x7f68b4100e20 2024-09-19T05:20:00.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.413+0000 7f68b9e34640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f68b4110fb0 con 0x7f68b4102ef0 2024-09-19T05:20:00.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.413+0000 7f68b37fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b4100e20 0x7f68b4199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:00.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.413+0000 7f68b37fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b4100e20 0x7f68b4199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:37150/0 (socket says 172.21.15.120:37150) 2024-09-19T05:20:00.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.413+0000 7f68b37fe640 1 -- 172.21.15.120:0/2796853357 learned_addr learned my addr 172.21.15.120:0/2796853357 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:00.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.413+0000 7f68b3fff640 1 --2- 172.21.15.120:0/2796853357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68b4102ef0 0x7f68b41a42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:00.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.413+0000 7f68b37fe640 1 -- 172.21.15.120:0/2796853357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68b4102ef0 msgr2=0x7f68b41a42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:00.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.413+0000 7f68b37fe640 1 --2- 172.21.15.120:0/2796853357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68b4102ef0 0x7f68b41a42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:00.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.413+0000 7f68b37fe640 1 -- 172.21.15.120:0/2796853357 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68b4102570 msgr2=0x7f68b41997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:00.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.413+0000 7f68b2ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68b4102570 0x7f68b41997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:00.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.413+0000 7f68b37fe640 1 --2- 172.21.15.120:0/2796853357 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68b4102570 0x7f68b41997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:00.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.413+0000 7f68b37fe640 1 -- 172.21.15.120:0/2796853357 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b41a4820 con 0x7f68b4100e20 2024-09-19T05:20:00.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.413+0000 7f68b2ffd640 1 --2- 172.21.15.120:0/2796853357 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68b4102570 0x7f68b41997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:20:00.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.414+0000 7f68b37fe640 1 --2- 172.21.15.120:0/2796853357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b4100e20 0x7f68b4199260 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f68a400d950 tx=0x7f68a400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:00.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.414+0000 7f68b0ff9640 1 -- 172.21.15.120:0/2796853357 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a4017030 con 0x7f68b4100e20 2024-09-19T05:20:00.418 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.414+0000 7f68b9e34640 1 -- 172.21.15.120:0/2796853357 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68b41a49f0 con 0x7f68b4100e20 2024-09-19T05:20:00.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.414+0000 7f68b0ff9640 1 -- 172.21.15.120:0/2796853357 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f68a4004020 con 0x7f68b4100e20 2024-09-19T05:20:00.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.414+0000 7f68b9e34640 1 -- 172.21.15.120:0/2796853357 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68b41a4f30 con 0x7f68b4100e20 2024-09-19T05:20:00.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.414+0000 7f68b0ff9640 1 -- 172.21.15.120:0/2796853357 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a4003c50 con 0x7f68b4100e20 2024-09-19T05:20:00.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.415+0000 7f68b9e34640 1 -- 172.21.15.120:0/2796853357 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68a0005290 con 0x7f68b4100e20 2024-09-19T05:20:00.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.417+0000 7f68b0ff9640 1 -- 172.21.15.120:0/2796853357 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f68a401a070 con 0x7f68b4100e20 2024-09-19T05:20:00.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.418+0000 7f68b0ff9640 1 --2- 172.21.15.120:0/2796853357 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f689c0a34c0 0x7f689c0a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:00.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.418+0000 7f68b2ffd640 1 --2- 172.21.15.120:0/2796853357 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f689c0a34c0 0x7f689c0a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:00.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.418+0000 7f68b0ff9640 1 -- 172.21.15.120:0/2796853357 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f68a40cf6c0 con 0x7f68b4100e20 2024-09-19T05:20:00.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.419+0000 7f68b2ffd640 1 --2- 172.21.15.120:0/2796853357 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f689c0a34c0 0x7f689c0a5980 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f68a8005fd0 tx=0x7f68a80094d0 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:00.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.422+0000 7f68b0ff9640 1 -- 172.21.15.120:0/2796853357 <== mon.2 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f68a4021070 con 0x7f68b4100e20 2024-09-19T05:20:00.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:00 smithi178 ceph-mon[34347]: overall HEALTH_OK 2024-09-19T05:20:00.625 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:20:00 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:20:00.431+0000 7f1ef03e1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T05:20:00.626 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:20:00 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:20:00.431+0000 7f1ef03e1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T05:20:00.626 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:20:00 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:20:00.431+0000 7f1ef03e1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T05:20:00.626 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:20:00 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:20:00.431+0000 7f1ef03e1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T05:20:00.626 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:20:00 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:20:00.431+0000 7f1ef03e1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T05:20:00.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.790+0000 7f68b9e34640 1 -- 172.21.15.120:0/2796853357 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68a0005850 con 0x7f68b4100e20 2024-09-19T05:20:00.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.791+0000 7f68b0ff9640 1 -- 172.21.15.120:0/2796853357 <== mon.2 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11921 (secure 0 0 0) 0x7f68a409bee0 con 0x7f68b4100e20 2024-09-19T05:20:00.793 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:20:00.793 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":25,"btime":"2024-09-19T05:19:16:322502+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/93472898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":93472898},{"type":"v1","addr":"172.21.15.120:6835","nonce":93472898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1976835398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1976835398},{"type":"v1","addr":"172.21.15.120:6837","nonce":1976835398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6839/2975851469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":2975851469},{"type":"v1","addr":"172.21.15.120:6839","nonce":2975851469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6841/2837552754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":2837552754},{"type":"v1","addr":"172.21.15.120:6841","nonce":2837552754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/61682954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":61682954},{"type":"v1","addr":"172.21.15.178:6833","nonce":61682954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1778722040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1778722040},{"type":"v1","addr":"172.21.15.194:6833","nonce":1778722040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:17:30.796197+0000","modified":"2024-09-19T05:19:15.911765+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24445,"mds_1":24443,"mds_2":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24401":{"gid":24401,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/890775592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":890775592},{"type":"v1","addr":"172.21.15.178:6835","nonce":890775592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6837/3960720164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3960720164},{"type":"v1","addr":"172.21.15.178:6837","nonce":3960720164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6835/3268846994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3268846994},{"type":"v1","addr":"172.21.15.194:6835","nonce":3268846994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.194:6837/378729335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":378729335},{"type":"v1","addr":"172.21.15.194:6837","nonce":378729335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.178:6839/3389137566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3389137566},{"type":"v1","addr":"172.21.15.178:6839","nonce":3389137566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6839/3817420679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3817420679},{"type":"v1","addr":"172.21.15.194:6839","nonce":3817420679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24445,"qdb_cluster":[24445,24443,24430]},"id":1}]} 2024-09-19T05:20:00.793 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 25 2024-09-19T05:20:00.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.793+0000 7f68b9e34640 1 -- 172.21.15.120:0/2796853357 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f689c0a34c0 msgr2=0x7f689c0a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:00.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.793+0000 7f68b9e34640 1 --2- 172.21.15.120:0/2796853357 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f689c0a34c0 0x7f689c0a5980 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f68a8005fd0 tx=0x7f68a80094d0 comp rx=0 tx=0).stop 2024-09-19T05:20:00.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.793+0000 7f68b9e34640 1 -- 172.21.15.120:0/2796853357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b4100e20 msgr2=0x7f68b4199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:00.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.793+0000 7f68b9e34640 1 --2- 172.21.15.120:0/2796853357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b4100e20 0x7f68b4199260 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f68a400d950 tx=0x7f68a400de10 comp rx=0 tx=0).stop 2024-09-19T05:20:00.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.793+0000 7f68b9e34640 1 -- 172.21.15.120:0/2796853357 shutdown_connections 2024-09-19T05:20:00.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.793+0000 7f68b9e34640 1 --2- 172.21.15.120:0/2796853357 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f689c0a34c0 0x7f689c0a5980 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:00.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.793+0000 7f68b9e34640 1 --2- 172.21.15.120:0/2796853357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68b4102ef0 0x7f68b41a42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:00.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.793+0000 7f68b9e34640 1 --2- 172.21.15.120:0/2796853357 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68b4102570 0x7f68b41997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:00.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.793+0000 7f68b9e34640 1 --2- 172.21.15.120:0/2796853357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68b4100e20 0x7f68b4199260 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:00.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.793+0000 7f68b9e34640 1 -- 172.21.15.120:0/2796853357 >> 172.21.15.120:0/2796853357 conn(0x7f68b40fc7d0 msgr2=0x7f68b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:00.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.793+0000 7f68b9e34640 1 -- 172.21.15.120:0/2796853357 shutdown_connections 2024-09-19T05:20:00.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:00.793+0000 7f68b9e34640 1 -- 172.21.15.120:0/2796853357 wait complete. 2024-09-19T05:20:01.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:01 smithi120 ceph-mon[30956]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T05:20:01.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:01 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/2796853357' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:20:01.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:01 smithi194 ceph-mon[35228]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T05:20:01.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:01 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/2796853357' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:20:01.426 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T05:20:01.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:01 smithi178 ceph-mon[34347]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T05:20:01.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:01 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/2796853357' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:20:01.697 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:02.223 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.207+0000 7f04faf77640 1 -- 172.21.15.120:0/3666289258 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04f41011e0 msgr2=0x7f04f4105980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:02.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.207+0000 7f04faf77640 1 --2- 172.21.15.120:0/3666289258 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04f41011e0 0x7f04f4105980 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f04dc009900 tx=0x7f04dc02a410 comp rx=0 tx=0).stop 2024-09-19T05:20:02.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.207+0000 7f04faf77640 1 -- 172.21.15.120:0/3666289258 shutdown_connections 2024-09-19T05:20:02.283 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.207+0000 7f04faf77640 1 --2- 172.21.15.120:0/3666289258 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04f4105ec0 0x7f04f4106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.207+0000 7f04faf77640 1 --2- 172.21.15.120:0/3666289258 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04f41011e0 0x7f04f4105980 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.207+0000 7f04faf77640 1 --2- 172.21.15.120:0/3666289258 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04f41008c0 0x7f04f4100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.207+0000 7f04faf77640 1 -- 172.21.15.120:0/3666289258 >> 172.21.15.120:0/3666289258 conn(0x7f04f40fc7d0 msgr2=0x7f04f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:02.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.207+0000 7f04faf77640 1 -- 172.21.15.120:0/3666289258 shutdown_connections 2024-09-19T05:20:02.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.207+0000 7f04faf77640 1 -- 172.21.15.120:0/3666289258 wait complete. 2024-09-19T05:20:02.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.208+0000 7f04faf77640 1 Processor -- start 2024-09-19T05:20:02.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.208+0000 7f04faf77640 1 -- start start 2024-09-19T05:20:02.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.208+0000 7f04faf77640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04f41008c0 0x7f04f41a4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:02.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.208+0000 7f04faf77640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04f41011e0 0x7f04f41a4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:02.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.208+0000 7f04faf77640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04f4105ec0 0x7f04f419e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:02.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.208+0000 7f04faf77640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f04f41184e0 con 0x7f04f4105ec0 2024-09-19T05:20:02.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.208+0000 7f04faf77640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f04f4118360 con 0x7f04f41008c0 2024-09-19T05:20:02.284 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.208+0000 7f04faf77640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f04f4118660 con 0x7f04f41011e0 2024-09-19T05:20:02.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.208+0000 7f04f8d13640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04f41008c0 0x7f04f41a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:02.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.208+0000 7f04f8d13640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04f41008c0 0x7f04f41a4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:37182/0 (socket says 172.21.15.120:37182) 2024-09-19T05:20:02.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.208+0000 7f04f8d13640 1 -- 172.21.15.120:0/3832105839 learned_addr learned my addr 172.21.15.120:0/3832105839 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:02.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.208+0000 7f04f9514640 1 --2- 172.21.15.120:0/3832105839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04f4105ec0 0x7f04f419e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:02.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.208+0000 7f04f3fff640 1 --2- 172.21.15.120:0/3832105839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04f41011e0 0x7f04f41a4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:02.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.209+0000 7f04f8d13640 1 -- 172.21.15.120:0/3832105839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04f41011e0 msgr2=0x7f04f41a4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:02.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.209+0000 7f04f8d13640 1 --2- 172.21.15.120:0/3832105839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04f41011e0 0x7f04f41a4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.209+0000 7f04f8d13640 1 -- 172.21.15.120:0/3832105839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04f4105ec0 msgr2=0x7f04f419e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:02.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.209+0000 7f04f8d13640 1 --2- 172.21.15.120:0/3832105839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04f4105ec0 0x7f04f419e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.209+0000 7f04f8d13640 1 -- 172.21.15.120:0/3832105839 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f419f030 con 0x7f04f41008c0 2024-09-19T05:20:02.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.209+0000 7f04f3fff640 1 --2- 172.21.15.120:0/3832105839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04f41011e0 0x7f04f41a4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:20:02.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.209+0000 7f04f8d13640 1 --2- 172.21.15.120:0/3832105839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04f41008c0 0x7f04f41a4740 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00e9f0 tx=0x7f04ec00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:02.285 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.209+0000 7f04f1ffb640 1 -- 172.21.15.120:0/3832105839 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec00cd80 con 0x7f04f41008c0 2024-09-19T05:20:02.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.209+0000 7f04faf77640 1 -- 172.21.15.120:0/3832105839 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04f419f320 con 0x7f04f41008c0 2024-09-19T05:20:02.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.209+0000 7f04f1ffb640 1 -- 172.21.15.120:0/3832105839 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f04ec0054d0 con 0x7f04f41008c0 2024-09-19T05:20:02.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.209+0000 7f04f1ffb640 1 -- 172.21.15.120:0/3832105839 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec010490 con 0x7f04f41008c0 2024-09-19T05:20:02.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.210+0000 7f04faf77640 1 -- 172.21.15.120:0/3832105839 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04f41ab610 con 0x7f04f41008c0 2024-09-19T05:20:02.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.212+0000 7f04fd350740 1 Processor -- start 2024-09-19T05:20:02.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.212+0000 7f04fd350740 1 -- start start 2024-09-19T05:20:02.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.214+0000 7f04fd350740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ed9b40 0x561045ed8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:02.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.214+0000 7f04fd350740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561045ed85d0 0x561045ed8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:02.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.214+0000 7f04fd350740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561045ee3370 0x561045ee5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:02.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.214+0000 7f04fd350740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561045e3e2f0 con 0x561045ed9b40 2024-09-19T05:20:02.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.214+0000 7f04fd350740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561045de5cf0 con 0x561045ed85d0 2024-09-19T05:20:02.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.214+0000 7f04fd350740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x561045e3a2b0 con 0x561045ee3370 2024-09-19T05:20:02.286 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.214+0000 7f04f9514640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ed9b40 0x561045ed8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:02.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.214+0000 7f04f9514640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ed9b40 0x561045ed8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55972/0 (socket says 172.21.15.120:55972) 2024-09-19T05:20:02.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.214+0000 7f04f9514640 1 -- 172.21.15.120:0/3891328414 learned_addr learned my addr 172.21.15.120:0/3891328414 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:02.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.214+0000 7f04f1ffb640 1 -- 172.21.15.120:0/3832105839 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 23) ==== 138532+0+0 (secure 0 0 0) 0x7f04ec005020 con 0x7f04f41008c0 2024-09-19T05:20:02.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.214+0000 7f04f3fff640 1 --2- 172.21.15.120:0/3891328414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561045ee3370 0x561045ee5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:02.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.214+0000 7f04f8d13640 1 --2- 172.21.15.120:0/3891328414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561045ed85d0 0x561045ed8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:02.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.214+0000 7f04f9514640 1 -- 172.21.15.120:0/3891328414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561045ee3370 msgr2=0x561045ee5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:02.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.214+0000 7f04f9514640 1 --2- 172.21.15.120:0/3891328414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561045ee3370 0x561045ee5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.214+0000 7f04f9514640 1 -- 172.21.15.120:0/3891328414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561045ed85d0 msgr2=0x561045ed8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:02.287 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.214+0000 7f04f9514640 1 --2- 172.21.15.120:0/3891328414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561045ed85d0 0x561045ed8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.214+0000 7f04f9514640 1 -- 172.21.15.120:0/3891328414 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561045dca3a0 con 0x561045ed9b40 2024-09-19T05:20:02.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.214+0000 7f04f8d13640 1 --2- 172.21.15.120:0/3891328414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561045ed85d0 0x561045ed8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:20:02.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.215+0000 7f04f9514640 1 --2- 172.21.15.120:0/3891328414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ed9b40 0x561045ed8090 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f04e4009f50 tx=0x7f04e40118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3de61bd8a4fa317 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:02.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.215+0000 7f04eaffd640 1 -- 172.21.15.120:0/3891328414 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e4004d20 con 0x561045ed9b40 2024-09-19T05:20:02.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.215+0000 7f04eaffd640 1 -- 172.21.15.120:0/3891328414 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f04e4004050 con 0x561045ed9b40 2024-09-19T05:20:02.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.215+0000 7f04eaffd640 1 -- 172.21.15.120:0/3891328414 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e4005280 con 0x561045ed9b40 2024-09-19T05:20:02.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.215+0000 7f04f1ffb640 1 --2- 172.21.15.120:0/3832105839 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f04e00a34c0 0x7f04e00a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:02.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.215+0000 7f04f1ffb640 1 -- 172.21.15.120:0/3832105839 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f04ec0d03d0 con 0x7f04f41008c0 2024-09-19T05:20:02.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.216+0000 7f04f8d13640 1 --2- 172.21.15.120:0/3832105839 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f04e00a34c0 0x7f04e00a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:02.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.216+0000 7f04fd350740 1 -- 172.21.15.120:0/3891328414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ed9b40 msgr2=0x561045ed8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:02.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.216+0000 7f04fd350740 1 --2- 172.21.15.120:0/3891328414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ed9b40 0x561045ed8090 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f04e4009f50 tx=0x7f04e40118d0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.216+0000 7f04f8d13640 1 --2- 172.21.15.120:0/3832105839 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f04e00a34c0 0x7f04e00a5980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0cda10 tx=0x7f04ec098040 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:02.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.216+0000 7f04fd350740 1 -- 172.21.15.120:0/3891328414 shutdown_connections 2024-09-19T05:20:02.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.216+0000 7f04fd350740 1 --2- 172.21.15.120:0/3891328414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561045ee3370 0x561045ee5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.216+0000 7f04fd350740 1 --2- 172.21.15.120:0/3891328414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561045ed85d0 0x561045ed8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.216+0000 7f04fd350740 1 --2- 172.21.15.120:0/3891328414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ed9b40 0x561045ed8090 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.216+0000 7f04fd350740 1 -- 172.21.15.120:0/3891328414 >> 172.21.15.120:0/3891328414 conn(0x561045ea1310 msgr2=0x561045ed4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:02.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.216+0000 7f04fd350740 1 -- 172.21.15.120:0/3891328414 shutdown_connections 2024-09-19T05:20:02.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.216+0000 7f04fd350740 1 -- 172.21.15.120:0/3891328414 wait complete. 2024-09-19T05:20:02.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.217+0000 7f04fd350740 1 -- start start 2024-09-19T05:20:02.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.217+0000 7f04fd350740 1 Processor -- start 2024-09-19T05:20:02.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.217+0000 7f04fd350740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ed85d0 0x561045ee2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:02.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.217+0000 7f04fd350740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561045ed9b40 0x561045edff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:02.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.217+0000 7f04fd350740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561045ee3370 0x561045ee04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:02.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.217+0000 7f04fd350740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561045ee6070 con 0x561045ed85d0 2024-09-19T05:20:02.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.217+0000 7f04fd350740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561045df9060 con 0x561045ee3370 2024-09-19T05:20:02.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.217+0000 7f04fd350740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x561045ee61f0 con 0x561045ed9b40 2024-09-19T05:20:02.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.217+0000 7f04fd350740 10 client.0 _ll_register_callbacks cb 0x561045b4c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:02.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.218+0000 7f04f9514640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ed85d0 0x561045ee2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:02.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.218+0000 7f04f9514640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ed85d0 0x561045ee2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55976/0 (socket says 172.21.15.120:55976) 2024-09-19T05:20:02.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.218+0000 7f04f9514640 1 -- 172.21.15.120:0/1000688987 learned_addr learned my addr 172.21.15.120:0/1000688987 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:02.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.218+0000 7f04f9514640 1 --2- 172.21.15.120:0/1000688987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561045ee3370 0x561045ee04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:02.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.218+0000 7f04f3fff640 1 --2- 172.21.15.120:0/1000688987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561045ed9b40 0x561045edff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:02.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.218+0000 7f04f9514640 1 -- 172.21.15.120:0/1000688987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561045ed9b40 msgr2=0x561045edff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:02.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.218+0000 7f04f9514640 1 --2- 172.21.15.120:0/1000688987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561045ed9b40 0x561045edff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.218+0000 7f04f9514640 1 -- 172.21.15.120:0/1000688987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561045ee3370 msgr2=0x561045ee04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:02.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.218+0000 7f04f9514640 1 --2- 172.21.15.120:0/1000688987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561045ee3370 0x561045ee04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.218+0000 7f04f9514640 1 -- 172.21.15.120:0/1000688987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561045baf3c0 con 0x561045ed85d0 2024-09-19T05:20:02.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.218+0000 7f04f9514640 1 --2- 172.21.15.120:0/1000688987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ed85d0 0x561045ee2cd0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f04e401b040 tx=0x7f04e4005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b1bb79a0526aef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:02.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.218+0000 7f04d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:20:02.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.218+0000 7f04d3fff640 1 -- 172.21.15.120:0/1000688987 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e4004c10 con 0x561045ed85d0 2024-09-19T05:20:02.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.218+0000 7f04d3fff640 1 -- 172.21.15.120:0/1000688987 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f04e401f040 con 0x561045ed85d0 2024-09-19T05:20:02.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.218+0000 7f04fd350740 1 -- 172.21.15.120:0/1000688987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04e4004050 con 0x561045ed85d0 2024-09-19T05:20:02.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.219+0000 7f04d3fff640 1 -- 172.21.15.120:0/1000688987 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f04e4034050 con 0x561045ed85d0 2024-09-19T05:20:02.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.219+0000 7f04fd350740 10 client.15423 fetch_fsmap learned FSMap version 25 2024-09-19T05:20:02.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.219+0000 7f04fd350740 1 -- 172.21.15.120:0/1000688987 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561045ef19f0 con 0x561045ed85d0 2024-09-19T05:20:02.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.219+0000 7f04d3fff640 1 -- 172.21.15.120:0/1000688987 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f04e4004050 con 0x561045ed85d0 2024-09-19T05:20:02.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.219+0000 7f04d3fff640 1 -- 172.21.15.120:0/1000688987 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f04e400f480 con 0x561045ed85d0 2024-09-19T05:20:02.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.219+0000 7f04fd350740 10 client.15423 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:20:02.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.219+0000 7f04fd350740 10 client.15423 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T05:20:02.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.219+0000 7f04fd350740 20 client.15423 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:02.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.219+0000 7f04fd350740 1 --2- 172.21.15.120:0/1000688987 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x561045ef2e50 0x561045ef5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:02.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.219+0000 7f04fd350740 4 client.15423 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:20:02.297 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.219+0000 7f04fd350740 1 -- 172.21.15.120:0/1000688987 --> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561045e4b860 con 0x561045ef2e50 2024-09-19T05:20:02.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.220+0000 7f04f3fff640 1 --2- 172.21.15.120:0/1000688987 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x561045ef2e50 0x561045ef5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:02.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.220+0000 7f04f3fff640 1 --2- 172.21.15.120:0/1000688987 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x561045ef2e50 0x561045ef5240 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5db051014e6c95a2 server_cookie=fc4fdafacc279280 in_seq=0 out_seq=0 2024-09-19T05:20:02.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.220+0000 7f04d3fff640 10 client.15423 ms_handle_connect on v2:172.21.15.194:6836/378729335 2024-09-19T05:20:02.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.221+0000 7f04d3fff640 1 -- 172.21.15.120:0/1000688987 <== mds.2 v2:172.21.15.194:6836/378729335 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561045e4b860 con 0x561045ef2e50 2024-09-19T05:20:02.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.221+0000 7f04d3fff640 10 client.15423 handle_command_reply: tid=0 2024-09-19T05:20:02.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.221+0000 7f04fd350740 1 client.15423 shutdown 2024-09-19T05:20:02.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.221+0000 7f04fd350740 1 -- 172.21.15.120:0/1000688987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ed85d0 msgr2=0x561045ee2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:02.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.221+0000 7f04fd350740 1 --2- 172.21.15.120:0/1000688987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ed85d0 0x561045ee2cd0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f04e401b040 tx=0x7f04e4005bd0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.221+0000 7f04fd350740 1 -- 172.21.15.120:0/1000688987 shutdown_connections 2024-09-19T05:20:02.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.221+0000 7f04fd350740 1 --2- 172.21.15.120:0/1000688987 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x561045ef2e50 0x561045ef5240 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.221+0000 7f04d3fff640 0 client.15423 ms_handle_reset on v2:172.21.15.194:6836/378729335 2024-09-19T05:20:02.298 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.221+0000 7f04fd350740 1 --2- 172.21.15.120:0/1000688987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561045ee3370 0x561045ee04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.221+0000 7f04fd350740 1 --2- 172.21.15.120:0/1000688987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561045ed9b40 0x561045edff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.221+0000 7f04fd350740 1 --2- 172.21.15.120:0/1000688987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ed85d0 0x561045ee2cd0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.221+0000 7f04fd350740 1 -- 172.21.15.120:0/1000688987 >> 172.21.15.120:0/1000688987 conn(0x561045ea1310 msgr2=0x561045eda930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:02.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.221+0000 7f04fd350740 1 -- 172.21.15.120:0/1000688987 shutdown_connections 2024-09-19T05:20:02.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.221+0000 7f04fd350740 1 -- 172.21.15.120:0/1000688987 wait complete. 2024-09-19T05:20:02.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.221+0000 7f04fd350740 20 client.15423 trim_cache size 0 max 16384 2024-09-19T05:20:02.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.246+0000 7f04fd350740 1 Processor -- start 2024-09-19T05:20:02.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.246+0000 7f04fd350740 1 -- start start 2024-09-19T05:20:02.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.246+0000 7f04fd350740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561045ed85d0 0x561045edb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:02.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.246+0000 7f04fd350740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561045ed9b40 0x561045edb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:02.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.246+0000 7f04fd350740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ee3370 0x561045efa840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:02.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.246+0000 7f04fd350740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f04f41b68a0 con 0x561045ee3370 2024-09-19T05:20:02.299 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.246+0000 7f04fd350740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f04f41b4170 con 0x561045ed9b40 2024-09-19T05:20:02.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.246+0000 7f04fd350740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f04f41b1fc0 con 0x561045ed85d0 2024-09-19T05:20:02.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.246+0000 7f04f9514640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ee3370 0x561045efa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:02.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.247+0000 7f04f9514640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561045ed85d0 0x561045edb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:02.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.247+0000 7f04f9514640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561045ed85d0 0x561045edb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:49742/0 (socket says 172.21.15.120:49742) 2024-09-19T05:20:02.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.247+0000 7f04f9514640 1 -- 172.21.15.120:0/823348370 learned_addr learned my addr 172.21.15.120:0/823348370 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:02.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.247+0000 7f04f3fff640 1 --2- 172.21.15.120:0/823348370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561045ed9b40 0x561045edb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:02.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.247+0000 7f04f9514640 1 -- 172.21.15.120:0/823348370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561045ed85d0 msgr2=0x561045edb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:02.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.247+0000 7f04f9514640 1 --2- 172.21.15.120:0/823348370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561045ed85d0 0x561045edb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.247+0000 7f04f9514640 1 -- 172.21.15.120:0/823348370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561045ed9b40 msgr2=0x561045edb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:02.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.247+0000 7f04f9514640 1 --2- 172.21.15.120:0/823348370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561045ed9b40 0x561045edb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.247+0000 7f04f9514640 1 -- 172.21.15.120:0/823348370 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561045ede4d0 con 0x561045ee3370 2024-09-19T05:20:02.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.247+0000 7f04f9514640 1 --2- 172.21.15.120:0/823348370 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ee3370 0x561045efa840 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f04e4002230 tx=0x7f04e4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ae69ede49f6ea1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:02.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.247+0000 7f04ea7fc640 1 -- 172.21.15.120:0/823348370 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e4004000 con 0x561045ee3370 2024-09-19T05:20:02.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.247+0000 7f04ea7fc640 1 -- 172.21.15.120:0/823348370 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f04e40047f0 con 0x561045ee3370 2024-09-19T05:20:02.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.247+0000 7f04ea7fc640 1 -- 172.21.15.120:0/823348370 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e400fa40 con 0x561045ee3370 2024-09-19T05:20:02.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.248+0000 7f04fd350740 1 -- 172.21.15.120:0/823348370 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ee3370 msgr2=0x561045efa840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:02.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.248+0000 7f04fd350740 1 --2- 172.21.15.120:0/823348370 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ee3370 0x561045efa840 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f04e4002230 tx=0x7f04e4005fd0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.248+0000 7f04fd350740 1 -- 172.21.15.120:0/823348370 shutdown_connections 2024-09-19T05:20:02.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.248+0000 7f04fd350740 1 --2- 172.21.15.120:0/823348370 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ee3370 0x561045efa840 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.248+0000 7f04fd350740 1 --2- 172.21.15.120:0/823348370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561045ed9b40 0x561045edb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.248+0000 7f04fd350740 1 --2- 172.21.15.120:0/823348370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561045ed85d0 0x561045edb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.248+0000 7f04fd350740 1 -- 172.21.15.120:0/823348370 >> 172.21.15.120:0/823348370 conn(0x561045ea1310 msgr2=0x561045ed3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:02.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.248+0000 7f04fd350740 1 -- 172.21.15.120:0/823348370 shutdown_connections 2024-09-19T05:20:02.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.248+0000 7f04fd350740 1 -- 172.21.15.120:0/823348370 wait complete. 2024-09-19T05:20:02.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.249+0000 7f04fd350740 1 -- start start 2024-09-19T05:20:02.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.249+0000 7f04fd350740 1 Processor -- start 2024-09-19T05:20:02.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.249+0000 7f04fd350740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ed85d0 0x561045ee7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:02.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.249+0000 7f04fd350740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561045ed9b40 0x561045ee7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:02.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.250+0000 7f04fd350740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561045ee3370 0x561045ee7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:02.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.250+0000 7f04fd350740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f04f41b2630 con 0x561045ed85d0 2024-09-19T05:20:02.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.250+0000 7f04fd350740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f04f41b3aa0 con 0x561045ed9b40 2024-09-19T05:20:02.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.250+0000 7f04fd350740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f04f41b2d00 con 0x561045ee3370 2024-09-19T05:20:02.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.250+0000 7f04f9514640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ed85d0 0x561045ee7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:02.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.250+0000 7f04f9514640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ed85d0 0x561045ee7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56004/0 (socket says 172.21.15.120:56004) 2024-09-19T05:20:02.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.250+0000 7f04fd350740 10 client.0 _ll_register_callbacks cb 0x7f04e40093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:02.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.250+0000 7f04f9514640 1 -- 172.21.15.120:0/173832114 learned_addr learned my addr 172.21.15.120:0/173832114 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:02.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.250+0000 7f04f9514640 1 --2- 172.21.15.120:0/173832114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561045ee3370 0x561045ee7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:02.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.250+0000 7f04f3fff640 1 --2- 172.21.15.120:0/173832114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561045ed9b40 0x561045ee7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:02.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.250+0000 7f04f9514640 1 -- 172.21.15.120:0/173832114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561045ee3370 msgr2=0x561045ee7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:02.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.250+0000 7f04f9514640 1 --2- 172.21.15.120:0/173832114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561045ee3370 0x561045ee7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.250+0000 7f04f9514640 1 -- 172.21.15.120:0/173832114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561045ed9b40 msgr2=0x561045ee7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:02.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.250+0000 7f04f9514640 1 --2- 172.21.15.120:0/173832114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561045ed9b40 0x561045ee7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.250+0000 7f04f9514640 1 -- 172.21.15.120:0/173832114 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561045f5ca60 con 0x561045ed85d0 2024-09-19T05:20:02.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.250+0000 7f04f9514640 1 --2- 172.21.15.120:0/173832114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ed85d0 0x561045ee7430 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f04e400f9c0 tx=0x7f04e4004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b49e2fb728415e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:02.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.250+0000 7f04d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:20:02.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.250+0000 7f04d3fff640 1 -- 172.21.15.120:0/173832114 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e400fa40 con 0x561045ed85d0 2024-09-19T05:20:02.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.251+0000 7f04d3fff640 1 -- 172.21.15.120:0/173832114 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f04e402d040 con 0x561045ed85d0 2024-09-19T05:20:02.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.251+0000 7f04fd350740 1 -- 172.21.15.120:0/173832114 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04e40047f0 con 0x561045ed85d0 2024-09-19T05:20:02.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.251+0000 7f04d3fff640 1 -- 172.21.15.120:0/173832114 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f04e404a050 con 0x561045ed85d0 2024-09-19T05:20:02.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.251+0000 7f04fd350740 10 client.15429 fetch_fsmap learned FSMap version 25 2024-09-19T05:20:02.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.251+0000 7f04fd350740 1 -- 172.21.15.120:0/173832114 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561045f5dd40 con 0x561045ed85d0 2024-09-19T05:20:02.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.251+0000 7f04d3fff640 1 -- 172.21.15.120:0/173832114 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f04e400fbe0 con 0x561045ed85d0 2024-09-19T05:20:02.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.251+0000 7f04d3fff640 1 -- 172.21.15.120:0/173832114 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f04e4027b00 con 0x561045ed85d0 2024-09-19T05:20:02.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.252+0000 7f04fd350740 10 client.15429 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:20:02.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.252+0000 7f04fd350740 10 client.15429 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T05:20:02.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.252+0000 7f04fd350740 20 client.15429 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:02.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.252+0000 7f04fd350740 1 --2- 172.21.15.120:0/173832114 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x561045f5e3a0 0x561045f60790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:02.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.252+0000 7f04fd350740 4 client.15429 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T05:20:02.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.252+0000 7f04fd350740 1 -- 172.21.15.120:0/173832114 --> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f04e40047f0 con 0x561045f5e3a0 2024-09-19T05:20:02.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.252+0000 7f04f3fff640 1 --2- 172.21.15.120:0/173832114 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x561045f5e3a0 0x561045f60790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:02.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.253+0000 7f04f3fff640 1 --2- 172.21.15.120:0/173832114 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x561045f5e3a0 0x561045f60790 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c851c28bbe32bb3 server_cookie=82d66c8c0b895638 in_seq=0 out_seq=0 2024-09-19T05:20:02.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.253+0000 7f04d3fff640 10 client.15429 ms_handle_connect on v2:172.21.15.194:6836/378729335 2024-09-19T05:20:02.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.253+0000 7f04d3fff640 1 -- 172.21.15.120:0/173832114 <== mds.2 v2:172.21.15.194:6836/378729335 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f04e40047f0 con 0x561045f5e3a0 2024-09-19T05:20:02.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.253+0000 7f04d3fff640 10 client.15429 handle_command_reply: tid=0 2024-09-19T05:20:02.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.253+0000 7f04fd350740 1 client.15429 shutdown 2024-09-19T05:20:02.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.253+0000 7f04fd350740 1 -- 172.21.15.120:0/173832114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ed85d0 msgr2=0x561045ee7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:02.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.253+0000 7f04fd350740 1 --2- 172.21.15.120:0/173832114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ed85d0 0x561045ee7430 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f04e400f9c0 tx=0x7f04e4004760 comp rx=0 tx=0).stop 2024-09-19T05:20:02.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.253+0000 7f04fd350740 1 -- 172.21.15.120:0/173832114 shutdown_connections 2024-09-19T05:20:02.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.253+0000 7f04fd350740 1 --2- 172.21.15.120:0/173832114 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x561045f5e3a0 0x561045f60790 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.253+0000 7f04d3fff640 0 client.15429 ms_handle_reset on v2:172.21.15.194:6836/378729335 2024-09-19T05:20:02.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.253+0000 7f04fd350740 1 --2- 172.21.15.120:0/173832114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561045ee3370 0x561045ee7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.253+0000 7f04fd350740 1 --2- 172.21.15.120:0/173832114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561045ed9b40 0x561045ee7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.253+0000 7f04fd350740 1 --2- 172.21.15.120:0/173832114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561045ed85d0 0x561045ee7430 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.253+0000 7f04fd350740 1 -- 172.21.15.120:0/173832114 >> 172.21.15.120:0/173832114 conn(0x561045ea1310 msgr2=0x561045ee17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:02.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.254+0000 7f04fd350740 1 -- 172.21.15.120:0/173832114 shutdown_connections 2024-09-19T05:20:02.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.254+0000 7f04fd350740 1 -- 172.21.15.120:0/173832114 wait complete. 2024-09-19T05:20:02.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.254+0000 7f04fd350740 20 client.15429 trim_cache size 0 max 16384 2024-09-19T05:20:02.306 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-09-19T05:20:02.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.254+0000 7f04faf77640 1 -- 172.21.15.120:0/3832105839 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f04e00a34c0 msgr2=0x7f04e00a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:02.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.254+0000 7f04faf77640 1 --2- 172.21.15.120:0/3832105839 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f04e00a34c0 0x7f04e00a5980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0cda10 tx=0x7f04ec098040 comp rx=0 tx=0).stop 2024-09-19T05:20:02.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.254+0000 7f04faf77640 1 -- 172.21.15.120:0/3832105839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04f41008c0 msgr2=0x7f04f41a4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:02.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.254+0000 7f04faf77640 1 --2- 172.21.15.120:0/3832105839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04f41008c0 0x7f04f41a4740 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f04ec00e9f0 tx=0x7f04ec00edf0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.254+0000 7f04faf77640 1 -- 172.21.15.120:0/3832105839 shutdown_connections 2024-09-19T05:20:02.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.255+0000 7f04faf77640 1 --2- 172.21.15.120:0/3832105839 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f04e00a34c0 0x7f04e00a5980 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.255+0000 7f04faf77640 1 --2- 172.21.15.120:0/3832105839 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f04f4105ec0 0x7f04f419e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.255+0000 7f04faf77640 1 --2- 172.21.15.120:0/3832105839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04f41011e0 0x7f04f41a4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.255+0000 7f04faf77640 1 --2- 172.21.15.120:0/3832105839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04f41008c0 0x7f04f41a4740 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:02.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.255+0000 7f04faf77640 1 -- 172.21.15.120:0/3832105839 >> 172.21.15.120:0/3832105839 conn(0x7f04f40fc7d0 msgr2=0x7f04f410f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:02.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.255+0000 7f04faf77640 1 -- 172.21.15.120:0/3832105839 shutdown_connections 2024-09-19T05:20:02.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:02.255+0000 7f04faf77640 1 -- 172.21.15.120:0/3832105839 wait complete. 2024-09-19T05:20:02.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:02 smithi178 ceph-mon[34347]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T05:20:02.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:02 smithi178 ceph-mon[34347]: mgrmap e24: x(active, since 48s), standbys: y, z 2024-09-19T05:20:02.841 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:02 smithi120 ceph-mon[30956]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T05:20:02.842 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:02 smithi120 ceph-mon[30956]: mgrmap e24: x(active, since 48s), standbys: y, z 2024-09-19T05:20:02.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:02 smithi194 ceph-mon[35228]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T05:20:02.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:02 smithi194 ceph-mon[35228]: mgrmap e24: x(active, since 48s), standbys: y, z 2024-09-19T05:20:02.944 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T05:20:03.230 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:03.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.714+0000 7f55680b4640 1 -- 172.21.15.120:0/1477306143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5560103760 msgr2=0x7f5560107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:03.716 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.714+0000 7f55680b4640 1 --2- 172.21.15.120:0/1477306143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5560103760 0x7f5560107ba0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5550009930 tx=0x7f555002a420 comp rx=0 tx=0).stop 2024-09-19T05:20:03.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.715+0000 7f55680b4640 1 -- 172.21.15.120:0/1477306143 shutdown_connections 2024-09-19T05:20:03.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.715+0000 7f55680b4640 1 --2- 172.21.15.120:0/1477306143 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55601082e0 0x7f556010ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.715+0000 7f55680b4640 1 --2- 172.21.15.120:0/1477306143 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5560103760 0x7f5560107ba0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.715+0000 7f55680b4640 1 --2- 172.21.15.120:0/1477306143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5560102db0 0x7f5560103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.715+0000 7f55680b4640 1 -- 172.21.15.120:0/1477306143 >> 172.21.15.120:0/1477306143 conn(0x7f55600fc7d0 msgr2=0x7f55600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:03.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.715+0000 7f55680b4640 1 -- 172.21.15.120:0/1477306143 shutdown_connections 2024-09-19T05:20:03.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.715+0000 7f55680b4640 1 -- 172.21.15.120:0/1477306143 wait complete. 2024-09-19T05:20:03.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.716+0000 7f55680b4640 1 Processor -- start 2024-09-19T05:20:03.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.716+0000 7f55680b4640 1 -- start start 2024-09-19T05:20:03.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.716+0000 7f55680b4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5560102db0 0x7f5560100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:03.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.716+0000 7f55680b4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5560103760 0x7f5560100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:03.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.716+0000 7f55680b4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55601082e0 0x7f5560101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:03.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.716+0000 7f55680b4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5560111f20 con 0x7f5560102db0 2024-09-19T05:20:03.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.716+0000 7f5565e50640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5560102db0 0x7f5560100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:03.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.716+0000 7f556564f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5560103760 0x7f5560100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:03.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.716+0000 7f5565e50640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5560102db0 0x7f5560100a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56024/0 (socket says 172.21.15.120:56024) 2024-09-19T05:20:03.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.716+0000 7f5565e50640 1 -- 172.21.15.120:0/1398025153 learned_addr learned my addr 172.21.15.120:0/1398025153 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:03.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.716+0000 7f55680b4640 1 -- 172.21.15.120:0/1398025153 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5560111da0 con 0x7f55601082e0 2024-09-19T05:20:03.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.716+0000 7f55680b4640 1 -- 172.21.15.120:0/1398025153 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f55601120a0 con 0x7f5560103760 2024-09-19T05:20:03.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.716+0000 7f5566651640 1 --2- 172.21.15.120:0/1398025153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55601082e0 0x7f5560101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:03.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.717+0000 7f5565e50640 1 -- 172.21.15.120:0/1398025153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5560103760 msgr2=0x7f5560100f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:03.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.717+0000 7f5565e50640 1 --2- 172.21.15.120:0/1398025153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5560103760 0x7f5560100f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.717+0000 7f5565e50640 1 -- 172.21.15.120:0/1398025153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55601082e0 msgr2=0x7f5560101490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:03.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.717+0000 7f5565e50640 1 --2- 172.21.15.120:0/1398025153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55601082e0 0x7f5560101490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.717+0000 7f5565e50640 1 -- 172.21.15.120:0/1398025153 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55601a6a00 con 0x7f5560102db0 2024-09-19T05:20:03.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.717+0000 7f5566651640 1 --2- 172.21.15.120:0/1398025153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55601082e0 0x7f5560101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:03.720 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.717+0000 7f5565e50640 1 --2- 172.21.15.120:0/1398025153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5560102db0 0x7f5560100a10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f555c00d770 tx=0x7f555c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:03.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.717+0000 7f5556ffd640 1 -- 172.21.15.120:0/1398025153 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c017070 con 0x7f5560102db0 2024-09-19T05:20:03.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.718+0000 7f5556ffd640 1 -- 172.21.15.120:0/1398025153 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f555c0054d0 con 0x7f5560102db0 2024-09-19T05:20:03.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.718+0000 7f55680b4640 1 -- 172.21.15.120:0/1398025153 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55601a6cf0 con 0x7f5560102db0 2024-09-19T05:20:03.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.718+0000 7f5556ffd640 1 -- 172.21.15.120:0/1398025153 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c004cf0 con 0x7f5560102db0 2024-09-19T05:20:03.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.718+0000 7f55680b4640 1 -- 172.21.15.120:0/1398025153 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55601a71b0 con 0x7f5560102db0 2024-09-19T05:20:03.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.721+0000 7f556a48d740 1 Processor -- start 2024-09-19T05:20:03.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.721+0000 7f556a48d740 1 -- start start 2024-09-19T05:20:03.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.721+0000 7f5556ffd640 1 -- 172.21.15.120:0/1398025153 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7f555c010460 con 0x7f5560102db0 2024-09-19T05:20:03.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.722+0000 7f556a48d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9873e7b40 0x55c9873e6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:03.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.722+0000 7f556a48d740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9873e65d0 0x55c9873e6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:03.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.722+0000 7f556a48d740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873f1370 0x55c9873f3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:03.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.722+0000 7f556a48d740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c98734c2f0 con 0x55c9873f1370 2024-09-19T05:20:03.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.722+0000 7f556a48d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55c9872f3cf0 con 0x55c9873e7b40 2024-09-19T05:20:03.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.722+0000 7f556a48d740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c9873482b0 con 0x55c9873e65d0 2024-09-19T05:20:03.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.722+0000 7f556564f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873f1370 0x55c9873f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:03.731 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.722+0000 7f556564f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873f1370 0x55c9873f3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56028/0 (socket says 172.21.15.120:56028) 2024-09-19T05:20:03.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.722+0000 7f556564f640 1 -- 172.21.15.120:0/3216017579 learned_addr learned my addr 172.21.15.120:0/3216017579 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:03.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.722+0000 7f5566651640 1 --2- 172.21.15.120:0/3216017579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9873e7b40 0x55c9873e6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:03.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.722+0000 7f556564f640 1 -- 172.21.15.120:0/3216017579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9873e65d0 msgr2=0x55c9873e6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:03.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.722+0000 7f556564f640 1 --2- 172.21.15.120:0/3216017579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9873e65d0 0x55c9873e6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.722+0000 7f556564f640 1 -- 172.21.15.120:0/3216017579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9873e7b40 msgr2=0x55c9873e6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:03.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.722+0000 7f556564f640 1 --2- 172.21.15.120:0/3216017579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9873e7b40 0x55c9873e6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.722+0000 7f556564f640 1 -- 172.21.15.120:0/3216017579 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9872d83a0 con 0x55c9873f1370 2024-09-19T05:20:03.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.722+0000 7f5566651640 1 --2- 172.21.15.120:0/3216017579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9873e7b40 0x55c9873e6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:03.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.723+0000 7f556564f640 1 --2- 172.21.15.120:0/3216017579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873f1370 0x55c9873f3760 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5550005ec0 tx=0x7f5550032be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2358333859e9f16 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:03.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.723+0000 7f554bfff640 1 -- 172.21.15.120:0/3216017579 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550040070 con 0x55c9873f1370 2024-09-19T05:20:03.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.723+0000 7f554bfff640 1 -- 172.21.15.120:0/3216017579 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5550031630 con 0x55c9873f1370 2024-09-19T05:20:03.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.723+0000 7f5556ffd640 1 --2- 172.21.15.120:0/1398025153 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f554c0a3620 0x7f554c0a5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:03.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.723+0000 7f554bfff640 1 -- 172.21.15.120:0/3216017579 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550035040 con 0x55c9873f1370 2024-09-19T05:20:03.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.724+0000 7f5566651640 1 --2- 172.21.15.120:0/1398025153 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f554c0a3620 0x7f554c0a5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:03.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.724+0000 7f556a48d740 1 -- 172.21.15.120:0/3216017579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873f1370 msgr2=0x55c9873f3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:03.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.724+0000 7f556a48d740 1 --2- 172.21.15.120:0/3216017579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873f1370 0x55c9873f3760 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5550005ec0 tx=0x7f5550032be0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.724+0000 7f5556ffd640 1 -- 172.21.15.120:0/1398025153 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f555c0cf900 con 0x7f5560102db0 2024-09-19T05:20:03.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.724+0000 7f5566651640 1 --2- 172.21.15.120:0/1398025153 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f554c0a3620 0x7f554c0a5ae0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5558005fd0 tx=0x7f5558009600 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:03.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.725+0000 7f556a48d740 1 -- 172.21.15.120:0/3216017579 shutdown_connections 2024-09-19T05:20:03.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.725+0000 7f556a48d740 1 --2- 172.21.15.120:0/3216017579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873f1370 0x55c9873f3760 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.725+0000 7f556a48d740 1 --2- 172.21.15.120:0/3216017579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9873e65d0 0x55c9873e6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.725+0000 7f556a48d740 1 --2- 172.21.15.120:0/3216017579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9873e7b40 0x55c9873e6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.725+0000 7f556a48d740 1 -- 172.21.15.120:0/3216017579 >> 172.21.15.120:0/3216017579 conn(0x55c9873af310 msgr2=0x55c9873e2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:03.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.725+0000 7f556a48d740 1 -- 172.21.15.120:0/3216017579 shutdown_connections 2024-09-19T05:20:03.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.725+0000 7f556a48d740 1 -- 172.21.15.120:0/3216017579 wait complete. 2024-09-19T05:20:03.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.725+0000 7f556a48d740 1 -- start start 2024-09-19T05:20:03.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.725+0000 7f556a48d740 1 Processor -- start 2024-09-19T05:20:03.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.726+0000 7f556a48d740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873e65d0 0x55c9873f0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:03.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.726+0000 7f556a48d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9873e7b40 0x55c9873ee0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:03.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.726+0000 7f556a48d740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9873f1370 0x55c9873ee860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:03.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.726+0000 7f556a48d740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c9873f4010 con 0x55c9873e65d0 2024-09-19T05:20:03.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.726+0000 7f556a48d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55c987307060 con 0x55c9873e7b40 2024-09-19T05:20:03.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.726+0000 7f556a48d740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c9873f4190 con 0x55c9873f1370 2024-09-19T05:20:03.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.726+0000 7f556a48d740 10 client.0 _ll_register_callbacks cb 0x55c98705a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:03.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.726+0000 7f556564f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9873e7b40 0x55c9873ee0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:03.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.726+0000 7f556564f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9873e7b40 0x55c9873ee0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:37252/0 (socket says 172.21.15.120:37252) 2024-09-19T05:20:03.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.726+0000 7f556564f640 1 -- 172.21.15.120:0/4123905513 learned_addr learned my addr 172.21.15.120:0/4123905513 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:03.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.726+0000 7f5565e50640 1 --2- 172.21.15.120:0/4123905513 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873e65d0 0x55c9873f0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:03.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.726+0000 7f5566651640 1 --2- 172.21.15.120:0/4123905513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9873f1370 0x55c9873ee860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:03.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.727+0000 7f5565e50640 1 -- 172.21.15.120:0/4123905513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9873f1370 msgr2=0x55c9873ee860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:03.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.727+0000 7f5565e50640 1 --2- 172.21.15.120:0/4123905513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9873f1370 0x55c9873ee860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.727+0000 7f5565e50640 1 -- 172.21.15.120:0/4123905513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9873e7b40 msgr2=0x55c9873ee0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:03.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.727+0000 7f5565e50640 1 --2- 172.21.15.120:0/4123905513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9873e7b40 0x55c9873ee0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.727+0000 7f5565e50640 1 -- 172.21.15.120:0/4123905513 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9870bd3c0 con 0x55c9873e65d0 2024-09-19T05:20:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.727+0000 7f5565e50640 1 --2- 172.21.15.120:0/4123905513 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873e65d0 0x55c9873f0e20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f555c0cce80 tx=0x7f555c097d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa16f07407c575c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.727+0000 7f55497fa640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:20:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.727+0000 7f55497fa640 1 -- 172.21.15.120:0/4123905513 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c0afe60 con 0x55c9873e65d0 2024-09-19T05:20:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.727+0000 7f556a48d740 1 -- 172.21.15.120:0/4123905513 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5550031630 con 0x55c9873e65d0 2024-09-19T05:20:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.727+0000 7f55497fa640 1 -- 172.21.15.120:0/4123905513 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f555c0cd360 con 0x55c9873e65d0 2024-09-19T05:20:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.727+0000 7f55497fa640 1 -- 172.21.15.120:0/4123905513 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f555c0b9050 con 0x55c9873e65d0 2024-09-19T05:20:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.727+0000 7f556a48d740 10 client.15441 fetch_fsmap learned FSMap version 25 2024-09-19T05:20:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.727+0000 7f556a48d740 1 -- 172.21.15.120:0/4123905513 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c9873ffc30 con 0x55c9873e65d0 2024-09-19T05:20:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.728+0000 7f55497fa640 1 -- 172.21.15.120:0/4123905513 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f555c009c30 con 0x55c9873e65d0 2024-09-19T05:20:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.728+0000 7f55497fa640 1 -- 172.21.15.120:0/4123905513 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f555c097740 con 0x55c9873e65d0 2024-09-19T05:20:03.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.728+0000 7f556a48d740 10 client.15441 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:20:03.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.728+0000 7f556a48d740 10 client.15441 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T05:20:03.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.728+0000 7f556a48d740 20 client.15441 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:03.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.728+0000 7f556a48d740 1 --2- 172.21.15.120:0/4123905513 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55c987401040 0x55c987403470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:03.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.728+0000 7f556a48d740 4 client.15441 mds_command: new command op to 24443 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:20:03.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.728+0000 7f556a48d740 1 -- 172.21.15.120:0/4123905513 --> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5550031630 con 0x55c987401040 2024-09-19T05:20:03.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.728+0000 7f556564f640 1 --2- 172.21.15.120:0/4123905513 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55c987401040 0x55c987403470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:03.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.729+0000 7f55497fa640 10 client.15441 ms_handle_connect on v2:172.21.15.178:6838/3389137566 2024-09-19T05:20:03.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.729+0000 7f556564f640 1 --2- 172.21.15.120:0/4123905513 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55c987401040 0x55c987403470 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f765bc4612c40e23 server_cookie=d1394266478b0c3b in_seq=0 out_seq=0 2024-09-19T05:20:03.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.729+0000 7f55497fa640 1 -- 172.21.15.120:0/4123905513 <== mds.1 v2:172.21.15.178:6838/3389137566 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f5550031630 con 0x55c987401040 2024-09-19T05:20:03.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.729+0000 7f55497fa640 10 client.15441 handle_command_reply: tid=0 2024-09-19T05:20:03.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.730+0000 7f556a48d740 1 client.15441 shutdown 2024-09-19T05:20:03.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.730+0000 7f556a48d740 1 -- 172.21.15.120:0/4123905513 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873e65d0 msgr2=0x55c9873f0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:03.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.730+0000 7f556a48d740 1 --2- 172.21.15.120:0/4123905513 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873e65d0 0x55c9873f0e20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f555c0cce80 tx=0x7f555c097d90 comp rx=0 tx=0).stop 2024-09-19T05:20:03.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.730+0000 7f556a48d740 1 -- 172.21.15.120:0/4123905513 shutdown_connections 2024-09-19T05:20:03.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.730+0000 7f556a48d740 1 --2- 172.21.15.120:0/4123905513 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55c987401040 0x55c987403470 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.730+0000 7f556a48d740 1 --2- 172.21.15.120:0/4123905513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9873f1370 0x55c9873ee860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.730+0000 7f556a48d740 1 --2- 172.21.15.120:0/4123905513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9873e7b40 0x55c9873ee0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.730+0000 7f556a48d740 1 --2- 172.21.15.120:0/4123905513 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873e65d0 0x55c9873f0e20 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.730+0000 7f556a48d740 1 -- 172.21.15.120:0/4123905513 >> 172.21.15.120:0/4123905513 conn(0x55c9873af310 msgr2=0x55c9873e8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:03.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.730+0000 7f55497fa640 0 client.15441 ms_handle_reset on v2:172.21.15.178:6838/3389137566 2024-09-19T05:20:03.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.730+0000 7f556a48d740 1 -- 172.21.15.120:0/4123905513 shutdown_connections 2024-09-19T05:20:03.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.730+0000 7f556a48d740 1 -- 172.21.15.120:0/4123905513 wait complete. 2024-09-19T05:20:03.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.730+0000 7f556a48d740 20 client.15441 trim_cache size 0 max 16384 2024-09-19T05:20:03.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.743+0000 7f556a48d740 1 Processor -- start 2024-09-19T05:20:03.745 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.743+0000 7f556a48d740 1 -- start start 2024-09-19T05:20:03.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.744+0000 7f556a48d740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873e65d0 0x55c9873e2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:03.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.744+0000 7f556a48d740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9873e7b40 0x55c987408d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:03.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.744+0000 7f556a48d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9873f1370 0x55c987409280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:03.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.744+0000 7f556a48d740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f55601b22e0 con 0x55c9873e65d0 2024-09-19T05:20:03.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.744+0000 7f556a48d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f55601afbb0 con 0x55c9873f1370 2024-09-19T05:20:03.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.744+0000 7f556a48d740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f55601ada00 con 0x55c9873e7b40 2024-09-19T05:20:03.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.744+0000 7f5565e50640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873e65d0 0x55c9873e2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:03.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.744+0000 7f556564f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9873e7b40 0x55c987408d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:03.746 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.744+0000 7f5565e50640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873e65d0 0x55c9873e2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56046/0 (socket says 172.21.15.120:56046) 2024-09-19T05:20:03.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.744+0000 7f5565e50640 1 -- 172.21.15.120:0/1209036593 learned_addr learned my addr 172.21.15.120:0/1209036593 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:03.747 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.744+0000 7f5566651640 1 --2- 172.21.15.120:0/1209036593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9873f1370 0x55c987409280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:03.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.744+0000 7f5565e50640 1 -- 172.21.15.120:0/1209036593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9873e7b40 msgr2=0x55c987408d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:03.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.745+0000 7f5565e50640 1 --2- 172.21.15.120:0/1209036593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9873e7b40 0x55c987408d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.745+0000 7f5565e50640 1 -- 172.21.15.120:0/1209036593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9873f1370 msgr2=0x55c987409280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:03.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.745+0000 7f5565e50640 1 --2- 172.21.15.120:0/1209036593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9873f1370 0x55c987409280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.745+0000 7f5565e50640 1 -- 172.21.15.120:0/1209036593 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9873eebd0 con 0x55c9873e65d0 2024-09-19T05:20:03.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.745+0000 7f5565e50640 1 --2- 172.21.15.120:0/1209036593 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873e65d0 0x55c9873e2e10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f555c09b6f0 tx=0x7f555c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d645b4a99f439e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:03.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.745+0000 7f554b7fe640 1 -- 172.21.15.120:0/1209036593 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c0afe60 con 0x55c9873e65d0 2024-09-19T05:20:03.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.745+0000 7f554b7fe640 1 -- 172.21.15.120:0/1209036593 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f555c015070 con 0x55c9873e65d0 2024-09-19T05:20:03.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.745+0000 7f554b7fe640 1 -- 172.21.15.120:0/1209036593 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c020040 con 0x55c9873e65d0 2024-09-19T05:20:03.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.746+0000 7f556a48d740 1 -- 172.21.15.120:0/1209036593 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873e65d0 msgr2=0x55c9873e2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:03.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.746+0000 7f556a48d740 1 --2- 172.21.15.120:0/1209036593 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873e65d0 0x55c9873e2e10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f555c09b6f0 tx=0x7f555c01e000 comp rx=0 tx=0).stop 2024-09-19T05:20:03.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.746+0000 7f556a48d740 1 -- 172.21.15.120:0/1209036593 shutdown_connections 2024-09-19T05:20:03.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.746+0000 7f556a48d740 1 --2- 172.21.15.120:0/1209036593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9873f1370 0x55c987409280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.746+0000 7f556a48d740 1 --2- 172.21.15.120:0/1209036593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9873e7b40 0x55c987408d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.746+0000 7f556a48d740 1 --2- 172.21.15.120:0/1209036593 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873e65d0 0x55c9873e2e10 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.746+0000 7f556a48d740 1 -- 172.21.15.120:0/1209036593 >> 172.21.15.120:0/1209036593 conn(0x55c9873af310 msgr2=0x55c9873e2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:03.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.746+0000 7f556a48d740 1 -- 172.21.15.120:0/1209036593 shutdown_connections 2024-09-19T05:20:03.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.746+0000 7f556a48d740 1 -- 172.21.15.120:0/1209036593 wait complete. 2024-09-19T05:20:03.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.747+0000 7f556a48d740 1 -- start start 2024-09-19T05:20:03.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.747+0000 7f556a48d740 1 Processor -- start 2024-09-19T05:20:03.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.747+0000 7f556a48d740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9873e65d0 0x55c9873f99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:03.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.747+0000 7f556a48d740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873e7b40 0x55c9873eac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:03.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.747+0000 7f556a48d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9873f1370 0x55c9873eb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:03.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.748+0000 7f556a48d740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f55601ae070 con 0x55c9873e7b40 2024-09-19T05:20:03.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.748+0000 7f556564f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873e7b40 0x55c9873eac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:03.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.748+0000 7f556564f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873e7b40 0x55c9873eac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56058/0 (socket says 172.21.15.120:56058) 2024-09-19T05:20:03.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.748+0000 7f556564f640 1 -- 172.21.15.120:0/188316524 learned_addr learned my addr 172.21.15.120:0/188316524 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:03.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.748+0000 7f556a48d740 1 -- 172.21.15.120:0/188316524 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f55601af4e0 con 0x55c9873f1370 2024-09-19T05:20:03.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.748+0000 7f556a48d740 1 -- 172.21.15.120:0/188316524 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f55601ae740 con 0x55c9873e65d0 2024-09-19T05:20:03.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.748+0000 7f5566651640 1 --2- 172.21.15.120:0/188316524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9873f1370 0x55c9873eb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:03.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.748+0000 7f5565e50640 1 --2- 172.21.15.120:0/188316524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9873e65d0 0x55c9873f99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:03.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.748+0000 7f556564f640 1 -- 172.21.15.120:0/188316524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9873e65d0 msgr2=0x55c9873f99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:03.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.748+0000 7f556564f640 1 --2- 172.21.15.120:0/188316524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9873e65d0 0x55c9873f99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.748+0000 7f556564f640 1 -- 172.21.15.120:0/188316524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9873f1370 msgr2=0x55c9873eb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:03.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.748+0000 7f556564f640 1 --2- 172.21.15.120:0/188316524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9873f1370 0x55c9873eb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.748+0000 7f556564f640 1 -- 172.21.15.120:0/188316524 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9873eb870 con 0x55c9873e7b40 2024-09-19T05:20:03.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.748+0000 7f556a48d740 10 client.0 _ll_register_callbacks cb 0x7f555c009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:03.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.748+0000 7f556a48d740 1 -- 172.21.15.120:0/188316524 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f555c015070 con 0x55c9873e7b40 2024-09-19T05:20:03.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.748+0000 7f556564f640 1 --2- 172.21.15.120:0/188316524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873e7b40 0x55c9873eac90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5550009850 tx=0x7f5550005500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d123f501dae995f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:03.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.748+0000 7f55497fa640 10 client.15447 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:20:03.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.749+0000 7f55497fa640 1 -- 172.21.15.120:0/188316524 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550035040 con 0x55c9873e7b40 2024-09-19T05:20:03.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.749+0000 7f55497fa640 1 -- 172.21.15.120:0/188316524 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f55500314d0 con 0x55c9873e7b40 2024-09-19T05:20:03.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.749+0000 7f55497fa640 1 -- 172.21.15.120:0/188316524 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5550040040 con 0x55c9873e7b40 2024-09-19T05:20:03.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.749+0000 7f556a48d740 10 client.15447 fetch_fsmap learned FSMap version 25 2024-09-19T05:20:03.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.749+0000 7f556a48d740 1 -- 172.21.15.120:0/188316524 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55c98746bb10 con 0x55c9873e7b40 2024-09-19T05:20:03.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.749+0000 7f55497fa640 1 -- 172.21.15.120:0/188316524 <== mon.0 v2:172.21.15.120:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f55500316d0 con 0x55c9873e7b40 2024-09-19T05:20:03.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.749+0000 7f556a48d740 10 client.15447 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:20:03.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.749+0000 7f556a48d740 10 client.15447 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T05:20:03.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.749+0000 7f556a48d740 20 client.15447 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:03.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.749+0000 7f556a48d740 1 --2- 172.21.15.120:0/188316524 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55c98746bd40 0x55c98746e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:03.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.749+0000 7f556a48d740 4 client.15447 mds_command: new command op to 24443 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T05:20:03.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.749+0000 7f556a48d740 1 -- 172.21.15.120:0/188316524 --> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c987359860 con 0x55c98746bd40 2024-09-19T05:20:03.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.750+0000 7f5565e50640 1 --2- 172.21.15.120:0/188316524 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55c98746bd40 0x55c98746e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:03.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.750+0000 7f5565e50640 1 --2- 172.21.15.120:0/188316524 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55c98746bd40 0x55c98746e130 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=429d745d541084cf server_cookie=3b1933547a8dd3d8 in_seq=0 out_seq=0 2024-09-19T05:20:03.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.750+0000 7f55497fa640 10 client.15447 ms_handle_connect on v2:172.21.15.178:6838/3389137566 2024-09-19T05:20:03.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.750+0000 7f55497fa640 1 -- 172.21.15.120:0/188316524 <== mds.1 v2:172.21.15.178:6838/3389137566 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c987359860 con 0x55c98746bd40 2024-09-19T05:20:03.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.750+0000 7f55497fa640 10 client.15447 handle_command_reply: tid=0 2024-09-19T05:20:03.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.750+0000 7f556a48d740 1 client.15447 shutdown 2024-09-19T05:20:03.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.750+0000 7f556a48d740 1 -- 172.21.15.120:0/188316524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873e7b40 msgr2=0x55c9873eac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:03.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.750+0000 7f556a48d740 1 --2- 172.21.15.120:0/188316524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873e7b40 0x55c9873eac90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5550009850 tx=0x7f5550005500 comp rx=0 tx=0).stop 2024-09-19T05:20:03.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.750+0000 7f556a48d740 1 -- 172.21.15.120:0/188316524 shutdown_connections 2024-09-19T05:20:03.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.751+0000 7f556a48d740 1 --2- 172.21.15.120:0/188316524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9873f1370 0x55c9873eb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.751+0000 7f556a48d740 1 --2- 172.21.15.120:0/188316524 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c9873e7b40 0x55c9873eac90 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.751+0000 7f556a48d740 1 --2- 172.21.15.120:0/188316524 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55c98746bd40 0x55c98746e130 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.751+0000 7f556a48d740 1 --2- 172.21.15.120:0/188316524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9873e65d0 0x55c9873f99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.751+0000 7f556a48d740 1 -- 172.21.15.120:0/188316524 >> 172.21.15.120:0/188316524 conn(0x55c9873af310 msgr2=0x55c9873e8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:03.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.751+0000 7f55497fa640 0 client.15447 ms_handle_reset on v2:172.21.15.178:6838/3389137566 2024-09-19T05:20:03.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.751+0000 7f556a48d740 1 -- 172.21.15.120:0/188316524 shutdown_connections 2024-09-19T05:20:03.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.751+0000 7f556a48d740 1 -- 172.21.15.120:0/188316524 wait complete. 2024-09-19T05:20:03.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.751+0000 7f556a48d740 20 client.15447 trim_cache size 0 max 16384 2024-09-19T05:20:03.757 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-09-19T05:20:03.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.752+0000 7f55680b4640 1 -- 172.21.15.120:0/1398025153 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f554c0a3620 msgr2=0x7f554c0a5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:03.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.752+0000 7f55680b4640 1 --2- 172.21.15.120:0/1398025153 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f554c0a3620 0x7f554c0a5ae0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5558005fd0 tx=0x7f5558009600 comp rx=0 tx=0).stop 2024-09-19T05:20:03.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.752+0000 7f55680b4640 1 -- 172.21.15.120:0/1398025153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5560102db0 msgr2=0x7f5560100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:03.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.752+0000 7f55680b4640 1 --2- 172.21.15.120:0/1398025153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5560102db0 0x7f5560100a10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f555c00d770 tx=0x7f555c00dc30 comp rx=0 tx=0).stop 2024-09-19T05:20:03.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.752+0000 7f55680b4640 1 -- 172.21.15.120:0/1398025153 shutdown_connections 2024-09-19T05:20:03.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.752+0000 7f55680b4640 1 --2- 172.21.15.120:0/1398025153 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f554c0a3620 0x7f554c0a5ae0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.752+0000 7f55680b4640 1 --2- 172.21.15.120:0/1398025153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55601082e0 0x7f5560101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.752+0000 7f55680b4640 1 --2- 172.21.15.120:0/1398025153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5560103760 0x7f5560100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.752+0000 7f55680b4640 1 --2- 172.21.15.120:0/1398025153 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5560102db0 0x7f5560100a10 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:03.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.752+0000 7f55680b4640 1 -- 172.21.15.120:0/1398025153 >> 172.21.15.120:0/1398025153 conn(0x7f55600fc7d0 msgr2=0x7f5560105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:03.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.752+0000 7f55680b4640 1 -- 172.21.15.120:0/1398025153 shutdown_connections 2024-09-19T05:20:03.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:03.752+0000 7f55680b4640 1 -- 172.21.15.120:0/1398025153 wait complete. 2024-09-19T05:20:04.541 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T05:20:04.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:04 smithi178 ceph-mon[34347]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T05:20:04.819 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:04.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:04 smithi120 ceph-mon[30956]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T05:20:04.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:04 smithi194 ceph-mon[35228]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T05:20:05.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.326+0000 7f95e0a92640 1 -- 172.21.15.120:0/460361137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95dc103760 msgr2=0x7f95dc107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:05.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.326+0000 7f95e0a92640 1 --2- 172.21.15.120:0/460361137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95dc103760 0x7f95dc107ba0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f95d0009930 tx=0x7f95d002a420 comp rx=0 tx=0).stop 2024-09-19T05:20:05.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.326+0000 7f95e0a92640 1 -- 172.21.15.120:0/460361137 shutdown_connections 2024-09-19T05:20:05.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.326+0000 7f95e0a92640 1 --2- 172.21.15.120:0/460361137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95dc1082e0 0x7f95dc10ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.381 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.326+0000 7f95e0a92640 1 --2- 172.21.15.120:0/460361137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95dc103760 0x7f95dc107ba0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.326+0000 7f95e0a92640 1 --2- 172.21.15.120:0/460361137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95dc102db0 0x7f95dc103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.326+0000 7f95e0a92640 1 -- 172.21.15.120:0/460361137 >> 172.21.15.120:0/460361137 conn(0x7f95dc0fc7d0 msgr2=0x7f95dc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:05.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.328+0000 7f95e0a92640 1 -- 172.21.15.120:0/460361137 shutdown_connections 2024-09-19T05:20:05.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.328+0000 7f95e0a92640 1 -- 172.21.15.120:0/460361137 wait complete. 2024-09-19T05:20:05.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.328+0000 7f95e0a92640 1 Processor -- start 2024-09-19T05:20:05.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.328+0000 7f95e0a92640 1 -- start start 2024-09-19T05:20:05.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.329+0000 7f95e0a92640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95dc102db0 0x7f95dc198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:05.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.329+0000 7f95e0a92640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95dc103760 0x7f95dc198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:05.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.329+0000 7f95e0a92640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95dc1082e0 0x7f95dc19ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:05.382 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.329+0000 7f95e0a92640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc111f20 con 0x7f95dc102db0 2024-09-19T05:20:05.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.329+0000 7f95e0a92640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc111da0 con 0x7f95dc1082e0 2024-09-19T05:20:05.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.329+0000 7f95e0a92640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc1120a0 con 0x7f95dc103760 2024-09-19T05:20:05.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.329+0000 7f95d9d9b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95dc103760 0x7f95dc198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:05.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.329+0000 7f95dad9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95dc1082e0 0x7f95dc19ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:05.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.329+0000 7f95dad9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95dc1082e0 0x7f95dc19ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:49956/0 (socket says 172.21.15.120:49956) 2024-09-19T05:20:05.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.329+0000 7f95dad9d640 1 -- 172.21.15.120:0/2533830133 learned_addr learned my addr 172.21.15.120:0/2533830133 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:05.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.329+0000 7f95d9d9b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95dc103760 0x7f95dc198ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:33460/0 (socket says 172.21.15.120:33460) 2024-09-19T05:20:05.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.329+0000 7f95d9d9b640 1 -- 172.21.15.120:0/2533830133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95dc1082e0 msgr2=0x7f95dc19ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:05.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.329+0000 7f95d9d9b640 1 --2- 172.21.15.120:0/2533830133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95dc1082e0 0x7f95dc19ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.383 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.329+0000 7f95d9d9b640 1 -- 172.21.15.120:0/2533830133 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95dc102db0 msgr2=0x7f95dc198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:05.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.329+0000 7f95d9d9b640 1 --2- 172.21.15.120:0/2533830133 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95dc102db0 0x7f95dc198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.329+0000 7f95d9d9b640 1 -- 172.21.15.120:0/2533830133 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95dc19d540 con 0x7f95dc103760 2024-09-19T05:20:05.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.330+0000 7f95d9d9b640 1 --2- 172.21.15.120:0/2533830133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95dc103760 0x7f95dc198ad0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f95d002a940 tx=0x7f95d00042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:05.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.330+0000 7f95cb7fe640 1 -- 172.21.15.120:0/2533830133 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d003f070 con 0x7f95dc103760 2024-09-19T05:20:05.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.330+0000 7f95e0a92640 1 -- 172.21.15.120:0/2533830133 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95dc19d7d0 con 0x7f95dc103760 2024-09-19T05:20:05.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.330+0000 7f95cb7fe640 1 -- 172.21.15.120:0/2533830133 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f95d003b460 con 0x7f95dc103760 2024-09-19T05:20:05.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.330+0000 7f95cb7fe640 1 -- 172.21.15.120:0/2533830133 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d0035070 con 0x7f95dc103760 2024-09-19T05:20:05.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.330+0000 7f95e0a92640 1 -- 172.21.15.120:0/2533830133 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95dc100940 con 0x7f95dc103760 2024-09-19T05:20:05.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.333+0000 7f95cb7fe640 1 -- 172.21.15.120:0/2533830133 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7f95d003b610 con 0x7f95dc103760 2024-09-19T05:20:05.384 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.333+0000 7f95e2e6b740 1 Processor -- start 2024-09-19T05:20:05.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.334+0000 7f95e2e6b740 1 -- start start 2024-09-19T05:20:05.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.334+0000 7f95cb7fe640 1 --2- 172.21.15.120:0/2533830133 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f95c40a3550 0x7f95c40a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:05.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.334+0000 7f95e2e6b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56190b53fb40 0x56190b53e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:05.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.334+0000 7f95e2e6b740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56190b53e5d0 0x56190b53ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:05.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.334+0000 7f95e2e6b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b549370 0x56190b54b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:05.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.334+0000 7f95e2e6b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56190b4a42f0 con 0x56190b549370 2024-09-19T05:20:05.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.334+0000 7f95e2e6b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56190b44bcf0 con 0x56190b53fb40 2024-09-19T05:20:05.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.334+0000 7f95e2e6b740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56190b4a02b0 con 0x56190b53e5d0 2024-09-19T05:20:05.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.334+0000 7f95cb7fe640 1 -- 172.21.15.120:0/2533830133 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f95d00f0440 con 0x7f95dc103760 2024-09-19T05:20:05.385 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.334+0000 7f95dad9d640 1 --2- 172.21.15.120:0/2533830133 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f95c40a3550 0x7f95c40a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:05.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.334+0000 7f95d9d9b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56190b53e5d0 0x56190b53ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:05.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.334+0000 7f95dad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b549370 0x56190b54b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:05.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.334+0000 7f95dad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b549370 0x56190b54b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46518/0 (socket says 172.21.15.120:46518) 2024-09-19T05:20:05.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.334+0000 7f95dad9d640 1 -- 172.21.15.120:0/829803579 learned_addr learned my addr 172.21.15.120:0/829803579 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:05.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.334+0000 7f95da59c640 1 --2- 172.21.15.120:0/829803579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56190b53fb40 0x56190b53e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:05.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.335+0000 7f95d9d9b640 1 -- 172.21.15.120:0/829803579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56190b53fb40 msgr2=0x56190b53e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:05.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.335+0000 7f95d9d9b640 1 --2- 172.21.15.120:0/829803579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56190b53fb40 0x56190b53e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.386 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.335+0000 7f95d9d9b640 1 -- 172.21.15.120:0/829803579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b549370 msgr2=0x56190b54b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:05.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.335+0000 7f95d9d9b640 1 --2- 172.21.15.120:0/829803579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b549370 0x56190b54b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.335+0000 7f95d9d9b640 1 -- 172.21.15.120:0/829803579 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56190b4303a0 con 0x56190b53e5d0 2024-09-19T05:20:05.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.335+0000 7f95dad9d640 1 --2- 172.21.15.120:0/829803579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b549370 0x56190b54b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:05.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.335+0000 7f95d9d9b640 1 --2- 172.21.15.120:0/829803579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56190b53e5d0 0x56190b53ea10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f95d00ed9c0 tx=0x7f95d00bc150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11998e582a3a8124 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:05.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.336+0000 7f95dad9d640 1 --2- 172.21.15.120:0/2533830133 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f95c40a3550 0x7f95c40a5a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x56190b53f070 tx=0x7f95d4009b60 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:05.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.336+0000 7f95c8ff9640 1 -- 172.21.15.120:0/829803579 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d0048040 con 0x56190b53e5d0 2024-09-19T05:20:05.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.336+0000 7f95c8ff9640 1 -- 172.21.15.120:0/829803579 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f95d00bcc50 con 0x56190b53e5d0 2024-09-19T05:20:05.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.336+0000 7f95c8ff9640 1 -- 172.21.15.120:0/829803579 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d00b8bc0 con 0x56190b53e5d0 2024-09-19T05:20:05.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.337+0000 7f95e2e6b740 1 -- 172.21.15.120:0/829803579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56190b53e5d0 msgr2=0x56190b53ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:05.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.337+0000 7f95e2e6b740 1 --2- 172.21.15.120:0/829803579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56190b53e5d0 0x56190b53ea10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f95d00ed9c0 tx=0x7f95d00bc150 comp rx=0 tx=0).stop 2024-09-19T05:20:05.387 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.337+0000 7f95e2e6b740 1 -- 172.21.15.120:0/829803579 shutdown_connections 2024-09-19T05:20:05.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.337+0000 7f95e2e6b740 1 --2- 172.21.15.120:0/829803579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b549370 0x56190b54b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.337+0000 7f95e2e6b740 1 --2- 172.21.15.120:0/829803579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56190b53e5d0 0x56190b53ea10 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f95d00ed9c0 tx=0x7f95d00bc150 comp rx=0 tx=0).stop 2024-09-19T05:20:05.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.337+0000 7f95e2e6b740 1 --2- 172.21.15.120:0/829803579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56190b53fb40 0x56190b53e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.337+0000 7f95e2e6b740 1 -- 172.21.15.120:0/829803579 >> 172.21.15.120:0/829803579 conn(0x56190b507310 msgr2=0x56190b53ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:05.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.337+0000 7f95e2e6b740 1 -- 172.21.15.120:0/829803579 shutdown_connections 2024-09-19T05:20:05.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.337+0000 7f95e2e6b740 1 -- 172.21.15.120:0/829803579 wait complete. 2024-09-19T05:20:05.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.337+0000 7f95e2e6b740 1 -- start start 2024-09-19T05:20:05.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.337+0000 7f95e2e6b740 1 Processor -- start 2024-09-19T05:20:05.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.338+0000 7f95e2e6b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b53fb40 0x56190b546220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:05.388 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.338+0000 7f95e2e6b740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56190b549370 0x56190b546760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:05.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.338+0000 7f95e2e6b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56190b546ca0 0x56190b566230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:05.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.338+0000 7f95e2e6b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56190b54be30 con 0x56190b53fb40 2024-09-19T05:20:05.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.338+0000 7f95d9d9b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56190b549370 0x56190b546760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:05.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.338+0000 7f95d9d9b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56190b549370 0x56190b546760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:33482/0 (socket says 172.21.15.120:33482) 2024-09-19T05:20:05.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.338+0000 7f95d9d9b640 1 -- 172.21.15.120:0/1913107501 learned_addr learned my addr 172.21.15.120:0/1913107501 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:05.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.338+0000 7f95e2e6b740 1 -- 172.21.15.120:0/1913107501 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56190b45f060 con 0x56190b546ca0 2024-09-19T05:20:05.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.338+0000 7f95e2e6b740 1 -- 172.21.15.120:0/1913107501 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56190b54bfb0 con 0x56190b549370 2024-09-19T05:20:05.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.338+0000 7f95dad9d640 1 --2- 172.21.15.120:0/1913107501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56190b546ca0 0x56190b566230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:05.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.338+0000 7f95da59c640 1 --2- 172.21.15.120:0/1913107501 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b53fb40 0x56190b546220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:05.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.338+0000 7f95e2e6b740 10 client.0 _ll_register_callbacks cb 0x56190b1b28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:05.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.338+0000 7f95dad9d640 1 -- 172.21.15.120:0/1913107501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56190b549370 msgr2=0x56190b546760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:05.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.338+0000 7f95dad9d640 1 --2- 172.21.15.120:0/1913107501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56190b549370 0x56190b546760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.338+0000 7f95dad9d640 1 -- 172.21.15.120:0/1913107501 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b53fb40 msgr2=0x56190b546220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:05.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.338+0000 7f95dad9d640 1 --2- 172.21.15.120:0/1913107501 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b53fb40 0x56190b546220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.338+0000 7f95dad9d640 1 -- 172.21.15.120:0/1913107501 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56190b2153c0 con 0x56190b546ca0 2024-09-19T05:20:05.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.339+0000 7f95dad9d640 1 --2- 172.21.15.120:0/1913107501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56190b546ca0 0x56190b566230 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f95d4011bf0 tx=0x7f95d4004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79a501ce99a137dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:05.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.339+0000 7f95d9d9b640 1 --2- 172.21.15.120:0/1913107501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56190b549370 0x56190b546760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:20:05.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.339+0000 7f95c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:20:05.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.339+0000 7f95c1ffb640 1 -- 172.21.15.120:0/1913107501 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d4020e40 con 0x56190b546ca0 2024-09-19T05:20:05.390 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.339+0000 7f95c1ffb640 1 -- 172.21.15.120:0/1913107501 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f95d401e3e0 con 0x56190b546ca0 2024-09-19T05:20:05.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.339+0000 7f95e2e6b740 1 -- 172.21.15.120:0/1913107501 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95d00bcc50 con 0x56190b546ca0 2024-09-19T05:20:05.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.339+0000 7f95c1ffb640 1 -- 172.21.15.120:0/1913107501 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f95d401e5e0 con 0x56190b546ca0 2024-09-19T05:20:05.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.339+0000 7f95e2e6b740 10 client.24944 fetch_fsmap learned FSMap version 25 2024-09-19T05:20:05.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.339+0000 7f95e2e6b740 1 -- 172.21.15.120:0/1913107501 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56190b568de0 con 0x56190b546ca0 2024-09-19T05:20:05.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.339+0000 7f95c1ffb640 1 -- 172.21.15.120:0/1913107501 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f95d00bcc50 con 0x56190b546ca0 2024-09-19T05:20:05.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.340+0000 7f95c1ffb640 1 -- 172.21.15.120:0/1913107501 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f95d401d040 con 0x56190b546ca0 2024-09-19T05:20:05.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.340+0000 7f95e2e6b740 10 client.24944 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:20:05.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.340+0000 7f95e2e6b740 10 client.24944 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:20:05.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.340+0000 7f95e2e6b740 20 client.24944 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:05.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.341+0000 7f95e2e6b740 1 --2- 172.21.15.120:0/1913107501 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56190b56a2a0 0x56190b56c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:05.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.341+0000 7f95e2e6b740 4 client.24944 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:20:05.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.341+0000 7f95da59c640 1 --2- 172.21.15.120:0/1913107501 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56190b56a2a0 0x56190b56c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:05.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.341+0000 7f95e2e6b740 1 -- 172.21.15.120:0/1913107501 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56190b4b1860 con 0x56190b56a2a0 2024-09-19T05:20:05.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.342+0000 7f95da59c640 1 --2- 172.21.15.120:0/1913107501 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56190b56a2a0 0x56190b56c710 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1924c5dd95e1e5f8 server_cookie=848b52581b6b28f0 in_seq=0 out_seq=0 2024-09-19T05:20:05.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.342+0000 7f95c1ffb640 10 client.24944 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:05.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.342+0000 7f95c1ffb640 1 -- 172.21.15.120:0/1913107501 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56190b4b1860 con 0x56190b56a2a0 2024-09-19T05:20:05.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.342+0000 7f95c1ffb640 10 client.24944 handle_command_reply: tid=0 2024-09-19T05:20:05.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.342+0000 7f95e2e6b740 1 client.24944 shutdown 2024-09-19T05:20:05.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.342+0000 7f95e2e6b740 1 -- 172.21.15.120:0/1913107501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56190b546ca0 msgr2=0x56190b566230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:05.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.342+0000 7f95e2e6b740 1 --2- 172.21.15.120:0/1913107501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56190b546ca0 0x56190b566230 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f95d4011bf0 tx=0x7f95d4004ab0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.343+0000 7f95e2e6b740 1 -- 172.21.15.120:0/1913107501 shutdown_connections 2024-09-19T05:20:05.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.343+0000 7f95e2e6b740 1 --2- 172.21.15.120:0/1913107501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56190b546ca0 0x56190b566230 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.343+0000 7f95e2e6b740 1 --2- 172.21.15.120:0/1913107501 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56190b56a2a0 0x56190b56c710 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.343+0000 7f95e2e6b740 1 --2- 172.21.15.120:0/1913107501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56190b549370 0x56190b546760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.343+0000 7f95e2e6b740 1 --2- 172.21.15.120:0/1913107501 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b53fb40 0x56190b546220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.393 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.343+0000 7f95e2e6b740 1 -- 172.21.15.120:0/1913107501 >> 172.21.15.120:0/1913107501 conn(0x56190b507310 msgr2=0x56190b540960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:05.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.343+0000 7f95c1ffb640 0 client.24944 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:05.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.343+0000 7f95e2e6b740 1 -- 172.21.15.120:0/1913107501 shutdown_connections 2024-09-19T05:20:05.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.343+0000 7f95e2e6b740 1 -- 172.21.15.120:0/1913107501 wait complete. 2024-09-19T05:20:05.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.343+0000 7f95e2e6b740 20 client.24944 trim_cache size 0 max 16384 2024-09-19T05:20:05.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.368+0000 7f95e2e6b740 1 Processor -- start 2024-09-19T05:20:05.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.368+0000 7f95e2e6b740 1 -- start start 2024-09-19T05:20:05.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.368+0000 7f95e2e6b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b53fb40 0x56190b547a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:05.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.368+0000 7f95e2e6b740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56190b546ca0 0x56190b54a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:05.394 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.368+0000 7f95da59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b53fb40 0x56190b547a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:05.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.368+0000 7f95da59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b53fb40 0x56190b547a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46546/0 (socket says 172.21.15.120:46546) 2024-09-19T05:20:05.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.368+0000 7f95da59c640 1 -- 172.21.15.120:0/805695733 learned_addr learned my addr 172.21.15.120:0/805695733 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:05.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.368+0000 7f95e2e6b740 1 --2- 172.21.15.120:0/805695733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56190b549370 0x56190b54aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:05.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.368+0000 7f95e2e6b740 1 -- 172.21.15.120:0/805695733 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc1a5800 con 0x56190b53fb40 2024-09-19T05:20:05.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.368+0000 7f95e2e6b740 1 -- 172.21.15.120:0/805695733 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc0723e0 con 0x56190b549370 2024-09-19T05:20:05.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.368+0000 7f95e2e6b740 1 -- 172.21.15.120:0/805695733 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc070230 con 0x56190b546ca0 2024-09-19T05:20:05.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.369+0000 7f95d9d9b640 1 --2- 172.21.15.120:0/805695733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56190b546ca0 0x56190b54a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:05.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.369+0000 7f95da59c640 1 -- 172.21.15.120:0/805695733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56190b546ca0 msgr2=0x56190b54a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:05.395 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.369+0000 7f95da59c640 1 --2- 172.21.15.120:0/805695733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56190b546ca0 0x56190b54a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.369+0000 7f95da59c640 1 -- 172.21.15.120:0/805695733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56190b549370 msgr2=0x56190b54aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:05.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.369+0000 7f95da59c640 1 --2- 172.21.15.120:0/805695733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56190b549370 0x56190b54aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.369+0000 7f95da59c640 1 -- 172.21.15.120:0/805695733 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56190b548930 con 0x56190b53fb40 2024-09-19T05:20:05.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.369+0000 7f95d9d9b640 1 --2- 172.21.15.120:0/805695733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56190b546ca0 0x56190b54a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:20:05.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.369+0000 7f95da59c640 1 --2- 172.21.15.120:0/805695733 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b53fb40 0x56190b547a80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f95cc000c00 tx=0x7f95cc00a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ef0564c6ddba8a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:05.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.369+0000 7f95c3fff640 1 -- 172.21.15.120:0/805695733 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc0242d0 con 0x56190b53fb40 2024-09-19T05:20:05.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.369+0000 7f95c3fff640 1 -- 172.21.15.120:0/805695733 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f95cc02b7e0 con 0x56190b53fb40 2024-09-19T05:20:05.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.369+0000 7f95c3fff640 1 -- 172.21.15.120:0/805695733 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc0227b0 con 0x56190b53fb40 2024-09-19T05:20:05.396 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.370+0000 7f95e2e6b740 1 -- 172.21.15.120:0/805695733 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b53fb40 msgr2=0x56190b547a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:05.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.370+0000 7f95e2e6b740 1 --2- 172.21.15.120:0/805695733 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b53fb40 0x56190b547a80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f95cc000c00 tx=0x7f95cc00a2c0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.370+0000 7f95e2e6b740 1 -- 172.21.15.120:0/805695733 shutdown_connections 2024-09-19T05:20:05.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.370+0000 7f95e2e6b740 1 --2- 172.21.15.120:0/805695733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56190b549370 0x56190b54aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.370+0000 7f95e2e6b740 1 --2- 172.21.15.120:0/805695733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56190b546ca0 0x56190b54a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.370+0000 7f95e2e6b740 1 --2- 172.21.15.120:0/805695733 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b53fb40 0x56190b547a80 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.370+0000 7f95e2e6b740 1 -- 172.21.15.120:0/805695733 >> 172.21.15.120:0/805695733 conn(0x56190b507310 msgr2=0x56190b546300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:05.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.370+0000 7f95e2e6b740 1 -- 172.21.15.120:0/805695733 shutdown_connections 2024-09-19T05:20:05.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.370+0000 7f95e2e6b740 1 -- 172.21.15.120:0/805695733 wait complete. 2024-09-19T05:20:05.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.371+0000 7f95e2e6b740 1 -- start start 2024-09-19T05:20:05.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.371+0000 7f95e2e6b740 1 Processor -- start 2024-09-19T05:20:05.397 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.371+0000 7f95e2e6b740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56190b53fb40 0x56190b562210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:05.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.371+0000 7f95e2e6b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b546ca0 0x56190b562750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:05.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.371+0000 7f95e2e6b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56190b549370 0x56190b54a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:05.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.371+0000 7f95d9d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b546ca0 0x56190b562750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:05.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.371+0000 7f95e2e6b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc0708a0 con 0x56190b546ca0 2024-09-19T05:20:05.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.371+0000 7f95e2e6b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc071d10 con 0x56190b549370 2024-09-19T05:20:05.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.371+0000 7f95e2e6b740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f95dc070f70 con 0x56190b53fb40 2024-09-19T05:20:05.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.371+0000 7f95d9d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b546ca0 0x56190b562750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46558/0 (socket says 172.21.15.120:46558) 2024-09-19T05:20:05.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.371+0000 7f95d9d9b640 1 -- 172.21.15.120:0/3301778295 learned_addr learned my addr 172.21.15.120:0/3301778295 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:05.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.371+0000 7f95e2e6b740 10 client.0 _ll_register_callbacks cb 0x7f95d40099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:05.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.371+0000 7f95dad9d640 1 --2- 172.21.15.120:0/3301778295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56190b549370 0x56190b54a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:05.398 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.371+0000 7f95da59c640 1 --2- 172.21.15.120:0/3301778295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56190b53fb40 0x56190b562210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:05.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.372+0000 7f95d9d9b640 1 -- 172.21.15.120:0/3301778295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56190b53fb40 msgr2=0x56190b562210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:05.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.372+0000 7f95d9d9b640 1 --2- 172.21.15.120:0/3301778295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56190b53fb40 0x56190b562210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.372+0000 7f95d9d9b640 1 -- 172.21.15.120:0/3301778295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56190b549370 msgr2=0x56190b54a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:05.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.372+0000 7f95d9d9b640 1 --2- 172.21.15.120:0/3301778295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56190b549370 0x56190b54a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.372+0000 7f95d9d9b640 1 -- 172.21.15.120:0/3301778295 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56190b544010 con 0x56190b546ca0 2024-09-19T05:20:05.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.372+0000 7f95dad9d640 1 --2- 172.21.15.120:0/3301778295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56190b549370 0x56190b54a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:05.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.372+0000 7f95d9d9b640 1 --2- 172.21.15.120:0/3301778295 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b546ca0 0x56190b562750 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f95d0006010 tx=0x7f95d0005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b879820580ab3081 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:05.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.372+0000 7f95c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:20:05.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.372+0000 7f95c1ffb640 1 -- 172.21.15.120:0/3301778295 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d0048040 con 0x56190b546ca0 2024-09-19T05:20:05.399 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.372+0000 7f95c1ffb640 1 -- 172.21.15.120:0/3301778295 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f95d003b980 con 0x56190b546ca0 2024-09-19T05:20:05.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.372+0000 7f95e2e6b740 1 -- 172.21.15.120:0/3301778295 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95cc02b7e0 con 0x56190b546ca0 2024-09-19T05:20:05.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.373+0000 7f95c1ffb640 1 -- 172.21.15.120:0/3301778295 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f95d00bcc50 con 0x56190b546ca0 2024-09-19T05:20:05.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.373+0000 7f95e2e6b740 10 client.15462 fetch_fsmap learned FSMap version 25 2024-09-19T05:20:05.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.373+0000 7f95e2e6b740 1 -- 172.21.15.120:0/3301778295 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56190b5d5310 con 0x56190b546ca0 2024-09-19T05:20:05.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.373+0000 7f95c1ffb640 1 -- 172.21.15.120:0/3301778295 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f95d00bc550 con 0x56190b546ca0 2024-09-19T05:20:05.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.373+0000 7f95c1ffb640 1 -- 172.21.15.120:0/3301778295 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f95d00c4d30 con 0x56190b546ca0 2024-09-19T05:20:05.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.373+0000 7f95e2e6b740 10 client.15462 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:20:05.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.373+0000 7f95e2e6b740 10 client.15462 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:20:05.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.373+0000 7f95e2e6b740 20 client.15462 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:05.400 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.373+0000 7f95e2e6b740 1 --2- 172.21.15.120:0/3301778295 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56190b5d5920 0x56190b5d7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:05.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.373+0000 7f95e2e6b740 4 client.15462 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T05:20:05.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.373+0000 7f95e2e6b740 1 -- 172.21.15.120:0/3301778295 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f95cc02b7e0 con 0x56190b5d5920 2024-09-19T05:20:05.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.373+0000 7f95da59c640 1 --2- 172.21.15.120:0/3301778295 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56190b5d5920 0x56190b5d7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:05.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.374+0000 7f95c1ffb640 10 client.15462 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:05.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.374+0000 7f95da59c640 1 --2- 172.21.15.120:0/3301778295 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56190b5d5920 0x56190b5d7d40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=182d1835906cba6a server_cookie=c87947310280054a in_seq=0 out_seq=0 2024-09-19T05:20:05.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.374+0000 7f95c1ffb640 1 -- 172.21.15.120:0/3301778295 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f95cc02b7e0 con 0x56190b5d5920 2024-09-19T05:20:05.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.374+0000 7f95c1ffb640 10 client.15462 handle_command_reply: tid=0 2024-09-19T05:20:05.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.374+0000 7f95e2e6b740 1 client.15462 shutdown 2024-09-19T05:20:05.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.374+0000 7f95e2e6b740 1 -- 172.21.15.120:0/3301778295 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b546ca0 msgr2=0x56190b562750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:05.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.374+0000 7f95e2e6b740 1 --2- 172.21.15.120:0/3301778295 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b546ca0 0x56190b562750 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f95d0006010 tx=0x7f95d0005b70 comp rx=0 tx=0).stop 2024-09-19T05:20:05.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.374+0000 7f95e2e6b740 1 -- 172.21.15.120:0/3301778295 shutdown_connections 2024-09-19T05:20:05.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.374+0000 7f95e2e6b740 1 --2- 172.21.15.120:0/3301778295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56190b549370 0x56190b54a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.374+0000 7f95e2e6b740 1 --2- 172.21.15.120:0/3301778295 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56190b546ca0 0x56190b562750 secure :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f95d0006010 tx=0x7f95d0005b70 comp rx=0 tx=0).stop 2024-09-19T05:20:05.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.374+0000 7f95e2e6b740 1 --2- 172.21.15.120:0/3301778295 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56190b5d5920 0x56190b5d7d40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.402 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.374+0000 7f95c1ffb640 0 client.15462 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:05.402 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-09-19T05:20:05.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.374+0000 7f95e2e6b740 1 --2- 172.21.15.120:0/3301778295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56190b53fb40 0x56190b562210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.404 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.374+0000 7f95e2e6b740 1 -- 172.21.15.120:0/3301778295 >> 172.21.15.120:0/3301778295 conn(0x56190b507310 msgr2=0x56190b5394e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:05.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.375+0000 7f95e2e6b740 1 -- 172.21.15.120:0/3301778295 shutdown_connections 2024-09-19T05:20:05.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.375+0000 7f95e2e6b740 1 -- 172.21.15.120:0/3301778295 wait complete. 2024-09-19T05:20:05.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.375+0000 7f95e2e6b740 20 client.15462 trim_cache size 0 max 16384 2024-09-19T05:20:05.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.375+0000 7f95e0a92640 1 -- 172.21.15.120:0/2533830133 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f95c40a3550 msgr2=0x7f95c40a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:05.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.375+0000 7f95e0a92640 1 --2- 172.21.15.120:0/2533830133 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f95c40a3550 0x7f95c40a5a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x56190b53f070 tx=0x7f95d4009b60 comp rx=0 tx=0).stop 2024-09-19T05:20:05.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.375+0000 7f95e0a92640 1 -- 172.21.15.120:0/2533830133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95dc103760 msgr2=0x7f95dc198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:05.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.375+0000 7f95e0a92640 1 --2- 172.21.15.120:0/2533830133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95dc103760 0x7f95dc198ad0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f95d002a940 tx=0x7f95d00042f0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.376+0000 7f95e0a92640 1 -- 172.21.15.120:0/2533830133 shutdown_connections 2024-09-19T05:20:05.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.376+0000 7f95e0a92640 1 --2- 172.21.15.120:0/2533830133 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f95c40a3550 0x7f95c40a5a10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.405 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.376+0000 7f95e0a92640 1 --2- 172.21.15.120:0/2533830133 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95dc1082e0 0x7f95dc19ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.376+0000 7f95e0a92640 1 --2- 172.21.15.120:0/2533830133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95dc103760 0x7f95dc198ad0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.376+0000 7f95e0a92640 1 --2- 172.21.15.120:0/2533830133 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95dc102db0 0x7f95dc198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:05.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.376+0000 7f95e0a92640 1 -- 172.21.15.120:0/2533830133 >> 172.21.15.120:0/2533830133 conn(0x7f95dc0fc7d0 msgr2=0x7f95dc105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:05.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.376+0000 7f95e0a92640 1 -- 172.21.15.120:0/2533830133 shutdown_connections 2024-09-19T05:20:05.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:05.376+0000 7f95e0a92640 1 -- 172.21.15.120:0/2533830133 wait complete. 2024-09-19T05:20:06.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.633+0000 7fd5cadbd640 1 -- 172.21.15.120:0/1599427303 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5c41069c0 msgr2=0x7fd5c4106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:06.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.633+0000 7fd5cadbd640 1 --2- 172.21.15.120:0/1599427303 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5c41069c0 0x7fd5c4106da0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8009930 tx=0x7fd5b802a420 comp rx=0 tx=0).stop 2024-09-19T05:20:06.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.633+0000 7fd5cadbd640 1 -- 172.21.15.120:0/1599427303 shutdown_connections 2024-09-19T05:20:06.636 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.633+0000 7fd5cadbd640 1 --2- 172.21.15.120:0/1599427303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5c4101350 0x7fd5c410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.633+0000 7fd5cadbd640 1 --2- 172.21.15.120:0/1599427303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5c41009b0 0x7fd5c4100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.633+0000 7fd5cadbd640 1 --2- 172.21.15.120:0/1599427303 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5c41069c0 0x7fd5c4106da0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.633+0000 7fd5cadbd640 1 -- 172.21.15.120:0/1599427303 >> 172.21.15.120:0/1599427303 conn(0x7fd5c4077990 msgr2=0x7fd5c40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:06.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.633+0000 7fd5cadbd640 1 -- 172.21.15.120:0/1599427303 shutdown_connections 2024-09-19T05:20:06.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.633+0000 7fd5cadbd640 1 -- 172.21.15.120:0/1599427303 wait complete. 2024-09-19T05:20:06.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.634+0000 7fd5cadbd640 1 Processor -- start 2024-09-19T05:20:06.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.634+0000 7fd5cadbd640 1 -- start start 2024-09-19T05:20:06.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.634+0000 7fd5cadbd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5c41009b0 0x7fd5c4198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:06.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.634+0000 7fd5cadbd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5c4101350 0x7fd5c41987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:06.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.634+0000 7fd5cadbd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5c41069c0 0x7fd5c419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:06.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.634+0000 7fd5cadbd640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c4110c70 con 0x7fd5c4101350 2024-09-19T05:20:06.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.634+0000 7fd5cadbd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c4110af0 con 0x7fd5c41069c0 2024-09-19T05:20:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.634+0000 7fd5cadbd640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c4110df0 con 0x7fd5c41009b0 2024-09-19T05:20:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.634+0000 7fd5c3fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5c4101350 0x7fd5c41987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.634+0000 7fd5c3fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5c4101350 0x7fd5c41987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46582/0 (socket says 172.21.15.120:46582) 2024-09-19T05:20:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.634+0000 7fd5c3fff640 1 -- 172.21.15.120:0/2313303974 learned_addr learned my addr 172.21.15.120:0/2313303974 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.634+0000 7fd5c8b59640 1 --2- 172.21.15.120:0/2313303974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5c41009b0 0x7fd5c4198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.634+0000 7fd5c3fff640 1 -- 172.21.15.120:0/2313303974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5c41009b0 msgr2=0x7fd5c4198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.634+0000 7fd5c935a640 1 --2- 172.21.15.120:0/2313303974 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5c41069c0 0x7fd5c419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.634+0000 7fd5c3fff640 1 --2- 172.21.15.120:0/2313303974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5c41009b0 0x7fd5c4198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.634+0000 7fd5c3fff640 1 -- 172.21.15.120:0/2313303974 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5c41069c0 msgr2=0x7fd5c419cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.634+0000 7fd5c3fff640 1 --2- 172.21.15.120:0/2313303974 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5c41069c0 0x7fd5c419cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.634+0000 7fd5c3fff640 1 -- 172.21.15.120:0/2313303974 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c419d270 con 0x7fd5c4101350 2024-09-19T05:20:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.634+0000 7fd5c935a640 1 --2- 172.21.15.120:0/2313303974 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5c41069c0 0x7fd5c419cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:20:06.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.635+0000 7fd5c3fff640 1 --2- 172.21.15.120:0/2313303974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5c4101350 0x7fd5c41987c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd5b000d950 tx=0x7fd5b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:06.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.635+0000 7fd5c1ffb640 1 -- 172.21.15.120:0/2313303974 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b0017030 con 0x7fd5c4101350 2024-09-19T05:20:06.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.635+0000 7fd5c1ffb640 1 -- 172.21.15.120:0/2313303974 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd5b0004020 con 0x7fd5c4101350 2024-09-19T05:20:06.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.635+0000 7fd5cadbd640 1 -- 172.21.15.120:0/2313303974 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5c419d560 con 0x7fd5c4101350 2024-09-19T05:20:06.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.635+0000 7fd5c1ffb640 1 -- 172.21.15.120:0/2313303974 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b00047a0 con 0x7fd5c4101350 2024-09-19T05:20:06.640 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.635+0000 7fd5cadbd640 1 -- 172.21.15.120:0/2313303974 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5c41a4df0 con 0x7fd5c4101350 2024-09-19T05:20:06.640 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.638+0000 7fd5c1ffb640 1 -- 172.21.15.120:0/2313303974 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7fd5b00041d0 con 0x7fd5c4101350 2024-09-19T05:20:06.642 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.639+0000 7fd5cdc31740 1 Processor -- start 2024-09-19T05:20:06.642 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.639+0000 7fd5cdc31740 1 -- start start 2024-09-19T05:20:06.642 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.639+0000 7fd5c1ffb640 1 --2- 172.21.15.120:0/2313303974 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fd5b40a3600 0x7fd5b40a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:06.642 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.639+0000 7fd5cdc31740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3bd9d0 0x5613dd3bddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:06.642 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.639+0000 7fd5cdc31740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613dd3be2f0 0x5613dd3ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:06.642 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.639+0000 7fd5cdc31740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613dd3cd0c0 0x5613dd3cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.639+0000 7fd5cdc31740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5613dd3222f0 con 0x5613dd3bd9d0 2024-09-19T05:20:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.639+0000 7fd5cdc31740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5613dd2ca270 con 0x5613dd3be2f0 2024-09-19T05:20:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.639+0000 7fd5cdc31740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5613dd31e2b0 con 0x5613dd3cd0c0 2024-09-19T05:20:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.639+0000 7fd5c1ffb640 1 -- 172.21.15.120:0/2313303974 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fd5b00cfa70 con 0x7fd5c4101350 2024-09-19T05:20:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.639+0000 7fd5c8b59640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3bd9d0 0x5613dd3bddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.639+0000 7fd5c8b59640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3bd9d0 0x5613dd3bddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46598/0 (socket says 172.21.15.120:46598) 2024-09-19T05:20:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.639+0000 7fd5c8b59640 1 -- 172.21.15.120:0/2565995402 learned_addr learned my addr 172.21.15.120:0/2565995402 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.639+0000 7fd5c935a640 1 --2- 172.21.15.120:0/2313303974 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fd5b40a3600 0x7fd5b40a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.639+0000 7fd5c3fff640 1 --2- 172.21.15.120:0/2565995402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613dd3be2f0 0x5613dd3ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.640+0000 7fd5c8b59640 1 -- 172.21.15.120:0/2565995402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613dd3cd0c0 msgr2=0x5613dd3cf4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T05:20:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.640+0000 7fd5c8b59640 1 --2- 172.21.15.120:0/2565995402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613dd3cd0c0 0x5613dd3cf4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.640+0000 7fd5c8b59640 1 -- 172.21.15.120:0/2565995402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613dd3be2f0 msgr2=0x5613dd3ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.640+0000 7fd5c8b59640 1 --2- 172.21.15.120:0/2565995402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613dd3be2f0 0x5613dd3ccb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.644 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.640+0000 7fd5c8b59640 1 -- 172.21.15.120:0/2565995402 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613dd2c9340 con 0x5613dd3bd9d0 2024-09-19T05:20:06.644 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.640+0000 7fd5c3fff640 1 --2- 172.21.15.120:0/2565995402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613dd3be2f0 0x5613dd3ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:06.644 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.640+0000 7fd5c8b59640 1 --2- 172.21.15.120:0/2565995402 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3bd9d0 0x5613dd3bddb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8009930 tx=0x7fd5b8005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c0c92074a5dd428 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:06.644 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.640+0000 7fd5c935a640 1 --2- 172.21.15.120:0/2313303974 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fd5b40a3600 0x7fd5b40a5ac0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc005c40 tx=0x7fd5bc0093c0 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:06.644 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.640+0000 7fd5aeffd640 1 -- 172.21.15.120:0/2565995402 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8035040 con 0x5613dd3bd9d0 2024-09-19T05:20:06.644 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.640+0000 7fd5aeffd640 1 -- 172.21.15.120:0/2565995402 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd5b8031760 con 0x5613dd3bd9d0 2024-09-19T05:20:06.644 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.640+0000 7fd5aeffd640 1 -- 172.21.15.120:0/2565995402 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8004a00 con 0x5613dd3bd9d0 2024-09-19T05:20:06.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.641+0000 7fd5cdc31740 1 -- 172.21.15.120:0/2565995402 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3bd9d0 msgr2=0x5613dd3bddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:06.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.641+0000 7fd5cdc31740 1 --2- 172.21.15.120:0/2565995402 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3bd9d0 0x5613dd3bddb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8009930 tx=0x7fd5b8005c00 comp rx=0 tx=0).stop 2024-09-19T05:20:06.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.641+0000 7fd5cdc31740 1 -- 172.21.15.120:0/2565995402 shutdown_connections 2024-09-19T05:20:06.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.641+0000 7fd5cdc31740 1 --2- 172.21.15.120:0/2565995402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613dd3cd0c0 0x5613dd3cf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.641+0000 7fd5cdc31740 1 --2- 172.21.15.120:0/2565995402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613dd3be2f0 0x5613dd3ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.641+0000 7fd5cdc31740 1 --2- 172.21.15.120:0/2565995402 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3bd9d0 0x5613dd3bddb0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.641+0000 7fd5cdc31740 1 -- 172.21.15.120:0/2565995402 >> 172.21.15.120:0/2565995402 conn(0x5613dd3ba060 msgr2=0x5613dd3ba440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:06.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.641+0000 7fd5cdc31740 1 -- 172.21.15.120:0/2565995402 shutdown_connections 2024-09-19T05:20:06.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.642+0000 7fd5cdc31740 1 -- 172.21.15.120:0/2565995402 wait complete. 2024-09-19T05:20:06.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.642+0000 7fd5cdc31740 1 -- start start 2024-09-19T05:20:06.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.642+0000 7fd5cdc31740 1 Processor -- start 2024-09-19T05:20:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.642+0000 7fd5cdc31740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613dd3bd9d0 0x5613dd3ca010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.642+0000 7fd5cdc31740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3be2f0 0x5613dd3ca550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.643+0000 7fd5cdc31740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613dd3cd0c0 0x5613dd3caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.643+0000 7fd5c3fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3be2f0 0x5613dd3ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.643+0000 7fd5c3fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3be2f0 0x5613dd3ca550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46610/0 (socket says 172.21.15.120:46610) 2024-09-19T05:20:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.643+0000 7fd5cdc31740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5613dd3cfc90 con 0x5613dd3be2f0 2024-09-19T05:20:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.643+0000 7fd5cdc31740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5613dd2ab290 con 0x5613dd3cd0c0 2024-09-19T05:20:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.643+0000 7fd5cdc31740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5613dd3cfe10 con 0x5613dd3bd9d0 2024-09-19T05:20:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.643+0000 7fd5c8b59640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613dd3bd9d0 0x5613dd3ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.643+0000 7fd5c8b59640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613dd3bd9d0 0x5613dd3ca010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:33532/0 (socket says 172.21.15.120:33532) 2024-09-19T05:20:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.643+0000 7fd5c3fff640 1 -- 172.21.15.120:0/447097989 learned_addr learned my addr 172.21.15.120:0/447097989 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.643+0000 7fd5cdc31740 10 client.0 _ll_register_callbacks cb 0x5613dd2dc140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:06.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.643+0000 7fd5c935a640 1 --2- 172.21.15.120:0/447097989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613dd3cd0c0 0x5613dd3caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.643+0000 7fd5c3fff640 1 -- 172.21.15.120:0/447097989 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613dd3bd9d0 msgr2=0x5613dd3ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.643+0000 7fd5c3fff640 1 --2- 172.21.15.120:0/447097989 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613dd3bd9d0 0x5613dd3ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.643+0000 7fd5c3fff640 1 -- 172.21.15.120:0/447097989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613dd3cd0c0 msgr2=0x5613dd3caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.643+0000 7fd5c3fff640 1 --2- 172.21.15.120:0/447097989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613dd3cd0c0 0x5613dd3caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.643+0000 7fd5c3fff640 1 -- 172.21.15.120:0/447097989 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613dd035210 con 0x5613dd3be2f0 2024-09-19T05:20:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.644+0000 7fd5c3fff640 1 --2- 172.21.15.120:0/447097989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3be2f0 0x5613dd3ca550 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0097eb0 tx=0x7fd5b009c290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20933b0f41c8640c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.644+0000 7fd5a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:20:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.644+0000 7fd5a3fff640 1 -- 172.21.15.120:0/447097989 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b00b4060 con 0x5613dd3be2f0 2024-09-19T05:20:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.644+0000 7fd5cdc31740 1 -- 172.21.15.120:0/447097989 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5b8031760 con 0x5613dd3be2f0 2024-09-19T05:20:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.644+0000 7fd5a3fff640 1 -- 172.21.15.120:0/447097989 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fd5b00cd270 con 0x5613dd3be2f0 2024-09-19T05:20:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.644+0000 7fd5a3fff640 1 -- 172.21.15.120:0/447097989 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd5b00a46c0 con 0x5613dd3be2f0 2024-09-19T05:20:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.645+0000 7fd5cdc31740 10 client.15474 fetch_fsmap learned FSMap version 25 2024-09-19T05:20:06.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.645+0000 7fd5cdc31740 1 -- 172.21.15.120:0/447097989 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5613dd101620 con 0x5613dd3be2f0 2024-09-19T05:20:06.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.645+0000 7fd5a3fff640 1 -- 172.21.15.120:0/447097989 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd5b8031760 con 0x5613dd3be2f0 2024-09-19T05:20:06.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.645+0000 7fd5a3fff640 1 -- 172.21.15.120:0/447097989 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd5b00977a0 con 0x5613dd3be2f0 2024-09-19T05:20:06.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.645+0000 7fd5cdc31740 10 client.15474 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:20:06.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.645+0000 7fd5cdc31740 10 client.15474 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:20:06.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.645+0000 7fd5cdc31740 20 client.15474 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:06.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.645+0000 7fd5cdc31740 1 --2- 172.21.15.120:0/447097989 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5613dd3dd500 0x5613dd3df940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:06.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.645+0000 7fd5cdc31740 4 client.15474 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:20:06.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.645+0000 7fd5cdc31740 1 -- 172.21.15.120:0/447097989 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613dd32fa20 con 0x5613dd3dd500 2024-09-19T05:20:06.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.645+0000 7fd5c8b59640 1 --2- 172.21.15.120:0/447097989 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5613dd3dd500 0x5613dd3df940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:06.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.646+0000 7fd5c8b59640 1 --2- 172.21.15.120:0/447097989 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5613dd3dd500 0x5613dd3df940 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d94005d08f97af0 server_cookie=23a20f16ba9187da in_seq=0 out_seq=0 2024-09-19T05:20:06.651 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.646+0000 7fd5a3fff640 10 client.15474 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:06.652 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.647+0000 7fd5a3fff640 1 -- 172.21.15.120:0/447097989 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5613dd32fa20 con 0x5613dd3dd500 2024-09-19T05:20:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.647+0000 7fd5a3fff640 10 client.15474 handle_command_reply: tid=0 2024-09-19T05:20:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.647+0000 7fd5cdc31740 1 client.15474 shutdown 2024-09-19T05:20:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.647+0000 7fd5cdc31740 1 -- 172.21.15.120:0/447097989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3be2f0 msgr2=0x5613dd3ca550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.647+0000 7fd5cdc31740 1 --2- 172.21.15.120:0/447097989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3be2f0 0x5613dd3ca550 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0097eb0 tx=0x7fd5b009c290 comp rx=0 tx=0).stop 2024-09-19T05:20:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.647+0000 7fd5cdc31740 1 -- 172.21.15.120:0/447097989 shutdown_connections 2024-09-19T05:20:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.647+0000 7fd5cdc31740 1 --2- 172.21.15.120:0/447097989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613dd3cd0c0 0x5613dd3caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.647+0000 7fd5cdc31740 1 --2- 172.21.15.120:0/447097989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3be2f0 0x5613dd3ca550 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.647+0000 7fd5cdc31740 1 --2- 172.21.15.120:0/447097989 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5613dd3dd500 0x5613dd3df940 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.647+0000 7fd5cdc31740 1 --2- 172.21.15.120:0/447097989 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613dd3bd9d0 0x5613dd3ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.647+0000 7fd5cdc31740 1 -- 172.21.15.120:0/447097989 >> 172.21.15.120:0/447097989 conn(0x5613dd3ba060 msgr2=0x5613dd3bfdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:06.654 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.647+0000 7fd5a3fff640 0 client.15474 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:06.654 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.647+0000 7fd5cdc31740 1 -- 172.21.15.120:0/447097989 shutdown_connections 2024-09-19T05:20:06.654 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.647+0000 7fd5cdc31740 1 -- 172.21.15.120:0/447097989 wait complete. 2024-09-19T05:20:06.654 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.648+0000 7fd5cdc31740 20 client.15474 trim_cache size 0 max 16384 2024-09-19T05:20:06.678 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.675+0000 7fd5cdc31740 1 Processor -- start 2024-09-19T05:20:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.675+0000 7fd5cdc31740 1 -- start start 2024-09-19T05:20:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.675+0000 7fd5cdc31740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613dd3bd9d0 0x5613dd3cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.675+0000 7fd5cdc31740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3be2f0 0x5613dd3e5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.676+0000 7fd5c3fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3be2f0 0x5613dd3e5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.676+0000 7fd5c3fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3be2f0 0x5613dd3e5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46612/0 (socket says 172.21.15.120:46612) 2024-09-19T05:20:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.676+0000 7fd5cdc31740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613dd3cd0c0 0x5613dd3e5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.676+0000 7fd5c3fff640 1 -- 172.21.15.120:0/591612640 learned_addr learned my addr 172.21.15.120:0/591612640 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.676+0000 7fd5c8b59640 1 --2- 172.21.15.120:0/591612640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613dd3bd9d0 0x5613dd3cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.676+0000 7fd5cdc31740 1 -- 172.21.15.120:0/591612640 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c41ade90 con 0x5613dd3be2f0 2024-09-19T05:20:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.676+0000 7fd5cdc31740 1 -- 172.21.15.120:0/591612640 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c41ab760 con 0x5613dd3bd9d0 2024-09-19T05:20:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.676+0000 7fd5cdc31740 1 -- 172.21.15.120:0/591612640 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c41a95b0 con 0x5613dd3cd0c0 2024-09-19T05:20:06.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.676+0000 7fd5c935a640 1 --2- 172.21.15.120:0/591612640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613dd3cd0c0 0x5613dd3e5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.676+0000 7fd5c3fff640 1 -- 172.21.15.120:0/591612640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613dd3cd0c0 msgr2=0x5613dd3e5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.676+0000 7fd5c3fff640 1 --2- 172.21.15.120:0/591612640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613dd3cd0c0 0x5613dd3e5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.676+0000 7fd5c3fff640 1 -- 172.21.15.120:0/591612640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613dd3bd9d0 msgr2=0x5613dd3cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.676+0000 7fd5c3fff640 1 --2- 172.21.15.120:0/591612640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613dd3bd9d0 0x5613dd3cbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.676+0000 7fd5c3fff640 1 -- 172.21.15.120:0/591612640 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613dd3c8540 con 0x5613dd3be2f0 2024-09-19T05:20:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.676+0000 7fd5c8b59640 1 --2- 172.21.15.120:0/591612640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613dd3bd9d0 0x5613dd3cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.676+0000 7fd5c3fff640 1 --2- 172.21.15.120:0/591612640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3be2f0 0x5613dd3e5210 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd5b009ffc0 tx=0x7fd5b009bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd3b7f86c5b2cce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.677+0000 7fd5ae7fc640 1 -- 172.21.15.120:0/591612640 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b00b4040 con 0x5613dd3be2f0 2024-09-19T05:20:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.677+0000 7fd5ae7fc640 1 -- 172.21.15.120:0/591612640 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd5b00cced0 con 0x5613dd3be2f0 2024-09-19T05:20:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.677+0000 7fd5ae7fc640 1 -- 172.21.15.120:0/591612640 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b0009bf0 con 0x5613dd3be2f0 2024-09-19T05:20:06.684 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.678+0000 7fd5cdc31740 1 -- 172.21.15.120:0/591612640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3be2f0 msgr2=0x5613dd3e5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:06.684 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.678+0000 7fd5cdc31740 1 --2- 172.21.15.120:0/591612640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3be2f0 0x5613dd3e5210 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd5b009ffc0 tx=0x7fd5b009bbd0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.684 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.678+0000 7fd5cdc31740 1 -- 172.21.15.120:0/591612640 shutdown_connections 2024-09-19T05:20:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.678+0000 7fd5cdc31740 1 --2- 172.21.15.120:0/591612640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613dd3cd0c0 0x5613dd3e5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.678+0000 7fd5cdc31740 1 --2- 172.21.15.120:0/591612640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3be2f0 0x5613dd3e5210 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.678+0000 7fd5cdc31740 1 --2- 172.21.15.120:0/591612640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613dd3bd9d0 0x5613dd3cbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.678+0000 7fd5cdc31740 1 -- 172.21.15.120:0/591612640 >> 172.21.15.120:0/591612640 conn(0x5613dd3ba060 msgr2=0x5613dd3cb870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.678+0000 7fd5cdc31740 1 -- 172.21.15.120:0/591612640 shutdown_connections 2024-09-19T05:20:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.678+0000 7fd5cdc31740 1 -- 172.21.15.120:0/591612640 wait complete. 2024-09-19T05:20:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.678+0000 7fd5cdc31740 1 -- start start 2024-09-19T05:20:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.679+0000 7fd5cdc31740 1 Processor -- start 2024-09-19T05:20:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.679+0000 7fd5cdc31740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3bd9d0 0x5613dd3d0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.679+0000 7fd5cdc31740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613dd3be2f0 0x5613dd3d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.679+0000 7fd5cdc31740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613dd3cd0c0 0x5613dd4461d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.679+0000 7fd5c8b59640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3bd9d0 0x5613dd3d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.679+0000 7fd5cdc31740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c41a9c20 con 0x5613dd3bd9d0 2024-09-19T05:20:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.679+0000 7fd5c3fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613dd3be2f0 0x5613dd3d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.679+0000 7fd5c8b59640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3bd9d0 0x5613dd3d0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46620/0 (socket says 172.21.15.120:46620) 2024-09-19T05:20:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.679+0000 7fd5c8b59640 1 -- 172.21.15.120:0/3567842881 learned_addr learned my addr 172.21.15.120:0/3567842881 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.679+0000 7fd5cdc31740 1 -- 172.21.15.120:0/3567842881 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c41ab090 con 0x5613dd3be2f0 2024-09-19T05:20:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.679+0000 7fd5cdc31740 1 -- 172.21.15.120:0/3567842881 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c41aa2f0 con 0x5613dd3cd0c0 2024-09-19T05:20:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.680+0000 7fd5cdc31740 10 client.0 _ll_register_callbacks cb 0x7fd5b009c150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.680+0000 7fd5c935a640 1 --2- 172.21.15.120:0/3567842881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613dd3cd0c0 0x5613dd4461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.680+0000 7fd5c3fff640 1 -- 172.21.15.120:0/3567842881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613dd3cd0c0 msgr2=0x5613dd4461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.680+0000 7fd5c3fff640 1 --2- 172.21.15.120:0/3567842881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613dd3cd0c0 0x5613dd4461d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.680+0000 7fd5c3fff640 1 -- 172.21.15.120:0/3567842881 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3bd9d0 msgr2=0x5613dd3d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.680+0000 7fd5c3fff640 1 --2- 172.21.15.120:0/3567842881 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3bd9d0 0x5613dd3d0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.686 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.680+0000 7fd5c3fff640 1 -- 172.21.15.120:0/3567842881 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613dd446710 con 0x5613dd3be2f0 2024-09-19T05:20:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.680+0000 7fd5c935a640 1 --2- 172.21.15.120:0/3567842881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613dd3cd0c0 0x5613dd4461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:20:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.680+0000 7fd5c8b59640 1 --2- 172.21.15.120:0/3567842881 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3bd9d0 0x5613dd3d0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.680+0000 7fd5c3fff640 1 --2- 172.21.15.120:0/3567842881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613dd3be2f0 0x5613dd3d0b40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd5b009b9e0 tx=0x7fd5b0009740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df65e4b937827fc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.680+0000 7fd5a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:20:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.680+0000 7fd5a3fff640 1 -- 172.21.15.120:0/3567842881 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b0014070 con 0x5613dd3be2f0 2024-09-19T05:20:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.680+0000 7fd5a3fff640 1 -- 172.21.15.120:0/3567842881 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fd5b00ba170 con 0x5613dd3be2f0 2024-09-19T05:20:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.680+0000 7fd5cdc31740 1 -- 172.21.15.120:0/3567842881 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5b00cced0 con 0x5613dd3be2f0 2024-09-19T05:20:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.681+0000 7fd5a3fff640 1 -- 172.21.15.120:0/3567842881 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd5b00b4050 con 0x5613dd3be2f0 2024-09-19T05:20:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.681+0000 7fd5cdc31740 10 client.24962 fetch_fsmap learned FSMap version 25 2024-09-19T05:20:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.681+0000 7fd5cdc31740 1 -- 172.21.15.120:0/3567842881 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5613dd447960 con 0x5613dd3be2f0 2024-09-19T05:20:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.681+0000 7fd5a3fff640 1 -- 172.21.15.120:0/3567842881 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fd5b00cced0 con 0x5613dd3be2f0 2024-09-19T05:20:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.682+0000 7fd5a3fff640 1 -- 172.21.15.120:0/3567842881 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd5b009a910 con 0x5613dd3be2f0 2024-09-19T05:20:06.687 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.682+0000 7fd5cdc31740 10 client.24962 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:20:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.682+0000 7fd5cdc31740 10 client.24962 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:20:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.682+0000 7fd5cdc31740 20 client.24962 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.682+0000 7fd5cdc31740 1 --2- 172.21.15.120:0/3567842881 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5613dd447d40 0x5613dd44a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.682+0000 7fd5cdc31740 4 client.24962 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:20:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.682+0000 7fd5cdc31740 1 -- 172.21.15.120:0/3567842881 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5613dd329d70 con 0x5613dd447d40 2024-09-19T05:20:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.682+0000 7fd5c8b59640 1 --2- 172.21.15.120:0/3567842881 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5613dd447d40 0x5613dd44a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.682+0000 7fd5a3fff640 10 client.24962 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:06.688 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.682+0000 7fd5c8b59640 1 --2- 172.21.15.120:0/3567842881 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5613dd447d40 0x5613dd44a130 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec227159e1f9d81 server_cookie=8b3bc2085392ca52 in_seq=0 out_seq=0 2024-09-19T05:20:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.688+0000 7fd5a3fff640 1 -- 172.21.15.120:0/3567842881 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5613dd329d70 con 0x5613dd447d40 2024-09-19T05:20:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.688+0000 7fd5a3fff640 10 client.24962 handle_command_reply: tid=0 2024-09-19T05:20:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.688+0000 7fd5cdc31740 1 client.24962 shutdown 2024-09-19T05:20:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.688+0000 7fd5cdc31740 1 -- 172.21.15.120:0/3567842881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613dd3be2f0 msgr2=0x5613dd3d0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.688+0000 7fd5cdc31740 1 --2- 172.21.15.120:0/3567842881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613dd3be2f0 0x5613dd3d0b40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd5b009b9e0 tx=0x7fd5b0009740 comp rx=0 tx=0).stop 2024-09-19T05:20:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.688+0000 7fd5cdc31740 1 -- 172.21.15.120:0/3567842881 shutdown_connections 2024-09-19T05:20:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.688+0000 7fd5cdc31740 1 --2- 172.21.15.120:0/3567842881 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5613dd447d40 0x5613dd44a130 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.689+0000 7fd5cdc31740 1 --2- 172.21.15.120:0/3567842881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613dd3cd0c0 0x5613dd4461d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.689+0000 7fd5cdc31740 1 --2- 172.21.15.120:0/3567842881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613dd3be2f0 0x5613dd3d0b40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.689+0000 7fd5cdc31740 1 --2- 172.21.15.120:0/3567842881 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5613dd3bd9d0 0x5613dd3d0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.689+0000 7fd5cdc31740 1 -- 172.21.15.120:0/3567842881 >> 172.21.15.120:0/3567842881 conn(0x5613dd3ba060 msgr2=0x5613dd3bfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.689+0000 7fd5a3fff640 0 client.24962 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.689+0000 7fd5cdc31740 1 -- 172.21.15.120:0/3567842881 shutdown_connections 2024-09-19T05:20:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.689+0000 7fd5cdc31740 1 -- 172.21.15.120:0/3567842881 wait complete. 2024-09-19T05:20:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.689+0000 7fd5cdc31740 20 client.24962 trim_cache size 0 max 16384 2024-09-19T05:20:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:20:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:20:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:20:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:20:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.690+0000 7fd5cadbd640 1 -- 172.21.15.120:0/2313303974 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fd5b40a3600 msgr2=0x7fd5b40a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.690+0000 7fd5cadbd640 1 --2- 172.21.15.120:0/2313303974 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fd5b40a3600 0x7fd5b40a5ac0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc005c40 tx=0x7fd5bc0093c0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.690+0000 7fd5cadbd640 1 -- 172.21.15.120:0/2313303974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5c4101350 msgr2=0x7fd5c41987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.690+0000 7fd5cadbd640 1 --2- 172.21.15.120:0/2313303974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5c4101350 0x7fd5c41987c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd5b000d950 tx=0x7fd5b000de10 comp rx=0 tx=0).stop 2024-09-19T05:20:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.690+0000 7fd5cadbd640 1 -- 172.21.15.120:0/2313303974 shutdown_connections 2024-09-19T05:20:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.690+0000 7fd5cadbd640 1 --2- 172.21.15.120:0/2313303974 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fd5b40a3600 0x7fd5b40a5ac0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.690+0000 7fd5cadbd640 1 --2- 172.21.15.120:0/2313303974 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5c41069c0 0x7fd5c419cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.694 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.690+0000 7fd5cadbd640 1 --2- 172.21.15.120:0/2313303974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5c4101350 0x7fd5c41987c0 secure :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd5b000d950 tx=0x7fd5b000de10 comp rx=0 tx=0).stop 2024-09-19T05:20:06.694 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.690+0000 7fd5cadbd640 1 --2- 172.21.15.120:0/2313303974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5c41009b0 0x7fd5c4198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:06.694 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.690+0000 7fd5cadbd640 1 -- 172.21.15.120:0/2313303974 >> 172.21.15.120:0/2313303974 conn(0x7fd5c4077990 msgr2=0x7fd5c4069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:06.694 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.690+0000 7fd5cadbd640 1 -- 172.21.15.120:0/2313303974 shutdown_connections 2024-09-19T05:20:06.694 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:06.690+0000 7fd5cadbd640 1 -- 172.21.15.120:0/2313303974 wait complete. 2024-09-19T05:20:06.694 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:06 smithi178 ceph-mon[34347]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-19T05:20:06.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:06 smithi120 ceph-mon[30956]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-19T05:20:06.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:06 smithi194 ceph-mon[35228]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-19T05:20:07.054 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T05:20:07.054 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T05:20:07.318 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:07.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.854+0000 7f6428029640 1 -- 172.21.15.120:0/1124288770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64201082a0 msgr2=0x7f642010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:07.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.854+0000 7f6428029640 1 --2- 172.21.15.120:0/1124288770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64201082a0 0x7f642010ec40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6418009cd0 tx=0x7f641802a8e0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.854+0000 7f6428029640 1 -- 172.21.15.120:0/1124288770 shutdown_connections 2024-09-19T05:20:07.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.854+0000 7f6428029640 1 --2- 172.21.15.120:0/1124288770 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64201082a0 0x7f642010ec40 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.854+0000 7f6428029640 1 --2- 172.21.15.120:0/1124288770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64201036e0 0x7f6420107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.854+0000 7f6428029640 1 --2- 172.21.15.120:0/1124288770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6420102d30 0x7f6420103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.854+0000 7f6428029640 1 -- 172.21.15.120:0/1124288770 >> 172.21.15.120:0/1124288770 conn(0x7f64200fc7d0 msgr2=0x7f64200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:07.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.854+0000 7f6428029640 1 -- 172.21.15.120:0/1124288770 shutdown_connections 2024-09-19T05:20:07.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.854+0000 7f6428029640 1 -- 172.21.15.120:0/1124288770 wait complete. 2024-09-19T05:20:07.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.855+0000 7f6428029640 1 Processor -- start 2024-09-19T05:20:07.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.855+0000 7f6428029640 1 -- start start 2024-09-19T05:20:07.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.855+0000 7f6428029640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6420102d30 0x7f6420198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:07.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.855+0000 7f6428029640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64201036e0 0x7f6420198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:07.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.855+0000 7f6428029640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64201082a0 0x7f642019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:07.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.855+0000 7f64255c4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64201036e0 0x7f6420198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:07.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.855+0000 7f64255c4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64201036e0 0x7f6420198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46638/0 (socket says 172.21.15.120:46638) 2024-09-19T05:20:07.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.855+0000 7f6428029640 1 -- 172.21.15.120:0/3736738351 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6420111f50 con 0x7f64201036e0 2024-09-19T05:20:07.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.855+0000 7f64255c4640 1 -- 172.21.15.120:0/3736738351 learned_addr learned my addr 172.21.15.120:0/3736738351 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:07.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.855+0000 7f6428029640 1 -- 172.21.15.120:0/3736738351 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6420111dd0 con 0x7f6420102d30 2024-09-19T05:20:07.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.855+0000 7f6428029640 1 -- 172.21.15.120:0/3736738351 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f64201120d0 con 0x7f64201082a0 2024-09-19T05:20:07.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.855+0000 7f6425dc5640 1 --2- 172.21.15.120:0/3736738351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6420102d30 0x7f6420198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:07.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.856+0000 7f64255c4640 1 -- 172.21.15.120:0/3736738351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64201082a0 msgr2=0x7f642019ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:07.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.856+0000 7f64255c4640 1 --2- 172.21.15.120:0/3736738351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64201082a0 0x7f642019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.856+0000 7f64255c4640 1 -- 172.21.15.120:0/3736738351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6420102d30 msgr2=0x7f6420198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:07.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.856+0000 7f64255c4640 1 --2- 172.21.15.120:0/3736738351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6420102d30 0x7f6420198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.856+0000 7f64255c4640 1 -- 172.21.15.120:0/3736738351 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f642019d3d0 con 0x7f64201036e0 2024-09-19T05:20:07.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.856+0000 7f64255c4640 1 --2- 172.21.15.120:0/3736738351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64201036e0 0x7f6420198960 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f641000c8c0 tx=0x7f641000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:07.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.856+0000 7f6416ffd640 1 -- 172.21.15.120:0/3736738351 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6410007bb0 con 0x7f64201036e0 2024-09-19T05:20:07.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.856+0000 7f6416ffd640 1 -- 172.21.15.120:0/3736738351 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6410007d50 con 0x7f64201036e0 2024-09-19T05:20:07.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.856+0000 7f6416ffd640 1 -- 172.21.15.120:0/3736738351 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6410018740 con 0x7f64201036e0 2024-09-19T05:20:07.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.856+0000 7f6428029640 1 -- 172.21.15.120:0/3736738351 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f642019d6c0 con 0x7f64201036e0 2024-09-19T05:20:07.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.856+0000 7f6428029640 1 -- 172.21.15.120:0/3736738351 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64201a4fa0 con 0x7f64201036e0 2024-09-19T05:20:07.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.859+0000 7f6416ffd640 1 -- 172.21.15.120:0/3736738351 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7f641000f450 con 0x7f64201036e0 2024-09-19T05:20:07.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.859+0000 7f6416ffd640 1 --2- 172.21.15.120:0/3736738351 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f640c0a3550 0x7f640c0a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:07.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.859+0000 7f6416ffd640 1 -- 172.21.15.120:0/3736738351 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f64100d0010 con 0x7f64201036e0 2024-09-19T05:20:07.862 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.859+0000 7f6425dc5640 1 --2- 172.21.15.120:0/3736738351 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f640c0a3550 0x7f640c0a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:07.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.860+0000 7f6425dc5640 1 --2- 172.21.15.120:0/3736738351 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f640c0a3550 0x7f640c0a5a10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f641c005fd0 tx=0x7f641c005850 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:07.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.860+0000 7f642a402740 1 Processor -- start 2024-09-19T05:20:07.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.861+0000 7f642a402740 1 -- start start 2024-09-19T05:20:07.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.861+0000 7f642a402740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5572a8b9eb60 0x5572a8b9ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:07.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.861+0000 7f642a402740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572a8b9f480 0x5572a8ba9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:07.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.861+0000 7f642a402740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572a8ba9d40 0x5572a8bac130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:07.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.861+0000 7f642a402740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5572a8b04280 con 0x5572a8b9f480 2024-09-19T05:20:07.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.861+0000 7f642a402740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5572a8aabb10 con 0x5572a8ba9d40 2024-09-19T05:20:07.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.861+0000 7f642a402740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5572a8b00240 con 0x5572a8b9eb60 2024-09-19T05:20:07.865 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.861+0000 7f6425dc5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5572a8b9eb60 0x5572a8b9ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:07.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.861+0000 7f64255c4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572a8b9f480 0x5572a8ba9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:07.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.862+0000 7f6425dc5640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5572a8b9eb60 0x5572a8b9ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:33570/0 (socket says 172.21.15.120:33570) 2024-09-19T05:20:07.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.862+0000 7f6425dc5640 1 -- 172.21.15.120:0/752594927 learned_addr learned my addr 172.21.15.120:0/752594927 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:07.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.862+0000 7f64265c6640 1 --2- 172.21.15.120:0/752594927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572a8ba9d40 0x5572a8bac130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:07.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.862+0000 7f6425dc5640 1 -- 172.21.15.120:0/752594927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572a8ba9d40 msgr2=0x5572a8bac130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:07.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.862+0000 7f6425dc5640 1 --2- 172.21.15.120:0/752594927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572a8ba9d40 0x5572a8bac130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.862+0000 7f6425dc5640 1 -- 172.21.15.120:0/752594927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572a8b9f480 msgr2=0x5572a8ba9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:07.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.862+0000 7f6425dc5640 1 --2- 172.21.15.120:0/752594927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572a8b9f480 0x5572a8ba9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.862+0000 7f6425dc5640 1 -- 172.21.15.120:0/752594927 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572a8ab81f0 con 0x5572a8b9eb60 2024-09-19T05:20:07.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.862+0000 7f64255c4640 1 --2- 172.21.15.120:0/752594927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572a8b9f480 0x5572a8ba9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:07.866 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.862+0000 7f6425dc5640 1 --2- 172.21.15.120:0/752594927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5572a8b9eb60 0x5572a8b9ef40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f641c00feb0 tx=0x7f641c012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92f5d84348bd704d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:07.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.862+0000 7f640bfff640 1 -- 172.21.15.120:0/752594927 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641c022070 con 0x5572a8b9eb60 2024-09-19T05:20:07.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.863+0000 7f640bfff640 1 -- 172.21.15.120:0/752594927 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f641c011e50 con 0x5572a8b9eb60 2024-09-19T05:20:07.867 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.863+0000 7f640bfff640 1 -- 172.21.15.120:0/752594927 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641c0108e0 con 0x5572a8b9eb60 2024-09-19T05:20:07.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.863+0000 7f642a402740 1 -- 172.21.15.120:0/752594927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5572a8b9eb60 msgr2=0x5572a8b9ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:07.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.863+0000 7f642a402740 1 --2- 172.21.15.120:0/752594927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5572a8b9eb60 0x5572a8b9ef40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f641c00feb0 tx=0x7f641c012000 comp rx=0 tx=0).stop 2024-09-19T05:20:07.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.864+0000 7f642a402740 1 -- 172.21.15.120:0/752594927 shutdown_connections 2024-09-19T05:20:07.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.864+0000 7f642a402740 1 --2- 172.21.15.120:0/752594927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572a8ba9d40 0x5572a8bac130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.873 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.864+0000 7f642a402740 1 --2- 172.21.15.120:0/752594927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572a8b9f480 0x5572a8ba9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.864+0000 7f642a402740 1 --2- 172.21.15.120:0/752594927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5572a8b9eb60 0x5572a8b9ef40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.864+0000 7f642a402740 1 -- 172.21.15.120:0/752594927 >> 172.21.15.120:0/752594927 conn(0x5572a8b9b0f0 msgr2=0x5572a8b9b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:07.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.864+0000 7f642a402740 1 -- 172.21.15.120:0/752594927 shutdown_connections 2024-09-19T05:20:07.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.864+0000 7f642a402740 1 -- 172.21.15.120:0/752594927 wait complete. 2024-09-19T05:20:07.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.864+0000 7f642a402740 1 -- start start 2024-09-19T05:20:07.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.864+0000 7f642a402740 1 Processor -- start 2024-09-19T05:20:07.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.865+0000 7f642a402740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5572a8b9eb60 0x5572a8ba6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:07.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.865+0000 7f642a402740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572a8b9f480 0x5572a8ba7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:07.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.865+0000 7f642a402740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572a8ba9d40 0x5572a8ba7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:07.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.865+0000 7f642a402740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5572a8bac910 con 0x5572a8b9f480 2024-09-19T05:20:07.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.865+0000 7f64255c4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572a8b9f480 0x5572a8ba7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:07.874 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.865+0000 7f64255c4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572a8b9f480 0x5572a8ba7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46652/0 (socket says 172.21.15.120:46652) 2024-09-19T05:20:07.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.865+0000 7f64255c4640 1 -- 172.21.15.120:0/3837492869 learned_addr learned my addr 172.21.15.120:0/3837492869 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:07.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.865+0000 7f642a402740 1 -- 172.21.15.120:0/3837492869 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5572a8abef10 con 0x5572a8ba9d40 2024-09-19T05:20:07.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.865+0000 7f642a402740 1 -- 172.21.15.120:0/3837492869 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5572a8baca90 con 0x5572a8b9eb60 2024-09-19T05:20:07.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.865+0000 7f64265c6640 1 --2- 172.21.15.120:0/3837492869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572a8ba9d40 0x5572a8ba7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:07.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.865+0000 7f642a402740 10 client.0 _ll_register_callbacks cb 0x5572a8a87a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:07.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.866+0000 7f6425dc5640 1 --2- 172.21.15.120:0/3837492869 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5572a8b9eb60 0x5572a8ba6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:07.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.866+0000 7f64265c6640 1 -- 172.21.15.120:0/3837492869 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5572a8b9eb60 msgr2=0x5572a8ba6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:07.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.866+0000 7f64265c6640 1 --2- 172.21.15.120:0/3837492869 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5572a8b9eb60 0x5572a8ba6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.866+0000 7f64265c6640 1 -- 172.21.15.120:0/3837492869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572a8b9f480 msgr2=0x5572a8ba7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:07.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.866+0000 7f64265c6640 1 --2- 172.21.15.120:0/3837492869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572a8b9f480 0x5572a8ba7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.866+0000 7f64265c6640 1 -- 172.21.15.120:0/3837492869 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572a88756a0 con 0x5572a8ba9d40 2024-09-19T05:20:07.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.866+0000 7f64265c6640 1 --2- 172.21.15.120:0/3837492869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572a8ba9d40 0x5572a8ba7690 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x5572a8b9c470 tx=0x7f6418031a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=460b7a381edd4aa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:07.875 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.866+0000 7f64097fa640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:20:07.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.866+0000 7f64097fa640 1 -- 172.21.15.120:0/3837492869 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6418049060 con 0x5572a8ba9d40 2024-09-19T05:20:07.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.866+0000 7f642a402740 1 -- 172.21.15.120:0/3837492869 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f641c011e50 con 0x5572a8ba9d40 2024-09-19T05:20:07.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.866+0000 7f64097fa640 1 -- 172.21.15.120:0/3837492869 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f6418003970 con 0x5572a8ba9d40 2024-09-19T05:20:07.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.866+0000 7f64097fa640 1 -- 172.21.15.120:0/3837492869 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6418003b70 con 0x5572a8ba9d40 2024-09-19T05:20:07.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.866+0000 7f642a402740 10 client.24971 fetch_fsmap learned FSMap version 25 2024-09-19T05:20:07.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.866+0000 7f642a402740 1 -- 172.21.15.120:0/3837492869 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5572a8bb8540 con 0x5572a8ba9d40 2024-09-19T05:20:07.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.867+0000 7f64097fa640 1 -- 172.21.15.120:0/3837492869 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f641c011e50 con 0x5572a8ba9d40 2024-09-19T05:20:07.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.867+0000 7f64097fa640 1 -- 172.21.15.120:0/3837492869 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6418030070 con 0x5572a8ba9d40 2024-09-19T05:20:07.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.867+0000 7f642a402740 10 client.24971 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:20:07.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.867+0000 7f642a402740 10 client.24971 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:20:07.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.867+0000 7f642a402740 20 client.24971 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:07.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.867+0000 7f642a402740 1 --2- 172.21.15.120:0/3837492869 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5572a8bb9950 0x5572a8bbbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:07.876 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.867+0000 7f642a402740 4 client.24971 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:20:07.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.867+0000 7f642a402740 1 -- 172.21.15.120:0/3837492869 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572a8b117f0 con 0x5572a8bb9950 2024-09-19T05:20:07.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.868+0000 7f6425dc5640 1 --2- 172.21.15.120:0/3837492869 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5572a8bb9950 0x5572a8bbbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:07.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.868+0000 7f64097fa640 10 client.24971 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:07.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.868+0000 7f6425dc5640 1 --2- 172.21.15.120:0/3837492869 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5572a8bb9950 0x5572a8bbbd60 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9804c4ea624f53f server_cookie=8bd02924ef3c2ea7 in_seq=0 out_seq=0 2024-09-19T05:20:07.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.869+0000 7f64097fa640 1 -- 172.21.15.120:0/3837492869 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5572a8b117f0 con 0x5572a8bb9950 2024-09-19T05:20:07.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.869+0000 7f64097fa640 10 client.24971 handle_command_reply: tid=0 2024-09-19T05:20:07.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.869+0000 7f642a402740 1 client.24971 shutdown 2024-09-19T05:20:07.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.869+0000 7f642a402740 1 -- 172.21.15.120:0/3837492869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572a8ba9d40 msgr2=0x5572a8ba7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:07.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.869+0000 7f642a402740 1 --2- 172.21.15.120:0/3837492869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572a8ba9d40 0x5572a8ba7690 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x5572a8b9c470 tx=0x7f6418031a80 comp rx=0 tx=0).stop 2024-09-19T05:20:07.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.869+0000 7f642a402740 1 -- 172.21.15.120:0/3837492869 shutdown_connections 2024-09-19T05:20:07.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.869+0000 7f642a402740 1 --2- 172.21.15.120:0/3837492869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572a8ba9d40 0x5572a8ba7690 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.877 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.869+0000 7f642a402740 1 --2- 172.21.15.120:0/3837492869 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572a8b9f480 0x5572a8ba7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.869+0000 7f642a402740 1 --2- 172.21.15.120:0/3837492869 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5572a8bb9950 0x5572a8bbbd60 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.869+0000 7f64097fa640 0 client.24971 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:07.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.869+0000 7f642a402740 1 --2- 172.21.15.120:0/3837492869 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5572a8b9eb60 0x5572a8ba6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.869+0000 7f642a402740 1 -- 172.21.15.120:0/3837492869 >> 172.21.15.120:0/3837492869 conn(0x5572a8b9b0f0 msgr2=0x5572a8ba0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:07.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.870+0000 7f642a402740 1 -- 172.21.15.120:0/3837492869 shutdown_connections 2024-09-19T05:20:07.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.870+0000 7f642a402740 1 -- 172.21.15.120:0/3837492869 wait complete. 2024-09-19T05:20:07.878 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.870+0000 7f642a402740 20 client.24971 trim_cache size 0 max 16384 2024-09-19T05:20:07.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.887+0000 7f642a402740 1 Processor -- start 2024-09-19T05:20:07.889 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.887+0000 7f642a402740 1 -- start start 2024-09-19T05:20:07.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.888+0000 7f642a402740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5572a8b9eb60 0x5572a8ba0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:07.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.888+0000 7f642a402740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572a8b9f480 0x5572a8bc1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:07.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.888+0000 7f642a402740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572a8ba9d40 0x5572a8bc1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:07.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.888+0000 7f642a402740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f64201ae010 con 0x5572a8b9f480 2024-09-19T05:20:07.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.888+0000 7f642a402740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f64201ab8e0 con 0x5572a8ba9d40 2024-09-19T05:20:07.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.888+0000 7f642a402740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f64201a9730 con 0x5572a8b9eb60 2024-09-19T05:20:07.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.888+0000 7f64265c6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572a8ba9d40 0x5572a8bc1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:07.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.888+0000 7f64265c6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572a8ba9d40 0x5572a8bc1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:50098/0 (socket says 172.21.15.120:50098) 2024-09-19T05:20:07.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.888+0000 7f64265c6640 1 -- 172.21.15.120:0/3033643170 learned_addr learned my addr 172.21.15.120:0/3033643170 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:07.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.888+0000 7f6425dc5640 1 --2- 172.21.15.120:0/3033643170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5572a8b9eb60 0x5572a8ba0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:07.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.888+0000 7f64255c4640 1 --2- 172.21.15.120:0/3033643170 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572a8b9f480 0x5572a8bc1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:07.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.888+0000 7f6425dc5640 1 -- 172.21.15.120:0/3033643170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572a8ba9d40 msgr2=0x5572a8bc1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:07.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.888+0000 7f6425dc5640 1 --2- 172.21.15.120:0/3033643170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572a8ba9d40 0x5572a8bc1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.888+0000 7f6425dc5640 1 -- 172.21.15.120:0/3033643170 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572a8b9f480 msgr2=0x5572a8bc1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:07.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.888+0000 7f6425dc5640 1 --2- 172.21.15.120:0/3033643170 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572a8b9f480 0x5572a8bc1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.889+0000 7f6425dc5640 1 -- 172.21.15.120:0/3033643170 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572a8b9af20 con 0x5572a8b9eb60 2024-09-19T05:20:07.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.889+0000 7f64255c4640 1 --2- 172.21.15.120:0/3033643170 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572a8b9f480 0x5572a8bc1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:20:07.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.889+0000 7f6425dc5640 1 --2- 172.21.15.120:0/3033643170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5572a8b9eb60 0x5572a8ba0cc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f641c0058c0 tx=0x7f641c0103d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e24605da3d3ff940 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:07.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.889+0000 7f640b7fe640 1 -- 172.21.15.120:0/3033643170 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641c022040 con 0x5572a8b9eb60 2024-09-19T05:20:07.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.889+0000 7f640b7fe640 1 -- 172.21.15.120:0/3033643170 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f641c004640 con 0x5572a8b9eb60 2024-09-19T05:20:07.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.889+0000 7f640b7fe640 1 -- 172.21.15.120:0/3033643170 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f641c01e6b0 con 0x5572a8b9eb60 2024-09-19T05:20:07.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.890+0000 7f642a402740 1 -- 172.21.15.120:0/3033643170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5572a8b9eb60 msgr2=0x5572a8ba0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:07.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.890+0000 7f642a402740 1 --2- 172.21.15.120:0/3033643170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5572a8b9eb60 0x5572a8ba0cc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f641c0058c0 tx=0x7f641c0103d0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.890+0000 7f642a402740 1 -- 172.21.15.120:0/3033643170 shutdown_connections 2024-09-19T05:20:07.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.890+0000 7f642a402740 1 --2- 172.21.15.120:0/3033643170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572a8ba9d40 0x5572a8bc1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.890+0000 7f642a402740 1 --2- 172.21.15.120:0/3033643170 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572a8b9f480 0x5572a8bc1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.890+0000 7f642a402740 1 --2- 172.21.15.120:0/3033643170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5572a8b9eb60 0x5572a8ba0cc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.890+0000 7f642a402740 1 -- 172.21.15.120:0/3033643170 >> 172.21.15.120:0/3033643170 conn(0x5572a8b9b0f0 msgr2=0x5572a8ba05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:07.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.891+0000 7f642a402740 1 -- 172.21.15.120:0/3033643170 shutdown_connections 2024-09-19T05:20:07.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.891+0000 7f642a402740 1 -- 172.21.15.120:0/3033643170 wait complete. 2024-09-19T05:20:07.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.891+0000 7f642a402740 1 -- start start 2024-09-19T05:20:07.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.891+0000 7f642a402740 1 Processor -- start 2024-09-19T05:20:07.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.892+0000 7f642a402740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5572a8b9f480 0x5572a8badfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:07.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.892+0000 7f642a402740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572a8ba9d40 0x5572a8bae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:07.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.892+0000 7f642a402740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572a8c215f0 0x5572a8c239e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:07.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.892+0000 7f642a402740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f64201a9da0 con 0x5572a8c215f0 2024-09-19T05:20:07.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.892+0000 7f642a402740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f64201ab210 con 0x5572a8ba9d40 2024-09-19T05:20:07.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.892+0000 7f642a402740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f64201aa470 con 0x5572a8b9f480 2024-09-19T05:20:07.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.892+0000 7f642a402740 10 client.0 _ll_register_callbacks cb 0x7f6418005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:07.899 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.892+0000 7f64265c6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572a8c215f0 0x5572a8c239e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:07.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.892+0000 7f64265c6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572a8c215f0 0x5572a8c239e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46676/0 (socket says 172.21.15.120:46676) 2024-09-19T05:20:07.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.892+0000 7f64265c6640 1 -- 172.21.15.120:0/527905115 learned_addr learned my addr 172.21.15.120:0/527905115 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:07.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.892+0000 7f64255c4640 1 --2- 172.21.15.120:0/527905115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572a8ba9d40 0x5572a8bae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:07.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.892+0000 7f64265c6640 1 -- 172.21.15.120:0/527905115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5572a8b9f480 msgr2=0x5572a8badfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:07.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.892+0000 7f64265c6640 1 --2- 172.21.15.120:0/527905115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5572a8b9f480 0x5572a8badfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.892+0000 7f64265c6640 1 -- 172.21.15.120:0/527905115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572a8ba9d40 msgr2=0x5572a8bae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:07.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.892+0000 7f64265c6640 1 --2- 172.21.15.120:0/527905115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572a8ba9d40 0x5572a8bae510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.892+0000 7f64265c6640 1 -- 172.21.15.120:0/527905115 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572a8c23f20 con 0x5572a8c215f0 2024-09-19T05:20:07.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.893+0000 7f64265c6640 1 --2- 172.21.15.120:0/527905115 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572a8c215f0 0x5572a8c239e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f641802ae00 tx=0x7f641803c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b323f0a92ec59a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:07.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.893+0000 7f64097fa640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:20:07.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.893+0000 7f64097fa640 1 -- 172.21.15.120:0/527905115 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6418049040 con 0x5572a8c215f0 2024-09-19T05:20:07.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.893+0000 7f642a402740 1 -- 172.21.15.120:0/527905115 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f641c004640 con 0x5572a8c215f0 2024-09-19T05:20:07.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.893+0000 7f64097fa640 1 -- 172.21.15.120:0/527905115 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f6418003970 con 0x5572a8c215f0 2024-09-19T05:20:07.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.893+0000 7f64097fa640 1 -- 172.21.15.120:0/527905115 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f641802af20 con 0x5572a8c215f0 2024-09-19T05:20:07.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.893+0000 7f642a402740 10 client.15498 fetch_fsmap learned FSMap version 25 2024-09-19T05:20:07.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.893+0000 7f642a402740 1 -- 172.21.15.120:0/527905115 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5572a8c25160 con 0x5572a8c215f0 2024-09-19T05:20:07.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.894+0000 7f64097fa640 1 -- 172.21.15.120:0/527905115 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6418036040 con 0x5572a8c215f0 2024-09-19T05:20:07.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.894+0000 7f64097fa640 1 -- 172.21.15.120:0/527905115 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6418030040 con 0x5572a8c215f0 2024-09-19T05:20:07.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.894+0000 7f642a402740 10 client.15498 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:20:07.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.894+0000 7f642a402740 10 client.15498 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:20:07.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.894+0000 7f642a402740 20 client.15498 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:07.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.894+0000 7f642a402740 1 --2- 172.21.15.120:0/527905115 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5572a8c258b0 0x5572a8c27cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:07.901 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.894+0000 7f642a402740 4 client.15498 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T05:20:07.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.894+0000 7f642a402740 1 -- 172.21.15.120:0/527905115 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f641c004640 con 0x5572a8c258b0 2024-09-19T05:20:07.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.894+0000 7f6425dc5640 1 --2- 172.21.15.120:0/527905115 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5572a8c258b0 0x5572a8c27cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:07.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.895+0000 7f64097fa640 10 client.15498 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:07.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.895+0000 7f6425dc5640 1 --2- 172.21.15.120:0/527905115 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5572a8c258b0 0x5572a8c27cf0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=870ada8216f605a4 server_cookie=24b2589a5ee51374 in_seq=0 out_seq=0 2024-09-19T05:20:07.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.896+0000 7f64097fa640 1 -- 172.21.15.120:0/527905115 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f641c004640 con 0x5572a8c258b0 2024-09-19T05:20:07.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.896+0000 7f64097fa640 10 client.15498 handle_command_reply: tid=0 2024-09-19T05:20:07.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.896+0000 7f642a402740 1 client.15498 shutdown 2024-09-19T05:20:07.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.897+0000 7f642a402740 1 -- 172.21.15.120:0/527905115 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572a8c215f0 msgr2=0x5572a8c239e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:07.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.897+0000 7f642a402740 1 --2- 172.21.15.120:0/527905115 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572a8c215f0 0x5572a8c239e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f641802ae00 tx=0x7f641803c9b0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.897+0000 7f642a402740 1 -- 172.21.15.120:0/527905115 shutdown_connections 2024-09-19T05:20:07.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.897+0000 7f642a402740 1 --2- 172.21.15.120:0/527905115 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5572a8c215f0 0x5572a8c239e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.897+0000 7f642a402740 1 --2- 172.21.15.120:0/527905115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572a8ba9d40 0x5572a8bae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.897+0000 7f642a402740 1 --2- 172.21.15.120:0/527905115 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5572a8c258b0 0x5572a8c27cf0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.897+0000 7f642a402740 1 --2- 172.21.15.120:0/527905115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5572a8b9f480 0x5572a8badfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.897+0000 7f64097fa640 0 client.15498 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:07.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.897+0000 7f642a402740 1 -- 172.21.15.120:0/527905115 >> 172.21.15.120:0/527905115 conn(0x5572a8b9b0f0 msgr2=0x5572a8b9a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:07.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.897+0000 7f642a402740 1 -- 172.21.15.120:0/527905115 shutdown_connections 2024-09-19T05:20:07.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.897+0000 7f642a402740 1 -- 172.21.15.120:0/527905115 wait complete. 2024-09-19T05:20:07.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.897+0000 7f642a402740 20 client.15498 trim_cache size 0 max 16384 2024-09-19T05:20:07.903 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T05:20:07.903 INFO:teuthology.orchestra.run.smithi120.stdout: "return_code": 0, 2024-09-19T05:20:07.903 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_tag": "682431df-85a5-470f-ba5b-4e36ef104c6d", 2024-09-19T05:20:07.904 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": "asynchronous" 2024-09-19T05:20:07.904 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T05:20:07.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.898+0000 7f6428029640 1 -- 172.21.15.120:0/3736738351 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f640c0a3550 msgr2=0x7f640c0a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:07.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.898+0000 7f6428029640 1 --2- 172.21.15.120:0/3736738351 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f640c0a3550 0x7f640c0a5a10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f641c005fd0 tx=0x7f641c005850 comp rx=0 tx=0).stop 2024-09-19T05:20:07.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.898+0000 7f6428029640 1 -- 172.21.15.120:0/3736738351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64201036e0 msgr2=0x7f6420198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:07.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.898+0000 7f6428029640 1 --2- 172.21.15.120:0/3736738351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64201036e0 0x7f6420198960 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f641000c8c0 tx=0x7f641000cd80 comp rx=0 tx=0).stop 2024-09-19T05:20:07.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.898+0000 7f6428029640 1 -- 172.21.15.120:0/3736738351 shutdown_connections 2024-09-19T05:20:07.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.898+0000 7f6428029640 1 --2- 172.21.15.120:0/3736738351 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f640c0a3550 0x7f640c0a5a10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.898+0000 7f6428029640 1 --2- 172.21.15.120:0/3736738351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64201082a0 0x7f642019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.898+0000 7f6428029640 1 --2- 172.21.15.120:0/3736738351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f64201036e0 0x7f6420198960 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.898+0000 7f6428029640 1 --2- 172.21.15.120:0/3736738351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6420102d30 0x7f6420198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:07.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.898+0000 7f6428029640 1 -- 172.21.15.120:0/3736738351 >> 172.21.15.120:0/3736738351 conn(0x7f64200fc7d0 msgr2=0x7f6420105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:07.905 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.898+0000 7f6428029640 1 -- 172.21.15.120:0/3736738351 shutdown_connections 2024-09-19T05:20:07.906 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:07.898+0000 7f6428029640 1 -- 172.21.15.120:0/3736738351 wait complete. 2024-09-19T05:20:08.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:08 smithi120 ceph-mon[30956]: scrub queued for path: / 2024-09-19T05:20:08.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:08 smithi120 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T05:20:08.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:08 smithi120 ceph-mon[30956]: scrub summary: active paths [/] 2024-09-19T05:20:08.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:08 smithi120 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T05:20:08.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:08 smithi194 ceph-mon[35228]: scrub queued for path: / 2024-09-19T05:20:08.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:08 smithi194 ceph-mon[35228]: scrub summary: idle+waiting paths [/] 2024-09-19T05:20:08.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:08 smithi194 ceph-mon[35228]: scrub summary: active paths [/] 2024-09-19T05:20:08.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:08 smithi194 ceph-mon[35228]: scrub summary: idle+waiting paths [/] 2024-09-19T05:20:08.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:08 smithi178 ceph-mon[34347]: scrub queued for path: / 2024-09-19T05:20:08.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:08 smithi178 ceph-mon[34347]: scrub summary: idle+waiting paths [/] 2024-09-19T05:20:08.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:08 smithi178 ceph-mon[34347]: scrub summary: active paths [/] 2024-09-19T05:20:08.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:08 smithi178 ceph-mon[34347]: scrub summary: idle+waiting paths [/] 2024-09-19T05:20:08.712 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T05:20:09.031 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:09 smithi120 ceph-mon[30956]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T05:20:09.100 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:09.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:09 smithi194 ceph-mon[35228]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T05:20:09.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:09 smithi178 ceph-mon[34347]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T05:20:09.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.645+0000 7ff972ffd640 1 -- 172.21.15.120:0/870436672 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff964031880 con 0x7ff974106b80 2024-09-19T05:20:09.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.646+0000 7ff97a5ca640 1 -- 172.21.15.120:0/870436672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff974106b80 msgr2=0x7ff974106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:09.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.646+0000 7ff97a5ca640 1 --2- 172.21.15.120:0/870436672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff974106b80 0x7ff974106f60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff964009900 tx=0x7ff96402a410 comp rx=0 tx=0).stop 2024-09-19T05:20:09.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.646+0000 7ff97a5ca640 1 -- 172.21.15.120:0/870436672 shutdown_connections 2024-09-19T05:20:09.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.646+0000 7ff97a5ca640 1 --2- 172.21.15.120:0/870436672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff974100aa0 0x7ff97410ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.646+0000 7ff97a5ca640 1 --2- 172.21.15.120:0/870436672 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff974100100 0x7ff974100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.646+0000 7ff97a5ca640 1 --2- 172.21.15.120:0/870436672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff974106b80 0x7ff974106f60 secure :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff964009900 tx=0x7ff96402a410 comp rx=0 tx=0).stop 2024-09-19T05:20:09.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.646+0000 7ff97a5ca640 1 -- 172.21.15.120:0/870436672 >> 172.21.15.120:0/870436672 conn(0x7ff974077230 msgr2=0x7ff9740fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:09.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.646+0000 7ff97a5ca640 1 -- 172.21.15.120:0/870436672 shutdown_connections 2024-09-19T05:20:09.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.646+0000 7ff97a5ca640 1 -- 172.21.15.120:0/870436672 wait complete. 2024-09-19T05:20:09.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.647+0000 7ff97a5ca640 1 Processor -- start 2024-09-19T05:20:09.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.647+0000 7ff97a5ca640 1 -- start start 2024-09-19T05:20:09.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.647+0000 7ff97a5ca640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff974100100 0x7ff9741985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:09.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.647+0000 7ff97a5ca640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff974100aa0 0x7ff974198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:09.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.648+0000 7ff97a5ca640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff97419cec0 0x7ff97419d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:09.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.648+0000 7ff97a5ca640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff974111f10 con 0x7ff974100100 2024-09-19T05:20:09.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.648+0000 7ff97a5ca640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff974111d90 con 0x7ff97419cec0 2024-09-19T05:20:09.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.648+0000 7ff97a5ca640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff974112090 con 0x7ff974100aa0 2024-09-19T05:20:09.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.648+0000 7ff978b67640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff97419cec0 0x7ff97419d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:09.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.648+0000 7ff9737fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff974100aa0 0x7ff974198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:09.650 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.648+0000 7ff978b67640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff97419cec0 0x7ff97419d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:50132/0 (socket says 172.21.15.120:50132) 2024-09-19T05:20:09.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.648+0000 7ff978b67640 1 -- 172.21.15.120:0/2767628260 learned_addr learned my addr 172.21.15.120:0/2767628260 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:09.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.648+0000 7ff973fff640 1 --2- 172.21.15.120:0/2767628260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff974100100 0x7ff9741985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:09.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.648+0000 7ff978b67640 1 -- 172.21.15.120:0/2767628260 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff974100aa0 msgr2=0x7ff974198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:09.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.648+0000 7ff978b67640 1 --2- 172.21.15.120:0/2767628260 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff974100aa0 0x7ff974198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.648+0000 7ff978b67640 1 -- 172.21.15.120:0/2767628260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff974100100 msgr2=0x7ff9741985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:09.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.648+0000 7ff978b67640 1 --2- 172.21.15.120:0/2767628260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff974100100 0x7ff9741985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.648+0000 7ff978b67640 1 -- 172.21.15.120:0/2767628260 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff97419d980 con 0x7ff97419cec0 2024-09-19T05:20:09.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.648+0000 7ff9737fe640 1 --2- 172.21.15.120:0/2767628260 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff974100aa0 0x7ff974198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:09.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.649+0000 7ff978b67640 1 --2- 172.21.15.120:0/2767628260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff97419cec0 0x7ff97419d370 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00e9d0 tx=0x7ff96c00ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:09.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.649+0000 7ff9717fa640 1 -- 172.21.15.120:0/2767628260 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c00cd80 con 0x7ff97419cec0 2024-09-19T05:20:09.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.649+0000 7ff97a5ca640 1 -- 172.21.15.120:0/2767628260 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff97419dc70 con 0x7ff97419cec0 2024-09-19T05:20:09.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.649+0000 7ff9717fa640 1 -- 172.21.15.120:0/2767628260 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff96c005020 con 0x7ff97419cec0 2024-09-19T05:20:09.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.649+0000 7ff9717fa640 1 -- 172.21.15.120:0/2767628260 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c0116d0 con 0x7ff97419cec0 2024-09-19T05:20:09.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.649+0000 7ff97a5ca640 1 -- 172.21.15.120:0/2767628260 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9741a5450 con 0x7ff97419cec0 2024-09-19T05:20:09.654 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.653+0000 7ff97c9a3740 1 Processor -- start 2024-09-19T05:20:09.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.653+0000 7ff9717fa640 1 -- 172.21.15.120:0/2767628260 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7ff96c0051d0 con 0x7ff97419cec0 2024-09-19T05:20:09.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.653+0000 7ff97c9a3740 1 -- start start 2024-09-19T05:20:09.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.653+0000 7ff97c9a3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561480c89490 0x561480c89870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:09.655 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.654+0000 7ff97c9a3740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561480c89db0 0x561480c94130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:09.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.654+0000 7ff97c9a3740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c94670 0x561480c96a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:09.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.654+0000 7ff97c9a3740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561480bef2e0 con 0x561480c94670 2024-09-19T05:20:09.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.654+0000 7ff97c9a3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561480b96ce0 con 0x561480c89490 2024-09-19T05:20:09.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.654+0000 7ff97c9a3740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x561480beb2a0 con 0x561480c89db0 2024-09-19T05:20:09.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.654+0000 7ff9737fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c94670 0x561480c96a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:09.657 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.654+0000 7ff973fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561480c89db0 0x561480c94130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:09.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.654+0000 7ff9737fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c94670 0x561480c96a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46712/0 (socket says 172.21.15.120:46712) 2024-09-19T05:20:09.658 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.654+0000 7ff9737fe640 1 -- 172.21.15.120:0/2369929144 learned_addr learned my addr 172.21.15.120:0/2369929144 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:09.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.654+0000 7ff973fff640 1 -- 172.21.15.120:0/2369929144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561480c89490 msgr2=0x561480c89870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:09.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.654+0000 7ff973fff640 1 --2- 172.21.15.120:0/2369929144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561480c89490 0x561480c89870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.654+0000 7ff973fff640 1 -- 172.21.15.120:0/2369929144 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c94670 msgr2=0x561480c96a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:09.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.654+0000 7ff973fff640 1 --2- 172.21.15.120:0/2369929144 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c94670 0x561480c96a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.654+0000 7ff973fff640 1 -- 172.21.15.120:0/2369929144 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561480b7b440 con 0x561480c89db0 2024-09-19T05:20:09.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.654+0000 7ff9737fe640 1 --2- 172.21.15.120:0/2369929144 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c94670 0x561480c96a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:09.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.655+0000 7ff9717fa640 1 --2- 172.21.15.120:0/2767628260 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ff95c0a3550 0x7ff95c0a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:09.659 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.655+0000 7ff973fff640 1 --2- 172.21.15.120:0/2369929144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561480c89db0 0x561480c94130 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff964008000 tx=0x7ff964032bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4977d9639111770 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:09.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.655+0000 7ff9717fa640 1 -- 172.21.15.120:0/2767628260 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7ff96c0d0120 con 0x7ff97419cec0 2024-09-19T05:20:09.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.655+0000 7ff9737fe640 1 --2- 172.21.15.120:0/2767628260 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ff95c0a3550 0x7ff95c0a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:09.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.655+0000 7ff95a7fc640 1 -- 172.21.15.120:0/2369929144 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96403f070 con 0x561480c89db0 2024-09-19T05:20:09.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.655+0000 7ff95a7fc640 1 -- 172.21.15.120:0/2369929144 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff964004020 con 0x561480c89db0 2024-09-19T05:20:09.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.655+0000 7ff95a7fc640 1 -- 172.21.15.120:0/2369929144 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff964035070 con 0x561480c89db0 2024-09-19T05:20:09.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.656+0000 7ff97c9a3740 1 -- 172.21.15.120:0/2369929144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561480c89db0 msgr2=0x561480c94130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:09.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.656+0000 7ff97c9a3740 1 --2- 172.21.15.120:0/2369929144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561480c89db0 0x561480c94130 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff964008000 tx=0x7ff964032bd0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.656+0000 7ff9737fe640 1 --2- 172.21.15.120:0/2767628260 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ff95c0a3550 0x7ff95c0a5a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x561480c86da0 tx=0x7ff96800bc10 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:09.660 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.656+0000 7ff97c9a3740 1 -- 172.21.15.120:0/2369929144 shutdown_connections 2024-09-19T05:20:09.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.656+0000 7ff97c9a3740 1 --2- 172.21.15.120:0/2369929144 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c94670 0x561480c96a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.656+0000 7ff97c9a3740 1 --2- 172.21.15.120:0/2369929144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561480c89db0 0x561480c94130 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.656+0000 7ff97c9a3740 1 --2- 172.21.15.120:0/2369929144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561480c89490 0x561480c89870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.656+0000 7ff97c9a3740 1 -- 172.21.15.120:0/2369929144 >> 172.21.15.120:0/2369929144 conn(0x561480c85a20 msgr2=0x561480c85e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:09.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.656+0000 7ff97c9a3740 1 -- 172.21.15.120:0/2369929144 shutdown_connections 2024-09-19T05:20:09.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.657+0000 7ff97c9a3740 1 -- 172.21.15.120:0/2369929144 wait complete. 2024-09-19T05:20:09.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.657+0000 7ff97c9a3740 1 -- start start 2024-09-19T05:20:09.661 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.657+0000 7ff97c9a3740 1 Processor -- start 2024-09-19T05:20:09.663 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.658+0000 7ff97c9a3740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c89490 0x561480c8d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:09.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.658+0000 7ff97c9a3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561480c89db0 0x561480c8da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:09.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.658+0000 7ff97c9a3740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561480c94670 0x561480c8df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:09.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.658+0000 7ff973fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c89490 0x561480c8d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:09.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.658+0000 7ff973fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c89490 0x561480c8d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46718/0 (socket says 172.21.15.120:46718) 2024-09-19T05:20:09.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.658+0000 7ff973fff640 1 -- 172.21.15.120:0/305548368 learned_addr learned my addr 172.21.15.120:0/305548368 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:09.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.658+0000 7ff97c9a3740 1 -- 172.21.15.120:0/305548368 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561480c971e0 con 0x561480c89490 2024-09-19T05:20:09.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.658+0000 7ff97c9a3740 1 -- 172.21.15.120:0/305548368 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561480baa050 con 0x561480c89db0 2024-09-19T05:20:09.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.658+0000 7ff97c9a3740 1 -- 172.21.15.120:0/305548368 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x561480c97360 con 0x561480c94670 2024-09-19T05:20:09.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.658+0000 7ff9737fe640 1 --2- 172.21.15.120:0/305548368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561480c89db0 0x561480c8da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:09.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.658+0000 7ff97c9a3740 10 client.0 _ll_register_callbacks cb 0x561480bea160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:09.664 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.658+0000 7ff978b67640 1 --2- 172.21.15.120:0/305548368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561480c94670 0x561480c8df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:09.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.659+0000 7ff9737fe640 1 -- 172.21.15.120:0/305548368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561480c94670 msgr2=0x561480c8df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:09.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.659+0000 7ff9737fe640 1 --2- 172.21.15.120:0/305548368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561480c94670 0x561480c8df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.659+0000 7ff9737fe640 1 -- 172.21.15.120:0/305548368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c89490 msgr2=0x561480c8d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:09.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.659+0000 7ff9737fe640 1 --2- 172.21.15.120:0/305548368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c89490 0x561480c8d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.659+0000 7ff9737fe640 1 -- 172.21.15.120:0/305548368 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614809603c0 con 0x561480c89db0 2024-09-19T05:20:09.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.659+0000 7ff973fff640 1 --2- 172.21.15.120:0/305548368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c89490 0x561480c8d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:09.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.659+0000 7ff9737fe640 1 --2- 172.21.15.120:0/305548368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561480c89db0 0x561480c8da10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff968004700 tx=0x7ff968004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bab0e5207c64a995 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:09.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.659+0000 7ff9537fe640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:20:09.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.659+0000 7ff9537fe640 1 -- 172.21.15.120:0/305548368 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96802a060 con 0x561480c89db0 2024-09-19T05:20:09.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.660+0000 7ff9537fe640 1 -- 172.21.15.120:0/305548368 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7ff96801dc20 con 0x561480c89db0 2024-09-19T05:20:09.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.660+0000 7ff97c9a3740 1 -- 172.21.15.120:0/305548368 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff964004020 con 0x561480c89db0 2024-09-19T05:20:09.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.660+0000 7ff9537fe640 1 -- 172.21.15.120:0/305548368 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff96801de20 con 0x561480c89db0 2024-09-19T05:20:09.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.660+0000 7ff97c9a3740 10 client.24983 fetch_fsmap learned FSMap version 25 2024-09-19T05:20:09.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.660+0000 7ff97c9a3740 1 -- 172.21.15.120:0/305548368 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561480ca2cd0 con 0x561480c89db0 2024-09-19T05:20:09.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.660+0000 7ff9537fe640 1 -- 172.21.15.120:0/305548368 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff96801b910 con 0x561480c89db0 2024-09-19T05:20:09.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.660+0000 7ff9537fe640 1 -- 172.21.15.120:0/305548368 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff968019040 con 0x561480c89db0 2024-09-19T05:20:09.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.660+0000 7ff97c9a3740 10 client.24983 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:20:09.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.661+0000 7ff97c9a3740 10 client.24983 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:20:09.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.661+0000 7ff97c9a3740 20 client.24983 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:09.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.661+0000 7ff97c9a3740 1 --2- 172.21.15.120:0/305548368 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x561480ca40e0 0x561480ca64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:09.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.661+0000 7ff97c9a3740 4 client.24983 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:20:09.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.661+0000 7ff97c9a3740 1 -- 172.21.15.120:0/305548368 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff964004020 con 0x561480ca40e0 2024-09-19T05:20:09.667 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.661+0000 7ff973fff640 1 --2- 172.21.15.120:0/305548368 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x561480ca40e0 0x561480ca64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:09.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.662+0000 7ff9537fe640 10 client.24983 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:09.668 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.662+0000 7ff973fff640 1 --2- 172.21.15.120:0/305548368 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x561480ca40e0 0x561480ca64f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e867b4de3f951fb server_cookie=8261b0d62dbcf124 in_seq=0 out_seq=0 2024-09-19T05:20:09.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.662+0000 7ff9537fe640 1 -- 172.21.15.120:0/305548368 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7ff964004020 con 0x561480ca40e0 2024-09-19T05:20:09.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.662+0000 7ff9537fe640 10 client.24983 handle_command_reply: tid=0 2024-09-19T05:20:09.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.662+0000 7ff97c9a3740 1 client.24983 shutdown 2024-09-19T05:20:09.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.663+0000 7ff97c9a3740 1 -- 172.21.15.120:0/305548368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561480c89db0 msgr2=0x561480c8da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:09.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.663+0000 7ff97c9a3740 1 --2- 172.21.15.120:0/305548368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561480c89db0 0x561480c8da10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff968004700 tx=0x7ff968004730 comp rx=0 tx=0).stop 2024-09-19T05:20:09.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.663+0000 7ff97c9a3740 1 -- 172.21.15.120:0/305548368 shutdown_connections 2024-09-19T05:20:09.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.663+0000 7ff97c9a3740 1 --2- 172.21.15.120:0/305548368 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x561480ca40e0 0x561480ca64f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.663+0000 7ff97c9a3740 1 --2- 172.21.15.120:0/305548368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561480c94670 0x561480c8df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.663+0000 7ff9537fe640 0 client.24983 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:09.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.663+0000 7ff97c9a3740 1 --2- 172.21.15.120:0/305548368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561480c89db0 0x561480c8da10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.663+0000 7ff97c9a3740 1 --2- 172.21.15.120:0/305548368 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c89490 0x561480c8d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.669 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.663+0000 7ff97c9a3740 1 -- 172.21.15.120:0/305548368 >> 172.21.15.120:0/305548368 conn(0x561480c85a20 msgr2=0x561480c8b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:09.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.663+0000 7ff97c9a3740 1 -- 172.21.15.120:0/305548368 shutdown_connections 2024-09-19T05:20:09.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.663+0000 7ff97c9a3740 1 -- 172.21.15.120:0/305548368 wait complete. 2024-09-19T05:20:09.670 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.664+0000 7ff97c9a3740 20 client.24983 trim_cache size 0 max 16384 2024-09-19T05:20:09.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.697+0000 7ff97c9a3740 1 Processor -- start 2024-09-19T05:20:09.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.697+0000 7ff97c9a3740 1 -- start start 2024-09-19T05:20:09.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.697+0000 7ff97c9a3740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c89490 0x561480c91810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:09.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.697+0000 7ff97c9a3740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561480c89db0 0x561480c8bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:09.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.697+0000 7ff97c9a3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561480c94670 0x561480c8c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:09.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.697+0000 7ff97c9a3740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff9741b6c10 con 0x561480c89490 2024-09-19T05:20:09.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.697+0000 7ff97c9a3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff9741b44e0 con 0x561480c94670 2024-09-19T05:20:09.699 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.697+0000 7ff97c9a3740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff9741b2330 con 0x561480c89db0 2024-09-19T05:20:09.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.697+0000 7ff978b67640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561480c94670 0x561480c8c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:09.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.697+0000 7ff9737fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561480c89db0 0x561480c8bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:09.700 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.697+0000 7ff978b67640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561480c94670 0x561480c8c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:50150/0 (socket says 172.21.15.120:50150) 2024-09-19T05:20:09.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.697+0000 7ff978b67640 1 -- 172.21.15.120:0/1058179789 learned_addr learned my addr 172.21.15.120:0/1058179789 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:09.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.698+0000 7ff978b67640 1 -- 172.21.15.120:0/1058179789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561480c89db0 msgr2=0x561480c8bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:09.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.698+0000 7ff978b67640 1 --2- 172.21.15.120:0/1058179789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561480c89db0 0x561480c8bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.698+0000 7ff978b67640 1 -- 172.21.15.120:0/1058179789 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c89490 msgr2=0x561480c91810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:20:09.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.698+0000 7ff973fff640 1 --2- 172.21.15.120:0/1058179789 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c89490 0x561480c91810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:09.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.698+0000 7ff978b67640 1 --2- 172.21.15.120:0/1058179789 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c89490 0x561480c91810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.698+0000 7ff978b67640 1 -- 172.21.15.120:0/1058179789 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561480c81000 con 0x561480c94670 2024-09-19T05:20:09.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.698+0000 7ff9737fe640 1 --2- 172.21.15.120:0/1058179789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561480c89db0 0x561480c8bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:09.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.698+0000 7ff973fff640 1 --2- 172.21.15.120:0/1058179789 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c89490 0x561480c91810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:20:09.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.698+0000 7ff978b67640 1 --2- 172.21.15.120:0/1058179789 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561480c94670 0x561480c8c430 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff96c009fd0 tx=0x7ff96c09bc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fda2ce8820c36343 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:09.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.699+0000 7ff959ffb640 1 -- 172.21.15.120:0/1058179789 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c01f040 con 0x561480c94670 2024-09-19T05:20:09.701 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.699+0000 7ff959ffb640 1 -- 172.21.15.120:0/1058179789 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff96c005580 con 0x561480c94670 2024-09-19T05:20:09.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.699+0000 7ff959ffb640 1 -- 172.21.15.120:0/1058179789 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c0cda20 con 0x561480c94670 2024-09-19T05:20:09.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.700+0000 7ff97c9a3740 1 -- 172.21.15.120:0/1058179789 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561480c94670 msgr2=0x561480c8c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:09.702 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.700+0000 7ff97c9a3740 1 --2- 172.21.15.120:0/1058179789 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561480c94670 0x561480c8c430 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff96c009fd0 tx=0x7ff96c09bc70 comp rx=0 tx=0).stop 2024-09-19T05:20:09.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.700+0000 7ff97c9a3740 1 -- 172.21.15.120:0/1058179789 shutdown_connections 2024-09-19T05:20:09.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.700+0000 7ff97c9a3740 1 --2- 172.21.15.120:0/1058179789 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561480c94670 0x561480c8c430 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.700+0000 7ff97c9a3740 1 --2- 172.21.15.120:0/1058179789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561480c89db0 0x561480c8bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.700+0000 7ff97c9a3740 1 --2- 172.21.15.120:0/1058179789 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c89490 0x561480c91810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.700+0000 7ff97c9a3740 1 -- 172.21.15.120:0/1058179789 >> 172.21.15.120:0/1058179789 conn(0x561480c85a20 msgr2=0x561480c84ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:09.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.700+0000 7ff97c9a3740 1 -- 172.21.15.120:0/1058179789 shutdown_connections 2024-09-19T05:20:09.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.700+0000 7ff97c9a3740 1 -- 172.21.15.120:0/1058179789 wait complete. 2024-09-19T05:20:09.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.700+0000 7ff97c9a3740 1 -- start start 2024-09-19T05:20:09.703 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.701+0000 7ff97c9a3740 1 Processor -- start 2024-09-19T05:20:09.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.701+0000 7ff97c9a3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561480c89490 0x561480c9c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:09.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.701+0000 7ff97c9a3740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c89db0 0x561480c9ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:09.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.701+0000 7ff97c9a3740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561480c94670 0x561480c9cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:09.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.701+0000 7ff97c9a3740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff9741b29a0 con 0x561480c89db0 2024-09-19T05:20:09.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.702+0000 7ff97c9a3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff9741b3e10 con 0x561480c89490 2024-09-19T05:20:09.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.702+0000 7ff97c9a3740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff9741b3070 con 0x561480c94670 2024-09-19T05:20:09.705 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.702+0000 7ff9737fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c89db0 0x561480c9ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:09.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.702+0000 7ff97c9a3740 10 client.0 _ll_register_callbacks cb 0x7ff9680105b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:09.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.702+0000 7ff9737fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c89db0 0x561480c9ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46748/0 (socket says 172.21.15.120:46748) 2024-09-19T05:20:09.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.702+0000 7ff9737fe640 1 -- 172.21.15.120:0/3314103624 learned_addr learned my addr 172.21.15.120:0/3314103624 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:09.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.702+0000 7ff978b67640 1 --2- 172.21.15.120:0/3314103624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561480c94670 0x561480c9cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:09.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.702+0000 7ff973fff640 1 --2- 172.21.15.120:0/3314103624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561480c89490 0x561480c9c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:09.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.702+0000 7ff9737fe640 1 -- 172.21.15.120:0/3314103624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561480c94670 msgr2=0x561480c9cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:09.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.702+0000 7ff9737fe640 1 --2- 172.21.15.120:0/3314103624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561480c94670 0x561480c9cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.702+0000 7ff9737fe640 1 -- 172.21.15.120:0/3314103624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561480c89490 msgr2=0x561480c9c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:09.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.702+0000 7ff9737fe640 1 --2- 172.21.15.120:0/3314103624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561480c89490 0x561480c9c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.702+0000 7ff9737fe640 1 -- 172.21.15.120:0/3314103624 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561480c852b0 con 0x561480c89db0 2024-09-19T05:20:09.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.703+0000 7ff9737fe640 1 --2- 172.21.15.120:0/3314103624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c89db0 0x561480c9ca50 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff96800be80 tx=0x7ff968025610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d4b6bdd1037cda server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:09.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.703+0000 7ff9537fe640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:20:09.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.703+0000 7ff9537fe640 1 -- 172.21.15.120:0/3314103624 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96803a060 con 0x561480c89db0 2024-09-19T05:20:09.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.703+0000 7ff9537fe640 1 -- 172.21.15.120:0/3314103624 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7ff96801b460 con 0x561480c89db0 2024-09-19T05:20:09.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.703+0000 7ff97c9a3740 1 -- 172.21.15.120:0/3314103624 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff96c005580 con 0x561480c89db0 2024-09-19T05:20:09.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.703+0000 7ff9537fe640 1 -- 172.21.15.120:0/3314103624 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff968025e40 con 0x561480c89db0 2024-09-19T05:20:09.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.703+0000 7ff97c9a3740 10 client.15513 fetch_fsmap learned FSMap version 25 2024-09-19T05:20:09.707 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.703+0000 7ff97c9a3740 1 -- 172.21.15.120:0/3314103624 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561480d0f060 con 0x561480c89db0 2024-09-19T05:20:09.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.704+0000 7ff9537fe640 1 -- 172.21.15.120:0/3314103624 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff96c005580 con 0x561480c89db0 2024-09-19T05:20:09.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.704+0000 7ff9537fe640 1 -- 172.21.15.120:0/3314103624 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff968034070 con 0x561480c89db0 2024-09-19T05:20:09.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.704+0000 7ff97c9a3740 10 client.15513 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:20:09.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.704+0000 7ff97c9a3740 10 client.15513 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:20:09.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.704+0000 7ff97c9a3740 20 client.15513 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:09.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.704+0000 7ff97c9a3740 1 --2- 172.21.15.120:0/3314103624 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x561480ca40e0 0x561480d11820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:09.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.704+0000 7ff97c9a3740 4 client.15513 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:20:09.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.704+0000 7ff97c9a3740 1 -- 172.21.15.120:0/3314103624 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561480bfc850 con 0x561480ca40e0 2024-09-19T05:20:09.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.704+0000 7ff973fff640 1 --2- 172.21.15.120:0/3314103624 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x561480ca40e0 0x561480d11820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:09.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.705+0000 7ff973fff640 1 --2- 172.21.15.120:0/3314103624 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x561480ca40e0 0x561480d11820 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b39c5fd870424382 server_cookie=859fe6b7f34b2dcc in_seq=0 out_seq=0 2024-09-19T05:20:09.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.705+0000 7ff9537fe640 10 client.15513 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:09.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.705+0000 7ff9537fe640 1 -- 172.21.15.120:0/3314103624 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x561480bfc850 con 0x561480ca40e0 2024-09-19T05:20:09.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.705+0000 7ff9537fe640 10 client.15513 handle_command_reply: tid=0 2024-09-19T05:20:09.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.705+0000 7ff97c9a3740 1 client.15513 shutdown 2024-09-19T05:20:09.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.706+0000 7ff97c9a3740 1 -- 172.21.15.120:0/3314103624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c89db0 msgr2=0x561480c9ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:09.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.706+0000 7ff97c9a3740 1 --2- 172.21.15.120:0/3314103624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c89db0 0x561480c9ca50 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff96800be80 tx=0x7ff968025610 comp rx=0 tx=0).stop 2024-09-19T05:20:09.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.706+0000 7ff97c9a3740 1 -- 172.21.15.120:0/3314103624 shutdown_connections 2024-09-19T05:20:09.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.706+0000 7ff97c9a3740 1 --2- 172.21.15.120:0/3314103624 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x561480ca40e0 0x561480d11820 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.706+0000 7ff9537fe640 0 client.15513 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:09.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.706+0000 7ff97c9a3740 1 --2- 172.21.15.120:0/3314103624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561480c94670 0x561480c9cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.706+0000 7ff97c9a3740 1 --2- 172.21.15.120:0/3314103624 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561480c89db0 0x561480c9ca50 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.706+0000 7ff97c9a3740 1 --2- 172.21.15.120:0/3314103624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561480c89490 0x561480c9c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.706+0000 7ff97c9a3740 1 -- 172.21.15.120:0/3314103624 >> 172.21.15.120:0/3314103624 conn(0x561480c85a20 msgr2=0x561480c92d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:09.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.706+0000 7ff97c9a3740 1 -- 172.21.15.120:0/3314103624 shutdown_connections 2024-09-19T05:20:09.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.706+0000 7ff97c9a3740 1 -- 172.21.15.120:0/3314103624 wait complete. 2024-09-19T05:20:09.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.706+0000 7ff97c9a3740 20 client.15513 trim_cache size 0 max 16384 2024-09-19T05:20:09.710 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T05:20:09.710 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T05:20:09.710 INFO:teuthology.orchestra.run.smithi120.stdout: "scrubs": { 2024-09-19T05:20:09.710 INFO:teuthology.orchestra.run.smithi120.stdout: "682431df-85a5-470f-ba5b-4e36ef104c6d": { 2024-09-19T05:20:09.711 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/", 2024-09-19T05:20:09.711 INFO:teuthology.orchestra.run.smithi120.stdout: "tag": "682431df-85a5-470f-ba5b-4e36ef104c6d", 2024-09-19T05:20:09.711 INFO:teuthology.orchestra.run.smithi120.stdout: "options": "recursive,force" 2024-09-19T05:20:09.711 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:20:09.711 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:20:09.711 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T05:20:09.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.707+0000 7ff97a5ca640 1 -- 172.21.15.120:0/2767628260 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ff95c0a3550 msgr2=0x7ff95c0a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:09.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.707+0000 7ff97a5ca640 1 --2- 172.21.15.120:0/2767628260 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ff95c0a3550 0x7ff95c0a5a10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x561480c86da0 tx=0x7ff96800bc10 comp rx=0 tx=0).stop 2024-09-19T05:20:09.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.707+0000 7ff97a5ca640 1 -- 172.21.15.120:0/2767628260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff97419cec0 msgr2=0x7ff97419d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:09.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.707+0000 7ff97a5ca640 1 --2- 172.21.15.120:0/2767628260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff97419cec0 0x7ff97419d370 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00e9d0 tx=0x7ff96c00ee90 comp rx=0 tx=0).stop 2024-09-19T05:20:09.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.707+0000 7ff97a5ca640 1 -- 172.21.15.120:0/2767628260 shutdown_connections 2024-09-19T05:20:09.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.707+0000 7ff97a5ca640 1 --2- 172.21.15.120:0/2767628260 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ff95c0a3550 0x7ff95c0a5a10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.708+0000 7ff97a5ca640 1 --2- 172.21.15.120:0/2767628260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff97419cec0 0x7ff97419d370 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.712 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.708+0000 7ff97a5ca640 1 --2- 172.21.15.120:0/2767628260 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff974100aa0 0x7ff974198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.708+0000 7ff97a5ca640 1 --2- 172.21.15.120:0/2767628260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff974100100 0x7ff9741985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:09.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.708+0000 7ff97a5ca640 1 -- 172.21.15.120:0/2767628260 >> 172.21.15.120:0/2767628260 conn(0x7ff974077230 msgr2=0x7ff9740fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:09.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.708+0000 7ff97a5ca640 1 -- 172.21.15.120:0/2767628260 shutdown_connections 2024-09-19T05:20:09.713 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:09.708+0000 7ff97a5ca640 1 -- 172.21.15.120:0/2767628260 wait complete. 2024-09-19T05:20:10.530 INFO:tasks.cephfs.filesystem:scrub status for tag:682431df-85a5-470f-ba5b-4e36ef104c6d - {'path': '/', 'tag': '682431df-85a5-470f-ba5b-4e36ef104c6d', 'options': 'recursive,force'} 2024-09-19T05:20:10.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:10 smithi178 ceph-mon[34347]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T05:20:10.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:10 smithi120 ceph-mon[30956]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T05:20:10.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:10 smithi194 ceph-mon[35228]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T05:20:12.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:12 smithi120 ceph-mon[30956]: scrub summary: idle 2024-09-19T05:20:12.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:12 smithi194 ceph-mon[35228]: scrub summary: idle 2024-09-19T05:20:12.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:12 smithi178 ceph-mon[34347]: scrub summary: idle 2024-09-19T05:20:13.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:13 smithi120 ceph-mon[30956]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T05:20:13.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:13 smithi194 ceph-mon[35228]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T05:20:13.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:13 smithi178 ceph-mon[34347]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T05:20:14.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:14 smithi178 ceph-mon[34347]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T05:20:14.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:14 smithi120 ceph-mon[30956]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T05:20:14.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:14 smithi194 ceph-mon[35228]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-19T05:20:16.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:16 smithi178 ceph-mon[34347]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T05:20:16.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:16 smithi120 ceph-mon[30956]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T05:20:16.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:16 smithi194 ceph-mon[35228]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-19T05:20:18.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:18 smithi178 ceph-mon[34347]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-19T05:20:18.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:18 smithi120 ceph-mon[30956]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-19T05:20:18.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:18 smithi194 ceph-mon[35228]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-19T05:20:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.823+0000 7fe0cf637640 1 -- 172.21.15.120:0/4035207436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0c81069c0 msgr2=0x7fe0c8106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.823+0000 7fe0cf637640 1 --2- 172.21.15.120:0/4035207436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0c81069c0 0x7fe0c8106da0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009930 tx=0x7fe0c402a420 comp rx=0 tx=0).stop 2024-09-19T05:20:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.823+0000 7fe0cf637640 1 -- 172.21.15.120:0/4035207436 shutdown_connections 2024-09-19T05:20:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.823+0000 7fe0cf637640 1 --2- 172.21.15.120:0/4035207436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0c8101350 0x7fe0c810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.823+0000 7fe0cf637640 1 --2- 172.21.15.120:0/4035207436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c81009b0 0x7fe0c8100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.823+0000 7fe0cf637640 1 --2- 172.21.15.120:0/4035207436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0c81069c0 0x7fe0c8106da0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.823+0000 7fe0cf637640 1 -- 172.21.15.120:0/4035207436 >> 172.21.15.120:0/4035207436 conn(0x7fe0c8077990 msgr2=0x7fe0c80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.823+0000 7fe0cf637640 1 -- 172.21.15.120:0/4035207436 shutdown_connections 2024-09-19T05:20:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.823+0000 7fe0cf637640 1 -- 172.21.15.120:0/4035207436 wait complete. 2024-09-19T05:20:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.824+0000 7fe0cf637640 1 Processor -- start 2024-09-19T05:20:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.824+0000 7fe0cf637640 1 -- start start 2024-09-19T05:20:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.825+0000 7fe0cf637640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c81009b0 0x7fe0c8197140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.825+0000 7fe0cf637640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0c8101350 0x7fe0c8197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.825+0000 7fe0cf637640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0c81069c0 0x7fe0c819ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.825+0000 7fe0cf637640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c8110cc0 con 0x7fe0c8101350 2024-09-19T05:20:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.825+0000 7fe0ccbd2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0c8101350 0x7fe0c8197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.825+0000 7fe0cf637640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c8110b40 con 0x7fe0c81069c0 2024-09-19T05:20:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.825+0000 7fe0cf637640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c8110e40 con 0x7fe0c81009b0 2024-09-19T05:20:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.825+0000 7fe0ccbd2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0c8101350 0x7fe0c8197680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46282/0 (socket says 172.21.15.120:46282) 2024-09-19T05:20:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.825+0000 7fe0ccbd2640 1 -- 172.21.15.120:0/3249865748 learned_addr learned my addr 172.21.15.120:0/3249865748 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.825+0000 7fe0cd3d3640 1 --2- 172.21.15.120:0/3249865748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c81009b0 0x7fe0c8197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.825+0000 7fe0cdbd4640 1 --2- 172.21.15.120:0/3249865748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0c81069c0 0x7fe0c819ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.825+0000 7fe0ccbd2640 1 -- 172.21.15.120:0/3249865748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c81009b0 msgr2=0x7fe0c8197140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.825+0000 7fe0ccbd2640 1 --2- 172.21.15.120:0/3249865748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c81009b0 0x7fe0c8197140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.825+0000 7fe0ccbd2640 1 -- 172.21.15.120:0/3249865748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0c81069c0 msgr2=0x7fe0c819ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.825+0000 7fe0ccbd2640 1 --2- 172.21.15.120:0/3249865748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0c81069c0 0x7fe0c819ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.825+0000 7fe0ccbd2640 1 -- 172.21.15.120:0/3249865748 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c819c130 con 0x7fe0c8101350 2024-09-19T05:20:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.825+0000 7fe0ccbd2640 1 --2- 172.21.15.120:0/3249865748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0c8101350 0x7fe0c8197680 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8009970 tx=0x7fe0b8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.826+0000 7fe0be7fc640 1 -- 172.21.15.120:0/3249865748 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b800d020 con 0x7fe0c8101350 2024-09-19T05:20:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.826+0000 7fe0be7fc640 1 -- 172.21.15.120:0/3249865748 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0b800d1c0 con 0x7fe0c8101350 2024-09-19T05:20:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.826+0000 7fe0cf637640 1 -- 172.21.15.120:0/3249865748 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c819c420 con 0x7fe0c8101350 2024-09-19T05:20:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.826+0000 7fe0cf637640 1 -- 172.21.15.120:0/3249865748 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0c80698a0 con 0x7fe0c8101350 2024-09-19T05:20:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.826+0000 7fe0be7fc640 1 -- 172.21.15.120:0/3249865748 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b800cc50 con 0x7fe0c8101350 2024-09-19T05:20:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.829+0000 7fe0d23cf740 1 Processor -- start 2024-09-19T05:20:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.829+0000 7fe0be7fc640 1 -- 172.21.15.120:0/3249865748 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7fe0b800c460 con 0x7fe0c8101350 2024-09-19T05:20:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.829+0000 7fe0d23cf740 1 -- start start 2024-09-19T05:20:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.830+0000 7fe0d23cf740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ed9af0 0x5590b6ed9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.830+0000 7fe0d23cf740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5590b6eda410 0x5590b6ee4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.830+0000 7fe0d23cf740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590b6ee4cb0 0x5590b6ee70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.830+0000 7fe0d23cf740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5590b6e3e2f0 con 0x5590b6ed9af0 2024-09-19T05:20:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.830+0000 7fe0d23cf740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5590b6de6270 con 0x5590b6ee4cb0 2024-09-19T05:20:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.830+0000 7fe0d23cf740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5590b6e3a2b0 con 0x5590b6eda410 2024-09-19T05:20:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.830+0000 7fe0cdbd4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ed9af0 0x5590b6ed9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.830+0000 7fe0cdbd4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ed9af0 0x5590b6ed9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46284/0 (socket says 172.21.15.120:46284) 2024-09-19T05:20:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.830+0000 7fe0cdbd4640 1 -- 172.21.15.120:0/905067336 learned_addr learned my addr 172.21.15.120:0/905067336 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.830+0000 7fe0ccbd2640 1 --2- 172.21.15.120:0/905067336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590b6ee4cb0 0x5590b6ee70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.830+0000 7fe0cd3d3640 1 --2- 172.21.15.120:0/905067336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5590b6eda410 0x5590b6ee4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.830+0000 7fe0cdbd4640 1 -- 172.21.15.120:0/905067336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5590b6eda410 msgr2=0x5590b6ee4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.830+0000 7fe0cdbd4640 1 --2- 172.21.15.120:0/905067336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5590b6eda410 0x5590b6ee4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.830+0000 7fe0cdbd4640 1 -- 172.21.15.120:0/905067336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590b6ee4cb0 msgr2=0x5590b6ee70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.830+0000 7fe0cdbd4640 1 --2- 172.21.15.120:0/905067336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590b6ee4cb0 0x5590b6ee70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.830+0000 7fe0cdbd4640 1 -- 172.21.15.120:0/905067336 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590b6de5340 con 0x5590b6ed9af0 2024-09-19T05:20:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.831+0000 7fe0cdbd4640 1 --2- 172.21.15.120:0/905067336 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ed9af0 0x5590b6ed9ed0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009f50 tx=0x7fe0c00118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3778e478e5dcb22d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.831+0000 7fe0be7fc640 1 --2- 172.21.15.120:0/3249865748 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fe0b40a3600 0x7fe0b40a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.831+0000 7fe0b37fe640 1 -- 172.21.15.120:0/905067336 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0004d20 con 0x5590b6ed9af0 2024-09-19T05:20:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.831+0000 7fe0b37fe640 1 -- 172.21.15.120:0/905067336 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0c0004050 con 0x5590b6ed9af0 2024-09-19T05:20:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.831+0000 7fe0cd3d3640 1 --2- 172.21.15.120:0/3249865748 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fe0b40a3600 0x7fe0b40a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:19.835 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.831+0000 7fe0b37fe640 1 -- 172.21.15.120:0/905067336 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0005280 con 0x5590b6ed9af0 2024-09-19T05:20:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.831+0000 7fe0be7fc640 1 -- 172.21.15.120:0/3249865748 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fe0b80d1230 con 0x7fe0c8101350 2024-09-19T05:20:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.832+0000 7fe0d23cf740 1 -- 172.21.15.120:0/905067336 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ed9af0 msgr2=0x5590b6ed9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.832+0000 7fe0d23cf740 1 --2- 172.21.15.120:0/905067336 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ed9af0 0x5590b6ed9ed0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009f50 tx=0x7fe0c00118d0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.832+0000 7fe0cd3d3640 1 --2- 172.21.15.120:0/3249865748 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fe0b40a3600 0x7fe0b40a5ac0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4031440 tx=0x7fe0c4005a20 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.832+0000 7fe0d23cf740 1 -- 172.21.15.120:0/905067336 shutdown_connections 2024-09-19T05:20:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.832+0000 7fe0d23cf740 1 --2- 172.21.15.120:0/905067336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590b6ee4cb0 0x5590b6ee70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.832+0000 7fe0d23cf740 1 --2- 172.21.15.120:0/905067336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5590b6eda410 0x5590b6ee4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.832+0000 7fe0d23cf740 1 --2- 172.21.15.120:0/905067336 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ed9af0 0x5590b6ed9ed0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.832+0000 7fe0d23cf740 1 -- 172.21.15.120:0/905067336 >> 172.21.15.120:0/905067336 conn(0x5590b6ed6060 msgr2=0x5590b6ed6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.832+0000 7fe0d23cf740 1 -- 172.21.15.120:0/905067336 shutdown_connections 2024-09-19T05:20:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.832+0000 7fe0d23cf740 1 -- 172.21.15.120:0/905067336 wait complete. 2024-09-19T05:20:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.833+0000 7fe0d23cf740 1 -- start start 2024-09-19T05:20:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.833+0000 7fe0d23cf740 1 Processor -- start 2024-09-19T05:20:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.834+0000 7fe0d23cf740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ed9af0 0x5590b6ee1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.834+0000 7fe0d23cf740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590b6eda410 0x5590b6ee2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.834+0000 7fe0d23cf740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5590b6ee4cb0 0x5590b6ee25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.834+0000 7fe0cd3d3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ed9af0 0x5590b6ee1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.834+0000 7fe0cd3d3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ed9af0 0x5590b6ee1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46290/0 (socket says 172.21.15.120:46290) 2024-09-19T05:20:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.834+0000 7fe0cd3d3640 1 -- 172.21.15.120:0/3157718324 learned_addr learned my addr 172.21.15.120:0/3157718324 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.834+0000 7fe0d23cf740 1 -- 172.21.15.120:0/3157718324 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5590b6eebc90 con 0x5590b6ed9af0 2024-09-19T05:20:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.834+0000 7fe0d23cf740 1 -- 172.21.15.120:0/3157718324 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5590b6dc7290 con 0x5590b6eda410 2024-09-19T05:20:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.834+0000 7fe0d23cf740 1 -- 172.21.15.120:0/3157718324 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5590b6eebe10 con 0x5590b6ee4cb0 2024-09-19T05:20:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.834+0000 7fe0cdbd4640 1 --2- 172.21.15.120:0/3157718324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5590b6ee4cb0 0x5590b6ee25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.834+0000 7fe0ccbd2640 1 --2- 172.21.15.120:0/3157718324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590b6eda410 0x5590b6ee2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.834+0000 7fe0d23cf740 10 client.0 _ll_register_callbacks cb 0x5590b6df8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.834+0000 7fe0ccbd2640 1 -- 172.21.15.120:0/3157718324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5590b6ee4cb0 msgr2=0x5590b6ee25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.834+0000 7fe0ccbd2640 1 --2- 172.21.15.120:0/3157718324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5590b6ee4cb0 0x5590b6ee25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.834+0000 7fe0ccbd2640 1 -- 172.21.15.120:0/3157718324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ed9af0 msgr2=0x5590b6ee1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.834+0000 7fe0ccbd2640 1 --2- 172.21.15.120:0/3157718324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ed9af0 0x5590b6ee1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.834+0000 7fe0ccbd2640 1 -- 172.21.15.120:0/3157718324 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590b6b51210 con 0x5590b6eda410 2024-09-19T05:20:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.834+0000 7fe0cd3d3640 1 --2- 172.21.15.120:0/3157718324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ed9af0 0x5590b6ee1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.835+0000 7fe0ccbd2640 1 --2- 172.21.15.120:0/3157718324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590b6eda410 0x5590b6ee2070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe0b80ce750 tx=0x7fe0b8009f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4763e035be9b7fca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.835+0000 7fe0b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:20:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.835+0000 7fe0b0ff9640 1 -- 172.21.15.120:0/3157718324 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b809d090 con 0x5590b6eda410 2024-09-19T05:20:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.835+0000 7fe0d23cf740 1 -- 172.21.15.120:0/3157718324 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0c0004050 con 0x5590b6eda410 2024-09-19T05:20:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.835+0000 7fe0b0ff9640 1 -- 172.21.15.120:0/3157718324 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fe0b80bd0d0 con 0x5590b6eda410 2024-09-19T05:20:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.835+0000 7fe0b0ff9640 1 -- 172.21.15.120:0/3157718324 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe0b809cc20 con 0x5590b6eda410 2024-09-19T05:20:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.835+0000 7fe0d23cf740 10 client.25001 fetch_fsmap learned FSMap version 25 2024-09-19T05:20:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.835+0000 7fe0d23cf740 1 -- 172.21.15.120:0/3157718324 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5590b6c1d620 con 0x5590b6eda410 2024-09-19T05:20:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.835+0000 7fe0b0ff9640 1 -- 172.21.15.120:0/3157718324 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0c0004050 con 0x5590b6eda410 2024-09-19T05:20:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.835+0000 7fe0b0ff9640 1 -- 172.21.15.120:0/3157718324 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe0b80a1130 con 0x5590b6eda410 2024-09-19T05:20:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.836+0000 7fe0d23cf740 10 client.25001 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:20:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.836+0000 7fe0d23cf740 10 client.25001 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:20:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.836+0000 7fe0d23cf740 20 client.25001 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.836+0000 7fe0d23cf740 1 --2- 172.21.15.120:0/3157718324 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5590b6ef8f70 0x5590b6efb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.836+0000 7fe0d23cf740 4 client.25001 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:20:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.836+0000 7fe0d23cf740 1 -- 172.21.15.120:0/3157718324 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590b6e4ba20 con 0x5590b6ef8f70 2024-09-19T05:20:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.836+0000 7fe0cd3d3640 1 --2- 172.21.15.120:0/3157718324 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5590b6ef8f70 0x5590b6efb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.836+0000 7fe0cd3d3640 1 --2- 172.21.15.120:0/3157718324 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5590b6ef8f70 0x5590b6efb360 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d4e034c443f3474 server_cookie=d890bb03298c4825 in_seq=0 out_seq=0 2024-09-19T05:20:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.836+0000 7fe0b0ff9640 10 client.25001 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.837+0000 7fe0b0ff9640 1 -- 172.21.15.120:0/3157718324 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5590b6e4ba20 con 0x5590b6ef8f70 2024-09-19T05:20:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.837+0000 7fe0b0ff9640 10 client.25001 handle_command_reply: tid=0 2024-09-19T05:20:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.837+0000 7fe0d23cf740 1 client.25001 shutdown 2024-09-19T05:20:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.837+0000 7fe0d23cf740 1 -- 172.21.15.120:0/3157718324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590b6eda410 msgr2=0x5590b6ee2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.837+0000 7fe0d23cf740 1 --2- 172.21.15.120:0/3157718324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590b6eda410 0x5590b6ee2070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe0b80ce750 tx=0x7fe0b8009f60 comp rx=0 tx=0).stop 2024-09-19T05:20:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.837+0000 7fe0d23cf740 1 -- 172.21.15.120:0/3157718324 shutdown_connections 2024-09-19T05:20:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.837+0000 7fe0d23cf740 1 --2- 172.21.15.120:0/3157718324 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5590b6ef8f70 0x5590b6efb360 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.837+0000 7fe0d23cf740 1 --2- 172.21.15.120:0/3157718324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5590b6ee4cb0 0x5590b6ee25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.837+0000 7fe0b0ff9640 0 client.25001 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.837+0000 7fe0d23cf740 1 --2- 172.21.15.120:0/3157718324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590b6eda410 0x5590b6ee2070 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.837+0000 7fe0d23cf740 1 --2- 172.21.15.120:0/3157718324 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ed9af0 0x5590b6ee1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.837+0000 7fe0d23cf740 1 -- 172.21.15.120:0/3157718324 >> 172.21.15.120:0/3157718324 conn(0x5590b6ed6060 msgr2=0x5590b6edbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:19.844 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.838+0000 7fe0d23cf740 1 -- 172.21.15.120:0/3157718324 shutdown_connections 2024-09-19T05:20:19.845 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.838+0000 7fe0d23cf740 1 -- 172.21.15.120:0/3157718324 wait complete. 2024-09-19T05:20:19.845 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.838+0000 7fe0d23cf740 20 client.25001 trim_cache size 0 max 16384 2024-09-19T05:20:19.855 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.852+0000 7fe0d23cf740 1 Processor -- start 2024-09-19T05:20:19.855 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.852+0000 7fe0d23cf740 1 -- start start 2024-09-19T05:20:19.855 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.852+0000 7fe0d23cf740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5590b6ed9af0 0x5590b6edc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:19.855 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.852+0000 7fe0d23cf740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590b6eda410 0x5590b6f00c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:19.855 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.852+0000 7fe0d23cf740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ee4cb0 0x5590b6f01170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:19.855 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.852+0000 7fe0d23cf740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ac011110 con 0x5590b6ee4cb0 2024-09-19T05:20:19.855 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.852+0000 7fe0d23cf740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ac00e9e0 con 0x5590b6eda410 2024-09-19T05:20:19.855 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.852+0000 7fe0d23cf740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ac00c830 con 0x5590b6ed9af0 2024-09-19T05:20:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.852+0000 7fe0cdbd4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ee4cb0 0x5590b6f01170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.852+0000 7fe0cdbd4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ee4cb0 0x5590b6f01170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46296/0 (socket says 172.21.15.120:46296) 2024-09-19T05:20:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.852+0000 7fe0cdbd4640 1 -- 172.21.15.120:0/2733962491 learned_addr learned my addr 172.21.15.120:0/2733962491 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.852+0000 7fe0cd3d3640 1 --2- 172.21.15.120:0/2733962491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5590b6ed9af0 0x5590b6edc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.852+0000 7fe0ccbd2640 1 --2- 172.21.15.120:0/2733962491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590b6eda410 0x5590b6f00c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.853+0000 7fe0cdbd4640 1 -- 172.21.15.120:0/2733962491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5590b6ed9af0 msgr2=0x5590b6edc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.853+0000 7fe0cdbd4640 1 --2- 172.21.15.120:0/2733962491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5590b6ed9af0 0x5590b6edc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.853+0000 7fe0cdbd4640 1 -- 172.21.15.120:0/2733962491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590b6eda410 msgr2=0x5590b6f00c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.853+0000 7fe0cdbd4640 1 --2- 172.21.15.120:0/2733962491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590b6eda410 0x5590b6f00c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.853+0000 7fe0cdbd4640 1 -- 172.21.15.120:0/2733962491 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590b6ee0060 con 0x5590b6ee4cb0 2024-09-19T05:20:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.853+0000 7fe0ccbd2640 1 --2- 172.21.15.120:0/2733962491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590b6eda410 0x5590b6f00c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.853+0000 7fe0cdbd4640 1 --2- 172.21.15.120:0/2733962491 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ee4cb0 0x5590b6f01170 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe0c001b040 tx=0x7fe0c0009cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3812cf6bd594f609 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:19.857 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.853+0000 7fe0b2ffd640 1 -- 172.21.15.120:0/2733962491 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0003d30 con 0x5590b6ee4cb0 2024-09-19T05:20:19.857 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.853+0000 7fe0b2ffd640 1 -- 172.21.15.120:0/2733962491 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0c0004380 con 0x5590b6ee4cb0 2024-09-19T05:20:19.857 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.853+0000 7fe0b2ffd640 1 -- 172.21.15.120:0/2733962491 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0005040 con 0x5590b6ee4cb0 2024-09-19T05:20:19.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.854+0000 7fe0d23cf740 1 -- 172.21.15.120:0/2733962491 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ee4cb0 msgr2=0x5590b6f01170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:19.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.854+0000 7fe0d23cf740 1 --2- 172.21.15.120:0/2733962491 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ee4cb0 0x5590b6f01170 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe0c001b040 tx=0x7fe0c0009cc0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.854+0000 7fe0d23cf740 1 -- 172.21.15.120:0/2733962491 shutdown_connections 2024-09-19T05:20:19.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.854+0000 7fe0d23cf740 1 --2- 172.21.15.120:0/2733962491 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ee4cb0 0x5590b6f01170 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.854+0000 7fe0d23cf740 1 --2- 172.21.15.120:0/2733962491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590b6eda410 0x5590b6f00c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.854+0000 7fe0d23cf740 1 --2- 172.21.15.120:0/2733962491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5590b6ed9af0 0x5590b6edc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.854+0000 7fe0d23cf740 1 -- 172.21.15.120:0/2733962491 >> 172.21.15.120:0/2733962491 conn(0x5590b6ed6060 msgr2=0x5590b6ee3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:19.860 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.854+0000 7fe0d23cf740 1 -- 172.21.15.120:0/2733962491 shutdown_connections 2024-09-19T05:20:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.854+0000 7fe0d23cf740 1 -- 172.21.15.120:0/2733962491 wait complete. 2024-09-19T05:20:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.854+0000 7fe0d23cf740 1 -- start start 2024-09-19T05:20:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.855+0000 7fe0d23cf740 1 Processor -- start 2024-09-19T05:20:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.855+0000 7fe0d23cf740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590b6ed9af0 0x5590b6eed1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.855+0000 7fe0d23cf740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5590b6eda410 0x5590b6eed6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.855+0000 7fe0d23cf740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ee4cb0 0x5590b6f62c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.855+0000 7fe0d23cf740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ac00cea0 con 0x5590b6ee4cb0 2024-09-19T05:20:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.855+0000 7fe0d23cf740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ac00e310 con 0x5590b6ed9af0 2024-09-19T05:20:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.855+0000 7fe0d23cf740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ac00d570 con 0x5590b6eda410 2024-09-19T05:20:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.855+0000 7fe0d23cf740 10 client.0 _ll_register_callbacks cb 0x7fe0b800c750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.855+0000 7fe0cdbd4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ee4cb0 0x5590b6f62c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.855+0000 7fe0cdbd4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ee4cb0 0x5590b6f62c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46302/0 (socket says 172.21.15.120:46302) 2024-09-19T05:20:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.855+0000 7fe0cdbd4640 1 -- 172.21.15.120:0/3418693840 learned_addr learned my addr 172.21.15.120:0/3418693840 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:19.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.855+0000 7fe0cd3d3640 1 --2- 172.21.15.120:0/3418693840 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590b6ed9af0 0x5590b6eed1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:19.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.855+0000 7fe0ccbd2640 1 --2- 172.21.15.120:0/3418693840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5590b6eda410 0x5590b6eed6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:19.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.855+0000 7fe0cdbd4640 1 -- 172.21.15.120:0/3418693840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5590b6eda410 msgr2=0x5590b6eed6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:19.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.855+0000 7fe0cdbd4640 1 --2- 172.21.15.120:0/3418693840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5590b6eda410 0x5590b6eed6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.855+0000 7fe0cdbd4640 1 -- 172.21.15.120:0/3418693840 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590b6ed9af0 msgr2=0x5590b6eed1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:19.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.855+0000 7fe0cdbd4640 1 --2- 172.21.15.120:0/3418693840 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590b6ed9af0 0x5590b6eed1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.856+0000 7fe0cdbd4640 1 -- 172.21.15.120:0/3418693840 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590b6eedfd0 con 0x5590b6ee4cb0 2024-09-19T05:20:19.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.856+0000 7fe0cdbd4640 1 --2- 172.21.15.120:0/3418693840 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ee4cb0 0x5590b6f62c00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0006010 tx=0x7fe0c0004210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e829fd3a18bba10b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:19.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.856+0000 7fe0b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:20:19.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.856+0000 7fe0b0ff9640 1 -- 172.21.15.120:0/3418693840 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0004d70 con 0x5590b6ee4cb0 2024-09-19T05:20:19.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.856+0000 7fe0b0ff9640 1 -- 172.21.15.120:0/3418693840 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fe0c0031040 con 0x5590b6ee4cb0 2024-09-19T05:20:19.862 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.856+0000 7fe0d23cf740 1 -- 172.21.15.120:0/3418693840 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0c0004380 con 0x5590b6ee4cb0 2024-09-19T05:20:19.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.856+0000 7fe0b0ff9640 1 -- 172.21.15.120:0/3418693840 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe0c0040050 con 0x5590b6ee4cb0 2024-09-19T05:20:19.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.856+0000 7fe0d23cf740 10 client.15531 fetch_fsmap learned FSMap version 25 2024-09-19T05:20:19.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.856+0000 7fe0d23cf740 1 -- 172.21.15.120:0/3418693840 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5590b6f64260 con 0x5590b6ee4cb0 2024-09-19T05:20:19.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.856+0000 7fe0b0ff9640 1 -- 172.21.15.120:0/3418693840 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe0c0004380 con 0x5590b6ee4cb0 2024-09-19T05:20:19.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.857+0000 7fe0b0ff9640 1 -- 172.21.15.120:0/3418693840 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe0c0005670 con 0x5590b6ee4cb0 2024-09-19T05:20:19.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.857+0000 7fe0d23cf740 10 client.15531 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:20:19.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.857+0000 7fe0d23cf740 10 client.15531 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:20:19.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.857+0000 7fe0d23cf740 20 client.15531 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:19.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.857+0000 7fe0d23cf740 1 --2- 172.21.15.120:0/3418693840 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5590b6ef8f70 0x5590b6f66690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:19.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.857+0000 7fe0d23cf740 4 client.15531 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:20:19.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.857+0000 7fe0d23cf740 1 -- 172.21.15.120:0/3418693840 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5590b6e45d70 con 0x5590b6ef8f70 2024-09-19T05:20:19.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.857+0000 7fe0cd3d3640 1 --2- 172.21.15.120:0/3418693840 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5590b6ef8f70 0x5590b6f66690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:19.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.857+0000 7fe0cd3d3640 1 --2- 172.21.15.120:0/3418693840 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5590b6ef8f70 0x5590b6f66690 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ecefa5271ee4d41 server_cookie=d70f0fd25f76b76f in_seq=0 out_seq=0 2024-09-19T05:20:19.863 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.857+0000 7fe0b0ff9640 10 client.15531 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.861+0000 7fe0b0ff9640 1 -- 172.21.15.120:0/3418693840 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5590b6e45d70 con 0x5590b6ef8f70 2024-09-19T05:20:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.861+0000 7fe0b0ff9640 10 client.15531 handle_command_reply: tid=0 2024-09-19T05:20:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.861+0000 7fe0d23cf740 1 client.15531 shutdown 2024-09-19T05:20:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.861+0000 7fe0d23cf740 1 -- 172.21.15.120:0/3418693840 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ee4cb0 msgr2=0x5590b6f62c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.861+0000 7fe0d23cf740 1 --2- 172.21.15.120:0/3418693840 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ee4cb0 0x5590b6f62c00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0006010 tx=0x7fe0c0004210 comp rx=0 tx=0).stop 2024-09-19T05:20:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.861+0000 7fe0d23cf740 1 -- 172.21.15.120:0/3418693840 shutdown_connections 2024-09-19T05:20:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.861+0000 7fe0d23cf740 1 --2- 172.21.15.120:0/3418693840 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5590b6ee4cb0 0x5590b6f62c00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.861+0000 7fe0d23cf740 1 --2- 172.21.15.120:0/3418693840 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5590b6ef8f70 0x5590b6f66690 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.861+0000 7fe0d23cf740 1 --2- 172.21.15.120:0/3418693840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5590b6eda410 0x5590b6eed6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.861+0000 7fe0b0ff9640 0 client.15531 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.861+0000 7fe0d23cf740 1 --2- 172.21.15.120:0/3418693840 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590b6ed9af0 0x5590b6eed1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.861+0000 7fe0d23cf740 1 -- 172.21.15.120:0/3418693840 >> 172.21.15.120:0/3418693840 conn(0x5590b6ed6060 msgr2=0x5590b6ed49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.862+0000 7fe0d23cf740 1 -- 172.21.15.120:0/3418693840 shutdown_connections 2024-09-19T05:20:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.862+0000 7fe0d23cf740 1 -- 172.21.15.120:0/3418693840 wait complete. 2024-09-19T05:20:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.862+0000 7fe0d23cf740 20 client.15531 trim_cache size 0 max 16384 2024-09-19T05:20:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:20:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:20:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:20:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:20:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.862+0000 7fe0cf637640 1 -- 172.21.15.120:0/3249865748 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fe0b40a3600 msgr2=0x7fe0b40a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.862+0000 7fe0cf637640 1 --2- 172.21.15.120:0/3249865748 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fe0b40a3600 0x7fe0b40a5ac0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4031440 tx=0x7fe0c4005a20 comp rx=0 tx=0).stop 2024-09-19T05:20:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.862+0000 7fe0cf637640 1 -- 172.21.15.120:0/3249865748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0c8101350 msgr2=0x7fe0c8197680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.862+0000 7fe0cf637640 1 --2- 172.21.15.120:0/3249865748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0c8101350 0x7fe0c8197680 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8009970 tx=0x7fe0b8009e30 comp rx=0 tx=0).stop 2024-09-19T05:20:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.862+0000 7fe0cf637640 1 -- 172.21.15.120:0/3249865748 shutdown_connections 2024-09-19T05:20:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.862+0000 7fe0cf637640 1 --2- 172.21.15.120:0/3249865748 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fe0b40a3600 0x7fe0b40a5ac0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.862+0000 7fe0cf637640 1 --2- 172.21.15.120:0/3249865748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0c81069c0 0x7fe0c819ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.862+0000 7fe0cf637640 1 --2- 172.21.15.120:0/3249865748 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe0c8101350 0x7fe0c8197680 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.862+0000 7fe0cf637640 1 --2- 172.21.15.120:0/3249865748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0c81009b0 0x7fe0c8197140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:19.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.862+0000 7fe0cf637640 1 -- 172.21.15.120:0/3249865748 >> 172.21.15.120:0/3249865748 conn(0x7fe0c8077990 msgr2=0x7fe0c8103920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:19.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.863+0000 7fe0cf637640 1 -- 172.21.15.120:0/3249865748 shutdown_connections 2024-09-19T05:20:19.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:19.863+0000 7fe0cf637640 1 -- 172.21.15.120:0/3249865748 wait complete. 2024-09-19T05:20:20.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:20 smithi178 ceph-mon[34347]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-19T05:20:20.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:20 smithi120 ceph-mon[30956]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-19T05:20:20.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:20 smithi194 ceph-mon[35228]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-19T05:20:22.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:22 smithi178 ceph-mon[34347]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T05:20:22.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:22 smithi120 ceph-mon[30956]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T05:20:22.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:22 smithi194 ceph-mon[35228]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T05:20:24.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:24 smithi178 ceph-mon[34347]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T05:20:24.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:24 smithi120 ceph-mon[30956]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T05:20:24.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:24 smithi194 ceph-mon[35228]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T05:20:26.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:25 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:20:26.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:25 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:20:26.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:25 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:20:26.368 INFO:tasks.workunit.client.0.smithi120.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T05:20:26.368 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T05:20:26.368 INFO:tasks.workunit.client.0.smithi120.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T05:20:26.368 INFO:tasks.workunit.client.0.smithi120.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T05:20:26.368 INFO:tasks.workunit.client.0.smithi120.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T05:20:26.368 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T05:20:26.368 INFO:tasks.workunit.client.0.smithi120.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T05:20:26.368 INFO:tasks.workunit.client.0.smithi120.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T05:20:26.369 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T05:20:26.369 INFO:tasks.workunit.client.0.smithi120.stderr: git switch -c 2024-09-19T05:20:26.369 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T05:20:26.369 INFO:tasks.workunit.client.0.smithi120.stderr:Or undo this operation with: 2024-09-19T05:20:26.369 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T05:20:26.369 INFO:tasks.workunit.client.0.smithi120.stderr: git switch - 2024-09-19T05:20:26.369 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T05:20:26.369 INFO:tasks.workunit.client.0.smithi120.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T05:20:26.369 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T05:20:26.369 INFO:tasks.workunit.client.0.smithi120.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T05:20:26.374 DEBUG:teuthology.orchestra.run.smithi120:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T05:20:26.399 INFO:tasks.workunit.client.0.smithi120.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T05:20:26.402 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T05:20:26.402 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T05:20:27.064 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T05:20:27.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:26 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:20:27.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:26 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:20:27.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:26 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:20:27.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:26 smithi120 ceph-mon[30956]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T05:20:27.132 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T05:20:27.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:26 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:20:27.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:26 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:20:27.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:26 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:20:27.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:26 smithi194 ceph-mon[35228]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T05:20:27.172 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T05:20:27.173 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T05:20:27.173 INFO:tasks.workunit.client.0.smithi120.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T05:20:27.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:26 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:20:27.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:26 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:20:27.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:26 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:20:27.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:26 smithi178 ceph-mon[34347]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T05:20:27.212 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T05:20:27.216 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T05:20:27.216 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T05:20:27.272 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2024-09-19T05:20:27.273 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2024-09-19T05:20:27.273 DEBUG:teuthology.orchestra.run.smithi120:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2024-09-19T05:20:27.337 INFO:tasks.workunit.client.0.smithi120.stdout:getting blogbench 2024-09-19T05:20:27.337 INFO:tasks.workunit.client.0.smithi120.stderr:+ echo 'getting blogbench' 2024-09-19T05:20:27.337 INFO:tasks.workunit.client.0.smithi120.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-09-19T05:20:27.356 INFO:tasks.workunit.client.0.smithi120.stderr:--2024-09-19 05:20:27-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-09-19T05:20:27.356 INFO:tasks.workunit.client.0.smithi120.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-19T05:20:27.434 INFO:tasks.workunit.client.0.smithi120.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-19T05:20:27.512 INFO:tasks.workunit.client.0.smithi120.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-19T05:20:27.513 INFO:tasks.workunit.client.0.smithi120.stderr:Length: 103355 (101K) [application/octet-stream] 2024-09-19T05:20:27.515 INFO:tasks.workunit.client.0.smithi120.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2024-09-19T05:20:27.518 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T05:20:27.667 INFO:tasks.workunit.client.0.smithi120.stderr: 0K .......... .......... .......... .......... .......... 49% 330K 0s 2024-09-19T05:20:27.739 INFO:tasks.workunit.client.0.smithi120.stderr: 50K .......... .......... .......... .......... .......... 99% 717K 0s 2024-09-19T05:20:27.739 INFO:tasks.workunit.client.0.smithi120.stderr: 100K 100% 1.74T=0.2s 2024-09-19T05:20:27.739 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T05:20:27.739 INFO:tasks.workunit.client.0.smithi120.stderr:2024-09-19 05:20:27 (456 KB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2024-09-19T05:20:27.740 INFO:tasks.workunit.client.0.smithi120.stderr: 2024-09-19T05:20:27.740 INFO:tasks.workunit.client.0.smithi120.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2024-09-19T05:20:27.779 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/ 2024-09-19T05:20:27.781 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/m4/ 2024-09-19T05:20:27.783 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/m4/acx_pthread.m4 2024-09-19T05:20:27.786 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/man/ 2024-09-19T05:20:27.788 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/man/blogbench.8 2024-09-19T05:20:27.791 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/man/Makefile.am 2024-09-19T05:20:27.793 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/man/Makefile.in 2024-09-19T05:20:27.795 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/src/ 2024-09-19T05:20:27.797 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/src/mysnprintf.c 2024-09-19T05:20:27.798 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/src/mysnprintf.h 2024-09-19T05:20:27.800 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/src/blogbench.c 2024-09-19T05:20:27.802 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/src/blogbench.h 2024-09-19T05:20:27.804 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/src/fakesnprintf.c 2024-09-19T05:20:27.806 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/src/fakesnprintf.h 2024-09-19T05:20:27.808 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/src/blogbench_p.h 2024-09-19T05:20:27.810 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/src/bsd-getopt_long.c 2024-09-19T05:20:27.812 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/src/bsd-getopt_long.h 2024-09-19T05:20:27.814 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/src/Makefile.am 2024-09-19T05:20:27.816 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/src/Makefile.in 2024-09-19T05:20:27.818 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/src/process.c 2024-09-19T05:20:27.820 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/src/globals.h 2024-09-19T05:20:27.822 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/src/commenter.c 2024-09-19T05:20:27.824 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/src/rewriter.c 2024-09-19T05:20:27.826 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/src/reader.c 2024-09-19T05:20:27.828 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/src/writer.c 2024-09-19T05:20:27.829 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/src/helpers.c 2024-09-19T05:20:27.831 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/NEWS 2024-09-19T05:20:27.833 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/compile 2024-09-19T05:20:27.835 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/depcomp 2024-09-19T05:20:27.837 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/aclocal.m4 2024-09-19T05:20:27.840 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/README 2024-09-19T05:20:27.841 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/configure 2024-09-19T05:20:27.849 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/configure.ac 2024-09-19T05:20:27.851 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/config.guess 2024-09-19T05:20:27.854 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/install-sh 2024-09-19T05:20:27.856 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/config.sub 2024-09-19T05:20:27.858 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/missing 2024-09-19T05:20:27.861 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/mkinstalldirs 2024-09-19T05:20:27.863 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/Makefile.am 2024-09-19T05:20:27.864 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/Makefile.in 2024-09-19T05:20:27.866 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/config.h.in 2024-09-19T05:20:27.868 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/AUTHORS 2024-09-19T05:20:27.870 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/INSTALL 2024-09-19T05:20:27.872 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/ChangeLog 2024-09-19T05:20:27.874 INFO:tasks.workunit.client.0.smithi120.stdout:blogbench-1.0/COPYING 2024-09-19T05:20:27.876 INFO:tasks.workunit.client.0.smithi120.stderr:+ cd blogbench-1.0/ 2024-09-19T05:20:27.877 INFO:tasks.workunit.client.0.smithi120.stdout:making blogbench 2024-09-19T05:20:27.877 INFO:tasks.workunit.client.0.smithi120.stderr:+ echo 'making blogbench' 2024-09-19T05:20:27.878 INFO:tasks.workunit.client.0.smithi120.stderr:+ ./configure 2024-09-19T05:20:27.970 INFO:tasks.workunit.client.0.smithi120.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-19T05:20:28.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:28 smithi178 ceph-mon[34347]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T05:20:28.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:28 smithi120 ceph-mon[30956]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T05:20:28.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:28 smithi194 ceph-mon[35228]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T05:20:28.979 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether build environment is sane... yes 2024-09-19T05:20:28.994 INFO:tasks.workunit.client.0.smithi120.stdout:checking for gawk... gawk 2024-09-19T05:20:29.014 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether make sets $(MAKE)... yes 2024-09-19T05:20:29.039 INFO:tasks.workunit.client.0.smithi120.stdout:checking for gcc... gcc 2024-09-19T05:20:29.109 INFO:tasks.workunit.client.0.smithi120.stdout:checking for C compiler default output file name... a.out 2024-09-19T05:20:29.111 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether the C compiler works... yes 2024-09-19T05:20:29.114 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether we are cross compiling... no 2024-09-19T05:20:29.161 INFO:tasks.workunit.client.0.smithi120.stdout:checking for suffix of executables... 2024-09-19T05:20:29.204 INFO:tasks.workunit.client.0.smithi120.stdout:checking for suffix of object files... o 2024-09-19T05:20:29.284 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether we are using the GNU C compiler... yes 2024-09-19T05:20:29.327 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether gcc accepts -g... yes 2024-09-19T05:20:29.404 INFO:tasks.workunit.client.0.smithi120.stdout:checking for gcc option to accept ANSI C... none needed 2024-09-19T05:20:29.469 INFO:tasks.workunit.client.0.smithi120.stdout:checking for style of include used by make... GNU 2024-09-19T05:20:29.599 INFO:tasks.workunit.client.0.smithi120.stdout:checking dependency style of gcc... gcc3 2024-09-19T05:20:29.681 INFO:tasks.workunit.client.0.smithi120.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-19T05:20:29.682 INFO:tasks.workunit.client.0.smithi120.stdout:checking how to run the C preprocessor... gcc -E 2024-09-19T05:20:29.730 INFO:tasks.workunit.client.0.smithi120.stdout:checking for egrep... grep -E 2024-09-19T05:20:29.742 INFO:tasks.workunit.client.0.smithi120.stdout:checking for AIX... no 2024-09-19T05:20:29.839 INFO:tasks.workunit.client.0.smithi120.stdout:checking for library containing strerror... none required 2024-09-19T05:20:30.017 INFO:tasks.workunit.client.0.smithi120.stdout:checking for ANSI C header files... yes 2024-09-19T05:20:30.095 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-19T05:20:30.152 INFO:tasks.workunit.client.0.smithi120.stdout:checking for sys/types.h... yes 2024-09-19T05:20:30.215 INFO:tasks.workunit.client.0.smithi120.stdout:checking for sys/stat.h... yes 2024-09-19T05:20:30.280 INFO:tasks.workunit.client.0.smithi120.stdout:checking for stdlib.h... yes 2024-09-19T05:20:30.350 INFO:tasks.workunit.client.0.smithi120.stdout:checking for string.h... yes 2024-09-19T05:20:30.420 INFO:tasks.workunit.client.0.smithi120.stdout:checking for memory.h... yes 2024-09-19T05:20:30.483 INFO:tasks.workunit.client.0.smithi120.stdout:checking for strings.h... yes 2024-09-19T05:20:30.547 INFO:tasks.workunit.client.0.smithi120.stdout:checking for inttypes.h... yes 2024-09-19T05:20:30.609 INFO:tasks.workunit.client.0.smithi120.stdout:checking for stdint.h... yes 2024-09-19T05:20:30.674 INFO:tasks.workunit.client.0.smithi120.stdout:checking for unistd.h... yes 2024-09-19T05:20:30.690 INFO:tasks.workunit.client.0.smithi120.stdout:checking for memory.h... (cached) yes 2024-09-19T05:20:30.691 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:30 smithi178 ceph-mon[34347]: pgmap v41: 97 pgs: 97 active+clean; 3.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 162 KiB/s wr, 30 op/s 2024-09-19T05:20:30.701 INFO:tasks.workunit.client.0.smithi120.stdout:checking for strings.h... (cached) yes 2024-09-19T05:20:30.713 INFO:tasks.workunit.client.0.smithi120.stdout:checking for unistd.h... (cached) yes 2024-09-19T05:20:30.775 INFO:tasks.workunit.client.0.smithi120.stdout:checking locale.h usability... yes 2024-09-19T05:20:30.800 INFO:tasks.workunit.client.0.smithi120.stdout:checking locale.h presence... yes 2024-09-19T05:20:30.801 INFO:tasks.workunit.client.0.smithi120.stdout:checking for locale.h... yes 2024-09-19T05:20:30.821 INFO:tasks.workunit.client.0.smithi120.stdout:checking for stdlib.h... (cached) yes 2024-09-19T05:20:30.831 INFO:tasks.workunit.client.0.smithi120.stdout:checking for string.h... (cached) yes 2024-09-19T05:20:30.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:30 smithi120 ceph-mon[30956]: pgmap v41: 97 pgs: 97 active+clean; 3.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 162 KiB/s wr, 30 op/s 2024-09-19T05:20:30.897 INFO:tasks.workunit.client.0.smithi120.stdout:checking sys/socket.h usability... yes 2024-09-19T05:20:30.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:30 smithi194 ceph-mon[35228]: pgmap v41: 97 pgs: 97 active+clean; 3.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 162 KiB/s wr, 30 op/s 2024-09-19T05:20:30.928 INFO:tasks.workunit.client.0.smithi120.stdout:checking sys/socket.h presence... yes 2024-09-19T05:20:30.929 INFO:tasks.workunit.client.0.smithi120.stdout:checking for sys/socket.h... yes 2024-09-19T05:20:31.000 INFO:tasks.workunit.client.0.smithi120.stdout:checking sys/time.h usability... yes 2024-09-19T05:20:31.027 INFO:tasks.workunit.client.0.smithi120.stdout:checking sys/time.h presence... yes 2024-09-19T05:20:31.027 INFO:tasks.workunit.client.0.smithi120.stdout:checking for sys/time.h... yes 2024-09-19T05:20:31.103 INFO:tasks.workunit.client.0.smithi120.stdout:checking fcntl.h usability... yes 2024-09-19T05:20:31.130 INFO:tasks.workunit.client.0.smithi120.stdout:checking fcntl.h presence... yes 2024-09-19T05:20:31.131 INFO:tasks.workunit.client.0.smithi120.stdout:checking for fcntl.h... yes 2024-09-19T05:20:31.214 INFO:tasks.workunit.client.0.smithi120.stdout:checking sys/fcntl.h usability... yes 2024-09-19T05:20:31.241 INFO:tasks.workunit.client.0.smithi120.stdout:checking sys/fcntl.h presence... yes 2024-09-19T05:20:31.242 INFO:tasks.workunit.client.0.smithi120.stdout:checking for sys/fcntl.h... yes 2024-09-19T05:20:31.336 INFO:tasks.workunit.client.0.smithi120.stdout:checking sys/param.h usability... yes 2024-09-19T05:20:31.364 INFO:tasks.workunit.client.0.smithi120.stdout:checking sys/param.h presence... yes 2024-09-19T05:20:31.365 INFO:tasks.workunit.client.0.smithi120.stdout:checking for sys/param.h... yes 2024-09-19T05:20:31.428 INFO:tasks.workunit.client.0.smithi120.stdout:checking ioctl.h usability... no 2024-09-19T05:20:31.457 INFO:tasks.workunit.client.0.smithi120.stdout:checking ioctl.h presence... no 2024-09-19T05:20:31.458 INFO:tasks.workunit.client.0.smithi120.stdout:checking for ioctl.h... no 2024-09-19T05:20:31.522 INFO:tasks.workunit.client.0.smithi120.stdout:checking sys/ioctl.h usability... yes 2024-09-19T05:20:31.548 INFO:tasks.workunit.client.0.smithi120.stdout:checking sys/ioctl.h presence... yes 2024-09-19T05:20:31.549 INFO:tasks.workunit.client.0.smithi120.stdout:checking for sys/ioctl.h... yes 2024-09-19T05:20:31.611 INFO:tasks.workunit.client.0.smithi120.stdout:checking return type of signal handlers... void 2024-09-19T05:20:31.667 INFO:tasks.workunit.client.0.smithi120.stdout:checking for size_t... yes 2024-09-19T05:20:31.717 INFO:tasks.workunit.client.0.smithi120.stdout:checking for dev_t... yes 2024-09-19T05:20:31.771 INFO:tasks.workunit.client.0.smithi120.stdout:checking for short... yes 2024-09-19T05:20:31.866 INFO:tasks.workunit.client.0.smithi120.stdout:checking size of short... 2 2024-09-19T05:20:31.924 INFO:tasks.workunit.client.0.smithi120.stdout:checking for int... yes 2024-09-19T05:20:32.006 INFO:tasks.workunit.client.0.smithi120.stdout:checking size of int... 4 2024-09-19T05:20:32.065 INFO:tasks.workunit.client.0.smithi120.stdout:checking for long... yes 2024-09-19T05:20:32.154 INFO:tasks.workunit.client.0.smithi120.stdout:checking size of long... 8 2024-09-19T05:20:32.214 INFO:tasks.workunit.client.0.smithi120.stdout:checking for long long... yes 2024-09-19T05:20:32.309 INFO:tasks.workunit.client.0.smithi120.stdout:checking size of long long... 8 2024-09-19T05:20:32.369 INFO:tasks.workunit.client.0.smithi120.stdout:checking for ssize_t... yes 2024-09-19T05:20:32.418 INFO:tasks.workunit.client.0.smithi120.stdout:checking for sig_atomic_t... yes 2024-09-19T05:20:32.471 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether gcc needs -traditional... no 2024-09-19T05:20:32.517 INFO:tasks.workunit.client.0.smithi120.stdout:checking for an ANSI C-conforming const... yes 2024-09-19T05:20:32.551 INFO:tasks.workunit.client.0.smithi120.stdout:checking for inline... inline 2024-09-19T05:20:32.629 INFO:tasks.workunit.client.0.smithi120.stdout:checking for working alloca.h... yes 2024-09-19T05:20:32.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:32 smithi178 ceph-mon[34347]: pgmap v42: 97 pgs: 97 active+clean; 3.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 162 KiB/s wr, 27 op/s 2024-09-19T05:20:32.698 INFO:tasks.workunit.client.0.smithi120.stdout:checking for alloca... yes 2024-09-19T05:20:32.779 INFO:tasks.workunit.client.0.smithi120.stdout:checking for working memcmp... yes 2024-09-19T05:20:32.858 INFO:tasks.workunit.client.0.smithi120.stdout:checking for strftime... yes 2024-09-19T05:20:32.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:32 smithi120 ceph-mon[30956]: pgmap v42: 97 pgs: 97 active+clean; 3.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 162 KiB/s wr, 27 op/s 2024-09-19T05:20:32.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:32 smithi194 ceph-mon[35228]: pgmap v42: 97 pgs: 97 active+clean; 3.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 162 KiB/s wr, 27 op/s 2024-09-19T05:20:32.951 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2024-09-19T05:20:32.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.952+0000 7f1d1399f640 1 -- 172.21.15.120:0/3311426209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d0c100890 msgr2=0x7f1d0c100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:32.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.952+0000 7f1d1399f640 1 --2- 172.21.15.120:0/3311426209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d0c100890 0x7f1d0c100c70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1d08009900 tx=0x7f1d0802a410 comp rx=0 tx=0).stop 2024-09-19T05:20:32.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.952+0000 7f1d1399f640 1 -- 172.21.15.120:0/3311426209 shutdown_connections 2024-09-19T05:20:32.956 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.952+0000 7f1d1399f640 1 --2- 172.21.15.120:0/3311426209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d0c10e440 0x7f1d0c110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.952+0000 7f1d1399f640 1 --2- 172.21.15.120:0/3311426209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d0c101240 0x7f1d0c10de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.952+0000 7f1d1399f640 1 --2- 172.21.15.120:0/3311426209 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d0c100890 0x7f1d0c100c70 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.952+0000 7f1d1399f640 1 -- 172.21.15.120:0/3311426209 >> 172.21.15.120:0/3311426209 conn(0x7f1d0c077990 msgr2=0x7f1d0c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.952+0000 7f1d1399f640 1 -- 172.21.15.120:0/3311426209 shutdown_connections 2024-09-19T05:20:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.952+0000 7f1d1399f640 1 -- 172.21.15.120:0/3311426209 wait complete. 2024-09-19T05:20:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.953+0000 7f1d1399f640 1 Processor -- start 2024-09-19T05:20:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.953+0000 7f1d1399f640 1 -- start start 2024-09-19T05:20:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.953+0000 7f1d1399f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d0c100890 0x7f1d0c19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.953+0000 7f1d1399f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d0c101240 0x7f1d0c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.953+0000 7f1d1399f640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d0c10e440 0x7f1d0c19edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:32.957 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.953+0000 7f1d1399f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0c113f50 con 0x7f1d0c101240 2024-09-19T05:20:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.953+0000 7f1d1399f640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0c113dd0 con 0x7f1d0c100890 2024-09-19T05:20:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.953+0000 7f1d1399f640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0c1140d0 con 0x7f1d0c10e440 2024-09-19T05:20:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.953+0000 7f1d10f3a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d0c101240 0x7f1d0c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.953+0000 7f1d10f3a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d0c101240 0x7f1d0c19aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44678/0 (socket says 172.21.15.120:44678) 2024-09-19T05:20:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.953+0000 7f1d10f3a640 1 -- 172.21.15.120:0/520641544 learned_addr learned my addr 172.21.15.120:0/520641544 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.953+0000 7f1d1173b640 1 --2- 172.21.15.120:0/520641544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d0c100890 0x7f1d0c19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.953+0000 7f1d11f3c640 1 --2- 172.21.15.120:0/520641544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d0c10e440 0x7f1d0c19edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.953+0000 7f1d10f3a640 1 -- 172.21.15.120:0/520641544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d0c10e440 msgr2=0x7f1d0c19edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.953+0000 7f1d10f3a640 1 --2- 172.21.15.120:0/520641544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d0c10e440 0x7f1d0c19edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.953+0000 7f1d10f3a640 1 -- 172.21.15.120:0/520641544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d0c100890 msgr2=0x7f1d0c19a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:32.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.953+0000 7f1d10f3a640 1 --2- 172.21.15.120:0/520641544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d0c100890 0x7f1d0c19a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.953+0000 7f1d10f3a640 1 -- 172.21.15.120:0/520641544 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d0c19f4f0 con 0x7f1d0c101240 2024-09-19T05:20:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.953+0000 7f1d10f3a640 1 --2- 172.21.15.120:0/520641544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d0c101240 0x7f1d0c19aa40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00d950 tx=0x7f1cfc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.954+0000 7f1d027fc640 1 -- 172.21.15.120:0/520641544 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc017070 con 0x7f1d0c101240 2024-09-19T05:20:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.954+0000 7f1d1399f640 1 -- 172.21.15.120:0/520641544 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d0c19f7e0 con 0x7f1d0c101240 2024-09-19T05:20:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.954+0000 7f1d027fc640 1 -- 172.21.15.120:0/520641544 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1cfc009c30 con 0x7f1d0c101240 2024-09-19T05:20:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.954+0000 7f1d027fc640 1 -- 172.21.15.120:0/520641544 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc00f620 con 0x7f1d0c101240 2024-09-19T05:20:32.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.954+0000 7f1d1399f640 1 -- 172.21.15.120:0/520641544 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d0c1a7070 con 0x7f1d0c101240 2024-09-19T05:20:32.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.956+0000 7f1d027fc640 1 -- 172.21.15.120:0/520641544 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7f1cfc0109a0 con 0x7f1d0c101240 2024-09-19T05:20:32.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.957+0000 7f1d16817740 1 Processor -- start 2024-09-19T05:20:32.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.957+0000 7f1d16817740 1 -- start start 2024-09-19T05:20:32.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.957+0000 7f1d16817740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556d9a9ccaf0 0x556d9a9cced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:32.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.957+0000 7f1d16817740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9cd410 0x556d9a9d7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:32.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.957+0000 7f1d16817740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d9a9d7cb0 0x556d9a9da0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:32.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.957+0000 7f1d16817740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556d9a9312f0 con 0x556d9a9cd410 2024-09-19T05:20:32.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.957+0000 7f1d16817740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x556d9a8d9270 con 0x556d9a9d7cb0 2024-09-19T05:20:32.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.957+0000 7f1d16817740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x556d9a92d2b0 con 0x556d9a9ccaf0 2024-09-19T05:20:32.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.957+0000 7f1d1173b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9cd410 0x556d9a9d7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:32.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.957+0000 7f1d11f3c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556d9a9ccaf0 0x556d9a9cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:32.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.957+0000 7f1d11f3c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556d9a9ccaf0 0x556d9a9cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:54870/0 (socket says 172.21.15.120:54870) 2024-09-19T05:20:32.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.957+0000 7f1d1173b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9cd410 0x556d9a9d7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44692/0 (socket says 172.21.15.120:44692) 2024-09-19T05:20:32.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.957+0000 7f1d11f3c640 1 -- 172.21.15.120:0/2672294242 learned_addr learned my addr 172.21.15.120:0/2672294242 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:32.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.957+0000 7f1d10f3a640 1 --2- 172.21.15.120:0/2672294242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d9a9d7cb0 0x556d9a9da0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:32.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.957+0000 7f1d11f3c640 1 -- 172.21.15.120:0/2672294242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d9a9d7cb0 msgr2=0x556d9a9da0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:32.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.957+0000 7f1d11f3c640 1 --2- 172.21.15.120:0/2672294242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d9a9d7cb0 0x556d9a9da0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.966 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.957+0000 7f1d11f3c640 1 -- 172.21.15.120:0/2672294242 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9cd410 msgr2=0x556d9a9d7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:32.966 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.957+0000 7f1d11f3c640 1 --2- 172.21.15.120:0/2672294242 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9cd410 0x556d9a9d7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.966 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.957+0000 7f1d11f3c640 1 -- 172.21.15.120:0/2672294242 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d9a8d8340 con 0x556d9a9ccaf0 2024-09-19T05:20:32.966 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.957+0000 7f1d027fc640 1 --2- 172.21.15.120:0/520641544 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1cf80a3580 0x7f1cf80a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:32.966 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.958+0000 7f1d11f3c640 1 --2- 172.21.15.120:0/2672294242 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556d9a9ccaf0 0x556d9a9cced0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1d04009f30 tx=0x7f1d040118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f136e17acf4def0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:32.966 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.958+0000 7f1d1173b640 1 --2- 172.21.15.120:0/520641544 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1cf80a3580 0x7f1cf80a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:32.966 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.958+0000 7f1d027fc640 1 -- 172.21.15.120:0/520641544 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f1cfc0cfba0 con 0x7f1d0c101240 2024-09-19T05:20:32.966 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.958+0000 7f1cf77fe640 1 -- 172.21.15.120:0/2672294242 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d04004d20 con 0x556d9a9ccaf0 2024-09-19T05:20:32.966 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.958+0000 7f1cf77fe640 1 -- 172.21.15.120:0/2672294242 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1d04004050 con 0x556d9a9ccaf0 2024-09-19T05:20:32.966 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.958+0000 7f1cf77fe640 1 -- 172.21.15.120:0/2672294242 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d04005280 con 0x556d9a9ccaf0 2024-09-19T05:20:32.966 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.959+0000 7f1d16817740 1 -- 172.21.15.120:0/2672294242 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556d9a9ccaf0 msgr2=0x556d9a9cced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:32.966 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.959+0000 7f1d16817740 1 --2- 172.21.15.120:0/2672294242 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556d9a9ccaf0 0x556d9a9cced0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1d04009f30 tx=0x7f1d040118d0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.959+0000 7f1d1173b640 1 --2- 172.21.15.120:0/520641544 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1cf80a3580 0x7f1cf80a5a40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1d08031440 tx=0x7f1d08005b90 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:32.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.959+0000 7f1d16817740 1 -- 172.21.15.120:0/2672294242 shutdown_connections 2024-09-19T05:20:32.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.959+0000 7f1d16817740 1 --2- 172.21.15.120:0/2672294242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d9a9d7cb0 0x556d9a9da0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.959+0000 7f1d16817740 1 --2- 172.21.15.120:0/2672294242 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9cd410 0x556d9a9d7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.959+0000 7f1d16817740 1 --2- 172.21.15.120:0/2672294242 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556d9a9ccaf0 0x556d9a9cced0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.959+0000 7f1d16817740 1 -- 172.21.15.120:0/2672294242 >> 172.21.15.120:0/2672294242 conn(0x556d9a9c9060 msgr2=0x556d9a9c9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:32.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.959+0000 7f1d16817740 1 -- 172.21.15.120:0/2672294242 shutdown_connections 2024-09-19T05:20:32.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.959+0000 7f1d16817740 1 -- 172.21.15.120:0/2672294242 wait complete. 2024-09-19T05:20:32.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.959+0000 7f1d16817740 1 -- start start 2024-09-19T05:20:32.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.959+0000 7f1d16817740 1 Processor -- start 2024-09-19T05:20:32.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.960+0000 7f1d16817740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9ccaf0 0x556d9a9d4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:32.967 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.960+0000 7f1d16817740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556d9a9cd410 0x556d9a9d5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:32.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.960+0000 7f1d16817740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d9a9d7cb0 0x556d9a9d5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:32.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.960+0000 7f1d16817740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556d9a9da880 con 0x556d9a9ccaf0 2024-09-19T05:20:32.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.960+0000 7f1d16817740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x556d9a8ba290 con 0x556d9a9d7cb0 2024-09-19T05:20:32.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.960+0000 7f1d16817740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x556d9a9daa00 con 0x556d9a9cd410 2024-09-19T05:20:32.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.960+0000 7f1d16817740 10 client.0 _ll_register_callbacks cb 0x556d9a8eb140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:32.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.960+0000 7f1d1173b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9ccaf0 0x556d9a9d4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:32.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.960+0000 7f1d1173b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9ccaf0 0x556d9a9d4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44702/0 (socket says 172.21.15.120:44702) 2024-09-19T05:20:32.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.960+0000 7f1d1173b640 1 -- 172.21.15.120:0/3038009792 learned_addr learned my addr 172.21.15.120:0/3038009792 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:32.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.960+0000 7f1d11f3c640 1 --2- 172.21.15.120:0/3038009792 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d9a9d7cb0 0x556d9a9d5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:32.968 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.960+0000 7f1d10f3a640 1 --2- 172.21.15.120:0/3038009792 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556d9a9cd410 0x556d9a9d5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:32.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.960+0000 7f1d1173b640 1 -- 172.21.15.120:0/3038009792 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556d9a9cd410 msgr2=0x556d9a9d5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:32.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.960+0000 7f1d1173b640 1 --2- 172.21.15.120:0/3038009792 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556d9a9cd410 0x556d9a9d5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.960+0000 7f1d1173b640 1 -- 172.21.15.120:0/3038009792 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d9a9d7cb0 msgr2=0x556d9a9d5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:32.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.960+0000 7f1d1173b640 1 --2- 172.21.15.120:0/3038009792 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d9a9d7cb0 0x556d9a9d5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.960+0000 7f1d1173b640 1 -- 172.21.15.120:0/3038009792 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d9a644210 con 0x556d9a9ccaf0 2024-09-19T05:20:32.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.960+0000 7f1d11f3c640 1 --2- 172.21.15.120:0/3038009792 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d9a9d7cb0 0x556d9a9d5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:32.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.960+0000 7f1d1173b640 1 --2- 172.21.15.120:0/3038009792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9ccaf0 0x556d9a9d4bf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1d080057c0 tx=0x7f1d08009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be88dbef9c1e3402 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:32.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.960+0000 7f1cf4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:20:32.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.961+0000 7f1cf4ff9640 1 -- 172.21.15.120:0/3038009792 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d08035040 con 0x556d9a9ccaf0 2024-09-19T05:20:32.969 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.961+0000 7f1cf4ff9640 1 -- 172.21.15.120:0/3038009792 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f1d08004240 con 0x556d9a9ccaf0 2024-09-19T05:20:32.970 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.961+0000 7f1d16817740 1 -- 172.21.15.120:0/3038009792 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d04004050 con 0x556d9a9ccaf0 2024-09-19T05:20:32.970 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.961+0000 7f1cf4ff9640 1 -- 172.21.15.120:0/3038009792 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1d0804fe10 con 0x556d9a9ccaf0 2024-09-19T05:20:32.970 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.961+0000 7f1d16817740 10 client.15543 fetch_fsmap learned FSMap version 25 2024-09-19T05:20:32.970 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.961+0000 7f1d16817740 1 -- 172.21.15.120:0/3038009792 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556d9a710620 con 0x556d9a9ccaf0 2024-09-19T05:20:32.970 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.961+0000 7f1cf4ff9640 1 -- 172.21.15.120:0/3038009792 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1d04004050 con 0x556d9a9ccaf0 2024-09-19T05:20:32.970 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.961+0000 7f1cf4ff9640 1 -- 172.21.15.120:0/3038009792 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1d08004af0 con 0x556d9a9ccaf0 2024-09-19T05:20:32.970 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.961+0000 7f1d16817740 10 client.15543 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:20:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.961+0000 7f1d16817740 10 client.15543 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:20:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.961+0000 7f1d16817740 20 client.15543 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.961+0000 7f1d16817740 1 --2- 172.21.15.120:0/3038009792 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556d9a9e7c50 0x556d9a9ea040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.961+0000 7f1d16817740 4 client.15543 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:20:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.961+0000 7f1d16817740 1 -- 172.21.15.120:0/3038009792 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d9a93ea20 con 0x556d9a9e7c50 2024-09-19T05:20:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.962+0000 7f1d10f3a640 1 --2- 172.21.15.120:0/3038009792 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556d9a9e7c50 0x556d9a9ea040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.962+0000 7f1cf4ff9640 10 client.15543 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:32.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.962+0000 7f1d10f3a640 1 --2- 172.21.15.120:0/3038009792 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556d9a9e7c50 0x556d9a9ea040 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66c786884f862cfb server_cookie=eff59d788c97f69b in_seq=0 out_seq=0 2024-09-19T05:20:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.963+0000 7f1cf4ff9640 1 -- 172.21.15.120:0/3038009792 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556d9a93ea20 con 0x556d9a9e7c50 2024-09-19T05:20:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.963+0000 7f1cf4ff9640 10 client.15543 handle_command_reply: tid=0 2024-09-19T05:20:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.963+0000 7f1d16817740 1 client.15543 shutdown 2024-09-19T05:20:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.963+0000 7f1d16817740 1 -- 172.21.15.120:0/3038009792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9ccaf0 msgr2=0x556d9a9d4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.963+0000 7f1d16817740 1 --2- 172.21.15.120:0/3038009792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9ccaf0 0x556d9a9d4bf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1d080057c0 tx=0x7f1d08009260 comp rx=0 tx=0).stop 2024-09-19T05:20:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.963+0000 7f1d16817740 1 -- 172.21.15.120:0/3038009792 shutdown_connections 2024-09-19T05:20:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.963+0000 7f1d16817740 1 --2- 172.21.15.120:0/3038009792 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d9a9d7cb0 0x556d9a9d5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.963+0000 7f1d16817740 1 --2- 172.21.15.120:0/3038009792 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556d9a9e7c50 0x556d9a9ea040 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.963+0000 7f1d16817740 1 --2- 172.21.15.120:0/3038009792 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556d9a9cd410 0x556d9a9d5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.963+0000 7f1d16817740 1 --2- 172.21.15.120:0/3038009792 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9ccaf0 0x556d9a9d4bf0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.963+0000 7f1cf4ff9640 0 client.15543 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.963+0000 7f1d16817740 1 -- 172.21.15.120:0/3038009792 >> 172.21.15.120:0/3038009792 conn(0x556d9a9c9060 msgr2=0x556d9a9cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.963+0000 7f1d16817740 1 -- 172.21.15.120:0/3038009792 shutdown_connections 2024-09-19T05:20:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.963+0000 7f1d16817740 1 -- 172.21.15.120:0/3038009792 wait complete. 2024-09-19T05:20:32.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.963+0000 7f1d16817740 20 client.15543 trim_cache size 0 max 16384 2024-09-19T05:20:32.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.979+0000 7f1d16817740 1 Processor -- start 2024-09-19T05:20:32.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.979+0000 7f1d16817740 1 -- start start 2024-09-19T05:20:32.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.979+0000 7f1d16817740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556d9a9cd410 0x556d9a9d54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:32.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.979+0000 7f1d16817740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9d7cb0 0x556d9a9ef8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:32.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.979+0000 7f1d16817740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d9a9efe20 0x556d9a9d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:32.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.979+0000 7f1d16817740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0c1ade50 con 0x556d9a9d7cb0 2024-09-19T05:20:32.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.979+0000 7f1d16817740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0c1ab720 con 0x556d9a9efe20 2024-09-19T05:20:32.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.979+0000 7f1d16817740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0c1a9570 con 0x556d9a9cd410 2024-09-19T05:20:32.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.979+0000 7f1d10f3a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9d7cb0 0x556d9a9ef8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:32.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.979+0000 7f1d10f3a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9d7cb0 0x556d9a9ef8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44708/0 (socket says 172.21.15.120:44708) 2024-09-19T05:20:32.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.979+0000 7f1d10f3a640 1 -- 172.21.15.120:0/964241443 learned_addr learned my addr 172.21.15.120:0/964241443 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:32.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.979+0000 7f1d11f3c640 1 --2- 172.21.15.120:0/964241443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d9a9efe20 0x556d9a9d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:32.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.979+0000 7f1d1173b640 1 --2- 172.21.15.120:0/964241443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556d9a9cd410 0x556d9a9d54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:32.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.979+0000 7f1d10f3a640 1 -- 172.21.15.120:0/964241443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556d9a9cd410 msgr2=0x556d9a9d54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:32.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.979+0000 7f1d10f3a640 1 --2- 172.21.15.120:0/964241443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556d9a9cd410 0x556d9a9d54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.979+0000 7f1d10f3a640 1 -- 172.21.15.120:0/964241443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d9a9efe20 msgr2=0x556d9a9d1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:32.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.979+0000 7f1d10f3a640 1 --2- 172.21.15.120:0/964241443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d9a9efe20 0x556d9a9d1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.979+0000 7f1d10f3a640 1 -- 172.21.15.120:0/964241443 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d9a9ea670 con 0x556d9a9d7cb0 2024-09-19T05:20:32.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.979+0000 7f1d11f3c640 1 --2- 172.21.15.120:0/964241443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d9a9efe20 0x556d9a9d1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:20:32.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.979+0000 7f1d1173b640 1 --2- 172.21.15.120:0/964241443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556d9a9cd410 0x556d9a9d54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:20:32.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.979+0000 7f1d10f3a640 1 --2- 172.21.15.120:0/964241443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9d7cb0 0x556d9a9ef8e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0cd230 tx=0x7f1cfc086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=583333a6323c82b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:32.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.980+0000 7f1cf6ffd640 1 -- 172.21.15.120:0/964241443 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc020040 con 0x556d9a9d7cb0 2024-09-19T05:20:32.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.980+0000 7f1cf6ffd640 1 -- 172.21.15.120:0/964241443 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1cfc0a4850 con 0x556d9a9d7cb0 2024-09-19T05:20:32.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.980+0000 7f1cf6ffd640 1 -- 172.21.15.120:0/964241443 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc0979e0 con 0x556d9a9d7cb0 2024-09-19T05:20:32.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.980+0000 7f1d16817740 1 -- 172.21.15.120:0/964241443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9d7cb0 msgr2=0x556d9a9ef8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:32.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.980+0000 7f1d16817740 1 --2- 172.21.15.120:0/964241443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9d7cb0 0x556d9a9ef8e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0cd230 tx=0x7f1cfc086040 comp rx=0 tx=0).stop 2024-09-19T05:20:32.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.980+0000 7f1d16817740 1 -- 172.21.15.120:0/964241443 shutdown_connections 2024-09-19T05:20:32.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.980+0000 7f1d16817740 1 --2- 172.21.15.120:0/964241443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d9a9efe20 0x556d9a9d1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.980+0000 7f1d16817740 1 --2- 172.21.15.120:0/964241443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9d7cb0 0x556d9a9ef8e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.980+0000 7f1d16817740 1 --2- 172.21.15.120:0/964241443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556d9a9cd410 0x556d9a9d54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.980+0000 7f1d16817740 1 -- 172.21.15.120:0/964241443 >> 172.21.15.120:0/964241443 conn(0x556d9a9c9060 msgr2=0x556d9a9d6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:32.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.980+0000 7f1d16817740 1 -- 172.21.15.120:0/964241443 shutdown_connections 2024-09-19T05:20:32.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.980+0000 7f1d16817740 1 -- 172.21.15.120:0/964241443 wait complete. 2024-09-19T05:20:32.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.981+0000 7f1d16817740 1 -- start start 2024-09-19T05:20:32.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.981+0000 7f1d16817740 1 Processor -- start 2024-09-19T05:20:32.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.981+0000 7f1d16817740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d9a9cd410 0x556d9a9d1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.981+0000 7f1d16817740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556d9a9d7cb0 0x556d9a9d2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.981+0000 7f1d16817740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9efe20 0x556d9a9d27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.981+0000 7f1d16817740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0c1a9be0 con 0x556d9a9efe20 2024-09-19T05:20:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.981+0000 7f1d16817740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0c1ab050 con 0x556d9a9cd410 2024-09-19T05:20:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.981+0000 7f1d16817740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0c1aa2b0 con 0x556d9a9d7cb0 2024-09-19T05:20:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.981+0000 7f1d16817740 10 client.0 _ll_register_callbacks cb 0x7f1d08032ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.981+0000 7f1d11f3c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9efe20 0x556d9a9d27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.981+0000 7f1d1173b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d9a9cd410 0x556d9a9d1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.981+0000 7f1d11f3c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9efe20 0x556d9a9d27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:44720/0 (socket says 172.21.15.120:44720) 2024-09-19T05:20:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.981+0000 7f1d11f3c640 1 -- 172.21.15.120:0/542596959 learned_addr learned my addr 172.21.15.120:0/542596959 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.982+0000 7f1d10f3a640 1 --2- 172.21.15.120:0/542596959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556d9a9d7cb0 0x556d9a9d2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.982+0000 7f1d1173b640 1 -- 172.21.15.120:0/542596959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556d9a9d7cb0 msgr2=0x556d9a9d2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:32.989 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.982+0000 7f1d1173b640 1 --2- 172.21.15.120:0/542596959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556d9a9d7cb0 0x556d9a9d2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.982+0000 7f1d1173b640 1 -- 172.21.15.120:0/542596959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9efe20 msgr2=0x556d9a9d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:32.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.982+0000 7f1d1173b640 1 --2- 172.21.15.120:0/542596959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9efe20 0x556d9a9d27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:32.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.982+0000 7f1d1173b640 1 -- 172.21.15.120:0/542596959 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d9aa51980 con 0x556d9a9cd410 2024-09-19T05:20:32.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.982+0000 7f1d10f3a640 1 --2- 172.21.15.120:0/542596959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556d9a9d7cb0 0x556d9a9d2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:20:32.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.982+0000 7f1d1173b640 1 --2- 172.21.15.120:0/542596959 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d9a9cd410 0x556d9a9d1d40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1d08006010 tx=0x7f1d08004980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7a9c2cdd5c43112 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:32.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.982+0000 7f1cf4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:20:32.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.982+0000 7f1cf4ff9640 1 -- 172.21.15.120:0/542596959 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d08005850 con 0x556d9a9cd410 2024-09-19T05:20:32.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.982+0000 7f1d16817740 1 -- 172.21.15.120:0/542596959 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1cfc0a4850 con 0x556d9a9cd410 2024-09-19T05:20:32.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.982+0000 7f1cf4ff9640 1 -- 172.21.15.120:0/542596959 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f1d08005030 con 0x556d9a9cd410 2024-09-19T05:20:32.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.982+0000 7f1cf4ff9640 1 -- 172.21.15.120:0/542596959 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1d08005250 con 0x556d9a9cd410 2024-09-19T05:20:32.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.982+0000 7f1d16817740 10 client.25025 fetch_fsmap learned FSMap version 25 2024-09-19T05:20:32.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.982+0000 7f1d16817740 1 -- 172.21.15.120:0/542596959 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556d9aa52c90 con 0x556d9a9cd410 2024-09-19T05:20:32.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.982+0000 7f1cf4ff9640 1 -- 172.21.15.120:0/542596959 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1cfc0a4850 con 0x556d9a9cd410 2024-09-19T05:20:32.990 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.983+0000 7f1cf4ff9640 1 -- 172.21.15.120:0/542596959 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1d08004160 con 0x556d9a9cd410 2024-09-19T05:20:32.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.983+0000 7f1d16817740 10 client.25025 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:20:32.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.983+0000 7f1d16817740 10 client.25025 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:20:32.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.983+0000 7f1d16817740 20 client.25025 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:32.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.983+0000 7f1d16817740 1 --2- 172.21.15.120:0/542596959 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556d9aa53410 0x556d9aa55830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:32.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.983+0000 7f1d16817740 4 client.25025 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:20:32.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.983+0000 7f1d16817740 1 -- 172.21.15.120:0/542596959 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556d9a938d70 con 0x556d9aa53410 2024-09-19T05:20:32.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.983+0000 7f1d10f3a640 1 --2- 172.21.15.120:0/542596959 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556d9aa53410 0x556d9aa55830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:32.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.983+0000 7f1cf4ff9640 10 client.25025 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:32.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:32.983+0000 7f1d10f3a640 1 --2- 172.21.15.120:0/542596959 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556d9aa53410 0x556d9aa55830 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a3476dd4bffcc30 server_cookie=f765b3168e0e17e8 in_seq=0 out_seq=0 2024-09-19T05:20:33.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.019+0000 7f1cf4ff9640 1 -- 172.21.15.120:0/542596959 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556d9a938d70 con 0x556d9aa53410 2024-09-19T05:20:33.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.019+0000 7f1cf4ff9640 10 client.25025 handle_command_reply: tid=0 2024-09-19T05:20:33.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.019+0000 7f1d16817740 1 client.25025 shutdown 2024-09-19T05:20:33.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.020+0000 7f1d16817740 1 -- 172.21.15.120:0/542596959 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d9a9cd410 msgr2=0x556d9a9d1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:33.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.020+0000 7f1d16817740 1 --2- 172.21.15.120:0/542596959 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d9a9cd410 0x556d9a9d1d40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1d08006010 tx=0x7f1d08004980 comp rx=0 tx=0).stop 2024-09-19T05:20:33.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.020+0000 7f1d16817740 1 -- 172.21.15.120:0/542596959 shutdown_connections 2024-09-19T05:20:33.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.020+0000 7f1d16817740 1 --2- 172.21.15.120:0/542596959 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556d9a9efe20 0x556d9a9d27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:33.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.020+0000 7f1d16817740 1 --2- 172.21.15.120:0/542596959 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556d9aa53410 0x556d9aa55830 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:33.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.020+0000 7f1d16817740 1 --2- 172.21.15.120:0/542596959 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556d9a9d7cb0 0x556d9a9d2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:33.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.020+0000 7f1d16817740 1 --2- 172.21.15.120:0/542596959 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d9a9cd410 0x556d9a9d1d40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:33.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.020+0000 7f1cf4ff9640 0 client.25025 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:33.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.020+0000 7f1d16817740 1 -- 172.21.15.120:0/542596959 >> 172.21.15.120:0/542596959 conn(0x556d9a9c9060 msgr2=0x556d9a9d6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:33.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.020+0000 7f1d16817740 1 -- 172.21.15.120:0/542596959 shutdown_connections 2024-09-19T05:20:33.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.020+0000 7f1d16817740 1 -- 172.21.15.120:0/542596959 wait complete. 2024-09-19T05:20:33.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.020+0000 7f1d16817740 20 client.25025 trim_cache size 0 max 16384 2024-09-19T05:20:33.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:20:33.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:20:33.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:20:33.024 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:20:33.024 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.020+0000 7f1d1399f640 1 -- 172.21.15.120:0/520641544 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1cf80a3580 msgr2=0x7f1cf80a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:33.024 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.020+0000 7f1d1399f640 1 --2- 172.21.15.120:0/520641544 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1cf80a3580 0x7f1cf80a5a40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1d08031440 tx=0x7f1d08005b90 comp rx=0 tx=0).stop 2024-09-19T05:20:33.024 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.020+0000 7f1d1399f640 1 -- 172.21.15.120:0/520641544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d0c101240 msgr2=0x7f1d0c19aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:33.024 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.020+0000 7f1d1399f640 1 --2- 172.21.15.120:0/520641544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d0c101240 0x7f1d0c19aa40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00d950 tx=0x7f1cfc00de10 comp rx=0 tx=0).stop 2024-09-19T05:20:33.025 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.020+0000 7f1d1399f640 1 -- 172.21.15.120:0/520641544 shutdown_connections 2024-09-19T05:20:33.025 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.020+0000 7f1d1399f640 1 --2- 172.21.15.120:0/520641544 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1cf80a3580 0x7f1cf80a5a40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:33.025 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.020+0000 7f1d1399f640 1 --2- 172.21.15.120:0/520641544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d0c10e440 0x7f1d0c19edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:33.025 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.020+0000 7f1d1399f640 1 --2- 172.21.15.120:0/520641544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d0c101240 0x7f1d0c19aa40 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:33.025 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.020+0000 7f1d1399f640 1 --2- 172.21.15.120:0/520641544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d0c100890 0x7f1d0c19a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:33.025 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.021+0000 7f1d1399f640 1 -- 172.21.15.120:0/520641544 >> 172.21.15.120:0/520641544 conn(0x7f1d0c077990 msgr2=0x7f1d0c0ff5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:33.026 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.021+0000 7f1d1399f640 1 -- 172.21.15.120:0/520641544 shutdown_connections 2024-09-19T05:20:33.026 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:33.021+0000 7f1d1399f640 1 -- 172.21.15.120:0/520641544 wait complete. 2024-09-19T05:20:33.050 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether stat accepts an empty string... no 2024-09-19T05:20:33.132 INFO:tasks.workunit.client.0.smithi120.stdout:checking for vprintf... yes 2024-09-19T05:20:33.207 INFO:tasks.workunit.client.0.smithi120.stdout:checking for _doprnt... no 2024-09-19T05:20:33.236 INFO:tasks.workunit.client.0.smithi120.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-19T05:20:33.250 INFO:tasks.workunit.client.0.smithi120.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-19T05:20:33.322 INFO:tasks.workunit.client.0.smithi120.stdout:checking for the pthreads library -lpthreads... no 2024-09-19T05:20:33.394 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether pthreads work without any flags... yes 2024-09-19T05:20:33.460 INFO:tasks.workunit.client.0.smithi120.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2024-09-19T05:20:33.460 INFO:tasks.workunit.client.0.smithi120.stdout:checking if more special flags are required for pthreads... no 2024-09-19T05:20:33.460 INFO:tasks.workunit.client.0.smithi120.stdout:checking for cc_r... gcc 2024-09-19T05:20:33.548 INFO:tasks.workunit.client.0.smithi120.stdout:checking for setrlimit... yes 2024-09-19T05:20:33.628 INFO:tasks.workunit.client.0.smithi120.stdout:checking for setproctitle... no 2024-09-19T05:20:33.708 INFO:tasks.workunit.client.0.smithi120.stdout:checking for getopt_long... yes 2024-09-19T05:20:33.813 INFO:tasks.workunit.client.0.smithi120.stdout:checking for strtoull... yes 2024-09-19T05:20:33.896 INFO:tasks.workunit.client.0.smithi120.stdout:checking for strtoq... yes 2024-09-19T05:20:33.983 INFO:tasks.workunit.client.0.smithi120.stdout:checking for snprintf... yes 2024-09-19T05:20:34.068 INFO:tasks.workunit.client.0.smithi120.stdout:checking for vsnprintf... yes 2024-09-19T05:20:34.154 INFO:tasks.workunit.client.0.smithi120.stdout:checking for vfprintf... yes 2024-09-19T05:20:34.239 INFO:tasks.workunit.client.0.smithi120.stdout:checking for gethostname... yes 2024-09-19T05:20:34.329 INFO:tasks.workunit.client.0.smithi120.stdout:checking for setlocale... yes 2024-09-19T05:20:34.416 INFO:tasks.workunit.client.0.smithi120.stdout:checking for sync... yes 2024-09-19T05:20:34.497 INFO:tasks.workunit.client.0.smithi120.stdout:checking whether snprintf is C99 conformant... done 2024-09-19T05:20:34.514 INFO:tasks.workunit.client.0.smithi120.stdout:configure: creating ./config.status 2024-09-19T05:20:34.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:34 smithi178 ceph-mon[34347]: pgmap v43: 97 pgs: 97 active+clean; 3.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 162 KiB/s wr, 27 op/s 2024-09-19T05:20:34.746 INFO:tasks.workunit.client.0.smithi120.stdout:config.status: creating Makefile 2024-09-19T05:20:34.767 INFO:tasks.workunit.client.0.smithi120.stdout:config.status: creating src/Makefile 2024-09-19T05:20:34.791 INFO:tasks.workunit.client.0.smithi120.stdout:config.status: creating man/Makefile 2024-09-19T05:20:34.806 INFO:tasks.workunit.client.0.smithi120.stdout:config.status: creating config.h 2024-09-19T05:20:34.869 INFO:tasks.workunit.client.0.smithi120.stdout:config.status: executing depfiles commands 2024-09-19T05:20:34.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:34 smithi120 ceph-mon[30956]: pgmap v43: 97 pgs: 97 active+clean; 3.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 162 KiB/s wr, 27 op/s 2024-09-19T05:20:34.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:34 smithi194 ceph-mon[35228]: pgmap v43: 97 pgs: 97 active+clean; 3.1 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 162 KiB/s wr, 27 op/s 2024-09-19T05:20:35.032 INFO:tasks.workunit.client.0.smithi120.stderr:+ make 2024-09-19T05:20:35.046 INFO:tasks.workunit.client.0.smithi120.stdout:make all-recursive 2024-09-19T05:20:35.052 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-19T05:20:35.056 INFO:tasks.workunit.client.0.smithi120.stdout:Making all in src 2024-09-19T05:20:35.079 INFO:tasks.workunit.client.0.smithi120.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-19T05:20:35.079 INFO:tasks.workunit.client.0.smithi120.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2024-09-19T05:20:35.079 INFO:tasks.workunit.client.0.smithi120.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2024-09-19T05:20:35.176 INFO:tasks.workunit.client.0.smithi120.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2024-09-19T05:20:35.176 INFO:tasks.workunit.client.0.smithi120.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2024-09-19T05:20:35.266 INFO:tasks.workunit.client.0.smithi120.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2024-09-19T05:20:35.267 INFO:tasks.workunit.client.0.smithi120.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2024-09-19T05:20:35.352 INFO:tasks.workunit.client.0.smithi120.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2024-09-19T05:20:35.352 INFO:tasks.workunit.client.0.smithi120.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2024-09-19T05:20:35.428 INFO:tasks.workunit.client.0.smithi120.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2024-09-19T05:20:35.428 INFO:tasks.workunit.client.0.smithi120.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2024-09-19T05:20:35.503 INFO:tasks.workunit.client.0.smithi120.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2024-09-19T05:20:35.504 INFO:tasks.workunit.client.0.smithi120.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2024-09-19T05:20:35.579 INFO:tasks.workunit.client.0.smithi120.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2024-09-19T05:20:35.579 INFO:tasks.workunit.client.0.smithi120.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2024-09-19T05:20:35.680 INFO:tasks.workunit.client.0.smithi120.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2024-09-19T05:20:35.680 INFO:tasks.workunit.client.0.smithi120.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2024-09-19T05:20:35.741 INFO:tasks.workunit.client.0.smithi120.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2024-09-19T05:20:35.741 INFO:tasks.workunit.client.0.smithi120.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2024-09-19T05:20:35.801 INFO:tasks.workunit.client.0.smithi120.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2024-09-19T05:20:35.802 INFO:tasks.workunit.client.0.smithi120.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2024-09-19T05:20:35.853 INFO:tasks.workunit.client.0.smithi120.stdout:gcc -g -O2 -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2024-09-19T05:20:35.906 INFO:tasks.workunit.client.0.smithi120.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-09-19T05:20:35.907 INFO:tasks.workunit.client.0.smithi120.stdout:Making all in man 2024-09-19T05:20:35.918 INFO:tasks.workunit.client.0.smithi120.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-19T05:20:35.918 INFO:tasks.workunit.client.0.smithi120.stdout:make[2]: Nothing to be done for 'all'. 2024-09-19T05:20:35.918 INFO:tasks.workunit.client.0.smithi120.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-09-19T05:20:35.926 INFO:tasks.workunit.client.0.smithi120.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-19T05:20:35.929 INFO:tasks.workunit.client.0.smithi120.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-19T05:20:35.929 INFO:tasks.workunit.client.0.smithi120.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-09-19T05:20:35.930 INFO:tasks.workunit.client.0.smithi120.stderr:+ cd src 2024-09-19T05:20:35.931 INFO:tasks.workunit.client.0.smithi120.stderr:+ mkdir blogtest_in 2024-09-19T05:20:35.934 INFO:tasks.workunit.client.0.smithi120.stdout:running blogbench 2024-09-19T05:20:35.934 INFO:tasks.workunit.client.0.smithi120.stderr:+ echo 'running blogbench' 2024-09-19T05:20:35.934 INFO:tasks.workunit.client.0.smithi120.stderr:+ ./blogbench -d blogtest_in 2024-09-19T05:20:35.934 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T05:20:35.934 INFO:tasks.workunit.client.0.smithi120.stdout:Frequency = 10 secs 2024-09-19T05:20:35.935 INFO:tasks.workunit.client.0.smithi120.stdout:Scratch dir = [blogtest_in] 2024-09-19T05:20:36.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:36 smithi178 ceph-mon[34347]: pgmap v44: 97 pgs: 97 active+clean; 6.4 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 533 KiB/s wr, 160 op/s 2024-09-19T05:20:36.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:36 smithi120 ceph-mon[30956]: pgmap v44: 97 pgs: 97 active+clean; 6.4 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 533 KiB/s wr, 160 op/s 2024-09-19T05:20:36.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:36 smithi194 ceph-mon[35228]: pgmap v44: 97 pgs: 97 active+clean; 6.4 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 533 KiB/s wr, 160 op/s 2024-09-19T05:20:38.310 INFO:tasks.workunit.client.0.smithi120.stdout:Spawning 3 writers... 2024-09-19T05:20:38.311 INFO:tasks.workunit.client.0.smithi120.stdout:Spawning 1 rewriters... 2024-09-19T05:20:38.311 INFO:tasks.workunit.client.0.smithi120.stdout:Spawning 5 commenters... 2024-09-19T05:20:38.311 INFO:tasks.workunit.client.0.smithi120.stdout:Spawning 100 readers... 2024-09-19T05:20:38.313 INFO:tasks.workunit.client.0.smithi120.stdout:Benchmarking for 30 iterations. 2024-09-19T05:20:38.313 INFO:tasks.workunit.client.0.smithi120.stdout:The test will run during 5 minutes. 2024-09-19T05:20:38.313 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T05:20:38.313 INFO:tasks.workunit.client.0.smithi120.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2024-09-19T05:20:38.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:38 smithi178 ceph-mon[34347]: pgmap v45: 97 pgs: 97 active+clean; 6.4 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 533 KiB/s wr, 158 op/s 2024-09-19T05:20:38.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:38 smithi120 ceph-mon[30956]: pgmap v45: 97 pgs: 97 active+clean; 6.4 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 533 KiB/s wr, 158 op/s 2024-09-19T05:20:38.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:38 smithi194 ceph-mon[35228]: pgmap v45: 97 pgs: 97 active+clean; 6.4 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 533 KiB/s wr, 158 op/s 2024-09-19T05:20:40.532 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T05:20:40.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:40 smithi178 ceph-mon[34347]: pgmap v46: 97 pgs: 97 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 1.4 MiB/s wr, 212 op/s 2024-09-19T05:20:40.874 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:40.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:40 smithi120 ceph-mon[30956]: pgmap v46: 97 pgs: 97 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 1.4 MiB/s wr, 212 op/s 2024-09-19T05:20:40.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:40 smithi194 ceph-mon[35228]: pgmap v46: 97 pgs: 97 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 1.4 MiB/s wr, 212 op/s 2024-09-19T05:20:41.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.440+0000 7f0fe4e63640 1 -- 172.21.15.120:0/3308489678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0fe0102570 msgr2=0x7f0fe01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:41.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.440+0000 7f0fe4e63640 1 --2- 172.21.15.120:0/3308489678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0fe0102570 0x7f0fe01029b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4009860 tx=0x7f0fd402a3d0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.441+0000 7f0fe4e63640 1 -- 172.21.15.120:0/3308489678 shutdown_connections 2024-09-19T05:20:41.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.441+0000 7f0fe4e63640 1 --2- 172.21.15.120:0/3308489678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fe0102ef0 0x7f0fe010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.441+0000 7f0fe4e63640 1 --2- 172.21.15.120:0/3308489678 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0fe0102570 0x7f0fe01029b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.441+0000 7f0fe4e63640 1 --2- 172.21.15.120:0/3308489678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fe0100e20 0x7f0fe0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.441+0000 7f0fe4e63640 1 -- 172.21.15.120:0/3308489678 >> 172.21.15.120:0/3308489678 conn(0x7f0fe00fc7d0 msgr2=0x7f0fe00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:41.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.441+0000 7f0fe4e63640 1 -- 172.21.15.120:0/3308489678 shutdown_connections 2024-09-19T05:20:41.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.441+0000 7f0fe4e63640 1 -- 172.21.15.120:0/3308489678 wait complete. 2024-09-19T05:20:41.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.442+0000 7f0fe4e63640 1 Processor -- start 2024-09-19T05:20:41.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.442+0000 7f0fe4e63640 1 -- start start 2024-09-19T05:20:41.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.442+0000 7f0fe4e63640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0fe0100e20 0x7f0fe01a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:41.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.442+0000 7f0fe4e63640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fe0102570 0x7f0fe01a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:41.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.442+0000 7f0fde59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0fe0100e20 0x7f0fe01a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:41.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.442+0000 7f0fe4e63640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fe0102ef0 0x7f0fe019e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:41.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.442+0000 7f0fde59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0fe0100e20 0x7f0fe01a46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55410/0 (socket says 172.21.15.120:55410) 2024-09-19T05:20:41.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.442+0000 7f0fe4e63640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe010fd70 con 0x7f0fe0100e20 2024-09-19T05:20:41.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.442+0000 7f0fe4e63640 1 -- 172.21.15.120:0/3367422971 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe010fbf0 con 0x7f0fe0102570 2024-09-19T05:20:41.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.442+0000 7f0fde59c640 1 -- 172.21.15.120:0/3367422971 learned_addr learned my addr 172.21.15.120:0/3367422971 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:41.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.442+0000 7f0fe4e63640 1 -- 172.21.15.120:0/3367422971 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe010fef0 con 0x7f0fe0102ef0 2024-09-19T05:20:41.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.443+0000 7f0fddd9b640 1 --2- 172.21.15.120:0/3367422971 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fe0102570 0x7f0fe01a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:41.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.443+0000 7f0fded9d640 1 --2- 172.21.15.120:0/3367422971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fe0102ef0 0x7f0fe019e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:41.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.443+0000 7f0fde59c640 1 -- 172.21.15.120:0/3367422971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fe0102ef0 msgr2=0x7f0fe019e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:41.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.443+0000 7f0fde59c640 1 --2- 172.21.15.120:0/3367422971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fe0102ef0 0x7f0fe019e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.443+0000 7f0fde59c640 1 -- 172.21.15.120:0/3367422971 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fe0102570 msgr2=0x7f0fe01a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:41.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.443+0000 7f0fde59c640 1 --2- 172.21.15.120:0/3367422971 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fe0102570 0x7f0fe01a4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.443+0000 7f0fde59c640 1 -- 172.21.15.120:0/3367422971 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fe019efd0 con 0x7f0fe0100e20 2024-09-19T05:20:41.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.443+0000 7f0fded9d640 1 --2- 172.21.15.120:0/3367422971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fe0102ef0 0x7f0fe019e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:20:41.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.443+0000 7f0fde59c640 1 --2- 172.21.15.120:0/3367422971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0fe0100e20 0x7f0fe01a46b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000e9c0 tx=0x7f0fd000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:41.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.443+0000 7f0fcf7fe640 1 -- 172.21.15.120:0/3367422971 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd000cde0 con 0x7f0fe0100e20 2024-09-19T05:20:41.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.443+0000 7f0fe4e63640 1 -- 172.21.15.120:0/3367422971 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fe019f2c0 con 0x7f0fe0100e20 2024-09-19T05:20:41.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.443+0000 7f0fe4e63640 1 -- 172.21.15.120:0/3367422971 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fe01ab510 con 0x7f0fe0100e20 2024-09-19T05:20:41.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.443+0000 7f0fcf7fe640 1 -- 172.21.15.120:0/3367422971 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0fd00035f0 con 0x7f0fe0100e20 2024-09-19T05:20:41.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.443+0000 7f0fcf7fe640 1 -- 172.21.15.120:0/3367422971 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd0010690 con 0x7f0fe0100e20 2024-09-19T05:20:41.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.447+0000 7f0fe723c740 1 Processor -- start 2024-09-19T05:20:41.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.447+0000 7f0fcf7fe640 1 -- 172.21.15.120:0/3367422971 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7f0fd00037a0 con 0x7f0fe0100e20 2024-09-19T05:20:41.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.447+0000 7f0fe723c740 1 -- start start 2024-09-19T05:20:41.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.447+0000 7f0fe723c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56138f5bd4a0 0x56138f5bd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:41.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.447+0000 7f0fe723c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56138f5bddc0 0x56138f5c8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:41.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.447+0000 7f0fe723c740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56138f5c8680 0x56138f5caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:41.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.447+0000 7f0fe723c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56138f5232e0 con 0x56138f5bddc0 2024-09-19T05:20:41.454 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.447+0000 7f0fe723c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56138f4cace0 con 0x56138f5bd4a0 2024-09-19T05:20:41.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.448+0000 7f0fded9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56138f5bd4a0 0x56138f5bd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:41.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.448+0000 7f0fded9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56138f5bd4a0 0x56138f5bd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:42850/0 (socket says 172.21.15.120:42850) 2024-09-19T05:20:41.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.448+0000 7f0fded9d640 1 -- 172.21.15.120:0/1071121094 learned_addr learned my addr 172.21.15.120:0/1071121094 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:41.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.448+0000 7f0fe723c740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56138f51f2a0 con 0x56138f5c8680 2024-09-19T05:20:41.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.448+0000 7f0fde59c640 1 --2- 172.21.15.120:0/1071121094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56138f5bddc0 0x56138f5c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:41.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.448+0000 7f0fddd9b640 1 --2- 172.21.15.120:0/1071121094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56138f5c8680 0x56138f5caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:41.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.449+0000 7f0fcf7fe640 1 --2- 172.21.15.120:0/3367422971 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0fc80a34d0 0x7f0fc80a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:41.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.449+0000 7f0fded9d640 1 --2- 172.21.15.120:0/3367422971 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0fc80a34d0 0x7f0fc80a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:41.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.449+0000 7f0fde59c640 1 -- 172.21.15.120:0/1071121094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56138f5c8680 msgr2=0x56138f5caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:41.455 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.449+0000 7f0fde59c640 1 --2- 172.21.15.120:0/1071121094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56138f5c8680 0x56138f5caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.449+0000 7f0fde59c640 1 -- 172.21.15.120:0/1071121094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56138f5bd4a0 msgr2=0x56138f5bd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:41.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.449+0000 7f0fde59c640 1 --2- 172.21.15.120:0/1071121094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56138f5bd4a0 0x56138f5bd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.449+0000 7f0fde59c640 1 -- 172.21.15.120:0/1071121094 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56138f4af440 con 0x56138f5bddc0 2024-09-19T05:20:41.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.449+0000 7f0fddd9b640 1 --2- 172.21.15.120:0/1071121094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56138f5c8680 0x56138f5caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:41.456 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.449+0000 7f0fcf7fe640 1 -- 172.21.15.120:0/3367422971 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f0fd00d0450 con 0x7f0fe0100e20 2024-09-19T05:20:41.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.450+0000 7f0fde59c640 1 --2- 172.21.15.120:0/1071121094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56138f5bddc0 0x56138f5c8140 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0fd00cd9d0 tx=0x7f0fd0020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19dff175134b0703 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:41.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.450+0000 7f0fccff9640 1 -- 172.21.15.120:0/1071121094 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd0003ac0 con 0x56138f5bddc0 2024-09-19T05:20:41.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.450+0000 7f0fccff9640 1 -- 172.21.15.120:0/1071121094 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0fd00d3e30 con 0x56138f5bddc0 2024-09-19T05:20:41.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.450+0000 7f0fccff9640 1 -- 172.21.15.120:0/1071121094 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd00a0840 con 0x56138f5bddc0 2024-09-19T05:20:41.459 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.450+0000 7f0fded9d640 1 --2- 172.21.15.120:0/3367422971 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0fc80a34d0 0x7f0fc80a5990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0fd80139c0 tx=0x7f0fd8004ab0 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.451+0000 7f0fe723c740 1 -- 172.21.15.120:0/1071121094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56138f5bddc0 msgr2=0x56138f5c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.451+0000 7f0fe723c740 1 --2- 172.21.15.120:0/1071121094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56138f5bddc0 0x56138f5c8140 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0fd00cd9d0 tx=0x7f0fd0020000 comp rx=0 tx=0).stop 2024-09-19T05:20:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.451+0000 7f0fe723c740 1 -- 172.21.15.120:0/1071121094 shutdown_connections 2024-09-19T05:20:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.451+0000 7f0fe723c740 1 --2- 172.21.15.120:0/1071121094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56138f5c8680 0x56138f5caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.451+0000 7f0fe723c740 1 --2- 172.21.15.120:0/1071121094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56138f5bddc0 0x56138f5c8140 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.451+0000 7f0fe723c740 1 --2- 172.21.15.120:0/1071121094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56138f5bd4a0 0x56138f5bd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.451+0000 7f0fe723c740 1 -- 172.21.15.120:0/1071121094 >> 172.21.15.120:0/1071121094 conn(0x56138f5b9a30 msgr2=0x56138f5b9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.451+0000 7f0fe723c740 1 -- 172.21.15.120:0/1071121094 shutdown_connections 2024-09-19T05:20:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.451+0000 7f0fe723c740 1 -- 172.21.15.120:0/1071121094 wait complete. 2024-09-19T05:20:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.452+0000 7f0fe723c740 1 -- start start 2024-09-19T05:20:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.452+0000 7f0fe723c740 1 Processor -- start 2024-09-19T05:20:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.452+0000 7f0fe723c740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56138f5bd4a0 0x56138f5c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:41.460 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.452+0000 7f0fe723c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56138f5bddc0 0x56138f5c5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:41.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.452+0000 7f0fe723c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56138f5c8680 0x56138f5c5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:41.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.452+0000 7f0fe723c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56138f5cb250 con 0x56138f5c8680 2024-09-19T05:20:41.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.452+0000 7f0fde59c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56138f5bd4a0 0x56138f5c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:41.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.452+0000 7f0fe723c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56138f4de050 con 0x56138f5bddc0 2024-09-19T05:20:41.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.452+0000 7f0fddd9b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56138f5bddc0 0x56138f5c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:41.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.452+0000 7f0fe723c740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56138f5cb3d0 con 0x56138f5bd4a0 2024-09-19T05:20:41.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.452+0000 7f0fde59c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56138f5bd4a0 0x56138f5c7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:43790/0 (socket says 172.21.15.120:43790) 2024-09-19T05:20:41.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.452+0000 7f0fddd9b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56138f5bddc0 0x56138f5c5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:42856/0 (socket says 172.21.15.120:42856) 2024-09-19T05:20:41.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.452+0000 7f0fde59c640 1 -- 172.21.15.120:0/64656296 learned_addr learned my addr 172.21.15.120:0/64656296 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:41.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.452+0000 7f0fe723c740 10 client.0 _ll_register_callbacks cb 0x56138f51e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:41.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.452+0000 7f0fded9d640 1 --2- 172.21.15.120:0/64656296 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56138f5c8680 0x56138f5c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:41.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.453+0000 7f0fde59c640 1 -- 172.21.15.120:0/64656296 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56138f5bddc0 msgr2=0x56138f5c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:41.461 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.453+0000 7f0fde59c640 1 --2- 172.21.15.120:0/64656296 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56138f5bddc0 0x56138f5c5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.453+0000 7f0fde59c640 1 -- 172.21.15.120:0/64656296 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56138f5c8680 msgr2=0x56138f5c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.453+0000 7f0fde59c640 1 --2- 172.21.15.120:0/64656296 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56138f5c8680 0x56138f5c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.453+0000 7f0fde59c640 1 -- 172.21.15.120:0/64656296 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56138f2943c0 con 0x56138f5bd4a0 2024-09-19T05:20:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.453+0000 7f0fddd9b640 1 --2- 172.21.15.120:0/64656296 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56138f5bddc0 0x56138f5c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.453+0000 7f0fde59c640 1 --2- 172.21.15.120:0/64656296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56138f5bd4a0 0x56138f5c7f90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0fd00cdae0 tx=0x7f0fd00cda30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=145af6fa6eadea71 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.453+0000 7f0fc5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:20:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.453+0000 7f0fc5ffb640 1 -- 172.21.15.120:0/64656296 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd0003ac0 con 0x56138f5bd4a0 2024-09-19T05:20:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.453+0000 7f0fc5ffb640 1 -- 172.21.15.120:0/64656296 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f0fd009c6f0 con 0x56138f5bd4a0 2024-09-19T05:20:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.453+0000 7f0fe723c740 1 -- 172.21.15.120:0/64656296 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fd00d3e30 con 0x56138f5bd4a0 2024-09-19T05:20:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.453+0000 7f0fc5ffb640 1 -- 172.21.15.120:0/64656296 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0fd009c970 con 0x56138f5bd4a0 2024-09-19T05:20:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.453+0000 7f0fe723c740 10 client.25102 fetch_fsmap learned FSMap version 25 2024-09-19T05:20:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.453+0000 7f0fe723c740 1 -- 172.21.15.120:0/64656296 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56138f5cb250 con 0x56138f5bd4a0 2024-09-19T05:20:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.454+0000 7f0fc5ffb640 1 -- 172.21.15.120:0/64656296 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0fd001d260 con 0x56138f5bd4a0 2024-09-19T05:20:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.454+0000 7f0fc5ffb640 1 -- 172.21.15.120:0/64656296 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0fd00cdcb0 con 0x56138f5bd4a0 2024-09-19T05:20:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.454+0000 7f0fe723c740 10 client.25102 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:20:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.454+0000 7f0fe723c740 10 client.25102 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:20:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.454+0000 7f0fe723c740 20 client.25102 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.454+0000 7f0fe723c740 1 --2- 172.21.15.120:0/64656296 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56138f5d7ec0 0x56138f5da2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.454+0000 7f0fe723c740 4 client.25102 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:20:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.454+0000 7f0fe723c740 1 -- 172.21.15.120:0/64656296 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0fd00d3e30 con 0x56138f5d7ec0 2024-09-19T05:20:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.454+0000 7f0fddd9b640 1 --2- 172.21.15.120:0/64656296 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56138f5d7ec0 0x56138f5da2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.454+0000 7f0fc5ffb640 10 client.25102 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.454+0000 7f0fddd9b640 1 --2- 172.21.15.120:0/64656296 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56138f5d7ec0 0x56138f5da2b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49d6449e7d0e43a7 server_cookie=d7eea8bd8b5bff7 in_seq=0 out_seq=0 2024-09-19T05:20:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.455+0000 7f0fc5ffb640 1 -- 172.21.15.120:0/64656296 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f0fd00d3e30 con 0x56138f5d7ec0 2024-09-19T05:20:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.455+0000 7f0fc5ffb640 10 client.25102 handle_command_reply: tid=0 2024-09-19T05:20:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.455+0000 7f0fe723c740 1 client.25102 shutdown 2024-09-19T05:20:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.455+0000 7f0fe723c740 1 -- 172.21.15.120:0/64656296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56138f5bd4a0 msgr2=0x56138f5c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.455+0000 7f0fe723c740 1 --2- 172.21.15.120:0/64656296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56138f5bd4a0 0x56138f5c7f90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0fd00cdae0 tx=0x7f0fd00cda30 comp rx=0 tx=0).stop 2024-09-19T05:20:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.455+0000 7f0fe723c740 1 -- 172.21.15.120:0/64656296 shutdown_connections 2024-09-19T05:20:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.455+0000 7f0fe723c740 1 --2- 172.21.15.120:0/64656296 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56138f5c8680 0x56138f5c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.455+0000 7f0fe723c740 1 --2- 172.21.15.120:0/64656296 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56138f5bddc0 0x56138f5c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.455+0000 7f0fe723c740 1 --2- 172.21.15.120:0/64656296 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56138f5d7ec0 0x56138f5da2b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.456+0000 7f0fe723c740 1 --2- 172.21.15.120:0/64656296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56138f5bd4a0 0x56138f5c7f90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.456+0000 7f0fe723c740 1 -- 172.21.15.120:0/64656296 >> 172.21.15.120:0/64656296 conn(0x56138f5b9a30 msgr2=0x56138f5bf760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.456+0000 7f0fc5ffb640 0 client.25102 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.456+0000 7f0fe723c740 1 -- 172.21.15.120:0/64656296 shutdown_connections 2024-09-19T05:20:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.456+0000 7f0fe723c740 1 -- 172.21.15.120:0/64656296 wait complete. 2024-09-19T05:20:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.456+0000 7f0fe723c740 20 client.25102 trim_cache size 0 max 16384 2024-09-19T05:20:41.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.479+0000 7f0fe723c740 1 Processor -- start 2024-09-19T05:20:41.481 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.479+0000 7f0fe723c740 1 -- start start 2024-09-19T05:20:41.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.480+0000 7f0fe723c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56138f5bd4a0 0x56138f5c5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:41.482 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.480+0000 7f0fe723c740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56138f5bddc0 0x56138f5bf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:41.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.480+0000 7f0fe723c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56138f5c8680 0x56138f5dce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:41.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.480+0000 7f0fe723c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe01b6730 con 0x56138f5c8680 2024-09-19T05:20:41.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.480+0000 7f0fe723c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe01b4000 con 0x56138f5bd4a0 2024-09-19T05:20:41.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.480+0000 7f0fe723c740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe01b1e50 con 0x56138f5bddc0 2024-09-19T05:20:41.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.480+0000 7f0fddd9b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56138f5bddc0 0x56138f5bf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:41.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.480+0000 7f0fddd9b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56138f5bddc0 0x56138f5bf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:43798/0 (socket says 172.21.15.120:43798) 2024-09-19T05:20:41.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.480+0000 7f0fddd9b640 1 -- 172.21.15.120:0/1701972978 learned_addr learned my addr 172.21.15.120:0/1701972978 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:41.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.480+0000 7f0fded9d640 1 --2- 172.21.15.120:0/1701972978 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56138f5c8680 0x56138f5dce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:41.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.480+0000 7f0fde59c640 1 --2- 172.21.15.120:0/1701972978 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56138f5bd4a0 0x56138f5c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:41.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.480+0000 7f0fddd9b640 1 -- 172.21.15.120:0/1701972978 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56138f5bd4a0 msgr2=0x56138f5c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:41.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.480+0000 7f0fddd9b640 1 --2- 172.21.15.120:0/1701972978 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56138f5bd4a0 0x56138f5c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.480+0000 7f0fddd9b640 1 -- 172.21.15.120:0/1701972978 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56138f5c8680 msgr2=0x56138f5dce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:41.483 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.480+0000 7f0fddd9b640 1 --2- 172.21.15.120:0/1701972978 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56138f5c8680 0x56138f5dce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.481+0000 7f0fddd9b640 1 -- 172.21.15.120:0/1701972978 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56138f5b9860 con 0x56138f5bddc0 2024-09-19T05:20:41.484 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.481+0000 7f0fddd9b640 1 --2- 172.21.15.120:0/1701972978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56138f5bddc0 0x56138f5bf600 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0fd402a8f0 tx=0x7f0fd4005ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb450f5278d137a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:41.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.481+0000 7f0fc7fff640 1 -- 172.21.15.120:0/1701972978 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4004050 con 0x56138f5bddc0 2024-09-19T05:20:41.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.481+0000 7f0fc7fff640 1 -- 172.21.15.120:0/1701972978 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0fd40054f0 con 0x56138f5bddc0 2024-09-19T05:20:41.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.481+0000 7f0fc7fff640 1 -- 172.21.15.120:0/1701972978 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4004b50 con 0x56138f5bddc0 2024-09-19T05:20:41.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.482+0000 7f0fe723c740 1 -- 172.21.15.120:0/1701972978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56138f5bddc0 msgr2=0x56138f5bf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:41.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.482+0000 7f0fe723c740 1 --2- 172.21.15.120:0/1701972978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56138f5bddc0 0x56138f5bf600 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0fd402a8f0 tx=0x7f0fd4005ab0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.482+0000 7f0fe723c740 1 -- 172.21.15.120:0/1701972978 shutdown_connections 2024-09-19T05:20:41.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.482+0000 7f0fe723c740 1 --2- 172.21.15.120:0/1701972978 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56138f5c8680 0x56138f5dce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.482+0000 7f0fe723c740 1 --2- 172.21.15.120:0/1701972978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56138f5bddc0 0x56138f5bf600 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.486 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.482+0000 7f0fe723c740 1 --2- 172.21.15.120:0/1701972978 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56138f5bd4a0 0x56138f5c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.482+0000 7f0fe723c740 1 -- 172.21.15.120:0/1701972978 >> 172.21.15.120:0/1701972978 conn(0x56138f5b9a30 msgr2=0x56138f5beef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:41.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.482+0000 7f0fe723c740 1 -- 172.21.15.120:0/1701972978 shutdown_connections 2024-09-19T05:20:41.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.482+0000 7f0fe723c740 1 -- 172.21.15.120:0/1701972978 wait complete. 2024-09-19T05:20:41.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.482+0000 7f0fe723c740 1 -- start start 2024-09-19T05:20:41.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.483+0000 7f0fe723c740 1 Processor -- start 2024-09-19T05:20:41.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.483+0000 7f0fe723c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56138f5bd4a0 0x56138f5da4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:41.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.483+0000 7f0fe723c740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56138f5bddc0 0x56138f5daa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:41.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.483+0000 7f0fe723c740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56138f5c8680 0x56138f6407f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:41.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.483+0000 7f0fe723c740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe01b24c0 con 0x56138f5bddc0 2024-09-19T05:20:41.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.483+0000 7f0fe723c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe01b3930 con 0x56138f5bd4a0 2024-09-19T05:20:41.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.483+0000 7f0fe723c740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0fe01b2b90 con 0x56138f5c8680 2024-09-19T05:20:41.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.483+0000 7f0fe723c740 10 client.0 _ll_register_callbacks cb 0x7f0fd80099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:41.487 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.483+0000 7f0fddd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56138f5bddc0 0x56138f5daa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:41.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.483+0000 7f0fde59c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56138f5bd4a0 0x56138f5da4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:41.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.483+0000 7f0fde59c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56138f5bd4a0 0x56138f5da4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:42882/0 (socket says 172.21.15.120:42882) 2024-09-19T05:20:41.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.483+0000 7f0fddd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56138f5bddc0 0x56138f5daa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55448/0 (socket says 172.21.15.120:55448) 2024-09-19T05:20:41.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.483+0000 7f0fde59c640 1 -- 172.21.15.120:0/1927838076 learned_addr learned my addr 172.21.15.120:0/1927838076 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:41.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.484+0000 7f0fded9d640 1 --2- 172.21.15.120:0/1927838076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56138f5c8680 0x56138f6407f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:41.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.484+0000 7f0fde59c640 1 -- 172.21.15.120:0/1927838076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56138f5c8680 msgr2=0x56138f6407f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:41.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.484+0000 7f0fde59c640 1 --2- 172.21.15.120:0/1927838076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56138f5c8680 0x56138f6407f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.484+0000 7f0fde59c640 1 -- 172.21.15.120:0/1927838076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56138f5bddc0 msgr2=0x56138f5daa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:41.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.484+0000 7f0fde59c640 1 --2- 172.21.15.120:0/1927838076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56138f5bddc0 0x56138f5daa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.484+0000 7f0fde59c640 1 -- 172.21.15.120:0/1927838076 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56138f640e00 con 0x56138f5bd4a0 2024-09-19T05:20:41.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.484+0000 7f0fddd9b640 1 --2- 172.21.15.120:0/1927838076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56138f5bddc0 0x56138f5daa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:41.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.484+0000 7f0fde59c640 1 --2- 172.21.15.120:0/1927838076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56138f5bd4a0 0x56138f5da4c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0fd009bf60 tx=0x7f0fd000c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25081779d85a9ee7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:41.488 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.484+0000 7f0fc5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:20:41.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.484+0000 7f0fc5ffb640 1 -- 172.21.15.120:0/1927838076 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fd00cdec0 con 0x56138f5bd4a0 2024-09-19T05:20:41.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.484+0000 7f0fc5ffb640 1 -- 172.21.15.120:0/1927838076 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f0fd009c8f0 con 0x56138f5bd4a0 2024-09-19T05:20:41.489 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.484+0000 7f0fe723c740 1 -- 172.21.15.120:0/1927838076 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0fd40054f0 con 0x56138f5bd4a0 2024-09-19T05:20:41.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.485+0000 7f0fc5ffb640 1 -- 172.21.15.120:0/1927838076 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0fd009cb90 con 0x56138f5bd4a0 2024-09-19T05:20:41.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.485+0000 7f0fe723c740 10 client.25043 fetch_fsmap learned FSMap version 25 2024-09-19T05:20:41.490 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.485+0000 7f0fe723c740 1 -- 172.21.15.120:0/1927838076 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56138f6420d0 con 0x56138f5bd4a0 2024-09-19T05:20:41.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.485+0000 7f0fc5ffb640 1 -- 172.21.15.120:0/1927838076 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0fd00a0840 con 0x56138f5bd4a0 2024-09-19T05:20:41.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.485+0000 7f0fc5ffb640 1 -- 172.21.15.120:0/1927838076 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0fd009b350 con 0x56138f5bd4a0 2024-09-19T05:20:41.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.485+0000 7f0fe723c740 10 client.25043 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:20:41.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.485+0000 7f0fe723c740 10 client.25043 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:20:41.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.485+0000 7f0fe723c740 20 client.25043 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:41.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.485+0000 7f0fe723c740 1 --2- 172.21.15.120:0/1927838076 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56138f642500 0x56138f6448f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:41.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.485+0000 7f0fe723c740 4 client.25043 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:20:41.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.485+0000 7f0fe723c740 1 -- 172.21.15.120:0/1927838076 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f0fd40054f0 con 0x56138f642500 2024-09-19T05:20:41.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.485+0000 7f0fddd9b640 1 --2- 172.21.15.120:0/1927838076 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56138f642500 0x56138f6448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:41.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.486+0000 7f0fc5ffb640 10 client.25043 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:41.491 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.486+0000 7f0fddd9b640 1 --2- 172.21.15.120:0/1927838076 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56138f642500 0x56138f6448f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=742160f3a6446040 server_cookie=5acd44abc97b4175 in_seq=0 out_seq=0 2024-09-19T05:20:41.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.486+0000 7f0fc5ffb640 1 -- 172.21.15.120:0/1927838076 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f0fd40054f0 con 0x56138f642500 2024-09-19T05:20:41.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.486+0000 7f0fc5ffb640 10 client.25043 handle_command_reply: tid=0 2024-09-19T05:20:41.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.486+0000 7f0fe723c740 1 client.25043 shutdown 2024-09-19T05:20:41.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.486+0000 7f0fe723c740 1 -- 172.21.15.120:0/1927838076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56138f5bd4a0 msgr2=0x56138f5da4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:41.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.486+0000 7f0fe723c740 1 --2- 172.21.15.120:0/1927838076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56138f5bd4a0 0x56138f5da4c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0fd009bf60 tx=0x7f0fd000c850 comp rx=0 tx=0).stop 2024-09-19T05:20:41.492 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.486+0000 7f0fe723c740 1 -- 172.21.15.120:0/1927838076 shutdown_connections 2024-09-19T05:20:41.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.486+0000 7f0fe723c740 1 --2- 172.21.15.120:0/1927838076 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56138f642500 0x56138f6448f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.486+0000 7f0fe723c740 1 --2- 172.21.15.120:0/1927838076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56138f5c8680 0x56138f6407f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.486+0000 7f0fe723c740 1 --2- 172.21.15.120:0/1927838076 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56138f5bddc0 0x56138f5daa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.486+0000 7f0fe723c740 1 --2- 172.21.15.120:0/1927838076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56138f5bd4a0 0x56138f5da4c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.486+0000 7f0fe723c740 1 -- 172.21.15.120:0/1927838076 >> 172.21.15.120:0/1927838076 conn(0x56138f5b9a30 msgr2=0x56138f5c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:41.493 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.486+0000 7f0fc5ffb640 0 client.25043 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:41.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.487+0000 7f0fe723c740 1 -- 172.21.15.120:0/1927838076 shutdown_connections 2024-09-19T05:20:41.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.487+0000 7f0fe723c740 1 -- 172.21.15.120:0/1927838076 wait complete. 2024-09-19T05:20:41.494 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.487+0000 7f0fe723c740 20 client.25043 trim_cache size 0 max 16384 2024-09-19T05:20:41.494 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T05:20:41.495 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "no active scrubs running", 2024-09-19T05:20:41.495 INFO:teuthology.orchestra.run.smithi120.stdout: "scrubs": {} 2024-09-19T05:20:41.495 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T05:20:41.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.487+0000 7f0fe4e63640 1 -- 172.21.15.120:0/3367422971 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0fc80a34d0 msgr2=0x7f0fc80a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:41.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.487+0000 7f0fe4e63640 1 --2- 172.21.15.120:0/3367422971 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0fc80a34d0 0x7f0fc80a5990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0fd80139c0 tx=0x7f0fd8004ab0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.487+0000 7f0fe4e63640 1 -- 172.21.15.120:0/3367422971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0fe0100e20 msgr2=0x7f0fe01a46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:41.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.487+0000 7f0fe4e63640 1 --2- 172.21.15.120:0/3367422971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0fe0100e20 0x7f0fe01a46b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0fd000e9c0 tx=0x7f0fd000ee80 comp rx=0 tx=0).stop 2024-09-19T05:20:41.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.488+0000 7f0fe4e63640 1 -- 172.21.15.120:0/3367422971 shutdown_connections 2024-09-19T05:20:41.496 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.488+0000 7f0fe4e63640 1 --2- 172.21.15.120:0/3367422971 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0fc80a34d0 0x7f0fc80a5990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.488+0000 7f0fe4e63640 1 --2- 172.21.15.120:0/3367422971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0fe0102ef0 0x7f0fe019e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.488+0000 7f0fe4e63640 1 --2- 172.21.15.120:0/3367422971 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fe0102570 0x7f0fe01a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.488+0000 7f0fe4e63640 1 --2- 172.21.15.120:0/3367422971 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0fe0100e20 0x7f0fe01a46b0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:41.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.488+0000 7f0fe4e63640 1 -- 172.21.15.120:0/3367422971 >> 172.21.15.120:0/3367422971 conn(0x7f0fe00fc7d0 msgr2=0x7f0fe00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:41.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.488+0000 7f0fe4e63640 1 -- 172.21.15.120:0/3367422971 shutdown_connections 2024-09-19T05:20:41.497 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:41.488+0000 7f0fe4e63640 1 -- 172.21.15.120:0/3367422971 wait complete. 2024-09-19T05:20:42.454 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T05:20:42.454 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:20:42.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:42 smithi178 ceph-mon[34347]: pgmap v47: 97 pgs: 97 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 1.2 MiB/s wr, 187 op/s 2024-09-19T05:20:42.811 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:42.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:42 smithi120 ceph-mon[30956]: pgmap v47: 97 pgs: 97 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 1.2 MiB/s wr, 187 op/s 2024-09-19T05:20:42.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:42 smithi194 ceph-mon[35228]: pgmap v47: 97 pgs: 97 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 1.2 MiB/s wr, 187 op/s 2024-09-19T05:20:43.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.350+0000 7f29a2b27640 1 -- 172.21.15.120:0/4204502328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f299c102ef0 msgr2=0x7f299c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:43.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.350+0000 7f29a2b27640 1 --2- 172.21.15.120:0/4204502328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f299c102ef0 0x7f299c10da40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2994009cd0 tx=0x7f299402a980 comp rx=0 tx=0).stop 2024-09-19T05:20:43.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.350+0000 7f29a2b27640 1 -- 172.21.15.120:0/4204502328 shutdown_connections 2024-09-19T05:20:43.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.350+0000 7f29a2b27640 1 --2- 172.21.15.120:0/4204502328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f299c102ef0 0x7f299c10da40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:43.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.350+0000 7f29a2b27640 1 --2- 172.21.15.120:0/4204502328 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f299c102570 0x7f299c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:43.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.350+0000 7f29a2b27640 1 --2- 172.21.15.120:0/4204502328 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f299c100e20 0x7f299c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:43.355 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.350+0000 7f29a2b27640 1 -- 172.21.15.120:0/4204502328 >> 172.21.15.120:0/4204502328 conn(0x7f299c0fc7d0 msgr2=0x7f299c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:43.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.350+0000 7f29a2b27640 1 -- 172.21.15.120:0/4204502328 shutdown_connections 2024-09-19T05:20:43.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.351+0000 7f29a2b27640 1 -- 172.21.15.120:0/4204502328 wait complete. 2024-09-19T05:20:43.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.351+0000 7f29a2b27640 1 Processor -- start 2024-09-19T05:20:43.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.351+0000 7f29a2b27640 1 -- start start 2024-09-19T05:20:43.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.352+0000 7f29a2b27640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f299c100e20 0x7f299c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:43.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.352+0000 7f29a2b27640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f299c102570 0x7f299c198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:43.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.352+0000 7f29a2b27640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f299c102ef0 0x7f299c19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:43.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.352+0000 7f29a2b27640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f299c110e30 con 0x7f299c102ef0 2024-09-19T05:20:43.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.352+0000 7f29a2b27640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f299c110cb0 con 0x7f299c100e20 2024-09-19T05:20:43.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.352+0000 7f29a2b27640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f299c110fb0 con 0x7f299c102570 2024-09-19T05:20:43.356 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.352+0000 7f29a10c4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f299c102ef0 0x7f299c19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:43.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.352+0000 7f299bfff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f299c102570 0x7f299c198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:43.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.352+0000 7f29a10c4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f299c102ef0 0x7f299c19cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:55466/0 (socket says 172.21.15.120:55466) 2024-09-19T05:20:43.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.352+0000 7f29a10c4640 1 -- 172.21.15.120:0/823114323 learned_addr learned my addr 172.21.15.120:0/823114323 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:43.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.352+0000 7f29a08c3640 1 --2- 172.21.15.120:0/823114323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f299c100e20 0x7f299c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:43.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.352+0000 7f29a10c4640 1 -- 172.21.15.120:0/823114323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f299c102570 msgr2=0x7f299c198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:43.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.352+0000 7f29a10c4640 1 --2- 172.21.15.120:0/823114323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f299c102570 0x7f299c198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:43.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.352+0000 7f29a10c4640 1 -- 172.21.15.120:0/823114323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f299c100e20 msgr2=0x7f299c198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:43.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.352+0000 7f29a10c4640 1 --2- 172.21.15.120:0/823114323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f299c100e20 0x7f299c198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:43.357 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.352+0000 7f29a10c4640 1 -- 172.21.15.120:0/823114323 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f299c19d3f0 con 0x7f299c102ef0 2024-09-19T05:20:43.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.352+0000 7f29a08c3640 1 --2- 172.21.15.120:0/823114323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f299c100e20 0x7f299c198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:20:43.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.353+0000 7f29a10c4640 1 --2- 172.21.15.120:0/823114323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f299c102ef0 0x7f299c19cd10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2994032000 tx=0x7f29940308e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:43.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.353+0000 7f2999ffb640 1 -- 172.21.15.120:0/823114323 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2994034040 con 0x7f299c102ef0 2024-09-19T05:20:43.358 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.353+0000 7f2999ffb640 1 -- 172.21.15.120:0/823114323 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f299402fd10 con 0x7f299c102ef0 2024-09-19T05:20:43.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.353+0000 7f29a2b27640 1 -- 172.21.15.120:0/823114323 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f299c19d680 con 0x7f299c102ef0 2024-09-19T05:20:43.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.353+0000 7f2999ffb640 1 -- 172.21.15.120:0/823114323 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29940044d0 con 0x7f299c102ef0 2024-09-19T05:20:43.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.353+0000 7f29a2b27640 1 -- 172.21.15.120:0/823114323 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f299c0fcbb0 con 0x7f299c102ef0 2024-09-19T05:20:43.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.355+0000 7f29a2b27640 1 -- 172.21.15.120:0/823114323 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f299c1021b0 con 0x7f299c102ef0 2024-09-19T05:20:43.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.356+0000 7f2999ffb640 1 -- 172.21.15.120:0/823114323 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7f2994037020 con 0x7f299c102ef0 2024-09-19T05:20:43.359 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.357+0000 7f2999ffb640 1 --2- 172.21.15.120:0/823114323 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f298c0a3590 0x7f298c0a5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:43.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.357+0000 7f29a08c3640 1 --2- 172.21.15.120:0/823114323 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f298c0a3590 0x7f298c0a5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:43.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.357+0000 7f2999ffb640 1 -- 172.21.15.120:0/823114323 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f29940f0d10 con 0x7f299c102ef0 2024-09-19T05:20:43.360 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.358+0000 7f29a08c3640 1 --2- 172.21.15.120:0/823114323 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f298c0a3590 0x7f298c0a5a50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2990009c80 tx=0x7f2990005f90 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:43.365 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.363+0000 7f2999ffb640 1 -- 172.21.15.120:0/823114323 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f29940bd560 con 0x7f299c102ef0 2024-09-19T05:20:43.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.708+0000 7f29a2b27640 1 -- 172.21.15.120:0/823114323 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f299c10a0a0 con 0x7f299c102ef0 2024-09-19T05:20:43.710 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.708+0000 7f2999ffb640 1 -- 172.21.15.120:0/823114323 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11921 (secure 0 0 0) 0x7f29940bce60 con 0x7f299c102ef0 2024-09-19T05:20:43.710 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:20:43.711 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":25,"btime":"2024-09-19T05:19:16:322502+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/93472898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":93472898},{"type":"v1","addr":"172.21.15.120:6835","nonce":93472898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1976835398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1976835398},{"type":"v1","addr":"172.21.15.120:6837","nonce":1976835398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6839/2975851469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":2975851469},{"type":"v1","addr":"172.21.15.120:6839","nonce":2975851469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6841/2837552754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":2837552754},{"type":"v1","addr":"172.21.15.120:6841","nonce":2837552754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/61682954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":61682954},{"type":"v1","addr":"172.21.15.178:6833","nonce":61682954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1778722040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1778722040},{"type":"v1","addr":"172.21.15.194:6833","nonce":1778722040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:17:30.796197+0000","modified":"2024-09-19T05:19:15.911765+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24445,"mds_1":24443,"mds_2":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24401":{"gid":24401,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/890775592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":890775592},{"type":"v1","addr":"172.21.15.178:6835","nonce":890775592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6837/3960720164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3960720164},{"type":"v1","addr":"172.21.15.178:6837","nonce":3960720164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6835/3268846994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3268846994},{"type":"v1","addr":"172.21.15.194:6835","nonce":3268846994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.194:6837/378729335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":378729335},{"type":"v1","addr":"172.21.15.194:6837","nonce":378729335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.178:6839/3389137566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3389137566},{"type":"v1","addr":"172.21.15.178:6839","nonce":3389137566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6839/3817420679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3817420679},{"type":"v1","addr":"172.21.15.194:6839","nonce":3817420679}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24445,"qdb_cluster":[24445,24443,24430]},"id":1}]} 2024-09-19T05:20:43.711 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 25 2024-09-19T05:20:43.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.711+0000 7f29a2b27640 1 -- 172.21.15.120:0/823114323 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f298c0a3590 msgr2=0x7f298c0a5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:43.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.711+0000 7f29a2b27640 1 --2- 172.21.15.120:0/823114323 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f298c0a3590 0x7f298c0a5a50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2990009c80 tx=0x7f2990005f90 comp rx=0 tx=0).stop 2024-09-19T05:20:43.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.712+0000 7f29a2b27640 1 -- 172.21.15.120:0/823114323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f299c102ef0 msgr2=0x7f299c19cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:43.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.712+0000 7f29a2b27640 1 --2- 172.21.15.120:0/823114323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f299c102ef0 0x7f299c19cd10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2994032000 tx=0x7f29940308e0 comp rx=0 tx=0).stop 2024-09-19T05:20:43.714 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.712+0000 7f29a2b27640 1 -- 172.21.15.120:0/823114323 shutdown_connections 2024-09-19T05:20:43.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.712+0000 7f29a2b27640 1 --2- 172.21.15.120:0/823114323 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f298c0a3590 0x7f298c0a5a50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:43.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.712+0000 7f29a2b27640 1 --2- 172.21.15.120:0/823114323 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f299c102ef0 0x7f299c19cd10 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:43.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.712+0000 7f29a2b27640 1 --2- 172.21.15.120:0/823114323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f299c102570 0x7f299c198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:43.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.712+0000 7f29a2b27640 1 --2- 172.21.15.120:0/823114323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f299c100e20 0x7f299c198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:43.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.712+0000 7f29a2b27640 1 -- 172.21.15.120:0/823114323 >> 172.21.15.120:0/823114323 conn(0x7f299c0fc7d0 msgr2=0x7f299c06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:43.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.712+0000 7f29a2b27640 1 -- 172.21.15.120:0/823114323 shutdown_connections 2024-09-19T05:20:43.715 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:43.712+0000 7f29a2b27640 1 -- 172.21.15.120:0/823114323 wait complete. 2024-09-19T05:20:44.100 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:43 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/823114323' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:20:44.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:43 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/823114323' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:20:44.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:43 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/823114323' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:20:44.515 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T05:20:44.873 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:45.022 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:44 smithi120 ceph-mon[30956]: pgmap v48: 97 pgs: 97 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 1.2 MiB/s wr, 187 op/s 2024-09-19T05:20:45.057 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:44 smithi194 ceph-mon[35228]: pgmap v48: 97 pgs: 97 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 1.2 MiB/s wr, 187 op/s 2024-09-19T05:20:45.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:44 smithi178 ceph-mon[34347]: pgmap v48: 97 pgs: 97 active+clean; 16 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 1.2 MiB/s wr, 187 op/s 2024-09-19T05:20:45.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.405+0000 7f7a58bae640 1 -- 172.21.15.120:0/3297012969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a5410ae80 msgr2=0x7f7a54113370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:45.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.405+0000 7f7a58bae640 1 --2- 172.21.15.120:0/3297012969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a5410ae80 0x7f7a54113370 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7a48009860 tx=0x7f7a4802a340 comp rx=0 tx=0).stop 2024-09-19T05:20:45.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.405+0000 7f7a58bae640 1 -- 172.21.15.120:0/3297012969 shutdown_connections 2024-09-19T05:20:45.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.405+0000 7f7a58bae640 1 --2- 172.21.15.120:0/3297012969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a541139e0 0x7f7a54115e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.405+0000 7f7a58bae640 1 --2- 172.21.15.120:0/3297012969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a5410ae80 0x7f7a54113370 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.405+0000 7f7a58bae640 1 --2- 172.21.15.120:0/3297012969 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a5410a560 0x7f7a5410a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.405+0000 7f7a58bae640 1 -- 172.21.15.120:0/3297012969 >> 172.21.15.120:0/3297012969 conn(0x7f7a5406e2d0 msgr2=0x7f7a5406e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:45.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.405+0000 7f7a58bae640 1 -- 172.21.15.120:0/3297012969 shutdown_connections 2024-09-19T05:20:45.408 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.405+0000 7f7a58bae640 1 -- 172.21.15.120:0/3297012969 wait complete. 2024-09-19T05:20:45.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.406+0000 7f7a58bae640 1 Processor -- start 2024-09-19T05:20:45.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.406+0000 7f7a58bae640 1 -- start start 2024-09-19T05:20:45.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.407+0000 7f7a58bae640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a5410a560 0x7f7a5410fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:45.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.407+0000 7f7a58bae640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a5410ae80 0x7f7a541102c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:45.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.407+0000 7f7a58bae640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a541139e0 0x7f7a541acd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:45.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.407+0000 7f7a58bae640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7a54117dc0 con 0x7f7a5410a560 2024-09-19T05:20:45.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.407+0000 7f7a58bae640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7a54117c40 con 0x7f7a541139e0 2024-09-19T05:20:45.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.407+0000 7f7a58bae640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7a54117f40 con 0x7f7a5410ae80 2024-09-19T05:20:45.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.407+0000 7f7a5259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a5410a560 0x7f7a5410fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:45.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.407+0000 7f7a51d9b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a5410ae80 0x7f7a541102c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:45.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.407+0000 7f7a5259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a5410a560 0x7f7a5410fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49164/0 (socket says 172.21.15.120:49164) 2024-09-19T05:20:45.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.407+0000 7f7a5259c640 1 -- 172.21.15.120:0/2601112625 learned_addr learned my addr 172.21.15.120:0/2601112625 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:45.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.407+0000 7f7a52d9d640 1 --2- 172.21.15.120:0/2601112625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a541139e0 0x7f7a541acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:45.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.407+0000 7f7a5259c640 1 -- 172.21.15.120:0/2601112625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a5410ae80 msgr2=0x7f7a541102c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:45.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.407+0000 7f7a5259c640 1 --2- 172.21.15.120:0/2601112625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a5410ae80 0x7f7a541102c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.407+0000 7f7a5259c640 1 -- 172.21.15.120:0/2601112625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a541139e0 msgr2=0x7f7a541acd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:45.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.407+0000 7f7a5259c640 1 --2- 172.21.15.120:0/2601112625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a541139e0 0x7f7a541acd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.407+0000 7f7a5259c640 1 -- 172.21.15.120:0/2601112625 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a541ad3e0 con 0x7f7a5410a560 2024-09-19T05:20:45.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.407+0000 7f7a52d9d640 1 --2- 172.21.15.120:0/2601112625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a541139e0 0x7f7a541acd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:45.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.407+0000 7f7a5259c640 1 --2- 172.21.15.120:0/2601112625 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a5410a560 0x7f7a5410fd80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400e9c0 tx=0x7f7a4400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:45.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.408+0000 7f7a437fe640 1 -- 172.21.15.120:0/2601112625 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4400cde0 con 0x7f7a5410a560 2024-09-19T05:20:45.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.408+0000 7f7a437fe640 1 -- 172.21.15.120:0/2601112625 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a440035f0 con 0x7f7a5410a560 2024-09-19T05:20:45.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.408+0000 7f7a58bae640 1 -- 172.21.15.120:0/2601112625 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a541ad6d0 con 0x7f7a5410a560 2024-09-19T05:20:45.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.408+0000 7f7a437fe640 1 -- 172.21.15.120:0/2601112625 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a44010690 con 0x7f7a5410a560 2024-09-19T05:20:45.411 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.408+0000 7f7a58bae640 1 -- 172.21.15.120:0/2601112625 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a541b3db0 con 0x7f7a5410a560 2024-09-19T05:20:45.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.410+0000 7f7a437fe640 1 -- 172.21.15.120:0/2601112625 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7f7a440037a0 con 0x7f7a5410a560 2024-09-19T05:20:45.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.411+0000 7f7a5af87740 1 Processor -- start 2024-09-19T05:20:45.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.411+0000 7f7a5af87740 1 -- start start 2024-09-19T05:20:45.413 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.411+0000 7f7a5af87740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eca3672b40 0x55eca3671090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:45.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.411+0000 7f7a5af87740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eca36715d0 0x55eca3671a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:45.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.411+0000 7f7a5af87740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eca367c370 0x55eca367e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:45.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.411+0000 7f7a5af87740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55eca35d72f0 con 0x55eca3672b40 2024-09-19T05:20:45.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.411+0000 7f7a5af87740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55eca357ecf0 con 0x55eca36715d0 2024-09-19T05:20:45.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.411+0000 7f7a5af87740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55eca35d32b0 con 0x55eca367c370 2024-09-19T05:20:45.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.412+0000 7f7a52d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eca3672b40 0x55eca3671090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:45.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.412+0000 7f7a52d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eca3672b40 0x55eca3671090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49168/0 (socket says 172.21.15.120:49168) 2024-09-19T05:20:45.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.412+0000 7f7a52d9d640 1 -- 172.21.15.120:0/1069773913 learned_addr learned my addr 172.21.15.120:0/1069773913 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:45.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.412+0000 7f7a5259c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eca36715d0 0x55eca3671a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:45.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.412+0000 7f7a51d9b640 1 --2- 172.21.15.120:0/1069773913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eca367c370 0x55eca367e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:45.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.412+0000 7f7a52d9d640 1 -- 172.21.15.120:0/1069773913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eca367c370 msgr2=0x55eca367e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:45.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.412+0000 7f7a52d9d640 1 --2- 172.21.15.120:0/1069773913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eca367c370 0x55eca367e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.412+0000 7f7a52d9d640 1 -- 172.21.15.120:0/1069773913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eca36715d0 msgr2=0x55eca3671a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:45.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.412+0000 7f7a52d9d640 1 --2- 172.21.15.120:0/1069773913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eca36715d0 0x55eca3671a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.412+0000 7f7a52d9d640 1 -- 172.21.15.120:0/1069773913 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eca35633a0 con 0x55eca3672b40 2024-09-19T05:20:45.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.412+0000 7f7a52d9d640 1 --2- 172.21.15.120:0/1069773913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eca3672b40 0x55eca3671090 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0117e0 tx=0x7f7a4c011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12d58084b2b436c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:45.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.412+0000 7f7a40ff9640 1 -- 172.21.15.120:0/1069773913 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c011310 con 0x55eca3672b40 2024-09-19T05:20:45.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.412+0000 7f7a40ff9640 1 -- 172.21.15.120:0/1069773913 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a4c003e20 con 0x55eca3672b40 2024-09-19T05:20:45.416 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.413+0000 7f7a40ff9640 1 -- 172.21.15.120:0/1069773913 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c0044f0 con 0x55eca3672b40 2024-09-19T05:20:45.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.413+0000 7f7a437fe640 1 --2- 172.21.15.120:0/2601112625 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f7a3c0a34d0 0x7f7a3c0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:45.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.413+0000 7f7a5259c640 1 --2- 172.21.15.120:0/2601112625 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f7a3c0a34d0 0x7f7a3c0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:45.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.413+0000 7f7a437fe640 1 -- 172.21.15.120:0/2601112625 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f7a440d02f0 con 0x7f7a5410a560 2024-09-19T05:20:45.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.414+0000 7f7a5af87740 1 -- 172.21.15.120:0/1069773913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eca3672b40 msgr2=0x55eca3671090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:45.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.414+0000 7f7a5259c640 1 --2- 172.21.15.120:0/2601112625 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f7a3c0a34d0 0x7f7a3c0a5990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7a440cd8d0 tx=0x7f7a440d3e00 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:45.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.414+0000 7f7a5af87740 1 --2- 172.21.15.120:0/1069773913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eca3672b40 0x55eca3671090 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0117e0 tx=0x7f7a4c011ca0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.414+0000 7f7a5af87740 1 -- 172.21.15.120:0/1069773913 shutdown_connections 2024-09-19T05:20:45.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.414+0000 7f7a5af87740 1 --2- 172.21.15.120:0/1069773913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eca367c370 0x55eca367e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.414+0000 7f7a5af87740 1 --2- 172.21.15.120:0/1069773913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eca36715d0 0x55eca3671a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.414+0000 7f7a5af87740 1 --2- 172.21.15.120:0/1069773913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eca3672b40 0x55eca3671090 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.414+0000 7f7a5af87740 1 -- 172.21.15.120:0/1069773913 >> 172.21.15.120:0/1069773913 conn(0x55eca363a310 msgr2=0x55eca366dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:45.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.415+0000 7f7a5af87740 1 -- 172.21.15.120:0/1069773913 shutdown_connections 2024-09-19T05:20:45.417 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.415+0000 7f7a5af87740 1 -- 172.21.15.120:0/1069773913 wait complete. 2024-09-19T05:20:45.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.415+0000 7f7a5af87740 1 -- start start 2024-09-19T05:20:45.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.415+0000 7f7a5af87740 1 Processor -- start 2024-09-19T05:20:45.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.415+0000 7f7a5af87740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eca36715d0 0x55eca367bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:45.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.415+0000 7f7a5af87740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eca3672b40 0x55eca3679050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:45.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.415+0000 7f7a5af87740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eca367c370 0x55eca36797e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:45.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.415+0000 7f7a5af87740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55eca367f070 con 0x55eca3672b40 2024-09-19T05:20:45.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.415+0000 7f7a5af87740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55eca3592060 con 0x55eca36715d0 2024-09-19T05:20:45.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.416+0000 7f7a5af87740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55eca367f1f0 con 0x55eca367c370 2024-09-19T05:20:45.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.416+0000 7f7a5af87740 10 client.0 _ll_register_callbacks cb 0x55eca32e58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:45.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.416+0000 7f7a52d9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eca36715d0 0x55eca367bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:45.420 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.416+0000 7f7a52d9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eca36715d0 0x55eca367bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:43378/0 (socket says 172.21.15.120:43378) 2024-09-19T05:20:45.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.416+0000 7f7a52d9d640 1 -- 172.21.15.120:0/3023138464 learned_addr learned my addr 172.21.15.120:0/3023138464 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:45.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.416+0000 7f7a52d9d640 1 --2- 172.21.15.120:0/3023138464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eca367c370 0x55eca36797e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:45.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.416+0000 7f7a51d9b640 1 --2- 172.21.15.120:0/3023138464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eca3672b40 0x55eca3679050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:45.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.416+0000 7f7a52d9d640 1 -- 172.21.15.120:0/3023138464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eca367c370 msgr2=0x55eca36797e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:45.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.416+0000 7f7a52d9d640 1 --2- 172.21.15.120:0/3023138464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eca367c370 0x55eca36797e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.416+0000 7f7a52d9d640 1 -- 172.21.15.120:0/3023138464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eca3672b40 msgr2=0x55eca3679050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:45.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.416+0000 7f7a52d9d640 1 --2- 172.21.15.120:0/3023138464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eca3672b40 0x55eca3679050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.416+0000 7f7a52d9d640 1 -- 172.21.15.120:0/3023138464 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eca33483c0 con 0x55eca36715d0 2024-09-19T05:20:45.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.416+0000 7f7a52d9d640 1 --2- 172.21.15.120:0/3023138464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eca36715d0 0x55eca367bda0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c003dd0 tx=0x7f7a4c0040d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8cf4c650007958c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:45.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.416+0000 7f7a39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:20:45.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.417+0000 7f7a39ffb640 1 -- 172.21.15.120:0/3023138464 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c01e070 con 0x55eca36715d0 2024-09-19T05:20:45.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.417+0000 7f7a39ffb640 1 -- 172.21.15.120:0/3023138464 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f7a4c00fdd0 con 0x55eca36715d0 2024-09-19T05:20:45.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.417+0000 7f7a5af87740 1 -- 172.21.15.120:0/3023138464 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a4c003e20 con 0x55eca36715d0 2024-09-19T05:20:45.421 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.417+0000 7f7a39ffb640 1 -- 172.21.15.120:0/3023138464 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7a4c032050 con 0x55eca36715d0 2024-09-19T05:20:45.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.417+0000 7f7a5af87740 10 client.25061 fetch_fsmap learned FSMap version 25 2024-09-19T05:20:45.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.417+0000 7f7a5af87740 1 -- 172.21.15.120:0/3023138464 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55eca368ab50 con 0x55eca36715d0 2024-09-19T05:20:45.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.417+0000 7f7a39ffb640 1 -- 172.21.15.120:0/3023138464 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a4c003e20 con 0x55eca36715d0 2024-09-19T05:20:45.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.418+0000 7f7a39ffb640 1 -- 172.21.15.120:0/3023138464 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7a4c018020 con 0x55eca36715d0 2024-09-19T05:20:45.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.418+0000 7f7a5af87740 10 client.25061 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:20:45.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.418+0000 7f7a5af87740 10 client.25061 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T05:20:45.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.418+0000 7f7a5af87740 20 client.25061 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:45.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.418+0000 7f7a5af87740 1 --2- 172.21.15.120:0/3023138464 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55eca368bea0 0x55eca368e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:45.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.418+0000 7f7a5af87740 4 client.25061 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:20:45.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.418+0000 7f7a5af87740 1 -- 172.21.15.120:0/3023138464 --> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eca35e4860 con 0x55eca368bea0 2024-09-19T05:20:45.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.418+0000 7f7a51d9b640 1 --2- 172.21.15.120:0/3023138464 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55eca368bea0 0x55eca368e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:45.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.418+0000 7f7a39ffb640 10 client.25061 ms_handle_connect on v2:172.21.15.194:6836/378729335 2024-09-19T05:20:45.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.418+0000 7f7a51d9b640 1 --2- 172.21.15.120:0/3023138464 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55eca368bea0 0x55eca368e290 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2ffa2c2e62ed4574 server_cookie=51034cad9b324c59 in_seq=0 out_seq=0 2024-09-19T05:20:45.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.419+0000 7f7a39ffb640 1 -- 172.21.15.120:0/3023138464 <== mds.2 v2:172.21.15.194:6836/378729335 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eca35e4860 con 0x55eca368bea0 2024-09-19T05:20:45.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.419+0000 7f7a39ffb640 10 client.25061 handle_command_reply: tid=0 2024-09-19T05:20:45.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.419+0000 7f7a5af87740 1 client.25061 shutdown 2024-09-19T05:20:45.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.419+0000 7f7a5af87740 1 -- 172.21.15.120:0/3023138464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eca36715d0 msgr2=0x55eca367bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:45.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.419+0000 7f7a5af87740 1 --2- 172.21.15.120:0/3023138464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eca36715d0 0x55eca367bda0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c003dd0 tx=0x7f7a4c0040d0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.419+0000 7f7a5af87740 1 -- 172.21.15.120:0/3023138464 shutdown_connections 2024-09-19T05:20:45.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.419+0000 7f7a5af87740 1 --2- 172.21.15.120:0/3023138464 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55eca368bea0 0x55eca368e290 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.419+0000 7f7a5af87740 1 --2- 172.21.15.120:0/3023138464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eca367c370 0x55eca36797e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.419+0000 7f7a5af87740 1 --2- 172.21.15.120:0/3023138464 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eca3672b40 0x55eca3679050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.419+0000 7f7a39ffb640 0 client.25061 ms_handle_reset on v2:172.21.15.194:6836/378729335 2024-09-19T05:20:45.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.419+0000 7f7a5af87740 1 --2- 172.21.15.120:0/3023138464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eca36715d0 0x55eca367bda0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.419+0000 7f7a5af87740 1 -- 172.21.15.120:0/3023138464 >> 172.21.15.120:0/3023138464 conn(0x55eca363a310 msgr2=0x55eca3673960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:45.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.420+0000 7f7a5af87740 1 -- 172.21.15.120:0/3023138464 shutdown_connections 2024-09-19T05:20:45.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.420+0000 7f7a5af87740 1 -- 172.21.15.120:0/3023138464 wait complete. 2024-09-19T05:20:45.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.420+0000 7f7a5af87740 20 client.25061 trim_cache size 0 max 16384 2024-09-19T05:20:45.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.438+0000 7f7a5af87740 1 Processor -- start 2024-09-19T05:20:45.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.438+0000 7f7a5af87740 1 -- start start 2024-09-19T05:20:45.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.438+0000 7f7a5af87740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eca36715d0 0x55eca3677920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:45.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.438+0000 7f7a5af87740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eca3672b40 0x55eca366cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:45.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.438+0000 7f7a5af87740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eca367c370 0x55eca366d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:45.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.438+0000 7f7a5af87740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7a541bf100 con 0x55eca36715d0 2024-09-19T05:20:45.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.438+0000 7f7a5af87740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7a541bc9d0 con 0x55eca3672b40 2024-09-19T05:20:45.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.438+0000 7f7a5af87740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7a541ba820 con 0x55eca367c370 2024-09-19T05:20:45.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.438+0000 7f7a51d9b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eca3672b40 0x55eca366cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:45.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.438+0000 7f7a51d9b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eca3672b40 0x55eca366cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:43384/0 (socket says 172.21.15.120:43384) 2024-09-19T05:20:45.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.438+0000 7f7a51d9b640 1 -- 172.21.15.120:0/1234512417 learned_addr learned my addr 172.21.15.120:0/1234512417 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:45.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.438+0000 7f7a52d9d640 1 --2- 172.21.15.120:0/1234512417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eca36715d0 0x55eca3677920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:45.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.438+0000 7f7a52d9d640 1 --2- 172.21.15.120:0/1234512417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eca367c370 0x55eca366d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:45.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.438+0000 7f7a51d9b640 1 -- 172.21.15.120:0/1234512417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eca367c370 msgr2=0x55eca366d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:45.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.438+0000 7f7a51d9b640 1 --2- 172.21.15.120:0/1234512417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eca367c370 0x55eca366d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.438+0000 7f7a51d9b640 1 -- 172.21.15.120:0/1234512417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eca36715d0 msgr2=0x55eca3677920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:45.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.438+0000 7f7a51d9b640 1 --2- 172.21.15.120:0/1234512417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eca36715d0 0x55eca3677920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.439+0000 7f7a51d9b640 1 -- 172.21.15.120:0/1234512417 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eca3678000 con 0x55eca3672b40 2024-09-19T05:20:45.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.439+0000 7f7a51d9b640 1 --2- 172.21.15.120:0/1234512417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eca3672b40 0x55eca366cc10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7a48009830 tx=0x7f7a480095b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ab1437d4cc8d2f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:45.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.439+0000 7f7a3bfff640 1 -- 172.21.15.120:0/1234512417 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48037040 con 0x55eca3672b40 2024-09-19T05:20:45.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.439+0000 7f7a3bfff640 1 -- 172.21.15.120:0/1234512417 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a48044070 con 0x55eca3672b40 2024-09-19T05:20:45.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.439+0000 7f7a3bfff640 1 -- 172.21.15.120:0/1234512417 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a480039e0 con 0x55eca3672b40 2024-09-19T05:20:45.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.440+0000 7f7a5af87740 1 -- 172.21.15.120:0/1234512417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eca3672b40 msgr2=0x55eca366cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:45.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.440+0000 7f7a5af87740 1 --2- 172.21.15.120:0/1234512417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eca3672b40 0x55eca366cc10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7a48009830 tx=0x7f7a480095b0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.440+0000 7f7a5af87740 1 -- 172.21.15.120:0/1234512417 shutdown_connections 2024-09-19T05:20:45.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.440+0000 7f7a5af87740 1 --2- 172.21.15.120:0/1234512417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eca367c370 0x55eca366d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.440+0000 7f7a5af87740 1 --2- 172.21.15.120:0/1234512417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eca3672b40 0x55eca366cc10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.440+0000 7f7a5af87740 1 --2- 172.21.15.120:0/1234512417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eca36715d0 0x55eca3677920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.440+0000 7f7a5af87740 1 -- 172.21.15.120:0/1234512417 >> 172.21.15.120:0/1234512417 conn(0x55eca363a310 msgr2=0x55eca366c500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:45.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.440+0000 7f7a5af87740 1 -- 172.21.15.120:0/1234512417 shutdown_connections 2024-09-19T05:20:45.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.440+0000 7f7a5af87740 1 -- 172.21.15.120:0/1234512417 wait complete. 2024-09-19T05:20:45.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.440+0000 7f7a5af87740 1 -- start start 2024-09-19T05:20:45.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.441+0000 7f7a5af87740 1 Processor -- start 2024-09-19T05:20:45.444 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.441+0000 7f7a5af87740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eca36715d0 0x55eca3684d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:45.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.441+0000 7f7a5af87740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eca3672b40 0x55eca3680060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:45.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.441+0000 7f7a5af87740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eca367c370 0x55eca36807f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:45.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.441+0000 7f7a5af87740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7a541bae90 con 0x55eca367c370 2024-09-19T05:20:45.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.441+0000 7f7a5af87740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7a541bc300 con 0x55eca36715d0 2024-09-19T05:20:45.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.441+0000 7f7a5af87740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7a541bb560 con 0x55eca3672b40 2024-09-19T05:20:45.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.441+0000 7f7a5af87740 10 client.0 _ll_register_callbacks cb 0x7f7a440d3cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:45.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.441+0000 7f7a52d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eca367c370 0x55eca36807f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:45.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.441+0000 7f7a52d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eca367c370 0x55eca36807f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49196/0 (socket says 172.21.15.120:49196) 2024-09-19T05:20:45.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.441+0000 7f7a52d9d640 1 -- 172.21.15.120:0/2244122554 learned_addr learned my addr 172.21.15.120:0/2244122554 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:45.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.441+0000 7f7a51d9b640 1 --2- 172.21.15.120:0/2244122554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eca3672b40 0x55eca3680060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:45.445 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.441+0000 7f7a52d9d640 1 --2- 172.21.15.120:0/2244122554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eca36715d0 0x55eca3684d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:45.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.442+0000 7f7a52d9d640 1 -- 172.21.15.120:0/2244122554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eca3672b40 msgr2=0x55eca3680060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:45.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.442+0000 7f7a52d9d640 1 --2- 172.21.15.120:0/2244122554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eca3672b40 0x55eca3680060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.442+0000 7f7a52d9d640 1 -- 172.21.15.120:0/2244122554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eca36715d0 msgr2=0x55eca3684d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:45.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.442+0000 7f7a52d9d640 1 --2- 172.21.15.120:0/2244122554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eca36715d0 0x55eca3684d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.442+0000 7f7a52d9d640 1 -- 172.21.15.120:0/2244122554 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eca36f5950 con 0x55eca367c370 2024-09-19T05:20:45.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.442+0000 7f7a52d9d640 1 --2- 172.21.15.120:0/2244122554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eca367c370 0x55eca36807f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c011ce0 tx=0x7f7a4c011510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2e5d2c1d17d7b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:45.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.442+0000 7f7a39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:20:45.448 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.442+0000 7f7a39ffb640 1 -- 172.21.15.120:0/2244122554 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c01e040 con 0x55eca367c370 2024-09-19T05:20:45.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.442+0000 7f7a39ffb640 1 -- 172.21.15.120:0/2244122554 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f7a4c003e00 con 0x55eca367c370 2024-09-19T05:20:45.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.442+0000 7f7a5af87740 1 -- 172.21.15.120:0/2244122554 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a48044070 con 0x55eca367c370 2024-09-19T05:20:45.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.442+0000 7f7a39ffb640 1 -- 172.21.15.120:0/2244122554 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7a4c025040 con 0x55eca367c370 2024-09-19T05:20:45.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.442+0000 7f7a5af87740 10 client.15591 fetch_fsmap learned FSMap version 25 2024-09-19T05:20:45.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.442+0000 7f7a5af87740 1 -- 172.21.15.120:0/2244122554 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55eca36f6ab0 con 0x55eca367c370 2024-09-19T05:20:45.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.442+0000 7f7a39ffb640 1 -- 172.21.15.120:0/2244122554 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7a4c01a440 con 0x55eca367c370 2024-09-19T05:20:45.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.443+0000 7f7a39ffb640 1 -- 172.21.15.120:0/2244122554 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7a4c018040 con 0x55eca367c370 2024-09-19T05:20:45.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.443+0000 7f7a5af87740 10 client.15591 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:20:45.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.443+0000 7f7a5af87740 10 client.15591 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T05:20:45.449 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.443+0000 7f7a5af87740 20 client.15591 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:45.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.443+0000 7f7a5af87740 1 --2- 172.21.15.120:0/2244122554 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55eca36f7170 0x55eca36f9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:45.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.443+0000 7f7a5af87740 4 client.15591 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T05:20:45.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.443+0000 7f7a5af87740 1 -- 172.21.15.120:0/2244122554 --> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f7a48044070 con 0x55eca36f7170 2024-09-19T05:20:45.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.443+0000 7f7a51d9b640 1 --2- 172.21.15.120:0/2244122554 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55eca36f7170 0x55eca36f9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:45.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.444+0000 7f7a51d9b640 1 --2- 172.21.15.120:0/2244122554 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55eca36f7170 0x55eca36f9560 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=587f9442ddc20fb server_cookie=81fd24609ccc3646 in_seq=0 out_seq=0 2024-09-19T05:20:45.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.444+0000 7f7a39ffb640 10 client.15591 ms_handle_connect on v2:172.21.15.194:6836/378729335 2024-09-19T05:20:45.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.444+0000 7f7a39ffb640 1 -- 172.21.15.120:0/2244122554 <== mds.2 v2:172.21.15.194:6836/378729335 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f7a48044070 con 0x55eca36f7170 2024-09-19T05:20:45.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.444+0000 7f7a39ffb640 10 client.15591 handle_command_reply: tid=0 2024-09-19T05:20:45.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.444+0000 7f7a5af87740 1 client.15591 shutdown 2024-09-19T05:20:45.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.444+0000 7f7a5af87740 1 -- 172.21.15.120:0/2244122554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eca367c370 msgr2=0x55eca36807f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:45.450 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.444+0000 7f7a5af87740 1 --2- 172.21.15.120:0/2244122554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eca367c370 0x55eca36807f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c011ce0 tx=0x7f7a4c011510 comp rx=0 tx=0).stop 2024-09-19T05:20:45.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.444+0000 7f7a5af87740 1 -- 172.21.15.120:0/2244122554 shutdown_connections 2024-09-19T05:20:45.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.444+0000 7f7a5af87740 1 --2- 172.21.15.120:0/2244122554 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55eca36f7170 0x55eca36f9560 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.444+0000 7f7a5af87740 1 --2- 172.21.15.120:0/2244122554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eca367c370 0x55eca36807f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.444+0000 7f7a5af87740 1 --2- 172.21.15.120:0/2244122554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eca3672b40 0x55eca3680060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.444+0000 7f7a5af87740 1 --2- 172.21.15.120:0/2244122554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eca36715d0 0x55eca3684d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.444+0000 7f7a5af87740 1 -- 172.21.15.120:0/2244122554 >> 172.21.15.120:0/2244122554 conn(0x55eca363a310 msgr2=0x55eca366cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:45.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.444+0000 7f7a39ffb640 0 client.15591 ms_handle_reset on v2:172.21.15.194:6836/378729335 2024-09-19T05:20:45.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.444+0000 7f7a5af87740 1 -- 172.21.15.120:0/2244122554 shutdown_connections 2024-09-19T05:20:45.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.444+0000 7f7a5af87740 1 -- 172.21.15.120:0/2244122554 wait complete. 2024-09-19T05:20:45.451 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.444+0000 7f7a5af87740 20 client.15591 trim_cache size 0 max 16384 2024-09-19T05:20:45.451 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-09-19T05:20:45.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.445+0000 7f7a58bae640 1 -- 172.21.15.120:0/2601112625 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f7a3c0a34d0 msgr2=0x7f7a3c0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:45.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.445+0000 7f7a58bae640 1 --2- 172.21.15.120:0/2601112625 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f7a3c0a34d0 0x7f7a3c0a5990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7a440cd8d0 tx=0x7f7a440d3e00 comp rx=0 tx=0).stop 2024-09-19T05:20:45.452 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.445+0000 7f7a58bae640 1 -- 172.21.15.120:0/2601112625 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a5410a560 msgr2=0x7f7a5410fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:45.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.445+0000 7f7a58bae640 1 --2- 172.21.15.120:0/2601112625 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a5410a560 0x7f7a5410fd80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400e9c0 tx=0x7f7a4400ee80 comp rx=0 tx=0).stop 2024-09-19T05:20:45.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.445+0000 7f7a58bae640 1 -- 172.21.15.120:0/2601112625 shutdown_connections 2024-09-19T05:20:45.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.445+0000 7f7a58bae640 1 --2- 172.21.15.120:0/2601112625 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f7a3c0a34d0 0x7f7a3c0a5990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.445+0000 7f7a58bae640 1 --2- 172.21.15.120:0/2601112625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a541139e0 0x7f7a541acd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.445+0000 7f7a58bae640 1 --2- 172.21.15.120:0/2601112625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a5410ae80 0x7f7a541102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.445+0000 7f7a58bae640 1 --2- 172.21.15.120:0/2601112625 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7a5410a560 0x7f7a5410fd80 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:45.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.445+0000 7f7a58bae640 1 -- 172.21.15.120:0/2601112625 >> 172.21.15.120:0/2601112625 conn(0x7f7a5406e2d0 msgr2=0x7f7a54072eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:45.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.445+0000 7f7a58bae640 1 -- 172.21.15.120:0/2601112625 shutdown_connections 2024-09-19T05:20:45.453 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:45.445+0000 7f7a58bae640 1 -- 172.21.15.120:0/2601112625 wait complete. 2024-09-19T05:20:46.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.132+0000 7efe09d9b640 1 -- 172.21.15.120:0/2384773602 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe00031880 con 0x7efe0c101740 2024-09-19T05:20:46.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.133+0000 7efe11181640 1 -- 172.21.15.120:0/2384773602 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe0c101740 msgr2=0x7efe0c101b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:46.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.133+0000 7efe11181640 1 --2- 172.21.15.120:0/2384773602 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe0c101740 0x7efe0c101b80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7efe00009900 tx=0x7efe0002a410 comp rx=0 tx=0).stop 2024-09-19T05:20:46.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.133+0000 7efe11181640 1 -- 172.21.15.120:0/2384773602 shutdown_connections 2024-09-19T05:20:46.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.133+0000 7efe11181640 1 --2- 172.21.15.120:0/2384773602 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe0c1020c0 0x7efe0c10d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.133+0000 7efe11181640 1 --2- 172.21.15.120:0/2384773602 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe0c101740 0x7efe0c101b80 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.133+0000 7efe11181640 1 --2- 172.21.15.120:0/2384773602 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe0c106b70 0x7efe0c106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.133+0000 7efe11181640 1 -- 172.21.15.120:0/2384773602 >> 172.21.15.120:0/2384773602 conn(0x7efe0c075ef0 msgr2=0x7efe0c076300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:46.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.133+0000 7efe11181640 1 -- 172.21.15.120:0/2384773602 shutdown_connections 2024-09-19T05:20:46.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.133+0000 7efe11181640 1 -- 172.21.15.120:0/2384773602 wait complete. 2024-09-19T05:20:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.134+0000 7efe11181640 1 Processor -- start 2024-09-19T05:20:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.134+0000 7efe11181640 1 -- start start 2024-09-19T05:20:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.135+0000 7efe11181640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe0c101740 0x7efe0c1982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.135+0000 7efe11181640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe0c1020c0 0x7efe0c1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.135+0000 7efe11181640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe0c106b70 0x7efe0c19cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.135+0000 7efe11181640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c111ea0 con 0x7efe0c101740 2024-09-19T05:20:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.135+0000 7efe0ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe0c101740 0x7efe0c1982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.135+0000 7efe11181640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c111d20 con 0x7efe0c1020c0 2024-09-19T05:20:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.135+0000 7efe11181640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c112020 con 0x7efe0c106b70 2024-09-19T05:20:46.138 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.135+0000 7efe0ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe0c101740 0x7efe0c1982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49216/0 (socket says 172.21.15.120:49216) 2024-09-19T05:20:46.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.135+0000 7efe0ad9d640 1 -- 172.21.15.120:0/693520020 learned_addr learned my addr 172.21.15.120:0/693520020 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:46.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.135+0000 7efe0b59e640 1 --2- 172.21.15.120:0/693520020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe0c106b70 0x7efe0c19cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:46.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.135+0000 7efe0a59c640 1 --2- 172.21.15.120:0/693520020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe0c1020c0 0x7efe0c1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:46.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.135+0000 7efe0ad9d640 1 -- 172.21.15.120:0/693520020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe0c106b70 msgr2=0x7efe0c19cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:46.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.135+0000 7efe0ad9d640 1 --2- 172.21.15.120:0/693520020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe0c106b70 0x7efe0c19cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.135+0000 7efe0ad9d640 1 -- 172.21.15.120:0/693520020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe0c1020c0 msgr2=0x7efe0c1987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:46.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.135+0000 7efe0ad9d640 1 --2- 172.21.15.120:0/693520020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe0c1020c0 0x7efe0c1987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.135+0000 7efe0ad9d640 1 -- 172.21.15.120:0/693520020 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe0c19d2a0 con 0x7efe0c101740 2024-09-19T05:20:46.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.135+0000 7efe0b59e640 1 --2- 172.21.15.120:0/693520020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe0c106b70 0x7efe0c19cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:20:46.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.136+0000 7efe0ad9d640 1 --2- 172.21.15.120:0/693520020 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe0c101740 0x7efe0c1982b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00e9f0 tx=0x7efdfc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:46.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.136+0000 7efdf3fff640 1 -- 172.21.15.120:0/693520020 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdfc00cd80 con 0x7efe0c101740 2024-09-19T05:20:46.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.136+0000 7efdf3fff640 1 -- 172.21.15.120:0/693520020 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efdfc0108e0 con 0x7efe0c101740 2024-09-19T05:20:46.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.136+0000 7efe11181640 1 -- 172.21.15.120:0/693520020 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe0c19d590 con 0x7efe0c101740 2024-09-19T05:20:46.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.136+0000 7efdf3fff640 1 -- 172.21.15.120:0/693520020 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdfc018920 con 0x7efe0c101740 2024-09-19T05:20:46.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.136+0000 7efe11181640 1 -- 172.21.15.120:0/693520020 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe0c1a4e20 con 0x7efe0c101740 2024-09-19T05:20:46.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.139+0000 7efdf3fff640 1 -- 172.21.15.120:0/693520020 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 24) ==== 138589+0+0 (secure 0 0 0) 0x7efdfc010a90 con 0x7efe0c101740 2024-09-19T05:20:46.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.139+0000 7efe13ff3740 1 Processor -- start 2024-09-19T05:20:46.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.139+0000 7efe13ff3740 1 -- start start 2024-09-19T05:20:46.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.140+0000 7efe13ff3740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b346f62af0 0x55b346f62ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:46.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.140+0000 7efe13ff3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b346f63410 0x55b346f6d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:46.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.140+0000 7efe13ff3740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b346f6dcb0 0x55b346f700a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:46.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.140+0000 7efe13ff3740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b346ec72f0 con 0x55b346f62af0 2024-09-19T05:20:46.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.140+0000 7efe13ff3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55b346e6f270 con 0x55b346f63410 2024-09-19T05:20:46.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.140+0000 7efe13ff3740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55b346ec32b0 con 0x55b346f6dcb0 2024-09-19T05:20:46.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.140+0000 7efdf3fff640 1 --2- 172.21.15.120:0/693520020 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7efdf40a36e0 0x7efdf40a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:46.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.140+0000 7efe0ad9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b346f63410 0x55b346f6d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:46.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.140+0000 7efe0a59c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b346f6dcb0 0x55b346f700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:46.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.140+0000 7efe0b59e640 1 --2- 172.21.15.120:0/693520020 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7efdf40a36e0 0x7efdf40a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:46.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.140+0000 7efe0a59c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b346f6dcb0 0x55b346f700a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:45838/0 (socket says 172.21.15.120:45838) 2024-09-19T05:20:46.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.140+0000 7efe0a59c640 1 -- 172.21.15.120:0/3331227836 learned_addr learned my addr 172.21.15.120:0/3331227836 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:46.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.140+0000 7efe0b59e640 1 --2- 172.21.15.120:0/3331227836 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b346f62af0 0x55b346f62ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:46.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.140+0000 7efdf3fff640 1 -- 172.21.15.120:0/693520020 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7efdfc0d0320 con 0x7efe0c101740 2024-09-19T05:20:46.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.140+0000 7efe0ad9d640 1 -- 172.21.15.120:0/3331227836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b346f6dcb0 msgr2=0x55b346f700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:46.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.140+0000 7efe0ad9d640 1 --2- 172.21.15.120:0/3331227836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b346f6dcb0 0x55b346f700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.140+0000 7efe0ad9d640 1 -- 172.21.15.120:0/3331227836 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b346f62af0 msgr2=0x55b346f62ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:46.145 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.140+0000 7efe0ad9d640 1 --2- 172.21.15.120:0/3331227836 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b346f62af0 0x55b346f62ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.145 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.140+0000 7efe0ad9d640 1 -- 172.21.15.120:0/3331227836 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b346e6e340 con 0x55b346f63410 2024-09-19T05:20:46.145 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.140+0000 7efe0a59c640 1 --2- 172.21.15.120:0/3331227836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b346f6dcb0 0x55b346f700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:46.145 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.141+0000 7efe0b59e640 1 --2- 172.21.15.120:0/693520020 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7efdf40a36e0 0x7efdf40a5ba0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efe04005c40 tx=0x7efe04009e50 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:46.145 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.141+0000 7efe0ad9d640 1 --2- 172.21.15.120:0/3331227836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b346f63410 0x55b346f6d770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efdfc0cd840 tx=0x7efdfc06f270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bb6a9f13bc474dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:46.145 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.141+0000 7efdf17fa640 1 -- 172.21.15.120:0/3331227836 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdfc09c300 con 0x55b346f63410 2024-09-19T05:20:46.145 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.141+0000 7efdf17fa640 1 -- 172.21.15.120:0/3331227836 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efdfc0a06b0 con 0x55b346f63410 2024-09-19T05:20:46.145 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.141+0000 7efdf17fa640 1 -- 172.21.15.120:0/3331227836 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdfc09b750 con 0x55b346f63410 2024-09-19T05:20:46.153 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.142+0000 7efe13ff3740 1 -- 172.21.15.120:0/3331227836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b346f63410 msgr2=0x55b346f6d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:46.153 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.142+0000 7efe13ff3740 1 --2- 172.21.15.120:0/3331227836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b346f63410 0x55b346f6d770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efdfc0cd840 tx=0x7efdfc06f270 comp rx=0 tx=0).stop 2024-09-19T05:20:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.142+0000 7efe13ff3740 1 -- 172.21.15.120:0/3331227836 shutdown_connections 2024-09-19T05:20:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.142+0000 7efe13ff3740 1 --2- 172.21.15.120:0/3331227836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b346f6dcb0 0x55b346f700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.142+0000 7efe13ff3740 1 --2- 172.21.15.120:0/3331227836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b346f63410 0x55b346f6d770 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.142+0000 7efe13ff3740 1 --2- 172.21.15.120:0/3331227836 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b346f62af0 0x55b346f62ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.142+0000 7efe13ff3740 1 -- 172.21.15.120:0/3331227836 >> 172.21.15.120:0/3331227836 conn(0x55b346f5f060 msgr2=0x55b346f5f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.142+0000 7efe13ff3740 1 -- 172.21.15.120:0/3331227836 shutdown_connections 2024-09-19T05:20:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.142+0000 7efe13ff3740 1 -- 172.21.15.120:0/3331227836 wait complete. 2024-09-19T05:20:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.143+0000 7efe13ff3740 1 -- start start 2024-09-19T05:20:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.143+0000 7efe13ff3740 1 Processor -- start 2024-09-19T05:20:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.144+0000 7efe13ff3740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b346f62af0 0x55b346f6ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:46.154 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.144+0000 7efe13ff3740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b346f63410 0x55b346f6b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.144+0000 7efe13ff3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b346f6dcb0 0x55b346f6b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.144+0000 7efe13ff3740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b346f70880 con 0x55b346f63410 2024-09-19T05:20:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.144+0000 7efe13ff3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55b346e50290 con 0x55b346f6dcb0 2024-09-19T05:20:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.144+0000 7efe13ff3740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55b346f70a00 con 0x55b346f62af0 2024-09-19T05:20:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.144+0000 7efe13ff3740 10 client.0 _ll_register_callbacks cb 0x55b346e81140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.144+0000 7efe0b59e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b346f6dcb0 0x55b346f6b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.144+0000 7efe0a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b346f63410 0x55b346f6b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.144+0000 7efe0b59e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b346f6dcb0 0x55b346f6b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:43430/0 (socket says 172.21.15.120:43430) 2024-09-19T05:20:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.144+0000 7efe0b59e640 1 -- 172.21.15.120:0/3800595279 learned_addr learned my addr 172.21.15.120:0/3800595279 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.144+0000 7efe0ad9d640 1 --2- 172.21.15.120:0/3800595279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b346f62af0 0x55b346f6ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.145+0000 7efe0b59e640 1 -- 172.21.15.120:0/3800595279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b346f62af0 msgr2=0x55b346f6ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.145+0000 7efe0b59e640 1 --2- 172.21.15.120:0/3800595279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b346f62af0 0x55b346f6ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.155 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.145+0000 7efe0b59e640 1 -- 172.21.15.120:0/3800595279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b346f63410 msgr2=0x55b346f6b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:46.156 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.145+0000 7efe0b59e640 1 --2- 172.21.15.120:0/3800595279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b346f63410 0x55b346f6b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.156 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.145+0000 7efe0b59e640 1 -- 172.21.15.120:0/3800595279 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b346bda210 con 0x55b346f6dcb0 2024-09-19T05:20:46.156 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.145+0000 7efe0b59e640 1 --2- 172.21.15.120:0/3800595279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b346f6dcb0 0x55b346f6b6e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efe0401e660 tx=0x7efe0401c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b3a96d77a219707 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:46.156 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.145+0000 7efdeeff5640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:20:46.156 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.145+0000 7efdeeff5640 1 -- 172.21.15.120:0/3800595279 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0401d630 con 0x55b346f6dcb0 2024-09-19T05:20:46.156 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.145+0000 7efe13ff3740 1 -- 172.21.15.120:0/3800595279 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdfc0a06b0 con 0x55b346f6dcb0 2024-09-19T05:20:46.156 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.145+0000 7efdeeff5640 1 -- 172.21.15.120:0/3800595279 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7efe0401d7d0 con 0x55b346f6dcb0 2024-09-19T05:20:46.156 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.145+0000 7efdeeff5640 1 -- 172.21.15.120:0/3800595279 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efe0401d9d0 con 0x55b346f6dcb0 2024-09-19T05:20:46.156 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.145+0000 7efe13ff3740 10 client.25079 fetch_fsmap learned FSMap version 25 2024-09-19T05:20:46.156 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.145+0000 7efe13ff3740 1 -- 172.21.15.120:0/3800595279 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b346ca6620 con 0x55b346f6dcb0 2024-09-19T05:20:46.156 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.146+0000 7efdeeff5640 1 -- 172.21.15.120:0/3800595279 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efe0401db70 con 0x55b346f6dcb0 2024-09-19T05:20:46.156 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.146+0000 7efdeeff5640 1 -- 172.21.15.120:0/3800595279 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efe04028c10 con 0x55b346f6dcb0 2024-09-19T05:20:46.156 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.146+0000 7efe13ff3740 10 client.25079 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:20:46.157 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.146+0000 7efe13ff3740 10 client.25079 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:20:46.157 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.146+0000 7efe13ff3740 20 client.25079 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:46.157 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.146+0000 7efe13ff3740 1 --2- 172.21.15.120:0/3800595279 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55b346f7e0e0 0x55b346f80500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:46.157 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.146+0000 7efe13ff3740 4 client.25079 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:20:46.157 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.146+0000 7efe13ff3740 1 -- 172.21.15.120:0/3800595279 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7efdfc0a06b0 con 0x55b346f7e0e0 2024-09-19T05:20:46.157 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.146+0000 7efe0ad9d640 1 --2- 172.21.15.120:0/3800595279 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55b346f7e0e0 0x55b346f80500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:46.157 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.147+0000 7efe0ad9d640 1 --2- 172.21.15.120:0/3800595279 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55b346f7e0e0 0x55b346f80500 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1433df68627bf5c server_cookie=7f225f13569840ca in_seq=0 out_seq=0 2024-09-19T05:20:46.157 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.147+0000 7efdeeff5640 10 client.25079 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:46.157 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.148+0000 7efdeeff5640 1 -- 172.21.15.120:0/3800595279 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7efdfc0a06b0 con 0x55b346f7e0e0 2024-09-19T05:20:46.157 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.148+0000 7efdeeff5640 10 client.25079 handle_command_reply: tid=0 2024-09-19T05:20:46.157 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.148+0000 7efe13ff3740 1 client.25079 shutdown 2024-09-19T05:20:46.157 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.148+0000 7efe13ff3740 1 -- 172.21.15.120:0/3800595279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b346f6dcb0 msgr2=0x55b346f6b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:46.157 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.148+0000 7efe13ff3740 1 --2- 172.21.15.120:0/3800595279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b346f6dcb0 0x55b346f6b6e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efe0401e660 tx=0x7efe0401c000 comp rx=0 tx=0).stop 2024-09-19T05:20:46.158 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.148+0000 7efe13ff3740 1 -- 172.21.15.120:0/3800595279 shutdown_connections 2024-09-19T05:20:46.158 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.148+0000 7efe13ff3740 1 --2- 172.21.15.120:0/3800595279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b346f6dcb0 0x55b346f6b6e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.158 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.148+0000 7efe13ff3740 1 --2- 172.21.15.120:0/3800595279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b346f63410 0x55b346f6b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.158 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.148+0000 7efe13ff3740 1 --2- 172.21.15.120:0/3800595279 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55b346f7e0e0 0x55b346f80500 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.158 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.148+0000 7efe13ff3740 1 --2- 172.21.15.120:0/3800595279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b346f62af0 0x55b346f6ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.158 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.148+0000 7efdeeff5640 0 client.25079 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:46.158 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.148+0000 7efe13ff3740 1 -- 172.21.15.120:0/3800595279 >> 172.21.15.120:0/3800595279 conn(0x55b346f5f060 msgr2=0x55b346f64dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:46.158 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.148+0000 7efe13ff3740 1 -- 172.21.15.120:0/3800595279 shutdown_connections 2024-09-19T05:20:46.158 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.148+0000 7efe13ff3740 1 -- 172.21.15.120:0/3800595279 wait complete. 2024-09-19T05:20:46.158 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.149+0000 7efe13ff3740 20 client.25079 trim_cache size 0 max 16384 2024-09-19T05:20:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.171+0000 7efe13ff3740 1 Processor -- start 2024-09-19T05:20:46.174 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.171+0000 7efe13ff3740 1 -- start start 2024-09-19T05:20:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.171+0000 7efe13ff3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b346f62af0 0x55b346f6b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.171+0000 7efe13ff3740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b346f63410 0x55b346f85e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.172+0000 7efe13ff3740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b346f6dcb0 0x55b346f86350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.172+0000 7efe13ff3740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c1b00d0 con 0x55b346f63410 2024-09-19T05:20:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.172+0000 7efe0ad9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b346f62af0 0x55b346f6b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.172+0000 7efe13ff3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c1ad9a0 con 0x55b346f62af0 2024-09-19T05:20:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.172+0000 7efe13ff3740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c1ab7f0 con 0x55b346f6dcb0 2024-09-19T05:20:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.172+0000 7efe0ad9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b346f62af0 0x55b346f6b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:43446/0 (socket says 172.21.15.120:43446) 2024-09-19T05:20:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.172+0000 7efe0ad9d640 1 -- 172.21.15.120:0/2693918036 learned_addr learned my addr 172.21.15.120:0/2693918036 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.172+0000 7efe0b59e640 1 --2- 172.21.15.120:0/2693918036 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b346f6dcb0 0x55b346f86350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.172+0000 7efe0a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b346f63410 0x55b346f85e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.172+0000 7efe0b59e640 1 -- 172.21.15.120:0/2693918036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b346f62af0 msgr2=0x55b346f6b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:46.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.172+0000 7efe0b59e640 1 --2- 172.21.15.120:0/2693918036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b346f62af0 0x55b346f6b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.172+0000 7efe0b59e640 1 -- 172.21.15.120:0/2693918036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b346f63410 msgr2=0x55b346f85e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:46.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.172+0000 7efe0b59e640 1 --2- 172.21.15.120:0/2693918036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b346f63410 0x55b346f85e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.172+0000 7efe0b59e640 1 -- 172.21.15.120:0/2693918036 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b346f6ba50 con 0x55b346f6dcb0 2024-09-19T05:20:46.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.172+0000 7efe0a59c640 1 --2- 172.21.15.120:0/2693918036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b346f63410 0x55b346f85e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:46.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.173+0000 7efe0b59e640 1 --2- 172.21.15.120:0/2693918036 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b346f6dcb0 0x55b346f86350 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efe0402f4b0 tx=0x7efe04005f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62d20d530d8b009a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:46.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.173+0000 7efdf0ff9640 1 -- 172.21.15.120:0/2693918036 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0401ee30 con 0x55b346f6dcb0 2024-09-19T05:20:46.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.173+0000 7efdf0ff9640 1 -- 172.21.15.120:0/2693918036 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efe040129a0 con 0x55b346f6dcb0 2024-09-19T05:20:46.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.173+0000 7efdf0ff9640 1 -- 172.21.15.120:0/2693918036 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe04004ab0 con 0x55b346f6dcb0 2024-09-19T05:20:46.179 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.174+0000 7efe13ff3740 1 -- 172.21.15.120:0/2693918036 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b346f6dcb0 msgr2=0x55b346f86350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:46.179 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.174+0000 7efe13ff3740 1 --2- 172.21.15.120:0/2693918036 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b346f6dcb0 0x55b346f86350 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efe0402f4b0 tx=0x7efe04005f70 comp rx=0 tx=0).stop 2024-09-19T05:20:46.179 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.174+0000 7efe13ff3740 1 -- 172.21.15.120:0/2693918036 shutdown_connections 2024-09-19T05:20:46.179 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.174+0000 7efe13ff3740 1 --2- 172.21.15.120:0/2693918036 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b346f6dcb0 0x55b346f86350 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.174+0000 7efe13ff3740 1 --2- 172.21.15.120:0/2693918036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b346f63410 0x55b346f85e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.174+0000 7efe13ff3740 1 --2- 172.21.15.120:0/2693918036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b346f62af0 0x55b346f6b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.174+0000 7efe13ff3740 1 -- 172.21.15.120:0/2693918036 >> 172.21.15.120:0/2693918036 conn(0x55b346f5f060 msgr2=0x55b346f69510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:46.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.174+0000 7efe13ff3740 1 -- 172.21.15.120:0/2693918036 shutdown_connections 2024-09-19T05:20:46.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.174+0000 7efe13ff3740 1 -- 172.21.15.120:0/2693918036 wait complete. 2024-09-19T05:20:46.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.175+0000 7efe13ff3740 1 -- start start 2024-09-19T05:20:46.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.175+0000 7efe13ff3740 1 Processor -- start 2024-09-19T05:20:46.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.175+0000 7efe13ff3740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b346f62af0 0x55b346f761f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:46.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.175+0000 7efe13ff3740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b346f63410 0x55b346f71510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:46.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.175+0000 7efe13ff3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b346f6dcb0 0x55b346f71a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:46.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.175+0000 7efe13ff3740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c1abe60 con 0x55b346f62af0 2024-09-19T05:20:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.175+0000 7efe13ff3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c1ad2d0 con 0x55b346f6dcb0 2024-09-19T05:20:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.175+0000 7efe13ff3740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c1ac530 con 0x55b346f63410 2024-09-19T05:20:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.175+0000 7efe13ff3740 10 client.0 _ll_register_callbacks cb 0x7efe04010f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.176+0000 7efe0a59c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b346f63410 0x55b346f71510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.176+0000 7efe0a59c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b346f63410 0x55b346f71510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:45870/0 (socket says 172.21.15.120:45870) 2024-09-19T05:20:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.176+0000 7efe0a59c640 1 -- 172.21.15.120:0/482563820 learned_addr learned my addr 172.21.15.120:0/482563820 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.176+0000 7efe0ad9d640 1 --2- 172.21.15.120:0/482563820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b346f62af0 0x55b346f761f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.176+0000 7efe0b59e640 1 --2- 172.21.15.120:0/482563820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b346f6dcb0 0x55b346f71a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.176+0000 7efe0b59e640 1 -- 172.21.15.120:0/482563820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b346f63410 msgr2=0x55b346f71510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.176+0000 7efe0b59e640 1 --2- 172.21.15.120:0/482563820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b346f63410 0x55b346f71510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.176+0000 7efe0b59e640 1 -- 172.21.15.120:0/482563820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b346f62af0 msgr2=0x55b346f761f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.176+0000 7efe0b59e640 1 --2- 172.21.15.120:0/482563820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b346f62af0 0x55b346f761f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.176+0000 7efe0b59e640 1 -- 172.21.15.120:0/482563820 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b346f72090 con 0x55b346f6dcb0 2024-09-19T05:20:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.176+0000 7efe0b59e640 1 --2- 172.21.15.120:0/482563820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b346f6dcb0 0x55b346f71a50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efe0401e630 tx=0x7efe0402f8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=531977750d7ec2a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.176+0000 7efdeeff5640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:20:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.176+0000 7efdeeff5640 1 -- 172.21.15.120:0/482563820 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0402fd50 con 0x55b346f6dcb0 2024-09-19T05:20:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.176+0000 7efdeeff5640 1 -- 172.21.15.120:0/482563820 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7efe0401db70 con 0x55b346f6dcb0 2024-09-19T05:20:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.176+0000 7efe13ff3740 1 -- 172.21.15.120:0/482563820 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe040129a0 con 0x55b346f6dcb0 2024-09-19T05:20:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.177+0000 7efdeeff5640 1 -- 172.21.15.120:0/482563820 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efe0401ddb0 con 0x55b346f6dcb0 2024-09-19T05:20:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.177+0000 7efe13ff3740 10 client.25085 fetch_fsmap learned FSMap version 25 2024-09-19T05:20:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.177+0000 7efe13ff3740 1 -- 172.21.15.120:0/482563820 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b346fed010 con 0x55b346f6dcb0 2024-09-19T05:20:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.177+0000 7efdeeff5640 1 -- 172.21.15.120:0/482563820 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7efe040129a0 con 0x55b346f6dcb0 2024-09-19T05:20:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.177+0000 7efdeeff5640 1 -- 172.21.15.120:0/482563820 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efe04005450 con 0x55b346f6dcb0 2024-09-19T05:20:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.177+0000 7efe13ff3740 10 client.25085 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:20:46.183 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.177+0000 7efe13ff3740 10 client.25085 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:20:46.184 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.177+0000 7efe13ff3740 20 client.25085 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:46.184 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.177+0000 7efe13ff3740 1 --2- 172.21.15.120:0/482563820 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55b346fed630 0x55b346fefa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:46.184 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.177+0000 7efe13ff3740 4 client.25085 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:20:46.184 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.177+0000 7efe13ff3740 1 -- 172.21.15.120:0/482563820 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b346ed4a20 con 0x55b346fed630 2024-09-19T05:20:46.184 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.177+0000 7efe0ad9d640 1 --2- 172.21.15.120:0/482563820 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55b346fed630 0x55b346fefa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:46.184 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.178+0000 7efe0ad9d640 1 --2- 172.21.15.120:0/482563820 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55b346fed630 0x55b346fefa50 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b64d44e1bc985784 server_cookie=b4cf97c37eadafab in_seq=0 out_seq=0 2024-09-19T05:20:46.184 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.178+0000 7efdeeff5640 10 client.25085 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:46.189 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T05:20:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:46.411+0000 7efdf3fff640 1 -- 172.21.15.120:0/693520020 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7efdfc098970 con 0x7efe0c101740 2024-09-19T05:20:46.591 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:46.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:46 smithi178 ceph-mon[34347]: pgmap v49: 97 pgs: 97 active+clean; 28 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 2.3 MiB/s wr, 274 op/s 2024-09-19T05:20:46.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:46 smithi178 ceph-mon[34347]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-19T05:20:46.719 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:46 smithi120 ceph-mon[30956]: pgmap v49: 97 pgs: 97 active+clean; 28 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 2.3 MiB/s wr, 274 op/s 2024-09-19T05:20:46.719 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:46 smithi120 ceph-mon[30956]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-19T05:20:46.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:46 smithi194 ceph-mon[35228]: pgmap v49: 97 pgs: 97 active+clean; 28 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 2.3 MiB/s wr, 274 op/s 2024-09-19T05:20:46.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:46 smithi194 ceph-mon[35228]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-19T05:20:47.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.095+0000 7fb5270a0640 1 -- 172.21.15.120:0/1406792985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb520100a90 msgr2=0x7fb520100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:47.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.095+0000 7fb5270a0640 1 --2- 172.21.15.120:0/1406792985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb520100a90 0x7fb520100ef0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb50c009930 tx=0x7fb50c02a420 comp rx=0 tx=0).stop 2024-09-19T05:20:47.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.095+0000 7fb5270a0640 1 -- 172.21.15.120:0/1406792985 shutdown_connections 2024-09-19T05:20:47.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.095+0000 7fb5270a0640 1 --2- 172.21.15.120:0/1406792985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb520101430 0x7fb52010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.095+0000 7fb5270a0640 1 --2- 172.21.15.120:0/1406792985 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb520100a90 0x7fb520100ef0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.095+0000 7fb5270a0640 1 --2- 172.21.15.120:0/1406792985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb520106a90 0x7fb520106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.095+0000 7fb5270a0640 1 -- 172.21.15.120:0/1406792985 >> 172.21.15.120:0/1406792985 conn(0x7fb5200fc7d0 msgr2=0x7fb5200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:47.098 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.095+0000 7fb5270a0640 1 -- 172.21.15.120:0/1406792985 shutdown_connections 2024-09-19T05:20:47.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.095+0000 7fb5270a0640 1 -- 172.21.15.120:0/1406792985 wait complete. 2024-09-19T05:20:47.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.096+0000 7fb5270a0640 1 Processor -- start 2024-09-19T05:20:47.099 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.096+0000 7fb5270a0640 1 -- start start 2024-09-19T05:20:47.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.096+0000 7fb5270a0640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb520101430 0x7fb5201961b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:47.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.096+0000 7fb5270a0640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb520106a90 0x7fb5201966f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:47.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.096+0000 7fb5270a0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb520196c30 0x7fb5201aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:47.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.097+0000 7fb5270a0640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb52010fc90 con 0x7fb520196c30 2024-09-19T05:20:47.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.097+0000 7fb5270a0640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb52010fb10 con 0x7fb520101430 2024-09-19T05:20:47.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.097+0000 7fb5270a0640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb52010fe10 con 0x7fb520106a90 2024-09-19T05:20:47.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.097+0000 7fb51ffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb520106a90 0x7fb5201966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:47.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.097+0000 7fb524e3c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb520101430 0x7fb5201961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:47.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.097+0000 7fb51ffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb520106a90 0x7fb5201966f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:45874/0 (socket says 172.21.15.120:45874) 2024-09-19T05:20:47.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.097+0000 7fb524e3c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb520101430 0x7fb5201961b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:43470/0 (socket says 172.21.15.120:43470) 2024-09-19T05:20:47.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.097+0000 7fb51ffff640 1 -- 172.21.15.120:0/2917480474 learned_addr learned my addr 172.21.15.120:0/2917480474 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:47.101 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.097+0000 7fb52563d640 1 --2- 172.21.15.120:0/2917480474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb520196c30 0x7fb5201aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:47.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.097+0000 7fb524e3c640 1 -- 172.21.15.120:0/2917480474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb520106a90 msgr2=0x7fb5201966f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:47.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.097+0000 7fb524e3c640 1 --2- 172.21.15.120:0/2917480474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb520106a90 0x7fb5201966f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.097+0000 7fb524e3c640 1 -- 172.21.15.120:0/2917480474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb520196c30 msgr2=0x7fb5201aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:47.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.097+0000 7fb524e3c640 1 --2- 172.21.15.120:0/2917480474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb520196c30 0x7fb5201aad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.097+0000 7fb524e3c640 1 -- 172.21.15.120:0/2917480474 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5201ab290 con 0x7fb520101430 2024-09-19T05:20:47.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.097+0000 7fb524e3c640 1 --2- 172.21.15.120:0/2917480474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb520101430 0x7fb5201961b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb51400e9f0 tx=0x7fb51400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:47.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.097+0000 7fb51dffb640 1 -- 172.21.15.120:0/2917480474 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51400ccc0 con 0x7fb520101430 2024-09-19T05:20:47.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.098+0000 7fb5270a0640 1 -- 172.21.15.120:0/2917480474 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5201ab580 con 0x7fb520101430 2024-09-19T05:20:47.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.098+0000 7fb51dffb640 1 -- 172.21.15.120:0/2917480474 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb5140108e0 con 0x7fb520101430 2024-09-19T05:20:47.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.098+0000 7fb51dffb640 1 -- 172.21.15.120:0/2917480474 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb514018880 con 0x7fb520101430 2024-09-19T05:20:47.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.098+0000 7fb5270a0640 1 -- 172.21.15.120:0/2917480474 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5201aba90 con 0x7fb520101430 2024-09-19T05:20:47.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.101+0000 7fb51dffb640 1 -- 172.21.15.120:0/2917480474 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fb514010a90 con 0x7fb520101430 2024-09-19T05:20:47.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.101+0000 7fb529479740 1 Processor -- start 2024-09-19T05:20:47.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.101+0000 7fb529479740 1 -- start start 2024-09-19T05:20:47.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.102+0000 7fb529479740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556522b84b40 0x556522b83090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:47.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.102+0000 7fb529479740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b835d0 0x556522b83a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:47.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.102+0000 7fb529479740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556522b8e370 0x556522b90760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:47.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.102+0000 7fb529479740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556522ae92f0 con 0x556522b8e370 2024-09-19T05:20:47.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.102+0000 7fb529479740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x556522a90cf0 con 0x556522b84b40 2024-09-19T05:20:47.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.102+0000 7fb529479740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x556522ae52b0 con 0x556522b835d0 2024-09-19T05:20:47.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.102+0000 7fb51dffb640 1 --2- 172.21.15.120:0/2917480474 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fb5100a33f0 0x7fb5100a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:47.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.102+0000 7fb52563d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556522b84b40 0x556522b83090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:47.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.102+0000 7fb524e3c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b835d0 0x556522b83a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:47.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.102+0000 7fb52563d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556522b84b40 0x556522b83090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:43486/0 (socket says 172.21.15.120:43486) 2024-09-19T05:20:47.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.102+0000 7fb52563d640 1 -- 172.21.15.120:0/2600830322 learned_addr learned my addr 172.21.15.120:0/2600830322 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:47.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.102+0000 7fb51ffff640 1 --2- 172.21.15.120:0/2600830322 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556522b8e370 0x556522b90760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:47.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.102+0000 7fb52563d640 1 --2- 172.21.15.120:0/2917480474 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fb5100a33f0 0x7fb5100a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:47.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.102+0000 7fb51dffb640 1 -- 172.21.15.120:0/2917480474 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fb5140cffe0 con 0x7fb520101430 2024-09-19T05:20:47.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.102+0000 7fb524e3c640 1 -- 172.21.15.120:0/2600830322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556522b84b40 msgr2=0x556522b83090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:47.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.102+0000 7fb524e3c640 1 --2- 172.21.15.120:0/2600830322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556522b84b40 0x556522b83090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.102+0000 7fb524e3c640 1 -- 172.21.15.120:0/2600830322 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556522b8e370 msgr2=0x556522b90760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:47.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.102+0000 7fb524e3c640 1 --2- 172.21.15.120:0/2600830322 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556522b8e370 0x556522b90760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.102+0000 7fb524e3c640 1 -- 172.21.15.120:0/2600830322 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556522a753a0 con 0x556522b835d0 2024-09-19T05:20:47.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.103+0000 7fb524e3c640 1 --2- 172.21.15.120:0/2600830322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b835d0 0x556522b83a10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb5140cd6e0 tx=0x7fb51406bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23ea7e80e084fac8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:47.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.103+0000 7fb50affd640 1 -- 172.21.15.120:0/2600830322 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51409c320 con 0x556522b835d0 2024-09-19T05:20:47.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.103+0000 7fb50affd640 1 -- 172.21.15.120:0/2600830322 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb5140a0620 con 0x556522b835d0 2024-09-19T05:20:47.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.103+0000 7fb50affd640 1 -- 172.21.15.120:0/2600830322 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51409c580 con 0x556522b835d0 2024-09-19T05:20:47.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.104+0000 7fb529479740 1 -- 172.21.15.120:0/2600830322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b835d0 msgr2=0x556522b83a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:47.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.104+0000 7fb529479740 1 --2- 172.21.15.120:0/2600830322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b835d0 0x556522b83a10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb5140cd6e0 tx=0x7fb51406bf40 comp rx=0 tx=0).stop 2024-09-19T05:20:47.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.104+0000 7fb52563d640 1 --2- 172.21.15.120:0/2917480474 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fb5100a33f0 0x7fb5100a58b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb518005f40 tx=0x7fb518009500 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:47.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.104+0000 7fb529479740 1 -- 172.21.15.120:0/2600830322 shutdown_connections 2024-09-19T05:20:47.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.104+0000 7fb529479740 1 --2- 172.21.15.120:0/2600830322 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556522b8e370 0x556522b90760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.104+0000 7fb529479740 1 --2- 172.21.15.120:0/2600830322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b835d0 0x556522b83a10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.104+0000 7fb529479740 1 --2- 172.21.15.120:0/2600830322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556522b84b40 0x556522b83090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.104+0000 7fb529479740 1 -- 172.21.15.120:0/2600830322 >> 172.21.15.120:0/2600830322 conn(0x556522b4c310 msgr2=0x556522b7fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:47.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.104+0000 7fb529479740 1 -- 172.21.15.120:0/2600830322 shutdown_connections 2024-09-19T05:20:47.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.104+0000 7fb529479740 1 -- 172.21.15.120:0/2600830322 wait complete. 2024-09-19T05:20:47.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.104+0000 7fb529479740 1 -- start start 2024-09-19T05:20:47.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.104+0000 7fb529479740 1 Processor -- start 2024-09-19T05:20:47.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.105+0000 7fb529479740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b835d0 0x556522b8ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:47.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.105+0000 7fb529479740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556522b84b40 0x556522b8b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:47.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.105+0000 7fb529479740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556522b8e370 0x556522b8b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:47.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.105+0000 7fb529479740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556522b91060 con 0x556522b8e370 2024-09-19T05:20:47.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.105+0000 7fb529479740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x556522aa4060 con 0x556522b84b40 2024-09-19T05:20:47.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.105+0000 7fb529479740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x556522b911e0 con 0x556522b835d0 2024-09-19T05:20:47.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.105+0000 7fb529479740 10 client.0 _ll_register_callbacks cb 0x5565227f78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:47.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.105+0000 7fb524e3c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b835d0 0x556522b8ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:47.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.105+0000 7fb52563d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556522b8e370 0x556522b8b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:47.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.105+0000 7fb524e3c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b835d0 0x556522b8ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:45894/0 (socket says 172.21.15.120:45894) 2024-09-19T05:20:47.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.105+0000 7fb524e3c640 1 -- 172.21.15.120:0/1923694566 learned_addr learned my addr 172.21.15.120:0/1923694566 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:47.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.105+0000 7fb51ffff640 1 --2- 172.21.15.120:0/1923694566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556522b84b40 0x556522b8b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:47.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.105+0000 7fb524e3c640 1 -- 172.21.15.120:0/1923694566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556522b84b40 msgr2=0x556522b8b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:47.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.105+0000 7fb524e3c640 1 --2- 172.21.15.120:0/1923694566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556522b84b40 0x556522b8b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.105+0000 7fb524e3c640 1 -- 172.21.15.120:0/1923694566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556522b8e370 msgr2=0x556522b8b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:47.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.105+0000 7fb524e3c640 1 --2- 172.21.15.120:0/1923694566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556522b8e370 0x556522b8b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.105+0000 7fb524e3c640 1 -- 172.21.15.120:0/1923694566 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55652285a3c0 con 0x556522b835d0 2024-09-19T05:20:47.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.106+0000 7fb524e3c640 1 --2- 172.21.15.120:0/1923694566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b835d0 0x556522b8ddc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb514098cf0 tx=0x7fb514009700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67d35436a72fedff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:47.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.106+0000 7fb4fffff640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:20:47.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.106+0000 7fb4fffff640 1 -- 172.21.15.120:0/1923694566 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5140a4ee0 con 0x556522b835d0 2024-09-19T05:20:47.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.106+0000 7fb4fffff640 1 -- 172.21.15.120:0/1923694566 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fb51409c790 con 0x556522b835d0 2024-09-19T05:20:47.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.106+0000 7fb529479740 1 -- 172.21.15.120:0/1923694566 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5140a0620 con 0x556522b835d0 2024-09-19T05:20:47.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.106+0000 7fb4fffff640 1 -- 172.21.15.120:0/1923694566 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb51409c320 con 0x556522b835d0 2024-09-19T05:20:47.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.106+0000 7fb529479740 10 client.25162 fetch_fsmap learned FSMap version 25 2024-09-19T05:20:47.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.106+0000 7fb529479740 1 -- 172.21.15.120:0/1923694566 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556522b91060 con 0x556522b835d0 2024-09-19T05:20:47.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.106+0000 7fb4fffff640 1 -- 172.21.15.120:0/1923694566 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb5140a0620 con 0x556522b835d0 2024-09-19T05:20:47.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.106+0000 7fb4fffff640 1 -- 172.21.15.120:0/1923694566 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb5140bc0c0 con 0x556522b835d0 2024-09-19T05:20:47.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.107+0000 7fb529479740 10 client.25162 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:20:47.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.107+0000 7fb529479740 10 client.25162 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T05:20:47.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.107+0000 7fb529479740 20 client.25162 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:47.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.107+0000 7fb529479740 1 --2- 172.21.15.120:0/1923694566 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x556522b9dcf0 0x556522ba00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:47.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.107+0000 7fb529479740 4 client.25162 mds_command: new command op to 24443 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:20:47.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.107+0000 7fb529479740 1 -- 172.21.15.120:0/1923694566 --> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556522af6860 con 0x556522b9dcf0 2024-09-19T05:20:47.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.107+0000 7fb51ffff640 1 --2- 172.21.15.120:0/1923694566 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x556522b9dcf0 0x556522ba00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:47.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.107+0000 7fb4fffff640 10 client.25162 ms_handle_connect on v2:172.21.15.178:6838/3389137566 2024-09-19T05:20:47.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.107+0000 7fb51ffff640 1 --2- 172.21.15.120:0/1923694566 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x556522b9dcf0 0x556522ba00e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e8877158062a8c17 server_cookie=695b416ca6dd232d in_seq=0 out_seq=0 2024-09-19T05:20:47.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.108+0000 7fb4fffff640 1 -- 172.21.15.120:0/1923694566 <== mds.1 v2:172.21.15.178:6838/3389137566 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556522af6860 con 0x556522b9dcf0 2024-09-19T05:20:47.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.108+0000 7fb4fffff640 10 client.25162 handle_command_reply: tid=0 2024-09-19T05:20:47.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.108+0000 7fb529479740 1 client.25162 shutdown 2024-09-19T05:20:47.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.108+0000 7fb529479740 1 -- 172.21.15.120:0/1923694566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b835d0 msgr2=0x556522b8ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:47.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.108+0000 7fb529479740 1 --2- 172.21.15.120:0/1923694566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b835d0 0x556522b8ddc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb514098cf0 tx=0x7fb514009700 comp rx=0 tx=0).stop 2024-09-19T05:20:47.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.108+0000 7fb529479740 1 -- 172.21.15.120:0/1923694566 shutdown_connections 2024-09-19T05:20:47.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.108+0000 7fb529479740 1 --2- 172.21.15.120:0/1923694566 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556522b8e370 0x556522b8b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.108+0000 7fb529479740 1 --2- 172.21.15.120:0/1923694566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556522b84b40 0x556522b8b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.108+0000 7fb529479740 1 --2- 172.21.15.120:0/1923694566 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x556522b9dcf0 0x556522ba00e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.108+0000 7fb529479740 1 --2- 172.21.15.120:0/1923694566 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b835d0 0x556522b8ddc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.108+0000 7fb4fffff640 0 client.25162 ms_handle_reset on v2:172.21.15.178:6838/3389137566 2024-09-19T05:20:47.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.108+0000 7fb529479740 1 -- 172.21.15.120:0/1923694566 >> 172.21.15.120:0/1923694566 conn(0x556522b4c310 msgr2=0x556522b85960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:47.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.109+0000 7fb529479740 1 -- 172.21.15.120:0/1923694566 shutdown_connections 2024-09-19T05:20:47.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.109+0000 7fb529479740 1 -- 172.21.15.120:0/1923694566 wait complete. 2024-09-19T05:20:47.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.109+0000 7fb529479740 20 client.25162 trim_cache size 0 max 16384 2024-09-19T05:20:47.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.126+0000 7fb529479740 1 Processor -- start 2024-09-19T05:20:47.128 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.126+0000 7fb529479740 1 -- start start 2024-09-19T05:20:47.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.127+0000 7fb529479740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b835d0 0x556522b86120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:47.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.127+0000 7fb529479740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556522b84b40 0x556522b86660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:47.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.127+0000 7fb529479740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556522b8e370 0x556522ba5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:47.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.127+0000 7fb524e3c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b835d0 0x556522b86120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:47.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.127+0000 7fb524e3c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b835d0 0x556522b86120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:45900/0 (socket says 172.21.15.120:45900) 2024-09-19T05:20:47.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.127+0000 7fb52563d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556522b8e370 0x556522ba5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:47.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.127+0000 7fb52563d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556522b8e370 0x556522ba5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49308/0 (socket says 172.21.15.120:49308) 2024-09-19T05:20:47.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.127+0000 7fb51ffff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556522b84b40 0x556522b86660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:47.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.127+0000 7fb51ffff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556522b84b40 0x556522b86660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:43500/0 (socket says 172.21.15.120:43500) 2024-09-19T05:20:47.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.128+0000 7fb524e3c640 1 -- 172.21.15.120:0/2349090505 learned_addr learned my addr 172.21.15.120:0/2349090505 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:47.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.128+0000 7fb529479740 1 -- 172.21.15.120:0/2349090505 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb5201b6da0 con 0x556522b8e370 2024-09-19T05:20:47.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.128+0000 7fb529479740 1 -- 172.21.15.120:0/2349090505 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb5201b4670 con 0x556522b84b40 2024-09-19T05:20:47.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.128+0000 7fb529479740 1 -- 172.21.15.120:0/2349090505 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb5201b24c0 con 0x556522b835d0 2024-09-19T05:20:47.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.128+0000 7fb524e3c640 1 -- 172.21.15.120:0/2349090505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556522b84b40 msgr2=0x556522b86660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:47.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.128+0000 7fb524e3c640 1 --2- 172.21.15.120:0/2349090505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556522b84b40 0x556522b86660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.128+0000 7fb524e3c640 1 -- 172.21.15.120:0/2349090505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556522b8e370 msgr2=0x556522ba5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:47.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.128+0000 7fb524e3c640 1 --2- 172.21.15.120:0/2349090505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556522b8e370 0x556522ba5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.128+0000 7fb524e3c640 1 -- 172.21.15.120:0/2349090505 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556522b80960 con 0x556522b835d0 2024-09-19T05:20:47.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.128+0000 7fb51ffff640 1 --2- 172.21.15.120:0/2349090505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556522b84b40 0x556522b86660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:47.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.128+0000 7fb52563d640 1 --2- 172.21.15.120:0/2349090505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556522b8e370 0x556522ba5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:47.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.128+0000 7fb524e3c640 1 --2- 172.21.15.120:0/2349090505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b835d0 0x556522b86120 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb51409c2b0 tx=0x7fb514098990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ee42051aa7baf0b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:47.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.128+0000 7fb50a7fc640 1 -- 172.21.15.120:0/2349090505 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51409c0f0 con 0x556522b835d0 2024-09-19T05:20:47.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.129+0000 7fb50a7fc640 1 -- 172.21.15.120:0/2349090505 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb514010730 con 0x556522b835d0 2024-09-19T05:20:47.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.129+0000 7fb50a7fc640 1 -- 172.21.15.120:0/2349090505 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5140985c0 con 0x556522b835d0 2024-09-19T05:20:47.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.129+0000 7fb529479740 1 -- 172.21.15.120:0/2349090505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b835d0 msgr2=0x556522b86120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:47.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.129+0000 7fb529479740 1 --2- 172.21.15.120:0/2349090505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b835d0 0x556522b86120 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb51409c2b0 tx=0x7fb514098990 comp rx=0 tx=0).stop 2024-09-19T05:20:47.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.129+0000 7fb529479740 1 -- 172.21.15.120:0/2349090505 shutdown_connections 2024-09-19T05:20:47.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.129+0000 7fb529479740 1 --2- 172.21.15.120:0/2349090505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556522b8e370 0x556522ba5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.129+0000 7fb529479740 1 --2- 172.21.15.120:0/2349090505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556522b84b40 0x556522b86660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.129+0000 7fb529479740 1 --2- 172.21.15.120:0/2349090505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b835d0 0x556522b86120 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.129+0000 7fb529479740 1 -- 172.21.15.120:0/2349090505 >> 172.21.15.120:0/2349090505 conn(0x556522b4c310 msgr2=0x556522b8a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:47.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.129+0000 7fb529479740 1 -- 172.21.15.120:0/2349090505 shutdown_connections 2024-09-19T05:20:47.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.130+0000 7fb529479740 1 -- 172.21.15.120:0/2349090505 wait complete. 2024-09-19T05:20:47.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.130+0000 7fb529479740 1 -- start start 2024-09-19T05:20:47.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.130+0000 7fb529479740 1 Processor -- start 2024-09-19T05:20:47.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.130+0000 7fb529479740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556522b835d0 0x556522b96c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:47.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.130+0000 7fb529479740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b84b40 0x556522b87f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:47.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.130+0000 7fb529479740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556522b8e370 0x556522b884a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:47.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.130+0000 7fb529479740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb5201b2b30 con 0x556522b835d0 2024-09-19T05:20:47.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.130+0000 7fb529479740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb5201b3fa0 con 0x556522b8e370 2024-09-19T05:20:47.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.130+0000 7fb529479740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb5201b3200 con 0x556522b84b40 2024-09-19T05:20:47.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.131+0000 7fb529479740 10 client.0 _ll_register_callbacks cb 0x7fb514005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:47.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.131+0000 7fb51ffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b84b40 0x556522b87f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:47.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.131+0000 7fb52563d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556522b8e370 0x556522b884a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:47.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.131+0000 7fb51ffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b84b40 0x556522b87f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:45912/0 (socket says 172.21.15.120:45912) 2024-09-19T05:20:47.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.131+0000 7fb51ffff640 1 -- 172.21.15.120:0/825938686 learned_addr learned my addr 172.21.15.120:0/825938686 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:47.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.131+0000 7fb524e3c640 1 --2- 172.21.15.120:0/825938686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556522b835d0 0x556522b96c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:47.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.131+0000 7fb52563d640 1 -- 172.21.15.120:0/825938686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b84b40 msgr2=0x556522b87f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:47.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.131+0000 7fb52563d640 1 --2- 172.21.15.120:0/825938686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b84b40 0x556522b87f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.131+0000 7fb52563d640 1 -- 172.21.15.120:0/825938686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556522b835d0 msgr2=0x556522b96c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:47.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.131+0000 7fb52563d640 1 --2- 172.21.15.120:0/825938686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556522b835d0 0x556522b96c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.131+0000 7fb52563d640 1 -- 172.21.15.120:0/825938686 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556522b80dd0 con 0x556522b8e370 2024-09-19T05:20:47.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.131+0000 7fb52563d640 1 --2- 172.21.15.120:0/825938686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556522b8e370 0x556522b884a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb518009270 tx=0x7fb518004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32fb37f0ca3f3642 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:47.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.131+0000 7fb4fffff640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:20:47.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.132+0000 7fb4fffff640 1 -- 172.21.15.120:0/825938686 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb518004b20 con 0x556522b8e370 2024-09-19T05:20:47.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.132+0000 7fb4fffff640 1 -- 172.21.15.120:0/825938686 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fb518019050 con 0x556522b8e370 2024-09-19T05:20:47.138 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.132+0000 7fb529479740 1 -- 172.21.15.120:0/825938686 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb514010730 con 0x556522b8e370 2024-09-19T05:20:47.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.132+0000 7fb4fffff640 1 -- 172.21.15.120:0/825938686 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb518004cc0 con 0x556522b8e370 2024-09-19T05:20:47.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.132+0000 7fb529479740 10 client.25103 fetch_fsmap learned FSMap version 25 2024-09-19T05:20:47.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.132+0000 7fb529479740 1 -- 172.21.15.120:0/825938686 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556522c085d0 con 0x556522b8e370 2024-09-19T05:20:47.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.132+0000 7fb4fffff640 1 -- 172.21.15.120:0/825938686 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb514010730 con 0x556522b8e370 2024-09-19T05:20:47.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.132+0000 7fb4fffff640 1 -- 172.21.15.120:0/825938686 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb518031460 con 0x556522b8e370 2024-09-19T05:20:47.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.132+0000 7fb529479740 10 client.25103 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T05:20:47.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.132+0000 7fb529479740 10 client.25103 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T05:20:47.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.132+0000 7fb529479740 20 client.25103 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:47.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.132+0000 7fb529479740 1 --2- 172.21.15.120:0/825938686 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x556522c08d20 0x556522c0b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:47.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.132+0000 7fb529479740 4 client.25103 mds_command: new command op to 24443 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T05:20:47.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.132+0000 7fb529479740 1 -- 172.21.15.120:0/825938686 --> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556522af0d70 con 0x556522c08d20 2024-09-19T05:20:47.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.133+0000 7fb524e3c640 1 --2- 172.21.15.120:0/825938686 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x556522c08d20 0x556522c0b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:47.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.133+0000 7fb4fffff640 10 client.25103 ms_handle_connect on v2:172.21.15.178:6838/3389137566 2024-09-19T05:20:47.139 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.133+0000 7fb524e3c640 1 --2- 172.21.15.120:0/825938686 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x556522c08d20 0x556522c0b140 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ad331429b417cf58 server_cookie=1445aae70297f238 in_seq=0 out_seq=0 2024-09-19T05:20:47.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.133+0000 7fb4fffff640 1 -- 172.21.15.120:0/825938686 <== mds.1 v2:172.21.15.178:6838/3389137566 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556522af0d70 con 0x556522c08d20 2024-09-19T05:20:47.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.133+0000 7fb4fffff640 10 client.25103 handle_command_reply: tid=0 2024-09-19T05:20:47.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.133+0000 7fb529479740 1 client.25103 shutdown 2024-09-19T05:20:47.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.133+0000 7fb529479740 1 -- 172.21.15.120:0/825938686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556522b8e370 msgr2=0x556522b884a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:47.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.133+0000 7fb529479740 1 --2- 172.21.15.120:0/825938686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556522b8e370 0x556522b884a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb518009270 tx=0x7fb518004ab0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.134+0000 7fb529479740 1 -- 172.21.15.120:0/825938686 shutdown_connections 2024-09-19T05:20:47.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.134+0000 7fb529479740 1 --2- 172.21.15.120:0/825938686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556522b8e370 0x556522b884a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.134+0000 7fb529479740 1 --2- 172.21.15.120:0/825938686 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x556522c08d20 0x556522c0b140 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.134+0000 7fb529479740 1 --2- 172.21.15.120:0/825938686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556522b84b40 0x556522b87f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.134+0000 7fb529479740 1 --2- 172.21.15.120:0/825938686 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556522b835d0 0x556522b96c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.134+0000 7fb529479740 1 -- 172.21.15.120:0/825938686 >> 172.21.15.120:0/825938686 conn(0x556522b4c310 msgr2=0x556522b7e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:47.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.134+0000 7fb4fffff640 0 client.25103 ms_handle_reset on v2:172.21.15.178:6838/3389137566 2024-09-19T05:20:47.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.134+0000 7fb529479740 1 -- 172.21.15.120:0/825938686 shutdown_connections 2024-09-19T05:20:47.140 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.134+0000 7fb529479740 1 -- 172.21.15.120:0/825938686 wait complete. 2024-09-19T05:20:47.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.134+0000 7fb529479740 20 client.25103 trim_cache size 0 max 16384 2024-09-19T05:20:47.141 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-09-19T05:20:47.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.135+0000 7fb5270a0640 1 -- 172.21.15.120:0/2917480474 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fb5100a33f0 msgr2=0x7fb5100a58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:47.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.135+0000 7fb5270a0640 1 --2- 172.21.15.120:0/2917480474 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fb5100a33f0 0x7fb5100a58b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb518005f40 tx=0x7fb518009500 comp rx=0 tx=0).stop 2024-09-19T05:20:47.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.135+0000 7fb5270a0640 1 -- 172.21.15.120:0/2917480474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb520101430 msgr2=0x7fb5201961b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:47.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.135+0000 7fb5270a0640 1 --2- 172.21.15.120:0/2917480474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb520101430 0x7fb5201961b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb51400e9f0 tx=0x7fb51400eeb0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.135+0000 7fb5270a0640 1 -- 172.21.15.120:0/2917480474 shutdown_connections 2024-09-19T05:20:47.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.135+0000 7fb5270a0640 1 --2- 172.21.15.120:0/2917480474 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fb5100a33f0 0x7fb5100a58b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.135+0000 7fb5270a0640 1 --2- 172.21.15.120:0/2917480474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb520196c30 0x7fb5201aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.135+0000 7fb5270a0640 1 --2- 172.21.15.120:0/2917480474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb520106a90 0x7fb5201966f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.135+0000 7fb5270a0640 1 --2- 172.21.15.120:0/2917480474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb520101430 0x7fb5201961b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.135+0000 7fb5270a0640 1 -- 172.21.15.120:0/2917480474 >> 172.21.15.120:0/2917480474 conn(0x7fb5200fc7d0 msgr2=0x7fb5200fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:47.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.135+0000 7fb5270a0640 1 -- 172.21.15.120:0/2917480474 shutdown_connections 2024-09-19T05:20:47.142 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:47.135+0000 7fb5270a0640 1 -- 172.21.15.120:0/2917480474 wait complete. 2024-09-19T05:20:47.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.476+0000 7efdeeff5640 1 -- 172.21.15.120:0/482563820 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b346ed4a20 con 0x55b346fed630 2024-09-19T05:20:47.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.476+0000 7efdeeff5640 10 client.25085 handle_command_reply: tid=0 2024-09-19T05:20:47.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.477+0000 7efe13ff3740 1 client.25085 shutdown 2024-09-19T05:20:47.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.477+0000 7efe13ff3740 1 -- 172.21.15.120:0/482563820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b346f6dcb0 msgr2=0x55b346f71a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:47.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.477+0000 7efe13ff3740 1 --2- 172.21.15.120:0/482563820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b346f6dcb0 0x55b346f71a50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efe0401e630 tx=0x7efe0402f8d0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.477+0000 7efe13ff3740 1 -- 172.21.15.120:0/482563820 shutdown_connections 2024-09-19T05:20:47.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.477+0000 7efe13ff3740 1 --2- 172.21.15.120:0/482563820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b346f6dcb0 0x55b346f71a50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.477+0000 7efe13ff3740 1 --2- 172.21.15.120:0/482563820 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55b346fed630 0x55b346fefa50 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.477+0000 7efe13ff3740 1 --2- 172.21.15.120:0/482563820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b346f63410 0x55b346f71510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.477+0000 7efe13ff3740 1 --2- 172.21.15.120:0/482563820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b346f62af0 0x55b346f761f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.477+0000 7efe13ff3740 1 -- 172.21.15.120:0/482563820 >> 172.21.15.120:0/482563820 conn(0x55b346f5f060 msgr2=0x55b346f64550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:47.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.477+0000 7efdeeff5640 0 client.25085 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:47.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.477+0000 7efe13ff3740 1 -- 172.21.15.120:0/482563820 shutdown_connections 2024-09-19T05:20:47.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.477+0000 7efe13ff3740 1 -- 172.21.15.120:0/482563820 wait complete. 2024-09-19T05:20:47.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.477+0000 7efe13ff3740 20 client.25085 trim_cache size 0 max 16384 2024-09-19T05:20:47.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:20:47.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:20:47.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:20:47.483 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:20:47.483 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.478+0000 7efe11181640 1 -- 172.21.15.120:0/693520020 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7efdf40a36e0 msgr2=0x7efdf40a5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:47.483 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.478+0000 7efe11181640 1 --2- 172.21.15.120:0/693520020 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7efdf40a36e0 0x7efdf40a5ba0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efe04005c40 tx=0x7efe04009e50 comp rx=0 tx=0).stop 2024-09-19T05:20:47.483 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.478+0000 7efe11181640 1 -- 172.21.15.120:0/693520020 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe0c101740 msgr2=0x7efe0c1982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:47.484 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.478+0000 7efe11181640 1 --2- 172.21.15.120:0/693520020 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe0c101740 0x7efe0c1982b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00e9f0 tx=0x7efdfc00eeb0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.484 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.478+0000 7efe11181640 1 -- 172.21.15.120:0/693520020 shutdown_connections 2024-09-19T05:20:47.484 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.478+0000 7efe11181640 1 --2- 172.21.15.120:0/693520020 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7efdf40a36e0 0x7efdf40a5ba0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.484 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.478+0000 7efe11181640 1 --2- 172.21.15.120:0/693520020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe0c106b70 0x7efe0c19cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.484 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.478+0000 7efe11181640 1 --2- 172.21.15.120:0/693520020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe0c1020c0 0x7efe0c1987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.484 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.478+0000 7efe11181640 1 --2- 172.21.15.120:0/693520020 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe0c101740 0x7efe0c1982b0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:47.484 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.478+0000 7efe11181640 1 -- 172.21.15.120:0/693520020 >> 172.21.15.120:0/693520020 conn(0x7efe0c075ef0 msgr2=0x7efe0c0ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:47.484 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.478+0000 7efe11181640 1 -- 172.21.15.120:0/693520020 shutdown_connections 2024-09-19T05:20:47.484 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:20:47.478+0000 7efe11181640 1 -- 172.21.15.120:0/693520020 wait complete. 2024-09-19T05:20:47.970 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T05:20:48.313 INFO:tasks.workunit.client.0.smithi120.stdout: 6 13369 418 5071 257 4812 526 2024-09-19T05:20:48.323 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:48.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:48 smithi178 ceph-mon[34347]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:20:48.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:48 smithi178 ceph-mon[34347]: pgmap v50: 97 pgs: 97 active+clean; 28 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 2.0 MiB/s wr, 141 op/s 2024-09-19T05:20:48.765 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:48 smithi120 ceph-mon[30956]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:20:48.766 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:48 smithi120 ceph-mon[30956]: pgmap v50: 97 pgs: 97 active+clean; 28 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 2.0 MiB/s wr, 141 op/s 2024-09-19T05:20:48.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.877+0000 7fc92e341640 1 -- 172.21.15.120:0/458263137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc928102570 msgr2=0x7fc9281029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:48.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.877+0000 7fc92e341640 1 --2- 172.21.15.120:0/458263137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc928102570 0x7fc9281029b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc910009900 tx=0x7fc91002a480 comp rx=0 tx=0).stop 2024-09-19T05:20:48.883 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.877+0000 7fc92e341640 1 -- 172.21.15.120:0/458263137 shutdown_connections 2024-09-19T05:20:48.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.877+0000 7fc92e341640 1 --2- 172.21.15.120:0/458263137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc928102ef0 0x7fc92810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.877+0000 7fc92e341640 1 --2- 172.21.15.120:0/458263137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc928102570 0x7fc9281029b0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.877+0000 7fc92e341640 1 --2- 172.21.15.120:0/458263137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc928100e20 0x7fc928101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.877+0000 7fc92e341640 1 -- 172.21.15.120:0/458263137 >> 172.21.15.120:0/458263137 conn(0x7fc9280fc7d0 msgr2=0x7fc9280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:48.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.877+0000 7fc92e341640 1 -- 172.21.15.120:0/458263137 shutdown_connections 2024-09-19T05:20:48.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.877+0000 7fc92e341640 1 -- 172.21.15.120:0/458263137 wait complete. 2024-09-19T05:20:48.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.878+0000 7fc92e341640 1 Processor -- start 2024-09-19T05:20:48.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.878+0000 7fc92e341640 1 -- start start 2024-09-19T05:20:48.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.878+0000 7fc92e341640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc928100e20 0x7fc928197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:48.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.878+0000 7fc92e341640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc928102570 0x7fc928197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:48.884 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.878+0000 7fc92e341640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc928102ef0 0x7fc92819bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:48.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.878+0000 7fc92e341640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc928110e80 con 0x7fc928102ef0 2024-09-19T05:20:48.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.878+0000 7fc92e341640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc928110d00 con 0x7fc928100e20 2024-09-19T05:20:48.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.878+0000 7fc92e341640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc928111000 con 0x7fc928102570 2024-09-19T05:20:48.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.878+0000 7fc927fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc928100e20 0x7fc928197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:48.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.878+0000 7fc9277fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc928102570 0x7fc928197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:48.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.878+0000 7fc927fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc928100e20 0x7fc928197330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:43526/0 (socket says 172.21.15.120:43526) 2024-09-19T05:20:48.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.878+0000 7fc9277fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc928102570 0x7fc928197870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:45924/0 (socket says 172.21.15.120:45924) 2024-09-19T05:20:48.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.878+0000 7fc927fff640 1 -- 172.21.15.120:0/3096220359 learned_addr learned my addr 172.21.15.120:0/3096220359 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:48.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.878+0000 7fc92c8de640 1 --2- 172.21.15.120:0/3096220359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc928102ef0 0x7fc92819bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:48.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.879+0000 7fc9277fe640 1 -- 172.21.15.120:0/3096220359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc928100e20 msgr2=0x7fc928197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:48.885 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.879+0000 7fc9277fe640 1 --2- 172.21.15.120:0/3096220359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc928100e20 0x7fc928197330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.879+0000 7fc9277fe640 1 -- 172.21.15.120:0/3096220359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc928102ef0 msgr2=0x7fc92819bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:48.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.879+0000 7fc9277fe640 1 --2- 172.21.15.120:0/3096220359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc928102ef0 0x7fc92819bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.879+0000 7fc9277fe640 1 -- 172.21.15.120:0/3096220359 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92819c2e0 con 0x7fc928102570 2024-09-19T05:20:48.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.879+0000 7fc9277fe640 1 --2- 172.21.15.120:0/3096220359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc928102570 0x7fc928197870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc91002a9a0 tx=0x7fc910003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:48.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.879+0000 7fc9257fa640 1 -- 172.21.15.120:0/3096220359 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91003f070 con 0x7fc928102570 2024-09-19T05:20:48.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.879+0000 7fc92e341640 1 -- 172.21.15.120:0/3096220359 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc92819c570 con 0x7fc928102570 2024-09-19T05:20:48.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.879+0000 7fc9257fa640 1 -- 172.21.15.120:0/3096220359 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc91003bb10 con 0x7fc928102570 2024-09-19T05:20:48.886 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.879+0000 7fc9257fa640 1 -- 172.21.15.120:0/3096220359 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc910035030 con 0x7fc928102570 2024-09-19T05:20:48.887 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.879+0000 7fc92e341640 1 -- 172.21.15.120:0/3096220359 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc928069f70 con 0x7fc928102570 2024-09-19T05:20:48.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.882+0000 7fc93071a740 1 Processor -- start 2024-09-19T05:20:48.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.882+0000 7fc93071a740 1 -- start start 2024-09-19T05:20:48.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.883+0000 7fc93071a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f08957b40 0x556f08956090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:48.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.883+0000 7fc93071a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f089565d0 0x556f08956a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:48.890 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.883+0000 7fc93071a740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f08961370 0x556f08963760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:48.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.883+0000 7fc93071a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556f088bc2f0 con 0x556f089565d0 2024-09-19T05:20:48.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.883+0000 7fc93071a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x556f08863cf0 con 0x556f08957b40 2024-09-19T05:20:48.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.883+0000 7fc93071a740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x556f088b82b0 con 0x556f08961370 2024-09-19T05:20:48.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.883+0000 7fc92c8de640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f08957b40 0x556f08956090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:48.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.883+0000 7fc927fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f089565d0 0x556f08956a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:48.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.883+0000 7fc92c8de640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f08957b40 0x556f08956090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:43540/0 (socket says 172.21.15.120:43540) 2024-09-19T05:20:48.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.883+0000 7fc92c8de640 1 -- 172.21.15.120:0/1022816119 learned_addr learned my addr 172.21.15.120:0/1022816119 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:48.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.883+0000 7fc927fff640 1 -- 172.21.15.120:0/1022816119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f08961370 msgr2=0x556f08963760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T05:20:48.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.883+0000 7fc927fff640 1 --2- 172.21.15.120:0/1022816119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f08961370 0x556f08963760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.883+0000 7fc9257fa640 1 -- 172.21.15.120:0/3096220359 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fc910042070 con 0x7fc928102570 2024-09-19T05:20:48.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.883+0000 7fc927fff640 1 -- 172.21.15.120:0/1022816119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f08957b40 msgr2=0x556f08956090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:48.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.883+0000 7fc927fff640 1 --2- 172.21.15.120:0/1022816119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f08957b40 0x556f08956090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.891 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.883+0000 7fc927fff640 1 -- 172.21.15.120:0/1022816119 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f088483a0 con 0x556f089565d0 2024-09-19T05:20:48.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.883+0000 7fc92c8de640 1 --2- 172.21.15.120:0/1022816119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f08957b40 0x556f08956090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:48.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.884+0000 7fc927fff640 1 --2- 172.21.15.120:0/1022816119 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f089565d0 0x556f08956a10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc918009c80 tx=0x7fc918011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d33931db56ebb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:48.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.884+0000 7fc91e7fc640 1 -- 172.21.15.120:0/1022816119 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918004230 con 0x556f089565d0 2024-09-19T05:20:48.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.884+0000 7fc91e7fc640 1 -- 172.21.15.120:0/1022816119 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9180043d0 con 0x556f089565d0 2024-09-19T05:20:48.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.884+0000 7fc91e7fc640 1 -- 172.21.15.120:0/1022816119 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918004c70 con 0x556f089565d0 2024-09-19T05:20:48.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.884+0000 7fc9257fa640 1 --2- 172.21.15.120:0/3096220359 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fc9140a3430 0x7fc9140a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:48.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.885+0000 7fc92c8de640 1 --2- 172.21.15.120:0/3096220359 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fc9140a3430 0x7fc9140a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:48.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.885+0000 7fc9257fa640 1 -- 172.21.15.120:0/3096220359 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fc9100f0150 con 0x7fc928102570 2024-09-19T05:20:48.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.885+0000 7fc93071a740 1 -- 172.21.15.120:0/1022816119 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f089565d0 msgr2=0x556f08956a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:48.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.885+0000 7fc93071a740 1 --2- 172.21.15.120:0/1022816119 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f089565d0 0x556f08956a10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc918009c80 tx=0x7fc918011810 comp rx=0 tx=0).stop 2024-09-19T05:20:48.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.885+0000 7fc93071a740 1 -- 172.21.15.120:0/1022816119 shutdown_connections 2024-09-19T05:20:48.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.885+0000 7fc93071a740 1 --2- 172.21.15.120:0/1022816119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f08961370 0x556f08963760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.892 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.885+0000 7fc93071a740 1 --2- 172.21.15.120:0/1022816119 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f089565d0 0x556f08956a10 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.885+0000 7fc93071a740 1 --2- 172.21.15.120:0/1022816119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f08957b40 0x556f08956090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.885+0000 7fc93071a740 1 -- 172.21.15.120:0/1022816119 >> 172.21.15.120:0/1022816119 conn(0x556f0891f310 msgr2=0x556f08952c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:48.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.885+0000 7fc92c8de640 1 --2- 172.21.15.120:0/3096220359 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fc9140a3430 0x7fc9140a58f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc920012840 tx=0x7fc920009500 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:48.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.885+0000 7fc93071a740 1 -- 172.21.15.120:0/1022816119 shutdown_connections 2024-09-19T05:20:48.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.885+0000 7fc93071a740 1 -- 172.21.15.120:0/1022816119 wait complete. 2024-09-19T05:20:48.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.886+0000 7fc93071a740 1 -- start start 2024-09-19T05:20:48.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.886+0000 7fc93071a740 1 Processor -- start 2024-09-19T05:20:48.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.886+0000 7fc93071a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f089565d0 0x556f08960dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:48.893 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.886+0000 7fc93071a740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f08957b40 0x556f0895e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:48.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.886+0000 7fc927fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f089565d0 0x556f08960dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:48.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.886+0000 7fc927fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f089565d0 0x556f08960dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49344/0 (socket says 172.21.15.120:49344) 2024-09-19T05:20:48.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.886+0000 7fc927fff640 1 -- 172.21.15.120:0/2883685172 learned_addr learned my addr 172.21.15.120:0/2883685172 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:48.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.886+0000 7fc93071a740 1 --2- 172.21.15.120:0/2883685172 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f08961370 0x556f0895e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:48.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.886+0000 7fc93071a740 1 -- 172.21.15.120:0/2883685172 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556f08964070 con 0x556f089565d0 2024-09-19T05:20:48.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.886+0000 7fc93071a740 1 -- 172.21.15.120:0/2883685172 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x556f08877060 con 0x556f08961370 2024-09-19T05:20:48.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.886+0000 7fc93071a740 1 -- 172.21.15.120:0/2883685172 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x556f089641f0 con 0x556f08957b40 2024-09-19T05:20:48.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.887+0000 7fc93071a740 10 client.0 _ll_register_callbacks cb 0x556f085ca8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:48.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.887+0000 7fc9277fe640 1 --2- 172.21.15.120:0/2883685172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f08957b40 0x556f0895e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:48.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.887+0000 7fc927fff640 1 -- 172.21.15.120:0/2883685172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f08957b40 msgr2=0x556f0895e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:48.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.887+0000 7fc927fff640 1 --2- 172.21.15.120:0/2883685172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f08957b40 0x556f0895e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.887+0000 7fc927fff640 1 -- 172.21.15.120:0/2883685172 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f08961370 msgr2=0x556f0895e810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T05:20:48.894 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.887+0000 7fc927fff640 1 --2- 172.21.15.120:0/2883685172 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f08961370 0x556f0895e810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.887+0000 7fc927fff640 1 -- 172.21.15.120:0/2883685172 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f0862d3c0 con 0x556f089565d0 2024-09-19T05:20:48.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.887+0000 7fc9277fe640 1 --2- 172.21.15.120:0/2883685172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f08957b40 0x556f0895e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:20:48.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.887+0000 7fc927fff640 1 --2- 172.21.15.120:0/2883685172 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f089565d0 0x556f08960dd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc918019ba0 tx=0x7fc918019bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6473d5a851300 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:48.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.887+0000 7fc9077fe640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:20:48.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.887+0000 7fc9077fe640 1 -- 172.21.15.120:0/2883685172 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918028020 con 0x556f089565d0 2024-09-19T05:20:48.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.887+0000 7fc9077fe640 1 -- 172.21.15.120:0/2883685172 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fc918024620 con 0x556f089565d0 2024-09-19T05:20:48.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.887+0000 7fc93071a740 1 -- 172.21.15.120:0/2883685172 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9180043d0 con 0x556f089565d0 2024-09-19T05:20:48.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.888+0000 7fc9077fe640 1 -- 172.21.15.120:0/2883685172 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc9180046c0 con 0x556f089565d0 2024-09-19T05:20:48.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.888+0000 7fc93071a740 10 client.15639 fetch_fsmap learned FSMap version 26 2024-09-19T05:20:48.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.888+0000 7fc93071a740 1 -- 172.21.15.120:0/2883685172 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556f08978380 con 0x556f089565d0 2024-09-19T05:20:48.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.888+0000 7fc9077fe640 1 -- 172.21.15.120:0/2883685172 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9180043d0 con 0x556f089565d0 2024-09-19T05:20:48.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.888+0000 7fc9077fe640 1 -- 172.21.15.120:0/2883685172 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fc918018070 con 0x556f089565d0 2024-09-19T05:20:48.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.888+0000 7fc93071a740 10 client.15639 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T05:20:48.895 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.888+0000 7fc93071a740 10 client.15639 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:20:48.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.888+0000 7fc93071a740 20 client.15639 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:48.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.888+0000 7fc93071a740 1 --2- 172.21.15.120:0/2883685172 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556f08979a60 0x556f0897bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:48.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.888+0000 7fc93071a740 4 client.15639 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:20:48.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.888+0000 7fc93071a740 1 -- 172.21.15.120:0/2883685172 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f088c9860 con 0x556f08979a60 2024-09-19T05:20:48.896 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.889+0000 7fc9277fe640 1 --2- 172.21.15.120:0/2883685172 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556f08979a60 0x556f0897bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:48.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.889+0000 7fc9077fe640 10 client.15639 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:48.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.889+0000 7fc9277fe640 1 --2- 172.21.15.120:0/2883685172 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556f08979a60 0x556f0897bef0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=128134a7774b438d server_cookie=d62d58e01d99bcee in_seq=0 out_seq=0 2024-09-19T05:20:48.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.890+0000 7fc9077fe640 1 -- 172.21.15.120:0/2883685172 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556f088c9860 con 0x556f08979a60 2024-09-19T05:20:48.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.890+0000 7fc9077fe640 10 client.15639 handle_command_reply: tid=0 2024-09-19T05:20:48.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.891+0000 7fc93071a740 1 client.15639 shutdown 2024-09-19T05:20:48.897 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.891+0000 7fc93071a740 1 -- 172.21.15.120:0/2883685172 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f089565d0 msgr2=0x556f08960dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:48.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.891+0000 7fc93071a740 1 --2- 172.21.15.120:0/2883685172 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f089565d0 0x556f08960dd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc918019ba0 tx=0x7fc918019bd0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.891+0000 7fc93071a740 1 -- 172.21.15.120:0/2883685172 shutdown_connections 2024-09-19T05:20:48.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.891+0000 7fc93071a740 1 --2- 172.21.15.120:0/2883685172 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f08961370 0x556f0895e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.891+0000 7fc93071a740 1 --2- 172.21.15.120:0/2883685172 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556f08979a60 0x556f0897bef0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.891+0000 7fc93071a740 1 --2- 172.21.15.120:0/2883685172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f08957b40 0x556f0895e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.891+0000 7fc93071a740 1 --2- 172.21.15.120:0/2883685172 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f089565d0 0x556f08960dd0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.891+0000 7fc93071a740 1 -- 172.21.15.120:0/2883685172 >> 172.21.15.120:0/2883685172 conn(0x556f0891f310 msgr2=0x556f08958960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:48.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.891+0000 7fc9077fe640 0 client.15639 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:48.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.891+0000 7fc93071a740 1 -- 172.21.15.120:0/2883685172 shutdown_connections 2024-09-19T05:20:48.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.891+0000 7fc93071a740 1 -- 172.21.15.120:0/2883685172 wait complete. 2024-09-19T05:20:48.898 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.891+0000 7fc93071a740 20 client.15639 trim_cache size 0 max 16384 2024-09-19T05:20:48.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:48 smithi194 ceph-mon[35228]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:20:48.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:48 smithi194 ceph-mon[35228]: pgmap v50: 97 pgs: 97 active+clean; 28 MiB data, 504 MiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 2.0 MiB/s wr, 141 op/s 2024-09-19T05:20:48.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.907+0000 7fc93071a740 1 Processor -- start 2024-09-19T05:20:48.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.907+0000 7fc93071a740 1 -- start start 2024-09-19T05:20:48.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.908+0000 7fc93071a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f089565d0 0x556f08952700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:48.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.908+0000 7fc93071a740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f08957b40 0x556f08952c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:48.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.908+0000 7fc93071a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f08961370 0x556f0895b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:48.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.908+0000 7fc93071a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc9281adf80 con 0x556f08961370 2024-09-19T05:20:48.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.908+0000 7fc93071a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc9281ab850 con 0x556f089565d0 2024-09-19T05:20:48.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.908+0000 7fc93071a740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc9281a96a0 con 0x556f08957b40 2024-09-19T05:20:48.910 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.908+0000 7fc92c8de640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f08961370 0x556f0895b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:48.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.908+0000 7fc92c8de640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f08961370 0x556f0895b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49346/0 (socket says 172.21.15.120:49346) 2024-09-19T05:20:48.911 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.908+0000 7fc92c8de640 1 -- 172.21.15.120:0/448528926 learned_addr learned my addr 172.21.15.120:0/448528926 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:48.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.908+0000 7fc92c8de640 1 -- 172.21.15.120:0/448528926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f08957b40 msgr2=0x556f08952c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:48.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.908+0000 7fc92c8de640 1 --2- 172.21.15.120:0/448528926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f08957b40 0x556f08952c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.908+0000 7fc92c8de640 1 -- 172.21.15.120:0/448528926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f089565d0 msgr2=0x556f08952700 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T05:20:48.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.908+0000 7fc92c8de640 1 --2- 172.21.15.120:0/448528926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f089565d0 0x556f08952700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.908+0000 7fc92c8de640 1 -- 172.21.15.120:0/448528926 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f08953180 con 0x556f08961370 2024-09-19T05:20:48.912 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.909+0000 7fc92c8de640 1 --2- 172.21.15.120:0/448528926 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f08961370 0x556f0895b2e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc9200039a0 tx=0x7fc920017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1045889c4901e515 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:48.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.909+0000 7fc91dffb640 1 -- 172.21.15.120:0/448528926 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92000fe40 con 0x556f08961370 2024-09-19T05:20:48.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.909+0000 7fc91dffb640 1 -- 172.21.15.120:0/448528926 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc9200044f0 con 0x556f08961370 2024-09-19T05:20:48.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.909+0000 7fc91dffb640 1 -- 172.21.15.120:0/448528926 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92001fb10 con 0x556f08961370 2024-09-19T05:20:48.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.910+0000 7fc93071a740 1 -- 172.21.15.120:0/448528926 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f08961370 msgr2=0x556f0895b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:48.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.910+0000 7fc93071a740 1 --2- 172.21.15.120:0/448528926 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f08961370 0x556f0895b2e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc9200039a0 tx=0x7fc920017000 comp rx=0 tx=0).stop 2024-09-19T05:20:48.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.910+0000 7fc93071a740 1 -- 172.21.15.120:0/448528926 shutdown_connections 2024-09-19T05:20:48.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.910+0000 7fc93071a740 1 --2- 172.21.15.120:0/448528926 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f08961370 0x556f0895b2e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.910+0000 7fc93071a740 1 --2- 172.21.15.120:0/448528926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f08957b40 0x556f08952c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.913 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.910+0000 7fc93071a740 1 --2- 172.21.15.120:0/448528926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f089565d0 0x556f08952700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.910+0000 7fc93071a740 1 -- 172.21.15.120:0/448528926 >> 172.21.15.120:0/448528926 conn(0x556f0891f310 msgr2=0x556f0895c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:48.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.910+0000 7fc93071a740 1 -- 172.21.15.120:0/448528926 shutdown_connections 2024-09-19T05:20:48.914 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.910+0000 7fc93071a740 1 -- 172.21.15.120:0/448528926 wait complete. 2024-09-19T05:20:48.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.911+0000 7fc93071a740 1 -- start start 2024-09-19T05:20:48.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.911+0000 7fc93071a740 1 Processor -- start 2024-09-19T05:20:48.915 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.912+0000 7fc93071a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f089565d0 0x556f0897e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:48.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.912+0000 7fc927fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f089565d0 0x556f0897e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:48.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.912+0000 7fc927fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f089565d0 0x556f0897e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49356/0 (socket says 172.21.15.120:49356) 2024-09-19T05:20:48.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.912+0000 7fc927fff640 1 -- 172.21.15.120:0/761894915 learned_addr learned my addr 172.21.15.120:0/761894915 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:48.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.912+0000 7fc93071a740 1 --2- 172.21.15.120:0/761894915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f08957b40 0x556f0897e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:48.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.912+0000 7fc93071a740 1 --2- 172.21.15.120:0/761894915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f08961370 0x556f0897ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:48.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.912+0000 7fc93071a740 1 -- 172.21.15.120:0/761894915 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc9281a9d10 con 0x556f089565d0 2024-09-19T05:20:48.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.912+0000 7fc93071a740 1 -- 172.21.15.120:0/761894915 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc9281ab180 con 0x556f08957b40 2024-09-19T05:20:48.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.912+0000 7fc93071a740 1 -- 172.21.15.120:0/761894915 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc9281aa3e0 con 0x556f08961370 2024-09-19T05:20:48.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.912+0000 7fc92c8de640 1 --2- 172.21.15.120:0/761894915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f08961370 0x556f0897ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:48.916 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.912+0000 7fc9277fe640 1 --2- 172.21.15.120:0/761894915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f08957b40 0x556f0897e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:48.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.912+0000 7fc93071a740 10 client.0 _ll_register_callbacks cb 0x7fc920009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:48.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.912+0000 7fc927fff640 1 -- 172.21.15.120:0/761894915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f08961370 msgr2=0x556f0897ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:48.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.912+0000 7fc927fff640 1 --2- 172.21.15.120:0/761894915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f08961370 0x556f0897ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.912+0000 7fc927fff640 1 -- 172.21.15.120:0/761894915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f08957b40 msgr2=0x556f0897e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:48.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.912+0000 7fc927fff640 1 --2- 172.21.15.120:0/761894915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f08957b40 0x556f0897e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.913+0000 7fc927fff640 1 -- 172.21.15.120:0/761894915 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f089e2710 con 0x556f089565d0 2024-09-19T05:20:48.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.913+0000 7fc927fff640 1 --2- 172.21.15.120:0/761894915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f089565d0 0x556f0897e400 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc918001eb0 tx=0x7fc918005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0978aed57e9179b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:48.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.913+0000 7fc9077fe640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:20:48.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.913+0000 7fc93071a740 1 -- 172.21.15.120:0/761894915 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9200044f0 con 0x556f089565d0 2024-09-19T05:20:48.917 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.913+0000 7fc9077fe640 1 -- 172.21.15.120:0/761894915 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918028040 con 0x556f089565d0 2024-09-19T05:20:48.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.913+0000 7fc9077fe640 1 -- 172.21.15.120:0/761894915 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fc91802c880 con 0x556f089565d0 2024-09-19T05:20:48.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.913+0000 7fc9077fe640 1 -- 172.21.15.120:0/761894915 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc918019770 con 0x556f089565d0 2024-09-19T05:20:48.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.913+0000 7fc93071a740 10 client.15645 fetch_fsmap learned FSMap version 26 2024-09-19T05:20:48.918 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.913+0000 7fc93071a740 1 -- 172.21.15.120:0/761894915 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({fsmap=26}) -- 0x556f089e37c0 con 0x556f089565d0 2024-09-19T05:20:48.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.914+0000 7fc9077fe640 1 -- 172.21.15.120:0/761894915 <== mon.0 v2:172.21.15.120:3300/0 4 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fc918018070 con 0x556f089565d0 2024-09-19T05:20:48.919 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.914+0000 7fc93071a740 10 client.15645 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T05:20:48.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.914+0000 7fc93071a740 10 client.15645 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:20:48.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.914+0000 7fc93071a740 20 client.15645 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:48.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.914+0000 7fc93071a740 1 --2- 172.21.15.120:0/761894915 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556f089e3e00 0x556f089e6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:48.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.914+0000 7fc93071a740 4 client.15645 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T05:20:48.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.914+0000 7fc93071a740 1 -- 172.21.15.120:0/761894915 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fc9200044f0 con 0x556f089e3e00 2024-09-19T05:20:48.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.914+0000 7fc9277fe640 1 --2- 172.21.15.120:0/761894915 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556f089e3e00 0x556f089e6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:48.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.915+0000 7fc9277fe640 1 --2- 172.21.15.120:0/761894915 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556f089e3e00 0x556f089e6220 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3de412a9197ae448 server_cookie=91b28ed27cb56157 in_seq=0 out_seq=0 2024-09-19T05:20:48.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.915+0000 7fc9077fe640 10 client.15645 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:48.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.915+0000 7fc9077fe640 1 -- 172.21.15.120:0/761894915 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fc9200044f0 con 0x556f089e3e00 2024-09-19T05:20:48.920 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.915+0000 7fc9077fe640 10 client.15645 handle_command_reply: tid=0 2024-09-19T05:20:48.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.915+0000 7fc93071a740 1 client.15645 shutdown 2024-09-19T05:20:48.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.915+0000 7fc93071a740 1 -- 172.21.15.120:0/761894915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f089565d0 msgr2=0x556f0897e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:48.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.915+0000 7fc93071a740 1 --2- 172.21.15.120:0/761894915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f089565d0 0x556f0897e400 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc918001eb0 tx=0x7fc918005f10 comp rx=0 tx=0).stop 2024-09-19T05:20:48.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.915+0000 7fc93071a740 1 -- 172.21.15.120:0/761894915 shutdown_connections 2024-09-19T05:20:48.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.915+0000 7fc93071a740 1 --2- 172.21.15.120:0/761894915 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556f089e3e00 0x556f089e6220 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.915+0000 7fc93071a740 1 --2- 172.21.15.120:0/761894915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556f08961370 0x556f0897ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.915+0000 7fc93071a740 1 --2- 172.21.15.120:0/761894915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f08957b40 0x556f0897e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.915+0000 7fc93071a740 1 --2- 172.21.15.120:0/761894915 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556f089565d0 0x556f0897e400 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.915+0000 7fc93071a740 1 -- 172.21.15.120:0/761894915 >> 172.21.15.120:0/761894915 conn(0x556f0891f310 msgr2=0x556f0895c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:48.921 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.915+0000 7fc9077fe640 0 client.15645 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:48.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.915+0000 7fc93071a740 1 -- 172.21.15.120:0/761894915 shutdown_connections 2024-09-19T05:20:48.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.916+0000 7fc93071a740 1 -- 172.21.15.120:0/761894915 wait complete. 2024-09-19T05:20:48.922 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.916+0000 7fc93071a740 20 client.15645 trim_cache size 0 max 16384 2024-09-19T05:20:48.922 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-09-19T05:20:48.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.916+0000 7fc92e341640 1 -- 172.21.15.120:0/3096220359 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fc9140a3430 msgr2=0x7fc9140a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:48.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.916+0000 7fc92e341640 1 --2- 172.21.15.120:0/3096220359 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fc9140a3430 0x7fc9140a58f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc920012840 tx=0x7fc920009500 comp rx=0 tx=0).stop 2024-09-19T05:20:48.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.916+0000 7fc92e341640 1 -- 172.21.15.120:0/3096220359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc928102570 msgr2=0x7fc928197870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:48.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.916+0000 7fc92e341640 1 --2- 172.21.15.120:0/3096220359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc928102570 0x7fc928197870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc91002a9a0 tx=0x7fc910003b90 comp rx=0 tx=0).stop 2024-09-19T05:20:48.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.917+0000 7fc92e341640 1 -- 172.21.15.120:0/3096220359 shutdown_connections 2024-09-19T05:20:48.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.917+0000 7fc92e341640 1 --2- 172.21.15.120:0/3096220359 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fc9140a3430 0x7fc9140a58f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.917+0000 7fc92e341640 1 --2- 172.21.15.120:0/3096220359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc928102ef0 0x7fc92819bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.923 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.917+0000 7fc92e341640 1 --2- 172.21.15.120:0/3096220359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc928102570 0x7fc928197870 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.917+0000 7fc92e341640 1 --2- 172.21.15.120:0/3096220359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc928100e20 0x7fc928197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:48.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.917+0000 7fc92e341640 1 -- 172.21.15.120:0/3096220359 >> 172.21.15.120:0/3096220359 conn(0x7fc9280fc7d0 msgr2=0x7fc9280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:48.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.917+0000 7fc92e341640 1 -- 172.21.15.120:0/3096220359 shutdown_connections 2024-09-19T05:20:48.924 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:48.917+0000 7fc92e341640 1 -- 172.21.15.120:0/3096220359 wait complete. 2024-09-19T05:20:50.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:50 smithi178 ceph-mon[34347]: pgmap v51: 97 pgs: 97 active+clean; 29 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 2.9 MiB/s wr, 371 op/s 2024-09-19T05:20:50.760 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T05:20:50.760 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T05:20:50.787 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:50 smithi120 ceph-mon[30956]: pgmap v51: 97 pgs: 97 active+clean; 29 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 2.9 MiB/s wr, 371 op/s 2024-09-19T05:20:50.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:50 smithi194 ceph-mon[35228]: pgmap v51: 97 pgs: 97 active+clean; 29 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 2.9 MiB/s wr, 371 op/s 2024-09-19T05:20:51.110 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:51.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.746+0000 7f3ba0368640 1 -- 172.21.15.120:0/3667147040 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b981037a0 msgr2=0x7f3b9810bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:51.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.746+0000 7f3ba0368640 1 --2- 172.21.15.120:0/3667147040 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b981037a0 0x7f3b9810bc00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3b8800fb10 tx=0x7f3b8802e570 comp rx=0 tx=0).stop 2024-09-19T05:20:51.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.746+0000 7f3ba0368640 1 -- 172.21.15.120:0/3667147040 shutdown_connections 2024-09-19T05:20:51.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.746+0000 7f3ba0368640 1 --2- 172.21.15.120:0/3667147040 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b9810c2f0 0x7f3b9810e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.748 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.746+0000 7f3ba0368640 1 --2- 172.21.15.120:0/3667147040 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b981037a0 0x7f3b9810bc00 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.746+0000 7f3ba0368640 1 --2- 172.21.15.120:0/3667147040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b98102df0 0x7f3b981031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.746+0000 7f3ba0368640 1 -- 172.21.15.120:0/3667147040 >> 172.21.15.120:0/3667147040 conn(0x7f3b980fc7d0 msgr2=0x7f3b980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:51.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.746+0000 7f3ba0368640 1 -- 172.21.15.120:0/3667147040 shutdown_connections 2024-09-19T05:20:51.749 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.746+0000 7f3ba0368640 1 -- 172.21.15.120:0/3667147040 wait complete. 2024-09-19T05:20:51.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.747+0000 7f3ba0368640 1 Processor -- start 2024-09-19T05:20:51.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.747+0000 7f3ba0368640 1 -- start start 2024-09-19T05:20:51.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.747+0000 7f3ba0368640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b98102df0 0x7f3b98196320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:51.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.747+0000 7f3ba0368640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b981037a0 0x7f3b98196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:51.750 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.747+0000 7f3ba0368640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b9810c2f0 0x7f3b9819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:51.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.748+0000 7f3ba0368640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9810fdb0 con 0x7f3b981037a0 2024-09-19T05:20:51.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.748+0000 7f3ba0368640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9810fc30 con 0x7f3b98102df0 2024-09-19T05:20:51.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.748+0000 7f3ba0368640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3b9810ff30 con 0x7f3b9810c2f0 2024-09-19T05:20:51.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.748+0000 7f3b9d903640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b981037a0 0x7f3b98196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:51.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.748+0000 7f3b9d903640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b981037a0 0x7f3b98196860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49372/0 (socket says 172.21.15.120:49372) 2024-09-19T05:20:51.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.748+0000 7f3b9d903640 1 -- 172.21.15.120:0/2924191055 learned_addr learned my addr 172.21.15.120:0/2924191055 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:51.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.748+0000 7f3b9e905640 1 --2- 172.21.15.120:0/2924191055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b9810c2f0 0x7f3b9819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:51.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.748+0000 7f3b9e104640 1 --2- 172.21.15.120:0/2924191055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b98102df0 0x7f3b98196320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:51.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.748+0000 7f3b9e905640 1 -- 172.21.15.120:0/2924191055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b98102df0 msgr2=0x7f3b98196320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:51.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.748+0000 7f3b9e905640 1 --2- 172.21.15.120:0/2924191055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b98102df0 0x7f3b98196320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.748+0000 7f3b9e905640 1 -- 172.21.15.120:0/2924191055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b981037a0 msgr2=0x7f3b98196860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:51.751 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.748+0000 7f3b9e905640 1 --2- 172.21.15.120:0/2924191055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b981037a0 0x7f3b98196860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.748+0000 7f3b9e905640 1 -- 172.21.15.120:0/2924191055 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b9819b2d0 con 0x7f3b9810c2f0 2024-09-19T05:20:51.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.748+0000 7f3b9d903640 1 --2- 172.21.15.120:0/2924191055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b981037a0 0x7f3b98196860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:51.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.748+0000 7f3b9e905640 1 --2- 172.21.15.120:0/2924191055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b9810c2f0 0x7f3b9819abf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3b90009fd0 tx=0x7f3b9000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:51.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.749+0000 7f3b8f7fe640 1 -- 172.21.15.120:0/2924191055 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9000ce20 con 0x7f3b9810c2f0 2024-09-19T05:20:51.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.749+0000 7f3b8f7fe640 1 -- 172.21.15.120:0/2924191055 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3b90005020 con 0x7f3b9810c2f0 2024-09-19T05:20:51.752 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.749+0000 7f3ba0368640 1 -- 172.21.15.120:0/2924191055 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b9819b5c0 con 0x7f3b9810c2f0 2024-09-19T05:20:51.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.749+0000 7f3ba0368640 1 -- 172.21.15.120:0/2924191055 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b981a2ea0 con 0x7f3b9810c2f0 2024-09-19T05:20:51.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.749+0000 7f3b8f7fe640 1 -- 172.21.15.120:0/2924191055 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b90010690 con 0x7f3b9810c2f0 2024-09-19T05:20:51.753 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.751+0000 7f3b8f7fe640 1 -- 172.21.15.120:0/2924191055 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f3b90004a40 con 0x7f3b9810c2f0 2024-09-19T05:20:51.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.752+0000 7f3b8f7fe640 1 --2- 172.21.15.120:0/2924191055 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f3b840a3430 0x7f3b840a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:51.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.752+0000 7f3b9e104640 1 --2- 172.21.15.120:0/2924191055 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f3b840a3430 0x7f3b840a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:51.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.752+0000 7f3ba2741740 1 Processor -- start 2024-09-19T05:20:51.754 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.752+0000 7f3b8f7fe640 1 -- 172.21.15.120:0/2924191055 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f3b900d0120 con 0x7f3b9810c2f0 2024-09-19T05:20:51.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.753+0000 7f3ba2741740 1 -- start start 2024-09-19T05:20:51.755 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.753+0000 7f3ba2741740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555a2b7d5b60 0x555a2b7d5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:51.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.753+0000 7f3ba2741740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a2b7d6480 0x555a2b7e0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:51.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.753+0000 7f3ba2741740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2b7e0d40 0x555a2b7e3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:51.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.753+0000 7f3ba2741740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x555a2b73b280 con 0x555a2b7d5b60 2024-09-19T05:20:51.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.753+0000 7f3ba2741740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x555a2b6e2b10 con 0x555a2b7d6480 2024-09-19T05:20:51.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.753+0000 7f3ba2741740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x555a2b737240 con 0x555a2b7e0d40 2024-09-19T05:20:51.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.753+0000 7f3b9e104640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555a2b7d5b60 0x555a2b7d5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:51.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.753+0000 7f3b9e905640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2b7e0d40 0x555a2b7e3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:51.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.753+0000 7f3b9d903640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a2b7d6480 0x555a2b7e0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:51.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.753+0000 7f3b9e104640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555a2b7d5b60 0x555a2b7d5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49376/0 (socket says 172.21.15.120:49376) 2024-09-19T05:20:51.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.753+0000 7f3b9e104640 1 -- 172.21.15.120:0/3351694874 learned_addr learned my addr 172.21.15.120:0/3351694874 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:51.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.753+0000 7f3b9e905640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2b7e0d40 0x555a2b7e3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:45968/0 (socket says 172.21.15.120:45968) 2024-09-19T05:20:51.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.753+0000 7f3b9e104640 1 --2- 172.21.15.120:0/2924191055 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f3b840a3430 0x7f3b840a58f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3b94009bd0 tx=0x7f3b94005f90 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:51.756 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.754+0000 7f3b9e905640 1 -- 172.21.15.120:0/3351694874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a2b7d6480 msgr2=0x555a2b7e0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:51.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.754+0000 7f3b9e905640 1 --2- 172.21.15.120:0/3351694874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a2b7d6480 0x555a2b7e0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.754+0000 7f3b9e905640 1 -- 172.21.15.120:0/3351694874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555a2b7d5b60 msgr2=0x555a2b7d5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:51.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.754+0000 7f3b9e905640 1 --2- 172.21.15.120:0/3351694874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555a2b7d5b60 0x555a2b7d5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.754+0000 7f3b9e905640 1 -- 172.21.15.120:0/3351694874 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a2b6ef1f0 con 0x555a2b7e0d40 2024-09-19T05:20:51.757 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.754+0000 7f3b9e905640 1 --2- 172.21.15.120:0/3351694874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2b7e0d40 0x555a2b7e3130 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3b900cd8c0 tx=0x7f3b9009cca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36f02694c52b286 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:51.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.754+0000 7f3b8cdea640 1 -- 172.21.15.120:0/3351694874 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b900b4020 con 0x555a2b7e0d40 2024-09-19T05:20:51.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.754+0000 7f3b8cdea640 1 -- 172.21.15.120:0/3351694874 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3b90004d30 con 0x555a2b7e0d40 2024-09-19T05:20:51.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.754+0000 7f3b8cdea640 1 -- 172.21.15.120:0/3351694874 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b900b5260 con 0x555a2b7e0d40 2024-09-19T05:20:51.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.755+0000 7f3ba2741740 1 -- 172.21.15.120:0/3351694874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2b7e0d40 msgr2=0x555a2b7e3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:51.758 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.755+0000 7f3ba2741740 1 --2- 172.21.15.120:0/3351694874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2b7e0d40 0x555a2b7e3130 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3b900cd8c0 tx=0x7f3b9009cca0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.755+0000 7f3ba2741740 1 -- 172.21.15.120:0/3351694874 shutdown_connections 2024-09-19T05:20:51.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.755+0000 7f3ba2741740 1 --2- 172.21.15.120:0/3351694874 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2b7e0d40 0x555a2b7e3130 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.755+0000 7f3ba2741740 1 --2- 172.21.15.120:0/3351694874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a2b7d6480 0x555a2b7e0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.755+0000 7f3ba2741740 1 --2- 172.21.15.120:0/3351694874 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555a2b7d5b60 0x555a2b7d5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.755+0000 7f3ba2741740 1 -- 172.21.15.120:0/3351694874 >> 172.21.15.120:0/3351694874 conn(0x555a2b7d20f0 msgr2=0x555a2b7d24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:51.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.755+0000 7f3ba2741740 1 -- 172.21.15.120:0/3351694874 shutdown_connections 2024-09-19T05:20:51.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.756+0000 7f3ba2741740 1 -- 172.21.15.120:0/3351694874 wait complete. 2024-09-19T05:20:51.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.756+0000 7f3ba2741740 1 -- start start 2024-09-19T05:20:51.759 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.756+0000 7f3ba2741740 1 Processor -- start 2024-09-19T05:20:51.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.757+0000 7f3ba2741740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2b7d5b60 0x555a2b7ddc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:51.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.757+0000 7f3ba2741740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a2b7d6480 0x555a2b7de140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:51.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.757+0000 7f3ba2741740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555a2b7e0d40 0x555a2b7de680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:51.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.757+0000 7f3ba2741740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x555a2b7e3910 con 0x555a2b7e0d40 2024-09-19T05:20:51.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.757+0000 7f3ba2741740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x555a2b6f5f10 con 0x555a2b7d6480 2024-09-19T05:20:51.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.757+0000 7f3ba2741740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x555a2b7e3a90 con 0x555a2b7d5b60 2024-09-19T05:20:51.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.757+0000 7f3b9e905640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555a2b7e0d40 0x555a2b7de680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:51.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.757+0000 7f3b9e905640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555a2b7e0d40 0x555a2b7de680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49382/0 (socket says 172.21.15.120:49382) 2024-09-19T05:20:51.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.757+0000 7f3b9e905640 1 -- 172.21.15.120:0/4035066033 learned_addr learned my addr 172.21.15.120:0/4035066033 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:51.762 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.757+0000 7f3ba2741740 10 client.0 _ll_register_callbacks cb 0x555a2b6bea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:51.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.757+0000 7f3b9d903640 1 --2- 172.21.15.120:0/4035066033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a2b7d6480 0x555a2b7de140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:51.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.757+0000 7f3b9e104640 1 --2- 172.21.15.120:0/4035066033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2b7d5b60 0x555a2b7ddc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:51.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.758+0000 7f3b9e905640 1 -- 172.21.15.120:0/4035066033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2b7d5b60 msgr2=0x555a2b7ddc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:51.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.758+0000 7f3b9e905640 1 --2- 172.21.15.120:0/4035066033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2b7d5b60 0x555a2b7ddc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.758+0000 7f3b9e905640 1 -- 172.21.15.120:0/4035066033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a2b7d6480 msgr2=0x555a2b7de140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:51.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.758+0000 7f3b9e905640 1 --2- 172.21.15.120:0/4035066033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a2b7d6480 0x555a2b7de140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.758+0000 7f3b9e905640 1 -- 172.21.15.120:0/4035066033 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a2b4ac6a0 con 0x555a2b7e0d40 2024-09-19T05:20:51.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.758+0000 7f3b9e104640 1 --2- 172.21.15.120:0/4035066033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2b7d5b60 0x555a2b7ddc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:51.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.758+0000 7f3b9e905640 1 --2- 172.21.15.120:0/4035066033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555a2b7e0d40 0x555a2b7de680 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3b900988b0 tx=0x7f3b90005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db8fa513f907033 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:51.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.758+0000 7f3b81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:20:51.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.758+0000 7f3b81ffb640 1 -- 172.21.15.120:0/4035066033 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b900b9070 con 0x555a2b7e0d40 2024-09-19T05:20:51.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.758+0000 7f3b81ffb640 1 -- 172.21.15.120:0/4035066033 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f3b900a4c30 con 0x555a2b7e0d40 2024-09-19T05:20:51.763 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.758+0000 7f3ba2741740 1 -- 172.21.15.120:0/4035066033 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b90004d30 con 0x555a2b7e0d40 2024-09-19T05:20:51.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.758+0000 7f3b81ffb640 1 -- 172.21.15.120:0/4035066033 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3b900b4030 con 0x555a2b7e0d40 2024-09-19T05:20:51.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.758+0000 7f3ba2741740 10 client.15657 fetch_fsmap learned FSMap version 26 2024-09-19T05:20:51.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.758+0000 7f3ba2741740 1 -- 172.21.15.120:0/4035066033 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555a2b7ef500 con 0x555a2b7e0d40 2024-09-19T05:20:51.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.759+0000 7f3b81ffb640 1 -- 172.21.15.120:0/4035066033 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3b90004d30 con 0x555a2b7e0d40 2024-09-19T05:20:51.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.759+0000 7f3b81ffb640 1 -- 172.21.15.120:0/4035066033 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f3b900983a0 con 0x555a2b7e0d40 2024-09-19T05:20:51.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.759+0000 7f3ba2741740 10 client.15657 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T05:20:51.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.759+0000 7f3ba2741740 10 client.15657 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:20:51.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.759+0000 7f3ba2741740 20 client.15657 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:51.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.759+0000 7f3ba2741740 1 --2- 172.21.15.120:0/4035066033 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x555a2b7f0850 0x555a2b7f2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:51.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.759+0000 7f3ba2741740 4 client.15657 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:20:51.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.759+0000 7f3ba2741740 1 -- 172.21.15.120:0/4035066033 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a2b7487f0 con 0x555a2b7f0850 2024-09-19T05:20:51.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.759+0000 7f3b9e104640 1 --2- 172.21.15.120:0/4035066033 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x555a2b7f0850 0x555a2b7f2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:51.764 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.760+0000 7f3b81ffb640 10 client.15657 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:51.765 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.760+0000 7f3b9e104640 1 --2- 172.21.15.120:0/4035066033 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x555a2b7f0850 0x555a2b7f2c40 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b31ec33884e5796 server_cookie=1d5cf5c90ea58885 in_seq=0 out_seq=0 2024-09-19T05:20:51.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.761+0000 7f3b81ffb640 1 -- 172.21.15.120:0/4035066033 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555a2b7487f0 con 0x555a2b7f0850 2024-09-19T05:20:51.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.761+0000 7f3b81ffb640 10 client.15657 handle_command_reply: tid=0 2024-09-19T05:20:51.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.761+0000 7f3ba2741740 1 client.15657 shutdown 2024-09-19T05:20:51.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.761+0000 7f3ba2741740 1 -- 172.21.15.120:0/4035066033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555a2b7e0d40 msgr2=0x555a2b7de680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:51.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.761+0000 7f3ba2741740 1 --2- 172.21.15.120:0/4035066033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555a2b7e0d40 0x555a2b7de680 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3b900988b0 tx=0x7f3b90005f70 comp rx=0 tx=0).stop 2024-09-19T05:20:51.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.761+0000 7f3ba2741740 1 -- 172.21.15.120:0/4035066033 shutdown_connections 2024-09-19T05:20:51.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.761+0000 7f3ba2741740 1 --2- 172.21.15.120:0/4035066033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555a2b7e0d40 0x555a2b7de680 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.761+0000 7f3ba2741740 1 --2- 172.21.15.120:0/4035066033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a2b7d6480 0x555a2b7de140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.761+0000 7f3ba2741740 1 --2- 172.21.15.120:0/4035066033 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x555a2b7f0850 0x555a2b7f2c40 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.766 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.761+0000 7f3ba2741740 1 --2- 172.21.15.120:0/4035066033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2b7d5b60 0x555a2b7ddc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.761+0000 7f3ba2741740 1 -- 172.21.15.120:0/4035066033 >> 172.21.15.120:0/4035066033 conn(0x555a2b7d20f0 msgr2=0x555a2b7d7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:51.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.761+0000 7f3b81ffb640 0 client.15657 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:51.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.762+0000 7f3ba2741740 1 -- 172.21.15.120:0/4035066033 shutdown_connections 2024-09-19T05:20:51.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.762+0000 7f3ba2741740 1 -- 172.21.15.120:0/4035066033 wait complete. 2024-09-19T05:20:51.767 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.762+0000 7f3ba2741740 20 client.15657 trim_cache size 0 max 16384 2024-09-19T05:20:51.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.783+0000 7f3ba2741740 1 Processor -- start 2024-09-19T05:20:51.784 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.783+0000 7f3ba2741740 1 -- start start 2024-09-19T05:20:51.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.783+0000 7f3ba2741740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a2b7d5b60 0x555a2b7f8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:51.785 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.783+0000 7f3ba2741740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555a2b7d6480 0x555a2b7f8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:51.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.783+0000 7f3ba2741740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2b7e0d40 0x555a2b7d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:51.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.783+0000 7f3ba2741740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c011160 con 0x555a2b7d6480 2024-09-19T05:20:51.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.783+0000 7f3ba2741740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c00ea30 con 0x555a2b7d5b60 2024-09-19T05:20:51.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.783+0000 7f3ba2741740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c00c880 con 0x555a2b7e0d40 2024-09-19T05:20:51.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.783+0000 7f3b9d903640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555a2b7d6480 0x555a2b7f8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:51.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.783+0000 7f3b9d903640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555a2b7d6480 0x555a2b7f8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49386/0 (socket says 172.21.15.120:49386) 2024-09-19T05:20:51.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.783+0000 7f3b9d903640 1 -- 172.21.15.120:0/4076690614 learned_addr learned my addr 172.21.15.120:0/4076690614 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:51.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.783+0000 7f3b9e905640 1 --2- 172.21.15.120:0/4076690614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2b7e0d40 0x555a2b7d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:51.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.783+0000 7f3b9e104640 1 --2- 172.21.15.120:0/4076690614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a2b7d5b60 0x555a2b7f8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:51.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.783+0000 7f3b9e104640 1 -- 172.21.15.120:0/4076690614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2b7e0d40 msgr2=0x555a2b7d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:51.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.783+0000 7f3b9e104640 1 --2- 172.21.15.120:0/4076690614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2b7e0d40 0x555a2b7d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.783+0000 7f3b9e104640 1 -- 172.21.15.120:0/4076690614 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555a2b7d6480 msgr2=0x555a2b7f8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:51.786 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.783+0000 7f3b9e104640 1 --2- 172.21.15.120:0/4076690614 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555a2b7d6480 0x555a2b7f8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.783+0000 7f3b9e104640 1 -- 172.21.15.120:0/4076690614 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a2b7f2fb0 con 0x555a2b7d5b60 2024-09-19T05:20:51.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.784+0000 7f3b9e104640 1 --2- 172.21.15.120:0/4076690614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a2b7d5b60 0x555a2b7f8240 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x555a2b7f3180 tx=0x7f3b94013040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cae32f64e6efc2cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:51.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.784+0000 7f3b83fff640 1 -- 172.21.15.120:0/4076690614 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b94032610 con 0x555a2b7d5b60 2024-09-19T05:20:51.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.784+0000 7f3b83fff640 1 -- 172.21.15.120:0/4076690614 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3b9401d8c0 con 0x555a2b7d5b60 2024-09-19T05:20:51.787 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.784+0000 7f3b83fff640 1 -- 172.21.15.120:0/4076690614 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b940297e0 con 0x555a2b7d5b60 2024-09-19T05:20:51.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.785+0000 7f3ba2741740 1 -- 172.21.15.120:0/4076690614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a2b7d5b60 msgr2=0x555a2b7f8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:51.789 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.785+0000 7f3ba2741740 1 --2- 172.21.15.120:0/4076690614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a2b7d5b60 0x555a2b7f8240 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x555a2b7f3180 tx=0x7f3b94013040 comp rx=0 tx=0).stop 2024-09-19T05:20:51.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.785+0000 7f3ba2741740 1 -- 172.21.15.120:0/4076690614 shutdown_connections 2024-09-19T05:20:51.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.785+0000 7f3ba2741740 1 --2- 172.21.15.120:0/4076690614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2b7e0d40 0x555a2b7d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.785+0000 7f3ba2741740 1 --2- 172.21.15.120:0/4076690614 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555a2b7d6480 0x555a2b7f8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.785+0000 7f3ba2741740 1 --2- 172.21.15.120:0/4076690614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a2b7d5b60 0x555a2b7f8240 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.785+0000 7f3ba2741740 1 -- 172.21.15.120:0/4076690614 >> 172.21.15.120:0/4076690614 conn(0x555a2b7d20f0 msgr2=0x555a2b7dccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:51.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.785+0000 7f3ba2741740 1 -- 172.21.15.120:0/4076690614 shutdown_connections 2024-09-19T05:20:51.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.785+0000 7f3ba2741740 1 -- 172.21.15.120:0/4076690614 wait complete. 2024-09-19T05:20:51.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.786+0000 7f3ba2741740 1 -- start start 2024-09-19T05:20:51.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.786+0000 7f3ba2741740 1 Processor -- start 2024-09-19T05:20:51.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.786+0000 7f3ba2741740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2b7d5b60 0x555a2b7dab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:51.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.786+0000 7f3ba2741740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a2b7d6480 0x555a2b7db080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:51.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.786+0000 7f3ba2741740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555a2b7e0d40 0x555a2b7db5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:51.790 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.786+0000 7f3ba2741740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c00cef0 con 0x555a2b7e0d40 2024-09-19T05:20:51.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.786+0000 7f3ba2741740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c00e360 con 0x555a2b7d6480 2024-09-19T05:20:51.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.786+0000 7f3ba2741740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c00d5c0 con 0x555a2b7d5b60 2024-09-19T05:20:51.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.786+0000 7f3ba2741740 10 client.0 _ll_register_callbacks cb 0x7f3b940099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:51.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.786+0000 7f3b9e104640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2b7d5b60 0x555a2b7dab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:51.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.786+0000 7f3b9e905640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555a2b7e0d40 0x555a2b7db5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:51.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.786+0000 7f3b9e104640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2b7d5b60 0x555a2b7dab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:45998/0 (socket says 172.21.15.120:45998) 2024-09-19T05:20:51.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.786+0000 7f3b9e104640 1 -- 172.21.15.120:0/1318816683 learned_addr learned my addr 172.21.15.120:0/1318816683 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:51.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.786+0000 7f3b9e905640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555a2b7e0d40 0x555a2b7db5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49396/0 (socket says 172.21.15.120:49396) 2024-09-19T05:20:51.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.787+0000 7f3b9d903640 1 --2- 172.21.15.120:0/1318816683 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a2b7d6480 0x555a2b7db080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:51.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.787+0000 7f3b9e104640 1 -- 172.21.15.120:0/1318816683 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a2b7d6480 msgr2=0x555a2b7db080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:51.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.787+0000 7f3b9e104640 1 --2- 172.21.15.120:0/1318816683 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a2b7d6480 0x555a2b7db080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.787+0000 7f3b9e104640 1 -- 172.21.15.120:0/1318816683 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555a2b7e0d40 msgr2=0x555a2b7db5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:51.791 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.787+0000 7f3b9e104640 1 --2- 172.21.15.120:0/1318816683 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555a2b7e0d40 0x555a2b7db5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.787+0000 7f3b9e104640 1 -- 172.21.15.120:0/1318816683 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a2b862a20 con 0x555a2b7d5b60 2024-09-19T05:20:51.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.787+0000 7f3b9d903640 1 --2- 172.21.15.120:0/1318816683 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a2b7d6480 0x555a2b7db080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:20:51.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.787+0000 7f3b9e104640 1 --2- 172.21.15.120:0/1318816683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2b7d5b60 0x555a2b7dab40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3b9401d830 tx=0x7f3b9400ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58c5de9aea1d0b76 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:51.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.787+0000 7f3b81ffb640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:20:51.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.787+0000 7f3b81ffb640 1 -- 172.21.15.120:0/1318816683 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b94040060 con 0x555a2b7d5b60 2024-09-19T05:20:51.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.787+0000 7f3b81ffb640 1 -- 172.21.15.120:0/1318816683 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f3b94037040 con 0x555a2b7d5b60 2024-09-19T05:20:51.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.787+0000 7f3ba2741740 1 -- 172.21.15.120:0/1318816683 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b9401d8c0 con 0x555a2b7d5b60 2024-09-19T05:20:51.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.787+0000 7f3b81ffb640 1 -- 172.21.15.120:0/1318816683 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3b9401de00 con 0x555a2b7d5b60 2024-09-19T05:20:51.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.787+0000 7f3ba2741740 10 client.25195 fetch_fsmap learned FSMap version 26 2024-09-19T05:20:51.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.788+0000 7f3ba2741740 1 -- 172.21.15.120:0/1318816683 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555a2b863c60 con 0x555a2b7d5b60 2024-09-19T05:20:51.792 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.788+0000 7f3b81ffb640 1 -- 172.21.15.120:0/1318816683 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f3b94048070 con 0x555a2b7d5b60 2024-09-19T05:20:51.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.788+0000 7f3b81ffb640 1 -- 172.21.15.120:0/1318816683 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f3b94032410 con 0x555a2b7d5b60 2024-09-19T05:20:51.793 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.788+0000 7f3ba2741740 10 client.25195 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T05:20:51.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.788+0000 7f3ba2741740 10 client.25195 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:20:51.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.788+0000 7f3ba2741740 20 client.25195 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:51.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.788+0000 7f3ba2741740 1 --2- 172.21.15.120:0/1318816683 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x555a2b8642d0 0x555a2b8666f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:51.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.788+0000 7f3ba2741740 4 client.25195 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T05:20:51.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.788+0000 7f3ba2741740 1 -- 172.21.15.120:0/1318816683 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555a2b742d00 con 0x555a2b8642d0 2024-09-19T05:20:51.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.788+0000 7f3b9d903640 1 --2- 172.21.15.120:0/1318816683 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x555a2b8642d0 0x555a2b8666f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:51.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.789+0000 7f3b9d903640 1 --2- 172.21.15.120:0/1318816683 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x555a2b8642d0 0x555a2b8666f0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97379a00a9e36df2 server_cookie=6285eb1c8207390b in_seq=0 out_seq=0 2024-09-19T05:20:51.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.789+0000 7f3b81ffb640 10 client.25195 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:51.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.790+0000 7f3b81ffb640 1 -- 172.21.15.120:0/1318816683 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555a2b742d00 con 0x555a2b8642d0 2024-09-19T05:20:51.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.790+0000 7f3b81ffb640 10 client.25195 handle_command_reply: tid=0 2024-09-19T05:20:51.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.790+0000 7f3ba2741740 1 client.25195 shutdown 2024-09-19T05:20:51.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.790+0000 7f3ba2741740 1 -- 172.21.15.120:0/1318816683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2b7d5b60 msgr2=0x555a2b7dab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:51.794 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.790+0000 7f3ba2741740 1 --2- 172.21.15.120:0/1318816683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2b7d5b60 0x555a2b7dab40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3b9401d830 tx=0x7f3b9400ef60 comp rx=0 tx=0).stop 2024-09-19T05:20:51.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.790+0000 7f3ba2741740 1 -- 172.21.15.120:0/1318816683 shutdown_connections 2024-09-19T05:20:51.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.790+0000 7f3ba2741740 1 --2- 172.21.15.120:0/1318816683 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x555a2b7e0d40 0x555a2b7db5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.790+0000 7f3ba2741740 1 --2- 172.21.15.120:0/1318816683 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555a2b7d6480 0x555a2b7db080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.790+0000 7f3ba2741740 1 --2- 172.21.15.120:0/1318816683 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x555a2b8642d0 0x555a2b8666f0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.790+0000 7f3ba2741740 1 --2- 172.21.15.120:0/1318816683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2b7d5b60 0x555a2b7dab40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.790+0000 7f3ba2741740 1 -- 172.21.15.120:0/1318816683 >> 172.21.15.120:0/1318816683 conn(0x555a2b7d20f0 msgr2=0x555a2b7df350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:51.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.790+0000 7f3b81ffb640 0 client.25195 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:51.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.790+0000 7f3ba2741740 1 -- 172.21.15.120:0/1318816683 shutdown_connections 2024-09-19T05:20:51.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.791+0000 7f3ba2741740 1 -- 172.21.15.120:0/1318816683 wait complete. 2024-09-19T05:20:51.795 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.791+0000 7f3ba2741740 20 client.25195 trim_cache size 0 max 16384 2024-09-19T05:20:51.795 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T05:20:51.796 INFO:teuthology.orchestra.run.smithi120.stdout: "return_code": 0, 2024-09-19T05:20:51.796 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_tag": "b3ed9bbf-ab3f-4698-9442-ef50a621a3f1", 2024-09-19T05:20:51.796 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": "asynchronous" 2024-09-19T05:20:51.796 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T05:20:51.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.791+0000 7f3ba0368640 1 -- 172.21.15.120:0/2924191055 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f3b840a3430 msgr2=0x7f3b840a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:51.796 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.791+0000 7f3ba0368640 1 --2- 172.21.15.120:0/2924191055 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f3b840a3430 0x7f3b840a58f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3b94009bd0 tx=0x7f3b94005f90 comp rx=0 tx=0).stop 2024-09-19T05:20:51.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.791+0000 7f3ba0368640 1 -- 172.21.15.120:0/2924191055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b9810c2f0 msgr2=0x7f3b9819abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:51.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.791+0000 7f3ba0368640 1 --2- 172.21.15.120:0/2924191055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b9810c2f0 0x7f3b9819abf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3b90009fd0 tx=0x7f3b9000ef10 comp rx=0 tx=0).stop 2024-09-19T05:20:51.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.792+0000 7f3ba0368640 1 -- 172.21.15.120:0/2924191055 shutdown_connections 2024-09-19T05:20:51.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.792+0000 7f3ba0368640 1 --2- 172.21.15.120:0/2924191055 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f3b840a3430 0x7f3b840a58f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.792+0000 7f3ba0368640 1 --2- 172.21.15.120:0/2924191055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b9810c2f0 0x7f3b9819abf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.792+0000 7f3ba0368640 1 --2- 172.21.15.120:0/2924191055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3b981037a0 0x7f3b98196860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.792+0000 7f3ba0368640 1 --2- 172.21.15.120:0/2924191055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b98102df0 0x7f3b98196320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:51.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.792+0000 7f3ba0368640 1 -- 172.21.15.120:0/2924191055 >> 172.21.15.120:0/2924191055 conn(0x7f3b980fc7d0 msgr2=0x7f3b980fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:51.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.792+0000 7f3ba0368640 1 -- 172.21.15.120:0/2924191055 shutdown_connections 2024-09-19T05:20:51.797 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:51.792+0000 7f3ba0368640 1 -- 172.21.15.120:0/2924191055 wait complete. 2024-09-19T05:20:52.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:52 smithi120 ceph-mon[30956]: scrub queued for path: / 2024-09-19T05:20:52.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:52 smithi120 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T05:20:52.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:52 smithi120 ceph-mon[30956]: scrub summary: active paths [/] 2024-09-19T05:20:52.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:52 smithi120 ceph-mon[30956]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:20:52.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:52 smithi194 ceph-mon[35228]: scrub queued for path: / 2024-09-19T05:20:52.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:52 smithi194 ceph-mon[35228]: scrub summary: idle+waiting paths [/] 2024-09-19T05:20:52.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:52 smithi194 ceph-mon[35228]: scrub summary: active paths [/] 2024-09-19T05:20:52.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:52 smithi194 ceph-mon[35228]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:20:52.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:52 smithi178 ceph-mon[34347]: scrub queued for path: / 2024-09-19T05:20:52.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:52 smithi178 ceph-mon[34347]: scrub summary: idle+waiting paths [/] 2024-09-19T05:20:52.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:52 smithi178 ceph-mon[34347]: scrub summary: active paths [/] 2024-09-19T05:20:52.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:52 smithi178 ceph-mon[34347]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:20:52.636 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T05:20:53.041 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:20:53.343 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:53 smithi120 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T05:20:53.343 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:53 smithi120 ceph-mon[30956]: pgmap v52: 97 pgs: 97 active+clean; 29 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 2.0 MiB/s wr, 317 op/s 2024-09-19T05:20:53.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:53 smithi194 ceph-mon[35228]: scrub summary: idle+waiting paths [/] 2024-09-19T05:20:53.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:53 smithi194 ceph-mon[35228]: pgmap v52: 97 pgs: 97 active+clean; 29 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 2.0 MiB/s wr, 317 op/s 2024-09-19T05:20:53.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:53 smithi178 ceph-mon[34347]: scrub summary: idle+waiting paths [/] 2024-09-19T05:20:53.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:53 smithi178 ceph-mon[34347]: pgmap v52: 97 pgs: 97 active+clean; 29 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 2.0 MiB/s wr, 317 op/s 2024-09-19T05:20:53.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.599+0000 7f3a042a2640 1 -- 172.21.15.120:0/1477300051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39fc102570 msgr2=0x7f39fc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:53.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.599+0000 7f3a042a2640 1 --2- 172.21.15.120:0/1477300051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39fc102570 0x7f39fc1029b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f39ec009890 tx=0x7f39ec02a410 comp rx=0 tx=0).stop 2024-09-19T05:20:53.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.599+0000 7f3a042a2640 1 -- 172.21.15.120:0/1477300051 shutdown_connections 2024-09-19T05:20:53.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.599+0000 7f3a042a2640 1 --2- 172.21.15.120:0/1477300051 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39fc102ef0 0x7f39fc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.599+0000 7f3a042a2640 1 --2- 172.21.15.120:0/1477300051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39fc102570 0x7f39fc1029b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.599+0000 7f3a042a2640 1 --2- 172.21.15.120:0/1477300051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39fc100e20 0x7f39fc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.599+0000 7f3a042a2640 1 -- 172.21.15.120:0/1477300051 >> 172.21.15.120:0/1477300051 conn(0x7f39fc0fc7d0 msgr2=0x7f39fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:53.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.600+0000 7f3a042a2640 1 -- 172.21.15.120:0/1477300051 shutdown_connections 2024-09-19T05:20:53.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.600+0000 7f3a042a2640 1 -- 172.21.15.120:0/1477300051 wait complete. 2024-09-19T05:20:53.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.600+0000 7f3a042a2640 1 Processor -- start 2024-09-19T05:20:53.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.600+0000 7f3a042a2640 1 -- start start 2024-09-19T05:20:53.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.601+0000 7f3a042a2640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39fc100e20 0x7f39fc073a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.601+0000 7f3a042a2640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39fc102570 0x7f39fc06cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.601+0000 7f3a042a2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39fc102ef0 0x7f39fc06d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.601+0000 7f3a042a2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc10fd30 con 0x7f39fc102ef0 2024-09-19T05:20:53.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.601+0000 7f3a042a2640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc10fbb0 con 0x7f39fc100e20 2024-09-19T05:20:53.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.601+0000 7f3a042a2640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc10feb0 con 0x7f39fc102570 2024-09-19T05:20:53.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.601+0000 7f3a0203e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39fc100e20 0x7f39fc073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.601+0000 7f3a0203e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39fc100e20 0x7f39fc073a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:43652/0 (socket says 172.21.15.120:43652) 2024-09-19T05:20:53.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.601+0000 7f3a0203e640 1 -- 172.21.15.120:0/3657026098 learned_addr learned my addr 172.21.15.120:0/3657026098 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:53.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.601+0000 7f3a0183d640 1 --2- 172.21.15.120:0/3657026098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39fc102570 0x7f39fc06cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.601+0000 7f3a0283f640 1 --2- 172.21.15.120:0/3657026098 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39fc102ef0 0x7f39fc06d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.601+0000 7f3a0203e640 1 -- 172.21.15.120:0/3657026098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39fc102570 msgr2=0x7f39fc06cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:53.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.601+0000 7f3a0203e640 1 --2- 172.21.15.120:0/3657026098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39fc102570 0x7f39fc06cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.601+0000 7f3a0203e640 1 -- 172.21.15.120:0/3657026098 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39fc102ef0 msgr2=0x7f39fc06d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:53.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.601+0000 7f3a0203e640 1 --2- 172.21.15.120:0/3657026098 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39fc102ef0 0x7f39fc06d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.607 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.601+0000 7f3a0203e640 1 -- 172.21.15.120:0/3657026098 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39fc06d680 con 0x7f39fc100e20 2024-09-19T05:20:53.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.602+0000 7f3a0203e640 1 --2- 172.21.15.120:0/3657026098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39fc100e20 0x7f39fc073a70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f39f800e9f0 tx=0x7f39f800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:53.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.602+0000 7f3a0183d640 1 --2- 172.21.15.120:0/3657026098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39fc102570 0x7f39fc06cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:20:53.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.602+0000 7f39f37fe640 1 -- 172.21.15.120:0/3657026098 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f800cd80 con 0x7f39fc100e20 2024-09-19T05:20:53.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.602+0000 7f3a042a2640 1 -- 172.21.15.120:0/3657026098 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39fc0715a0 con 0x7f39fc100e20 2024-09-19T05:20:53.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.602+0000 7f39f37fe640 1 -- 172.21.15.120:0/3657026098 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f39f80035f0 con 0x7f39fc100e20 2024-09-19T05:20:53.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.602+0000 7f39f37fe640 1 -- 172.21.15.120:0/3657026098 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f8010690 con 0x7f39fc100e20 2024-09-19T05:20:53.608 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.602+0000 7f3a042a2640 1 -- 172.21.15.120:0/3657026098 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39fc071ae0 con 0x7f39fc100e20 2024-09-19T05:20:53.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.605+0000 7f39f37fe640 1 -- 172.21.15.120:0/3657026098 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f39f80037a0 con 0x7f39fc100e20 2024-09-19T05:20:53.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.605+0000 7f3a0667b740 1 Processor -- start 2024-09-19T05:20:53.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.605+0000 7f3a0667b740 1 -- start start 2024-09-19T05:20:53.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.605+0000 7f3a0667b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5599a1ea84a0 0x5599a1ea8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.605+0000 7f3a0667b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea8dc0 0x5599a1eb3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.605+0000 7f3a0667b740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599a1eb3680 0x5599a1eb5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.605+0000 7f3a0667b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5599a1e0e2e0 con 0x5599a1ea8dc0 2024-09-19T05:20:53.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.605+0000 7f3a0667b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5599a1db5ce0 con 0x5599a1ea84a0 2024-09-19T05:20:53.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.605+0000 7f3a0667b740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5599a1e0a2a0 con 0x5599a1eb3680 2024-09-19T05:20:53.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.606+0000 7f3a0183d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599a1eb3680 0x5599a1eb5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.606+0000 7f3a0203e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea8dc0 0x5599a1eb3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.606+0000 7f3a0183d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599a1eb3680 0x5599a1eb5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:46020/0 (socket says 172.21.15.120:46020) 2024-09-19T05:20:53.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.606+0000 7f3a0183d640 1 -- 172.21.15.120:0/3498868241 learned_addr learned my addr 172.21.15.120:0/3498868241 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:53.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.606+0000 7f3a0283f640 1 --2- 172.21.15.120:0/3498868241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5599a1ea84a0 0x5599a1ea8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.606+0000 7f39f37fe640 1 --2- 172.21.15.120:0/3657026098 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f39e80a33c0 0x7f39e80a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.606+0000 7f3a0203e640 1 -- 172.21.15.120:0/3498868241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599a1eb3680 msgr2=0x5599a1eb5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:53.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.606+0000 7f3a0203e640 1 --2- 172.21.15.120:0/3498868241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599a1eb3680 0x5599a1eb5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.606+0000 7f3a0203e640 1 -- 172.21.15.120:0/3498868241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5599a1ea84a0 msgr2=0x5599a1ea8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:53.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.606+0000 7f3a0203e640 1 --2- 172.21.15.120:0/3498868241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5599a1ea84a0 0x5599a1ea8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.606+0000 7f3a0203e640 1 -- 172.21.15.120:0/3498868241 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599a1d9a440 con 0x5599a1ea8dc0 2024-09-19T05:20:53.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.606+0000 7f3a0183d640 1 --2- 172.21.15.120:0/3498868241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599a1eb3680 0x5599a1eb5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:53.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.606+0000 7f39f37fe640 1 -- 172.21.15.120:0/3657026098 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f39f80d0120 con 0x7f39fc100e20 2024-09-19T05:20:53.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.606+0000 7f3a0283f640 1 --2- 172.21.15.120:0/3657026098 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f39e80a33c0 0x7f39e80a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.607+0000 7f3a0203e640 1 --2- 172.21.15.120:0/3498868241 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea8dc0 0x5599a1eb3140 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f39f80cd7c0 tx=0x7f39f8066d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f34a11c93a8db75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:53.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.607+0000 7f39f0dea640 1 -- 172.21.15.120:0/3498868241 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f809c120 con 0x5599a1ea8dc0 2024-09-19T05:20:53.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.607+0000 7f39f0dea640 1 -- 172.21.15.120:0/3498868241 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f39f8003b10 con 0x5599a1ea8dc0 2024-09-19T05:20:53.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.607+0000 7f39f0dea640 1 -- 172.21.15.120:0/3498868241 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f80d3cc0 con 0x5599a1ea8dc0 2024-09-19T05:20:53.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.608+0000 7f3a0283f640 1 --2- 172.21.15.120:0/3657026098 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f39e80a33c0 0x7f39e80a5880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f39f4005fd0 tx=0x7f39f4014040 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:53.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.608+0000 7f3a0667b740 1 -- 172.21.15.120:0/3498868241 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea8dc0 msgr2=0x5599a1eb3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:53.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.608+0000 7f3a0667b740 1 --2- 172.21.15.120:0/3498868241 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea8dc0 0x5599a1eb3140 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f39f80cd7c0 tx=0x7f39f8066d50 comp rx=0 tx=0).stop 2024-09-19T05:20:53.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.608+0000 7f3a0667b740 1 -- 172.21.15.120:0/3498868241 shutdown_connections 2024-09-19T05:20:53.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.608+0000 7f3a0667b740 1 --2- 172.21.15.120:0/3498868241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599a1eb3680 0x5599a1eb5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.608+0000 7f3a0667b740 1 --2- 172.21.15.120:0/3498868241 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea8dc0 0x5599a1eb3140 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.608+0000 7f3a0667b740 1 --2- 172.21.15.120:0/3498868241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5599a1ea84a0 0x5599a1ea8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.608+0000 7f3a0667b740 1 -- 172.21.15.120:0/3498868241 >> 172.21.15.120:0/3498868241 conn(0x5599a1ea4a30 msgr2=0x5599a1ea4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:53.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.608+0000 7f3a0667b740 1 -- 172.21.15.120:0/3498868241 shutdown_connections 2024-09-19T05:20:53.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.609+0000 7f3a0667b740 1 -- 172.21.15.120:0/3498868241 wait complete. 2024-09-19T05:20:53.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.609+0000 7f3a0667b740 1 -- start start 2024-09-19T05:20:53.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.609+0000 7f3a0667b740 1 Processor -- start 2024-09-19T05:20:53.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.609+0000 7f3a0667b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea84a0 0x5599a1eb3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.610+0000 7f3a0667b740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599a1ea8dc0 0x5599a1eac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.610+0000 7f3a0667b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5599a1eb3680 0x5599a1eacb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.610+0000 7f3a0667b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5599a1eb61f0 con 0x5599a1ea84a0 2024-09-19T05:20:53.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.610+0000 7f3a0667b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5599a1dc9050 con 0x5599a1eb3680 2024-09-19T05:20:53.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.610+0000 7f3a0667b740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5599a1eb6370 con 0x5599a1ea8dc0 2024-09-19T05:20:53.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.610+0000 7f3a0203e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea84a0 0x5599a1eb3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.610+0000 7f3a0203e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea84a0 0x5599a1eb3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49434/0 (socket says 172.21.15.120:49434) 2024-09-19T05:20:53.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.610+0000 7f3a0203e640 1 -- 172.21.15.120:0/649549638 learned_addr learned my addr 172.21.15.120:0/649549638 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:53.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.610+0000 7f3a0667b740 10 client.0 _ll_register_callbacks cb 0x5599a1e09160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:53.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.610+0000 7f3a0283f640 1 --2- 172.21.15.120:0/649549638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5599a1eb3680 0x5599a1eacb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.610+0000 7f3a0203e640 1 -- 172.21.15.120:0/649549638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599a1ea8dc0 msgr2=0x5599a1eac3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:53.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.610+0000 7f3a0183d640 1 --2- 172.21.15.120:0/649549638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599a1ea8dc0 0x5599a1eac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.610+0000 7f3a0203e640 1 --2- 172.21.15.120:0/649549638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599a1ea8dc0 0x5599a1eac3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.610+0000 7f3a0203e640 1 -- 172.21.15.120:0/649549638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5599a1eb3680 msgr2=0x5599a1eacb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:53.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.610+0000 7f3a0203e640 1 --2- 172.21.15.120:0/649549638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5599a1eb3680 0x5599a1eacb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.610+0000 7f3a0203e640 1 -- 172.21.15.120:0/649549638 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599a1b7f3c0 con 0x5599a1ea84a0 2024-09-19T05:20:53.617 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.610+0000 7f3a0283f640 1 --2- 172.21.15.120:0/649549638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5599a1eb3680 0x5599a1eacb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:20:53.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.611+0000 7f3a0203e640 1 --2- 172.21.15.120:0/649549638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea84a0 0x5599a1eb3130 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f39f8098030 tx=0x7f39f806f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd58086bc7c482a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:53.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.611+0000 7f39e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:20:53.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.611+0000 7f39e5ffb640 1 -- 172.21.15.120:0/649549638 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f809bcb0 con 0x5599a1ea84a0 2024-09-19T05:20:53.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.611+0000 7f39e5ffb640 1 -- 172.21.15.120:0/649549638 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f39f80980a0 con 0x5599a1ea84a0 2024-09-19T05:20:53.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.611+0000 7f3a0667b740 1 -- 172.21.15.120:0/649549638 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5599a1e1b850 con 0x5599a1ea84a0 2024-09-19T05:20:53.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.611+0000 7f39e5ffb640 1 -- 172.21.15.120:0/649549638 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f39f809be90 con 0x5599a1ea84a0 2024-09-19T05:20:53.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.611+0000 7f3a0667b740 10 client.15675 fetch_fsmap learned FSMap version 27 2024-09-19T05:20:53.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.611+0000 7f3a0667b740 1 -- 172.21.15.120:0/649549638 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5599a1ec1b60 con 0x5599a1ea84a0 2024-09-19T05:20:53.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.611+0000 7f39e5ffb640 1 -- 172.21.15.120:0/649549638 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x5599a1e1b850 con 0x5599a1ea84a0 2024-09-19T05:20:53.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.612+0000 7f39e5ffb640 1 -- 172.21.15.120:0/649549638 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f39f80cda40 con 0x5599a1ea84a0 2024-09-19T05:20:53.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.612+0000 7f3a0667b740 10 client.15675 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:20:53.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.612+0000 7f3a0667b740 10 client.15675 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:20:53.618 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.612+0000 7f3a0667b740 20 client.15675 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:53.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.612+0000 7f3a0667b740 1 --2- 172.21.15.120:0/649549638 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5599a1ec2eb0 0x5599a1ec52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.612+0000 7f3a0667b740 4 client.15675 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:20:53.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.612+0000 7f3a0667b740 1 -- 172.21.15.120:0/649549638 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599a1e15d60 con 0x5599a1ec2eb0 2024-09-19T05:20:53.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.612+0000 7f3a0183d640 1 --2- 172.21.15.120:0/649549638 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5599a1ec2eb0 0x5599a1ec52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.613+0000 7f39e5ffb640 10 client.15675 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:53.619 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.613+0000 7f3a0183d640 1 --2- 172.21.15.120:0/649549638 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5599a1ec2eb0 0x5599a1ec52a0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc6f891d4b6b2da1 server_cookie=bb17f21a55d25843 in_seq=0 out_seq=0 2024-09-19T05:20:53.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.614+0000 7f39e5ffb640 1 -- 172.21.15.120:0/649549638 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5599a1e15d60 con 0x5599a1ec2eb0 2024-09-19T05:20:53.620 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.614+0000 7f39e5ffb640 10 client.15675 handle_command_reply: tid=0 2024-09-19T05:20:53.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.614+0000 7f3a0667b740 1 client.15675 shutdown 2024-09-19T05:20:53.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.614+0000 7f3a0667b740 1 -- 172.21.15.120:0/649549638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea84a0 msgr2=0x5599a1eb3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:53.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.614+0000 7f3a0667b740 1 --2- 172.21.15.120:0/649549638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea84a0 0x5599a1eb3130 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f39f8098030 tx=0x7f39f806f740 comp rx=0 tx=0).stop 2024-09-19T05:20:53.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.614+0000 7f3a0667b740 1 -- 172.21.15.120:0/649549638 shutdown_connections 2024-09-19T05:20:53.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.614+0000 7f3a0667b740 1 --2- 172.21.15.120:0/649549638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5599a1eb3680 0x5599a1eacb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.614+0000 7f3a0667b740 1 --2- 172.21.15.120:0/649549638 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5599a1ec2eb0 0x5599a1ec52a0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.614+0000 7f3a0667b740 1 --2- 172.21.15.120:0/649549638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599a1ea8dc0 0x5599a1eac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.614+0000 7f3a0667b740 1 --2- 172.21.15.120:0/649549638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea84a0 0x5599a1eb3130 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.614+0000 7f3a0667b740 1 -- 172.21.15.120:0/649549638 >> 172.21.15.120:0/649549638 conn(0x5599a1ea4a30 msgr2=0x5599a1eaa760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:53.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.614+0000 7f39e5ffb640 0 client.15675 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:53.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.614+0000 7f3a0667b740 1 -- 172.21.15.120:0/649549638 shutdown_connections 2024-09-19T05:20:53.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.614+0000 7f3a0667b740 1 -- 172.21.15.120:0/649549638 wait complete. 2024-09-19T05:20:53.621 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.614+0000 7f3a0667b740 20 client.15675 trim_cache size 0 max 16384 2024-09-19T05:20:53.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.635+0000 7f3a0667b740 1 Processor -- start 2024-09-19T05:20:53.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.635+0000 7f3a0667b740 1 -- start start 2024-09-19T05:20:53.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.635+0000 7f3a0667b740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599a1ea84a0 0x5599a1eb0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.635+0000 7f3a0667b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea8dc0 0x5599a1eaaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.635+0000 7f3a0667b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5599a1eb3680 0x5599a1eb8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.635+0000 7f3a0667b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc1b69c0 con 0x5599a1ea8dc0 2024-09-19T05:20:53.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.635+0000 7f3a0667b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc1b4290 con 0x5599a1eb3680 2024-09-19T05:20:53.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.635+0000 7f3a0667b740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc1b20e0 con 0x5599a1ea84a0 2024-09-19T05:20:53.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.635+0000 7f3a0183d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea8dc0 0x5599a1eaaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.635+0000 7f3a0283f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5599a1eb3680 0x5599a1eb8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.635+0000 7f3a0283f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5599a1eb3680 0x5599a1eb8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:43690/0 (socket says 172.21.15.120:43690) 2024-09-19T05:20:53.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.635+0000 7f3a0183d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea8dc0 0x5599a1eaaf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49436/0 (socket says 172.21.15.120:49436) 2024-09-19T05:20:53.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.635+0000 7f3a0283f640 1 -- 172.21.15.120:0/4132150862 learned_addr learned my addr 172.21.15.120:0/4132150862 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:53.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.636+0000 7f3a0203e640 1 --2- 172.21.15.120:0/4132150862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599a1ea84a0 0x5599a1eb0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.636+0000 7f3a0183d640 1 -- 172.21.15.120:0/4132150862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599a1ea84a0 msgr2=0x5599a1eb0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:53.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.636+0000 7f3a0183d640 1 --2- 172.21.15.120:0/4132150862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599a1ea84a0 0x5599a1eb0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.636+0000 7f3a0183d640 1 -- 172.21.15.120:0/4132150862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5599a1eb3680 msgr2=0x5599a1eb8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:53.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.636+0000 7f3a0183d640 1 --2- 172.21.15.120:0/4132150862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5599a1eb3680 0x5599a1eb8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.636+0000 7f3a0183d640 1 -- 172.21.15.120:0/4132150862 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599a1ea4860 con 0x5599a1ea8dc0 2024-09-19T05:20:53.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.636+0000 7f3a0283f640 1 --2- 172.21.15.120:0/4132150862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5599a1eb3680 0x5599a1eb8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:53.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.636+0000 7f3a0183d640 1 --2- 172.21.15.120:0/4132150862 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea8dc0 0x5599a1eaaf00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x5599a1ea5db0 tx=0x7f39ec005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efdb7f3ca7969f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:53.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.636+0000 7f39e7fff640 1 -- 172.21.15.120:0/4132150862 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec041e60 con 0x5599a1ea8dc0 2024-09-19T05:20:53.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.636+0000 7f39e7fff640 1 -- 172.21.15.120:0/4132150862 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f39ec030e20 con 0x5599a1ea8dc0 2024-09-19T05:20:53.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.636+0000 7f39e7fff640 1 -- 172.21.15.120:0/4132150862 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ec004920 con 0x5599a1ea8dc0 2024-09-19T05:20:53.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.638+0000 7f3a0667b740 1 -- 172.21.15.120:0/4132150862 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea8dc0 msgr2=0x5599a1eaaf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:53.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.638+0000 7f3a0667b740 1 --2- 172.21.15.120:0/4132150862 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea8dc0 0x5599a1eaaf00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x5599a1ea5db0 tx=0x7f39ec005890 comp rx=0 tx=0).stop 2024-09-19T05:20:53.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.638+0000 7f3a0667b740 1 -- 172.21.15.120:0/4132150862 shutdown_connections 2024-09-19T05:20:53.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.638+0000 7f3a0667b740 1 --2- 172.21.15.120:0/4132150862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5599a1eb3680 0x5599a1eb8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.638+0000 7f3a0667b740 1 --2- 172.21.15.120:0/4132150862 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea8dc0 0x5599a1eaaf00 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.638+0000 7f3a0667b740 1 --2- 172.21.15.120:0/4132150862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599a1ea84a0 0x5599a1eb0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.638+0000 7f3a0667b740 1 -- 172.21.15.120:0/4132150862 >> 172.21.15.120:0/4132150862 conn(0x5599a1ea4a30 msgr2=0x5599a1eac120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:53.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.638+0000 7f3a0667b740 1 -- 172.21.15.120:0/4132150862 shutdown_connections 2024-09-19T05:20:53.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.638+0000 7f3a0667b740 1 -- 172.21.15.120:0/4132150862 wait complete. 2024-09-19T05:20:53.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.638+0000 7f3a0667b740 1 -- start start 2024-09-19T05:20:53.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.639+0000 7f3a0667b740 1 Processor -- start 2024-09-19T05:20:53.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.639+0000 7f3a0667b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea84a0 0x5599a1ebfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.639+0000 7f3a0667b740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599a1ea8dc0 0x5599a1ebce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.639+0000 7f3a0667b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5599a1eb3680 0x5599a1ebd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.639+0000 7f3a0667b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc1b2750 con 0x5599a1ea84a0 2024-09-19T05:20:53.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.639+0000 7f3a0667b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc1b3bc0 con 0x5599a1eb3680 2024-09-19T05:20:53.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.639+0000 7f3a0667b740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc1b2e20 con 0x5599a1ea8dc0 2024-09-19T05:20:53.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.639+0000 7f3a0667b740 10 client.0 _ll_register_callbacks cb 0x7f39f40093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:20:53.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.639+0000 7f3a0203e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea84a0 0x5599a1ebfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.642 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.639+0000 7f3a0203e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea84a0 0x5599a1ebfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49450/0 (socket says 172.21.15.120:49450) 2024-09-19T05:20:53.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.639+0000 7f3a0183d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599a1ea8dc0 0x5599a1ebce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.639+0000 7f3a0203e640 1 -- 172.21.15.120:0/2391943984 learned_addr learned my addr 172.21.15.120:0/2391943984 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:20:53.643 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.639+0000 7f3a0283f640 1 --2- 172.21.15.120:0/2391943984 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5599a1eb3680 0x5599a1ebd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.640+0000 7f3a0203e640 1 -- 172.21.15.120:0/2391943984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599a1ea8dc0 msgr2=0x5599a1ebce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:53.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.640+0000 7f3a0203e640 1 --2- 172.21.15.120:0/2391943984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599a1ea8dc0 0x5599a1ebce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.646 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.640+0000 7f3a0203e640 1 -- 172.21.15.120:0/2391943984 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5599a1eb3680 msgr2=0x5599a1ebd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:20:53.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.640+0000 7f3a0203e640 1 --2- 172.21.15.120:0/2391943984 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5599a1eb3680 0x5599a1ebd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.640+0000 7f3a0203e640 1 -- 172.21.15.120:0/2391943984 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599a1ebda10 con 0x5599a1ea84a0 2024-09-19T05:20:53.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.640+0000 7f3a0183d640 1 --2- 172.21.15.120:0/2391943984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599a1ea8dc0 0x5599a1ebce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:20:53.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.640+0000 7f3a0203e640 1 --2- 172.21.15.120:0/2391943984 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea84a0 0x5599a1ebfb40 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f39f80987b0 tx=0x7f39f80a4eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a85a6010e96e955 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:20:53.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.640+0000 7f39e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:20:53.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.640+0000 7f39e5ffb640 1 -- 172.21.15.120:0/2391943984 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f809bcb0 con 0x5599a1ea84a0 2024-09-19T05:20:53.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.640+0000 7f39e5ffb640 1 -- 172.21.15.120:0/2391943984 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f39f809c7b0 con 0x5599a1ea84a0 2024-09-19T05:20:53.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.640+0000 7f3a0667b740 1 -- 172.21.15.120:0/2391943984 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39ec030e20 con 0x5599a1ea84a0 2024-09-19T05:20:53.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.640+0000 7f39e5ffb640 1 -- 172.21.15.120:0/2391943984 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f39f80b5050 con 0x5599a1ea84a0 2024-09-19T05:20:53.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.640+0000 7f3a0667b740 10 client.15681 fetch_fsmap learned FSMap version 27 2024-09-19T05:20:53.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.640+0000 7f3a0667b740 1 -- 172.21.15.120:0/2391943984 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5599a1f2d610 con 0x5599a1ea84a0 2024-09-19T05:20:53.647 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.641+0000 7f39e5ffb640 1 -- 172.21.15.120:0/2391943984 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f39f809ca50 con 0x5599a1ea84a0 2024-09-19T05:20:53.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.641+0000 7f39e5ffb640 1 -- 172.21.15.120:0/2391943984 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f39f806d260 con 0x5599a1ea84a0 2024-09-19T05:20:53.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.641+0000 7f3a0667b740 10 client.15681 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:20:53.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.641+0000 7f3a0667b740 10 client.15681 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:20:53.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.641+0000 7f3a0667b740 20 client.15681 populate_metadata read hostname 'smithi120' 2024-09-19T05:20:53.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.641+0000 7f3a0667b740 1 --2- 172.21.15.120:0/2391943984 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5599a1f2daa0 0x5599a1f2fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:20:53.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.641+0000 7f3a0667b740 4 client.15681 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:20:53.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.641+0000 7f3a0667b740 1 -- 172.21.15.120:0/2391943984 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f39ec030e20 con 0x5599a1f2daa0 2024-09-19T05:20:53.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.641+0000 7f3a0183d640 1 --2- 172.21.15.120:0/2391943984 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5599a1f2daa0 0x5599a1f2fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:20:53.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.642+0000 7f39e5ffb640 10 client.15681 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:53.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.642+0000 7f3a0183d640 1 --2- 172.21.15.120:0/2391943984 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5599a1f2daa0 0x5599a1f2fec0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2649bdad4d610594 server_cookie=2dc302b204c08fb1 in_seq=0 out_seq=0 2024-09-19T05:20:53.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.643+0000 7f39e5ffb640 1 -- 172.21.15.120:0/2391943984 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f39ec030e20 con 0x5599a1f2daa0 2024-09-19T05:20:53.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.643+0000 7f39e5ffb640 10 client.15681 handle_command_reply: tid=0 2024-09-19T05:20:53.648 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.643+0000 7f3a0667b740 1 client.15681 shutdown 2024-09-19T05:20:53.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.643+0000 7f3a0667b740 1 -- 172.21.15.120:0/2391943984 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea84a0 msgr2=0x5599a1ebfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:53.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.643+0000 7f3a0667b740 1 --2- 172.21.15.120:0/2391943984 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea84a0 0x5599a1ebfb40 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f39f80987b0 tx=0x7f39f80a4eb0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.643+0000 7f3a0667b740 1 -- 172.21.15.120:0/2391943984 shutdown_connections 2024-09-19T05:20:53.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.643+0000 7f3a0667b740 1 --2- 172.21.15.120:0/2391943984 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5599a1eb3680 0x5599a1ebd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.643+0000 7f3a0667b740 1 --2- 172.21.15.120:0/2391943984 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5599a1f2daa0 0x5599a1f2fec0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.643+0000 7f3a0667b740 1 --2- 172.21.15.120:0/2391943984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599a1ea8dc0 0x5599a1ebce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.643+0000 7f3a0667b740 1 --2- 172.21.15.120:0/2391943984 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5599a1ea84a0 0x5599a1ebfb40 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.643+0000 7f3a0667b740 1 -- 172.21.15.120:0/2391943984 >> 172.21.15.120:0/2391943984 conn(0x5599a1ea4a30 msgr2=0x5599a1ea3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:53.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.643+0000 7f39e5ffb640 0 client.15681 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:20:53.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.643+0000 7f3a0667b740 1 -- 172.21.15.120:0/2391943984 shutdown_connections 2024-09-19T05:20:53.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.643+0000 7f3a0667b740 1 -- 172.21.15.120:0/2391943984 wait complete. 2024-09-19T05:20:53.649 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.644+0000 7f3a0667b740 20 client.15681 trim_cache size 0 max 16384 2024-09-19T05:20:53.650 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T05:20:53.650 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T05:20:53.650 INFO:teuthology.orchestra.run.smithi120.stdout: "scrubs": { 2024-09-19T05:20:53.650 INFO:teuthology.orchestra.run.smithi120.stdout: "b3ed9bbf-ab3f-4698-9442-ef50a621a3f1": { 2024-09-19T05:20:53.650 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/", 2024-09-19T05:20:53.650 INFO:teuthology.orchestra.run.smithi120.stdout: "tag": "b3ed9bbf-ab3f-4698-9442-ef50a621a3f1", 2024-09-19T05:20:53.650 INFO:teuthology.orchestra.run.smithi120.stdout: "options": "recursive,force" 2024-09-19T05:20:53.650 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:20:53.650 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:20:53.650 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T05:20:53.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.644+0000 7f3a042a2640 1 -- 172.21.15.120:0/3657026098 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f39e80a33c0 msgr2=0x7f39e80a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:53.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.644+0000 7f3a042a2640 1 --2- 172.21.15.120:0/3657026098 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f39e80a33c0 0x7f39e80a5880 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f39f4005fd0 tx=0x7f39f4014040 comp rx=0 tx=0).stop 2024-09-19T05:20:53.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.644+0000 7f3a042a2640 1 -- 172.21.15.120:0/3657026098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39fc100e20 msgr2=0x7f39fc073a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:20:53.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.644+0000 7f3a042a2640 1 --2- 172.21.15.120:0/3657026098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39fc100e20 0x7f39fc073a70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f39f800e9f0 tx=0x7f39f800edf0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.651 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.644+0000 7f3a042a2640 1 -- 172.21.15.120:0/3657026098 shutdown_connections 2024-09-19T05:20:53.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.644+0000 7f3a042a2640 1 --2- 172.21.15.120:0/3657026098 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f39e80a33c0 0x7f39e80a5880 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.644+0000 7f3a042a2640 1 --2- 172.21.15.120:0/3657026098 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39fc102ef0 0x7f39fc06d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.644+0000 7f3a042a2640 1 --2- 172.21.15.120:0/3657026098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39fc102570 0x7f39fc06cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.644+0000 7f3a042a2640 1 --2- 172.21.15.120:0/3657026098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39fc100e20 0x7f39fc073a70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:20:53.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.644+0000 7f3a042a2640 1 -- 172.21.15.120:0/3657026098 >> 172.21.15.120:0/3657026098 conn(0x7f39fc0fc7d0 msgr2=0x7f39fc104920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:20:53.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.645+0000 7f3a042a2640 1 -- 172.21.15.120:0/3657026098 shutdown_connections 2024-09-19T05:20:53.652 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:20:53.645+0000 7f3a042a2640 1 -- 172.21.15.120:0/3657026098 wait complete. 2024-09-19T05:20:54.362 INFO:tasks.cephfs.filesystem:scrub status for tag:b3ed9bbf-ab3f-4698-9442-ef50a621a3f1 - {'path': '/', 'tag': 'b3ed9bbf-ab3f-4698-9442-ef50a621a3f1', 'options': 'recursive,force'} 2024-09-19T05:20:54.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:54 smithi120 ceph-mon[30956]: pgmap v53: 97 pgs: 97 active+clean; 29 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 2.0 MiB/s wr, 317 op/s 2024-09-19T05:20:54.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:54 smithi178 ceph-mon[34347]: pgmap v53: 97 pgs: 97 active+clean; 29 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 2.0 MiB/s wr, 317 op/s 2024-09-19T05:20:54.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:54 smithi194 ceph-mon[35228]: pgmap v53: 97 pgs: 97 active+clean; 29 MiB data, 516 MiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 2.0 MiB/s wr, 317 op/s 2024-09-19T05:20:56.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:56 smithi178 ceph-mon[34347]: pgmap v54: 97 pgs: 97 active+clean; 48 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.7 MiB/s wr, 482 op/s 2024-09-19T05:20:56.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:56 smithi120 ceph-mon[30956]: pgmap v54: 97 pgs: 97 active+clean; 48 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.7 MiB/s wr, 482 op/s 2024-09-19T05:20:56.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:56 smithi194 ceph-mon[35228]: pgmap v54: 97 pgs: 97 active+clean; 48 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.7 MiB/s wr, 482 op/s 2024-09-19T05:20:57.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:57 smithi178 ceph-mon[34347]: scrub summary: idle 2024-09-19T05:20:57.763 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:57 smithi120 ceph-mon[30956]: scrub summary: idle 2024-09-19T05:20:57.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:57 smithi194 ceph-mon[35228]: scrub summary: idle 2024-09-19T05:20:58.314 INFO:tasks.workunit.client.0.smithi120.stdout: 15 12295 470 5882 433 4043 790 2024-09-19T05:20:58.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:20:58 smithi178 ceph-mon[34347]: pgmap v55: 97 pgs: 97 active+clean; 48 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 2.6 MiB/s wr, 395 op/s 2024-09-19T05:20:58.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:20:58 smithi120 ceph-mon[30956]: pgmap v55: 97 pgs: 97 active+clean; 48 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 2.6 MiB/s wr, 395 op/s 2024-09-19T05:20:58.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:20:58 smithi194 ceph-mon[35228]: pgmap v55: 97 pgs: 97 active+clean; 48 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 2.6 MiB/s wr, 395 op/s 2024-09-19T05:21:00.585 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.581+0000 7f6a8c6d7640 1 -- 172.21.15.120:0/709303736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a841009d0 msgr2=0x7f6a84100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:00.585 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.581+0000 7f6a8c6d7640 1 --2- 172.21.15.120:0/709303736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a841009d0 0x7f6a84100e30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6a74009890 tx=0x7f6a7402a380 comp rx=0 tx=0).stop 2024-09-19T05:21:00.585 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.581+0000 7f6a8c6d7640 1 -- 172.21.15.120:0/709303736 shutdown_connections 2024-09-19T05:21:00.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.581+0000 7f6a8c6d7640 1 --2- 172.21.15.120:0/709303736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a84101370 0x7f6a8410d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.581+0000 7f6a8c6d7640 1 --2- 172.21.15.120:0/709303736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a841009d0 0x7f6a84100e30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.581+0000 7f6a8c6d7640 1 --2- 172.21.15.120:0/709303736 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a841069e0 0x7f6a84106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.581+0000 7f6a8c6d7640 1 -- 172.21.15.120:0/709303736 >> 172.21.15.120:0/709303736 conn(0x7f6a840fc6b0 msgr2=0x7f6a840fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:00.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.581+0000 7f6a8c6d7640 1 -- 172.21.15.120:0/709303736 shutdown_connections 2024-09-19T05:21:00.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.581+0000 7f6a8c6d7640 1 -- 172.21.15.120:0/709303736 wait complete. 2024-09-19T05:21:00.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.582+0000 7f6a8c6d7640 1 Processor -- start 2024-09-19T05:21:00.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.582+0000 7f6a8c6d7640 1 -- start start 2024-09-19T05:21:00.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.582+0000 7f6a8c6d7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a841009d0 0x7f6a841982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:00.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.582+0000 7f6a8c6d7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a84101370 0x7f6a84198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:00.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.582+0000 7f6a8c6d7640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a841069e0 0x7f6a8419cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:00.586 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.583+0000 7f6a8c6d7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6a84111db0 con 0x7f6a841009d0 2024-09-19T05:21:00.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.583+0000 7f6a8c6d7640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6a84111c30 con 0x7f6a841069e0 2024-09-19T05:21:00.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.583+0000 7f6a8a473640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a841009d0 0x7f6a841982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:00.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.583+0000 7f6a89c72640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a84101370 0x7f6a84198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:00.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.583+0000 7f6a8a473640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a841009d0 0x7f6a841982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37362/0 (socket says 172.21.15.120:37362) 2024-09-19T05:21:00.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.583+0000 7f6a8a473640 1 -- 172.21.15.120:0/3570754744 learned_addr learned my addr 172.21.15.120:0/3570754744 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:00.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.583+0000 7f6a8c6d7640 1 -- 172.21.15.120:0/3570754744 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6a84111f30 con 0x7f6a84101370 2024-09-19T05:21:00.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.583+0000 7f6a8ac74640 1 --2- 172.21.15.120:0/3570754744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a841069e0 0x7f6a8419cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:00.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.583+0000 7f6a89c72640 1 -- 172.21.15.120:0/3570754744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a841069e0 msgr2=0x7f6a8419cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:00.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.583+0000 7f6a89c72640 1 --2- 172.21.15.120:0/3570754744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a841069e0 0x7f6a8419cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.583+0000 7f6a89c72640 1 -- 172.21.15.120:0/3570754744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a841009d0 msgr2=0x7f6a841982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:00.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.583+0000 7f6a89c72640 1 --2- 172.21.15.120:0/3570754744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a841009d0 0x7f6a841982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.583+0000 7f6a89c72640 1 -- 172.21.15.120:0/3570754744 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a8419d2d0 con 0x7f6a84101370 2024-09-19T05:21:00.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.583+0000 7f6a8ac74640 1 --2- 172.21.15.120:0/3570754744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a841069e0 0x7f6a8419cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:00.587 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.583+0000 7f6a89c72640 1 --2- 172.21.15.120:0/3570754744 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a84101370 0x7f6a84198820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6a74035040 tx=0x7f6a74005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:00.588 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.583+0000 7f6a7b7fe640 1 -- 172.21.15.120:0/3570754744 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a74040020 con 0x7f6a84101370 2024-09-19T05:21:00.588 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.583+0000 7f6a8c6d7640 1 -- 172.21.15.120:0/3570754744 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a8419d560 con 0x7f6a84101370 2024-09-19T05:21:00.588 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.583+0000 7f6a7b7fe640 1 -- 172.21.15.120:0/3570754744 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a74038040 con 0x7f6a84101370 2024-09-19T05:21:00.588 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.583+0000 7f6a7b7fe640 1 -- 172.21.15.120:0/3570754744 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a74037070 con 0x7f6a84101370 2024-09-19T05:21:00.588 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.584+0000 7f6a8c6d7640 1 -- 172.21.15.120:0/3570754744 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a841a4e50 con 0x7f6a84101370 2024-09-19T05:21:00.589 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.587+0000 7f6a8f472740 1 Processor -- start 2024-09-19T05:21:00.589 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.587+0000 7f6a7b7fe640 1 -- 172.21.15.120:0/3570754744 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f6a74043020 con 0x7f6a84101370 2024-09-19T05:21:00.589 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.587+0000 7f6a8f472740 1 -- start start 2024-09-19T05:21:00.589 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.587+0000 7f6a8f472740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65eaaf0 0x55eda65eaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:00.591 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.587+0000 7f6a8f472740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eda65eb410 0x55eda65f5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.587+0000 7f6a8f472740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eda65f5cb0 0x55eda65f80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.587+0000 7f6a8f472740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55eda654f2f0 con 0x55eda65eaaf0 2024-09-19T05:21:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.587+0000 7f6a8f472740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55eda64f7270 con 0x55eda65f5cb0 2024-09-19T05:21:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.587+0000 7f6a8f472740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55eda654b2b0 con 0x55eda65eb410 2024-09-19T05:21:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.588+0000 7f6a8ac74640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65eaaf0 0x55eda65eaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.588+0000 7f6a8ac74640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65eaaf0 0x55eda65eaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37372/0 (socket says 172.21.15.120:37372) 2024-09-19T05:21:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.588+0000 7f6a8ac74640 1 -- 172.21.15.120:0/383500094 learned_addr learned my addr 172.21.15.120:0/383500094 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.588+0000 7f6a8a473640 1 --2- 172.21.15.120:0/383500094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eda65eb410 0x55eda65f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.588+0000 7f6a89c72640 1 --2- 172.21.15.120:0/383500094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eda65f5cb0 0x55eda65f80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.588+0000 7f6a8a473640 1 -- 172.21.15.120:0/383500094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eda65f5cb0 msgr2=0x55eda65f80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:00.592 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.588+0000 7f6a8a473640 1 --2- 172.21.15.120:0/383500094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eda65f5cb0 0x55eda65f80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.588+0000 7f6a8a473640 1 -- 172.21.15.120:0/383500094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65eaaf0 msgr2=0x55eda65eaed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.588+0000 7f6a8a473640 1 --2- 172.21.15.120:0/383500094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65eaaf0 0x55eda65eaed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.588+0000 7f6a8a473640 1 -- 172.21.15.120:0/383500094 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eda64f6340 con 0x55eda65eb410 2024-09-19T05:21:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.588+0000 7f6a7b7fe640 1 --2- 172.21.15.120:0/3570754744 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f6a700a3460 0x7f6a700a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.588+0000 7f6a89c72640 1 --2- 172.21.15.120:0/383500094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eda65f5cb0 0x55eda65f80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:21:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.588+0000 7f6a8ac74640 1 --2- 172.21.15.120:0/383500094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65eaaf0 0x55eda65eaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.588+0000 7f6a8a473640 1 --2- 172.21.15.120:0/383500094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eda65eb410 0x55eda65f5770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009cc0 tx=0x7f6a80011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dfe54ba90e0f1f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.588+0000 7f6a7b7fe640 1 -- 172.21.15.120:0/3570754744 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f6a740ef680 con 0x7f6a84101370 2024-09-19T05:21:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.588+0000 7f6a8ac74640 1 --2- 172.21.15.120:0/3570754744 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f6a700a3460 0x7f6a700a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.589+0000 7f6a78ff9640 1 -- 172.21.15.120:0/383500094 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a80004250 con 0x55eda65eb410 2024-09-19T05:21:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.589+0000 7f6a78ff9640 1 -- 172.21.15.120:0/383500094 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a800043f0 con 0x55eda65eb410 2024-09-19T05:21:00.593 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.589+0000 7f6a78ff9640 1 -- 172.21.15.120:0/383500094 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a80004dd0 con 0x55eda65eb410 2024-09-19T05:21:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.589+0000 7f6a8f472740 1 -- 172.21.15.120:0/383500094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eda65eb410 msgr2=0x55eda65f5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.589+0000 7f6a8f472740 1 --2- 172.21.15.120:0/383500094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eda65eb410 0x55eda65f5770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009cc0 tx=0x7f6a80011810 comp rx=0 tx=0).stop 2024-09-19T05:21:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.589+0000 7f6a8ac74640 1 --2- 172.21.15.120:0/3570754744 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f6a700a3460 0x7f6a700a5920 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c009fd0 tx=0x7f6a7c009500 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.589+0000 7f6a8f472740 1 -- 172.21.15.120:0/383500094 shutdown_connections 2024-09-19T05:21:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.589+0000 7f6a8f472740 1 --2- 172.21.15.120:0/383500094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eda65f5cb0 0x55eda65f80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.589+0000 7f6a8f472740 1 --2- 172.21.15.120:0/383500094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eda65eb410 0x55eda65f5770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.589+0000 7f6a8f472740 1 --2- 172.21.15.120:0/383500094 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65eaaf0 0x55eda65eaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.589+0000 7f6a8f472740 1 -- 172.21.15.120:0/383500094 >> 172.21.15.120:0/383500094 conn(0x55eda65e7060 msgr2=0x55eda65e7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.590+0000 7f6a8f472740 1 -- 172.21.15.120:0/383500094 shutdown_connections 2024-09-19T05:21:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.590+0000 7f6a8f472740 1 -- 172.21.15.120:0/383500094 wait complete. 2024-09-19T05:21:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.590+0000 7f6a8f472740 1 -- start start 2024-09-19T05:21:00.594 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.590+0000 7f6a8f472740 1 Processor -- start 2024-09-19T05:21:00.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.590+0000 7f6a8f472740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eda65eaaf0 0x55eda65f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:00.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.590+0000 7f6a8f472740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eda65eb410 0x55eda65f3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:00.598 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.591+0000 7f6a8f472740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65f5cb0 0x55eda65f3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:00.598 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.591+0000 7f6a8f472740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55eda65f8880 con 0x55eda65f5cb0 2024-09-19T05:21:00.598 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.591+0000 7f6a8f472740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55eda64d8290 con 0x55eda65eb410 2024-09-19T05:21:00.598 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.591+0000 7f6a8f472740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55eda65f8a00 con 0x55eda65eaaf0 2024-09-19T05:21:00.598 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.591+0000 7f6a8f472740 10 client.0 _ll_register_callbacks cb 0x55eda6509140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:00.598 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.591+0000 7f6a8a473640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eda65eaaf0 0x55eda65f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:00.598 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.591+0000 7f6a8ac74640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65f5cb0 0x55eda65f3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:00.598 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.591+0000 7f6a8ac74640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65f5cb0 0x55eda65f3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37382/0 (socket says 172.21.15.120:37382) 2024-09-19T05:21:00.598 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.591+0000 7f6a8ac74640 1 -- 172.21.15.120:0/1095691302 learned_addr learned my addr 172.21.15.120:0/1095691302 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:00.598 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.591+0000 7f6a89c72640 1 --2- 172.21.15.120:0/1095691302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eda65eb410 0x55eda65f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:00.598 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.591+0000 7f6a8ac74640 1 -- 172.21.15.120:0/1095691302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eda65eaaf0 msgr2=0x55eda65f2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:00.598 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.591+0000 7f6a8ac74640 1 --2- 172.21.15.120:0/1095691302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eda65eaaf0 0x55eda65f2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.598 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.591+0000 7f6a8ac74640 1 -- 172.21.15.120:0/1095691302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eda65eb410 msgr2=0x55eda65f3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:00.599 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.591+0000 7f6a8ac74640 1 --2- 172.21.15.120:0/1095691302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eda65eb410 0x55eda65f3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.599 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.591+0000 7f6a8ac74640 1 -- 172.21.15.120:0/1095691302 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eda6262210 con 0x55eda65f5cb0 2024-09-19T05:21:00.599 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.591+0000 7f6a8a473640 1 --2- 172.21.15.120:0/1095691302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eda65eaaf0 0x55eda65f2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:00.599 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.591+0000 7f6a89c72640 1 --2- 172.21.15.120:0/1095691302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eda65eb410 0x55eda65f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:21:00.599 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.591+0000 7f6a8ac74640 1 --2- 172.21.15.120:0/1095691302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65f5cb0 0x55eda65f3640 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c0047a0 tx=0x7f6a7c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93b2e99b3f7c63e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:00.599 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.591+0000 7f6a6dffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:21:00.599 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.591+0000 7f6a6dffb640 1 -- 172.21.15.120:0/1095691302 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c02d060 con 0x55eda65f5cb0 2024-09-19T05:21:00.599 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.592+0000 7f6a6dffb640 1 -- 172.21.15.120:0/1095691302 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f6a7c017030 con 0x55eda65f5cb0 2024-09-19T05:21:00.599 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.592+0000 7f6a8f472740 1 -- 172.21.15.120:0/1095691302 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a800043f0 con 0x55eda65f5cb0 2024-09-19T05:21:00.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.592+0000 7f6a6dffb640 1 -- 172.21.15.120:0/1095691302 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6a7c0114a0 con 0x55eda65f5cb0 2024-09-19T05:21:00.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.592+0000 7f6a8f472740 10 client.15693 fetch_fsmap learned FSMap version 27 2024-09-19T05:21:00.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.592+0000 7f6a8f472740 1 -- 172.21.15.120:0/1095691302 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55eda632e620 con 0x55eda65f5cb0 2024-09-19T05:21:00.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.592+0000 7f6a6dffb640 1 -- 172.21.15.120:0/1095691302 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a800043f0 con 0x55eda65f5cb0 2024-09-19T05:21:00.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.592+0000 7f6a6dffb640 1 -- 172.21.15.120:0/1095691302 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f6a7c028990 con 0x55eda65f5cb0 2024-09-19T05:21:00.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.592+0000 7f6a8f472740 10 client.15693 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:21:00.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.592+0000 7f6a8f472740 10 client.15693 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:21:00.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.592+0000 7f6a8f472740 20 client.15693 populate_metadata read hostname 'smithi120' 2024-09-19T05:21:00.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.592+0000 7f6a8f472740 1 --2- 172.21.15.120:0/1095691302 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55eda6605c40 0x55eda66080b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:00.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.592+0000 7f6a8f472740 4 client.15693 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:21:00.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.592+0000 7f6a8f472740 1 -- 172.21.15.120:0/1095691302 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eda655ca20 con 0x55eda6605c40 2024-09-19T05:21:00.600 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.593+0000 7f6a8a473640 1 --2- 172.21.15.120:0/1095691302 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55eda6605c40 0x55eda66080b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:00.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.593+0000 7f6a6dffb640 10 client.15693 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:00.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.593+0000 7f6a8a473640 1 --2- 172.21.15.120:0/1095691302 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55eda6605c40 0x55eda66080b0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cd53f487507ca47 server_cookie=cc99b3914b547d45 in_seq=0 out_seq=0 2024-09-19T05:21:00.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.594+0000 7f6a6dffb640 1 -- 172.21.15.120:0/1095691302 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eda655ca20 con 0x55eda6605c40 2024-09-19T05:21:00.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.594+0000 7f6a6dffb640 10 client.15693 handle_command_reply: tid=0 2024-09-19T05:21:00.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.594+0000 7f6a8f472740 1 client.15693 shutdown 2024-09-19T05:21:00.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.594+0000 7f6a8f472740 1 -- 172.21.15.120:0/1095691302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65f5cb0 msgr2=0x55eda65f3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:00.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.594+0000 7f6a8f472740 1 --2- 172.21.15.120:0/1095691302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65f5cb0 0x55eda65f3640 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c0047a0 tx=0x7f6a7c004ab0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.594+0000 7f6a8f472740 1 -- 172.21.15.120:0/1095691302 shutdown_connections 2024-09-19T05:21:00.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.594+0000 7f6a8f472740 1 --2- 172.21.15.120:0/1095691302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65f5cb0 0x55eda65f3640 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.594+0000 7f6a8f472740 1 --2- 172.21.15.120:0/1095691302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eda65eb410 0x55eda65f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.594+0000 7f6a8f472740 1 --2- 172.21.15.120:0/1095691302 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55eda6605c40 0x55eda66080b0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.594+0000 7f6a8f472740 1 --2- 172.21.15.120:0/1095691302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eda65eaaf0 0x55eda65f2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.601 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.594+0000 7f6a6dffb640 0 client.15693 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:00.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.594+0000 7f6a8f472740 1 -- 172.21.15.120:0/1095691302 >> 172.21.15.120:0/1095691302 conn(0x55eda65e7060 msgr2=0x55eda65ecdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:00.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.594+0000 7f6a8f472740 1 -- 172.21.15.120:0/1095691302 shutdown_connections 2024-09-19T05:21:00.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.594+0000 7f6a8f472740 1 -- 172.21.15.120:0/1095691302 wait complete. 2024-09-19T05:21:00.602 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.594+0000 7f6a8f472740 20 client.15693 trim_cache size 0 max 16384 2024-09-19T05:21:00.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.617+0000 7f6a8f472740 1 Processor -- start 2024-09-19T05:21:00.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.617+0000 7f6a8f472740 1 -- start start 2024-09-19T05:21:00.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.617+0000 7f6a8f472740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eda65eaaf0 0x55eda65ed560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:00.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.618+0000 7f6a8f472740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65eb410 0x55eda65f3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:00.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.618+0000 7f6a89c72640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65eb410 0x55eda65f3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:00.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.618+0000 7f6a89c72640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65eb410 0x55eda65f3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37396/0 (socket says 172.21.15.120:37396) 2024-09-19T05:21:00.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.618+0000 7f6a89c72640 1 -- 172.21.15.120:0/3164440754 learned_addr learned my addr 172.21.15.120:0/3164440754 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:00.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.618+0000 7f6a8f472740 1 --2- 172.21.15.120:0/3164440754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eda65f5cb0 0x55eda65f4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:00.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.618+0000 7f6a8f472740 1 -- 172.21.15.120:0/3164440754 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6a841b0120 con 0x55eda65eb410 2024-09-19T05:21:00.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.618+0000 7f6a8f472740 1 -- 172.21.15.120:0/3164440754 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6a841ad9f0 con 0x55eda65eaaf0 2024-09-19T05:21:00.621 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.618+0000 7f6a8a473640 1 --2- 172.21.15.120:0/3164440754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eda65eaaf0 0x55eda65ed560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.618+0000 7f6a8f472740 1 -- 172.21.15.120:0/3164440754 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6a841ab840 con 0x55eda65f5cb0 2024-09-19T05:21:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.618+0000 7f6a8ac74640 1 --2- 172.21.15.120:0/3164440754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eda65f5cb0 0x55eda65f4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.618+0000 7f6a8a473640 1 -- 172.21.15.120:0/3164440754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eda65f5cb0 msgr2=0x55eda65f4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.618+0000 7f6a8a473640 1 --2- 172.21.15.120:0/3164440754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eda65f5cb0 0x55eda65f4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.618+0000 7f6a8a473640 1 -- 172.21.15.120:0/3164440754 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65eb410 msgr2=0x55eda65f3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.618+0000 7f6a8a473640 1 --2- 172.21.15.120:0/3164440754 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65eb410 0x55eda65f3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.618+0000 7f6a8a473640 1 -- 172.21.15.120:0/3164440754 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eda65ea870 con 0x55eda65eaaf0 2024-09-19T05:21:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.618+0000 7f6a8ac74640 1 --2- 172.21.15.120:0/3164440754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eda65f5cb0 0x55eda65f4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:21:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.619+0000 7f6a8a473640 1 --2- 172.21.15.120:0/3164440754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eda65eaaf0 0x55eda65ed560 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6a80011d10 tx=0x7f6a80004a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d49181b0e7707ab2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.619+0000 7f6a6ffff640 1 -- 172.21.15.120:0/3164440754 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a80004360 con 0x55eda65eaaf0 2024-09-19T05:21:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.619+0000 7f6a6ffff640 1 -- 172.21.15.120:0/3164440754 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a80004500 con 0x55eda65eaaf0 2024-09-19T05:21:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.619+0000 7f6a6ffff640 1 -- 172.21.15.120:0/3164440754 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a800038e0 con 0x55eda65eaaf0 2024-09-19T05:21:00.624 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.620+0000 7f6a8f472740 1 -- 172.21.15.120:0/3164440754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eda65eaaf0 msgr2=0x55eda65ed560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.620+0000 7f6a8f472740 1 --2- 172.21.15.120:0/3164440754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eda65eaaf0 0x55eda65ed560 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6a80011d10 tx=0x7f6a80004a70 comp rx=0 tx=0).stop 2024-09-19T05:21:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.620+0000 7f6a8f472740 1 -- 172.21.15.120:0/3164440754 shutdown_connections 2024-09-19T05:21:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.620+0000 7f6a8f472740 1 --2- 172.21.15.120:0/3164440754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eda65f5cb0 0x55eda65f4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.620+0000 7f6a8f472740 1 --2- 172.21.15.120:0/3164440754 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65eb410 0x55eda65f3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.620+0000 7f6a8f472740 1 --2- 172.21.15.120:0/3164440754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eda65eaaf0 0x55eda65ed560 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.620+0000 7f6a8f472740 1 -- 172.21.15.120:0/3164440754 >> 172.21.15.120:0/3164440754 conn(0x55eda65e7060 msgr2=0x55eda65f4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.620+0000 7f6a8f472740 1 -- 172.21.15.120:0/3164440754 shutdown_connections 2024-09-19T05:21:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.620+0000 7f6a8f472740 1 -- 172.21.15.120:0/3164440754 wait complete. 2024-09-19T05:21:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.621+0000 7f6a8f472740 1 -- start start 2024-09-19T05:21:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.621+0000 7f6a8f472740 1 Processor -- start 2024-09-19T05:21:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.621+0000 7f6a8f472740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eda65eaaf0 0x55eda65f8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.621+0000 7f6a8f472740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65eb410 0x55eda65f9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.622+0000 7f6a8f472740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eda65f5cb0 0x55eda65f96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.622+0000 7f6a8f472740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6a841abeb0 con 0x55eda65eb410 2024-09-19T05:21:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.622+0000 7f6a8f472740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6a841ad320 con 0x55eda65f5cb0 2024-09-19T05:21:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.622+0000 7f6a8f472740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6a841ac580 con 0x55eda65eaaf0 2024-09-19T05:21:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.622+0000 7f6a8f472740 10 client.0 _ll_register_callbacks cb 0x7f6a7c003c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.622+0000 7f6a8a473640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eda65eaaf0 0x55eda65f8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.622+0000 7f6a8a473640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eda65eaaf0 0x55eda65f8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:60856/0 (socket says 172.21.15.120:60856) 2024-09-19T05:21:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.622+0000 7f6a8a473640 1 -- 172.21.15.120:0/853683386 learned_addr learned my addr 172.21.15.120:0/853683386 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.622+0000 7f6a89c72640 1 --2- 172.21.15.120:0/853683386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65eb410 0x55eda65f9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.622+0000 7f6a8ac74640 1 --2- 172.21.15.120:0/853683386 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eda65f5cb0 0x55eda65f96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.622+0000 7f6a89c72640 1 -- 172.21.15.120:0/853683386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eda65eaaf0 msgr2=0x55eda65f8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.622+0000 7f6a89c72640 1 --2- 172.21.15.120:0/853683386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eda65eaaf0 0x55eda65f8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.622+0000 7f6a89c72640 1 -- 172.21.15.120:0/853683386 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eda65f5cb0 msgr2=0x55eda65f96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.622+0000 7f6a89c72640 1 --2- 172.21.15.120:0/853683386 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eda65f5cb0 0x55eda65f96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.622+0000 7f6a89c72640 1 -- 172.21.15.120:0/853683386 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eda66773b0 con 0x55eda65eb410 2024-09-19T05:21:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.622+0000 7f6a8ac74640 1 --2- 172.21.15.120:0/853683386 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eda65f5cb0 0x55eda65f96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.622+0000 7f6a89c72640 1 --2- 172.21.15.120:0/853683386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65eb410 0x55eda65f9190 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6a740bb9b0 tx=0x7f6a740bb620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6703966c9d04b2c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.622+0000 7f6a6dffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:21:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.623+0000 7f6a6dffb640 1 -- 172.21.15.120:0/853683386 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a740d3020 con 0x55eda65eb410 2024-09-19T05:21:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.623+0000 7f6a6dffb640 1 -- 172.21.15.120:0/853683386 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f6a740bbc80 con 0x55eda65eb410 2024-09-19T05:21:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.623+0000 7f6a8f472740 1 -- 172.21.15.120:0/853683386 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55eda6556d70 con 0x55eda65eb410 2024-09-19T05:21:00.630 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.623+0000 7f6a6dffb640 1 -- 172.21.15.120:0/853683386 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6a740bba20 con 0x55eda65eb410 2024-09-19T05:21:00.630 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.623+0000 7f6a8f472740 10 client.15699 fetch_fsmap learned FSMap version 27 2024-09-19T05:21:00.630 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.623+0000 7f6a8f472740 1 -- 172.21.15.120:0/853683386 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55eda66786c0 con 0x55eda65eb410 2024-09-19T05:21:00.630 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.624+0000 7f6a6dffb640 1 -- 172.21.15.120:0/853683386 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55eda6556d70 con 0x55eda65eb410 2024-09-19T05:21:00.630 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.624+0000 7f6a6dffb640 1 -- 172.21.15.120:0/853683386 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f6a740da180 con 0x55eda65eb410 2024-09-19T05:21:00.630 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.624+0000 7f6a8f472740 10 client.15699 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:21:00.630 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.624+0000 7f6a8f472740 10 client.15699 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:21:00.630 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.624+0000 7f6a8f472740 20 client.15699 populate_metadata read hostname 'smithi120' 2024-09-19T05:21:00.630 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.624+0000 7f6a8f472740 1 --2- 172.21.15.120:0/853683386 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55eda6678ea0 0x55eda667b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:00.630 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.624+0000 7f6a8f472740 4 client.15699 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:21:00.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.624+0000 7f6a8f472740 1 -- 172.21.15.120:0/853683386 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55eda64d3900 con 0x55eda6678ea0 2024-09-19T05:21:00.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.624+0000 7f6a8a473640 1 --2- 172.21.15.120:0/853683386 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55eda6678ea0 0x55eda667b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:00.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.625+0000 7f6a6dffb640 10 client.15699 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:00.631 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:00.625+0000 7f6a8a473640 1 --2- 172.21.15.120:0/853683386 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55eda6678ea0 0x55eda667b2c0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c20a389f51f1127c server_cookie=2dc4e0de79fb8e10 in_seq=0 out_seq=0 2024-09-19T05:21:00.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:00 smithi178 ceph-mon[34347]: pgmap v56: 97 pgs: 97 active+clean; 74 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.0 MiB/s wr, 532 op/s 2024-09-19T05:21:00.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:00 smithi120 ceph-mon[30956]: pgmap v56: 97 pgs: 97 active+clean; 74 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.0 MiB/s wr, 532 op/s 2024-09-19T05:21:00.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:00 smithi194 ceph-mon[35228]: pgmap v56: 97 pgs: 97 active+clean; 74 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.0 MiB/s wr, 532 op/s 2024-09-19T05:21:01.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.125+0000 7f6a6dffb640 1 -- 172.21.15.120:0/853683386 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55eda64d3900 con 0x55eda6678ea0 2024-09-19T05:21:01.127 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.125+0000 7f6a6dffb640 10 client.15699 handle_command_reply: tid=0 2024-09-19T05:21:01.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.125+0000 7f6a8f472740 1 client.15699 shutdown 2024-09-19T05:21:01.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.125+0000 7f6a8f472740 1 -- 172.21.15.120:0/853683386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65eb410 msgr2=0x55eda65f9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:01.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.125+0000 7f6a8f472740 1 --2- 172.21.15.120:0/853683386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65eb410 0x55eda65f9190 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6a740bb9b0 tx=0x7f6a740bb620 comp rx=0 tx=0).stop 2024-09-19T05:21:01.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.126+0000 7f6a8f472740 1 -- 172.21.15.120:0/853683386 shutdown_connections 2024-09-19T05:21:01.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.126+0000 7f6a8f472740 1 --2- 172.21.15.120:0/853683386 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eda65f5cb0 0x55eda65f96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:01.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.126+0000 7f6a8f472740 1 --2- 172.21.15.120:0/853683386 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55eda65eb410 0x55eda65f9190 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:01.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.126+0000 7f6a8f472740 1 --2- 172.21.15.120:0/853683386 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55eda6678ea0 0x55eda667b2c0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:01.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.126+0000 7f6a8f472740 1 --2- 172.21.15.120:0/853683386 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55eda65eaaf0 0x55eda65f8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:01.128 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.126+0000 7f6a6dffb640 0 client.15699 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.126+0000 7f6a8f472740 1 -- 172.21.15.120:0/853683386 >> 172.21.15.120:0/853683386 conn(0x55eda65e7060 msgr2=0x55eda65e61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.126+0000 7f6a8f472740 1 -- 172.21.15.120:0/853683386 shutdown_connections 2024-09-19T05:21:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.126+0000 7f6a8f472740 1 -- 172.21.15.120:0/853683386 wait complete. 2024-09-19T05:21:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.126+0000 7f6a8f472740 20 client.15699 trim_cache size 0 max 16384 2024-09-19T05:21:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:21:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:21:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:21:01.129 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:21:01.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.127+0000 7f6a8c6d7640 1 -- 172.21.15.120:0/3570754744 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f6a700a3460 msgr2=0x7f6a700a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:01.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.127+0000 7f6a8c6d7640 1 --2- 172.21.15.120:0/3570754744 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f6a700a3460 0x7f6a700a5920 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c009fd0 tx=0x7f6a7c009500 comp rx=0 tx=0).stop 2024-09-19T05:21:01.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.127+0000 7f6a8c6d7640 1 -- 172.21.15.120:0/3570754744 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a84101370 msgr2=0x7f6a84198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:01.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.127+0000 7f6a8c6d7640 1 --2- 172.21.15.120:0/3570754744 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a84101370 0x7f6a84198820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6a74035040 tx=0x7f6a74005dc0 comp rx=0 tx=0).stop 2024-09-19T05:21:01.130 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.127+0000 7f6a8c6d7640 1 -- 172.21.15.120:0/3570754744 shutdown_connections 2024-09-19T05:21:01.131 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.127+0000 7f6a8c6d7640 1 --2- 172.21.15.120:0/3570754744 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f6a700a3460 0x7f6a700a5920 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:01.131 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.127+0000 7f6a8c6d7640 1 --2- 172.21.15.120:0/3570754744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a841069e0 0x7f6a8419cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:01.131 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.127+0000 7f6a8c6d7640 1 --2- 172.21.15.120:0/3570754744 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a84101370 0x7f6a84198820 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:01.131 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.127+0000 7f6a8c6d7640 1 --2- 172.21.15.120:0/3570754744 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a841009d0 0x7f6a841982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:01.131 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.127+0000 7f6a8c6d7640 1 -- 172.21.15.120:0/3570754744 >> 172.21.15.120:0/3570754744 conn(0x7f6a840fc6b0 msgr2=0x7f6a840fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:01.131 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.127+0000 7f6a8c6d7640 1 -- 172.21.15.120:0/3570754744 shutdown_connections 2024-09-19T05:21:01.131 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:01.127+0000 7f6a8c6d7640 1 -- 172.21.15.120:0/3570754744 wait complete. 2024-09-19T05:21:02.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:02 smithi178 ceph-mon[34347]: pgmap v57: 97 pgs: 97 active+clean; 74 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.1 MiB/s wr, 302 op/s 2024-09-19T05:21:02.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:02 smithi120 ceph-mon[30956]: pgmap v57: 97 pgs: 97 active+clean; 74 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.1 MiB/s wr, 302 op/s 2024-09-19T05:21:02.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:02 smithi194 ceph-mon[35228]: pgmap v57: 97 pgs: 97 active+clean; 74 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.1 MiB/s wr, 302 op/s 2024-09-19T05:21:04.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:04 smithi178 ceph-mon[34347]: pgmap v58: 97 pgs: 97 active+clean; 74 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.1 MiB/s wr, 302 op/s 2024-09-19T05:21:04.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:04 smithi120 ceph-mon[30956]: pgmap v58: 97 pgs: 97 active+clean; 74 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.1 MiB/s wr, 302 op/s 2024-09-19T05:21:04.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:04 smithi194 ceph-mon[35228]: pgmap v58: 97 pgs: 97 active+clean; 74 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 4.1 MiB/s wr, 302 op/s 2024-09-19T05:21:06.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:06 smithi178 ceph-mon[34347]: pgmap v59: 97 pgs: 97 active+clean; 89 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.2 MiB/s wr, 676 op/s 2024-09-19T05:21:06.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:06 smithi120 ceph-mon[30956]: pgmap v59: 97 pgs: 97 active+clean; 89 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.2 MiB/s wr, 676 op/s 2024-09-19T05:21:06.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:06 smithi194 ceph-mon[35228]: pgmap v59: 97 pgs: 97 active+clean; 89 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.2 MiB/s wr, 676 op/s 2024-09-19T05:21:08.314 INFO:tasks.workunit.client.0.smithi120.stdout: 34 3594 698 1214 917 604 323 2024-09-19T05:21:08.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:08 smithi120 ceph-mon[30956]: pgmap v60: 97 pgs: 97 active+clean; 89 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.5 MiB/s wr, 511 op/s 2024-09-19T05:21:08.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:08 smithi178 ceph-mon[34347]: pgmap v60: 97 pgs: 97 active+clean; 89 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.5 MiB/s wr, 511 op/s 2024-09-19T05:21:08.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:08 smithi194 ceph-mon[35228]: pgmap v60: 97 pgs: 97 active+clean; 89 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 5.5 MiB/s wr, 511 op/s 2024-09-19T05:21:10.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:10 smithi178 ceph-mon[34347]: pgmap v61: 97 pgs: 97 active+clean; 119 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.3 MiB/s wr, 671 op/s 2024-09-19T05:21:10.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:10 smithi120 ceph-mon[30956]: pgmap v61: 97 pgs: 97 active+clean; 119 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.3 MiB/s wr, 671 op/s 2024-09-19T05:21:10.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:10 smithi194 ceph-mon[35228]: pgmap v61: 97 pgs: 97 active+clean; 119 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 8.3 MiB/s wr, 671 op/s 2024-09-19T05:21:12.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:12 smithi178 ceph-mon[34347]: pgmap v62: 97 pgs: 97 active+clean; 119 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.8 MiB/s wr, 534 op/s 2024-09-19T05:21:12.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:12 smithi120 ceph-mon[30956]: pgmap v62: 97 pgs: 97 active+clean; 119 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.8 MiB/s wr, 534 op/s 2024-09-19T05:21:12.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:12 smithi194 ceph-mon[35228]: pgmap v62: 97 pgs: 97 active+clean; 119 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.8 MiB/s wr, 534 op/s 2024-09-19T05:21:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.233+0000 7f17293b7640 1 -- 172.21.15.120:0/38767703 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1724101370 msgr2=0x7f172410d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.233+0000 7f17293b7640 1 --2- 172.21.15.120:0/38767703 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1724101370 0x7f172410d8a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f171c009cd0 tx=0x7f171c02a8e0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.233+0000 7f17293b7640 1 -- 172.21.15.120:0/38767703 shutdown_connections 2024-09-19T05:21:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.233+0000 7f17293b7640 1 --2- 172.21.15.120:0/38767703 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1724101370 0x7f172410d8a0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.233+0000 7f17293b7640 1 --2- 172.21.15.120:0/38767703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17241009d0 0x7f1724100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.233+0000 7f17293b7640 1 --2- 172.21.15.120:0/38767703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17241069e0 0x7f1724106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.233+0000 7f17293b7640 1 -- 172.21.15.120:0/38767703 >> 172.21.15.120:0/38767703 conn(0x7f17240fc6f0 msgr2=0x7f17240feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:14.236 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.233+0000 7f17293b7640 1 -- 172.21.15.120:0/38767703 shutdown_connections 2024-09-19T05:21:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.233+0000 7f17293b7640 1 -- 172.21.15.120:0/38767703 wait complete. 2024-09-19T05:21:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.234+0000 7f17293b7640 1 Processor -- start 2024-09-19T05:21:14.237 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.234+0000 7f17293b7640 1 -- start start 2024-09-19T05:21:14.238 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.235+0000 7f17293b7640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17241009d0 0x7f1724199030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:14.239 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.235+0000 7f17293b7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1724101370 0x7f1724199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:14.239 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.235+0000 7f17293b7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17241069e0 0x7f17241a40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:14.239 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.235+0000 7f17293b7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1724110d20 con 0x7f1724101370 2024-09-19T05:21:14.239 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.235+0000 7f17293b7640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1724110ba0 con 0x7f17241009d0 2024-09-19T05:21:14.239 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.235+0000 7f17293b7640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1724110ea0 con 0x7f17241069e0 2024-09-19T05:21:14.239 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.235+0000 7f17227fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1724101370 0x7f1724199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:14.239 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.235+0000 7f17227fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1724101370 0x7f1724199570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58120/0 (socket says 172.21.15.120:58120) 2024-09-19T05:21:14.239 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.235+0000 7f17227fc640 1 -- 172.21.15.120:0/2587429427 learned_addr learned my addr 172.21.15.120:0/2587429427 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:14.239 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.235+0000 7f17237fe640 1 --2- 172.21.15.120:0/2587429427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17241069e0 0x7f17241a40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:14.239 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.235+0000 7f1722ffd640 1 --2- 172.21.15.120:0/2587429427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17241009d0 0x7f1724199030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:14.239 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.235+0000 7f17237fe640 1 -- 172.21.15.120:0/2587429427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17241009d0 msgr2=0x7f1724199030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:14.240 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.235+0000 7f17237fe640 1 --2- 172.21.15.120:0/2587429427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17241009d0 0x7f1724199030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.240 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.235+0000 7f17237fe640 1 -- 172.21.15.120:0/2587429427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1724101370 msgr2=0x7f1724199570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:14.240 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.235+0000 7f17237fe640 1 --2- 172.21.15.120:0/2587429427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1724101370 0x7f1724199570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.240 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.235+0000 7f17237fe640 1 -- 172.21.15.120:0/2587429427 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17241a45f0 con 0x7f17241069e0 2024-09-19T05:21:14.240 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.235+0000 7f17227fc640 1 --2- 172.21.15.120:0/2587429427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1724101370 0x7f1724199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:14.240 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.235+0000 7f17237fe640 1 --2- 172.21.15.120:0/2587429427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17241069e0 0x7f17241a40b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f171c009ca0 tx=0x7f171c003970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:14.240 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.235+0000 7f170bfff640 1 -- 172.21.15.120:0/2587429427 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c004040 con 0x7f17241069e0 2024-09-19T05:21:14.240 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.236+0000 7f17293b7640 1 -- 172.21.15.120:0/2587429427 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17241a47c0 con 0x7f17241069e0 2024-09-19T05:21:14.240 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.236+0000 7f170bfff640 1 -- 172.21.15.120:0/2587429427 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f171c004690 con 0x7f17241069e0 2024-09-19T05:21:14.240 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.236+0000 7f170bfff640 1 -- 172.21.15.120:0/2587429427 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c030de0 con 0x7f17241069e0 2024-09-19T05:21:14.240 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.236+0000 7f17293b7640 1 -- 172.21.15.120:0/2587429427 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17241a4c80 con 0x7f17241069e0 2024-09-19T05:21:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.238+0000 7f172c22a740 1 Processor -- start 2024-09-19T05:21:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.238+0000 7f170bfff640 1 -- 172.21.15.120:0/2587429427 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f171c0305a0 con 0x7f17241069e0 2024-09-19T05:21:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.238+0000 7f172c22a740 1 -- start start 2024-09-19T05:21:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.239+0000 7f172c22a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f859d0 0x5602b4f85db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.239+0000 7f172c22a740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5602b4f862f0 0x5602b4f94b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:14.246 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.239+0000 7f172c22a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5602b4f950c0 0x5602b4f974b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.239+0000 7f172c22a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5602b4eea2f0 con 0x5602b4f859d0 2024-09-19T05:21:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.239+0000 7f172c22a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5602b4e92270 con 0x5602b4f950c0 2024-09-19T05:21:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.239+0000 7f172c22a740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5602b4ee62b0 con 0x5602b4f862f0 2024-09-19T05:21:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.239+0000 7f17227fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f859d0 0x5602b4f85db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.239+0000 7f17227fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f859d0 0x5602b4f85db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58136/0 (socket says 172.21.15.120:58136) 2024-09-19T05:21:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.239+0000 7f17227fc640 1 -- 172.21.15.120:0/3465111525 learned_addr learned my addr 172.21.15.120:0/3465111525 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.239+0000 7f1722ffd640 1 --2- 172.21.15.120:0/3465111525 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5602b4f862f0 0x5602b4f94b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.239+0000 7f17227fc640 1 --2- 172.21.15.120:0/3465111525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5602b4f950c0 0x5602b4f974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.239+0000 7f17227fc640 1 -- 172.21.15.120:0/3465111525 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5602b4f862f0 msgr2=0x5602b4f94b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.239+0000 7f17227fc640 1 --2- 172.21.15.120:0/3465111525 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5602b4f862f0 0x5602b4f94b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.247 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.239+0000 7f17227fc640 1 -- 172.21.15.120:0/3465111525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5602b4f950c0 msgr2=0x5602b4f974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.239+0000 7f17227fc640 1 --2- 172.21.15.120:0/3465111525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5602b4f950c0 0x5602b4f974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.239+0000 7f170bfff640 1 --2- 172.21.15.120:0/2587429427 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f170c0a3460 0x7f170c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.239+0000 7f17227fc640 1 -- 172.21.15.120:0/3465111525 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602b4e91340 con 0x5602b4f859d0 2024-09-19T05:21:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.239+0000 7f1722ffd640 1 --2- 172.21.15.120:0/2587429427 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f170c0a3460 0x7f170c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.239+0000 7f17227fc640 1 --2- 172.21.15.120:0/3465111525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f859d0 0x5602b4f85db0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1718013ad0 tx=0x7f1718009cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5425f5babfb915f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.239+0000 7f170bfff640 1 -- 172.21.15.120:0/2587429427 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f171c02e030 con 0x7f17241069e0 2024-09-19T05:21:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.239+0000 7f17097fa640 1 -- 172.21.15.120:0/3465111525 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171800fa40 con 0x5602b4f859d0 2024-09-19T05:21:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.239+0000 7f17097fa640 1 -- 172.21.15.120:0/3465111525 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f171800fbe0 con 0x5602b4f859d0 2024-09-19T05:21:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.239+0000 7f17097fa640 1 -- 172.21.15.120:0/3465111525 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1718003b60 con 0x5602b4f859d0 2024-09-19T05:21:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.240+0000 7f172c22a740 1 -- 172.21.15.120:0/3465111525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f859d0 msgr2=0x5602b4f85db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.240+0000 7f1722ffd640 1 --2- 172.21.15.120:0/2587429427 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f170c0a3460 0x7f170c0a5920 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x5602b4f886c0 tx=0x7f1714005f90 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:14.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.240+0000 7f172c22a740 1 --2- 172.21.15.120:0/3465111525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f859d0 0x5602b4f85db0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1718013ad0 tx=0x7f1718009cc0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.240+0000 7f172c22a740 1 -- 172.21.15.120:0/3465111525 shutdown_connections 2024-09-19T05:21:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.240+0000 7f172c22a740 1 --2- 172.21.15.120:0/3465111525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5602b4f950c0 0x5602b4f974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.240+0000 7f172c22a740 1 --2- 172.21.15.120:0/3465111525 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5602b4f862f0 0x5602b4f94b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.240+0000 7f172c22a740 1 --2- 172.21.15.120:0/3465111525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f859d0 0x5602b4f85db0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.240+0000 7f172c22a740 1 -- 172.21.15.120:0/3465111525 >> 172.21.15.120:0/3465111525 conn(0x5602b4f82060 msgr2=0x5602b4f82440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.240+0000 7f172c22a740 1 -- 172.21.15.120:0/3465111525 shutdown_connections 2024-09-19T05:21:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.240+0000 7f172c22a740 1 -- 172.21.15.120:0/3465111525 wait complete. 2024-09-19T05:21:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.241+0000 7f172c22a740 1 -- start start 2024-09-19T05:21:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.241+0000 7f172c22a740 1 Processor -- start 2024-09-19T05:21:14.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.241+0000 7f172c22a740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5602b4f859d0 0x5602b4f91ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.241+0000 7f172c22a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f862f0 0x5602b4f92530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.241+0000 7f172c22a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5602b4f950c0 0x5602b4f92a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.241+0000 7f172c22a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5602b4f97cf0 con 0x5602b4f862f0 2024-09-19T05:21:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.241+0000 7f172c22a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5602b4e73290 con 0x5602b4f950c0 2024-09-19T05:21:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.241+0000 7f172c22a740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5602b4f97e70 con 0x5602b4f859d0 2024-09-19T05:21:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.241+0000 7f172c22a740 10 client.0 _ll_register_callbacks cb 0x5602b4ea4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.241+0000 7f17227fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f862f0 0x5602b4f92530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.241+0000 7f17227fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f862f0 0x5602b4f92530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:58140/0 (socket says 172.21.15.120:58140) 2024-09-19T05:21:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.241+0000 7f17227fc640 1 -- 172.21.15.120:0/2672554903 learned_addr learned my addr 172.21.15.120:0/2672554903 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.241+0000 7f1722ffd640 1 --2- 172.21.15.120:0/2672554903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5602b4f859d0 0x5602b4f91ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.241+0000 7f17227fc640 1 -- 172.21.15.120:0/2672554903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5602b4f859d0 msgr2=0x5602b4f91ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:14.250 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.241+0000 7f17227fc640 1 --2- 172.21.15.120:0/2672554903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5602b4f859d0 0x5602b4f91ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.241+0000 7f17227fc640 1 -- 172.21.15.120:0/2672554903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5602b4f950c0 msgr2=0x5602b4f92a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.241+0000 7f17227fc640 1 --2- 172.21.15.120:0/2672554903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5602b4f950c0 0x5602b4f92a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.241+0000 7f17227fc640 1 -- 172.21.15.120:0/2672554903 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602b4bfd210 con 0x5602b4f862f0 2024-09-19T05:21:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.242+0000 7f17227fc640 1 --2- 172.21.15.120:0/2672554903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f862f0 0x5602b4f92530 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1718003740 tx=0x7f1718021bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c5bd0452e244af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.242+0000 7f1706ff5640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:21:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.242+0000 7f1706ff5640 1 -- 172.21.15.120:0/2672554903 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171800fa40 con 0x5602b4f862f0 2024-09-19T05:21:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.242+0000 7f1706ff5640 1 -- 172.21.15.120:0/2672554903 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f17180135a0 con 0x5602b4f862f0 2024-09-19T05:21:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.242+0000 7f172c22a740 1 -- 172.21.15.120:0/2672554903 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f171800fbe0 con 0x5602b4f862f0 2024-09-19T05:21:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.242+0000 7f1706ff5640 1 -- 172.21.15.120:0/2672554903 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1718031050 con 0x5602b4f862f0 2024-09-19T05:21:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.242+0000 7f172c22a740 10 client.15711 fetch_fsmap learned FSMap version 27 2024-09-19T05:21:14.251 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.242+0000 7f172c22a740 1 -- 172.21.15.120:0/2672554903 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5602b4cc9620 con 0x5602b4f862f0 2024-09-19T05:21:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.242+0000 7f1706ff5640 1 -- 172.21.15.120:0/2672554903 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f171800fbe0 con 0x5602b4f862f0 2024-09-19T05:21:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.243+0000 7f1706ff5640 1 -- 172.21.15.120:0/2672554903 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f171801e070 con 0x5602b4f862f0 2024-09-19T05:21:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.243+0000 7f172c22a740 10 client.15711 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:21:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.243+0000 7f172c22a740 10 client.15711 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:21:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.243+0000 7f172c22a740 20 client.15711 populate_metadata read hostname 'smithi120' 2024-09-19T05:21:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.243+0000 7f172c22a740 1 --2- 172.21.15.120:0/2672554903 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5602b4fa4f40 0x5602b4fa7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.243+0000 7f172c22a740 4 client.15711 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:21:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.243+0000 7f172c22a740 1 -- 172.21.15.120:0/2672554903 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602b4ef7a20 con 0x5602b4fa4f40 2024-09-19T05:21:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.243+0000 7f1722ffd640 1 --2- 172.21.15.120:0/2672554903 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5602b4fa4f40 0x5602b4fa7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.243+0000 7f1706ff5640 10 client.15711 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:14.252 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.243+0000 7f1722ffd640 1 --2- 172.21.15.120:0/2672554903 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5602b4fa4f40 0x5602b4fa7330 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40bd661f2202aaf7 server_cookie=c5529d5cd06b2d21 in_seq=0 out_seq=0 2024-09-19T05:21:14.254 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.246+0000 7f1706ff5640 1 -- 172.21.15.120:0/2672554903 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5602b4ef7a20 con 0x5602b4fa4f40 2024-09-19T05:21:14.254 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.246+0000 7f1706ff5640 10 client.15711 handle_command_reply: tid=0 2024-09-19T05:21:14.254 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.246+0000 7f172c22a740 1 client.15711 shutdown 2024-09-19T05:21:14.254 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.246+0000 7f172c22a740 1 -- 172.21.15.120:0/2672554903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f862f0 msgr2=0x5602b4f92530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:14.254 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.246+0000 7f172c22a740 1 --2- 172.21.15.120:0/2672554903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f862f0 0x5602b4f92530 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1718003740 tx=0x7f1718021bd0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.254 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.246+0000 7f172c22a740 1 -- 172.21.15.120:0/2672554903 shutdown_connections 2024-09-19T05:21:14.254 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.246+0000 7f172c22a740 1 --2- 172.21.15.120:0/2672554903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5602b4f950c0 0x5602b4f92a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.254 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.246+0000 7f172c22a740 1 --2- 172.21.15.120:0/2672554903 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f862f0 0x5602b4f92530 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.254 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.246+0000 7f172c22a740 1 --2- 172.21.15.120:0/2672554903 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5602b4fa4f40 0x5602b4fa7330 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.246+0000 7f172c22a740 1 --2- 172.21.15.120:0/2672554903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5602b4f859d0 0x5602b4f91ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.246+0000 7f172c22a740 1 -- 172.21.15.120:0/2672554903 >> 172.21.15.120:0/2672554903 conn(0x5602b4f82060 msgr2=0x5602b4f87dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.246+0000 7f1706ff5640 0 client.15711 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.247+0000 7f172c22a740 1 -- 172.21.15.120:0/2672554903 shutdown_connections 2024-09-19T05:21:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.247+0000 7f172c22a740 1 -- 172.21.15.120:0/2672554903 wait complete. 2024-09-19T05:21:14.255 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.247+0000 7f172c22a740 20 client.15711 trim_cache size 0 max 16384 2024-09-19T05:21:14.265 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.263+0000 7f172c22a740 1 Processor -- start 2024-09-19T05:21:14.265 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.263+0000 7f172c22a740 1 -- start start 2024-09-19T05:21:14.266 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.264+0000 7f172c22a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5602b4f859d0 0x5602b4f93f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:14.266 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.264+0000 7f172c22a740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5602b4f862f0 0x5602b4facbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:14.266 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.264+0000 7f172c22a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f950c0 0x5602b4fad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:14.266 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.264+0000 7f172c22a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f17241addd0 con 0x5602b4f950c0 2024-09-19T05:21:14.266 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.264+0000 7f172c22a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f17241ab6a0 con 0x5602b4f859d0 2024-09-19T05:21:14.266 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.264+0000 7f172c22a740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f17241a94f0 con 0x5602b4f862f0 2024-09-19T05:21:14.266 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.264+0000 7f1722ffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5602b4f859d0 0x5602b4f93f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:14.266 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.264+0000 7f17237fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f950c0 0x5602b4fad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:14.266 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.264+0000 7f17227fc640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5602b4f862f0 0x5602b4facbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:14.266 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.264+0000 7f1722ffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5602b4f859d0 0x5602b4f93f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:33712/0 (socket says 172.21.15.120:33712) 2024-09-19T05:21:14.266 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.264+0000 7f1722ffd640 1 -- 172.21.15.120:0/1944237577 learned_addr learned my addr 172.21.15.120:0/1944237577 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:14.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.264+0000 7f17237fe640 1 -- 172.21.15.120:0/1944237577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5602b4f862f0 msgr2=0x5602b4facbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:14.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.264+0000 7f17237fe640 1 --2- 172.21.15.120:0/1944237577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5602b4f862f0 0x5602b4facbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.264+0000 7f17237fe640 1 -- 172.21.15.120:0/1944237577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5602b4f859d0 msgr2=0x5602b4f93f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:14.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.264+0000 7f17237fe640 1 --2- 172.21.15.120:0/1944237577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5602b4f859d0 0x5602b4f93f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.264+0000 7f17237fe640 1 -- 172.21.15.120:0/1944237577 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602b4fa7960 con 0x5602b4f950c0 2024-09-19T05:21:14.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.264+0000 7f17227fc640 1 --2- 172.21.15.120:0/1944237577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5602b4f862f0 0x5602b4facbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:14.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.265+0000 7f17237fe640 1 --2- 172.21.15.120:0/1944237577 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f950c0 0x5602b4fad130 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f171c0ee620 tx=0x7f171c02a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdaed5a44bdfbecf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:14.271 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.265+0000 7f1708ff9640 1 -- 172.21.15.120:0/1944237577 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c004840 con 0x5602b4f950c0 2024-09-19T05:21:14.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.265+0000 7f1708ff9640 1 -- 172.21.15.120:0/1944237577 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f171c036070 con 0x5602b4f950c0 2024-09-19T05:21:14.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.265+0000 7f1708ff9640 1 -- 172.21.15.120:0/1944237577 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171c0bb580 con 0x5602b4f950c0 2024-09-19T05:21:14.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.266+0000 7f172c22a740 1 -- 172.21.15.120:0/1944237577 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f950c0 msgr2=0x5602b4fad130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:14.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.266+0000 7f172c22a740 1 --2- 172.21.15.120:0/1944237577 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f950c0 0x5602b4fad130 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f171c0ee620 tx=0x7f171c02a8e0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.266+0000 7f172c22a740 1 -- 172.21.15.120:0/1944237577 shutdown_connections 2024-09-19T05:21:14.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.266+0000 7f172c22a740 1 --2- 172.21.15.120:0/1944237577 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f950c0 0x5602b4fad130 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.266+0000 7f172c22a740 1 --2- 172.21.15.120:0/1944237577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5602b4f862f0 0x5602b4facbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.266+0000 7f172c22a740 1 --2- 172.21.15.120:0/1944237577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5602b4f859d0 0x5602b4f93f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.266+0000 7f172c22a740 1 -- 172.21.15.120:0/1944237577 >> 172.21.15.120:0/1944237577 conn(0x5602b4f82060 msgr2=0x5602b4f93850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:14.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.266+0000 7f172c22a740 1 -- 172.21.15.120:0/1944237577 shutdown_connections 2024-09-19T05:21:14.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.266+0000 7f172c22a740 1 -- 172.21.15.120:0/1944237577 wait complete. 2024-09-19T05:21:14.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.266+0000 7f172c22a740 1 -- start start 2024-09-19T05:21:14.272 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.266+0000 7f172c22a740 1 Processor -- start 2024-09-19T05:21:14.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.267+0000 7f172c22a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5602b4f859d0 0x5602b4f9d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:14.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.267+0000 7f172c22a740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5602b4f862f0 0x5602b4f8ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:14.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.267+0000 7f172c22a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f950c0 0x5602b4f8efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:14.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.267+0000 7f172c22a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f17241a9b60 con 0x5602b4f950c0 2024-09-19T05:21:14.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.267+0000 7f172c22a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f17241aafd0 con 0x5602b4f859d0 2024-09-19T05:21:14.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.267+0000 7f172c22a740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f17241aa230 con 0x5602b4f862f0 2024-09-19T05:21:14.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.267+0000 7f172c22a740 10 client.0 _ll_register_callbacks cb 0x7f17140097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:14.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.267+0000 7f17237fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f950c0 0x5602b4f8efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:14.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.267+0000 7f1722ffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5602b4f859d0 0x5602b4f9d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:14.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.267+0000 7f17227fc640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5602b4f862f0 0x5602b4f8ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:14.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.267+0000 7f1722ffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5602b4f859d0 0x5602b4f9d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:33716/0 (socket says 172.21.15.120:33716) 2024-09-19T05:21:14.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.267+0000 7f1722ffd640 1 -- 172.21.15.120:0/1081340638 learned_addr learned my addr 172.21.15.120:0/1081340638 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:14.273 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.267+0000 7f1722ffd640 1 -- 172.21.15.120:0/1081340638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5602b4f862f0 msgr2=0x5602b4f8ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.267+0000 7f1722ffd640 1 --2- 172.21.15.120:0/1081340638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5602b4f862f0 0x5602b4f8ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.267+0000 7f1722ffd640 1 -- 172.21.15.120:0/1081340638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f950c0 msgr2=0x5602b4f8efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.267+0000 7f1722ffd640 1 --2- 172.21.15.120:0/1081340638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f950c0 0x5602b4f8efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.267+0000 7f1722ffd640 1 -- 172.21.15.120:0/1081340638 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602b4f868d0 con 0x5602b4f859d0 2024-09-19T05:21:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.267+0000 7f17237fe640 1 --2- 172.21.15.120:0/1081340638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f950c0 0x5602b4f8efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.267+0000 7f1722ffd640 1 --2- 172.21.15.120:0/1081340638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5602b4f859d0 0x5602b4f9d590 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1714004550 tx=0x7f17140046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c2ec79135a59388 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.267+0000 7f1706ff5640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:21:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.267+0000 7f1706ff5640 1 -- 172.21.15.120:0/1081340638 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1714003c70 con 0x5602b4f859d0 2024-09-19T05:21:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.267+0000 7f1706ff5640 1 -- 172.21.15.120:0/1081340638 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f1714003e10 con 0x5602b4f859d0 2024-09-19T05:21:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.267+0000 7f172c22a740 1 -- 172.21.15.120:0/1081340638 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f171c036070 con 0x5602b4f859d0 2024-09-19T05:21:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.268+0000 7f1706ff5640 1 -- 172.21.15.120:0/1081340638 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f171402b380 con 0x5602b4f859d0 2024-09-19T05:21:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.268+0000 7f172c22a740 10 client.25175 fetch_fsmap learned FSMap version 27 2024-09-19T05:21:14.274 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.268+0000 7f172c22a740 1 -- 172.21.15.120:0/1081340638 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5602b500f7f0 con 0x5602b4f859d0 2024-09-19T05:21:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.268+0000 7f1706ff5640 1 -- 172.21.15.120:0/1081340638 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f171c036070 con 0x5602b4f859d0 2024-09-19T05:21:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.268+0000 7f1706ff5640 1 -- 172.21.15.120:0/1081340638 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f171401f800 con 0x5602b4f859d0 2024-09-19T05:21:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.268+0000 7f172c22a740 10 client.25175 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:21:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.268+0000 7f172c22a740 10 client.25175 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:21:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.268+0000 7f172c22a740 20 client.25175 populate_metadata read hostname 'smithi120' 2024-09-19T05:21:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.268+0000 7f172c22a740 1 --2- 172.21.15.120:0/1081340638 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5602b5010080 0x5602b50124a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.268+0000 7f172c22a740 4 client.25175 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:21:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.268+0000 7f172c22a740 1 -- 172.21.15.120:0/1081340638 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5602b4ef1d70 con 0x5602b5010080 2024-09-19T05:21:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.268+0000 7f17227fc640 1 --2- 172.21.15.120:0/1081340638 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5602b5010080 0x5602b50124a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.268+0000 7f1706ff5640 10 client.25175 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:14.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.268+0000 7f17227fc640 1 --2- 172.21.15.120:0/1081340638 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5602b5010080 0x5602b50124a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a46023e6b650b5b server_cookie=3630d01224961616 in_seq=0 out_seq=0 2024-09-19T05:21:14.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:14 smithi178 ceph-mon[34347]: pgmap v63: 97 pgs: 97 active+clean; 119 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.8 MiB/s wr, 534 op/s 2024-09-19T05:21:14.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.805+0000 7f1706ff5640 1 -- 172.21.15.120:0/1081340638 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5602b4ef1d70 con 0x5602b5010080 2024-09-19T05:21:14.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.805+0000 7f1706ff5640 10 client.25175 handle_command_reply: tid=0 2024-09-19T05:21:14.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.805+0000 7f172c22a740 1 client.25175 shutdown 2024-09-19T05:21:14.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.805+0000 7f172c22a740 1 -- 172.21.15.120:0/1081340638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5602b4f859d0 msgr2=0x5602b4f9d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:14.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.805+0000 7f172c22a740 1 --2- 172.21.15.120:0/1081340638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5602b4f859d0 0x5602b4f9d590 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1714004550 tx=0x7f17140046c0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.806+0000 7f172c22a740 1 -- 172.21.15.120:0/1081340638 shutdown_connections 2024-09-19T05:21:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.806+0000 7f172c22a740 1 --2- 172.21.15.120:0/1081340638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5602b4f950c0 0x5602b4f8efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.806+0000 7f172c22a740 1 --2- 172.21.15.120:0/1081340638 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5602b5010080 0x5602b50124a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.806+0000 7f172c22a740 1 --2- 172.21.15.120:0/1081340638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5602b4f862f0 0x5602b4f8ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.806+0000 7f1706ff5640 0 client.25175 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.806+0000 7f172c22a740 1 --2- 172.21.15.120:0/1081340638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5602b4f859d0 0x5602b4f9d590 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.806+0000 7f172c22a740 1 -- 172.21.15.120:0/1081340638 >> 172.21.15.120:0/1081340638 conn(0x5602b4f82060 msgr2=0x5602b4f811c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.806+0000 7f172c22a740 1 -- 172.21.15.120:0/1081340638 shutdown_connections 2024-09-19T05:21:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.806+0000 7f172c22a740 1 -- 172.21.15.120:0/1081340638 wait complete. 2024-09-19T05:21:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.806+0000 7f172c22a740 20 client.25175 trim_cache size 0 max 16384 2024-09-19T05:21:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:21:14.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:21:14.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:21:14.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:21:14.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.806+0000 7f17293b7640 1 -- 172.21.15.120:0/2587429427 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f170c0a3460 msgr2=0x7f170c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.806+0000 7f17293b7640 1 --2- 172.21.15.120:0/2587429427 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f170c0a3460 0x7f170c0a5920 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x5602b4f886c0 tx=0x7f1714005f90 comp rx=0 tx=0).stop 2024-09-19T05:21:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.806+0000 7f17293b7640 1 -- 172.21.15.120:0/2587429427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17241069e0 msgr2=0x7f17241a40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.807+0000 7f17293b7640 1 --2- 172.21.15.120:0/2587429427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17241069e0 0x7f17241a40b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f171c009ca0 tx=0x7f171c003970 comp rx=0 tx=0).stop 2024-09-19T05:21:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.807+0000 7f17293b7640 1 -- 172.21.15.120:0/2587429427 shutdown_connections 2024-09-19T05:21:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.807+0000 7f17293b7640 1 --2- 172.21.15.120:0/2587429427 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f170c0a3460 0x7f170c0a5920 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.807+0000 7f17293b7640 1 --2- 172.21.15.120:0/2587429427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17241069e0 0x7f17241a40b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.807+0000 7f17293b7640 1 --2- 172.21.15.120:0/2587429427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1724101370 0x7f1724199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.807+0000 7f17293b7640 1 --2- 172.21.15.120:0/2587429427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17241009d0 0x7f1724199030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.807+0000 7f17293b7640 1 -- 172.21.15.120:0/2587429427 >> 172.21.15.120:0/2587429427 conn(0x7f17240fc6f0 msgr2=0x7f17240fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.807+0000 7f17293b7640 1 -- 172.21.15.120:0/2587429427 shutdown_connections 2024-09-19T05:21:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:14.807+0000 7f17293b7640 1 -- 172.21.15.120:0/2587429427 wait complete. 2024-09-19T05:21:14.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:14 smithi120 ceph-mon[30956]: pgmap v63: 97 pgs: 97 active+clean; 119 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.8 MiB/s wr, 534 op/s 2024-09-19T05:21:14.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:14 smithi194 ceph-mon[35228]: pgmap v63: 97 pgs: 97 active+clean; 119 MiB data, 797 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.8 MiB/s wr, 534 op/s 2024-09-19T05:21:16.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:16 smithi178 ceph-mon[34347]: pgmap v64: 97 pgs: 97 active+clean; 131 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.6 MiB/s wr, 987 op/s 2024-09-19T05:21:16.707 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:16 smithi194 ceph-mon[35228]: pgmap v64: 97 pgs: 97 active+clean; 131 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.6 MiB/s wr, 987 op/s 2024-09-19T05:21:16.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:16 smithi120 ceph-mon[30956]: pgmap v64: 97 pgs: 97 active+clean; 131 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.6 MiB/s wr, 987 op/s 2024-09-19T05:21:18.314 INFO:tasks.workunit.client.0.smithi120.stdout:write(): Bad file descriptor 54 3820 943 1385 709 674 264 2024-09-19T05:21:18.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:18 smithi178 ceph-mon[34347]: pgmap v65: 97 pgs: 97 active+clean; 131 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.6 MiB/s wr, 613 op/s 2024-09-19T05:21:18.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:18 smithi120 ceph-mon[30956]: pgmap v65: 97 pgs: 97 active+clean; 131 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.6 MiB/s wr, 613 op/s 2024-09-19T05:21:18.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:18 smithi194 ceph-mon[35228]: pgmap v65: 97 pgs: 97 active+clean; 131 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.6 MiB/s wr, 613 op/s 2024-09-19T05:21:20.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:20 smithi178 ceph-mon[34347]: pgmap v66: 97 pgs: 97 active+clean; 159 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.1 MiB/s wr, 781 op/s 2024-09-19T05:21:20.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:20 smithi120 ceph-mon[30956]: pgmap v66: 97 pgs: 97 active+clean; 159 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.1 MiB/s wr, 781 op/s 2024-09-19T05:21:20.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:20 smithi194 ceph-mon[35228]: pgmap v66: 97 pgs: 97 active+clean; 159 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.1 MiB/s wr, 781 op/s 2024-09-19T05:21:22.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:22 smithi178 ceph-mon[34347]: pgmap v67: 97 pgs: 97 active+clean; 159 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.3 MiB/s wr, 620 op/s 2024-09-19T05:21:22.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:22 smithi120 ceph-mon[30956]: pgmap v67: 97 pgs: 97 active+clean; 159 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.3 MiB/s wr, 620 op/s 2024-09-19T05:21:22.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:22 smithi194 ceph-mon[35228]: pgmap v67: 97 pgs: 97 active+clean; 159 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.3 MiB/s wr, 620 op/s 2024-09-19T05:21:24.363 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T05:21:24.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:24 smithi178 ceph-mon[34347]: pgmap v68: 97 pgs: 97 active+clean; 159 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.3 MiB/s wr, 620 op/s 2024-09-19T05:21:24.721 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:24.848 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:24 smithi120 ceph-mon[30956]: pgmap v68: 97 pgs: 97 active+clean; 159 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.3 MiB/s wr, 620 op/s 2024-09-19T05:21:24.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:24 smithi194 ceph-mon[35228]: pgmap v68: 97 pgs: 97 active+clean; 159 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.3 MiB/s wr, 620 op/s 2024-09-19T05:21:25.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.256+0000 7fcf0c6cb640 1 -- 172.21.15.120:0/1173395062 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf04101df0 msgr2=0x7fcf041021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:25.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.256+0000 7fcf0c6cb640 1 --2- 172.21.15.120:0/1173395062 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf04101df0 0x7fcf041021d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fcf00009900 tx=0x7fcf0002a410 comp rx=0 tx=0).stop 2024-09-19T05:21:25.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.256+0000 7fcf0c6cb640 1 -- 172.21.15.120:0/1173395062 shutdown_connections 2024-09-19T05:21:25.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.256+0000 7fcf0c6cb640 1 --2- 172.21.15.120:0/1173395062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf04106f20 0x7fcf0410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.256+0000 7fcf0c6cb640 1 --2- 172.21.15.120:0/1173395062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf041027a0 0x7fcf041067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.256+0000 7fcf0c6cb640 1 --2- 172.21.15.120:0/1173395062 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf04101df0 0x7fcf041021d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.256+0000 7fcf0c6cb640 1 -- 172.21.15.120:0/1173395062 >> 172.21.15.120:0/1173395062 conn(0x7fcf040fd8f0 msgr2=0x7fcf040ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:25.259 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.257+0000 7fcf0c6cb640 1 -- 172.21.15.120:0/1173395062 shutdown_connections 2024-09-19T05:21:25.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.257+0000 7fcf0c6cb640 1 -- 172.21.15.120:0/1173395062 wait complete. 2024-09-19T05:21:25.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.257+0000 7fcf0c6cb640 1 Processor -- start 2024-09-19T05:21:25.260 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.258+0000 7fcf0c6cb640 1 -- start start 2024-09-19T05:21:25.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.258+0000 7fcf0c6cb640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf04101df0 0x7fcf04075ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:25.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.258+0000 7fcf0c6cb640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf041027a0 0x7fcf04075ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:25.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.258+0000 7fcf0c6cb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf04106f20 0x7fcf0406cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:25.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.258+0000 7fcf0c6cb640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcf04111e40 con 0x7fcf04106f20 2024-09-19T05:21:25.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.258+0000 7fcf0c6cb640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fcf04111cc0 con 0x7fcf041027a0 2024-09-19T05:21:25.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.258+0000 7fcf0c6cb640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcf04111fc0 con 0x7fcf04101df0 2024-09-19T05:21:25.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.258+0000 7fcf09c66640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf041027a0 0x7fcf04075ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:25.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.258+0000 7fcf09c66640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf041027a0 0x7fcf04075ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:59366/0 (socket says 172.21.15.120:59366) 2024-09-19T05:21:25.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.258+0000 7fcf09c66640 1 -- 172.21.15.120:0/1182170766 learned_addr learned my addr 172.21.15.120:0/1182170766 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:25.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.258+0000 7fcf0a467640 1 --2- 172.21.15.120:0/1182170766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf04101df0 0x7fcf04075ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:25.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.258+0000 7fcf0ac68640 1 --2- 172.21.15.120:0/1182170766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf04106f20 0x7fcf0406cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:25.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.259+0000 7fcf09c66640 1 -- 172.21.15.120:0/1182170766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf04101df0 msgr2=0x7fcf04075ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:25.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.259+0000 7fcf09c66640 1 --2- 172.21.15.120:0/1182170766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf04101df0 0x7fcf04075ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.259+0000 7fcf09c66640 1 -- 172.21.15.120:0/1182170766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf04106f20 msgr2=0x7fcf0406cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:25.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.259+0000 7fcf09c66640 1 --2- 172.21.15.120:0/1182170766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf04106f20 0x7fcf0406cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.259+0000 7fcf09c66640 1 -- 172.21.15.120:0/1182170766 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf0406d480 con 0x7fcf041027a0 2024-09-19T05:21:25.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.259+0000 7fcf09c66640 1 --2- 172.21.15.120:0/1182170766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf041027a0 0x7fcf04075ff0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcef400e9f0 tx=0x7fcef400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:25.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.259+0000 7fcefb7fe640 1 -- 172.21.15.120:0/1182170766 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef400cd80 con 0x7fcf041027a0 2024-09-19T05:21:25.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.259+0000 7fcf0c6cb640 1 -- 172.21.15.120:0/1182170766 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf0406d770 con 0x7fcf041027a0 2024-09-19T05:21:25.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.259+0000 7fcefb7fe640 1 -- 172.21.15.120:0/1182170766 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcef40108e0 con 0x7fcf041027a0 2024-09-19T05:21:25.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.260+0000 7fcefb7fe640 1 -- 172.21.15.120:0/1182170766 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef4018920 con 0x7fcf041027a0 2024-09-19T05:21:25.263 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.260+0000 7fcf0c6cb640 1 -- 172.21.15.120:0/1182170766 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf04071730 con 0x7fcf041027a0 2024-09-19T05:21:25.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.263+0000 7fcefb7fe640 1 -- 172.21.15.120:0/1182170766 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fcef4010a90 con 0x7fcf041027a0 2024-09-19T05:21:25.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.263+0000 7fcf0eaa4740 1 Processor -- start 2024-09-19T05:21:25.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.264+0000 7fcf0eaa4740 1 -- start start 2024-09-19T05:21:25.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.264+0000 7fcf0eaa4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c16a0d4a0 0x562c16a0d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:25.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.264+0000 7fcf0eaa4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a0ddc0 0x562c16a18140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:25.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.264+0000 7fcf0eaa4740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c16a18680 0x562c16a1aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:25.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.264+0000 7fcf0eaa4740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562c169732e0 con 0x562c16a18680 2024-09-19T05:21:25.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.264+0000 7fcf0eaa4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x562c1691ace0 con 0x562c16a0d4a0 2024-09-19T05:21:25.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.264+0000 7fcf0eaa4740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562c1696f2a0 con 0x562c16a0ddc0 2024-09-19T05:21:25.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.264+0000 7fcefb7fe640 1 --2- 172.21.15.120:0/1182170766 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fcef00a3430 0x7fcef00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:25.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.264+0000 7fcf0a467640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a0ddc0 0x562c16a18140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:25.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.264+0000 7fcf0a467640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a0ddc0 0x562c16a18140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:50744/0 (socket says 172.21.15.120:50744) 2024-09-19T05:21:25.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.264+0000 7fcf0a467640 1 -- 172.21.15.120:0/488022544 learned_addr learned my addr 172.21.15.120:0/488022544 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:25.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.264+0000 7fcefb7fe640 1 -- 172.21.15.120:0/1182170766 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fcef40d0100 con 0x7fcf041027a0 2024-09-19T05:21:25.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.264+0000 7fcf09c66640 1 --2- 172.21.15.120:0/488022544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c16a18680 0x562c16a1aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:25.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.264+0000 7fcf0ac68640 1 --2- 172.21.15.120:0/488022544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c16a0d4a0 0x562c16a0d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:25.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.265+0000 7fcf0a467640 1 -- 172.21.15.120:0/488022544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c16a0d4a0 msgr2=0x562c16a0d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:25.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.265+0000 7fcf0a467640 1 --2- 172.21.15.120:0/488022544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c16a0d4a0 0x562c16a0d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.265+0000 7fcf0a467640 1 -- 172.21.15.120:0/488022544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c16a18680 msgr2=0x562c16a1aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:25.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.265+0000 7fcf0a467640 1 --2- 172.21.15.120:0/488022544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c16a18680 0x562c16a1aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.265+0000 7fcf0a467640 1 -- 172.21.15.120:0/488022544 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c168ff440 con 0x562c16a0ddc0 2024-09-19T05:21:25.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.265+0000 7fcf0ac68640 1 --2- 172.21.15.120:0/1182170766 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fcef00a3430 0x7fcef00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:25.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.265+0000 7fcf0a467640 1 --2- 172.21.15.120:0/488022544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a0ddc0 0x562c16a18140 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcf00009900 tx=0x7fcf000040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f66119d2e84bfd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:25.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.265+0000 7fcef8ff9640 1 -- 172.21.15.120:0/488022544 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf00035030 con 0x562c16a0ddc0 2024-09-19T05:21:25.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.265+0000 7fcef8ff9640 1 -- 172.21.15.120:0/488022544 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcf000054f0 con 0x562c16a0ddc0 2024-09-19T05:21:25.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.266+0000 7fcef8ff9640 1 -- 172.21.15.120:0/488022544 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf000035f0 con 0x562c16a0ddc0 2024-09-19T05:21:25.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.266+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/488022544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a0ddc0 msgr2=0x562c16a18140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:25.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.266+0000 7fcf0ac68640 1 --2- 172.21.15.120:0/1182170766 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fcef00a3430 0x7fcef00a58f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcefc005fd0 tx=0x7fcefc004ab0 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:25.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.266+0000 7fcf0eaa4740 1 --2- 172.21.15.120:0/488022544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a0ddc0 0x562c16a18140 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcf00009900 tx=0x7fcf000040c0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.266+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/488022544 shutdown_connections 2024-09-19T05:21:25.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.266+0000 7fcf0eaa4740 1 --2- 172.21.15.120:0/488022544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c16a18680 0x562c16a1aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.266+0000 7fcf0eaa4740 1 --2- 172.21.15.120:0/488022544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a0ddc0 0x562c16a18140 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.266+0000 7fcf0eaa4740 1 --2- 172.21.15.120:0/488022544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c16a0d4a0 0x562c16a0d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.266+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/488022544 >> 172.21.15.120:0/488022544 conn(0x562c16a09a30 msgr2=0x562c16a09e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:25.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.267+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/488022544 shutdown_connections 2024-09-19T05:21:25.270 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.267+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/488022544 wait complete. 2024-09-19T05:21:25.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.267+0000 7fcf0eaa4740 1 -- start start 2024-09-19T05:21:25.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.267+0000 7fcf0eaa4740 1 Processor -- start 2024-09-19T05:21:25.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.268+0000 7fcf0eaa4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a0d4a0 0x562c16a17f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:25.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.268+0000 7fcf0eaa4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c16a0ddc0 0x562c16a151e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:25.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.268+0000 7fcf0eaa4740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c16a18680 0x562c16a15720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:25.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.268+0000 7fcf0eaa4740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x562c16a1b2f0 con 0x562c16a18680 2024-09-19T05:21:25.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.268+0000 7fcf0eaa4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x562c1692e050 con 0x562c16a0ddc0 2024-09-19T05:21:25.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.268+0000 7fcf0eaa4740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562c16a1b470 con 0x562c16a0d4a0 2024-09-19T05:21:25.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.268+0000 7fcf0eaa4740 10 client.0 _ll_register_callbacks cb 0x562c1696e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:25.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.268+0000 7fcf0a467640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a0d4a0 0x562c16a17f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:25.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.268+0000 7fcf0a467640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a0d4a0 0x562c16a17f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:50748/0 (socket says 172.21.15.120:50748) 2024-09-19T05:21:25.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.268+0000 7fcf0a467640 1 -- 172.21.15.120:0/219868548 learned_addr learned my addr 172.21.15.120:0/219868548 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:25.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.268+0000 7fcf0ac68640 1 --2- 172.21.15.120:0/219868548 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c16a18680 0x562c16a15720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:25.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.268+0000 7fcf09c66640 1 --2- 172.21.15.120:0/219868548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c16a0ddc0 0x562c16a151e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:25.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.268+0000 7fcf0a467640 1 -- 172.21.15.120:0/219868548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c16a0ddc0 msgr2=0x562c16a151e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:25.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.268+0000 7fcf0a467640 1 --2- 172.21.15.120:0/219868548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c16a0ddc0 0x562c16a151e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.268+0000 7fcf0a467640 1 -- 172.21.15.120:0/219868548 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c16a18680 msgr2=0x562c16a15720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:25.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.268+0000 7fcf0a467640 1 --2- 172.21.15.120:0/219868548 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c16a18680 0x562c16a15720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.268+0000 7fcf0a467640 1 -- 172.21.15.120:0/219868548 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c166e43c0 con 0x562c16a0d4a0 2024-09-19T05:21:25.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.269+0000 7fcf0a467640 1 --2- 172.21.15.120:0/219868548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a0d4a0 0x562c16a17f30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcf0002a450 tx=0x7fcf000048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19ce0900642a37c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:25.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.269+0000 7fceedffb640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:21:25.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.269+0000 7fceedffb640 1 -- 172.21.15.120:0/219868548 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf00035030 con 0x562c16a0d4a0 2024-09-19T05:21:25.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.269+0000 7fceedffb640 1 -- 172.21.15.120:0/219868548 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fcf000050b0 con 0x562c16a0d4a0 2024-09-19T05:21:25.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.269+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/219868548 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf000054f0 con 0x562c16a0d4a0 2024-09-19T05:21:25.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.269+0000 7fceedffb640 1 -- 172.21.15.120:0/219868548 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcf000052d0 con 0x562c16a0d4a0 2024-09-19T05:21:25.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.269+0000 7fcf0eaa4740 10 client.25258 fetch_fsmap learned FSMap version 27 2024-09-19T05:21:25.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.269+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/219868548 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562c16a1b2f0 con 0x562c16a0d4a0 2024-09-19T05:21:25.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.269+0000 7fceedffb640 1 -- 172.21.15.120:0/219868548 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcf000054f0 con 0x562c16a0d4a0 2024-09-19T05:21:25.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.270+0000 7fceedffb640 1 -- 172.21.15.120:0/219868548 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fcf00031700 con 0x562c16a0d4a0 2024-09-19T05:21:25.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.270+0000 7fcf0eaa4740 10 client.25258 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:21:25.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.270+0000 7fcf0eaa4740 10 client.25258 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:21:25.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.270+0000 7fcf0eaa4740 20 client.25258 populate_metadata read hostname 'smithi120' 2024-09-19T05:21:25.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.270+0000 7fcf0eaa4740 1 --2- 172.21.15.120:0/219868548 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x562c16a27de0 0x562c16a2a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:25.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.270+0000 7fcf0eaa4740 4 client.25258 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:21:25.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.270+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/219868548 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c16980850 con 0x562c16a27de0 2024-09-19T05:21:25.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.270+0000 7fcf09c66640 1 --2- 172.21.15.120:0/219868548 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x562c16a27de0 0x562c16a2a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:25.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.270+0000 7fcf09c66640 1 --2- 172.21.15.120:0/219868548 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x562c16a27de0 0x562c16a2a1d0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d78c619924893076 server_cookie=e6093989b71fbc57 in_seq=0 out_seq=0 2024-09-19T05:21:25.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.270+0000 7fceedffb640 10 client.25258 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:25.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.274+0000 7fceedffb640 1 -- 172.21.15.120:0/219868548 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562c16980850 con 0x562c16a27de0 2024-09-19T05:21:25.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.274+0000 7fceedffb640 10 client.25258 handle_command_reply: tid=0 2024-09-19T05:21:25.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.274+0000 7fcf0eaa4740 1 client.25258 shutdown 2024-09-19T05:21:25.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.275+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/219868548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a0d4a0 msgr2=0x562c16a17f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:25.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.275+0000 7fcf0eaa4740 1 --2- 172.21.15.120:0/219868548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a0d4a0 0x562c16a17f30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcf0002a450 tx=0x7fcf000048f0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.275+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/219868548 shutdown_connections 2024-09-19T05:21:25.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.275+0000 7fcf0eaa4740 1 --2- 172.21.15.120:0/219868548 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c16a18680 0x562c16a15720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.275+0000 7fcf0eaa4740 1 --2- 172.21.15.120:0/219868548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c16a0ddc0 0x562c16a151e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.275+0000 7fcf0eaa4740 1 --2- 172.21.15.120:0/219868548 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x562c16a27de0 0x562c16a2a1d0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.275+0000 7fcf0eaa4740 1 --2- 172.21.15.120:0/219868548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a0d4a0 0x562c16a17f30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.275+0000 7fceedffb640 0 client.25258 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:25.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.275+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/219868548 >> 172.21.15.120:0/219868548 conn(0x562c16a09a30 msgr2=0x562c16a0f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:25.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.275+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/219868548 shutdown_connections 2024-09-19T05:21:25.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.275+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/219868548 wait complete. 2024-09-19T05:21:25.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.275+0000 7fcf0eaa4740 20 client.25258 trim_cache size 0 max 16384 2024-09-19T05:21:25.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.302+0000 7fcf0eaa4740 1 Processor -- start 2024-09-19T05:21:25.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.302+0000 7fcf0eaa4740 1 -- start start 2024-09-19T05:21:25.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.302+0000 7fcf0eaa4740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c16a09a30 0x562c16a13ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:25.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.302+0000 7fcf0eaa4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a0d4a0 0x562c16a2f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:25.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.302+0000 7fcf0eaa4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c16a0ddc0 0x562c16a2fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:25.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.302+0000 7fcf0eaa4740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcf041bef30 con 0x562c16a09a30 2024-09-19T05:21:25.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.302+0000 7fcf0eaa4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fcf041bc800 con 0x562c16a0ddc0 2024-09-19T05:21:25.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.302+0000 7fcf0eaa4740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcf041ba650 con 0x562c16a0d4a0 2024-09-19T05:21:25.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.302+0000 7fcf0a467640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c16a09a30 0x562c16a13ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:25.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.302+0000 7fcf09c66640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a0d4a0 0x562c16a2f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:25.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.303+0000 7fcf0a467640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c16a09a30 0x562c16a13ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49880/0 (socket says 172.21.15.120:49880) 2024-09-19T05:21:25.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.303+0000 7fcf0a467640 1 -- 172.21.15.120:0/2784188516 learned_addr learned my addr 172.21.15.120:0/2784188516 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:25.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.303+0000 7fcf09c66640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a0d4a0 0x562c16a2f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:50762/0 (socket says 172.21.15.120:50762) 2024-09-19T05:21:25.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.303+0000 7fcf0ac68640 1 --2- 172.21.15.120:0/2784188516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c16a0ddc0 0x562c16a2fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:25.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.303+0000 7fcf0a467640 1 -- 172.21.15.120:0/2784188516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a0d4a0 msgr2=0x562c16a2f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:25.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.303+0000 7fcf0a467640 1 --2- 172.21.15.120:0/2784188516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a0d4a0 0x562c16a2f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.303+0000 7fcf0a467640 1 -- 172.21.15.120:0/2784188516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c16a0ddc0 msgr2=0x562c16a2fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:25.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.303+0000 7fcf0a467640 1 --2- 172.21.15.120:0/2784188516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c16a0ddc0 0x562c16a2fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.303+0000 7fcf0a467640 1 -- 172.21.15.120:0/2784188516 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c16a182a0 con 0x562c16a09a30 2024-09-19T05:21:25.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.303+0000 7fcf09c66640 1 --2- 172.21.15.120:0/2784188516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a0d4a0 0x562c16a2f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:25.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.303+0000 7fcf0ac68640 1 --2- 172.21.15.120:0/2784188516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c16a0ddc0 0x562c16a2fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:25.307 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.303+0000 7fcf0a467640 1 --2- 172.21.15.120:0/2784188516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c16a09a30 0x562c16a13ab0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fcf00031ad0 tx=0x7fcf000040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44e567c34ea8239 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:25.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.304+0000 7fceeffff640 1 -- 172.21.15.120:0/2784188516 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf00035070 con 0x562c16a09a30 2024-09-19T05:21:25.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.304+0000 7fceeffff640 1 -- 172.21.15.120:0/2784188516 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcf00049070 con 0x562c16a09a30 2024-09-19T05:21:25.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.304+0000 7fceeffff640 1 -- 172.21.15.120:0/2784188516 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf00003bc0 con 0x562c16a09a30 2024-09-19T05:21:25.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.305+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/2784188516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c16a09a30 msgr2=0x562c16a13ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:25.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.305+0000 7fcf0eaa4740 1 --2- 172.21.15.120:0/2784188516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c16a09a30 0x562c16a13ab0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fcf00031ad0 tx=0x7fcf000040c0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.305+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/2784188516 shutdown_connections 2024-09-19T05:21:25.308 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.305+0000 7fcf0eaa4740 1 --2- 172.21.15.120:0/2784188516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c16a0ddc0 0x562c16a2fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.305+0000 7fcf0eaa4740 1 --2- 172.21.15.120:0/2784188516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a0d4a0 0x562c16a2f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.305+0000 7fcf0eaa4740 1 --2- 172.21.15.120:0/2784188516 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c16a09a30 0x562c16a13ab0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.305+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/2784188516 >> 172.21.15.120:0/2784188516 conn(0x562c16a15880 msgr2=0x562c16a08b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:25.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.305+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/2784188516 shutdown_connections 2024-09-19T05:21:25.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.305+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/2784188516 wait complete. 2024-09-19T05:21:25.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.306+0000 7fcf0eaa4740 1 -- start start 2024-09-19T05:21:25.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.306+0000 7fcf0eaa4740 1 Processor -- start 2024-09-19T05:21:25.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.306+0000 7fcf0eaa4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a09a30 0x562c16a1c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:25.309 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.306+0000 7fcf0eaa4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c16a0d4a0 0x562c16a1c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:25.311 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.306+0000 7fcf0eaa4740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c16a0ddc0 0x562c16a1ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:25.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.306+0000 7fcf0a467640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a09a30 0x562c16a1c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:25.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.307+0000 7fcf0a467640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a09a30 0x562c16a1c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:50768/0 (socket says 172.21.15.120:50768) 2024-09-19T05:21:25.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.307+0000 7fcf0a467640 1 -- 172.21.15.120:0/2470163460 learned_addr learned my addr 172.21.15.120:0/2470163460 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:25.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.307+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/2470163460 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fcf041bacc0 con 0x562c16a0ddc0 2024-09-19T05:21:25.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.307+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/2470163460 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fcf041bc130 con 0x562c16a0d4a0 2024-09-19T05:21:25.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.307+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/2470163460 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcf041bb390 con 0x562c16a09a30 2024-09-19T05:21:25.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.307+0000 7fcf09c66640 1 --2- 172.21.15.120:0/2470163460 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c16a0d4a0 0x562c16a1c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:25.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.307+0000 7fcf0eaa4740 10 client.0 _ll_register_callbacks cb 0x7fcefc0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:25.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.307+0000 7fcf0ac68640 1 --2- 172.21.15.120:0/2470163460 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c16a0ddc0 0x562c16a1ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:25.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.307+0000 7fcf09c66640 1 -- 172.21.15.120:0/2470163460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a09a30 msgr2=0x562c16a1c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:25.312 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.307+0000 7fcf09c66640 1 --2- 172.21.15.120:0/2470163460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a09a30 0x562c16a1c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.307+0000 7fcf09c66640 1 -- 172.21.15.120:0/2470163460 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c16a0ddc0 msgr2=0x562c16a1ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:25.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.307+0000 7fcf09c66640 1 --2- 172.21.15.120:0/2470163460 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c16a0ddc0 0x562c16a1ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.307+0000 7fcf09c66640 1 -- 172.21.15.120:0/2470163460 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c16a91980 con 0x562c16a0d4a0 2024-09-19T05:21:25.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.307+0000 7fcf0ac68640 1 --2- 172.21.15.120:0/2470163460 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c16a0ddc0 0x562c16a1ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:21:25.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.307+0000 7fcf09c66640 1 --2- 172.21.15.120:0/2470163460 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c16a0d4a0 0x562c16a1c900 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcef40cd7a0 tx=0x7fcef40cf040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea88fba364612a79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:25.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.307+0000 7fceedffb640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:21:25.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.307+0000 7fceedffb640 1 -- 172.21.15.120:0/2470163460 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef40cda20 con 0x562c16a0d4a0 2024-09-19T05:21:25.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.307+0000 7fceedffb640 1 -- 172.21.15.120:0/2470163460 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fcef40cdbc0 con 0x562c16a0d4a0 2024-09-19T05:21:25.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.308+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/2470163460 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf00049070 con 0x562c16a0d4a0 2024-09-19T05:21:25.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.308+0000 7fceedffb640 1 -- 172.21.15.120:0/2470163460 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcef40b5200 con 0x562c16a0d4a0 2024-09-19T05:21:25.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.308+0000 7fcf0eaa4740 10 client.25193 fetch_fsmap learned FSMap version 27 2024-09-19T05:21:25.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.308+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/2470163460 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562c16a92bd0 con 0x562c16a0d4a0 2024-09-19T05:21:25.313 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.308+0000 7fceedffb640 1 -- 172.21.15.120:0/2470163460 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fcf00049070 con 0x562c16a0d4a0 2024-09-19T05:21:25.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.308+0000 7fceedffb640 1 -- 172.21.15.120:0/2470163460 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fcef409b780 con 0x562c16a0d4a0 2024-09-19T05:21:25.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.308+0000 7fcf0eaa4740 10 client.25193 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:21:25.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.308+0000 7fcf0eaa4740 10 client.25193 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:21:25.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.308+0000 7fcf0eaa4740 20 client.25193 populate_metadata read hostname 'smithi120' 2024-09-19T05:21:25.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.308+0000 7fcf0eaa4740 1 --2- 172.21.15.120:0/2470163460 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x562c16a18680 0x562c16a953a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:25.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.308+0000 7fcf0eaa4740 4 client.25193 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:21:25.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.308+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/2470163460 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562c1697ad60 con 0x562c16a18680 2024-09-19T05:21:25.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.309+0000 7fcf0a467640 1 --2- 172.21.15.120:0/2470163460 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x562c16a18680 0x562c16a953a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:25.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.309+0000 7fcf0a467640 1 --2- 172.21.15.120:0/2470163460 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x562c16a18680 0x562c16a953a0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c76881b59e98bbff server_cookie=6387e1334d85e014 in_seq=0 out_seq=0 2024-09-19T05:21:25.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.309+0000 7fceedffb640 10 client.25193 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:25.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.309+0000 7fceedffb640 1 -- 172.21.15.120:0/2470163460 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562c1697ad60 con 0x562c16a18680 2024-09-19T05:21:25.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.309+0000 7fceedffb640 10 client.25193 handle_command_reply: tid=0 2024-09-19T05:21:25.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.309+0000 7fcf0eaa4740 1 client.25193 shutdown 2024-09-19T05:21:25.314 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.309+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/2470163460 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c16a0d4a0 msgr2=0x562c16a1c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:25.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.309+0000 7fcf0eaa4740 1 --2- 172.21.15.120:0/2470163460 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c16a0d4a0 0x562c16a1c900 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcef40cd7a0 tx=0x7fcef40cf040 comp rx=0 tx=0).stop 2024-09-19T05:21:25.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.310+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/2470163460 shutdown_connections 2024-09-19T05:21:25.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.310+0000 7fcf0eaa4740 1 --2- 172.21.15.120:0/2470163460 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x562c16a0ddc0 0x562c16a1ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.310+0000 7fcf0eaa4740 1 --2- 172.21.15.120:0/2470163460 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562c16a0d4a0 0x562c16a1c900 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.310+0000 7fcf0eaa4740 1 --2- 172.21.15.120:0/2470163460 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x562c16a18680 0x562c16a953a0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.310+0000 7fcf0eaa4740 1 --2- 172.21.15.120:0/2470163460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c16a09a30 0x562c16a1c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.310+0000 7fceedffb640 0 client.25193 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:25.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.310+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/2470163460 >> 172.21.15.120:0/2470163460 conn(0x562c16a15880 msgr2=0x562c16a16a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:25.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.310+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/2470163460 shutdown_connections 2024-09-19T05:21:25.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.310+0000 7fcf0eaa4740 1 -- 172.21.15.120:0/2470163460 wait complete. 2024-09-19T05:21:25.315 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.310+0000 7fcf0eaa4740 20 client.25193 trim_cache size 0 max 16384 2024-09-19T05:21:25.316 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T05:21:25.316 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "no active scrubs running", 2024-09-19T05:21:25.316 INFO:teuthology.orchestra.run.smithi120.stdout: "scrubs": {} 2024-09-19T05:21:25.316 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T05:21:25.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.310+0000 7fcf0c6cb640 1 -- 172.21.15.120:0/1182170766 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fcef00a3430 msgr2=0x7fcef00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:25.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.310+0000 7fcf0c6cb640 1 --2- 172.21.15.120:0/1182170766 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fcef00a3430 0x7fcef00a58f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcefc005fd0 tx=0x7fcefc004ab0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.310+0000 7fcf0c6cb640 1 -- 172.21.15.120:0/1182170766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf041027a0 msgr2=0x7fcf04075ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:25.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.310+0000 7fcf0c6cb640 1 --2- 172.21.15.120:0/1182170766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf041027a0 0x7fcf04075ff0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcef400e9f0 tx=0x7fcef400eeb0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.311+0000 7fcf0c6cb640 1 -- 172.21.15.120:0/1182170766 shutdown_connections 2024-09-19T05:21:25.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.311+0000 7fcf0c6cb640 1 --2- 172.21.15.120:0/1182170766 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fcef00a3430 0x7fcef00a58f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.311+0000 7fcf0c6cb640 1 --2- 172.21.15.120:0/1182170766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcf04106f20 0x7fcf0406cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.311+0000 7fcf0c6cb640 1 --2- 172.21.15.120:0/1182170766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf041027a0 0x7fcf04075ff0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.311+0000 7fcf0c6cb640 1 --2- 172.21.15.120:0/1182170766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf04101df0 0x7fcf04075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:25.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.311+0000 7fcf0c6cb640 1 -- 172.21.15.120:0/1182170766 >> 172.21.15.120:0/1182170766 conn(0x7fcf040fd8f0 msgr2=0x7fcf040fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:25.317 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.311+0000 7fcf0c6cb640 1 -- 172.21.15.120:0/1182170766 shutdown_connections 2024-09-19T05:21:25.318 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:25.311+0000 7fcf0c6cb640 1 -- 172.21.15.120:0/1182170766 wait complete. 2024-09-19T05:21:26.145 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T05:21:26.145 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:21:26.526 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:26.662 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:26 smithi120 ceph-mon[30956]: pgmap v69: 97 pgs: 97 active+clean; 180 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.3 MiB/s wr, 767 op/s 2024-09-19T05:21:26.662 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:26 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:21:26.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:26 smithi178 ceph-mon[34347]: pgmap v69: 97 pgs: 97 active+clean; 180 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.3 MiB/s wr, 767 op/s 2024-09-19T05:21:26.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:26 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:21:26.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:26 smithi194 ceph-mon[35228]: pgmap v69: 97 pgs: 97 active+clean; 180 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.3 MiB/s wr, 767 op/s 2024-09-19T05:21:26.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:26 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:21:27.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.126+0000 7f2b40f5d640 1 -- 172.21.15.120:0/2025319771 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b34031e40 con 0x7f2b3c108e00 2024-09-19T05:21:27.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.127+0000 7f2b441c3640 1 -- 172.21.15.120:0/2025319771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b3c108e00 msgr2=0x7f2b3c10ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:27.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.127+0000 7f2b441c3640 1 --2- 172.21.15.120:0/2025319771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b3c108e00 0x7f2b3c10ce00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2b34009ca0 tx=0x7f2b3402a8c0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.127+0000 7f2b441c3640 1 -- 172.21.15.120:0/2025319771 shutdown_connections 2024-09-19T05:21:27.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.127+0000 7f2b441c3640 1 --2- 172.21.15.120:0/2025319771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b3c10d530 0x7f2b3c1150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.129 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.127+0000 7f2b441c3640 1 --2- 172.21.15.120:0/2025319771 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b3c108e00 0x7f2b3c10ce00 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.127+0000 7f2b441c3640 1 --2- 172.21.15.120:0/2025319771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b3c108450 0x7f2b3c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.127+0000 7f2b441c3640 1 -- 172.21.15.120:0/2025319771 >> 172.21.15.120:0/2025319771 conn(0x7f2b3c077ba0 msgr2=0x7f2b3c079fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:27.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.128+0000 7f2b441c3640 1 -- 172.21.15.120:0/2025319771 shutdown_connections 2024-09-19T05:21:27.130 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.128+0000 7f2b441c3640 1 -- 172.21.15.120:0/2025319771 wait complete. 2024-09-19T05:21:27.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.129+0000 7f2b441c3640 1 Processor -- start 2024-09-19T05:21:27.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.129+0000 7f2b441c3640 1 -- start start 2024-09-19T05:21:27.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.129+0000 7f2b441c3640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b3c108450 0x7f2b3c1a47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:27.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.129+0000 7f2b441c3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b3c10d530 0x7f2b3c1a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:27.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.129+0000 7f2b441c3640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b3c19e9a0 0x7f2b3c19ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:27.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.129+0000 7f2b441c3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3c118430 con 0x7f2b3c10d530 2024-09-19T05:21:27.131 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.129+0000 7f2b441c3640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3c1182b0 con 0x7f2b3c19e9a0 2024-09-19T05:21:27.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.129+0000 7f2b441c3640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3c1185b0 con 0x7f2b3c108450 2024-09-19T05:21:27.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.129+0000 7f2b42760640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b3c19e9a0 0x7f2b3c19ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:27.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.129+0000 7f2b42760640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b3c19e9a0 0x7f2b3c19ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:59410/0 (socket says 172.21.15.120:59410) 2024-09-19T05:21:27.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.129+0000 7f2b42760640 1 -- 172.21.15.120:0/1772079157 learned_addr learned my addr 172.21.15.120:0/1772079157 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:27.132 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.129+0000 7f2b4175e640 1 --2- 172.21.15.120:0/1772079157 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b3c10d530 0x7f2b3c1a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:27.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.130+0000 7f2b41f5f640 1 --2- 172.21.15.120:0/1772079157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b3c108450 0x7f2b3c1a47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:27.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.130+0000 7f2b42760640 1 -- 172.21.15.120:0/1772079157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b3c108450 msgr2=0x7f2b3c1a47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:27.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.130+0000 7f2b42760640 1 --2- 172.21.15.120:0/1772079157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b3c108450 0x7f2b3c1a47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.130+0000 7f2b42760640 1 -- 172.21.15.120:0/1772079157 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b3c10d530 msgr2=0x7f2b3c1a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:27.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.130+0000 7f2b42760640 1 --2- 172.21.15.120:0/1772079157 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b3c10d530 0x7f2b3c1a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.130+0000 7f2b42760640 1 -- 172.21.15.120:0/1772079157 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b3c19f4c0 con 0x7f2b3c19e9a0 2024-09-19T05:21:27.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.130+0000 7f2b42760640 1 --2- 172.21.15.120:0/1772079157 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b3c19e9a0 0x7f2b3c19ee50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c00d680 tx=0x7f2b2c00db40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:27.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.130+0000 7f2b32ffd640 1 -- 172.21.15.120:0/1772079157 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c017070 con 0x7f2b3c19e9a0 2024-09-19T05:21:27.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.130+0000 7f2b32ffd640 1 -- 172.21.15.120:0/1772079157 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2b2c009820 con 0x7f2b3c19e9a0 2024-09-19T05:21:27.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.131+0000 7f2b32ffd640 1 -- 172.21.15.120:0/1772079157 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c004c60 con 0x7f2b3c19e9a0 2024-09-19T05:21:27.133 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.131+0000 7f2b441c3640 1 -- 172.21.15.120:0/1772079157 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b3c19f7b0 con 0x7f2b3c19e9a0 2024-09-19T05:21:27.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.131+0000 7f2b441c3640 1 -- 172.21.15.120:0/1772079157 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b3c1ab9a0 con 0x7f2b3c19e9a0 2024-09-19T05:21:27.134 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.132+0000 7f2b441c3640 1 -- 172.21.15.120:0/1772079157 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b3c1098e0 con 0x7f2b3c19e9a0 2024-09-19T05:21:27.135 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.134+0000 7f2b32ffd640 1 -- 172.21.15.120:0/1772079157 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f2b2c005220 con 0x7f2b3c19e9a0 2024-09-19T05:21:27.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.134+0000 7f2b32ffd640 1 --2- 172.21.15.120:0/1772079157 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f2b280a34a0 0x7f2b280a5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:27.136 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.135+0000 7f2b32ffd640 1 -- 172.21.15.120:0/1772079157 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f2b2c0cf5a0 con 0x7f2b3c19e9a0 2024-09-19T05:21:27.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.135+0000 7f2b41f5f640 1 --2- 172.21.15.120:0/1772079157 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f2b280a34a0 0x7f2b280a5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:27.137 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.136+0000 7f2b41f5f640 1 --2- 172.21.15.120:0/1772079157 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f2b280a34a0 0x7f2b280a5960 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c19fae0 tx=0x7f2b3800b390 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:27.141 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.139+0000 7f2b32ffd640 1 -- 172.21.15.120:0/1772079157 <== mon.2 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2b2c09bf30 con 0x7f2b3c19e9a0 2024-09-19T05:21:27.466 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.464+0000 7f2b441c3640 1 -- 172.21.15.120:0/1772079157 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b3c110770 con 0x7f2b3c19e9a0 2024-09-19T05:21:27.467 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:21:27.467 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.465+0000 7f2b32ffd640 1 -- 172.21.15.120:0/1772079157 <== mon.2 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11924 (secure 0 0 0) 0x7f2b2c09b830 con 0x7f2b3c19e9a0 2024-09-19T05:21:27.468 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":27,"btime":"2024-09-19T05:20:52:006497+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/93472898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":93472898},{"type":"v1","addr":"172.21.15.120:6835","nonce":93472898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1976835398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1976835398},{"type":"v1","addr":"172.21.15.120:6837","nonce":1976835398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6839/2975851469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":2975851469},{"type":"v1","addr":"172.21.15.120:6839","nonce":2975851469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6841/2837552754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":2837552754},{"type":"v1","addr":"172.21.15.120:6841","nonce":2837552754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/61682954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":61682954},{"type":"v1","addr":"172.21.15.178:6833","nonce":61682954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1778722040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1778722040},{"type":"v1","addr":"172.21.15.194:6833","nonce":1778722040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:17:30.796197+0000","modified":"2024-09-19T05:20:51.956362+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24445,"mds_1":24443,"mds_2":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24401":{"gid":24401,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/890775592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":890775592},{"type":"v1","addr":"172.21.15.178:6835","nonce":890775592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6837/3960720164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3960720164},{"type":"v1","addr":"172.21.15.178:6837","nonce":3960720164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6835/3268846994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3268846994},{"type":"v1","addr":"172.21.15.194:6835","nonce":3268846994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.194:6837/378729335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":378729335},{"type":"v1","addr":"172.21.15.194:6837","nonce":378729335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.178:6839/3389137566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3389137566},{"type":"v1","addr":"172.21.15.178:6839","nonce":3389137566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6839/3817420679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3817420679},{"type":"v1","addr":"172.21.15.194:6839","nonce":3817420679}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24445,"qdb_cluster":[24445,24443,24430]},"id":1}]} 2024-09-19T05:21:27.468 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 27 2024-09-19T05:21:27.470 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.468+0000 7f2b441c3640 1 -- 172.21.15.120:0/1772079157 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f2b280a34a0 msgr2=0x7f2b280a5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:27.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.468+0000 7f2b441c3640 1 --2- 172.21.15.120:0/1772079157 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f2b280a34a0 0x7f2b280a5960 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c19fae0 tx=0x7f2b3800b390 comp rx=0 tx=0).stop 2024-09-19T05:21:27.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.468+0000 7f2b441c3640 1 -- 172.21.15.120:0/1772079157 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b3c19e9a0 msgr2=0x7f2b3c19ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:27.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.468+0000 7f2b441c3640 1 --2- 172.21.15.120:0/1772079157 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b3c19e9a0 0x7f2b3c19ee50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c00d680 tx=0x7f2b2c00db40 comp rx=0 tx=0).stop 2024-09-19T05:21:27.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.468+0000 7f2b441c3640 1 -- 172.21.15.120:0/1772079157 shutdown_connections 2024-09-19T05:21:27.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.468+0000 7f2b441c3640 1 --2- 172.21.15.120:0/1772079157 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f2b280a34a0 0x7f2b280a5960 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.468+0000 7f2b441c3640 1 --2- 172.21.15.120:0/1772079157 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b3c19e9a0 0x7f2b3c19ee50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.468+0000 7f2b441c3640 1 --2- 172.21.15.120:0/1772079157 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2b3c10d530 0x7f2b3c1a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.468+0000 7f2b441c3640 1 --2- 172.21.15.120:0/1772079157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b3c108450 0x7f2b3c1a47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.468+0000 7f2b441c3640 1 -- 172.21.15.120:0/1772079157 >> 172.21.15.120:0/1772079157 conn(0x7f2b3c077ba0 msgr2=0x7f2b3c078530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:27.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.469+0000 7f2b441c3640 1 -- 172.21.15.120:0/1772079157 shutdown_connections 2024-09-19T05:21:27.471 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:27.469+0000 7f2b441c3640 1 -- 172.21.15.120:0/1772079157 wait complete. 2024-09-19T05:21:27.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:27 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:21:27.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:27 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:21:27.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:27 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:21:27.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:27 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:21:27.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:27 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:21:27.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:27 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:21:27.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:27 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1772079157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:21:27.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:27 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:21:27.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:27 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:21:27.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:27 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:21:27.931 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.929+0000 7f235fdf8640 1 -- 172.21.15.120:0/1618446378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23581069c0 msgr2=0x7f2358106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:27.931 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.929+0000 7f235fdf8640 1 --2- 172.21.15.120:0/1618446378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23581069c0 0x7f2358106da0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2354009930 tx=0x7f235402a420 comp rx=0 tx=0).stop 2024-09-19T05:21:27.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.929+0000 7f235fdf8640 1 -- 172.21.15.120:0/1618446378 shutdown_connections 2024-09-19T05:21:27.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.929+0000 7f235fdf8640 1 --2- 172.21.15.120:0/1618446378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2358101350 0x7f235810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.929+0000 7f235fdf8640 1 --2- 172.21.15.120:0/1618446378 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23581009b0 0x7f2358100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.929+0000 7f235fdf8640 1 --2- 172.21.15.120:0/1618446378 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23581069c0 0x7f2358106da0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.929+0000 7f235fdf8640 1 -- 172.21.15.120:0/1618446378 >> 172.21.15.120:0/1618446378 conn(0x7f2358077990 msgr2=0x7f23580fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:27.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.929+0000 7f235fdf8640 1 -- 172.21.15.120:0/1618446378 shutdown_connections 2024-09-19T05:21:27.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.929+0000 7f235fdf8640 1 -- 172.21.15.120:0/1618446378 wait complete. 2024-09-19T05:21:27.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.930+0000 7f235fdf8640 1 Processor -- start 2024-09-19T05:21:27.932 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.930+0000 7f235fdf8640 1 -- start start 2024-09-19T05:21:27.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.930+0000 7f235fdf8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23581009b0 0x7f2358197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:27.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.930+0000 7f235fdf8640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2358101350 0x7f2358197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:27.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.930+0000 7f235fdf8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23581069c0 0x7f235819bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:27.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.930+0000 7f235fdf8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2358110cb0 con 0x7f23581069c0 2024-09-19T05:21:27.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.930+0000 7f235fdf8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2358110b30 con 0x7f23581009b0 2024-09-19T05:21:27.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.930+0000 7f235fdf8640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2358110e30 con 0x7f2358101350 2024-09-19T05:21:27.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.930+0000 7f235db94640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23581009b0 0x7f2358197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:27.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.930+0000 7f235e395640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23581069c0 0x7f235819bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:27.934 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.930+0000 7f235db94640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23581009b0 0x7f2358197220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:59442/0 (socket says 172.21.15.120:59442) 2024-09-19T05:21:27.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.930+0000 7f235e395640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23581069c0 0x7f235819bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49942/0 (socket says 172.21.15.120:49942) 2024-09-19T05:21:27.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.930+0000 7f235db94640 1 -- 172.21.15.120:0/2272275034 learned_addr learned my addr 172.21.15.120:0/2272275034 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:27.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.930+0000 7f235d393640 1 --2- 172.21.15.120:0/2272275034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2358101350 0x7f2358197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:27.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.931+0000 7f235db94640 1 -- 172.21.15.120:0/2272275034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2358101350 msgr2=0x7f2358197760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:27.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.931+0000 7f235db94640 1 --2- 172.21.15.120:0/2272275034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2358101350 0x7f2358197760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.931+0000 7f235db94640 1 -- 172.21.15.120:0/2272275034 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23581069c0 msgr2=0x7f235819bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:27.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.931+0000 7f235db94640 1 --2- 172.21.15.120:0/2272275034 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23581069c0 0x7f235819bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.931+0000 7f235db94640 1 -- 172.21.15.120:0/2272275034 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f235819c210 con 0x7f23581009b0 2024-09-19T05:21:27.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.931+0000 7f235db94640 1 --2- 172.21.15.120:0/2272275034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23581009b0 0x7f2358197220 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2354005940 tx=0x7f23540040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:27.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.931+0000 7f234effd640 1 -- 172.21.15.120:0/2272275034 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2354035070 con 0x7f23581009b0 2024-09-19T05:21:27.935 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.931+0000 7f235fdf8640 1 -- 172.21.15.120:0/2272275034 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f235819c4a0 con 0x7f23581009b0 2024-09-19T05:21:27.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.931+0000 7f234effd640 1 -- 172.21.15.120:0/2272275034 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f23540044b0 con 0x7f23581009b0 2024-09-19T05:21:27.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.931+0000 7f234effd640 1 -- 172.21.15.120:0/2272275034 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2354003ca0 con 0x7f23581009b0 2024-09-19T05:21:27.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.931+0000 7f235fdf8640 1 -- 172.21.15.120:0/2272275034 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23580698a0 con 0x7f23581009b0 2024-09-19T05:21:27.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.934+0000 7f234effd640 1 -- 172.21.15.120:0/2272275034 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f235403d760 con 0x7f23581009b0 2024-09-19T05:21:27.936 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.935+0000 7f2362c68740 1 Processor -- start 2024-09-19T05:21:27.937 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.935+0000 7f2362c68740 1 -- start start 2024-09-19T05:21:27.938 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.935+0000 7f2362c68740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1fda67a10 0x55c1fda67df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:27.938 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.935+0000 7f2362c68740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1fda68330 0x55c1fda7af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.935+0000 7f2362c68740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda7b4c0 0x55c1fda7d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.935+0000 7f235db94640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1fda68330 0x55c1fda7af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.935+0000 7f2362c68740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c1fd9cc2f0 con 0x55c1fda67a10 2024-09-19T05:21:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.935+0000 7f2362c68740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55c1fd974270 con 0x55c1fda7b4c0 2024-09-19T05:21:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.935+0000 7f2362c68740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c1fd9c82b0 con 0x55c1fda68330 2024-09-19T05:21:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.935+0000 7f235db94640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1fda68330 0x55c1fda7af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:50824/0 (socket says 172.21.15.120:50824) 2024-09-19T05:21:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.935+0000 7f235db94640 1 -- 172.21.15.120:0/219821900 learned_addr learned my addr 172.21.15.120:0/219821900 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.935+0000 7f235e395640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1fda67a10 0x55c1fda67df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.936+0000 7f235d393640 1 --2- 172.21.15.120:0/219821900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda7b4c0 0x55c1fda7d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.936+0000 7f235db94640 1 -- 172.21.15.120:0/219821900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda7b4c0 msgr2=0x55c1fda7d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:27.939 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.936+0000 7f235db94640 1 --2- 172.21.15.120:0/219821900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda7b4c0 0x55c1fda7d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.936+0000 7f235db94640 1 -- 172.21.15.120:0/219821900 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1fda67a10 msgr2=0x55c1fda67df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.936+0000 7f235db94640 1 --2- 172.21.15.120:0/219821900 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1fda67a10 0x55c1fda67df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.936+0000 7f235db94640 1 -- 172.21.15.120:0/219821900 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1fd973340 con 0x55c1fda68330 2024-09-19T05:21:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.936+0000 7f235d393640 1 --2- 172.21.15.120:0/219821900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda7b4c0 0x55c1fda7d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:21:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.936+0000 7f235db94640 1 --2- 172.21.15.120:0/219821900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1fda68330 0x55c1fda7af80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f23540f1c80 tx=0x7f23540f6bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ab81fc4b17bbd7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.936+0000 7f234effd640 1 --2- 172.21.15.120:0/2272275034 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f23440a3560 0x7f23440a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.936+0000 7f2343fff640 1 -- 172.21.15.120:0/219821900 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23540f4930 con 0x55c1fda68330 2024-09-19T05:21:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.936+0000 7f2343fff640 1 -- 172.21.15.120:0/219821900 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f23540c0fa0 con 0x55c1fda68330 2024-09-19T05:21:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.936+0000 7f2343fff640 1 -- 172.21.15.120:0/219821900 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23540c4c50 con 0x55c1fda68330 2024-09-19T05:21:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.937+0000 7f235e395640 1 --2- 172.21.15.120:0/2272275034 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f23440a3560 0x7f23440a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:27.940 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.937+0000 7f234effd640 1 -- 172.21.15.120:0/2272275034 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f23540f4560 con 0x7f23581009b0 2024-09-19T05:21:27.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.937+0000 7f235e395640 1 --2- 172.21.15.120:0/2272275034 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f23440a3560 0x7f23440a5a20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2350005fd0 tx=0x7f2350009500 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:27.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.937+0000 7f2362c68740 1 -- 172.21.15.120:0/219821900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1fda68330 msgr2=0x55c1fda7af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:27.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.937+0000 7f2362c68740 1 --2- 172.21.15.120:0/219821900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1fda68330 0x55c1fda7af80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f23540f1c80 tx=0x7f23540f6bc0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.937+0000 7f2362c68740 1 -- 172.21.15.120:0/219821900 shutdown_connections 2024-09-19T05:21:27.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.938+0000 7f2362c68740 1 --2- 172.21.15.120:0/219821900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda7b4c0 0x55c1fda7d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.938+0000 7f2362c68740 1 --2- 172.21.15.120:0/219821900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1fda68330 0x55c1fda7af80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.938+0000 7f2362c68740 1 --2- 172.21.15.120:0/219821900 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1fda67a10 0x55c1fda67df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.938+0000 7f2362c68740 1 -- 172.21.15.120:0/219821900 >> 172.21.15.120:0/219821900 conn(0x55c1fda64060 msgr2=0x55c1fda64440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:27.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.938+0000 7f2362c68740 1 -- 172.21.15.120:0/219821900 shutdown_connections 2024-09-19T05:21:27.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.938+0000 7f2362c68740 1 -- 172.21.15.120:0/219821900 wait complete. 2024-09-19T05:21:27.946 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.938+0000 7f2362c68740 1 -- start start 2024-09-19T05:21:27.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.938+0000 7f2362c68740 1 Processor -- start 2024-09-19T05:21:27.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.939+0000 7f2362c68740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1fda67a10 0x55c1fda78430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:27.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.939+0000 7f2362c68740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda68330 0x55c1fda78970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:27.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.939+0000 7f2362c68740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1fda7b4c0 0x55c1fda78eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:27.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.939+0000 7f2362c68740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c1fda7de50 con 0x55c1fda67a10 2024-09-19T05:21:27.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.939+0000 7f235d393640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda68330 0x55c1fda78970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:27.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.939+0000 7f2362c68740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55c1fd955290 con 0x55c1fda68330 2024-09-19T05:21:27.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.939+0000 7f235d393640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda68330 0x55c1fda78970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:59460/0 (socket says 172.21.15.120:59460) 2024-09-19T05:21:27.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.939+0000 7f2362c68740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c1fda7dfd0 con 0x55c1fda7b4c0 2024-09-19T05:21:27.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.939+0000 7f235d393640 1 -- 172.21.15.120:0/137038948 learned_addr learned my addr 172.21.15.120:0/137038948 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:27.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.939+0000 7f235e395640 1 --2- 172.21.15.120:0/137038948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1fda7b4c0 0x55c1fda78eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:27.947 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.939+0000 7f235db94640 1 --2- 172.21.15.120:0/137038948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1fda67a10 0x55c1fda78430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:27.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.940+0000 7f2362c68740 10 client.0 _ll_register_callbacks cb 0x55c1fd986140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:27.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.940+0000 7f235e395640 1 -- 172.21.15.120:0/137038948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda68330 msgr2=0x55c1fda78970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:27.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.940+0000 7f235e395640 1 --2- 172.21.15.120:0/137038948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda68330 0x55c1fda78970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.940+0000 7f235e395640 1 -- 172.21.15.120:0/137038948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1fda67a10 msgr2=0x55c1fda78430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:27.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.940+0000 7f235e395640 1 --2- 172.21.15.120:0/137038948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1fda67a10 0x55c1fda78430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.940+0000 7f235e395640 1 -- 172.21.15.120:0/137038948 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1fd6df210 con 0x55c1fda7b4c0 2024-09-19T05:21:27.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.940+0000 7f235d393640 1 --2- 172.21.15.120:0/137038948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda68330 0x55c1fda78970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:27.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.940+0000 7f2362c68740 1 -- 172.21.15.120:0/137038948 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23540c0fa0 con 0x55c1fda7b4c0 2024-09-19T05:21:27.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.940+0000 7f235e395640 1 --2- 172.21.15.120:0/137038948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1fda7b4c0 0x55c1fda78eb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2350009fd0 tx=0x7f2350004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=beb7947b920f30aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:27.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.940+0000 7f23417fa640 10 client.25282 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:21:27.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.940+0000 7f23417fa640 1 -- 172.21.15.120:0/137038948 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f235002e060 con 0x55c1fda7b4c0 2024-09-19T05:21:27.948 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.940+0000 7f23417fa640 1 -- 172.21.15.120:0/137038948 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f2350018030 con 0x55c1fda7b4c0 2024-09-19T05:21:27.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.941+0000 7f23417fa640 1 -- 172.21.15.120:0/137038948 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f235001e5a0 con 0x55c1fda7b4c0 2024-09-19T05:21:27.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.941+0000 7f2362c68740 10 client.25282 fetch_fsmap learned FSMap version 27 2024-09-19T05:21:27.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.941+0000 7f2362c68740 1 -- 172.21.15.120:0/137038948 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55c1fd7ab620 con 0x55c1fda7b4c0 2024-09-19T05:21:27.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.941+0000 7f23417fa640 1 -- 172.21.15.120:0/137038948 <== mon.1 v2:172.21.15.194:3300/0 4 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f235001e740 con 0x55c1fda7b4c0 2024-09-19T05:21:27.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.941+0000 7f2362c68740 10 client.25282 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:21:27.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.941+0000 7f2362c68740 10 client.25282 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:21:27.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.941+0000 7f2362c68740 20 client.25282 populate_metadata read hostname 'smithi120' 2024-09-19T05:21:27.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.941+0000 7f2362c68740 1 --2- 172.21.15.120:0/137038948 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55c1fda8b480 0x55c1fda8d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:27.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.941+0000 7f2362c68740 4 client.25282 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:21:27.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.941+0000 7f2362c68740 1 -- 172.21.15.120:0/137038948 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1fd9d9a20 con 0x55c1fda8b480 2024-09-19T05:21:27.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.941+0000 7f235db94640 1 --2- 172.21.15.120:0/137038948 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55c1fda8b480 0x55c1fda8d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:27.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.942+0000 7f23417fa640 10 client.25282 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:27.949 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.942+0000 7f235db94640 1 --2- 172.21.15.120:0/137038948 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55c1fda8b480 0x55c1fda8d940 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3c843c4b294cfac server_cookie=81f113e96ce24d2e in_seq=0 out_seq=0 2024-09-19T05:21:27.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.942+0000 7f23417fa640 1 -- 172.21.15.120:0/137038948 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c1fd9d9a20 con 0x55c1fda8b480 2024-09-19T05:21:27.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.942+0000 7f23417fa640 10 client.25282 handle_command_reply: tid=0 2024-09-19T05:21:27.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.942+0000 7f2362c68740 1 client.25282 shutdown 2024-09-19T05:21:27.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.943+0000 7f2362c68740 1 -- 172.21.15.120:0/137038948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1fda7b4c0 msgr2=0x55c1fda78eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:27.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.943+0000 7f2362c68740 1 --2- 172.21.15.120:0/137038948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1fda7b4c0 0x55c1fda78eb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2350009fd0 tx=0x7f2350004ab0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.943+0000 7f2362c68740 1 -- 172.21.15.120:0/137038948 shutdown_connections 2024-09-19T05:21:27.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.943+0000 7f2362c68740 1 --2- 172.21.15.120:0/137038948 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55c1fda8b480 0x55c1fda8d940 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.943+0000 7f2362c68740 1 --2- 172.21.15.120:0/137038948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1fda7b4c0 0x55c1fda78eb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.943+0000 7f2362c68740 1 --2- 172.21.15.120:0/137038948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda68330 0x55c1fda78970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.943+0000 7f2362c68740 1 --2- 172.21.15.120:0/137038948 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1fda67a10 0x55c1fda78430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.943+0000 7f2362c68740 1 -- 172.21.15.120:0/137038948 >> 172.21.15.120:0/137038948 conn(0x55c1fda64060 msgr2=0x55c1fda69d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:27.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.943+0000 7f23417fa640 0 client.25282 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:27.950 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.943+0000 7f2362c68740 1 -- 172.21.15.120:0/137038948 shutdown_connections 2024-09-19T05:21:27.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.943+0000 7f2362c68740 1 -- 172.21.15.120:0/137038948 wait complete. 2024-09-19T05:21:27.951 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.944+0000 7f2362c68740 20 client.25282 trim_cache size 0 max 16384 2024-09-19T05:21:27.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:27 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:21:27.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:27 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:21:27.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:27 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:21:27.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:27 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:21:27.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:27 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:21:27.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:27 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:21:27.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:27 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1772079157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:21:27.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:27 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:21:27.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:27 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:21:27.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:27 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:21:27.971 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.968+0000 7f2362c68740 1 Processor -- start 2024-09-19T05:21:27.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.968+0000 7f2362c68740 1 -- start start 2024-09-19T05:21:27.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.968+0000 7f2362c68740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1fda67a10 0x55c1fda93250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:27.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.968+0000 7f2362c68740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1fda68330 0x55c1fda93790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:27.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.968+0000 7f2362c68740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda7b4c0 0x55c1fda75690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:27.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.968+0000 7f2362c68740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f23581adeb0 con 0x55c1fda67a10 2024-09-19T05:21:27.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.968+0000 7f2362c68740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f23581ab780 con 0x55c1fda7b4c0 2024-09-19T05:21:27.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.968+0000 7f2362c68740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f23581a95d0 con 0x55c1fda68330 2024-09-19T05:21:27.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.968+0000 7f235db94640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1fda67a10 0x55c1fda93250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:27.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.968+0000 7f235d393640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1fda68330 0x55c1fda93790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:27.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.968+0000 7f235db94640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1fda67a10 0x55c1fda93250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49970/0 (socket says 172.21.15.120:49970) 2024-09-19T05:21:27.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.969+0000 7f235db94640 1 -- 172.21.15.120:0/1982506382 learned_addr learned my addr 172.21.15.120:0/1982506382 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:27.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.969+0000 7f235e395640 1 --2- 172.21.15.120:0/1982506382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda7b4c0 0x55c1fda75690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:27.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.969+0000 7f235d393640 1 -- 172.21.15.120:0/1982506382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda7b4c0 msgr2=0x55c1fda75690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:27.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.969+0000 7f235d393640 1 --2- 172.21.15.120:0/1982506382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda7b4c0 0x55c1fda75690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.969+0000 7f235d393640 1 -- 172.21.15.120:0/1982506382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1fda67a10 msgr2=0x55c1fda93250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:27.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.969+0000 7f235d393640 1 --2- 172.21.15.120:0/1982506382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1fda67a10 0x55c1fda93250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.969+0000 7f235d393640 1 -- 172.21.15.120:0/1982506382 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1fda773c0 con 0x55c1fda68330 2024-09-19T05:21:27.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.969+0000 7f235db94640 1 --2- 172.21.15.120:0/1982506382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1fda67a10 0x55c1fda93250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:27.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.969+0000 7f235e395640 1 --2- 172.21.15.120:0/1982506382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda7b4c0 0x55c1fda75690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:27.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.969+0000 7f235d393640 1 --2- 172.21.15.120:0/1982506382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1fda68330 0x55c1fda93790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55c1fda79a70 tx=0x7f23480139f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ffeff2c7c4bd74 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:27.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.969+0000 7f23437fe640 1 -- 172.21.15.120:0/1982506382 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2348021070 con 0x55c1fda68330 2024-09-19T05:21:27.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.969+0000 7f23437fe640 1 -- 172.21.15.120:0/1982506382 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f23480035f0 con 0x55c1fda68330 2024-09-19T05:21:27.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.969+0000 7f23437fe640 1 -- 172.21.15.120:0/1982506382 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2348011720 con 0x55c1fda68330 2024-09-19T05:21:27.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.970+0000 7f2362c68740 1 -- 172.21.15.120:0/1982506382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1fda68330 msgr2=0x55c1fda93790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:27.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.970+0000 7f2362c68740 1 --2- 172.21.15.120:0/1982506382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1fda68330 0x55c1fda93790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55c1fda79a70 tx=0x7f23480139f0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.970+0000 7f2362c68740 1 -- 172.21.15.120:0/1982506382 shutdown_connections 2024-09-19T05:21:27.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.970+0000 7f2362c68740 1 --2- 172.21.15.120:0/1982506382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda7b4c0 0x55c1fda75690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.970+0000 7f2362c68740 1 --2- 172.21.15.120:0/1982506382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1fda68330 0x55c1fda93790 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.970+0000 7f2362c68740 1 --2- 172.21.15.120:0/1982506382 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1fda67a10 0x55c1fda93250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.970+0000 7f2362c68740 1 -- 172.21.15.120:0/1982506382 >> 172.21.15.120:0/1982506382 conn(0x55c1fda64060 msgr2=0x55c1fda7a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:27.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.970+0000 7f2362c68740 1 -- 172.21.15.120:0/1982506382 shutdown_connections 2024-09-19T05:21:27.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.970+0000 7f2362c68740 1 -- 172.21.15.120:0/1982506382 wait complete. 2024-09-19T05:21:27.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.971+0000 7f2362c68740 1 -- start start 2024-09-19T05:21:27.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.971+0000 7f2362c68740 1 Processor -- start 2024-09-19T05:21:27.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.971+0000 7f2362c68740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1fda67a10 0x55c1fda83220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:27.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.971+0000 7f2362c68740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda68330 0x55c1fda83760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:27.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.971+0000 7f2362c68740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1fda7b4c0 0x55c1fda801f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:27.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.971+0000 7f2362c68740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f23581a9c40 con 0x55c1fda7b4c0 2024-09-19T05:21:27.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.971+0000 7f2362c68740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f23581ab0b0 con 0x55c1fda68330 2024-09-19T05:21:27.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.971+0000 7f2362c68740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f23581aa310 con 0x55c1fda67a10 2024-09-19T05:21:27.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.971+0000 7f2362c68740 10 client.0 _ll_register_callbacks cb 0x7f2350009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:27.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.971+0000 7f235d393640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda68330 0x55c1fda83760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:27.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.971+0000 7f235d393640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda68330 0x55c1fda83760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:59484/0 (socket says 172.21.15.120:59484) 2024-09-19T05:21:27.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.971+0000 7f235d393640 1 -- 172.21.15.120:0/3351715144 learned_addr learned my addr 172.21.15.120:0/3351715144 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:27.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.972+0000 7f235db94640 1 --2- 172.21.15.120:0/3351715144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1fda67a10 0x55c1fda83220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:27.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.972+0000 7f235e395640 1 --2- 172.21.15.120:0/3351715144 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1fda7b4c0 0x55c1fda801f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.972+0000 7f235d393640 1 -- 172.21.15.120:0/3351715144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1fda67a10 msgr2=0x55c1fda83220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.972+0000 7f235d393640 1 --2- 172.21.15.120:0/3351715144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1fda67a10 0x55c1fda83220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.972+0000 7f235d393640 1 -- 172.21.15.120:0/3351715144 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1fda7b4c0 msgr2=0x55c1fda801f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.972+0000 7f235d393640 1 --2- 172.21.15.120:0/3351715144 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1fda7b4c0 0x55c1fda801f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.972+0000 7f235d393640 1 -- 172.21.15.120:0/3351715144 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1fda80730 con 0x55c1fda68330 2024-09-19T05:21:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.972+0000 7f23417fa640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:21:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.972+0000 7f235d393640 1 --2- 172.21.15.120:0/3351715144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda68330 0x55c1fda83760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f234801e000 tx=0x7f2348005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27bacdff9369f668 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.972+0000 7f23417fa640 1 -- 172.21.15.120:0/3351715144 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2348021040 con 0x55c1fda68330 2024-09-19T05:21:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.972+0000 7f23417fa640 1 -- 172.21.15.120:0/3351715144 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f23480037a0 con 0x55c1fda68330 2024-09-19T05:21:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.972+0000 7f2362c68740 1 -- 172.21.15.120:0/3351715144 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23480035f0 con 0x55c1fda68330 2024-09-19T05:21:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.972+0000 7f23417fa640 1 -- 172.21.15.120:0/3351715144 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2348034050 con 0x55c1fda68330 2024-09-19T05:21:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.972+0000 7f2362c68740 10 client.25214 fetch_fsmap learned FSMap version 27 2024-09-19T05:21:27.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.972+0000 7f2362c68740 1 -- 172.21.15.120:0/3351715144 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c1fdaf6930 con 0x55c1fda68330 2024-09-19T05:21:27.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.973+0000 7f23417fa640 1 -- 172.21.15.120:0/3351715144 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f23480035f0 con 0x55c1fda68330 2024-09-19T05:21:27.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.973+0000 7f23417fa640 1 -- 172.21.15.120:0/3351715144 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f234802f030 con 0x55c1fda68330 2024-09-19T05:21:27.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.973+0000 7f2362c68740 10 client.25214 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:21:27.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.973+0000 7f2362c68740 10 client.25214 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:21:27.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.973+0000 7f2362c68740 20 client.25214 populate_metadata read hostname 'smithi120' 2024-09-19T05:21:27.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.973+0000 7f2362c68740 1 --2- 172.21.15.120:0/3351715144 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55c1fdaf6f50 0x55c1fdaf9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:27.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.973+0000 7f2362c68740 4 client.25214 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:21:27.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.973+0000 7f2362c68740 1 -- 172.21.15.120:0/3351715144 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c1fd9d3d70 con 0x55c1fdaf6f50 2024-09-19T05:21:27.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.973+0000 7f235db94640 1 --2- 172.21.15.120:0/3351715144 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55c1fdaf6f50 0x55c1fdaf9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:27.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.974+0000 7f23417fa640 10 client.25214 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:27.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:27.973+0000 7f235db94640 1 --2- 172.21.15.120:0/3351715144 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55c1fdaf6f50 0x55c1fdaf9370 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5bc3cc15b8462a2 server_cookie=392938c19df66c03 in_seq=0 out_seq=0 2024-09-19T05:21:28.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:27 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:21:28.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:27 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:21:28.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:27 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:21:28.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:27 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:21:28.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:27 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:21:28.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:27 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:21:28.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:27 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1772079157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:21:28.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:27 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:21:28.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:27 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:21:28.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:27 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:21:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.262+0000 7f23417fa640 1 -- 172.21.15.120:0/3351715144 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c1fd9d3d70 con 0x55c1fdaf6f50 2024-09-19T05:21:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.262+0000 7f23417fa640 10 client.25214 handle_command_reply: tid=0 2024-09-19T05:21:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.262+0000 7f2362c68740 1 client.25214 shutdown 2024-09-19T05:21:28.266 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.262+0000 7f2362c68740 1 -- 172.21.15.120:0/3351715144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda68330 msgr2=0x55c1fda83760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.262+0000 7f2362c68740 1 --2- 172.21.15.120:0/3351715144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda68330 0x55c1fda83760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f234801e000 tx=0x7f2348005270 comp rx=0 tx=0).stop 2024-09-19T05:21:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.262+0000 7f2362c68740 1 -- 172.21.15.120:0/3351715144 shutdown_connections 2024-09-19T05:21:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.262+0000 7f2362c68740 1 --2- 172.21.15.120:0/3351715144 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c1fda7b4c0 0x55c1fda801f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.262+0000 7f2362c68740 1 --2- 172.21.15.120:0/3351715144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c1fda68330 0x55c1fda83760 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.262+0000 7f2362c68740 1 --2- 172.21.15.120:0/3351715144 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55c1fdaf6f50 0x55c1fdaf9370 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.262+0000 7f2362c68740 1 --2- 172.21.15.120:0/3351715144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c1fda67a10 0x55c1fda83220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.262+0000 7f2362c68740 1 -- 172.21.15.120:0/3351715144 >> 172.21.15.120:0/3351715144 conn(0x55c1fda64060 msgr2=0x55c1fda783d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.262+0000 7f23417fa640 0 client.25214 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.263+0000 7f2362c68740 1 -- 172.21.15.120:0/3351715144 shutdown_connections 2024-09-19T05:21:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.263+0000 7f2362c68740 1 -- 172.21.15.120:0/3351715144 wait complete. 2024-09-19T05:21:28.267 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.263+0000 7f2362c68740 20 client.25214 trim_cache size 0 max 16384 2024-09-19T05:21:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:21:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:21:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:21:28.268 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:21:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.264+0000 7f235fdf8640 1 -- 172.21.15.120:0/2272275034 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f23440a3560 msgr2=0x7f23440a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.264+0000 7f235fdf8640 1 --2- 172.21.15.120:0/2272275034 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f23440a3560 0x7f23440a5a20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2350005fd0 tx=0x7f2350009500 comp rx=0 tx=0).stop 2024-09-19T05:21:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.264+0000 7f235fdf8640 1 -- 172.21.15.120:0/2272275034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23581009b0 msgr2=0x7f2358197220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.264+0000 7f235fdf8640 1 --2- 172.21.15.120:0/2272275034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23581009b0 0x7f2358197220 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2354005940 tx=0x7f23540040c0 comp rx=0 tx=0).stop 2024-09-19T05:21:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.264+0000 7f235fdf8640 1 -- 172.21.15.120:0/2272275034 shutdown_connections 2024-09-19T05:21:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.264+0000 7f235fdf8640 1 --2- 172.21.15.120:0/2272275034 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f23440a3560 0x7f23440a5a20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.264+0000 7f235fdf8640 1 --2- 172.21.15.120:0/2272275034 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f23581069c0 0x7f235819bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:28.269 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.264+0000 7f235fdf8640 1 --2- 172.21.15.120:0/2272275034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2358101350 0x7f2358197760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.264+0000 7f235fdf8640 1 --2- 172.21.15.120:0/2272275034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23581009b0 0x7f2358197220 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.264+0000 7f235fdf8640 1 -- 172.21.15.120:0/2272275034 >> 172.21.15.120:0/2272275034 conn(0x7f2358077990 msgr2=0x7f23581038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.264+0000 7f235fdf8640 1 -- 172.21.15.120:0/2272275034 shutdown_connections 2024-09-19T05:21:28.270 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:28.264+0000 7f235fdf8640 1 -- 172.21.15.120:0/2272275034 wait complete. 2024-09-19T05:21:28.314 INFO:tasks.workunit.client.0.smithi120.stdout: 64 11401 502 6266 451 1244 181 2024-09-19T05:21:28.674 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T05:21:28.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:28 smithi178 ceph-mon[34347]: pgmap v70: 97 pgs: 97 active+clean; 180 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 314 op/s 2024-09-19T05:21:29.024 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:29.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:28 smithi120 ceph-mon[30956]: pgmap v70: 97 pgs: 97 active+clean; 180 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 314 op/s 2024-09-19T05:21:29.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:28 smithi194 ceph-mon[35228]: pgmap v70: 97 pgs: 97 active+clean; 180 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 314 op/s 2024-09-19T05:21:29.594 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.592+0000 7ff6e3de1640 1 -- 172.21.15.120:0/2480551262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6dc106b80 msgr2=0x7ff6dc106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:29.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.592+0000 7ff6e3de1640 1 --2- 172.21.15.120:0/2480551262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6dc106b80 0x7ff6dc106f60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009890 tx=0x7ff6d002a380 comp rx=0 tx=0).stop 2024-09-19T05:21:29.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.592+0000 7ff6e3de1640 1 -- 172.21.15.120:0/2480551262 shutdown_connections 2024-09-19T05:21:29.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.592+0000 7ff6e3de1640 1 --2- 172.21.15.120:0/2480551262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6dc1005a0 0x7ff6dc10ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.592+0000 7ff6e3de1640 1 --2- 172.21.15.120:0/2480551262 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6dc0ffc00 0x7ff6dc100060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.592+0000 7ff6e3de1640 1 --2- 172.21.15.120:0/2480551262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6dc106b80 0x7ff6dc106f60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.592+0000 7ff6e3de1640 1 -- 172.21.15.120:0/2480551262 >> 172.21.15.120:0/2480551262 conn(0x7ff6dc0fba90 msgr2=0x7ff6dc0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:29.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.592+0000 7ff6e3de1640 1 -- 172.21.15.120:0/2480551262 shutdown_connections 2024-09-19T05:21:29.595 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.592+0000 7ff6e3de1640 1 -- 172.21.15.120:0/2480551262 wait complete. 2024-09-19T05:21:29.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.593+0000 7ff6e3de1640 1 Processor -- start 2024-09-19T05:21:29.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.593+0000 7ff6e3de1640 1 -- start start 2024-09-19T05:21:29.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.594+0000 7ff6e3de1640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6dc0ffc00 0x7ff6dc198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:29.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.594+0000 7ff6e3de1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6dc1005a0 0x7ff6dc1988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:29.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.594+0000 7ff6e3de1640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6dc106b80 0x7ff6dc19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:29.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.594+0000 7ff6e3de1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc111e50 con 0x7ff6dc1005a0 2024-09-19T05:21:29.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.594+0000 7ff6e3de1640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc111cd0 con 0x7ff6dc0ffc00 2024-09-19T05:21:29.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.594+0000 7ff6e3de1640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc111fd0 con 0x7ff6dc106b80 2024-09-19T05:21:29.598 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.594+0000 7ff6e137c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6dc1005a0 0x7ff6dc1988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:29.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.594+0000 7ff6e237e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6dc106b80 0x7ff6dc19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:29.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.594+0000 7ff6e237e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6dc106b80 0x7ff6dc19cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:50862/0 (socket says 172.21.15.120:50862) 2024-09-19T05:21:29.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.594+0000 7ff6e137c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6dc1005a0 0x7ff6dc1988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49990/0 (socket says 172.21.15.120:49990) 2024-09-19T05:21:29.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.594+0000 7ff6e237e640 1 -- 172.21.15.120:0/3269296892 learned_addr learned my addr 172.21.15.120:0/3269296892 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:29.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.594+0000 7ff6e1b7d640 1 --2- 172.21.15.120:0/3269296892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6dc0ffc00 0x7ff6dc198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:29.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.594+0000 7ff6e237e640 1 -- 172.21.15.120:0/3269296892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6dc0ffc00 msgr2=0x7ff6dc198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:29.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.594+0000 7ff6e237e640 1 --2- 172.21.15.120:0/3269296892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6dc0ffc00 0x7ff6dc198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.594+0000 7ff6e237e640 1 -- 172.21.15.120:0/3269296892 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6dc1005a0 msgr2=0x7ff6dc1988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:29.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.594+0000 7ff6e237e640 1 --2- 172.21.15.120:0/3269296892 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6dc1005a0 0x7ff6dc1988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.594+0000 7ff6e237e640 1 -- 172.21.15.120:0/3269296892 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6dc19d320 con 0x7ff6dc106b80 2024-09-19T05:21:29.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.594+0000 7ff6e1b7d640 1 --2- 172.21.15.120:0/3269296892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6dc0ffc00 0x7ff6dc198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:21:29.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.594+0000 7ff6e137c640 1 --2- 172.21.15.120:0/3269296892 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6dc1005a0 0x7ff6dc1988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:29.599 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.595+0000 7ff6e237e640 1 --2- 172.21.15.120:0/3269296892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6dc106b80 0x7ff6dc19cc40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400eb40 tx=0x7ff6d400ef40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:29.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.595+0000 7ff6ceffd640 1 -- 172.21.15.120:0/3269296892 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d400ce40 con 0x7ff6dc106b80 2024-09-19T05:21:29.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.595+0000 7ff6e3de1640 1 -- 172.21.15.120:0/3269296892 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6dc19d610 con 0x7ff6dc106b80 2024-09-19T05:21:29.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.595+0000 7ff6ceffd640 1 -- 172.21.15.120:0/3269296892 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff6d4005020 con 0x7ff6dc106b80 2024-09-19T05:21:29.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.595+0000 7ff6ceffd640 1 -- 172.21.15.120:0/3269296892 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4010670 con 0x7ff6dc106b80 2024-09-19T05:21:29.600 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.595+0000 7ff6e3de1640 1 -- 172.21.15.120:0/3269296892 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6dc1a4ef0 con 0x7ff6dc106b80 2024-09-19T05:21:29.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.598+0000 7ff6ceffd640 1 -- 172.21.15.120:0/3269296892 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7ff6d40051d0 con 0x7ff6dc106b80 2024-09-19T05:21:29.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.598+0000 7ff6e61ba740 1 Processor -- start 2024-09-19T05:21:29.601 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.598+0000 7ff6e61ba740 1 -- start start 2024-09-19T05:21:29.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.599+0000 7ff6e61ba740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c05bec1350 0x55c05bebf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:29.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.599+0000 7ff6e61ba740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c05bebfde0 0x55c05bec0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:29.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.599+0000 7ff6e61ba740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c05becab80 0x55c05beccf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:29.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.599+0000 7ff6e61ba740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c05be1d2f0 con 0x55c05bec1350 2024-09-19T05:21:29.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.599+0000 7ff6e61ba740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55c05bdc4cf0 con 0x55c05becab80 2024-09-19T05:21:29.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.599+0000 7ff6e61ba740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c05be192b0 con 0x55c05bebfde0 2024-09-19T05:21:29.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.599+0000 7ff6e1b7d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c05bebfde0 0x55c05bec0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:29.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.599+0000 7ff6e1b7d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c05bebfde0 0x55c05bec0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:50878/0 (socket says 172.21.15.120:50878) 2024-09-19T05:21:29.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.599+0000 7ff6e1b7d640 1 -- 172.21.15.120:0/2563725509 learned_addr learned my addr 172.21.15.120:0/2563725509 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:29.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.599+0000 7ff6e137c640 1 --2- 172.21.15.120:0/2563725509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c05bec1350 0x55c05bebf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:29.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.599+0000 7ff6e137c640 1 --2- 172.21.15.120:0/2563725509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c05becab80 0x55c05beccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:29.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.599+0000 7ff6ceffd640 1 --2- 172.21.15.120:0/3269296892 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ff6c80a33b0 0x7ff6c80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:29.602 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.599+0000 7ff6e1b7d640 1 -- 172.21.15.120:0/2563725509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c05becab80 msgr2=0x55c05beccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:29.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.599+0000 7ff6e1b7d640 1 --2- 172.21.15.120:0/2563725509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c05becab80 0x55c05beccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.599+0000 7ff6e1b7d640 1 -- 172.21.15.120:0/2563725509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c05bec1350 msgr2=0x55c05bebf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:29.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.599+0000 7ff6e1b7d640 1 --2- 172.21.15.120:0/2563725509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c05bec1350 0x55c05bebf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.599+0000 7ff6e1b7d640 1 -- 172.21.15.120:0/2563725509 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c05bda93a0 con 0x55c05bebfde0 2024-09-19T05:21:29.603 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.600+0000 7ff6ceffd640 1 -- 172.21.15.120:0/3269296892 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7ff6d40d0550 con 0x7ff6dc106b80 2024-09-19T05:21:29.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.600+0000 7ff6e1b7d640 1 --2- 172.21.15.120:0/2563725509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c05bebfde0 0x55c05bec0220 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0034000 tx=0x7ff6d0005da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acb87ef6d64fd6c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:29.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.600+0000 7ff6e237e640 1 --2- 172.21.15.120:0/3269296892 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ff6c80a33b0 0x7ff6c80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:29.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.600+0000 7ff6c7fff640 1 -- 172.21.15.120:0/2563725509 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0037040 con 0x55c05bebfde0 2024-09-19T05:21:29.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.600+0000 7ff6c7fff640 1 -- 172.21.15.120:0/2563725509 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff6d0030450 con 0x55c05bebfde0 2024-09-19T05:21:29.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.600+0000 7ff6c7fff640 1 -- 172.21.15.120:0/2563725509 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d00053a0 con 0x55c05bebfde0 2024-09-19T05:21:29.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.601+0000 7ff6e61ba740 1 -- 172.21.15.120:0/2563725509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c05bebfde0 msgr2=0x55c05bec0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:29.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.601+0000 7ff6e237e640 1 --2- 172.21.15.120:0/3269296892 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ff6c80a33b0 0x7ff6c80a5870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff6d409c4e0 tx=0x7ff6d4005860 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:29.604 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.601+0000 7ff6e61ba740 1 --2- 172.21.15.120:0/2563725509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c05bebfde0 0x55c05bec0220 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0034000 tx=0x7ff6d0005da0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.601+0000 7ff6e61ba740 1 -- 172.21.15.120:0/2563725509 shutdown_connections 2024-09-19T05:21:29.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.601+0000 7ff6e61ba740 1 --2- 172.21.15.120:0/2563725509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c05becab80 0x55c05beccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.601+0000 7ff6e61ba740 1 --2- 172.21.15.120:0/2563725509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c05bebfde0 0x55c05bec0220 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.601+0000 7ff6e61ba740 1 --2- 172.21.15.120:0/2563725509 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c05bec1350 0x55c05bebf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.601+0000 7ff6e61ba740 1 -- 172.21.15.120:0/2563725509 >> 172.21.15.120:0/2563725509 conn(0x55c05be80310 msgr2=0x55c05bebc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:29.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.602+0000 7ff6e61ba740 1 -- 172.21.15.120:0/2563725509 shutdown_connections 2024-09-19T05:21:29.605 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.602+0000 7ff6e61ba740 1 -- 172.21.15.120:0/2563725509 wait complete. 2024-09-19T05:21:29.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.603+0000 7ff6e61ba740 1 -- start start 2024-09-19T05:21:29.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.603+0000 7ff6e61ba740 1 Processor -- start 2024-09-19T05:21:29.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.604+0000 7ff6e61ba740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c05bebfde0 0x55c05beca550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:29.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.604+0000 7ff6e61ba740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c05bec1350 0x55c05bec7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:29.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.604+0000 7ff6e137c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c05bebfde0 0x55c05beca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:29.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.604+0000 7ff6e137c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c05bebfde0 0x55c05beca550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:59522/0 (socket says 172.21.15.120:59522) 2024-09-19T05:21:29.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.604+0000 7ff6e137c640 1 -- 172.21.15.120:0/2541904922 learned_addr learned my addr 172.21.15.120:0/2541904922 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:29.606 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.604+0000 7ff6e1b7d640 1 --2- 172.21.15.120:0/2541904922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c05bec1350 0x55c05bec7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:29.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.605+0000 7ff6e61ba740 1 --2- 172.21.15.120:0/2541904922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c05becab80 0x55c05bec7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:29.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.605+0000 7ff6e61ba740 1 -- 172.21.15.120:0/2541904922 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c05becd820 con 0x55c05becab80 2024-09-19T05:21:29.610 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.605+0000 7ff6e61ba740 1 -- 172.21.15.120:0/2541904922 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55c05bdd8060 con 0x55c05bebfde0 2024-09-19T05:21:29.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.605+0000 7ff6e61ba740 1 -- 172.21.15.120:0/2541904922 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c05becd9a0 con 0x55c05bec1350 2024-09-19T05:21:29.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.605+0000 7ff6e61ba740 10 client.0 _ll_register_callbacks cb 0x55c05bb2b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:29.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.605+0000 7ff6e137c640 1 --2- 172.21.15.120:0/2541904922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c05becab80 0x55c05bec7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:29.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.605+0000 7ff6e1b7d640 1 -- 172.21.15.120:0/2541904922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c05bebfde0 msgr2=0x55c05beca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:29.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.605+0000 7ff6e1b7d640 1 --2- 172.21.15.120:0/2541904922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c05bebfde0 0x55c05beca550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.605+0000 7ff6e1b7d640 1 -- 172.21.15.120:0/2541904922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c05becab80 msgr2=0x55c05bec7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:29.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.605+0000 7ff6e1b7d640 1 --2- 172.21.15.120:0/2541904922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c05becab80 0x55c05bec7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.606+0000 7ff6e1b7d640 1 -- 172.21.15.120:0/2541904922 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c05bb8e3c0 con 0x55c05bec1350 2024-09-19T05:21:29.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.606+0000 7ff6e1b7d640 1 --2- 172.21.15.120:0/2541904922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c05bec1350 0x55c05bec7800 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0035040 tx=0x7ff6d0030f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dff88db66e60d07b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:29.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.606+0000 7ff6c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:21:29.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.606+0000 7ff6e61ba740 1 -- 172.21.15.120:0/2541904922 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6d0030450 con 0x55c05bec1350 2024-09-19T05:21:29.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.606+0000 7ff6c57fa640 1 -- 172.21.15.120:0/2541904922 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0037040 con 0x55c05bec1350 2024-09-19T05:21:29.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.606+0000 7ff6c57fa640 1 -- 172.21.15.120:0/2541904922 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7ff6d0005530 con 0x55c05bec1350 2024-09-19T05:21:29.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.606+0000 7ff6c57fa640 1 -- 172.21.15.120:0/2541904922 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff6d0030d90 con 0x55c05bec1350 2024-09-19T05:21:29.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.606+0000 7ff6e61ba740 10 client.25300 fetch_fsmap learned FSMap version 27 2024-09-19T05:21:29.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.606+0000 7ff6e61ba740 1 -- 172.21.15.120:0/2541904922 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55c05becd870 con 0x55c05bec1350 2024-09-19T05:21:29.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.607+0000 7ff6c57fa640 1 -- 172.21.15.120:0/2541904922 <== mon.1 v2:172.21.15.194:3300/0 4 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff6d00046c0 con 0x55c05bec1350 2024-09-19T05:21:29.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.607+0000 7ff6e61ba740 10 client.25300 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:21:29.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.607+0000 7ff6e61ba740 10 client.25300 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T05:21:29.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.607+0000 7ff6e61ba740 20 client.25300 populate_metadata read hostname 'smithi120' 2024-09-19T05:21:29.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.607+0000 7ff6e61ba740 1 --2- 172.21.15.120:0/2541904922 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55c05beda2e0 0x55c05bedc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:29.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.607+0000 7ff6e61ba740 4 client.25300 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:21:29.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.607+0000 7ff6e61ba740 1 -- 172.21.15.120:0/2541904922 --> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c05be2a860 con 0x55c05beda2e0 2024-09-19T05:21:29.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.607+0000 7ff6e137c640 1 --2- 172.21.15.120:0/2541904922 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55c05beda2e0 0x55c05bedc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:29.612 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.607+0000 7ff6c57fa640 10 client.25300 ms_handle_connect on v2:172.21.15.194:6836/378729335 2024-09-19T05:21:29.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.607+0000 7ff6e137c640 1 --2- 172.21.15.120:0/2541904922 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55c05beda2e0 0x55c05bedc6d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d2b8a419655ca98 server_cookie=623804c70ea8390 in_seq=0 out_seq=0 2024-09-19T05:21:29.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.608+0000 7ff6c57fa640 1 -- 172.21.15.120:0/2541904922 <== mds.2 v2:172.21.15.194:6836/378729335 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c05be2a860 con 0x55c05beda2e0 2024-09-19T05:21:29.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.608+0000 7ff6c57fa640 10 client.25300 handle_command_reply: tid=0 2024-09-19T05:21:29.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.608+0000 7ff6e61ba740 1 client.25300 shutdown 2024-09-19T05:21:29.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.608+0000 7ff6e61ba740 1 -- 172.21.15.120:0/2541904922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c05bec1350 msgr2=0x55c05bec7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:29.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.608+0000 7ff6e61ba740 1 --2- 172.21.15.120:0/2541904922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c05bec1350 0x55c05bec7800 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0035040 tx=0x7ff6d0030f90 comp rx=0 tx=0).stop 2024-09-19T05:21:29.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.608+0000 7ff6e61ba740 1 -- 172.21.15.120:0/2541904922 shutdown_connections 2024-09-19T05:21:29.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.608+0000 7ff6e61ba740 1 --2- 172.21.15.120:0/2541904922 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55c05beda2e0 0x55c05bedc6d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.608+0000 7ff6e61ba740 1 --2- 172.21.15.120:0/2541904922 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c05becab80 0x55c05bec7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.608+0000 7ff6c57fa640 0 client.25300 ms_handle_reset on v2:172.21.15.194:6836/378729335 2024-09-19T05:21:29.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.608+0000 7ff6e61ba740 1 --2- 172.21.15.120:0/2541904922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c05bec1350 0x55c05bec7800 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.608+0000 7ff6e61ba740 1 --2- 172.21.15.120:0/2541904922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c05bebfde0 0x55c05beca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.613 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.608+0000 7ff6e61ba740 1 -- 172.21.15.120:0/2541904922 >> 172.21.15.120:0/2541904922 conn(0x55c05be80310 msgr2=0x55c05bec2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:29.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.608+0000 7ff6e61ba740 1 -- 172.21.15.120:0/2541904922 shutdown_connections 2024-09-19T05:21:29.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.608+0000 7ff6e61ba740 1 -- 172.21.15.120:0/2541904922 wait complete. 2024-09-19T05:21:29.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.608+0000 7ff6e61ba740 20 client.25300 trim_cache size 0 max 16384 2024-09-19T05:21:29.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.626+0000 7ff6e61ba740 1 Processor -- start 2024-09-19T05:21:29.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.626+0000 7ff6e61ba740 1 -- start start 2024-09-19T05:21:29.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.626+0000 7ff6e61ba740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c05bebfde0 0x55c05bec2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:29.628 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.626+0000 7ff6e61ba740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c05bec1350 0x55c05bec2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:29.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.626+0000 7ff6e61ba740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c05becab80 0x55c05bee1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:29.630 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.626+0000 7ff6e61ba740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc1adf90 con 0x55c05bec1350 2024-09-19T05:21:29.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.626+0000 7ff6e61ba740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc1ab860 con 0x55c05bebfde0 2024-09-19T05:21:29.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.626+0000 7ff6e61ba740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc1a96b0 con 0x55c05becab80 2024-09-19T05:21:29.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.626+0000 7ff6e1b7d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c05bec1350 0x55c05bec2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:29.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.626+0000 7ff6e1b7d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c05bec1350 0x55c05bec2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50012/0 (socket says 172.21.15.120:50012) 2024-09-19T05:21:29.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.626+0000 7ff6e1b7d640 1 -- 172.21.15.120:0/93026572 learned_addr learned my addr 172.21.15.120:0/93026572 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:29.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.626+0000 7ff6e137c640 1 --2- 172.21.15.120:0/93026572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c05becab80 0x55c05bee1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:29.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.626+0000 7ff6e137c640 1 --2- 172.21.15.120:0/93026572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c05bebfde0 0x55c05bec2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:29.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.627+0000 7ff6e137c640 1 -- 172.21.15.120:0/93026572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c05becab80 msgr2=0x55c05bee1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:29.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.627+0000 7ff6e137c640 1 --2- 172.21.15.120:0/93026572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c05becab80 0x55c05bee1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.627+0000 7ff6e137c640 1 -- 172.21.15.120:0/93026572 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c05bec1350 msgr2=0x55c05bec2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:29.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.627+0000 7ff6e137c640 1 --2- 172.21.15.120:0/93026572 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c05bec1350 0x55c05bec2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.627+0000 7ff6e137c640 1 -- 172.21.15.120:0/93026572 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c05beca8c0 con 0x55c05bebfde0 2024-09-19T05:21:29.631 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.627+0000 7ff6e137c640 1 --2- 172.21.15.120:0/93026572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c05bebfde0 0x55c05bec2930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8009f40 tx=0x7ff6d8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4aa4544daae220c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:29.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.627+0000 7ff6c77fe640 1 -- 172.21.15.120:0/93026572 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8003a80 con 0x55c05bebfde0 2024-09-19T05:21:29.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.627+0000 7ff6c77fe640 1 -- 172.21.15.120:0/93026572 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff6d80054d0 con 0x55c05bebfde0 2024-09-19T05:21:29.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.627+0000 7ff6c77fe640 1 -- 172.21.15.120:0/93026572 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8004c30 con 0x55c05bebfde0 2024-09-19T05:21:29.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.628+0000 7ff6e61ba740 1 -- 172.21.15.120:0/93026572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c05bebfde0 msgr2=0x55c05bec2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:29.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.628+0000 7ff6e61ba740 1 --2- 172.21.15.120:0/93026572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c05bebfde0 0x55c05bec2930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8009f40 tx=0x7ff6d8004730 comp rx=0 tx=0).stop 2024-09-19T05:21:29.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.628+0000 7ff6e61ba740 1 -- 172.21.15.120:0/93026572 shutdown_connections 2024-09-19T05:21:29.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.628+0000 7ff6e61ba740 1 --2- 172.21.15.120:0/93026572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c05becab80 0x55c05bee1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.628+0000 7ff6e61ba740 1 --2- 172.21.15.120:0/93026572 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c05bec1350 0x55c05bec2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.628+0000 7ff6e61ba740 1 --2- 172.21.15.120:0/93026572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c05bebfde0 0x55c05bec2930 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.628+0000 7ff6e61ba740 1 -- 172.21.15.120:0/93026572 >> 172.21.15.120:0/93026572 conn(0x55c05be80310 msgr2=0x55c05bec9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:29.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.628+0000 7ff6e61ba740 1 -- 172.21.15.120:0/93026572 shutdown_connections 2024-09-19T05:21:29.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.628+0000 7ff6e61ba740 1 -- 172.21.15.120:0/93026572 wait complete. 2024-09-19T05:21:29.632 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.628+0000 7ff6e61ba740 1 -- start start 2024-09-19T05:21:29.633 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.629+0000 7ff6e61ba740 1 Processor -- start 2024-09-19T05:21:29.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.629+0000 7ff6e61ba740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c05bebfde0 0x55c05bececc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:29.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.629+0000 7ff6e61ba740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c05bec1350 0x55c05becf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:29.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.629+0000 7ff6e61ba740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c05becab80 0x55c05becf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:29.635 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.629+0000 7ff6e61ba740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc1a9d20 con 0x55c05bec1350 2024-09-19T05:21:29.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.629+0000 7ff6e61ba740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc1ab190 con 0x55c05bebfde0 2024-09-19T05:21:29.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.629+0000 7ff6e61ba740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff6dc1aa3f0 con 0x55c05becab80 2024-09-19T05:21:29.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.629+0000 7ff6e61ba740 10 client.0 _ll_register_callbacks cb 0x7ff6d8009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:29.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.630+0000 7ff6e1b7d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c05bec1350 0x55c05becf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:29.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.630+0000 7ff6e1b7d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c05bec1350 0x55c05becf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50026/0 (socket says 172.21.15.120:50026) 2024-09-19T05:21:29.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.630+0000 7ff6e1b7d640 1 -- 172.21.15.120:0/2428230301 learned_addr learned my addr 172.21.15.120:0/2428230301 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:29.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.630+0000 7ff6e137c640 1 --2- 172.21.15.120:0/2428230301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c05becab80 0x55c05becf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:29.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.630+0000 7ff6e137c640 1 --2- 172.21.15.120:0/2428230301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c05bebfde0 0x55c05bececc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:29.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.630+0000 7ff6e1b7d640 1 -- 172.21.15.120:0/2428230301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c05becab80 msgr2=0x55c05becf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:29.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.630+0000 7ff6e1b7d640 1 --2- 172.21.15.120:0/2428230301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c05becab80 0x55c05becf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.630+0000 7ff6e1b7d640 1 -- 172.21.15.120:0/2428230301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c05bebfde0 msgr2=0x55c05bececc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:29.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.630+0000 7ff6e1b7d640 1 --2- 172.21.15.120:0/2428230301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c05bebfde0 0x55c05bececc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.636 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.630+0000 7ff6e1b7d640 1 -- 172.21.15.120:0/2428230301 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c05bec8160 con 0x55c05bec1350 2024-09-19T05:21:29.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.630+0000 7ff6e137c640 1 --2- 172.21.15.120:0/2428230301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c05bebfde0 0x55c05bececc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:29.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.630+0000 7ff6e1b7d640 1 --2- 172.21.15.120:0/2428230301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c05bec1350 0x55c05becf200 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0000c00 tx=0x7ff6d0005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=501ee1f2f68e0206 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:29.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.630+0000 7ff6c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:21:29.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.631+0000 7ff6c57fa640 1 -- 172.21.15.120:0/2428230301 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0030910 con 0x55c05bec1350 2024-09-19T05:21:29.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.631+0000 7ff6e61ba740 1 -- 172.21.15.120:0/2428230301 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6d80054d0 con 0x55c05bec1350 2024-09-19T05:21:29.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.631+0000 7ff6c57fa640 1 -- 172.21.15.120:0/2428230301 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7ff6d0004b70 con 0x55c05bec1350 2024-09-19T05:21:29.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.631+0000 7ff6c57fa640 1 -- 172.21.15.120:0/2428230301 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff6d0004d70 con 0x55c05bec1350 2024-09-19T05:21:29.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.631+0000 7ff6e61ba740 10 client.15777 fetch_fsmap learned FSMap version 27 2024-09-19T05:21:29.637 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.631+0000 7ff6e61ba740 1 -- 172.21.15.120:0/2428230301 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c05bf45130 con 0x55c05bec1350 2024-09-19T05:21:29.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.631+0000 7ff6c57fa640 1 -- 172.21.15.120:0/2428230301 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff6d80054d0 con 0x55c05bec1350 2024-09-19T05:21:29.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.631+0000 7ff6c57fa640 1 -- 172.21.15.120:0/2428230301 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7ff6d0003a70 con 0x55c05bec1350 2024-09-19T05:21:29.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.631+0000 7ff6e61ba740 10 client.15777 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:21:29.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.631+0000 7ff6e61ba740 10 client.15777 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T05:21:29.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.631+0000 7ff6e61ba740 20 client.15777 populate_metadata read hostname 'smithi120' 2024-09-19T05:21:29.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.631+0000 7ff6e61ba740 1 --2- 172.21.15.120:0/2428230301 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55c05beda2e0 0x55c05bf47800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:29.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.631+0000 7ff6e61ba740 4 client.15777 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T05:21:29.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.631+0000 7ff6e61ba740 1 -- 172.21.15.120:0/2428230301 --> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c05be24d70 con 0x55c05beda2e0 2024-09-19T05:21:29.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.632+0000 7ff6e137c640 1 --2- 172.21.15.120:0/2428230301 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55c05beda2e0 0x55c05bf47800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:29.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.632+0000 7ff6c57fa640 10 client.15777 ms_handle_connect on v2:172.21.15.194:6836/378729335 2024-09-19T05:21:29.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.632+0000 7ff6e137c640 1 --2- 172.21.15.120:0/2428230301 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55c05beda2e0 0x55c05bf47800 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=be338c1f5b9d6fe5 server_cookie=a9f9ec85064928fd in_seq=0 out_seq=0 2024-09-19T05:21:29.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.632+0000 7ff6c57fa640 1 -- 172.21.15.120:0/2428230301 <== mds.2 v2:172.21.15.194:6836/378729335 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c05be24d70 con 0x55c05beda2e0 2024-09-19T05:21:29.638 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.632+0000 7ff6c57fa640 10 client.15777 handle_command_reply: tid=0 2024-09-19T05:21:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.632+0000 7ff6e61ba740 1 client.15777 shutdown 2024-09-19T05:21:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.633+0000 7ff6e61ba740 1 -- 172.21.15.120:0/2428230301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c05bec1350 msgr2=0x55c05becf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.633+0000 7ff6e61ba740 1 --2- 172.21.15.120:0/2428230301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c05bec1350 0x55c05becf200 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0000c00 tx=0x7ff6d0005a90 comp rx=0 tx=0).stop 2024-09-19T05:21:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.633+0000 7ff6e61ba740 1 -- 172.21.15.120:0/2428230301 shutdown_connections 2024-09-19T05:21:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.633+0000 7ff6e61ba740 1 --2- 172.21.15.120:0/2428230301 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55c05beda2e0 0x55c05bf47800 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.633+0000 7ff6c57fa640 0 client.15777 ms_handle_reset on v2:172.21.15.194:6836/378729335 2024-09-19T05:21:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.633+0000 7ff6e61ba740 1 --2- 172.21.15.120:0/2428230301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c05becab80 0x55c05becf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.633+0000 7ff6e61ba740 1 --2- 172.21.15.120:0/2428230301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c05bec1350 0x55c05becf200 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.633+0000 7ff6e61ba740 1 --2- 172.21.15.120:0/2428230301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c05bebfde0 0x55c05bececc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.633+0000 7ff6e61ba740 1 -- 172.21.15.120:0/2428230301 >> 172.21.15.120:0/2428230301 conn(0x55c05be80310 msgr2=0x55c05beb24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.633+0000 7ff6e61ba740 1 -- 172.21.15.120:0/2428230301 shutdown_connections 2024-09-19T05:21:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.633+0000 7ff6e61ba740 1 -- 172.21.15.120:0/2428230301 wait complete. 2024-09-19T05:21:29.639 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.633+0000 7ff6e61ba740 20 client.15777 trim_cache size 0 max 16384 2024-09-19T05:21:29.640 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-09-19T05:21:29.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.634+0000 7ff6e3de1640 1 -- 172.21.15.120:0/3269296892 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ff6c80a33b0 msgr2=0x7ff6c80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:29.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.634+0000 7ff6e3de1640 1 --2- 172.21.15.120:0/3269296892 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ff6c80a33b0 0x7ff6c80a5870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff6d409c4e0 tx=0x7ff6d4005860 comp rx=0 tx=0).stop 2024-09-19T05:21:29.640 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.634+0000 7ff6e3de1640 1 -- 172.21.15.120:0/3269296892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6dc106b80 msgr2=0x7ff6dc19cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.634+0000 7ff6e3de1640 1 --2- 172.21.15.120:0/3269296892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6dc106b80 0x7ff6dc19cc40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400eb40 tx=0x7ff6d400ef40 comp rx=0 tx=0).stop 2024-09-19T05:21:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.634+0000 7ff6e3de1640 1 -- 172.21.15.120:0/3269296892 shutdown_connections 2024-09-19T05:21:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.634+0000 7ff6e3de1640 1 --2- 172.21.15.120:0/3269296892 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ff6c80a33b0 0x7ff6c80a5870 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.634+0000 7ff6e3de1640 1 --2- 172.21.15.120:0/3269296892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6dc106b80 0x7ff6dc19cc40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.634+0000 7ff6e3de1640 1 --2- 172.21.15.120:0/3269296892 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6dc1005a0 0x7ff6dc1988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.634+0000 7ff6e3de1640 1 --2- 172.21.15.120:0/3269296892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6dc0ffc00 0x7ff6dc198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.634+0000 7ff6e3de1640 1 -- 172.21.15.120:0/3269296892 >> 172.21.15.120:0/3269296892 conn(0x7ff6dc0fba90 msgr2=0x7ff6dc0fc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.634+0000 7ff6e3de1640 1 -- 172.21.15.120:0/3269296892 shutdown_connections 2024-09-19T05:21:29.641 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:29.634+0000 7ff6e3de1640 1 -- 172.21.15.120:0/3269296892 wait complete. 2024-09-19T05:21:30.362 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T05:21:30.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:30 smithi120 ceph-mon[30956]: pgmap v71: 97 pgs: 97 active+clean; 174 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.7 MiB/s wr, 629 op/s 2024-09-19T05:21:30.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:30 smithi178 ceph-mon[34347]: pgmap v71: 97 pgs: 97 active+clean; 174 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.7 MiB/s wr, 629 op/s 2024-09-19T05:21:30.714 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:30.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:30 smithi194 ceph-mon[35228]: pgmap v71: 97 pgs: 97 active+clean; 174 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.7 MiB/s wr, 629 op/s 2024-09-19T05:21:31.261 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.259+0000 7f5f3c86b640 1 -- 172.21.15.120:0/2368994799 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f38101420 msgr2=0x7f5f3810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:31.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.259+0000 7f5f3c86b640 1 --2- 172.21.15.120:0/2368994799 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f38101420 0x7f5f3810d950 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009cd0 tx=0x7f5f3002a8e0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.259+0000 7f5f3c86b640 1 -- 172.21.15.120:0/2368994799 shutdown_connections 2024-09-19T05:21:31.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.259+0000 7f5f3c86b640 1 --2- 172.21.15.120:0/2368994799 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f38101420 0x7f5f3810d950 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.259+0000 7f5f3c86b640 1 --2- 172.21.15.120:0/2368994799 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f38100a80 0x7f5f38100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.259+0000 7f5f3c86b640 1 --2- 172.21.15.120:0/2368994799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f38106a80 0x7f5f38106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.259+0000 7f5f3c86b640 1 -- 172.21.15.120:0/2368994799 >> 172.21.15.120:0/2368994799 conn(0x7f5f380fc7a0 msgr2=0x7f5f380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:31.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.259+0000 7f5f3c86b640 1 -- 172.21.15.120:0/2368994799 shutdown_connections 2024-09-19T05:21:31.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.259+0000 7f5f3c86b640 1 -- 172.21.15.120:0/2368994799 wait complete. 2024-09-19T05:21:31.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.260+0000 7f5f3c86b640 1 Processor -- start 2024-09-19T05:21:31.262 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.260+0000 7f5f3c86b640 1 -- start start 2024-09-19T05:21:31.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.260+0000 7f5f3c86b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f38100a80 0x7f5f38195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.260+0000 7f5f3c86b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f38101420 0x7f5f38196510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.260+0000 7f5f3c86b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f38106a80 0x7f5f38196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.260+0000 7f5f3c86b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3810fc80 con 0x7f5f38106a80 2024-09-19T05:21:31.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.260+0000 7f5f3c86b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3810fb00 con 0x7f5f38101420 2024-09-19T05:21:31.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.260+0000 7f5f3c86b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3810fe00 con 0x7f5f38100a80 2024-09-19T05:21:31.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.260+0000 7f5f3659c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f38100a80 0x7f5f38195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.264 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.260+0000 7f5f35d9b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f38101420 0x7f5f38196510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.261+0000 7f5f3659c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f38100a80 0x7f5f38195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:50926/0 (socket says 172.21.15.120:50926) 2024-09-19T05:21:31.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.261+0000 7f5f36d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f38106a80 0x7f5f38196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.261+0000 7f5f3659c640 1 -- 172.21.15.120:0/1810588673 learned_addr learned my addr 172.21.15.120:0/1810588673 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:31.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.261+0000 7f5f3659c640 1 -- 172.21.15.120:0/1810588673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f38101420 msgr2=0x7f5f38196510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:31.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.261+0000 7f5f3659c640 1 --2- 172.21.15.120:0/1810588673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f38101420 0x7f5f38196510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.261+0000 7f5f3659c640 1 -- 172.21.15.120:0/1810588673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f38106a80 msgr2=0x7f5f38196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:31.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.261+0000 7f5f3659c640 1 --2- 172.21.15.120:0/1810588673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f38106a80 0x7f5f38196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.261+0000 7f5f3659c640 1 -- 172.21.15.120:0/1810588673 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f381aac50 con 0x7f5f38100a80 2024-09-19T05:21:31.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.261+0000 7f5f36d9d640 1 --2- 172.21.15.120:0/1810588673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f38106a80 0x7f5f38196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:31.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.261+0000 7f5f3659c640 1 --2- 172.21.15.120:0/1810588673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f38100a80 0x7f5f38195fd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5f2800ea20 tx=0x7f5f2800eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:31.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.261+0000 7f5f277fe640 1 -- 172.21.15.120:0/1810588673 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2800cd80 con 0x7f5f38100a80 2024-09-19T05:21:31.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.262+0000 7f5f277fe640 1 -- 172.21.15.120:0/1810588673 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f280108e0 con 0x7f5f38100a80 2024-09-19T05:21:31.265 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.262+0000 7f5f3c86b640 1 -- 172.21.15.120:0/1810588673 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f381aaf40 con 0x7f5f38100a80 2024-09-19T05:21:31.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.262+0000 7f5f277fe640 1 -- 172.21.15.120:0/1810588673 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f28018840 con 0x7f5f38100a80 2024-09-19T05:21:31.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.262+0000 7f5f3c86b640 1 -- 172.21.15.120:0/1810588673 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f381ab440 con 0x7f5f38100a80 2024-09-19T05:21:31.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.264+0000 7f5f277fe640 1 -- 172.21.15.120:0/1810588673 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f5f28010a90 con 0x7f5f38100a80 2024-09-19T05:21:31.266 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.265+0000 7f5f3ec44740 1 Processor -- start 2024-09-19T05:21:31.267 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.265+0000 7f5f3ec44740 1 -- start start 2024-09-19T05:21:31.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.265+0000 7f5f3ec44740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55595c11db40 0x55595c11c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.265+0000 7f5f3ec44740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55595c11c5d0 0x55595c11ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.265+0000 7f5f3ec44740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55595c127370 0x55595c129760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.265+0000 7f5f3ec44740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55595c0822f0 con 0x55595c127370 2024-09-19T05:21:31.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.265+0000 7f5f3ec44740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55595c029cf0 con 0x55595c11db40 2024-09-19T05:21:31.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.265+0000 7f5f3ec44740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55595c07e2b0 con 0x55595c11c5d0 2024-09-19T05:21:31.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.266+0000 7f5f36d9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55595c11db40 0x55595c11c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.266+0000 7f5f36d9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55595c11db40 0x55595c11c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:59572/0 (socket says 172.21.15.120:59572) 2024-09-19T05:21:31.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.266+0000 7f5f36d9d640 1 -- 172.21.15.120:0/1551067982 learned_addr learned my addr 172.21.15.120:0/1551067982 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:31.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.266+0000 7f5f35d9b640 1 --2- 172.21.15.120:0/1551067982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55595c127370 0x55595c129760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.268 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.266+0000 7f5f277fe640 1 --2- 172.21.15.120:0/1810588673 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f5f200a3430 0x7f5f200a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.266+0000 7f5f3659c640 1 --2- 172.21.15.120:0/1551067982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55595c11c5d0 0x55595c11ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.266+0000 7f5f36d9d640 1 --2- 172.21.15.120:0/1810588673 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f5f200a3430 0x7f5f200a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.266+0000 7f5f35d9b640 1 -- 172.21.15.120:0/1551067982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55595c11c5d0 msgr2=0x55595c11ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:31.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.266+0000 7f5f35d9b640 1 --2- 172.21.15.120:0/1551067982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55595c11c5d0 0x55595c11ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.266+0000 7f5f35d9b640 1 -- 172.21.15.120:0/1551067982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55595c11db40 msgr2=0x55595c11c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:31.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.266+0000 7f5f35d9b640 1 --2- 172.21.15.120:0/1551067982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55595c11db40 0x55595c11c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.266+0000 7f5f35d9b640 1 -- 172.21.15.120:0/1551067982 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55595c00e3a0 con 0x55595c127370 2024-09-19T05:21:31.269 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.266+0000 7f5f3659c640 1 --2- 172.21.15.120:0/1551067982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55595c11c5d0 0x55595c11ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:21:31.271 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.266+0000 7f5f35d9b640 1 --2- 172.21.15.120:0/1551067982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55595c127370 0x55595c129760 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5f38197820 tx=0x7f5f2c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314c68c059b17f03 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:31.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.266+0000 7f5f277fe640 1 -- 172.21.15.120:0/1810588673 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f5f280cffe0 con 0x7f5f38100a80 2024-09-19T05:21:31.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.266+0000 7f5f36d9d640 1 --2- 172.21.15.120:0/1810588673 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f5f200a3430 0x7f5f200a58f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009a60 tx=0x7f5f3002a8e0 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:31.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.267+0000 7f5f24ff9640 1 -- 172.21.15.120:0/1551067982 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c004230 con 0x55595c127370 2024-09-19T05:21:31.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.267+0000 7f5f24ff9640 1 -- 172.21.15.120:0/1551067982 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f2c009e10 con 0x55595c127370 2024-09-19T05:21:31.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.267+0000 7f5f24ff9640 1 -- 172.21.15.120:0/1551067982 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c004c60 con 0x55595c127370 2024-09-19T05:21:31.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.268+0000 7f5f3ec44740 1 -- 172.21.15.120:0/1551067982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55595c127370 msgr2=0x55595c129760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:31.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.268+0000 7f5f3ec44740 1 --2- 172.21.15.120:0/1551067982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55595c127370 0x55595c129760 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5f38197820 tx=0x7f5f2c011810 comp rx=0 tx=0).stop 2024-09-19T05:21:31.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.268+0000 7f5f3ec44740 1 -- 172.21.15.120:0/1551067982 shutdown_connections 2024-09-19T05:21:31.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.268+0000 7f5f3ec44740 1 --2- 172.21.15.120:0/1551067982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55595c127370 0x55595c129760 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.268+0000 7f5f3ec44740 1 --2- 172.21.15.120:0/1551067982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55595c11c5d0 0x55595c11ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.272 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.268+0000 7f5f3ec44740 1 --2- 172.21.15.120:0/1551067982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55595c11db40 0x55595c11c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.268+0000 7f5f3ec44740 1 -- 172.21.15.120:0/1551067982 >> 172.21.15.120:0/1551067982 conn(0x55595c0e5310 msgr2=0x55595c118c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:31.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.268+0000 7f5f3ec44740 1 -- 172.21.15.120:0/1551067982 shutdown_connections 2024-09-19T05:21:31.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.268+0000 7f5f3ec44740 1 -- 172.21.15.120:0/1551067982 wait complete. 2024-09-19T05:21:31.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.268+0000 7f5f3ec44740 1 -- start start 2024-09-19T05:21:31.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.268+0000 7f5f3ec44740 1 Processor -- start 2024-09-19T05:21:31.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.269+0000 7f5f3ec44740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55595c11c5d0 0x55595c126d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.269+0000 7f5f3ec44740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55595c11db40 0x55595c124030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.269+0000 7f5f3ec44740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55595c127370 0x55595c124640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.269+0000 7f5f3ec44740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55595c12a070 con 0x55595c11c5d0 2024-09-19T05:21:31.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.269+0000 7f5f3ec44740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55595c03d060 con 0x55595c11db40 2024-09-19T05:21:31.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.269+0000 7f5f3ec44740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55595c12a1f0 con 0x55595c127370 2024-09-19T05:21:31.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.269+0000 7f5f3ec44740 10 client.0 _ll_register_callbacks cb 0x55595bd908c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:31.273 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.269+0000 7f5f3659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55595c11c5d0 0x55595c126d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.269+0000 7f5f3659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55595c11c5d0 0x55595c126d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50070/0 (socket says 172.21.15.120:50070) 2024-09-19T05:21:31.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.269+0000 7f5f3659c640 1 -- 172.21.15.120:0/3762129510 learned_addr learned my addr 172.21.15.120:0/3762129510 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:31.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.269+0000 7f5f36d9d640 1 --2- 172.21.15.120:0/3762129510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55595c127370 0x55595c124640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.269+0000 7f5f35d9b640 1 --2- 172.21.15.120:0/3762129510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55595c11db40 0x55595c124030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.269+0000 7f5f3659c640 1 -- 172.21.15.120:0/3762129510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55595c127370 msgr2=0x55595c124640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:31.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.269+0000 7f5f3659c640 1 --2- 172.21.15.120:0/3762129510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55595c127370 0x55595c124640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.269+0000 7f5f3659c640 1 -- 172.21.15.120:0/3762129510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55595c11db40 msgr2=0x55595c124030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:31.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.269+0000 7f5f3659c640 1 --2- 172.21.15.120:0/3762129510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55595c11db40 0x55595c124030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.269+0000 7f5f3659c640 1 -- 172.21.15.120:0/3762129510 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55595bdf33c0 con 0x55595c11c5d0 2024-09-19T05:21:31.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.269+0000 7f5f3659c640 1 --2- 172.21.15.120:0/3762129510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55595c11c5d0 0x55595c126d80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5f28000c00 tx=0x7f5f2809bd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12101dd477ecb11b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:31.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.269+0000 7f5f1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:21:31.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.270+0000 7f5f1dffb640 1 -- 172.21.15.120:0/3762129510 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f280cdb10 con 0x55595c11c5d0 2024-09-19T05:21:31.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.270+0000 7f5f3ec44740 1 -- 172.21.15.120:0/3762129510 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f2c009e10 con 0x55595c11c5d0 2024-09-19T05:21:31.274 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.270+0000 7f5f1dffb640 1 -- 172.21.15.120:0/3762129510 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f5f280a0320 con 0x55595c11c5d0 2024-09-19T05:21:31.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.270+0000 7f5f1dffb640 1 -- 172.21.15.120:0/3762129510 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5f28010de0 con 0x55595c11c5d0 2024-09-19T05:21:31.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.270+0000 7f5f3ec44740 10 client.15789 fetch_fsmap learned FSMap version 27 2024-09-19T05:21:31.275 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.270+0000 7f5f3ec44740 1 -- 172.21.15.120:0/3762129510 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55595c135b60 con 0x55595c11c5d0 2024-09-19T05:21:31.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.270+0000 7f5f1dffb640 1 -- 172.21.15.120:0/3762129510 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f280bae50 con 0x55595c11c5d0 2024-09-19T05:21:31.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.270+0000 7f5f1dffb640 1 -- 172.21.15.120:0/3762129510 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f5f28098010 con 0x55595c11c5d0 2024-09-19T05:21:31.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.271+0000 7f5f3ec44740 10 client.15789 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:21:31.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.271+0000 7f5f3ec44740 10 client.15789 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T05:21:31.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.271+0000 7f5f3ec44740 20 client.15789 populate_metadata read hostname 'smithi120' 2024-09-19T05:21:31.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.271+0000 7f5f3ec44740 1 --2- 172.21.15.120:0/3762129510 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55595c137020 0x55595c139410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.271+0000 7f5f3ec44740 4 client.15789 mds_command: new command op to 24443 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:21:31.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.271+0000 7f5f3ec44740 1 -- 172.21.15.120:0/3762129510 --> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5f2c009e10 con 0x55595c137020 2024-09-19T05:21:31.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.271+0000 7f5f35d9b640 1 --2- 172.21.15.120:0/3762129510 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55595c137020 0x55595c139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.271+0000 7f5f35d9b640 1 --2- 172.21.15.120:0/3762129510 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55595c137020 0x55595c139410 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=710dca683c91b7eb server_cookie=ec6e01c4a2b7d4f4 in_seq=0 out_seq=0 2024-09-19T05:21:31.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.271+0000 7f5f1dffb640 10 client.15789 ms_handle_connect on v2:172.21.15.178:6838/3389137566 2024-09-19T05:21:31.277 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.272+0000 7f5f1dffb640 1 -- 172.21.15.120:0/3762129510 <== mds.1 v2:172.21.15.178:6838/3389137566 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f5f2c009e10 con 0x55595c137020 2024-09-19T05:21:31.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.272+0000 7f5f1dffb640 10 client.15789 handle_command_reply: tid=0 2024-09-19T05:21:31.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.272+0000 7f5f3ec44740 1 client.15789 shutdown 2024-09-19T05:21:31.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.272+0000 7f5f3ec44740 1 -- 172.21.15.120:0/3762129510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55595c11c5d0 msgr2=0x55595c126d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:31.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.272+0000 7f5f3ec44740 1 --2- 172.21.15.120:0/3762129510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55595c11c5d0 0x55595c126d80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5f28000c00 tx=0x7f5f2809bd10 comp rx=0 tx=0).stop 2024-09-19T05:21:31.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.272+0000 7f5f3ec44740 1 -- 172.21.15.120:0/3762129510 shutdown_connections 2024-09-19T05:21:31.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.272+0000 7f5f3ec44740 1 --2- 172.21.15.120:0/3762129510 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55595c137020 0x55595c139410 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.272+0000 7f5f3ec44740 1 --2- 172.21.15.120:0/3762129510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55595c127370 0x55595c124640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.272+0000 7f5f3ec44740 1 --2- 172.21.15.120:0/3762129510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55595c11db40 0x55595c124030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.272+0000 7f5f3ec44740 1 --2- 172.21.15.120:0/3762129510 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55595c11c5d0 0x55595c126d80 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.272+0000 7f5f3ec44740 1 -- 172.21.15.120:0/3762129510 >> 172.21.15.120:0/3762129510 conn(0x55595c0e5310 msgr2=0x55595c11e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:31.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.273+0000 7f5f1dffb640 0 client.15789 ms_handle_reset on v2:172.21.15.178:6838/3389137566 2024-09-19T05:21:31.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.273+0000 7f5f3ec44740 1 -- 172.21.15.120:0/3762129510 shutdown_connections 2024-09-19T05:21:31.278 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.273+0000 7f5f3ec44740 1 -- 172.21.15.120:0/3762129510 wait complete. 2024-09-19T05:21:31.279 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.273+0000 7f5f3ec44740 20 client.15789 trim_cache size 0 max 16384 2024-09-19T05:21:31.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.290+0000 7f5f3ec44740 1 Processor -- start 2024-09-19T05:21:31.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.290+0000 7f5f3ec44740 1 -- start start 2024-09-19T05:21:31.292 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.291+0000 7f5f3ec44740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55595c11c5d0 0x55595c133310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.291+0000 7f5f3ec44740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55595c11db40 0x55595c125fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.291+0000 7f5f3ec44740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55595c127370 0x55595c1264e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.291+0000 7f5f3ec44740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5f381b6910 con 0x55595c11db40 2024-09-19T05:21:31.293 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.291+0000 7f5f3ec44740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5f381b41e0 con 0x55595c127370 2024-09-19T05:21:31.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.291+0000 7f5f3ec44740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5f381b2030 con 0x55595c11c5d0 2024-09-19T05:21:31.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.291+0000 7f5f35d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55595c11db40 0x55595c125fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.291+0000 7f5f36d9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55595c127370 0x55595c1264e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.291+0000 7f5f36d9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55595c127370 0x55595c1264e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:59604/0 (socket says 172.21.15.120:59604) 2024-09-19T05:21:31.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.291+0000 7f5f36d9d640 1 -- 172.21.15.120:0/2071286579 learned_addr learned my addr 172.21.15.120:0/2071286579 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:31.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.291+0000 7f5f3659c640 1 --2- 172.21.15.120:0/2071286579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55595c11c5d0 0x55595c133310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.291+0000 7f5f36d9d640 1 -- 172.21.15.120:0/2071286579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55595c11c5d0 msgr2=0x55595c133310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:31.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.291+0000 7f5f36d9d640 1 --2- 172.21.15.120:0/2071286579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55595c11c5d0 0x55595c133310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.291+0000 7f5f36d9d640 1 -- 172.21.15.120:0/2071286579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55595c11db40 msgr2=0x55595c125fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:31.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.291+0000 7f5f36d9d640 1 --2- 172.21.15.120:0/2071286579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55595c11db40 0x55595c125fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.291+0000 7f5f36d9d640 1 -- 172.21.15.120:0/2071286579 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55595c122580 con 0x55595c127370 2024-09-19T05:21:31.294 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.292+0000 7f5f36d9d640 1 --2- 172.21.15.120:0/2071286579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55595c127370 0x55595c1264e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009cd0 tx=0x7f5f30005f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dbf515a3fef964c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:31.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.292+0000 7f5f1ffff640 1 -- 172.21.15.120:0/2071286579 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3004f070 con 0x55595c127370 2024-09-19T05:21:31.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.292+0000 7f5f1ffff640 1 -- 172.21.15.120:0/2071286579 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f30036050 con 0x55595c127370 2024-09-19T05:21:31.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.292+0000 7f5f1ffff640 1 -- 172.21.15.120:0/2071286579 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f30054750 con 0x55595c127370 2024-09-19T05:21:31.295 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.293+0000 7f5f3ec44740 1 -- 172.21.15.120:0/2071286579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55595c127370 msgr2=0x55595c1264e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:31.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.293+0000 7f5f3ec44740 1 --2- 172.21.15.120:0/2071286579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55595c127370 0x55595c1264e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009cd0 tx=0x7f5f30005f50 comp rx=0 tx=0).stop 2024-09-19T05:21:31.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.293+0000 7f5f3ec44740 1 -- 172.21.15.120:0/2071286579 shutdown_connections 2024-09-19T05:21:31.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.293+0000 7f5f3ec44740 1 --2- 172.21.15.120:0/2071286579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55595c127370 0x55595c1264e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.293+0000 7f5f3ec44740 1 --2- 172.21.15.120:0/2071286579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55595c11db40 0x55595c125fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.293+0000 7f5f3ec44740 1 --2- 172.21.15.120:0/2071286579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55595c11c5d0 0x55595c133310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.293+0000 7f5f3ec44740 1 -- 172.21.15.120:0/2071286579 >> 172.21.15.120:0/2071286579 conn(0x55595c0e5310 msgr2=0x55595c125890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:31.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.293+0000 7f5f3ec44740 1 -- 172.21.15.120:0/2071286579 shutdown_connections 2024-09-19T05:21:31.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.293+0000 7f5f3ec44740 1 -- 172.21.15.120:0/2071286579 wait complete. 2024-09-19T05:21:31.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.293+0000 7f5f3ec44740 1 -- start start 2024-09-19T05:21:31.296 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.294+0000 7f5f3ec44740 1 Processor -- start 2024-09-19T05:21:31.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.294+0000 7f5f3ec44740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55595c11c5d0 0x55595c12f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.294+0000 7f5f3ec44740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55595c11db40 0x55595c12bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.294+0000 7f5f3ec44740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55595c127370 0x55595c12c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.294+0000 7f5f3ec44740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5f381b26a0 con 0x55595c11db40 2024-09-19T05:21:31.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.294+0000 7f5f3ec44740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5f381b3b10 con 0x55595c127370 2024-09-19T05:21:31.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.294+0000 7f5f3ec44740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5f381b2d70 con 0x55595c11c5d0 2024-09-19T05:21:31.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.294+0000 7f5f3ec44740 10 client.0 _ll_register_callbacks cb 0x7f5f2800c7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:31.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.294+0000 7f5f35d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55595c11db40 0x55595c12bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.294+0000 7f5f36d9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55595c127370 0x55595c12c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.300 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.294+0000 7f5f3659c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55595c11c5d0 0x55595c12f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.294+0000 7f5f35d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55595c11db40 0x55595c12bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50090/0 (socket says 172.21.15.120:50090) 2024-09-19T05:21:31.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.294+0000 7f5f35d9b640 1 -- 172.21.15.120:0/655129906 learned_addr learned my addr 172.21.15.120:0/655129906 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:31.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.295+0000 7f5f36d9d640 1 -- 172.21.15.120:0/655129906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55595c11c5d0 msgr2=0x55595c12f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:31.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.295+0000 7f5f36d9d640 1 --2- 172.21.15.120:0/655129906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55595c11c5d0 0x55595c12f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.295+0000 7f5f36d9d640 1 -- 172.21.15.120:0/655129906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55595c11db40 msgr2=0x55595c12bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:31.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.295+0000 7f5f36d9d640 1 --2- 172.21.15.120:0/655129906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55595c11db40 0x55595c12bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.295+0000 7f5f36d9d640 1 -- 172.21.15.120:0/655129906 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55595c12c650 con 0x55595c127370 2024-09-19T05:21:31.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.295+0000 7f5f3659c640 1 --2- 172.21.15.120:0/655129906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55595c11c5d0 0x55595c12f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:21:31.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.295+0000 7f5f36d9d640 1 --2- 172.21.15.120:0/655129906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55595c127370 0x55595c12c110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5f3002aed0 tx=0x7f5f300307d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0a5e354f34bfe8d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:31.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.295+0000 7f5f1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:21:31.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.295+0000 7f5f1dffb640 1 -- 172.21.15.120:0/655129906 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3005b070 con 0x55595c127370 2024-09-19T05:21:31.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.295+0000 7f5f1dffb640 1 -- 172.21.15.120:0/655129906 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f5f30054660 con 0x55595c127370 2024-09-19T05:21:31.301 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.295+0000 7f5f3ec44740 1 -- 172.21.15.120:0/655129906 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f30036050 con 0x55595c127370 2024-09-19T05:21:31.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.296+0000 7f5f1dffb640 1 -- 172.21.15.120:0/655129906 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5f30067050 con 0x55595c127370 2024-09-19T05:21:31.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.296+0000 7f5f3ec44740 10 client.25250 fetch_fsmap learned FSMap version 27 2024-09-19T05:21:31.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.296+0000 7f5f3ec44740 1 -- 172.21.15.120:0/655129906 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55595c1a28c0 con 0x55595c127370 2024-09-19T05:21:31.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.296+0000 7f5f1dffb640 1 -- 172.21.15.120:0/655129906 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5f30031d00 con 0x55595c127370 2024-09-19T05:21:31.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.296+0000 7f5f1dffb640 1 -- 172.21.15.120:0/655129906 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f5f30030070 con 0x55595c127370 2024-09-19T05:21:31.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.296+0000 7f5f3ec44740 10 client.25250 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:21:31.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.296+0000 7f5f3ec44740 10 client.25250 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T05:21:31.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.296+0000 7f5f3ec44740 20 client.25250 populate_metadata read hostname 'smithi120' 2024-09-19T05:21:31.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.296+0000 7f5f3ec44740 1 --2- 172.21.15.120:0/655129906 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55595c1a2e80 0x55595c1a52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:31.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.296+0000 7f5f3ec44740 4 client.25250 mds_command: new command op to 24443 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T05:21:31.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.296+0000 7f5f3ec44740 1 -- 172.21.15.120:0/655129906 --> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f5f30036050 con 0x55595c1a2e80 2024-09-19T05:21:31.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.297+0000 7f5f3659c640 1 --2- 172.21.15.120:0/655129906 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55595c1a2e80 0x55595c1a52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:31.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.297+0000 7f5f1dffb640 10 client.25250 ms_handle_connect on v2:172.21.15.178:6838/3389137566 2024-09-19T05:21:31.302 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.297+0000 7f5f3659c640 1 --2- 172.21.15.120:0/655129906 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55595c1a2e80 0x55595c1a52a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=18f12e8ea08afd93 server_cookie=b0c4949530ddf494 in_seq=0 out_seq=0 2024-09-19T05:21:31.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.297+0000 7f5f1dffb640 1 -- 172.21.15.120:0/655129906 <== mds.1 v2:172.21.15.178:6838/3389137566 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f5f30036050 con 0x55595c1a2e80 2024-09-19T05:21:31.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.297+0000 7f5f1dffb640 10 client.25250 handle_command_reply: tid=0 2024-09-19T05:21:31.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.297+0000 7f5f3ec44740 1 client.25250 shutdown 2024-09-19T05:21:31.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.297+0000 7f5f3ec44740 1 -- 172.21.15.120:0/655129906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55595c127370 msgr2=0x55595c12c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:31.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.298+0000 7f5f3ec44740 1 --2- 172.21.15.120:0/655129906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55595c127370 0x55595c12c110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5f3002aed0 tx=0x7f5f300307d0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.298+0000 7f5f3ec44740 1 -- 172.21.15.120:0/655129906 shutdown_connections 2024-09-19T05:21:31.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.298+0000 7f5f3ec44740 1 --2- 172.21.15.120:0/655129906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55595c127370 0x55595c12c110 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.298+0000 7f5f3ec44740 1 --2- 172.21.15.120:0/655129906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55595c11db40 0x55595c12bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.298+0000 7f5f3ec44740 1 --2- 172.21.15.120:0/655129906 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55595c1a2e80 0x55595c1a52a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.298+0000 7f5f3ec44740 1 --2- 172.21.15.120:0/655129906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55595c11c5d0 0x55595c12f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.298+0000 7f5f3ec44740 1 -- 172.21.15.120:0/655129906 >> 172.21.15.120:0/655129906 conn(0x55595c0e5310 msgr2=0x55595c1260b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:31.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.298+0000 7f5f1dffb640 0 client.25250 ms_handle_reset on v2:172.21.15.178:6838/3389137566 2024-09-19T05:21:31.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.298+0000 7f5f3ec44740 1 -- 172.21.15.120:0/655129906 shutdown_connections 2024-09-19T05:21:31.303 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.298+0000 7f5f3ec44740 1 -- 172.21.15.120:0/655129906 wait complete. 2024-09-19T05:21:31.304 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.298+0000 7f5f3ec44740 20 client.25250 trim_cache size 0 max 16384 2024-09-19T05:21:31.304 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-09-19T05:21:31.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.299+0000 7f5f3c86b640 1 -- 172.21.15.120:0/1810588673 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f5f200a3430 msgr2=0x7f5f200a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:31.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.299+0000 7f5f3c86b640 1 --2- 172.21.15.120:0/1810588673 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f5f200a3430 0x7f5f200a58f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009a60 tx=0x7f5f3002a8e0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.299+0000 7f5f3c86b640 1 -- 172.21.15.120:0/1810588673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f38100a80 msgr2=0x7f5f38195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:31.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.299+0000 7f5f3c86b640 1 --2- 172.21.15.120:0/1810588673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f38100a80 0x7f5f38195fd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5f2800ea20 tx=0x7f5f2800eee0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.305 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.299+0000 7f5f3c86b640 1 -- 172.21.15.120:0/1810588673 shutdown_connections 2024-09-19T05:21:31.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.299+0000 7f5f3c86b640 1 --2- 172.21.15.120:0/1810588673 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f5f200a3430 0x7f5f200a58f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.299+0000 7f5f3c86b640 1 --2- 172.21.15.120:0/1810588673 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5f38106a80 0x7f5f38196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.299+0000 7f5f3c86b640 1 --2- 172.21.15.120:0/1810588673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f38101420 0x7f5f38196510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.299+0000 7f5f3c86b640 1 --2- 172.21.15.120:0/1810588673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f38100a80 0x7f5f38195fd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:31.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.299+0000 7f5f3c86b640 1 -- 172.21.15.120:0/1810588673 >> 172.21.15.120:0/1810588673 conn(0x7f5f380fc7a0 msgr2=0x7f5f380fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:31.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.299+0000 7f5f3c86b640 1 -- 172.21.15.120:0/1810588673 shutdown_connections 2024-09-19T05:21:31.306 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:31.299+0000 7f5f3c86b640 1 -- 172.21.15.120:0/1810588673 wait complete. 2024-09-19T05:21:32.092 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T05:21:32.462 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:32.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:32 smithi178 ceph-mon[34347]: pgmap v72: 97 pgs: 97 active+clean; 174 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 461 op/s 2024-09-19T05:21:32.734 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:32 smithi120 ceph-mon[30956]: pgmap v72: 97 pgs: 97 active+clean; 174 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 461 op/s 2024-09-19T05:21:32.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:32 smithi194 ceph-mon[35228]: pgmap v72: 97 pgs: 97 active+clean; 174 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 461 op/s 2024-09-19T05:21:33.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.034+0000 7fa5883cb640 1 -- 172.21.15.120:0/2900905115 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa580106b80 msgr2=0x7fa580106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:33.036 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.034+0000 7fa5883cb640 1 --2- 172.21.15.120:0/2900905115 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa580106b80 0x7fa580106f60 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa57c009900 tx=0x7fa57c02a410 comp rx=0 tx=0).stop 2024-09-19T05:21:33.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.034+0000 7fa5883cb640 1 -- 172.21.15.120:0/2900905115 shutdown_connections 2024-09-19T05:21:33.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.034+0000 7fa5883cb640 1 --2- 172.21.15.120:0/2900905115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa580100aa0 0x7fa58010ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.034+0000 7fa5883cb640 1 --2- 172.21.15.120:0/2900905115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa580100100 0x7fa580100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.034+0000 7fa5883cb640 1 --2- 172.21.15.120:0/2900905115 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa580106b80 0x7fa580106f60 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.034+0000 7fa5883cb640 1 -- 172.21.15.120:0/2900905115 >> 172.21.15.120:0/2900905115 conn(0x7fa580077230 msgr2=0x7fa5800fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:33.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.034+0000 7fa5883cb640 1 -- 172.21.15.120:0/2900905115 shutdown_connections 2024-09-19T05:21:33.037 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.034+0000 7fa5883cb640 1 -- 172.21.15.120:0/2900905115 wait complete. 2024-09-19T05:21:33.038 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.035+0000 7fa5883cb640 1 Processor -- start 2024-09-19T05:21:33.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.035+0000 7fa5883cb640 1 -- start start 2024-09-19T05:21:33.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.035+0000 7fa5883cb640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa580100100 0x7fa5801983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:33.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.035+0000 7fa5883cb640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa580100aa0 0x7fa580198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:33.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.035+0000 7fa5883cb640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa580106b80 0x7fa58019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:33.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.035+0000 7fa5883cb640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa580111f10 con 0x7fa580100100 2024-09-19T05:21:33.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.035+0000 7fa5883cb640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa580111d90 con 0x7fa580100aa0 2024-09-19T05:21:33.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.035+0000 7fa5883cb640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa580112090 con 0x7fa580106b80 2024-09-19T05:21:33.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.036+0000 7fa586167640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa580100100 0x7fa5801983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:33.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.036+0000 7fa586167640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa580100100 0x7fa5801983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50104/0 (socket says 172.21.15.120:50104) 2024-09-19T05:21:33.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.036+0000 7fa586167640 1 -- 172.21.15.120:0/68617131 learned_addr learned my addr 172.21.15.120:0/68617131 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:33.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.036+0000 7fa586968640 1 --2- 172.21.15.120:0/68617131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa580106b80 0x7fa58019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:33.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.036+0000 7fa585966640 1 --2- 172.21.15.120:0/68617131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa580100aa0 0x7fa580198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:33.039 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.036+0000 7fa586167640 1 -- 172.21.15.120:0/68617131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa580106b80 msgr2=0x7fa58019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:33.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.036+0000 7fa586167640 1 --2- 172.21.15.120:0/68617131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa580106b80 0x7fa58019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.036+0000 7fa586167640 1 -- 172.21.15.120:0/68617131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa580100aa0 msgr2=0x7fa580198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:33.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.036+0000 7fa586167640 1 --2- 172.21.15.120:0/68617131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa580100aa0 0x7fa580198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.036+0000 7fa586167640 1 -- 172.21.15.120:0/68617131 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58019d3a0 con 0x7fa580100100 2024-09-19T05:21:33.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.036+0000 7fa586167640 1 --2- 172.21.15.120:0/68617131 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa580100100 0x7fa5801983f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa57c005ab0 tx=0x7fa57c003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:33.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.036+0000 7fa5777fe640 1 -- 172.21.15.120:0/68617131 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57c03f070 con 0x7fa580100100 2024-09-19T05:21:33.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.037+0000 7fa5883cb640 1 -- 172.21.15.120:0/68617131 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa58019d630 con 0x7fa580100100 2024-09-19T05:21:33.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.037+0000 7fa5883cb640 1 -- 172.21.15.120:0/68617131 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5801a4f70 con 0x7fa580100100 2024-09-19T05:21:33.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.037+0000 7fa5777fe640 1 -- 172.21.15.120:0/68617131 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa57c031d60 con 0x7fa580100100 2024-09-19T05:21:33.040 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.037+0000 7fa5777fe640 1 -- 172.21.15.120:0/68617131 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57c035030 con 0x7fa580100100 2024-09-19T05:21:33.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.039+0000 7fa5777fe640 1 -- 172.21.15.120:0/68617131 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fa57c042070 con 0x7fa580100100 2024-09-19T05:21:33.041 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.040+0000 7fa5777fe640 1 --2- 172.21.15.120:0/68617131 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fa56c0a3430 0x7fa56c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:33.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.040+0000 7fa585966640 1 --2- 172.21.15.120:0/68617131 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fa56c0a3430 0x7fa56c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:33.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.040+0000 7fa5777fe640 1 -- 172.21.15.120:0/68617131 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fa57c0f0530 con 0x7fa580100100 2024-09-19T05:21:33.042 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.040+0000 7fa58a7a4740 1 Processor -- start 2024-09-19T05:21:33.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.041+0000 7fa585966640 1 --2- 172.21.15.120:0/68617131 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fa56c0a3430 0x7fa56c0a58f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa570005d00 tx=0x7fa570005c50 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:33.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.041+0000 7fa58a7a4740 1 -- start start 2024-09-19T05:21:33.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.041+0000 7fa58a7a4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560751716840 0x560751716c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:33.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.041+0000 7fa58a7a4740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715120 0x560751715560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:33.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.041+0000 7fa58a7a4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560751715b80 0x56075172af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:33.043 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.041+0000 7fa58a7a4740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56075167b2f0 con 0x560751715120 2024-09-19T05:21:33.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.041+0000 7fa58a7a4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x560751622cf0 con 0x560751715b80 2024-09-19T05:21:33.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.041+0000 7fa58a7a4740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5607516772b0 con 0x560751716840 2024-09-19T05:21:33.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.041+0000 7fa585966640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715120 0x560751715560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:33.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.041+0000 7fa585966640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715120 0x560751715560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50110/0 (socket says 172.21.15.120:50110) 2024-09-19T05:21:33.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.041+0000 7fa585966640 1 -- 172.21.15.120:0/2899475846 learned_addr learned my addr 172.21.15.120:0/2899475846 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:33.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.041+0000 7fa586167640 1 --2- 172.21.15.120:0/2899475846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560751716840 0x560751716c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:33.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.041+0000 7fa586968640 1 --2- 172.21.15.120:0/2899475846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560751715b80 0x56075172af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:33.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.041+0000 7fa585966640 1 -- 172.21.15.120:0/2899475846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560751716840 msgr2=0x560751716c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:33.044 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.041+0000 7fa585966640 1 --2- 172.21.15.120:0/2899475846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560751716840 0x560751716c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.041+0000 7fa585966640 1 -- 172.21.15.120:0/2899475846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560751715b80 msgr2=0x56075172af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:33.045 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.041+0000 7fa585966640 1 --2- 172.21.15.120:0/2899475846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560751715b80 0x56075172af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.041+0000 7fa585966640 1 -- 172.21.15.120:0/2899475846 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607516073a0 con 0x560751715120 2024-09-19T05:21:33.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.041+0000 7fa586167640 1 --2- 172.21.15.120:0/2899475846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560751716840 0x560751716c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:33.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.042+0000 7fa585966640 1 --2- 172.21.15.120:0/2899475846 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715120 0x560751715560 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa57000bf80 tx=0x7fa570012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e001ffd6c6826f6a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:33.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.042+0000 7fa574dea640 1 -- 172.21.15.120:0/2899475846 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa570022070 con 0x560751715120 2024-09-19T05:21:33.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.042+0000 7fa574dea640 1 -- 172.21.15.120:0/2899475846 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa570011e50 con 0x560751715120 2024-09-19T05:21:33.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.042+0000 7fa574dea640 1 -- 172.21.15.120:0/2899475846 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa570010a00 con 0x560751715120 2024-09-19T05:21:33.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.043+0000 7fa58a7a4740 1 -- 172.21.15.120:0/2899475846 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715120 msgr2=0x560751715560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:33.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.043+0000 7fa58a7a4740 1 --2- 172.21.15.120:0/2899475846 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715120 0x560751715560 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa57000bf80 tx=0x7fa570012000 comp rx=0 tx=0).stop 2024-09-19T05:21:33.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.043+0000 7fa58a7a4740 1 -- 172.21.15.120:0/2899475846 shutdown_connections 2024-09-19T05:21:33.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.043+0000 7fa58a7a4740 1 --2- 172.21.15.120:0/2899475846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560751715b80 0x56075172af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.043+0000 7fa58a7a4740 1 --2- 172.21.15.120:0/2899475846 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715120 0x560751715560 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.046 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.043+0000 7fa58a7a4740 1 --2- 172.21.15.120:0/2899475846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560751716840 0x560751716c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.043+0000 7fa58a7a4740 1 -- 172.21.15.120:0/2899475846 >> 172.21.15.120:0/2899475846 conn(0x5607516de310 msgr2=0x560751711c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:33.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.043+0000 7fa58a7a4740 1 -- 172.21.15.120:0/2899475846 shutdown_connections 2024-09-19T05:21:33.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.043+0000 7fa58a7a4740 1 -- 172.21.15.120:0/2899475846 wait complete. 2024-09-19T05:21:33.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.044+0000 7fa58a7a4740 1 -- start start 2024-09-19T05:21:33.047 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.044+0000 7fa58a7a4740 1 Processor -- start 2024-09-19T05:21:33.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.044+0000 7fa58a7a4740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715120 0x56075172ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:33.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.044+0000 7fa58a7a4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560751715b80 0x560751728120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:33.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.045+0000 7fa58a7a4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560751716840 0x560751728710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:33.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.045+0000 7fa586167640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715120 0x56075172ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:33.051 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.045+0000 7fa586167640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715120 0x56075172ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50118/0 (socket says 172.21.15.120:50118) 2024-09-19T05:21:33.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.045+0000 7fa586167640 1 -- 172.21.15.120:0/1174094982 learned_addr learned my addr 172.21.15.120:0/1174094982 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:33.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.045+0000 7fa585966640 1 --2- 172.21.15.120:0/1174094982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560751715b80 0x560751728120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:33.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.045+0000 7fa58a7a4740 1 -- 172.21.15.120:0/1174094982 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56075172b930 con 0x560751715120 2024-09-19T05:21:33.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.045+0000 7fa58a7a4740 1 -- 172.21.15.120:0/1174094982 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x560751636060 con 0x560751715b80 2024-09-19T05:21:33.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.045+0000 7fa58a7a4740 1 -- 172.21.15.120:0/1174094982 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56075172bab0 con 0x560751716840 2024-09-19T05:21:33.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.045+0000 7fa586968640 1 --2- 172.21.15.120:0/1174094982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560751716840 0x560751728710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:33.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.045+0000 7fa58a7a4740 10 client.0 _ll_register_callbacks cb 0x5607513898c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:33.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.045+0000 7fa586167640 1 -- 172.21.15.120:0/1174094982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560751716840 msgr2=0x560751728710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:33.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.045+0000 7fa586167640 1 --2- 172.21.15.120:0/1174094982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560751716840 0x560751728710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.045+0000 7fa586167640 1 -- 172.21.15.120:0/1174094982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560751715b80 msgr2=0x560751728120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:33.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.045+0000 7fa586167640 1 --2- 172.21.15.120:0/1174094982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560751715b80 0x560751728120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.045+0000 7fa586167640 1 -- 172.21.15.120:0/1174094982 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607513ec3c0 con 0x560751715120 2024-09-19T05:21:33.052 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.045+0000 7fa58a7a4740 1 -- 172.21.15.120:0/1174094982 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa570011e50 con 0x560751715120 2024-09-19T05:21:33.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.045+0000 7fa586167640 1 --2- 172.21.15.120:0/1174094982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715120 0x56075172ae70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa57c005ec0 tx=0x7fa57c0bc650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3857894b148fcdc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:33.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.045+0000 7fa569ffb640 10 client.15807 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:21:33.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.045+0000 7fa569ffb640 1 -- 172.21.15.120:0/1174094982 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57c049040 con 0x560751715120 2024-09-19T05:21:33.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.046+0000 7fa569ffb640 1 -- 172.21.15.120:0/1174094982 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fa57c03b560 con 0x560751715120 2024-09-19T05:21:33.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.046+0000 7fa569ffb640 1 -- 172.21.15.120:0/1174094982 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa57c0bc7c0 con 0x560751715120 2024-09-19T05:21:33.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.046+0000 7fa58a7a4740 10 client.15807 fetch_fsmap learned FSMap version 27 2024-09-19T05:21:33.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.046+0000 7fa58a7a4740 1 -- 172.21.15.120:0/1174094982 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({fsmap=27}) -- 0x560751737280 con 0x560751715120 2024-09-19T05:21:33.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.046+0000 7fa569ffb640 1 -- 172.21.15.120:0/1174094982 <== mon.0 v2:172.21.15.120:3300/0 4 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fa57c0d0ce0 con 0x560751715120 2024-09-19T05:21:33.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.046+0000 7fa58a7a4740 10 client.15807 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:21:33.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.046+0000 7fa58a7a4740 10 client.15807 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:21:33.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.046+0000 7fa58a7a4740 20 client.15807 populate_metadata read hostname 'smithi120' 2024-09-19T05:21:33.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.046+0000 7fa58a7a4740 1 --2- 172.21.15.120:0/1174094982 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5607517388c0 0x56075173ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:33.053 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.046+0000 7fa58a7a4740 4 client.15807 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:21:33.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.046+0000 7fa58a7a4740 1 -- 172.21.15.120:0/1174094982 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560751688860 con 0x5607517388c0 2024-09-19T05:21:33.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.047+0000 7fa585966640 1 --2- 172.21.15.120:0/1174094982 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5607517388c0 0x56075173ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:33.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.047+0000 7fa569ffb640 10 client.15807 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:33.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.047+0000 7fa585966640 1 --2- 172.21.15.120:0/1174094982 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5607517388c0 0x56075173ad10 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75a5aace484ccc1d server_cookie=44aa11fae05daef0 in_seq=0 out_seq=0 2024-09-19T05:21:33.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.048+0000 7fa569ffb640 1 -- 172.21.15.120:0/1174094982 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560751688860 con 0x5607517388c0 2024-09-19T05:21:33.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.048+0000 7fa569ffb640 10 client.15807 handle_command_reply: tid=0 2024-09-19T05:21:33.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.048+0000 7fa58a7a4740 1 client.15807 shutdown 2024-09-19T05:21:33.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.048+0000 7fa58a7a4740 1 -- 172.21.15.120:0/1174094982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715120 msgr2=0x56075172ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:33.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.048+0000 7fa58a7a4740 1 --2- 172.21.15.120:0/1174094982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715120 0x56075172ae70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa57c005ec0 tx=0x7fa57c0bc650 comp rx=0 tx=0).stop 2024-09-19T05:21:33.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.048+0000 7fa58a7a4740 1 -- 172.21.15.120:0/1174094982 shutdown_connections 2024-09-19T05:21:33.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.048+0000 7fa58a7a4740 1 --2- 172.21.15.120:0/1174094982 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5607517388c0 0x56075173ad10 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.048+0000 7fa58a7a4740 1 --2- 172.21.15.120:0/1174094982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560751716840 0x560751728710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.054 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.048+0000 7fa58a7a4740 1 --2- 172.21.15.120:0/1174094982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560751715b80 0x560751728120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.048+0000 7fa58a7a4740 1 --2- 172.21.15.120:0/1174094982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715120 0x56075172ae70 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.048+0000 7fa58a7a4740 1 -- 172.21.15.120:0/1174094982 >> 172.21.15.120:0/1174094982 conn(0x5607516de310 msgr2=0x560751710d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.048+0000 7fa569ffb640 0 client.15807 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.048+0000 7fa58a7a4740 1 -- 172.21.15.120:0/1174094982 shutdown_connections 2024-09-19T05:21:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.048+0000 7fa58a7a4740 1 -- 172.21.15.120:0/1174094982 wait complete. 2024-09-19T05:21:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.049+0000 7fa58a7a4740 20 client.15807 trim_cache size 0 max 16384 2024-09-19T05:21:33.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.072+0000 7fa58a7a4740 1 Processor -- start 2024-09-19T05:21:33.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.072+0000 7fa58a7a4740 1 -- start start 2024-09-19T05:21:33.074 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.073+0000 7fa58a7a4740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715120 0x560751734bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.073+0000 7fa58a7a4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560751715b80 0x560751717c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.073+0000 7fa58a7a4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560751716840 0x560751710bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.073+0000 7fa58a7a4740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa5801ae0a0 con 0x560751715120 2024-09-19T05:21:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.073+0000 7fa58a7a4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa5801ab970 con 0x560751716840 2024-09-19T05:21:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.073+0000 7fa58a7a4740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa5801a97c0 con 0x560751715b80 2024-09-19T05:21:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.073+0000 7fa586167640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715120 0x560751734bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.073+0000 7fa586167640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715120 0x560751734bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:50126/0 (socket says 172.21.15.120:50126) 2024-09-19T05:21:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.073+0000 7fa586167640 1 -- 172.21.15.120:0/775743760 learned_addr learned my addr 172.21.15.120:0/775743760 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.073+0000 7fa585966640 1 --2- 172.21.15.120:0/775743760 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560751715b80 0x560751717c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:33.076 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.073+0000 7fa586968640 1 --2- 172.21.15.120:0/775743760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560751716840 0x560751710bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.073+0000 7fa586167640 1 -- 172.21.15.120:0/775743760 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560751715b80 msgr2=0x560751717c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.073+0000 7fa586167640 1 --2- 172.21.15.120:0/775743760 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560751715b80 0x560751717c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.073+0000 7fa586167640 1 -- 172.21.15.120:0/775743760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560751716840 msgr2=0x560751710bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.073+0000 7fa586167640 1 --2- 172.21.15.120:0/775743760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560751716840 0x560751710bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.073+0000 7fa586167640 1 -- 172.21.15.120:0/775743760 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560751726670 con 0x560751715120 2024-09-19T05:21:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.073+0000 7fa586968640 1 --2- 172.21.15.120:0/775743760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560751716840 0x560751710bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:21:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.073+0000 7fa586167640 1 --2- 172.21.15.120:0/775743760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715120 0x560751734bd0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa57c0b8c20 tx=0x7fa57c0bf000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236c25cf149c8278 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.074+0000 7fa56bfff640 1 -- 172.21.15.120:0/775743760 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57c049070 con 0x560751715120 2024-09-19T05:21:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.074+0000 7fa56bfff640 1 -- 172.21.15.120:0/775743760 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa570011e50 con 0x560751715120 2024-09-19T05:21:33.077 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.074+0000 7fa56bfff640 1 -- 172.21.15.120:0/775743760 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57c0a1060 con 0x560751715120 2024-09-19T05:21:33.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.075+0000 7fa58a7a4740 1 -- 172.21.15.120:0/775743760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715120 msgr2=0x560751734bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:33.080 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.075+0000 7fa58a7a4740 1 --2- 172.21.15.120:0/775743760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715120 0x560751734bd0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa57c0b8c20 tx=0x7fa57c0bf000 comp rx=0 tx=0).stop 2024-09-19T05:21:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.075+0000 7fa58a7a4740 1 -- 172.21.15.120:0/775743760 shutdown_connections 2024-09-19T05:21:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.075+0000 7fa58a7a4740 1 --2- 172.21.15.120:0/775743760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560751716840 0x560751710bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.075+0000 7fa58a7a4740 1 --2- 172.21.15.120:0/775743760 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560751715b80 0x560751717c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.075+0000 7fa58a7a4740 1 --2- 172.21.15.120:0/775743760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715120 0x560751734bd0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.075+0000 7fa58a7a4740 1 -- 172.21.15.120:0/775743760 >> 172.21.15.120:0/775743760 conn(0x5607516de310 msgr2=0x5607517104e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.075+0000 7fa58a7a4740 1 -- 172.21.15.120:0/775743760 shutdown_connections 2024-09-19T05:21:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.075+0000 7fa58a7a4740 1 -- 172.21.15.120:0/775743760 wait complete. 2024-09-19T05:21:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.075+0000 7fa58a7a4740 1 -- start start 2024-09-19T05:21:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.076+0000 7fa58a7a4740 1 Processor -- start 2024-09-19T05:21:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.076+0000 7fa58a7a4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560751715120 0x5607517311e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.076+0000 7fa58a7a4740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715b80 0x56075173fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:33.081 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.076+0000 7fa58a7a4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560751716840 0x560751740250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:33.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.076+0000 7fa58a7a4740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa5801a9e30 con 0x560751715b80 2024-09-19T05:21:33.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.076+0000 7fa58a7a4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa5801ab2a0 con 0x560751715120 2024-09-19T05:21:33.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.076+0000 7fa58a7a4740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa5801aa500 con 0x560751716840 2024-09-19T05:21:33.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.076+0000 7fa58a7a4740 10 client.0 _ll_register_callbacks cb 0x7fa57c0b83a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:33.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.076+0000 7fa586167640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560751715120 0x5607517311e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:33.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.076+0000 7fa585966640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715b80 0x56075173fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:33.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.076+0000 7fa586167640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560751715120 0x5607517311e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:59662/0 (socket says 172.21.15.120:59662) 2024-09-19T05:21:33.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.076+0000 7fa586167640 1 -- 172.21.15.120:0/2061543950 learned_addr learned my addr 172.21.15.120:0/2061543950 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:33.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.076+0000 7fa586968640 1 --2- 172.21.15.120:0/2061543950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560751716840 0x560751740250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:33.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.076+0000 7fa586167640 1 -- 172.21.15.120:0/2061543950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560751716840 msgr2=0x560751740250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:33.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.076+0000 7fa586167640 1 --2- 172.21.15.120:0/2061543950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560751716840 0x560751740250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.076+0000 7fa586167640 1 -- 172.21.15.120:0/2061543950 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715b80 msgr2=0x56075173fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:33.082 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.076+0000 7fa586167640 1 --2- 172.21.15.120:0/2061543950 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715b80 0x56075173fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.076+0000 7fa586167640 1 -- 172.21.15.120:0/2061543950 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560751740810 con 0x560751715120 2024-09-19T05:21:33.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.076+0000 7fa586968640 1 --2- 172.21.15.120:0/2061543950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560751716840 0x560751740250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:21:33.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.076+0000 7fa585966640 1 --2- 172.21.15.120:0/2061543950 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715b80 0x56075173fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:33.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.077+0000 7fa586167640 1 --2- 172.21.15.120:0/2061543950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560751715120 0x5607517311e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa57c000c00 tx=0x7fa57c03b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9eeb73016beb717d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:33.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.077+0000 7fa569ffb640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:21:33.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.077+0000 7fa569ffb640 1 -- 172.21.15.120:0/2061543950 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57c0ca060 con 0x560751715120 2024-09-19T05:21:33.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.077+0000 7fa569ffb640 1 -- 172.21.15.120:0/2061543950 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fa57c0c4fa0 con 0x560751715120 2024-09-19T05:21:33.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.077+0000 7fa58a7a4740 1 -- 172.21.15.120:0/2061543950 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa570011e50 con 0x560751715120 2024-09-19T05:21:33.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.077+0000 7fa569ffb640 1 -- 172.21.15.120:0/2061543950 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa57c0a1070 con 0x560751715120 2024-09-19T05:21:33.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.077+0000 7fa58a7a4740 10 client.25268 fetch_fsmap learned FSMap version 27 2024-09-19T05:21:33.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.077+0000 7fa58a7a4740 1 -- 172.21.15.120:0/2061543950 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560751740810 con 0x560751715120 2024-09-19T05:21:33.083 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.078+0000 7fa569ffb640 1 -- 172.21.15.120:0/2061543950 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa570011e50 con 0x560751715120 2024-09-19T05:21:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.078+0000 7fa569ffb640 1 -- 172.21.15.120:0/2061543950 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7fa57c0d0ce0 con 0x560751715120 2024-09-19T05:21:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.078+0000 7fa58a7a4740 10 client.25268 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:21:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.078+0000 7fa58a7a4740 10 client.25268 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:21:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.078+0000 7fa58a7a4740 20 client.25268 populate_metadata read hostname 'smithi120' 2024-09-19T05:21:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.078+0000 7fa58a7a4740 1 --2- 172.21.15.120:0/2061543950 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5607517a36b0 0x5607517a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.078+0000 7fa58a7a4740 4 client.25268 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T05:21:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.078+0000 7fa58a7a4740 1 -- 172.21.15.120:0/2061543950 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560751682d70 con 0x5607517a36b0 2024-09-19T05:21:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.078+0000 7fa585966640 1 --2- 172.21.15.120:0/2061543950 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5607517a36b0 0x5607517a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.079+0000 7fa585966640 1 --2- 172.21.15.120:0/2061543950 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5607517a36b0 0x5607517a5aa0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=364bd92a820e40c7 server_cookie=37a07a633305079f in_seq=0 out_seq=0 2024-09-19T05:21:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.079+0000 7fa569ffb640 10 client.25268 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.079+0000 7fa569ffb640 1 -- 172.21.15.120:0/2061543950 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560751682d70 con 0x5607517a36b0 2024-09-19T05:21:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.079+0000 7fa569ffb640 10 client.25268 handle_command_reply: tid=0 2024-09-19T05:21:33.084 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.079+0000 7fa58a7a4740 1 client.25268 shutdown 2024-09-19T05:21:33.085 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.079+0000 7fa58a7a4740 1 -- 172.21.15.120:0/2061543950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560751715120 msgr2=0x5607517311e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:33.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.079+0000 7fa58a7a4740 1 --2- 172.21.15.120:0/2061543950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560751715120 0x5607517311e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa57c000c00 tx=0x7fa57c03b790 comp rx=0 tx=0).stop 2024-09-19T05:21:33.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.079+0000 7fa58a7a4740 1 -- 172.21.15.120:0/2061543950 shutdown_connections 2024-09-19T05:21:33.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.079+0000 7fa58a7a4740 1 --2- 172.21.15.120:0/2061543950 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5607517a36b0 0x5607517a5aa0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.079+0000 7fa58a7a4740 1 --2- 172.21.15.120:0/2061543950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560751716840 0x560751740250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.079+0000 7fa58a7a4740 1 --2- 172.21.15.120:0/2061543950 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560751715b80 0x56075173fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.079+0000 7fa58a7a4740 1 --2- 172.21.15.120:0/2061543950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560751715120 0x5607517311e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.079+0000 7fa569ffb640 0 client.25268 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:33.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.079+0000 7fa58a7a4740 1 -- 172.21.15.120:0/2061543950 >> 172.21.15.120:0/2061543950 conn(0x5607516de310 msgr2=0x560751710d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:33.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.080+0000 7fa58a7a4740 1 -- 172.21.15.120:0/2061543950 shutdown_connections 2024-09-19T05:21:33.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.080+0000 7fa58a7a4740 1 -- 172.21.15.120:0/2061543950 wait complete. 2024-09-19T05:21:33.086 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.080+0000 7fa58a7a4740 20 client.25268 trim_cache size 0 max 16384 2024-09-19T05:21:33.087 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-09-19T05:21:33.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.080+0000 7fa5883cb640 1 -- 172.21.15.120:0/68617131 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fa56c0a3430 msgr2=0x7fa56c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:33.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.080+0000 7fa5883cb640 1 --2- 172.21.15.120:0/68617131 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fa56c0a3430 0x7fa56c0a58f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa570005d00 tx=0x7fa570005c50 comp rx=0 tx=0).stop 2024-09-19T05:21:33.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.080+0000 7fa5883cb640 1 -- 172.21.15.120:0/68617131 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa580100100 msgr2=0x7fa5801983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:33.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.080+0000 7fa5883cb640 1 --2- 172.21.15.120:0/68617131 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa580100100 0x7fa5801983f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa57c005ab0 tx=0x7fa57c003c80 comp rx=0 tx=0).stop 2024-09-19T05:21:33.087 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.080+0000 7fa5883cb640 1 -- 172.21.15.120:0/68617131 shutdown_connections 2024-09-19T05:21:33.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.080+0000 7fa5883cb640 1 --2- 172.21.15.120:0/68617131 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fa56c0a3430 0x7fa56c0a58f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.080+0000 7fa5883cb640 1 --2- 172.21.15.120:0/68617131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa580106b80 0x7fa58019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.080+0000 7fa5883cb640 1 --2- 172.21.15.120:0/68617131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa580100aa0 0x7fa580198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.081+0000 7fa5883cb640 1 --2- 172.21.15.120:0/68617131 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa580100100 0x7fa5801983f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:33.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.081+0000 7fa5883cb640 1 -- 172.21.15.120:0/68617131 >> 172.21.15.120:0/68617131 conn(0x7fa580077230 msgr2=0x7fa580104c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:33.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.081+0000 7fa5883cb640 1 -- 172.21.15.120:0/68617131 shutdown_connections 2024-09-19T05:21:33.088 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:33.081+0000 7fa5883cb640 1 -- 172.21.15.120:0/68617131 wait complete. 2024-09-19T05:21:34.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:34 smithi120 ceph-mon[30956]: pgmap v73: 97 pgs: 97 active+clean; 174 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 461 op/s 2024-09-19T05:21:34.691 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:34 smithi178 ceph-mon[34347]: pgmap v73: 97 pgs: 97 active+clean; 174 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 461 op/s 2024-09-19T05:21:34.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:34 smithi194 ceph-mon[35228]: pgmap v73: 97 pgs: 97 active+clean; 174 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 461 op/s 2024-09-19T05:21:35.241 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T05:21:35.241 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T05:21:35.595 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:36.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.143+0000 7f19ed74e640 1 -- 172.21.15.120:0/2604277937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19e8102ef0 msgr2=0x7f19e810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:36.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.143+0000 7f19ed74e640 1 --2- 172.21.15.120:0/2604277937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19e8102ef0 0x7f19e810da40 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009ca0 tx=0x7f19e002a950 comp rx=0 tx=0).stop 2024-09-19T05:21:36.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.143+0000 7f19ed74e640 1 -- 172.21.15.120:0/2604277937 shutdown_connections 2024-09-19T05:21:36.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.143+0000 7f19ed74e640 1 --2- 172.21.15.120:0/2604277937 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19e8102ef0 0x7f19e810da40 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.143+0000 7f19ed74e640 1 --2- 172.21.15.120:0/2604277937 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19e8102570 0x7f19e81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.143+0000 7f19ed74e640 1 --2- 172.21.15.120:0/2604277937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19e8100e20 0x7f19e8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.143+0000 7f19ed74e640 1 -- 172.21.15.120:0/2604277937 >> 172.21.15.120:0/2604277937 conn(0x7f19e80fc7d0 msgr2=0x7f19e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:36.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.143+0000 7f19ed74e640 1 -- 172.21.15.120:0/2604277937 shutdown_connections 2024-09-19T05:21:36.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.143+0000 7f19ed74e640 1 -- 172.21.15.120:0/2604277937 wait complete. 2024-09-19T05:21:36.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.144+0000 7f19ed74e640 1 Processor -- start 2024-09-19T05:21:36.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.144+0000 7f19ed74e640 1 -- start start 2024-09-19T05:21:36.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.144+0000 7f19ed74e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19e8100e20 0x7f19e80fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:36.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.144+0000 7f19ed74e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19e8102570 0x7f19e80fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:36.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.145+0000 7f19ed74e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19e8102ef0 0x7f19e80fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:36.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.145+0000 7f19e67fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19e8102570 0x7f19e80fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:36.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.145+0000 7f19e6ffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19e8100e20 0x7f19e80fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:36.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.145+0000 7f19e67fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19e8102570 0x7f19e80fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54752/0 (socket says 172.21.15.120:54752) 2024-09-19T05:21:36.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.145+0000 7f19e67fc640 1 -- 172.21.15.120:0/2445274161 learned_addr learned my addr 172.21.15.120:0/2445274161 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:36.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.145+0000 7f19ed74e640 1 -- 172.21.15.120:0/2445274161 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f19e8110e30 con 0x7f19e8102570 2024-09-19T05:21:36.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.145+0000 7f19ed74e640 1 -- 172.21.15.120:0/2445274161 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f19e8110cb0 con 0x7f19e8100e20 2024-09-19T05:21:36.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.145+0000 7f19ed74e640 1 -- 172.21.15.120:0/2445274161 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f19e8110fb0 con 0x7f19e8102ef0 2024-09-19T05:21:36.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.145+0000 7f19e77fe640 1 --2- 172.21.15.120:0/2445274161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19e8102ef0 0x7f19e80fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:36.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.145+0000 7f19e6ffd640 1 -- 172.21.15.120:0/2445274161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19e8102ef0 msgr2=0x7f19e80fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:36.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.145+0000 7f19e6ffd640 1 --2- 172.21.15.120:0/2445274161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19e8102ef0 0x7f19e80fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.145+0000 7f19e6ffd640 1 -- 172.21.15.120:0/2445274161 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19e8102570 msgr2=0x7f19e80fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:36.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.145+0000 7f19e6ffd640 1 --2- 172.21.15.120:0/2445274161 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19e8102570 0x7f19e80fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.145+0000 7f19e6ffd640 1 -- 172.21.15.120:0/2445274161 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e81a6860 con 0x7f19e8100e20 2024-09-19T05:21:36.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.145+0000 7f19e67fc640 1 --2- 172.21.15.120:0/2445274161 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19e8102570 0x7f19e80fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:36.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.145+0000 7f19e6ffd640 1 --2- 172.21.15.120:0/2445274161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19e8100e20 0x7f19e80fcc80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f19d800d720 tx=0x7f19d800dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:36.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.146+0000 7f19cffff640 1 -- 172.21.15.120:0/2445274161 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d8017070 con 0x7f19e8100e20 2024-09-19T05:21:36.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.146+0000 7f19cffff640 1 -- 172.21.15.120:0/2445274161 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f19d800de30 con 0x7f19e8100e20 2024-09-19T05:21:36.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.146+0000 7f19cffff640 1 -- 172.21.15.120:0/2445274161 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d80047a0 con 0x7f19e8100e20 2024-09-19T05:21:36.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.146+0000 7f19ed74e640 1 -- 172.21.15.120:0/2445274161 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19e81a6b50 con 0x7f19e8100e20 2024-09-19T05:21:36.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.146+0000 7f19ed74e640 1 -- 172.21.15.120:0/2445274161 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19e81a6f80 con 0x7f19e8100e20 2024-09-19T05:21:36.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.148+0000 7f19cffff640 1 -- 172.21.15.120:0/2445274161 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f19d80099d0 con 0x7f19e8100e20 2024-09-19T05:21:36.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.149+0000 7f19efb27740 1 Processor -- start 2024-09-19T05:21:36.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.149+0000 7f19efb27740 1 -- start start 2024-09-19T05:21:36.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.149+0000 7f19cffff640 1 --2- 172.21.15.120:0/2445274161 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f19d00a33b0 0x7f19d00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:36.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.149+0000 7f19efb27740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634cca01370 0x5634cca01750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:36.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.149+0000 7f19efb27740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca01c90 0x5634cca0c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:36.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.149+0000 7f19efb27740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634cca0c550 0x5634cca0e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:36.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.149+0000 7f19efb27740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5634cc95e280 con 0x5634cca01c90 2024-09-19T05:21:36.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.149+0000 7f19efb27740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5634cc905b10 con 0x5634cca0c550 2024-09-19T05:21:36.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.149+0000 7f19efb27740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5634cc95a240 con 0x5634cca01370 2024-09-19T05:21:36.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.149+0000 7f19e67fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca01c90 0x5634cca0c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:36.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.149+0000 7f19e77fe640 1 --2- 172.21.15.120:0/2445274161 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f19d00a33b0 0x7f19d00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:36.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.150+0000 7f19e67fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca01c90 0x5634cca0c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54754/0 (socket says 172.21.15.120:54754) 2024-09-19T05:21:36.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.150+0000 7f19e67fc640 1 -- 172.21.15.120:0/4135607530 learned_addr learned my addr 172.21.15.120:0/4135607530 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:36.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.150+0000 7f19cffff640 1 -- 172.21.15.120:0/2445274161 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f19d80cf9d0 con 0x7f19e8100e20 2024-09-19T05:21:36.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.150+0000 7f19e77fe640 1 --2- 172.21.15.120:0/4135607530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634cca0c550 0x5634cca0e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:36.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.150+0000 7f19e6ffd640 1 --2- 172.21.15.120:0/4135607530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634cca01370 0x5634cca01750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:36.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.150+0000 7f19e67fc640 1 -- 172.21.15.120:0/4135607530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634cca01370 msgr2=0x5634cca01750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:36.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.150+0000 7f19e67fc640 1 --2- 172.21.15.120:0/4135607530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634cca01370 0x5634cca01750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.150+0000 7f19e67fc640 1 -- 172.21.15.120:0/4135607530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634cca0c550 msgr2=0x5634cca0e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:36.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.150+0000 7f19e67fc640 1 --2- 172.21.15.120:0/4135607530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634cca0c550 0x5634cca0e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.150+0000 7f19e67fc640 1 -- 172.21.15.120:0/4135607530 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634cc9121f0 con 0x5634cca01c90 2024-09-19T05:21:36.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.150+0000 7f19e6ffd640 1 --2- 172.21.15.120:0/4135607530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634cca01370 0x5634cca01750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:21:36.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.150+0000 7f19e77fe640 1 --2- 172.21.15.120:0/2445274161 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f19d00a33b0 0x7f19d00a5870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f19e0005e30 tx=0x7f19e00099c0 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:36.154 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.150+0000 7f19e67fc640 1 --2- 172.21.15.120:0/4135607530 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca01c90 0x5634cca0c010 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f19dc011510 tx=0x7f19dc0119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac47ffd8a4f8b23 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:36.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.151+0000 7f19cd7fa640 1 -- 172.21.15.120:0/4135607530 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc01e070 con 0x5634cca01c90 2024-09-19T05:21:36.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.151+0000 7f19cd7fa640 1 -- 172.21.15.120:0/4135607530 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f19dc00fa70 con 0x5634cca01c90 2024-09-19T05:21:36.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.151+0000 7f19cd7fa640 1 -- 172.21.15.120:0/4135607530 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc019a90 con 0x5634cca01c90 2024-09-19T05:21:36.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.152+0000 7f19efb27740 1 -- 172.21.15.120:0/4135607530 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca01c90 msgr2=0x5634cca0c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:36.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.152+0000 7f19efb27740 1 --2- 172.21.15.120:0/4135607530 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca01c90 0x5634cca0c010 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f19dc011510 tx=0x7f19dc0119d0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.156 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.152+0000 7f19efb27740 1 -- 172.21.15.120:0/4135607530 shutdown_connections 2024-09-19T05:21:36.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.152+0000 7f19efb27740 1 --2- 172.21.15.120:0/4135607530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634cca0c550 0x5634cca0e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.152+0000 7f19efb27740 1 --2- 172.21.15.120:0/4135607530 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca01c90 0x5634cca0c010 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.152+0000 7f19efb27740 1 --2- 172.21.15.120:0/4135607530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634cca01370 0x5634cca01750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.152+0000 7f19efb27740 1 -- 172.21.15.120:0/4135607530 >> 172.21.15.120:0/4135607530 conn(0x5634cc9fd900 msgr2=0x5634cc9fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:36.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.152+0000 7f19efb27740 1 -- 172.21.15.120:0/4135607530 shutdown_connections 2024-09-19T05:21:36.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.152+0000 7f19efb27740 1 -- 172.21.15.120:0/4135607530 wait complete. 2024-09-19T05:21:36.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.152+0000 7f19efb27740 1 -- start start 2024-09-19T05:21:36.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.152+0000 7f19efb27740 1 Processor -- start 2024-09-19T05:21:36.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.153+0000 7f19efb27740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca01370 0x5634cca09460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:36.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.153+0000 7f19efb27740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634cca01c90 0x5634cca099a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:36.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.153+0000 7f19e6ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca01370 0x5634cca09460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:36.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.153+0000 7f19e6ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca01370 0x5634cca09460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54760/0 (socket says 172.21.15.120:54760) 2024-09-19T05:21:36.157 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.153+0000 7f19e6ffd640 1 -- 172.21.15.120:0/547155103 learned_addr learned my addr 172.21.15.120:0/547155103 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:36.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.153+0000 7f19e67fc640 1 --2- 172.21.15.120:0/547155103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634cca01c90 0x5634cca099a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:36.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.153+0000 7f19efb27740 1 --2- 172.21.15.120:0/547155103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634cca0c550 0x5634cca09ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:36.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.153+0000 7f19efb27740 1 -- 172.21.15.120:0/547155103 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5634cca0f120 con 0x5634cca01370 2024-09-19T05:21:36.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.153+0000 7f19efb27740 1 -- 172.21.15.120:0/547155103 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5634cc918f10 con 0x5634cca0c550 2024-09-19T05:21:36.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.153+0000 7f19efb27740 1 -- 172.21.15.120:0/547155103 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5634cca0f2a0 con 0x5634cca01c90 2024-09-19T05:21:36.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.153+0000 7f19efb27740 10 client.0 _ll_register_callbacks cb 0x5634cc8e1a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:36.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.154+0000 7f19e77fe640 1 --2- 172.21.15.120:0/547155103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634cca0c550 0x5634cca09ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:36.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.154+0000 7f19e6ffd640 1 -- 172.21.15.120:0/547155103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634cca01c90 msgr2=0x5634cca099a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:36.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.154+0000 7f19e6ffd640 1 --2- 172.21.15.120:0/547155103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634cca01c90 0x5634cca099a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.154+0000 7f19e6ffd640 1 -- 172.21.15.120:0/547155103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634cca0c550 msgr2=0x5634cca09ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:36.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.154+0000 7f19e6ffd640 1 --2- 172.21.15.120:0/547155103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634cca0c550 0x5634cca09ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.154+0000 7f19e6ffd640 1 -- 172.21.15.120:0/547155103 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634cc6cf6a0 con 0x5634cca01370 2024-09-19T05:21:36.158 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.154+0000 7f19e77fe640 1 --2- 172.21.15.120:0/547155103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634cca0c550 0x5634cca09ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:21:36.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.154+0000 7f19e6ffd640 1 --2- 172.21.15.120:0/547155103 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca01370 0x5634cca09460 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f19d809b900 tx=0x7f19d809c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf8e9dca9a33579 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:36.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.154+0000 7f19caff5640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:21:36.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.154+0000 7f19caff5640 1 -- 172.21.15.120:0/547155103 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d806fdf0 con 0x5634cca01370 2024-09-19T05:21:36.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.154+0000 7f19caff5640 1 -- 172.21.15.120:0/547155103 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f19d8098270 con 0x5634cca01370 2024-09-19T05:21:36.159 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.154+0000 7f19efb27740 1 -- 172.21.15.120:0/547155103 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19dc00fa70 con 0x5634cca01370 2024-09-19T05:21:36.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.155+0000 7f19caff5640 1 -- 172.21.15.120:0/547155103 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f19d809bc00 con 0x5634cca01370 2024-09-19T05:21:36.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.155+0000 7f19efb27740 10 client.15825 fetch_fsmap learned FSMap version 27 2024-09-19T05:21:36.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.155+0000 7f19efb27740 1 -- 172.21.15.120:0/547155103 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5634cca1ade0 con 0x5634cca01370 2024-09-19T05:21:36.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.155+0000 7f19caff5640 1 -- 172.21.15.120:0/547155103 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f19dc00fa70 con 0x5634cca01370 2024-09-19T05:21:36.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.155+0000 7f19caff5640 1 -- 172.21.15.120:0/547155103 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f19d807a300 con 0x5634cca01370 2024-09-19T05:21:36.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.155+0000 7f19efb27740 10 client.15825 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:21:36.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.155+0000 7f19efb27740 10 client.15825 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:21:36.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.155+0000 7f19efb27740 20 client.15825 populate_metadata read hostname 'smithi120' 2024-09-19T05:21:36.161 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.155+0000 7f19efb27740 1 --2- 172.21.15.120:0/547155103 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5634cca1c240 0x5634cca1e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:36.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.155+0000 7f19efb27740 4 client.15825 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:21:36.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.155+0000 7f19efb27740 1 -- 172.21.15.120:0/547155103 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634cc96b7f0 con 0x5634cca1c240 2024-09-19T05:21:36.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.155+0000 7f19e67fc640 1 --2- 172.21.15.120:0/547155103 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5634cca1c240 0x5634cca1e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:36.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.156+0000 7f19e67fc640 1 --2- 172.21.15.120:0/547155103 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5634cca1c240 0x5634cca1e690 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8980fa293f4da370 server_cookie=5122f38656b99234 in_seq=0 out_seq=0 2024-09-19T05:21:36.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.156+0000 7f19caff5640 10 client.15825 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:36.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.156+0000 7f19caff5640 1 -- 172.21.15.120:0/547155103 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5634cc96b7f0 con 0x5634cca1c240 2024-09-19T05:21:36.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.156+0000 7f19caff5640 10 client.15825 handle_command_reply: tid=0 2024-09-19T05:21:36.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.156+0000 7f19efb27740 1 client.15825 shutdown 2024-09-19T05:21:36.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.157+0000 7f19efb27740 1 -- 172.21.15.120:0/547155103 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca01370 msgr2=0x5634cca09460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:36.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.157+0000 7f19efb27740 1 --2- 172.21.15.120:0/547155103 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca01370 0x5634cca09460 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f19d809b900 tx=0x7f19d809c300 comp rx=0 tx=0).stop 2024-09-19T05:21:36.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.157+0000 7f19efb27740 1 -- 172.21.15.120:0/547155103 shutdown_connections 2024-09-19T05:21:36.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.157+0000 7f19efb27740 1 --2- 172.21.15.120:0/547155103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634cca0c550 0x5634cca09ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.157+0000 7f19efb27740 1 --2- 172.21.15.120:0/547155103 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5634cca1c240 0x5634cca1e690 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.162 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.157+0000 7f19efb27740 1 --2- 172.21.15.120:0/547155103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634cca01c90 0x5634cca099a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.157+0000 7f19efb27740 1 --2- 172.21.15.120:0/547155103 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca01370 0x5634cca09460 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.157+0000 7f19caff5640 0 client.15825 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:36.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.157+0000 7f19efb27740 1 -- 172.21.15.120:0/547155103 >> 172.21.15.120:0/547155103 conn(0x5634cc9fd900 msgr2=0x5634cc9f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:36.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.157+0000 7f19efb27740 1 -- 172.21.15.120:0/547155103 shutdown_connections 2024-09-19T05:21:36.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.157+0000 7f19efb27740 1 -- 172.21.15.120:0/547155103 wait complete. 2024-09-19T05:21:36.163 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.157+0000 7f19efb27740 20 client.15825 trim_cache size 0 max 16384 2024-09-19T05:21:36.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.180+0000 7f19efb27740 1 Processor -- start 2024-09-19T05:21:36.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.180+0000 7f19efb27740 1 -- start start 2024-09-19T05:21:36.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.180+0000 7f19efb27740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca01370 0x5634cca23f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:36.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.180+0000 7f19efb27740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634cca01c90 0x5634cca244a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:36.183 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.180+0000 7f19efb27740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634cca0c550 0x5634cca066c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:36.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.180+0000 7f19efb27740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f19e81adf90 con 0x5634cca01370 2024-09-19T05:21:36.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.180+0000 7f19efb27740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f19e81ab860 con 0x5634cca0c550 2024-09-19T05:21:36.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.180+0000 7f19efb27740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f19e81a96d0 con 0x5634cca01c90 2024-09-19T05:21:36.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.180+0000 7f19e6ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca01370 0x5634cca23f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:36.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.180+0000 7f19e77fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634cca0c550 0x5634cca066c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:36.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.180+0000 7f19e67fc640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634cca01c90 0x5634cca244a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:36.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.180+0000 7f19e77fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634cca0c550 0x5634cca066c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:43280/0 (socket says 172.21.15.120:43280) 2024-09-19T05:21:36.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.180+0000 7f19e6ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca01370 0x5634cca23f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54768/0 (socket says 172.21.15.120:54768) 2024-09-19T05:21:36.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.180+0000 7f19e77fe640 1 -- 172.21.15.120:0/2298027426 learned_addr learned my addr 172.21.15.120:0/2298027426 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:36.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.181+0000 7f19e77fe640 1 -- 172.21.15.120:0/2298027426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634cca01c90 msgr2=0x5634cca244a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:36.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.181+0000 7f19e77fe640 1 --2- 172.21.15.120:0/2298027426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634cca01c90 0x5634cca244a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.181+0000 7f19e77fe640 1 -- 172.21.15.120:0/2298027426 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca01370 msgr2=0x5634cca23f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:36.184 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.181+0000 7f19e77fe640 1 --2- 172.21.15.120:0/2298027426 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca01370 0x5634cca23f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.181+0000 7f19e77fe640 1 -- 172.21.15.120:0/2298027426 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634cc9f0830 con 0x5634cca0c550 2024-09-19T05:21:36.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.181+0000 7f19e6ffd640 1 --2- 172.21.15.120:0/2298027426 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca01370 0x5634cca23f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:36.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.181+0000 7f19e77fe640 1 --2- 172.21.15.120:0/2298027426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634cca0c550 0x5634cca066c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009ca0 tx=0x7f19e0031000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7f3cf99cfb84856 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:36.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.181+0000 7f19ccff9640 1 -- 172.21.15.120:0/2298027426 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e0034040 con 0x5634cca0c550 2024-09-19T05:21:36.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.181+0000 7f19ccff9640 1 -- 172.21.15.120:0/2298027426 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f19e0003e20 con 0x5634cca0c550 2024-09-19T05:21:36.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.181+0000 7f19ccff9640 1 -- 172.21.15.120:0/2298027426 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e00046e0 con 0x5634cca0c550 2024-09-19T05:21:36.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.182+0000 7f19efb27740 1 -- 172.21.15.120:0/2298027426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634cca0c550 msgr2=0x5634cca066c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:36.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.182+0000 7f19efb27740 1 --2- 172.21.15.120:0/2298027426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634cca0c550 0x5634cca066c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009ca0 tx=0x7f19e0031000 comp rx=0 tx=0).stop 2024-09-19T05:21:36.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.182+0000 7f19efb27740 1 -- 172.21.15.120:0/2298027426 shutdown_connections 2024-09-19T05:21:36.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.182+0000 7f19efb27740 1 --2- 172.21.15.120:0/2298027426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634cca0c550 0x5634cca066c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.182+0000 7f19efb27740 1 --2- 172.21.15.120:0/2298027426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634cca01c90 0x5634cca244a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.182+0000 7f19efb27740 1 --2- 172.21.15.120:0/2298027426 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca01370 0x5634cca23f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.182+0000 7f19efb27740 1 -- 172.21.15.120:0/2298027426 >> 172.21.15.120:0/2298027426 conn(0x5634cc9fd900 msgr2=0x5634cc9f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:36.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.183+0000 7f19efb27740 1 -- 172.21.15.120:0/2298027426 shutdown_connections 2024-09-19T05:21:36.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.183+0000 7f19efb27740 1 -- 172.21.15.120:0/2298027426 wait complete. 2024-09-19T05:21:36.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.183+0000 7f19efb27740 1 -- start start 2024-09-19T05:21:36.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.183+0000 7f19efb27740 1 Processor -- start 2024-09-19T05:21:36.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.183+0000 7f19efb27740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634cca01370 0x5634cca10a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:36.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.184+0000 7f19efb27740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634cca01c90 0x5634cca10f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:36.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.184+0000 7f19efb27740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca0c550 0x5634cca85f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:36.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.184+0000 7f19efb27740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f19e81a9d20 con 0x5634cca0c550 2024-09-19T05:21:36.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.184+0000 7f19e6ffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634cca01370 0x5634cca10a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:36.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.184+0000 7f19e67fc640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634cca01c90 0x5634cca10f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:36.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.184+0000 7f19e67fc640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634cca01c90 0x5634cca10f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:33118/0 (socket says 172.21.15.120:33118) 2024-09-19T05:21:36.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.184+0000 7f19e6ffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634cca01370 0x5634cca10a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:43286/0 (socket says 172.21.15.120:43286) 2024-09-19T05:21:36.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.184+0000 7f19e67fc640 1 -- 172.21.15.120:0/647837942 learned_addr learned my addr 172.21.15.120:0/647837942 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:36.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.184+0000 7f19e77fe640 1 --2- 172.21.15.120:0/647837942 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca0c550 0x5634cca85f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:36.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.184+0000 7f19efb27740 1 -- 172.21.15.120:0/647837942 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f19e81ab190 con 0x5634cca01370 2024-09-19T05:21:36.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.184+0000 7f19efb27740 1 -- 172.21.15.120:0/647837942 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f19e81aa3f0 con 0x5634cca01c90 2024-09-19T05:21:36.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.184+0000 7f19efb27740 10 client.0 _ll_register_callbacks cb 0x7f19d8005170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:36.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.184+0000 7f19e67fc640 1 -- 172.21.15.120:0/647837942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634cca01370 msgr2=0x5634cca10a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:36.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.184+0000 7f19e67fc640 1 --2- 172.21.15.120:0/647837942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634cca01370 0x5634cca10a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.184+0000 7f19e67fc640 1 -- 172.21.15.120:0/647837942 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca0c550 msgr2=0x5634cca85f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:36.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.184+0000 7f19e67fc640 1 --2- 172.21.15.120:0/647837942 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca0c550 0x5634cca85f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.184+0000 7f19e67fc640 1 -- 172.21.15.120:0/647837942 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634cca86520 con 0x5634cca01c90 2024-09-19T05:21:36.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.185+0000 7f19efb27740 1 -- 172.21.15.120:0/647837942 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19e0003e20 con 0x5634cca01c90 2024-09-19T05:21:36.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.185+0000 7f19e67fc640 1 --2- 172.21.15.120:0/647837942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634cca01c90 0x5634cca10f70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f19dc011ed0 tx=0x7f19dc005fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73550ad8db23ec46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:36.190 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.185+0000 7f19caff5640 10 client.25354 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:21:36.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.186+0000 7f19caff5640 1 -- 172.21.15.120:0/647837942 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc028070 con 0x5634cca01c90 2024-09-19T05:21:36.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.186+0000 7f19caff5640 1 -- 172.21.15.120:0/647837942 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f19dc00f5c0 con 0x5634cca01c90 2024-09-19T05:21:36.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.186+0000 7f19caff5640 1 -- 172.21.15.120:0/647837942 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f19dc01e040 con 0x5634cca01c90 2024-09-19T05:21:36.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.186+0000 7f19efb27740 10 client.25354 fetch_fsmap learned FSMap version 27 2024-09-19T05:21:36.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.186+0000 7f19efb27740 1 -- 172.21.15.120:0/647837942 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({fsmap=27}) -- 0x5634cca87730 con 0x5634cca01c90 2024-09-19T05:21:36.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.187+0000 7f19caff5640 1 -- 172.21.15.120:0/647837942 <== mon.1 v2:172.21.15.194:3300/0 4 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f19dc00f840 con 0x5634cca01c90 2024-09-19T05:21:36.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.187+0000 7f19efb27740 10 client.25354 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:21:36.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.187+0000 7f19efb27740 10 client.25354 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:21:36.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.187+0000 7f19efb27740 20 client.25354 populate_metadata read hostname 'smithi120' 2024-09-19T05:21:36.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.187+0000 7f19efb27740 1 --2- 172.21.15.120:0/647837942 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5634cca87c10 0x5634cca8a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:36.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.187+0000 7f19efb27740 4 client.25354 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T05:21:36.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.187+0000 7f19efb27740 1 -- 172.21.15.120:0/647837942 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5634cc965d00 con 0x5634cca87c10 2024-09-19T05:21:36.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.187+0000 7f19e6ffd640 1 --2- 172.21.15.120:0/647837942 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5634cca87c10 0x5634cca8a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:36.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.188+0000 7f19e6ffd640 1 --2- 172.21.15.120:0/647837942 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5634cca87c10 0x5634cca8a030 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a430fb0c86c33e2 server_cookie=910edb7b089dc2e4 in_seq=0 out_seq=0 2024-09-19T05:21:36.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.188+0000 7f19caff5640 10 client.25354 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:36.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.189+0000 7f19caff5640 1 -- 172.21.15.120:0/647837942 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5634cc965d00 con 0x5634cca87c10 2024-09-19T05:21:36.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.189+0000 7f19caff5640 10 client.25354 handle_command_reply: tid=0 2024-09-19T05:21:36.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.189+0000 7f19efb27740 1 client.25354 shutdown 2024-09-19T05:21:36.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.189+0000 7f19efb27740 1 -- 172.21.15.120:0/647837942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634cca01c90 msgr2=0x5634cca10f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:36.193 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.189+0000 7f19efb27740 1 --2- 172.21.15.120:0/647837942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634cca01c90 0x5634cca10f70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f19dc011ed0 tx=0x7f19dc005fa0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.189+0000 7f19efb27740 1 -- 172.21.15.120:0/647837942 shutdown_connections 2024-09-19T05:21:36.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.189+0000 7f19efb27740 1 --2- 172.21.15.120:0/647837942 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634cca0c550 0x5634cca85f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.189+0000 7f19efb27740 1 --2- 172.21.15.120:0/647837942 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5634cca87c10 0x5634cca8a030 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.189+0000 7f19efb27740 1 --2- 172.21.15.120:0/647837942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634cca01c90 0x5634cca10f70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.189+0000 7f19efb27740 1 --2- 172.21.15.120:0/647837942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634cca01370 0x5634cca10a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.189+0000 7f19efb27740 1 -- 172.21.15.120:0/647837942 >> 172.21.15.120:0/647837942 conn(0x5634cc9fd900 msgr2=0x5634cca02dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:36.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.189+0000 7f19caff5640 0 client.25354 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:36.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.189+0000 7f19efb27740 1 -- 172.21.15.120:0/647837942 shutdown_connections 2024-09-19T05:21:36.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.189+0000 7f19efb27740 1 -- 172.21.15.120:0/647837942 wait complete. 2024-09-19T05:21:36.194 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.189+0000 7f19efb27740 20 client.25354 trim_cache size 0 max 16384 2024-09-19T05:21:36.194 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T05:21:36.195 INFO:teuthology.orchestra.run.smithi120.stdout: "return_code": 0, 2024-09-19T05:21:36.195 INFO:teuthology.orchestra.run.smithi120.stdout: "scrub_tag": "99695ca2-1ecb-4f92-a55b-f4c722f61271", 2024-09-19T05:21:36.195 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": "asynchronous" 2024-09-19T05:21:36.195 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T05:21:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.190+0000 7f19ed74e640 1 -- 172.21.15.120:0/2445274161 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f19d00a33b0 msgr2=0x7f19d00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.190+0000 7f19ed74e640 1 --2- 172.21.15.120:0/2445274161 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f19d00a33b0 0x7f19d00a5870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f19e0005e30 tx=0x7f19e00099c0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.190+0000 7f19ed74e640 1 -- 172.21.15.120:0/2445274161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19e8100e20 msgr2=0x7f19e80fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.190+0000 7f19ed74e640 1 --2- 172.21.15.120:0/2445274161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19e8100e20 0x7f19e80fcc80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f19d800d720 tx=0x7f19d800dbe0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.190+0000 7f19ed74e640 1 -- 172.21.15.120:0/2445274161 shutdown_connections 2024-09-19T05:21:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.190+0000 7f19ed74e640 1 --2- 172.21.15.120:0/2445274161 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f19d00a33b0 0x7f19d00a5870 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.190+0000 7f19ed74e640 1 --2- 172.21.15.120:0/2445274161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19e8102ef0 0x7f19e80fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.190+0000 7f19ed74e640 1 --2- 172.21.15.120:0/2445274161 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f19e8102570 0x7f19e80fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.190+0000 7f19ed74e640 1 --2- 172.21.15.120:0/2445274161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19e8100e20 0x7f19e80fcc80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.190+0000 7f19ed74e640 1 -- 172.21.15.120:0/2445274161 >> 172.21.15.120:0/2445274161 conn(0x7f19e80fc7d0 msgr2=0x7f19e8069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.190+0000 7f19ed74e640 1 -- 172.21.15.120:0/2445274161 shutdown_connections 2024-09-19T05:21:36.196 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:36.190+0000 7f19ed74e640 1 -- 172.21.15.120:0/2445274161 wait complete. 2024-09-19T05:21:36.588 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-i[65624]: 2024-09-19T05:21:36.259+0000 7f1b91dc9640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000798 [...4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7/ auth{2=1} v68138 ap=2 f(v10 m2024-09-19T05:21:10.353123+0000 59=59+0) n(v2 rc2024-09-19T05:21:10.353123+0000 b1334092 60=59+1) old_inodes=1 (inest sync->mix g=2) caps={15168=pAsLsXsFs/-@142} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55fcbd5d2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000798:[<0x10000000399/blog-7 v9304>,<0x10000000208/blogtest_in v333>,<0x10000000201/src v2926>,<0x10000000006/blogbench-1.0 v2648>,<0x10000000005/tmp v52>,<0x10000000003/client.0 v39>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v54>,<0x10000000001/sv_0 v71>,<0x10000000000/qa v59>,<0x1/volumes v56>]//[]","memoryvalue":"(2)0x10000000798:[<0x10000000399/blog-7 v68138>,<0x10000000208/blogtest_in v3543>,<0x10000000201/src v3048>,<0x10000000006/blogbench-1.0 v2767>,<0x10000000005/tmp v168>,<0x10000000003/client.0 v151>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v163>,<0x10000000001/sv_0 v172>,<0x10000000000/qa v160>,<0x1/volumes v154>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T05:21:10.306108+0000 60=60+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T05:21:10.353123+0000 b1334092 60=59+1)","memory_value.dirstat":"f(v10 m2024-09-19T05:21:10.353123+0000 59=59+0)","memory_value.rstat":"n(v2 rc2024-09-19T05:21:10.353123+0000 b1334092 60=59+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-09-19T05:21:36.589 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-i[65624]: 2024-09-19T05:21:36.465+0000 7f1b91dc9640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c5b [...4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/ auth{2=1} v56979 ap=2 f(v8 m2024-09-19T05:21:15.066841+0000 90=90+0) n(v1 rc2024-09-19T05:21:15.066841+0000 b2134315 91=90+1) old_inodes=1 (inest sync->mix g=2) caps={15168=pAsLsXsFs/-@200} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55fcbe6cc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000c5b:[<0x10000000399/blog-14 v23358>,<0x10000000208/blogtest_in v411>,<0x10000000201/src v2966>,<0x10000000006/blogbench-1.0 v2688>,<0x10000000005/tmp v92>,<0x10000000003/client.0 v73>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v88>,<0x10000000001/sv_0 v99>,<0x10000000000/qa v89>,<0x1/volumes v84>]//[]","memoryvalue":"(2)0x10000000c5b:[<0x10000000399/blog-14 v56979>,<0x10000000208/blogtest_in v3597>,<0x10000000201/src v3048>,<0x10000000006/blogbench-1.0 v2767>,<0x10000000005/tmp v168>,<0x10000000003/client.0 v151>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v163>,<0x10000000001/sv_0 v172>,<0x10000000000/qa v160>,<0x1/volumes v154>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-19T05:21:15.023772+0000 91=91+0)","ondisk_value.rstat":"n(v0 rc2024-09-19T05:21:15.066841+0000 b2134315 91=90+1)","memory_value.dirstat":"f(v8 m2024-09-19T05:21:15.066841+0000 90=90+0)","memory_value.rstat":"n(v1 rc2024-09-19T05:21:15.066841+0000 b2134315 91=90+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-09-19T05:21:36.589 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-mon[35228]: pgmap v74: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 550 op/s 2024-09-19T05:21:36.590 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.221+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e22 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-10.jpg auth v930 ap=1 s=12221 n(v0 rc2024-09-19T05:21:20.344153+0000 b12221 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d7c4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e22:[<0x10000001d51/picture-10.jpg v794>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e22:[<0x10000001d51/picture-10.jpg v930>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.590 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.221+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e34 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-1.jpg auth v922 ap=1 s=57195 n(v0 rc2024-09-19T05:21:20.466682+0000 b57195 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d7c4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e34:[<0x10000001d51/picture-1.jpg v868>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e34:[<0x10000001d51/picture-1.jpg v922>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.590 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.221+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001dc1 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-9.xml auth v928 ap=1 s=5601 n(v0 rc2024-09-19T05:21:19.704925+0000 b5601 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d7c4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001dc1:[<0x10000001d51/article-9.xml v450>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001dc1:[<0x10000001d51/article-9.xml v928>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.590 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.221+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e2a [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-6.jpg auth v872 ap=1 s=43937 n(v0 rc2024-09-19T05:21:20.394318+0000 b43937 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7c5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e2a:[<0x10000001d51/picture-6.jpg v872>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e2a:[<0x10000001d51/picture-6.jpg v872>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.591 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.221+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d76 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-44.xml auth v948 ap=1 s=12418 n(v0 rc2024-09-19T05:21:19.154461+0000 b12418 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d7c5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d76:[<0x10000001d51/article-44.xml v158>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d76:[<0x10000001d51/article-44.xml v948>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.591 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.221+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d9e [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-24.xml auth v936 ap=1 s=14218 n(v0 rc2024-09-19T05:21:19.441626+0000 b14218 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d7c6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d9e:[<0x10000001d51/article-24.xml v324>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d9e:[<0x10000001d51/article-24.xml v936>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.591 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.221+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d52 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-62.xml auth v950 ap=1 s=11022 n(v0 rc2024-09-19T05:21:18.910660+0000 b11022 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d7c5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d52:[<0x10000001d51/article-62.xml v8>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d52:[<0x10000001d51/article-62.xml v950>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.591 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.221+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001dfa [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-28.jpg auth v938 ap=1 s=22932 n(v0 rc2024-09-19T05:21:20.093836+0000 b22932 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d7c6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001dfa:[<0x10000001d51/picture-28.jpg v646>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001dfa:[<0x10000001d51/picture-28.jpg v938>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.591 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.222+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001de7 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-37.jpg auth v942 ap=1 s=16020 n(v0 rc2024-09-19T05:21:19.951605+0000 b16020 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d7c6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001de7:[<0x10000001d51/picture-37.jpg v572>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001de7:[<0x10000001d51/picture-37.jpg v942>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.591 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.222+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e11 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-17.jpg auth v932 ap=1 s=34593 n(v0 rc2024-09-19T05:21:20.247822+0000 b34593 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d7c7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e11:[<0x10000001d51/picture-17.jpg v738>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e11:[<0x10000001d51/picture-17.jpg v932>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.591 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.222+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001dce [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-3.xml auth v924 ap=1 s=21241 n(v0 rc2024-09-19T05:21:19.804421+0000 b21241 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d7c7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001dce:[<0x10000001d51/article-3.xml v500>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001dce:[<0x10000001d51/article-3.xml v924>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.591 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.222+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e02 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-24.jpg auth v934 ap=1 s=9025 n(v0 rc2024-09-19T05:21:20.142674+0000 b9025 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d7d2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e02:[<0x10000001d51/picture-24.jpg v678>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e02:[<0x10000001d51/picture-24.jpg v934>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.591 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.222+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001df0 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-33.jpg auth v940 ap=1 s=60063 n(v0 rc2024-09-19T05:21:20.028429+0000 b60063 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d7d2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001df0:[<0x10000001d51/picture-33.jpg v606>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001df0:[<0x10000001d51/picture-33.jpg v940>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.591 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.222+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001dc4 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-7.xml auth v926 ap=1 s=26853 n(v0 rc2024-09-19T05:21:19.741097+0000 b26853 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d7d2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001dc4:[<0x10000001d51/article-7.xml v466>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001dc4:[<0x10000001d51/article-7.xml v926>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.591 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.222+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001dd8 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-42.jpg auth v946 ap=1 s=38278 n(v0 rc2024-09-19T05:21:19.864430+0000 b38278 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d7d3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001dd8:[<0x10000001d51/picture-42.jpg v532>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001dd8:[<0x10000001d51/picture-42.jpg v946>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.591 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.223+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001de1 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-39.jpg auth v944 ap=1 s=36614 n(v0 rc2024-09-19T05:21:19.914514+0000 b36614 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d7d3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001de1:[<0x10000001d51/picture-39.jpg v556>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001de1:[<0x10000001d51/picture-39.jpg v944>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.592 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.223+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d59 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-59.xml auth v956 ap=1 s=2545 n(v0 rc2024-09-19T05:21:18.963625+0000 b2545 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d878c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d59:[<0x10000001d51/article-59.xml v34>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d59:[<0x10000001d51/article-59.xml v956>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.592 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.223+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e1c [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-13.jpg auth v930 ap=1 s=16552 n(v0 rc2024-09-19T05:21:20.308503+0000 b16552 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d879180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e1c:[<0x10000001d51/picture-13.jpg v770>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e1c:[<0x10000001d51/picture-13.jpg v930>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.592 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.224+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001dae [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-18.xml auth v940 ap=1 s=18761 n(v0 rc2024-09-19T05:21:19.536576+0000 b18761 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d894000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001dae:[<0x10000001d51/article-18.xml v372>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001dae:[<0x10000001d51/article-18.xml v940>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.592 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.224+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e0f [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-18.jpg auth v938 ap=1 s=49558 n(v0 rc2024-09-19T05:21:20.235935+0000 b49558 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d879700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e0f:[<0x10000001d51/picture-18.jpg v730>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e0f:[<0x10000001d51/picture-18.jpg v938>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.592 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.224+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e0e [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-19.jpg auth v942 ap=1 s=30298 n(v0 rc2024-09-19T05:21:20.222077+0000 b30298 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d894580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e0e:[<0x10000001d51/picture-19.jpg v722>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e0e:[<0x10000001d51/picture-19.jpg v942>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.593 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.225+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d69 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-51.xml auth v954 ap=1 s=11776 n(v0 rc2024-09-19T05:21:19.070179+0000 b11776 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d894b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d69:[<0x10000001d51/article-51.xml v100>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d69:[<0x10000001d51/article-51.xml v954>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.594 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.225+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d98 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-27.xml auth v946 ap=1 s=3186 n(v0 rc2024-09-19T05:21:19.395925+0000 b3186 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d895080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d98:[<0x10000001d51/article-27.xml v300>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d98:[<0x10000001d51/article-27.xml v946>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.594 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.225+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e2e [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-4.jpg auth v924 ap=1 s=29670 n(v0 rc2024-09-19T05:21:20.427559+0000 b29670 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d895600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e2e:[<0x10000001d51/picture-4.jpg v844>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e2e:[<0x10000001d51/picture-4.jpg v924>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.594 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.225+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001dec [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-35.jpg auth v950 ap=1 s=47241 n(v0 rc2024-09-19T05:21:19.985645+0000 b47241 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d895b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001dec:[<0x10000001d51/picture-35.jpg v588>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001dec:[<0x10000001d51/picture-35.jpg v950>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.594 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.225+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e32 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-2.jpg auth v922 ap=1 s=29905 n(v0 rc2024-09-19T05:21:20.456503+0000 b29905 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d896100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e32:[<0x10000001d51/picture-2.jpg v860>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e32:[<0x10000001d51/picture-2.jpg v922>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.594 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.226+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001da8 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-20.xml auth v944 ap=1 s=12219 n(v0 rc2024-09-19T05:21:19.502401+0000 b12219 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d896680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001da8:[<0x10000001d51/article-20.xml v356>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001da8:[<0x10000001d51/article-20.xml v944>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.594 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.226+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e19 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-14.jpg auth v932 ap=1 s=63695 n(v0 rc2024-09-19T05:21:20.294344+0000 b63695 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d896c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e19:[<0x10000001d51/picture-14.jpg v762>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e19:[<0x10000001d51/picture-14.jpg v932>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.594 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.226+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d54 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-61.xml auth v958 ap=1 s=7403 n(v0 rc2024-09-19T05:21:18.922311+0000 b7403 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d897180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d54:[<0x10000001d51/article-61.xml v920>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d54:[<0x10000001d51/article-61.xml v958>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.594 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.226+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d7b [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-41.xml auth v912 ap=1 s=3397 n(v0 rc2024-09-19T05:21:19.192021+0000 b3397 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d897700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d7b:[<0x10000001d51/article-41.xml v912>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d7b:[<0x10000001d51/article-41.xml v912>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.594 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.227+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d75 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-45.xml auth v952 ap=1 s=21375 n(v0 rc2024-09-19T05:21:19.145161+0000 b21375 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d89c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d75:[<0x10000001d51/article-45.xml v150>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d75:[<0x10000001d51/article-45.xml v952>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.594 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.227+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e28 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-7.jpg auth v926 ap=1 s=20805 n(v0 rc2024-09-19T05:21:20.380155+0000 b20805 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d89c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e28:[<0x10000001d51/picture-7.jpg v818>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e28:[<0x10000001d51/picture-7.jpg v926>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.594 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.227+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d90 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-31.xml auth v948 ap=1 s=29241 n(v0 rc2024-09-19T05:21:19.330283+0000 b29241 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d89cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d90:[<0x10000001d51/article-31.xml v268>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d90:[<0x10000001d51/article-31.xml v948>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.595 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.227+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e24 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-9.jpg auth v928 ap=1 s=11183 n(v0 rc2024-09-19T05:21:20.355379+0000 b11183 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d89d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e24:[<0x10000001d51/picture-9.jpg v802>,<0x10000000399/blog-59 v66982>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e24:[<0x10000001d51/picture-9.jpg v928>,<0x10000000399/blog-59 v71280>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.595 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.234+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f5f [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-23.jpg auth v1216 ap=1 s=48540 n(v0 rc2024-09-19T05:21:23.144473+0000 b48540 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7d3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f5f:[<0x10000001e36/picture-23.jpg v1216>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f5f:[<0x10000001e36/picture-23.jpg v1216>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.595 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.234+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ed4 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-79.jpg auth v632 ap=1 s=55427 n(v0 rc2024-09-19T05:21:21.478272+0000 b55427 1=1+0)/n(v0 rc2024-09-19T05:21:21.474395+0000 b55427 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7d4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ed4:[<0x10000001e36/picture-79.jpg v632>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ed4:[<0x10000001e36/picture-79.jpg v632>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.595 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.235+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eb1 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-14.xml auth v484 ap=1 s=2532 n(v0 rc2024-09-19T05:21:21.198644+0000 b2532 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@2},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7d4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eb1:[<0x10000001e36/article-14.xml v484>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001eb1:[<0x10000001e36/article-14.xml v484>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.595 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.235+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f27 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-45.jpg auth v1000 ap=1 s=27505 n(v0 rc2024-09-19T05:21:22.345502+0000 b27505 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@2},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7d4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f27:[<0x10000001e36/picture-45.jpg v1000>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f27:[<0x10000001e36/picture-45.jpg v1000>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.595 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.235+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f30 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-41.jpg auth v1046 ap=1 s=65248 n(v0 rc2024-09-19T05:21:22.478511+0000 b65248 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7d5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f30:[<0x10000001e36/picture-41.jpg v1046>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f30:[<0x10000001e36/picture-41.jpg v1046>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.595 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.236+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f03 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-60.jpg auth v918 ap=1 s=12655 n(v0 rc2024-09-19T05:21:21.923283+0000 b12655 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7d5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f03:[<0x10000001e36/picture-60.jpg v918>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f03:[<0x10000001e36/picture-60.jpg v918>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.595 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.236+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e6e [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-46.xml auth v226 ap=1 s=11621 n(v0 rc2024-09-19T05:21:20.765210+0000 b11621 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@2},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d87c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e6e:[<0x10000001e36/article-46.xml v226>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e6e:[<0x10000001e36/article-46.xml v226>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.595 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.236+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ef7 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-66.jpg auth v942 ap=1 s=24025 n(v0 rc2024-09-19T05:21:21.789295+0000 b24025 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d87c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ef7:[<0x10000001e36/picture-66.jpg v942>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ef7:[<0x10000001e36/picture-66.jpg v942>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.595 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.237+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ed2 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-80.jpg auth v624 ap=1 s=19055 n(v0 rc2024-09-19T05:21:21.459019+0000 b19055 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d87cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ed2:[<0x10000001e36/picture-80.jpg v624>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ed2:[<0x10000001e36/picture-80.jpg v624>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.595 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.237+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e6c [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-47.xml auth v864 ap=1 s=31360 n(v0 rc2024-09-19T05:21:20.753295+0000 b31360 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d87d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e6c:[<0x10000001e36/article-47.xml v864>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e6c:[<0x10000001e36/article-47.xml v864>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.595 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.238+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e3b [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-71.xml auth v24 ap=1 s=15386 n(v0 rc2024-09-19T05:21:20.505293+0000 b15386 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@2},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d87d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e3b:[<0x10000001e36/article-71.xml v24>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e3b:[<0x10000001e36/article-71.xml v24>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.596 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.238+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f62 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-22.jpg auth v1422 ap=1 s=10315 n(v0 rc2024-09-19T05:21:23.175466+0000 b10315 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d87db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f62:[<0x10000001e36/picture-22.jpg v1422>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f62:[<0x10000001e36/picture-22.jpg v1422>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.596 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.240+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eb7 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-11.xml auth v508 ap=1 s=5412 n(v0 rc2024-09-19T05:21:21.229616+0000 b5412 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d87e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eb7:[<0x10000001e36/article-11.xml v508>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001eb7:[<0x10000001e36/article-11.xml v508>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.596 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.241+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ead [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-16.xml auth v468 ap=1 s=11773 n(v0 rc2024-09-19T05:21:21.167187+0000 b11773 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@2},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d87e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ead:[<0x10000001e36/article-16.xml v468>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ead:[<0x10000001e36/article-16.xml v468>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.596 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.241+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e5f [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-54.xml auth v160 ap=1 s=2290 n(v0 rc2024-09-19T05:21:20.678034+0000 b2290 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@2},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d87ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e5f:[<0x10000001e36/article-54.xml v160>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e5f:[<0x10000001e36/article-54.xml v160>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.596 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.241+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e99 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-26.xml auth v388 ap=1 s=19201 n(v0 rc2024-09-19T05:21:20.988694+0000 b19201 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d87f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e99:[<0x10000001e36/article-26.xml v388>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e99:[<0x10000001e36/article-26.xml v388>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.596 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.241+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f6f [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-15.jpg auth v1420 ap=1 s=47602 n(v0 rc2024-09-19T05:21:23.428418+0000 b47602 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d87f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f6f:[<0x10000001e36/picture-15.jpg v1420>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f6f:[<0x10000001e36/picture-15.jpg v1420>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.596 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.242+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f0c [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-56.jpg auth v902 ap=1 s=27940 n(v0 rc2024-09-19T05:21:22.041001+0000 b27940 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7de000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f0c:[<0x10000001e36/picture-56.jpg v902>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f0c:[<0x10000001e36/picture-56.jpg v902>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.596 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.242+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f23 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-47.jpg auth v1040 ap=1 s=9708 n(v0 rc2024-09-19T05:21:22.277929+0000 b9708 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7de580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f23:[<0x10000001e36/picture-47.jpg v1040>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f23:[<0x10000001e36/picture-47.jpg v1040>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.596 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.242+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eb9 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-10.xml auth v516 ap=1 s=9810 n(v0 rc2024-09-19T05:21:21.243466+0000 b9810 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7deb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eb9:[<0x10000001e36/article-10.xml v516>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001eb9:[<0x10000001e36/article-10.xml v516>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.596 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.243+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f75 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-12.jpg auth v1416 ap=1 s=10197 n(v0 rc2024-09-19T05:21:23.562583+0000 b10197 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7df080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f75:[<0x10000001e36/picture-12.jpg v1416>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f75:[<0x10000001e36/picture-12.jpg v1416>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.596 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.243+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f29 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-44.jpg auth v1008 ap=1 s=22954 n(v0 rc2024-09-19T05:21:22.371935+0000 b22954 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7df600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f29:[<0x10000001e36/picture-44.jpg v1008>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f29:[<0x10000001e36/picture-44.jpg v1008>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.596 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.245+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e6a [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-48.xml auth v208 ap=1 s=4375 n(v0 rc2024-09-19T05:21:20.740376+0000 b4375 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@2},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7dfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e6a:[<0x10000001e36/article-48.xml v208>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e6a:[<0x10000001e36/article-48.xml v208>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.597 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.246+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ec5 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-4.xml auth v566 ap=1 s=22549 n(v0 rc2024-09-19T05:21:21.341869+0000 b22549 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7e0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ec5:[<0x10000001e36/article-4.xml v566>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ec5:[<0x10000001e36/article-4.xml v566>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.597 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.246+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e9b [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-25.xml auth v396 ap=1 s=18213 n(v0 rc2024-09-19T05:21:21.001851+0000 b18213 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@2},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7e0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e9b:[<0x10000001e36/article-25.xml v396>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e9b:[<0x10000001e36/article-25.xml v396>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.597 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.246+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ee7 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-72.jpg auth v974 ap=1 s=8927 n(v0 rc2024-09-19T05:21:21.642860+0000 b8927 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7e0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ee7:[<0x10000001e36/picture-72.jpg v974>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ee7:[<0x10000001e36/picture-72.jpg v974>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.597 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.247+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f05 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-59.jpg auth v914 ap=1 s=29499 n(v0 rc2024-09-19T05:21:21.948645+0000 b29499 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7e1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f05:[<0x10000001e36/picture-59.jpg v914>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f05:[<0x10000001e36/picture-59.jpg v914>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.597 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.248+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e7e [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-38.xml auth v292 ap=1 s=1731 n(v0 rc2024-09-19T05:21:20.851177+0000 b1731 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@3},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7e1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e7e:[<0x10000001e36/article-38.xml v292>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e7e:[<0x10000001e36/article-38.xml v292>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.601 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.248+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f8a [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-3.jpg auth v1425 ap=1 s=38813 n(v0 rc2024-09-19T05:21:23.978669+0000 b38813 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2c302580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f8a:[<0x10000001e36/picture-3.jpg v1425>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f8a:[<0x10000001e36/picture-3.jpg v1425>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.601 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.248+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f10 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-55.jpg auth v900 ap=1 s=20985 n(v0 rc2024-09-19T05:21:22.065408+0000 b20985 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7a1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f10:[<0x10000001e36/picture-55.jpg v900>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f10:[<0x10000001e36/picture-55.jpg v900>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.601 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.249+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f78 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-11.jpg auth v1429 ap=1 s=40068 n(v0 rc2024-09-19T05:21:23.612688+0000 b40068 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7b8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f78:[<0x10000001e36/picture-11.jpg v1429>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f78:[<0x10000001e36/picture-11.jpg v1429>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.601 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.249+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eed [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-70.jpg auth v710 ap=1 s=36219 n(v0 rc2024-09-19T05:21:21.702719+0000 b36219 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7b8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eed:[<0x10000001e36/picture-70.jpg v710>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001eed:[<0x10000001e36/picture-70.jpg v710>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.602 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.249+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ec4 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-5.xml auth v558 ap=1 s=18627 n(v0 rc2024-09-19T05:21:21.325324+0000 b18627 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7b8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ec4:[<0x10000001e36/article-5.xml v558>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ec4:[<0x10000001e36/article-5.xml v558>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.602 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.250+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e86 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-34.xml auth v324 ap=1 s=20952 n(v0 rc2024-09-19T05:21:20.888311+0000 b20952 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@2},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7b9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e86:[<0x10000001e36/article-34.xml v324>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e86:[<0x10000001e36/article-34.xml v324>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.602 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.250+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eea [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-71.jpg auth v970 ap=1 s=20419 n(v0 rc2024-09-19T05:21:21.668638+0000 b20419 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7b9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eea:[<0x10000001e36/picture-71.jpg v970>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001eea:[<0x10000001e36/picture-71.jpg v970>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.602 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.250+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e90 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-29.xml auth v364 ap=1 s=3903 n(v0 rc2024-09-19T05:21:20.948743+0000 b3903 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@3},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7b9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e90:[<0x10000001e36/article-29.xml v364>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e90:[<0x10000001e36/article-29.xml v364>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.602 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.250+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e53 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-60.xml auth v112 ap=1 s=13904 n(v0 rc2024-09-19T05:21:20.613549+0000 b13904 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@2},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7ba100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e53:[<0x10000001e36/article-60.xml v112>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e53:[<0x10000001e36/article-60.xml v112>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.602 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.250+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001efd [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-63.jpg auth v930 ap=1 s=11629 n(v0 rc2024-09-19T05:21:21.851472+0000 b11629 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7ba680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001efd:[<0x10000001e36/picture-63.jpg v930>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001efd:[<0x10000001e36/picture-63.jpg v930>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.602 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.251+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f32 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-40.jpg auth v1058 ap=1 s=43160 n(v0 rc2024-09-19T05:21:22.503926+0000 b43160 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7bac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f32:[<0x10000001e36/picture-40.jpg v1058>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f32:[<0x10000001e36/picture-40.jpg v1058>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.602 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.251+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ea1 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-22.xml auth v420 ap=1 s=10385 n(v0 rc2024-09-19T05:21:21.092193+0000 b10385 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@2},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7bb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ea1:[<0x10000001e36/article-22.xml v420>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ea1:[<0x10000001e36/article-22.xml v420>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.602 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.251+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e68 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-49.xml auth v200 ap=1 s=12101 n(v0 rc2024-09-19T05:21:20.729209+0000 b12101 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@3},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7bb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e68:[<0x10000001e36/article-49.xml v200>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e68:[<0x10000001e36/article-49.xml v200>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.602 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.251+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e55 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-59.xml auth v120 ap=1 s=11105 n(v0 rc2024-09-19T05:21:20.627586+0000 b11105 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@3},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2c302000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e55:[<0x10000001e36/article-59.xml v120>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e55:[<0x10000001e36/article-59.xml v120>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.602 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.251+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f6a [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-18.jpg auth v1430 ap=1 s=12441 n(v0 rc2024-09-19T05:21:23.303405+0000 b12441 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d797b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f6a:[<0x10000001e36/picture-18.jpg v1430>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f6a:[<0x10000001e36/picture-18.jpg v1430>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.602 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.251+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f73 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-13.jpg auth v1350 ap=1 s=48033 n(v0 rc2024-09-19T05:21:23.525706+0000 b48033 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d797600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f73:[<0x10000001e36/picture-13.jpg v1350>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f73:[<0x10000001e36/picture-13.jpg v1350>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.603 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.252+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ea9 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-18.xml auth v452 ap=1 s=7540 n(v0 rc2024-09-19T05:21:21.135087+0000 b7540 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@2},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d798100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ea9:[<0x10000001e36/article-18.xml v452>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ea9:[<0x10000001e36/article-18.xml v452>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.603 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.252+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e64 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-51.xml auth v184 ap=1 s=32254 n(v0 rc2024-09-19T05:21:20.706540+0000 b32254 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@3},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d798c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e64:[<0x10000001e36/article-51.xml v184>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e64:[<0x10000001e36/article-51.xml v184>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.603 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.252+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f68 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-19.jpg auth v1294 ap=1 s=22435 n(v0 rc2024-09-19T05:21:23.280186+0000 b22435 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d798680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f68:[<0x10000001e36/picture-19.jpg v1294>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f68:[<0x10000001e36/picture-19.jpg v1294>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.603 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.252+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ece [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-82.jpg auth v608 ap=1 s=29034 n(v0 rc2024-09-19T05:21:21.426589+0000 b29034 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d799180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ece:[<0x10000001e36/picture-82.jpg v608>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ece:[<0x10000001e36/picture-82.jpg v608>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.603 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.253+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e96 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-27.xml auth v380 ap=1 s=6012 n(v0 rc2024-09-19T05:21:20.972231+0000 b6012 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@3},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d799700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e96:[<0x10000001e36/article-27.xml v380>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e96:[<0x10000001e36/article-27.xml v380>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.603 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.253+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f89 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-4.jpg auth v1414 ap=1 s=59245 n(v0 rc2024-09-19T05:21:23.944096+0000 b59245 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@2},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2c304100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f89:[<0x10000001e36/picture-4.jpg v1414>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f89:[<0x10000001e36/picture-4.jpg v1414>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.603 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.253+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f3d [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-35.jpg auth v1268 ap=1 s=63829 n(v0 rc2024-09-19T05:21:22.698531+0000 b63829 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2c304680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f3d:[<0x10000001e36/picture-35.jpg v1268>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f3d:[<0x10000001e36/picture-35.jpg v1268>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.603 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.253+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f8c [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-2.jpg auth v1420 ap=1 s=42936 n(v0 rc2024-09-19T05:21:24.033332+0000 b42936 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2c304c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f8c:[<0x10000001e36/picture-2.jpg v1420>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f8c:[<0x10000001e36/picture-2.jpg v1420>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.603 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.253+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e3d [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-70.xml auth v32 ap=1 s=16285 n(v0 rc2024-09-19T05:21:20.514298+0000 b16285 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@3},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2c305700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e3d:[<0x10000001e36/article-70.xml v32>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e3d:[<0x10000001e36/article-70.xml v32>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.603 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.253+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ed7 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-78.jpg auth v642 ap=1 s=14139 n(v0 rc2024-09-19T05:21:21.504212+0000 b14139 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2c305180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ed7:[<0x10000001e36/picture-78.jpg v642>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ed7:[<0x10000001e36/picture-78.jpg v642>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.603 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.254+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f71 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-14.jpg auth v1428 ap=1 s=28583 n(v0 rc2024-09-19T05:21:23.473477+0000 b28583 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d79e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f71:[<0x10000001e36/picture-14.jpg v1428>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f71:[<0x10000001e36/picture-14.jpg v1428>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.603 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.254+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e50 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-61.xml auth v104 ap=1 s=18070 n(v0 rc2024-09-19T05:21:20.605927+0000 b18070 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@3},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d79eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e50:[<0x10000001e36/article-61.xml v104>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e50:[<0x10000001e36/article-61.xml v104>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.604 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.254+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ea5 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-20.xml auth v436 ap=1 s=17639 n(v0 rc2024-09-19T05:21:21.117415+0000 b17639 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@2},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d79e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ea5:[<0x10000001e36/article-20.xml v436>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ea5:[<0x10000001e36/article-20.xml v436>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.604 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.254+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e78 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-41.xml auth v268 ap=1 s=7942 n(v0 rc2024-09-19T05:21:20.821097+0000 b7942 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@3},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d79f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e78:[<0x10000001e36/article-41.xml v268>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e78:[<0x10000001e36/article-41.xml v268>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.604 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.255+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e70 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-45.xml auth v234 ap=1 s=5741 n(v0 rc2024-09-19T05:21:20.771617+0000 b5741 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@3},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d79f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e70:[<0x10000001e36/article-45.xml v234>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e70:[<0x10000001e36/article-45.xml v234>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.604 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.256+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f01 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-61.jpg auth v798 ap=1 s=59173 n(v0 rc2024-09-19T05:21:21.901939+0000 b59173 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7a0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f01:[<0x10000001e36/picture-61.jpg v798>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f01:[<0x10000001e36/picture-61.jpg v798>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.604 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.256+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e3f [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-69.xml auth v40 ap=1 s=22317 n(v0 rc2024-09-19T05:21:20.523077+0000 b22317 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d79fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e3f:[<0x10000001e36/article-69.xml v40>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e3f:[<0x10000001e36/article-69.xml v40>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.604 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.256+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f82 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-7.jpg auth v1404 ap=1 s=28028 n(v0 rc2024-09-19T05:21:23.808122+0000 b28028 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7a0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f82:[<0x10000001e36/picture-7.jpg v1404>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f82:[<0x10000001e36/picture-7.jpg v1404>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.604 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.256+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001e8c [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-31.xml auth v348 ap=1 s=29399 n(v0 rc2024-09-19T05:21:20.923764+0000 b29399 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@3},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7a0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001e8c:[<0x10000001e36/article-31.xml v348>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001e8c:[<0x10000001e36/article-31.xml v348>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.604 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.256+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f7c [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-9.jpg auth v1424 ap=1 s=56032 n(v0 rc2024-09-19T05:21:23.714045+0000 b56032 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d7a1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f7c:[<0x10000001e36/picture-9.jpg v1424>,<0x10000000399/blog-61 v66910>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f7c:[<0x10000001e36/picture-9.jpg v1424>,<0x10000000399/blog-61 v73407>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.604 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.299+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fa5 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-13.jpg auth v82 ap=1 s=14081 n(v0 rc2024-09-19T05:21:24.521121+0000 b14081 1=1+0)/n(v0 rc2024-09-19T05:21:24.516877+0000 b14081 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d2fb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fa5:[<0x10000001f93/picture-13.jpg v82>,<0x10000000399/blog-63 v67738>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fa5:[<0x10000001f93/picture-13.jpg v82>,<0x10000000399/blog-63 v73409>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.604 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.299+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fc6 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-2.jpg auth v184 ap=1 s=14504 n(v0 rc2024-09-19T05:21:25.040637+0000 b14504 1=1+0)/n(v0 rc2024-09-19T05:21:25.036062+0000 b14504 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d25f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fc6:[<0x10000001f93/picture-2.jpg v184>,<0x10000000399/blog-63 v67738>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fc6:[<0x10000001f93/picture-2.jpg v184>,<0x10000000399/blog-63 v73409>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.604 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.299+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fb5 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-7.jpg auth v216 ap=1 s=50727 n(v0 rc2024-09-19T05:21:24.824559+0000 b50727 1=1+0) caps={15168=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d25f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fb5:[<0x10000001f93/picture-7.jpg v216>,<0x10000000399/blog-63 v67738>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fb5:[<0x10000001f93/picture-7.jpg v216>,<0x10000000399/blog-63 v73409>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.604 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.299+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001faf [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-9.jpg auth v120 ap=1 s=56834 n(v0 rc2024-09-19T05:21:24.728721+0000 b56834 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d25fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001faf:[<0x10000001f93/picture-9.jpg v120>,<0x10000000399/blog-63 v67738>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001faf:[<0x10000001f93/picture-9.jpg v120>,<0x10000000399/blog-63 v73409>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.605 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.300+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fbf [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-4.jpg auth v202 ap=1 s=60018 n(v0 rc2024-09-19T05:21:24.964885+0000 b60018 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d2fb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fbf:[<0x10000001f93/picture-4.jpg v202>,<0x10000000399/blog-63 v67738>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fbf:[<0x10000001f93/picture-4.jpg v202>,<0x10000000399/blog-63 v73409>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.605 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.300+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fab [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-10.jpg auth v112 ap=1 s=21548 n(v0 rc2024-09-19T05:21:24.675432+0000 b21548 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d260100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fab:[<0x10000001f93/picture-10.jpg v112>,<0x10000000399/blog-63 v67738>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fab:[<0x10000001f93/picture-10.jpg v112>,<0x10000000399/blog-63 v73409>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.605 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.300+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fc9 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-1.jpg auth v194 ap=1 s=64836 n(v0 rc2024-09-19T05:21:25.107702+0000 b64836 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d260680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fc9:[<0x10000001f93/picture-1.jpg v194>,<0x10000000399/blog-63 v67738>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fc9:[<0x10000001f93/picture-1.jpg v194>,<0x10000000399/blog-63 v73409>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.605 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.301+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fb8 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-6.jpg auth v148 ap=1 s=30630 n(v0 rc2024-09-19T05:21:24.877623+0000 b30630 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d260c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fb8:[<0x10000001f93/picture-6.jpg v148>,<0x10000000399/blog-63 v67738>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fb8:[<0x10000001f93/picture-6.jpg v148>,<0x10000000399/blog-63 v73409>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.605 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.301+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f9f [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-3.xml auth v200 ap=1 s=20408 n(v0 rc2024-09-19T05:21:24.384601+0000 b20408 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d261180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f9f:[<0x10000001f93/article-3.xml v200>,<0x10000000399/blog-63 v67738>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f9f:[<0x10000001f93/article-3.xml v200>,<0x10000000399/blog-63 v73409>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.605 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.302+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f97 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-7.xml auth v16 ap=1 s=22303 n(v0 rc2024-09-19T05:21:24.209334+0000 b22303 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d261700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f97:[<0x10000001f93/article-7.xml v16>,<0x10000000399/blog-63 v67738>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f97:[<0x10000001f93/article-7.xml v16>,<0x10000000399/blog-63 v73409>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.605 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.302+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f95 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-8.xml auth v8 ap=1 s=2324 n(v0 rc2024-09-19T05:21:24.176264+0000 b2324 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2caa2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f95:[<0x10000001f93/article-8.xml v8>,<0x10000000399/blog-63 v67738>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f95:[<0x10000001f93/article-8.xml v8>,<0x10000000399/blog-63 v73409>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.605 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.303+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fb2 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-8.jpg auth v220 ap=1 s=60475 n(v0 rc2024-09-19T05:21:24.773265+0000 b60475 1=1+0) caps={15168=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2caa2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fb2:[<0x10000001f93/picture-8.jpg v220>,<0x10000000399/blog-63 v67738>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fb2:[<0x10000001f93/picture-8.jpg v220>,<0x10000000399/blog-63 v73409>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.605 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.303+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f99 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-6.xml auth v212 ap=1 s=3956 n(v0 rc2024-09-19T05:21:24.244266+0000 b3956 1=1+0) caps={15168=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2caa2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f99:[<0x10000001f93/article-6.xml v212>,<0x10000000399/blog-63 v67738>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f99:[<0x10000001f93/article-6.xml v212>,<0x10000000399/blog-63 v73409>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.606 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.303+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fa1 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-2.xml auth v196 ap=1 s=1205 n(v0 rc2024-09-19T05:21:24.440786+0000 b1205 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2caa3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fa1:[<0x10000001f93/article-2.xml v196>,<0x10000000399/blog-63 v67738>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fa1:[<0x10000001f93/article-2.xml v196>,<0x10000000399/blog-63 v73409>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.606 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.303+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fbb [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-5.jpg auth v206 ap=1 s=65438 n(v0 rc2024-09-19T05:21:24.918550+0000 b65438 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2caa3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fbb:[<0x10000001f93/picture-5.jpg v206>,<0x10000000399/blog-63 v67738>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fbb:[<0x10000001f93/picture-5.jpg v206>,<0x10000000399/blog-63 v73409>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.606 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.304+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fc3 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-3.jpg auth v198 ap=1 s=21538 n(v0 rc2024-09-19T05:21:25.008959+0000 b21538 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2caa3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fc3:[<0x10000001f93/picture-3.jpg v198>,<0x10000000399/blog-63 v67738>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fc3:[<0x10000001f93/picture-3.jpg v198>,<0x10000000399/blog-63 v73409>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.606 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.304+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001faa [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-11.jpg auth v102 ap=1 s=40303 n(v0 rc2024-09-19T05:21:24.620849+0000 b40303 1=1+0)/n(v0 rc2024-09-19T05:21:24.616395+0000 b40303 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x561d2caa4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001faa:[<0x10000001f93/picture-11.jpg v102>,<0x10000000399/blog-63 v67738>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001faa:[<0x10000001f93/picture-11.jpg v102>,<0x10000000399/blog-63 v73409>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.606 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.304+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f9b [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-5.xml auth v208 ap=1 s=24875 n(v0 rc2024-09-19T05:21:24.285815+0000 b24875 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2caa4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f9b:[<0x10000001f93/article-5.xml v208>,<0x10000000399/blog-63 v67738>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f9b:[<0x10000001f93/article-5.xml v208>,<0x10000000399/blog-63 v73409>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.606 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.304+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fa7 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-12.jpg auth v92 ap=1 s=30815 n(v0 rc2024-09-19T05:21:24.565584+0000 b30815 1=1+0)/n(v0 rc2024-09-19T05:21:24.560941+0000 b30815 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x561d2caa4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fa7:[<0x10000001f93/picture-12.jpg v92>,<0x10000000399/blog-63 v67738>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fa7:[<0x10000001f93/picture-12.jpg v92>,<0x10000000399/blog-63 v73409>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.606 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.304+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f9d [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-4.xml auth v204 ap=1 s=9333 n(v0 rc2024-09-19T05:21:24.329855+0000 b9333 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2caa5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f9d:[<0x10000001f93/article-4.xml v204>,<0x10000000399/blog-63 v67738>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f9d:[<0x10000001f93/article-4.xml v204>,<0x10000000399/blog-63 v73409>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.606 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.304+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fa3 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-1.xml auth v74 ap=1 s=24546 n(v0 rc2024-09-19T05:21:24.490223+0000 b24546 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2caa5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fa3:[<0x10000001f93/article-1.xml v74>,<0x10000000399/blog-63 v67738>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fa3:[<0x10000001f93/article-1.xml v74>,<0x10000000399/blog-63 v73409>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.606 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.329+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ff8 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-4.jpg auth v116 ap=1 s=42438 n(v0 rc2024-09-19T05:21:25.728835+0000 b42438 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8b1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ff8:[<0x10000001fcc/picture-4.jpg v116>,<0x10000000399/blog-65 v67326>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ff8:[<0x10000001fcc/picture-4.jpg v116>,<0x10000000399/blog-65 v73415>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.607 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.329+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ffe [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-2.jpg auth v134 ap=1 s=43290 n(v0 rc2024-09-19T05:21:25.834283+0000 b43290 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8b1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ffe:[<0x10000001fcc/picture-2.jpg v134>,<0x10000000399/blog-65 v67326>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ffe:[<0x10000001fcc/picture-2.jpg v134>,<0x10000000399/blog-65 v73415>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.607 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.329+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fec [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-7.jpg auth v166 ap=1 s=40330 n(v0 rc2024-09-19T05:21:25.564572+0000 b40330 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2c092000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fec:[<0x10000001fcc/picture-7.jpg v86>,<0x10000000399/blog-65 v67326>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fec:[<0x10000001fcc/picture-7.jpg v166>,<0x10000000399/blog-65 v73415>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.607 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.329+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fce [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-9.xml auth v8 ap=1 s=22700 n(v0 rc2024-09-19T05:21:25.175666+0000 b22700 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2c092b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fce:[<0x10000001fcc/article-9.xml v8>,<0x10000000399/blog-65 v67326>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fce:[<0x10000001fcc/article-9.xml v8>,<0x10000000399/blog-65 v73415>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.607 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.330+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fe3 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-3.xml auth v60 ap=1 s=5873 n(v0 rc2024-09-19T05:21:25.455725+0000 b5873 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2c093600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fe3:[<0x10000001fcc/article-3.xml v60>,<0x10000000399/blog-65 v67326>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fe3:[<0x10000001fcc/article-3.xml v60>,<0x10000000399/blog-65 v73415>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.607 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.330+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fd1 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-8.xml auth v16 ap=1 s=21065 n(v0 rc2024-09-19T05:21:25.217144+0000 b21065 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2c094100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fd1:[<0x10000001fcc/article-8.xml v16>,<0x10000000399/blog-65 v67326>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fd1:[<0x10000001fcc/article-8.xml v16>,<0x10000000399/blog-65 v73415>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.607 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.330+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ff0 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-6.jpg auth v158 ap=1 s=44319 n(v0 rc2024-09-19T05:21:25.616268+0000 b44319 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2c093080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ff0:[<0x10000001fcc/picture-6.jpg v96>,<0x10000000399/blog-65 v67326>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ff0:[<0x10000001fcc/picture-6.jpg v158>,<0x10000000399/blog-65 v73415>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.607 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.331+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002001 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-1.jpg auth v142 ap=1 s=28471 n(v0 rc2024-09-19T05:21:25.870762+0000 b28471 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2c092580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002001:[<0x10000001fcc/picture-1.jpg v142>,<0x10000000399/blog-65 v67326>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002001:[<0x10000001fcc/picture-1.jpg v142>,<0x10000000399/blog-65 v73415>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.607 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.334+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fd5 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-7.xml auth v170 ap=1 s=7216 n(v0 rc2024-09-19T05:21:25.260365+0000 b7216 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2c093b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fd5:[<0x10000001fcc/article-7.xml v24>,<0x10000000399/blog-65 v67326>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fd5:[<0x10000001fcc/article-7.xml v170>,<0x10000000399/blog-65 v73415>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.607 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.334+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fda [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-6.xml auth v162 ap=1 s=4116 n(v0 rc2024-09-19T05:21:25.318516+0000 b4116 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2c094680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fda:[<0x10000001fcc/article-6.xml v34>,<0x10000000399/blog-65 v67326>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fda:[<0x10000001fcc/article-6.xml v162>,<0x10000000399/blog-65 v73415>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.607 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.335+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fe6 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-2.xml auth v146 ap=1 s=8581 n(v0 rc2024-09-19T05:21:25.487941+0000 b8581 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2c094c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fe6:[<0x10000001fcc/article-2.xml v68>,<0x10000000399/blog-65 v67326>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fe6:[<0x10000001fcc/article-2.xml v146>,<0x10000000399/blog-65 v73415>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.607 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.341+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ff4 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-5.jpg auth v154 ap=1 s=59886 n(v0 rc2024-09-19T05:21:25.674372+0000 b59886 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2c095180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ff4:[<0x10000001fcc/picture-5.jpg v106>,<0x10000000399/blog-65 v67326>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ff4:[<0x10000001fcc/picture-5.jpg v154>,<0x10000000399/blog-65 v73415>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.607 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.341+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ffb [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-3.jpg auth v150 ap=1 s=24401 n(v0 rc2024-09-19T05:21:25.773277+0000 b24401 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2c095700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ffb:[<0x10000001fcc/picture-3.jpg v124>,<0x10000000399/blog-65 v67326>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ffb:[<0x10000001fcc/picture-3.jpg v150>,<0x10000000399/blog-65 v73415>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.608 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.342+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fdd [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-5.xml auth v44 ap=1 s=27943 n(v0 rc2024-09-19T05:21:25.378410+0000 b27943 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d71e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fdd:[<0x10000001fcc/article-5.xml v44>,<0x10000000399/blog-65 v67326>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fdd:[<0x10000001fcc/article-5.xml v44>,<0x10000000399/blog-65 v73415>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.608 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.342+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fe0 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-4.xml auth v52 ap=1 s=21004 n(v0 rc2024-09-19T05:21:25.413837+0000 b21004 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d71e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fe0:[<0x10000001fcc/article-4.xml v52>,<0x10000000399/blog-65 v67326>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fe0:[<0x10000001fcc/article-4.xml v52>,<0x10000000399/blog-65 v73415>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.608 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.343+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fe9 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-1.xml auth v78 ap=1 s=20782 n(v0 rc2024-09-19T05:21:25.530296+0000 b20782 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d71eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fe9:[<0x10000001fcc/article-1.xml v78>,<0x10000000399/blog-65 v67326>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fe9:[<0x10000001fcc/article-1.xml v78>,<0x10000000399/blog-65 v73415>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.608 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.360+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b5f [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-77.xml auth v222 ap=1 s=23927 n(v0 rc2024-09-19T05:21:15.858693+0000 b23927 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d877600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b5f:[<0x1000000120e/article-77.xml v222>,<0x10000000399/blog-25 v65890>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001b5f:[<0x1000000120e/article-77.xml v222>,<0x10000000399/blog-25 v73437>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.608 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.586+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001de5 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-37/picture-48.jpg auth v1052 ap=1 s=34628 n(v0 rc2024-09-19T05:21:19.946555+0000 b34628 1=1+0) caps={15168=pAsLsXsFscr/-@2} | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561d2d845700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001de5:[<0x10000001648/picture-48.jpg v925>,<0x10000000399/blog-37 v66258>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001de5:[<0x10000001648/picture-48.jpg v1052>,<0x10000000399/blog-37 v73677>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.608 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.588+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f55 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-37/article-62.xml auth v943 ap=1 s=21675 n(v0 rc2024-09-19T05:21:23.025635+0000 b21675 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d235180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f55:[<0x10000001648/article-62.xml v943>,<0x10000000399/blog-37 v66258>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f55:[<0x10000001648/article-62.xml v943>,<0x10000000399/blog-37 v73677>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-mon[34347]: pgmap v74: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 550 op/s 2024-09-19T05:21:36.694 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.319+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002000 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-51.xml auth v8 ap=1 s=28959 n(v0 rc2024-09-19T05:21:25.838593+0000 b28959 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c61a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002000:[<0x10000001ffd/article-51.xml v8>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002000:[<0x10000001ffd/article-51.xml v8>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.694 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.320+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000204e [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-27.xml auth v636 ap=1 s=11106 n(v0 rc2024-09-19T05:21:27.371372+0000 b11106 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c61ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000204e:[<0x10000001ffd/article-27.xml v226>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x1000000204e:[<0x10000001ffd/article-27.xml v636>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.694 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.320+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002064 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-20.xml auth v296 ap=1 s=11421 n(v0 rc2024-09-19T05:21:27.935348+0000 b11421 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c61bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002064:[<0x10000001ffd/article-20.xml v296>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002064:[<0x10000001ffd/article-20.xml v296>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.694 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.320+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002020 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-41.xml auth v708 ap=1 s=2879 n(v0 rc2024-09-19T05:21:26.489200+0000 b2879 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c61c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002020:[<0x10000001ffd/article-41.xml v100>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002020:[<0x10000001ffd/article-41.xml v708>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.694 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.320+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002013 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-45.xml auth v726 ap=1 s=3118 n(v0 rc2024-09-19T05:21:26.166767+0000 b3118 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c61cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002013:[<0x10000001ffd/article-45.xml v62>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002013:[<0x10000001ffd/article-45.xml v726>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.694 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.321+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002042 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-31.xml auth v190 ap=1 s=18944 n(v0 rc2024-09-19T05:21:27.152895+0000 b18944 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c61d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002042:[<0x10000001ffd/article-31.xml v190>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002042:[<0x10000001ffd/article-31.xml v190>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.694 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.321+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002016 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-44.xml auth v724 ap=1 s=1323 n(v0 rc2024-09-19T05:21:26.235046+0000 b1323 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c61f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002016:[<0x10000001ffd/article-44.xml v72>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002016:[<0x10000001ffd/article-44.xml v724>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.694 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.322+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002057 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-24.xml auth v618 ap=1 s=21878 n(v0 rc2024-09-19T05:21:27.608784+0000 b21878 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c620100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002057:[<0x10000001ffd/article-24.xml v256>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002057:[<0x10000001ffd/article-24.xml v618>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.695 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.322+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000203f [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-32.xml auth v668 ap=1 s=26714 n(v0 rc2024-09-19T05:21:27.056878+0000 b26714 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c622580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000203f:[<0x10000001ffd/article-32.xml v180>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x1000000203f:[<0x10000001ffd/article-32.xml v668>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.695 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.323+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002061 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-21.xml auth v602 ap=1 s=17752 n(v0 rc2024-09-19T05:21:27.851656+0000 b17752 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c622b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002061:[<0x10000001ffd/article-21.xml v286>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002061:[<0x10000001ffd/article-21.xml v602>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.695 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.323+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002044 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-30.xml auth v654 ap=1 s=2219 n(v0 rc2024-09-19T05:21:27.195909+0000 b2219 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c623080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002044:[<0x10000001ffd/article-30.xml v198>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002044:[<0x10000001ffd/article-30.xml v654>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.695 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.323+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002003 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-50.xml auth v750 ap=1 s=25043 n(v0 rc2024-09-19T05:21:25.886257+0000 b25043 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c623b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002003:[<0x10000001ffd/article-50.xml v16>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002003:[<0x10000001ffd/article-50.xml v750>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.695 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.324+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000201b [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-43.xml auth v710 ap=1 s=20351 n(v0 rc2024-09-19T05:21:26.331256+0000 b20351 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c624c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000201b:[<0x10000001ffd/article-43.xml v82>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x1000000201b:[<0x10000001ffd/article-43.xml v710>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.695 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.324+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000203c [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-33.xml auth v172 ap=1 s=22586 n(v0 rc2024-09-19T05:21:26.983552+0000 b22586 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c625180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000203c:[<0x10000001ffd/article-33.xml v172>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x1000000203c:[<0x10000001ffd/article-33.xml v172>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.695 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.324+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000204b [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-28.xml auth v640 ap=1 s=11942 n(v0 rc2024-09-19T05:21:27.299388+0000 b11942 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c626000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000204b:[<0x10000001ffd/article-28.xml v216>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x1000000204b:[<0x10000001ffd/article-28.xml v640>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.695 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.325+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002039 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-34.xml auth v164 ap=1 s=9280 n(v0 rc2024-09-19T05:21:26.923044+0000 b9280 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c627600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002039:[<0x10000001ffd/article-34.xml v164>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002039:[<0x10000001ffd/article-34.xml v164>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.695 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.325+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002048 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-29.xml auth v208 ap=1 s=11400 n(v0 rc2024-09-19T05:21:27.254108+0000 b11400 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c627b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002048:[<0x10000001ffd/article-29.xml v208>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002048:[<0x10000001ffd/article-29.xml v208>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.695 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.325+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000205e [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-22.xml auth v604 ap=1 s=30211 n(v0 rc2024-09-19T05:21:27.772804+0000 b30211 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c628100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000205e:[<0x10000001ffd/article-22.xml v276>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x1000000205e:[<0x10000001ffd/article-22.xml v604>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.695 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.325+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002007 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-49.xml auth v26 ap=1 s=31473 n(v0 rc2024-09-19T05:21:25.939345+0000 b31473 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c628680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002007:[<0x10000001ffd/article-49.xml v26>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002007:[<0x10000001ffd/article-49.xml v26>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.695 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.326+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002010 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-46.xml auth v732 ap=1 s=7854 n(v0 rc2024-09-19T05:21:26.093864+0000 b7854 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c629180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002010:[<0x10000001ffd/article-46.xml v52>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002010:[<0x10000001ffd/article-46.xml v732>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.695 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.326+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000200d [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-47.xml auth v736 ap=1 s=25968 n(v0 rc2024-09-19T05:21:26.024203+0000 b25968 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c629700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000200d:[<0x10000001ffd/article-47.xml v42>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x1000000200d:[<0x10000001ffd/article-47.xml v736>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.696 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.326+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002051 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-26.xml auth v632 ap=1 s=21028 n(v0 rc2024-09-19T05:21:27.432780+0000 b21028 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c62ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002051:[<0x10000001ffd/article-26.xml v236>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002051:[<0x10000001ffd/article-26.xml v632>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.696 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.327+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000200a [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-48.xml auth v34 ap=1 s=22020 n(v0 rc2024-09-19T05:21:25.979653+0000 b22020 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c62c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000200a:[<0x10000001ffd/article-48.xml v34>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x1000000200a:[<0x10000001ffd/article-48.xml v34>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.696 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.327+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002035 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-35.xml auth v680 ap=1 s=31610 n(v0 rc2024-09-19T05:21:26.829569+0000 b31610 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c62d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002035:[<0x10000001ffd/article-35.xml v154>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002035:[<0x10000001ffd/article-35.xml v680>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.696 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.327+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002029 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-38.xml auth v694 ap=1 s=28564 n(v0 rc2024-09-19T05:21:26.657963+0000 b28564 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c62d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002029:[<0x10000001ffd/article-38.xml v128>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002029:[<0x10000001ffd/article-38.xml v694>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.696 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.327+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002054 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-25.xml auth v620 ap=1 s=29694 n(v0 rc2024-09-19T05:21:27.524600+0000 b29694 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c62cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002054:[<0x10000001ffd/article-25.xml v246>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002054:[<0x10000001ffd/article-25.xml v620>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.696 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.327+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002024 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-40.xml auth v706 ap=1 s=6702 n(v0 rc2024-09-19T05:21:26.571465+0000 b6702 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c634000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002024:[<0x10000001ffd/article-40.xml v110>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002024:[<0x10000001ffd/article-40.xml v706>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.696 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.328+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000201e [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-42.xml auth v92 ap=1 s=29838 n(v0 rc2024-09-19T05:21:26.416572+0000 b29838 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c635080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000201e:[<0x10000001ffd/article-42.xml v92>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x1000000201e:[<0x10000001ffd/article-42.xml v92>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.696 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.328+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000202e [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-37.xml auth v138 ap=1 s=9926 n(v0 rc2024-09-19T05:21:26.735012+0000 b9926 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c635600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000202e:[<0x10000001ffd/article-37.xml v138>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x1000000202e:[<0x10000001ffd/article-37.xml v138>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.696 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.328+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002027 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-39.xml auth v120 ap=1 s=26535 n(v0 rc2024-09-19T05:21:26.629193+0000 b26535 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c635b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002027:[<0x10000001ffd/article-39.xml v120>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002027:[<0x10000001ffd/article-39.xml v120>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.696 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.328+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002031 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-36.xml auth v146 ap=1 s=26494 n(v0 rc2024-09-19T05:21:26.783306+0000 b26494 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c636100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002031:[<0x10000001ffd/article-36.xml v146>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002031:[<0x10000001ffd/article-36.xml v146>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.700 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.329+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000205b [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-23.xml auth v610 ap=1 s=24636 n(v0 rc2024-09-19T05:21:27.697681+0000 b24636 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c637700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000205b:[<0x10000001ffd/article-23.xml v266>,<0x10000000399/blog-66 v68702>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x1000000205b:[<0x10000001ffd/article-23.xml v610>,<0x10000000399/blog-66 v70922>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.700 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.331+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fcd [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-18.xml auth v106 ap=1 s=25315 n(v0 rc2024-09-19T05:21:25.154081+0000 b25315 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c63d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fcd:[<0x10000001fad/article-18.xml v106>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fcd:[<0x10000001fad/article-18.xml v106>,<0x10000000399/blog-64 v71544>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.700 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.332+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fb4 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-27.xml auth v942 ap=1 s=30516 n(v0 rc2024-09-19T05:21:24.784326+0000 b30516 1=1+0) caps={15168=pAsLsXsFscr/-@2} | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c63e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fb4:[<0x10000001fad/article-27.xml v24>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fb4:[<0x10000001fad/article-27.xml v942>,<0x10000000399/blog-64 v71544>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.700 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.332+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fc7 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-20.xml auth v90 ap=1 s=7202 n(v0 rc2024-09-19T05:21:25.078589+0000 b7202 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c63f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fc7:[<0x10000001fad/article-20.xml v90>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fc7:[<0x10000001fad/article-20.xml v90>,<0x10000000399/blog-64 v71544>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.700 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.333+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002015 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-61.jpg auth v312 ap=1 s=46467 n(v0 rc2024-09-19T05:21:26.205774+0000 b46467 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c39e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002015:[<0x10000001fad/picture-61.jpg v312>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002015:[<0x10000001fad/picture-61.jpg v312>,<0x10000000399/blog-64 v71544>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.700 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.333+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000200c [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-64.jpg auth v284 ap=1 s=30640 n(v0 rc2024-09-19T05:21:26.020784+0000 b30640 1=1+0)/n(v0 rc2024-09-19T05:21:26.017332+0000 b30640 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c39f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000200c:[<0x10000001fad/picture-64.jpg v284>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x1000000200c:[<0x10000001fad/picture-64.jpg v284>,<0x10000000399/blog-64 v71544>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.700 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.334+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fea [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-9.xml auth v182 ap=1 s=18273 n(v0 rc2024-09-19T05:21:25.533808+0000 b18273 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c3a0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fea:[<0x10000001fad/article-9.xml v182>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fea:[<0x10000001fad/article-9.xml v182>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.700 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.334+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fbd [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-24.xml auth v54 ap=1 s=28021 n(v0 rc2024-09-19T05:21:24.931492+0000 b28021 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c3a1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fbd:[<0x10000001fad/article-24.xml v54>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fbd:[<0x10000001fad/article-24.xml v54>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.700 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.335+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002060 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-37.jpg auth v524 ap=1 s=62035 n(v0 rc2024-09-19T05:21:27.802442+0000 b62035 1=1+0)/n(v0 rc2024-09-19T05:21:27.797287+0000 b62035 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c672000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002060:[<0x10000001fad/picture-37.jpg v524>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002060:[<0x10000001fad/picture-37.jpg v524>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.701 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.335+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ffa [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-3.xml auth v880 ap=1 s=22153 n(v0 rc2024-09-19T05:21:25.745545+0000 b22153 1=1+0) caps={15168=pAsLsXsFscr/-@2} | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c672b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ffa:[<0x10000001fad/article-3.xml v232>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ffa:[<0x10000001fad/article-3.xml v880>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.701 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.335+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fef [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-7.xml auth v198 ap=1 s=6778 n(v0 rc2024-09-19T05:21:25.594513+0000 b6778 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c674100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fef:[<0x10000001fad/article-7.xml v198>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fef:[<0x10000001fad/article-7.xml v198>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.701 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.335+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002021 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-57.jpg auth v346 ap=1 s=55661 n(v0 rc2024-09-19T05:21:26.504654+0000 b55661 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c673b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002021:[<0x10000001fad/picture-57.jpg v346>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002021:[<0x10000001fad/picture-57.jpg v346>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.701 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.336+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002052 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-42.jpg auth v482 ap=1 s=50974 n(v0 rc2024-09-19T05:21:27.501802+0000 b50974 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c674680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002052:[<0x10000001fad/picture-42.jpg v482>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002052:[<0x10000001fad/picture-42.jpg v482>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.701 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.336+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000205a [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-39.jpg auth v508 ap=1 s=11913 n(v0 rc2024-09-19T05:21:27.690864+0000 b11913 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c674c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000205a:[<0x10000001fad/picture-39.jpg v508>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x1000000205a:[<0x10000001fad/picture-39.jpg v508>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.701 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.336+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fed [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-8.xml auth v190 ap=1 s=8839 n(v0 rc2024-09-19T05:21:25.562679+0000 b8839 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c675700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fed:[<0x10000001fad/article-8.xml v190>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fed:[<0x10000001fad/article-8.xml v190>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.701 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.336+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000203b [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-49.jpg auth v414 ap=1 s=35305 n(v0 rc2024-09-19T05:21:26.949060+0000 b35305 1=1+0)/n(v0 rc2024-09-19T05:21:26.942818+0000 b35305 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c67c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000203b:[<0x10000001fad/picture-49.jpg v414>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x1000000203b:[<0x10000001fad/picture-49.jpg v414>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.701 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.337+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fc5 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-21.xml auth v82 ap=1 s=6735 n(v0 rc2024-09-19T05:21:25.037663+0000 b6735 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c67d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fc5:[<0x10000001fad/article-21.xml v82>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fc5:[<0x10000001fad/article-21.xml v82>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.701 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.337+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fde [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-13.xml auth v150 ap=1 s=19445 n(v0 rc2024-09-19T05:21:25.395132+0000 b19445 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c67db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fde:[<0x10000001fad/article-13.xml v150>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fde:[<0x10000001fad/article-13.xml v150>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.701 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.337+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ff2 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-6.xml auth v206 ap=1 s=14730 n(v0 rc2024-09-19T05:21:25.635817+0000 b14730 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c67e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ff2:[<0x10000001fad/article-6.xml v206>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ff2:[<0x10000001fad/article-6.xml v206>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.701 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.338+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ffc [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-2.xml auth v242 ap=1 s=10153 n(v0 rc2024-09-19T05:21:25.797917+0000 b10153 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c67e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ffc:[<0x10000001fad/article-2.xml v242>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ffc:[<0x10000001fad/article-2.xml v242>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.702 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.338+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000202a [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-54.jpg auth v372 ap=1 s=28897 n(v0 rc2024-09-19T05:21:26.664219+0000 b28897 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c67ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000202a:[<0x10000001fad/picture-54.jpg v372>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x1000000202a:[<0x10000001fad/picture-54.jpg v372>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.702 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.338+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002038 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-50.jpg auth v406 ap=1 s=28528 n(v0 rc2024-09-19T05:21:26.876219+0000 b28528 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c684000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002038:[<0x10000001fad/picture-50.jpg v406>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002038:[<0x10000001fad/picture-50.jpg v406>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.702 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.338+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000201d [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-58.jpg auth v338 ap=1 s=56036 n(v0 rc2024-09-19T05:21:26.418450+0000 b56036 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c684580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000201d:[<0x10000001fad/picture-58.jpg v338>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x1000000201d:[<0x10000001fad/picture-58.jpg v338>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.702 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.339+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002008 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-65.jpg auth v276 ap=1 s=58410 n(v0 rc2024-09-19T05:21:25.979254+0000 b58410 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c684b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002008:[<0x10000001fad/picture-65.jpg v276>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002008:[<0x10000001fad/picture-65.jpg v276>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.702 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.339+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fb1 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-28.xml auth v16 ap=1 s=1789 n(v0 rc2024-09-19T05:21:24.751170+0000 b1789 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c685080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fb1:[<0x10000001fad/article-28.xml v16>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fb1:[<0x10000001fad/article-28.xml v16>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.702 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.339+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002034 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-51.jpg auth v398 ap=1 s=18207 n(v0 rc2024-09-19T05:21:26.822180+0000 b18207 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c685600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002034:[<0x10000001fad/picture-51.jpg v398>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002034:[<0x10000001fad/picture-51.jpg v398>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.702 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.339+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002012 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-62.jpg auth v302 ap=1 s=63395 n(v0 rc2024-09-19T05:21:26.130955+0000 b63395 1=1+0)/n(v0 rc2024-09-19T05:21:26.125919+0000 b63395 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c685b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002012:[<0x10000001fad/picture-62.jpg v302>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002012:[<0x10000001fad/picture-62.jpg v302>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.703 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.339+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002046 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-46.jpg auth v444 ap=1 s=25437 n(v0 rc2024-09-19T05:21:27.226284+0000 b25437 1=1+0)/n(v0 rc2024-09-19T05:21:27.220585+0000 b25437 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c686100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002046:[<0x10000001fad/picture-46.jpg v444>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002046:[<0x10000001fad/picture-46.jpg v444>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.703 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.340+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002026 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-55.jpg auth v364 ap=1 s=62235 n(v0 rc2024-09-19T05:21:26.631090+0000 b62235 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c686c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002026:[<0x10000001fad/picture-55.jpg v364>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002026:[<0x10000001fad/picture-55.jpg v364>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.703 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.340+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ff5 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-5.xml auth v214 ap=1 s=4653 n(v0 rc2024-09-19T05:21:25.668288+0000 b4653 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c687700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ff5:[<0x10000001fad/article-5.xml v214>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ff5:[<0x10000001fad/article-5.xml v214>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.703 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.340+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fae [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-29.xml auth v8 ap=1 s=16287 n(v0 rc2024-09-19T05:21:24.714171+0000 b16287 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c690000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fae:[<0x10000001fad/article-29.xml v8>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fae:[<0x10000001fad/article-29.xml v8>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.703 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.340+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000200f [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-63.jpg auth v294 ap=1 s=13284 n(v0 rc2024-09-19T05:21:26.088427+0000 b13284 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c690580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000200f:[<0x10000001fad/picture-63.jpg v294>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x1000000200f:[<0x10000001fad/picture-63.jpg v294>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.703 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.340+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002058 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-40.jpg auth v498 ap=1 s=36235 n(v0 rc2024-09-19T05:21:27.608394+0000 b36235 1=1+0)/n(v0 rc2024-09-19T05:21:27.602442+0000 b36235 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c690b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002058:[<0x10000001fad/picture-40.jpg v498>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002058:[<0x10000001fad/picture-40.jpg v498>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.703 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.341+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fc2 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-22.xml auth v924 ap=1 s=3845 n(v0 rc2024-09-19T05:21:25.004270+0000 b3845 1=1+0) caps={15168=pAsLsXsFscr/-@2} | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c691080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fc2:[<0x10000001fad/article-22.xml v72>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fc2:[<0x10000001fad/article-22.xml v924>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.703 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.341+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fdb [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-14.xml auth v142 ap=1 s=29835 n(v0 rc2024-09-19T05:21:25.357905+0000 b29835 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c691b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fdb:[<0x10000001fad/article-14.xml v142>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fdb:[<0x10000001fad/article-14.xml v142>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.703 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.341+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002049 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-45.jpg auth v454 ap=1 s=25526 n(v0 rc2024-09-19T05:21:27.289198+0000 b25526 1=1+0)/n(v0 rc2024-09-19T05:21:27.283777+0000 b25526 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c692100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002049:[<0x10000001fad/picture-45.jpg v454>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002049:[<0x10000001fad/picture-45.jpg v454>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.703 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.341+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002055 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-41.jpg auth v490 ap=1 s=16708 n(v0 rc2024-09-19T05:21:27.552880+0000 b16708 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c692680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002055:[<0x10000001fad/picture-41.jpg v490>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002055:[<0x10000001fad/picture-41.jpg v490>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.703 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.342+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002005 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-66.jpg auth v266 ap=1 s=26039 n(v0 rc2024-09-19T05:21:25.921255+0000 b26039 1=1+0)/n(v0 rc2024-09-19T05:21:25.916291+0000 b26039 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c693180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002005:[<0x10000001fad/picture-66.jpg v266>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002005:[<0x10000001fad/picture-66.jpg v266>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.703 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.342+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002018 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-60.jpg auth v320 ap=1 s=14068 n(v0 rc2024-09-19T05:21:26.259490+0000 b14068 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c692c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002018:[<0x10000001fad/picture-60.jpg v320>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002018:[<0x10000001fad/picture-60.jpg v320>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.704 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.342+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fe4 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-11.xml auth v166 ap=1 s=26366 n(v0 rc2024-09-19T05:21:25.470994+0000 b26366 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c69a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fe4:[<0x10000001fad/article-11.xml v166>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fe4:[<0x10000001fad/article-11.xml v166>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.704 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.342+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fd4 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-16.xml auth v124 ap=1 s=23166 n(v0 rc2024-09-19T05:21:25.250596+0000 b23166 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c69a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fd4:[<0x10000001fad/article-16.xml v124>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fd4:[<0x10000001fad/article-16.xml v124>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.704 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.342+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fb7 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-26.xml auth v938 ap=1 s=29328 n(v0 rc2024-09-19T05:21:24.829763+0000 b29328 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c69ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fb7:[<0x10000001fad/article-26.xml v34>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fb7:[<0x10000001fad/article-26.xml v938>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.704 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.343+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002023 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-56.jpg auth v354 ap=1 s=42702 n(v0 rc2024-09-19T05:21:26.564469+0000 b42702 1=1+0)/n(v0 rc2024-09-19T05:21:26.557907+0000 b42702 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c69b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002023:[<0x10000001fad/picture-56.jpg v354>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002023:[<0x10000001fad/picture-56.jpg v354>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.704 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.343+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002041 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-47.jpg auth v434 ap=1 s=47725 n(v0 rc2024-09-19T05:21:27.156120+0000 b47725 1=1+0)/n(v0 rc2024-09-19T05:21:27.151849+0000 b47725 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c69bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002041:[<0x10000001fad/picture-47.jpg v434>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002041:[<0x10000001fad/picture-47.jpg v434>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.704 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.343+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fe7 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-10.xml auth v174 ap=1 s=6115 n(v0 rc2024-09-19T05:21:25.503044+0000 b6115 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c69c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fe7:[<0x10000001fad/article-10.xml v174>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fe7:[<0x10000001fad/article-10.xml v174>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.704 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.343+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000204d [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-44.jpg auth v464 ap=1 s=61661 n(v0 rc2024-09-19T05:21:27.372776+0000 b61661 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c69cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000204d:[<0x10000001fad/picture-44.jpg v464>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x1000000204d:[<0x10000001fad/picture-44.jpg v464>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.704 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.343+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fba [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-25.xml auth v934 ap=1 s=21125 n(v0 rc2024-09-19T05:21:24.883206+0000 b21125 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c69d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fba:[<0x10000001fad/article-25.xml v44>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fba:[<0x10000001fad/article-25.xml v934>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.704 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.343+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ff7 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-4.xml auth v888 ap=1 s=28045 n(v0 rc2024-09-19T05:21:25.702157+0000 b28045 1=1+0) caps={15168=pAsLsXsFscr/-@2} | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c69d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ff7:[<0x10000001fad/article-4.xml v222>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ff7:[<0x10000001fad/article-4.xml v888>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.704 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.344+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000201a [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-59.jpg auth v328 ap=1 s=26415 n(v0 rc2024-09-19T05:21:26.329457+0000 b26415 1=1+0)/n(v0 rc2024-09-19T05:21:26.320723+0000 b26415 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c6a2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000201a:[<0x10000001fad/picture-59.jpg v328>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x1000000201a:[<0x10000001fad/picture-59.jpg v328>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.704 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.344+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fd8 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-15.xml auth v916 ap=1 s=18658 n(v0 rc2024-09-19T05:21:25.299162+0000 b18658 1=1+0) caps={15168=pAsLsXsFscr/-@2} | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c6a3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fd8:[<0x10000001fad/article-15.xml v132>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fd8:[<0x10000001fad/article-15.xml v916>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.705 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.344+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002063 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-36.jpg auth v534 ap=1 s=13808 n(v0 rc2024-09-19T05:21:27.899889+0000 b13808 1=1+0)/n(v0 rc2024-09-19T05:21:27.891218+0000 b13808 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c6a3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002063:[<0x10000001fad/picture-36.jpg v534>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002063:[<0x10000001fad/picture-36.jpg v534>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.705 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.345+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000204f [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-43.jpg auth v472 ap=1 s=31484 n(v0 rc2024-09-19T05:21:27.423927+0000 b31484 1=1+0)/n(v0 rc2024-09-19T05:21:27.416897+0000 b31484 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c6a3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000204f:[<0x10000001fad/picture-43.jpg v472>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x1000000204f:[<0x10000001fad/picture-43.jpg v472>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.705 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.345+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fca [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-19.xml auth v98 ap=1 s=5173 n(v0 rc2024-09-19T05:21:25.109520+0000 b5173 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c6a4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fca:[<0x10000001fad/article-19.xml v98>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fca:[<0x10000001fad/article-19.xml v98>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.705 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.345+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000205d [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-38.jpg auth v516 ap=1 s=36325 n(v0 rc2024-09-19T05:21:27.742479+0000 b36325 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c6a4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000205d:[<0x10000001fad/picture-38.jpg v516>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x1000000205d:[<0x10000001fad/picture-38.jpg v516>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.705 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.345+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000202f [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-52.jpg auth v388 ap=1 s=48618 n(v0 rc2024-09-19T05:21:26.767917+0000 b48618 1=1+0)/n(v0 rc2024-09-19T05:21:26.764527+0000 b48618 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c6b0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000202f:[<0x10000001fad/picture-52.jpg v388>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x1000000202f:[<0x10000001fad/picture-52.jpg v388>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.705 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.345+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fe1 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-12.xml auth v158 ap=1 s=30706 n(v0 rc2024-09-19T05:21:25.441925+0000 b30706 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c6a5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fe1:[<0x10000001fad/article-12.xml v158>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fe1:[<0x10000001fad/article-12.xml v158>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.705 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.345+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fff [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-1.xml auth v250 ap=1 s=25275 n(v0 rc2024-09-19T05:21:25.835505+0000 b25275 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c6b0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fff:[<0x10000001fad/article-1.xml v250>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fff:[<0x10000001fad/article-1.xml v250>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.705 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.346+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000202c [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-53.jpg auth v380 ap=1 s=49072 n(v0 rc2024-09-19T05:21:26.715708+0000 b49072 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c6b1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000202c:[<0x10000001fad/picture-53.jpg v380>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x1000000202c:[<0x10000001fad/picture-53.jpg v380>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.705 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.346+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002002 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-67.jpg auth v258 ap=1 s=61030 n(v0 rc2024-09-19T05:21:25.881607+0000 b61030 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c6b1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002002:[<0x10000001fad/picture-67.jpg v258>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000002002:[<0x10000001fad/picture-67.jpg v258>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.705 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.346+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fd0 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-17.xml auth v918 ap=1 s=23218 n(v0 rc2024-09-19T05:21:25.187819+0000 b23218 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55f17c6b2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fd0:[<0x10000001fad/article-17.xml v114>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fd0:[<0x10000001fad/article-17.xml v918>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.705 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:21:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:21:36.347+0000 7fbf9e9ab640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000203e [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-48.jpg auth v424 ap=1 s=60843 n(v0 rc2024-09-19T05:21:27.064166+0000 b60843 1=1+0)/n(v0 rc2024-09-19T05:21:27.052478+0000 b60843 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55f17c6b3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000203e:[<0x10000001fad/picture-48.jpg v424>,<0x10000000399/blog-64 v68694>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x1000000203e:[<0x10000001fad/picture-48.jpg v424>,<0x10000000399/blog-64 v73483>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.756 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:36 smithi120 ceph-mon[30956]: pgmap v74: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 550 op/s 2024-09-19T05:21:36.906 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.607+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d72 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-13.jpg auth v340 ap=1 s=20751 n(v0 rc2024-09-19T05:21:19.124387+0000 b20751 1=1+0)/n(v0 rc2024-09-19T05:21:19.122927+0000 b20751 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d27a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d72:[<0x10000001d1d/picture-13.jpg v340>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d72:[<0x10000001d1d/picture-13.jpg v340>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.906 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.607+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d68 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-18.jpg auth v300 ap=1 s=9349 n(v0 rc2024-09-19T05:21:19.065192+0000 b9349 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d27ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d68:[<0x10000001d1d/picture-18.jpg v300>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d68:[<0x10000001d1d/picture-18.jpg v300>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.906 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.607+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d66 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-19.jpg auth v292 ap=1 s=37936 n(v0 rc2024-09-19T05:21:19.055459+0000 b37936 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d27b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d66:[<0x10000001d1d/picture-19.jpg v292>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d66:[<0x10000001d1d/picture-19.jpg v292>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.906 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.607+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d88 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-4.jpg auth v424 ap=1 s=49919 n(v0 rc2024-09-19T05:21:19.286222+0000 b49919 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d27b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d88:[<0x10000001d1d/picture-4.jpg v424>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d88:[<0x10000001d1d/picture-4.jpg v424>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.906 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.607+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d44 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-35.jpg auth v162 ap=1 s=57167 n(v0 rc2024-09-19T05:21:18.831355+0000 b57167 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d27bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d44:[<0x10000001d1d/picture-35.jpg v162>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d44:[<0x10000001d1d/picture-35.jpg v162>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.906 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.608+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d70 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-14.jpg auth v332 ap=1 s=59730 n(v0 rc2024-09-19T05:21:19.114801+0000 b59730 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d27c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d70:[<0x10000001d1d/picture-14.jpg v332>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d70:[<0x10000001d1d/picture-14.jpg v332>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.906 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.608+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d80 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-7.jpg auth v398 ap=1 s=60985 n(v0 rc2024-09-19T05:21:19.245032+0000 b60985 1=1+0)/n(v0 rc2024-09-19T05:21:19.244112+0000 b60985 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d27cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d80:[<0x10000001d1d/picture-7.jpg v398>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d80:[<0x10000001d1d/picture-7.jpg v398>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.906 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.608+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d8c [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-2.jpg auth v440 ap=1 s=52715 n(v0 rc2024-09-19T05:21:19.305016+0000 b52715 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d27c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d8c:[<0x10000001d1d/picture-2.jpg v440>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d8c:[<0x10000001d1d/picture-2.jpg v440>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.907 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.608+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d7c [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-9.jpg auth v378 ap=1 s=43984 n(v0 rc2024-09-19T05:21:19.198861+0000 b43984 1=1+0)/n(v0 rc2024-09-19T05:21:19.197416+0000 b43984 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d27d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d7c:[<0x10000001d1d/picture-9.jpg v378>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d7c:[<0x10000001d1d/picture-9.jpg v378>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.907 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.608+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d79 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-10.jpg auth v368 ap=1 s=16371 n(v0 rc2024-09-19T05:21:19.176233+0000 b16371 1=1+0)/n(v0 rc2024-09-19T05:21:19.174926+0000 b16371 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d27d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d79:[<0x10000001d1d/picture-10.jpg v368>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d79:[<0x10000001d1d/picture-10.jpg v368>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.907 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.608+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d8f [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-1.jpg auth v448 ap=1 s=28208 n(v0 rc2024-09-19T05:21:19.316536+0000 b28208 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@3},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d262000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d8f:[<0x10000001d1d/picture-1.jpg v448>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d8f:[<0x10000001d1d/picture-1.jpg v448>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.909 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.608+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d82 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-6.jpg auth v408 ap=1 s=26785 n(v0 rc2024-09-19T05:21:19.267238+0000 b26785 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d262580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d82:[<0x10000001d1d/picture-6.jpg v408>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d82:[<0x10000001d1d/picture-6.jpg v408>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.909 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.609+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d6a [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-17.jpg auth v308 ap=1 s=14627 n(v0 rc2024-09-19T05:21:19.078676+0000 b14627 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d263600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d6a:[<0x10000001d1d/picture-17.jpg v308>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d6a:[<0x10000001d1d/picture-17.jpg v308>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.909 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.609+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d55 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-28.jpg auth v218 ap=1 s=21259 n(v0 rc2024-09-19T05:21:18.930842+0000 b21259 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d262b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d55:[<0x10000001d1d/picture-28.jpg v218>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d55:[<0x10000001d1d/picture-28.jpg v218>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.910 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.609+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d5d [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-24.jpg auth v252 ap=1 s=46260 n(v0 rc2024-09-19T05:21:18.994619+0000 b46260 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d263b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d5d:[<0x10000001d1d/picture-24.jpg v252>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d5d:[<0x10000001d1d/picture-24.jpg v252>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.910 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.609+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d4a [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-33.jpg auth v178 ap=1 s=44751 n(v0 rc2024-09-19T05:21:18.865592+0000 b44751 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d264100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d4a:[<0x10000001d1d/picture-33.jpg v178>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d4a:[<0x10000001d1d/picture-33.jpg v178>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.910 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.609+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d40 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-37.jpg auth v146 ap=1 s=57713 n(v0 rc2024-09-19T05:21:18.800470+0000 b57713 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d263080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d40:[<0x10000001d1d/picture-37.jpg v146>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d40:[<0x10000001d1d/picture-37.jpg v146>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.910 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.610+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d36 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-42.jpg auth v106 ap=1 s=60905 n(v0 rc2024-09-19T05:21:18.733087+0000 b60905 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d264680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d36:[<0x10000001d1d/picture-42.jpg v106>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d36:[<0x10000001d1d/picture-42.jpg v106>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.910 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.610+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d5b [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-25.jpg auth v244 ap=1 s=33546 n(v0 rc2024-09-19T05:21:18.980952+0000 b33546 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d265180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d5b:[<0x10000001d1d/picture-25.jpg v244>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d5b:[<0x10000001d1d/picture-25.jpg v244>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.910 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.610+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d3c [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-39.jpg auth v130 ap=1 s=41777 n(v0 rc2024-09-19T05:21:18.772370+0000 b41777 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d264c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d3c:[<0x10000001d1d/picture-39.jpg v130>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d3c:[<0x10000001d1d/picture-39.jpg v130>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.910 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.610+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d7e [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-8.jpg auth v388 ap=1 s=14482 n(v0 rc2024-09-19T05:21:19.222476+0000 b14482 1=1+0)/n(v0 rc2024-09-19T05:21:19.221388+0000 b14482 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d458580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d7e:[<0x10000001d1d/picture-8.jpg v388>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d7e:[<0x10000001d1d/picture-8.jpg v388>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.910 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.610+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d4e [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-31.jpg auth v194 ap=1 s=14985 n(v0 rc2024-09-19T05:21:18.887911+0000 b14985 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d265700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d4e:[<0x10000001d1d/picture-31.jpg v194>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d4e:[<0x10000001d1d/picture-31.jpg v194>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.910 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.611+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d28 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-49.jpg auth v48 ap=1 s=54436 n(v0 rc2024-09-19T05:21:18.640314+0000 b54436 1=1+0)/n(v0 rc2024-09-19T05:21:18.638225+0000 b54436 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d458000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d28:[<0x10000001d1d/picture-49.jpg v48>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d28:[<0x10000001d1d/picture-49.jpg v48>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.910 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.611+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d58 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-26.jpg auth v234 ap=1 s=54518 n(v0 rc2024-09-19T05:21:18.958812+0000 b54518 1=1+0)/n(v0 rc2024-09-19T05:21:18.956620+0000 b54518 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d458b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d58:[<0x10000001d1d/picture-26.jpg v234>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d58:[<0x10000001d1d/picture-26.jpg v234>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.911 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.611+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d53 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-29.jpg auth v210 ap=1 s=27983 n(v0 rc2024-09-19T05:21:18.915310+0000 b27983 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d459080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d53:[<0x10000001d1d/picture-29.jpg v210>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d53:[<0x10000001d1d/picture-29.jpg v210>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.911 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.611+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d86 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-5.jpg auth v416 ap=1 s=52377 n(v0 rc2024-09-19T05:21:19.279490+0000 b52377 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d459600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d86:[<0x10000001d1d/picture-5.jpg v416>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d86:[<0x10000001d1d/picture-5.jpg v416>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.911 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.611+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d24 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-51.jpg auth v32 ap=1 s=21791 n(v0 rc2024-09-19T05:21:18.609318+0000 b21791 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d45a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d24:[<0x10000001d1d/picture-51.jpg v32>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d24:[<0x10000001d1d/picture-51.jpg v32>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.911 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.611+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d26 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-50.jpg auth v40 ap=1 s=39348 n(v0 rc2024-09-19T05:21:18.629031+0000 b39348 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d459b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d26:[<0x10000001d1d/picture-50.jpg v40>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d26:[<0x10000001d1d/picture-50.jpg v40>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.911 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.612+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d2e [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-46.jpg auth v74 ap=1 s=47378 n(v0 rc2024-09-19T05:21:18.682994+0000 b47378 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d45a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d2e:[<0x10000001d1d/picture-46.jpg v74>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d2e:[<0x10000001d1d/picture-46.jpg v74>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.911 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.612+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d8a [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-3.jpg auth v432 ap=1 s=37703 n(v0 rc2024-09-19T05:21:19.293494+0000 b37703 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d45ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d8a:[<0x10000001d1d/picture-3.jpg v432>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d8a:[<0x10000001d1d/picture-3.jpg v432>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.911 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.612+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d77 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-11.jpg auth v358 ap=1 s=32280 n(v0 rc2024-09-19T05:21:19.161833+0000 b32280 1=1+0)/n(v0 rc2024-09-19T05:21:19.159421+0000 b32280 1=1+0) (ifile excl) caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d45b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d77:[<0x10000001d1d/picture-11.jpg v358>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d77:[<0x10000001d1d/picture-11.jpg v358>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.911 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.612+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d3a [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-40.jpg auth v122 ap=1 s=40124 n(v0 rc2024-09-19T05:21:18.757825+0000 b40124 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d45b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d3a:[<0x10000001d1d/picture-40.jpg v122>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d3a:[<0x10000001d1d/picture-40.jpg v122>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.911 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.612+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d5e [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-23.jpg auth v260 ap=1 s=27542 n(v0 rc2024-09-19T05:21:19.011160+0000 b27542 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d5b0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d5e:[<0x10000001d1d/picture-23.jpg v260>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d5e:[<0x10000001d1d/picture-23.jpg v260>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.911 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.612+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d30 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-45.jpg auth v82 ap=1 s=35715 n(v0 rc2024-09-19T05:21:18.695504+0000 b35715 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d5b0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d30:[<0x10000001d1d/picture-45.jpg v82>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d30:[<0x10000001d1d/picture-45.jpg v82>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.912 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.613+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d38 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-41.jpg auth v114 ap=1 s=17160 n(v0 rc2024-09-19T05:21:18.741411+0000 b17160 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d5b0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d38:[<0x10000001d1d/picture-41.jpg v114>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d38:[<0x10000001d1d/picture-41.jpg v114>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.912 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.613+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d60 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-22.jpg auth v268 ap=1 s=45330 n(v0 rc2024-09-19T05:21:19.022257+0000 b45330 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d5b1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d60:[<0x10000001d1d/picture-22.jpg v268>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d60:[<0x10000001d1d/picture-22.jpg v268>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.912 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.613+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d6e [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-15.jpg auth v324 ap=1 s=36033 n(v0 rc2024-09-19T05:21:19.101265+0000 b36033 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d5b1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d6e:[<0x10000001d1d/picture-15.jpg v324>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d6e:[<0x10000001d1d/picture-15.jpg v324>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.912 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.613+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d2c [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-47.jpg auth v66 ap=1 s=22534 n(v0 rc2024-09-19T05:21:18.668641+0000 b22534 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d5b1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d2c:[<0x10000001d1d/picture-47.jpg v66>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d2c:[<0x10000001d1d/picture-47.jpg v66>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.912 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.613+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d74 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-12.jpg auth v350 ap=1 s=56401 n(v0 rc2024-09-19T05:21:19.147216+0000 b56401 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d5b2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d74:[<0x10000001d1d/picture-12.jpg v350>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d74:[<0x10000001d1d/picture-12.jpg v350>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.912 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.613+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d32 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-44.jpg auth v90 ap=1 s=28200 n(v0 rc2024-09-19T05:21:18.706610+0000 b28200 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d5b2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d32:[<0x10000001d1d/picture-44.jpg v90>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d32:[<0x10000001d1d/picture-44.jpg v90>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.912 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.614+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d62 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-21.jpg auth v276 ap=1 s=56929 n(v0 rc2024-09-19T05:21:19.033535+0000 b56929 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d5b2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d62:[<0x10000001d1d/picture-21.jpg v276>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d62:[<0x10000001d1d/picture-21.jpg v276>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.912 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.614+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d50 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-30.jpg auth v202 ap=1 s=53357 n(v0 rc2024-09-19T05:21:18.903338+0000 b53357 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d5b3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d50:[<0x10000001d1d/picture-30.jpg v202>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d50:[<0x10000001d1d/picture-30.jpg v202>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.912 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.614+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d42 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-36.jpg auth v154 ap=1 s=16038 n(v0 rc2024-09-19T05:21:18.812826+0000 b16038 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d5b3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d42:[<0x10000001d1d/picture-36.jpg v154>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d42:[<0x10000001d1d/picture-36.jpg v154>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.912 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.614+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d34 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-43.jpg auth v98 ap=1 s=60200 n(v0 rc2024-09-19T05:21:18.723164+0000 b60200 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d26e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d34:[<0x10000001d1d/picture-43.jpg v98>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d34:[<0x10000001d1d/picture-43.jpg v98>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.912 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.614+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d64 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-20.jpg auth v284 ap=1 s=9100 n(v0 rc2024-09-19T05:21:19.042143+0000 b9100 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d26e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d64:[<0x10000001d1d/picture-20.jpg v284>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d64:[<0x10000001d1d/picture-20.jpg v284>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.912 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.614+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d3e [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-38.jpg auth v138 ap=1 s=30429 n(v0 rc2024-09-19T05:21:18.783680+0000 b30429 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d26eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d3e:[<0x10000001d1d/picture-38.jpg v138>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d3e:[<0x10000001d1d/picture-38.jpg v138>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.913 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.615+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d56 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-27.jpg auth v226 ap=1 s=43518 n(v0 rc2024-09-19T05:21:18.947302+0000 b43518 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d26f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d56:[<0x10000001d1d/picture-27.jpg v226>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d56:[<0x10000001d1d/picture-27.jpg v226>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.913 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.615+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d22 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-52.jpg auth v24 ap=1 s=62139 n(v0 rc2024-09-19T05:21:18.600782+0000 b62139 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d26f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d22:[<0x10000001d1d/picture-52.jpg v24>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d22:[<0x10000001d1d/picture-52.jpg v24>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.913 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.615+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d48 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-34.jpg auth v170 ap=1 s=36208 n(v0 rc2024-09-19T05:21:18.842996+0000 b36208 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d270100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d48:[<0x10000001d1d/picture-34.jpg v170>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d48:[<0x10000001d1d/picture-34.jpg v170>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.913 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.615+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d1e [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-1.xml auth v8 ap=1 s=1065 n(v0 rc2024-09-19T05:21:18.571264+0000 b1065 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@3},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d26fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d1e:[<0x10000001d1d/article-1.xml v8>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d1e:[<0x10000001d1d/article-1.xml v8>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.913 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.615+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d20 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-53.jpg auth v16 ap=1 s=42985 n(v0 rc2024-09-19T05:21:18.587944+0000 b42985 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d270680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d20:[<0x10000001d1d/picture-53.jpg v16>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d20:[<0x10000001d1d/picture-53.jpg v16>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.913 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.616+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d6c [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-16.jpg auth v316 ap=1 s=33034 n(v0 rc2024-09-19T05:21:19.091776+0000 b33034 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@1},l=15168(-1) | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d270c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d6c:[<0x10000001d1d/picture-16.jpg v316>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d6c:[<0x10000001d1d/picture-16.jpg v316>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.913 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.616+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d2a [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-48.jpg auth v58 ap=1 s=62380 n(v0 rc2024-09-19T05:21:18.659376+0000 b62380 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d271700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d2a:[<0x10000001d1d/picture-48.jpg v58>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d2a:[<0x10000001d1d/picture-48.jpg v58>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.913 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.616+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d4c [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-32.jpg auth v186 ap=1 s=27540 n(v0 rc2024-09-19T05:21:18.875786+0000 b27540 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@1},l=15168 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d271180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d4c:[<0x10000001d1d/picture-32.jpg v186>,<0x10000000399/blog-58 v60389>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001d4c:[<0x10000001d1d/picture-32.jpg v186>,<0x10000000399/blog-58 v73685>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.914 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.626+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001edf [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-64.xml auth v1282 ap=1 s=1255 n(v0 rc2024-09-19T05:21:21.572436+0000 b1255 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d71f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001edf:[<0x10000001eda/article-64.xml v1282>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001edf:[<0x10000001eda/article-64.xml v1282>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.914 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.627+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f1c [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-37.xml auth v1214 ap=1 s=23891 n(v0 rc2024-09-19T05:21:22.192643+0000 b23891 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d71f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f1c:[<0x10000001eda/article-37.xml v1214>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f1c:[<0x10000001eda/article-37.xml v1214>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.914 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.627+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fa9 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-27.jpg auth v1178 ap=1 s=19756 n(v0 rc2024-09-19T05:21:24.621673+0000 b19756 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d71fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fa9:[<0x10000001eda/picture-27.jpg v1178>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fa9:[<0x10000001eda/picture-27.jpg v1178>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.916 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T05:21:36.922 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.627+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f18 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-39.xml auth v252 ap=1 s=14358 n(v0 rc2024-09-19T05:21:22.144388+0000 b14358 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d720100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f18:[<0x10000001eda/article-39.xml v252>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f18:[<0x10000001eda/article-39.xml v252>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.922 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.628+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f1e [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-36.xml auth v280 ap=1 s=19732 n(v0 rc2024-09-19T05:21:22.223769+0000 b19732 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d720680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f1e:[<0x10000001eda/article-36.xml v280>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f1e:[<0x10000001eda/article-36.xml v280>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.922 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.628+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f52 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-12.xml auth v500 ap=1 s=9367 n(v0 rc2024-09-19T05:21:22.994994+0000 b9367 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d720c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f52:[<0x10000001eda/article-12.xml v500>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f52:[<0x10000001eda/article-12.xml v500>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.922 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.628+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f76 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-52.jpg auth v638 ap=1 s=31707 n(v0 rc2024-09-19T05:21:23.571415+0000 b31707 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d721180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f76:[<0x10000001eda/picture-52.jpg v638>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f76:[<0x10000001eda/picture-52.jpg v638>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.922 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.628+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f6e [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-1.xml auth v1096 ap=1 s=29121 n(v0 rc2024-09-19T05:21:23.387038+0000 b29121 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d721700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f6e:[<0x10000001eda/article-1.xml v1096>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f6e:[<0x10000001eda/article-1.xml v1096>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.922 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.628+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f9c [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-34.jpg auth v1192 ap=1 s=52169 n(v0 rc2024-09-19T05:21:24.326705+0000 b52169 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d726000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f9c:[<0x10000001eda/picture-34.jpg v1192>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f9c:[<0x10000001eda/picture-34.jpg v1192>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.922 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.629+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f74 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-53.jpg auth v630 ap=1 s=46620 n(v0 rc2024-09-19T05:21:23.529740+0000 b46620 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d726580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f74:[<0x10000001eda/picture-53.jpg v630>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f74:[<0x10000001eda/picture-53.jpg v630>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.922 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.629+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001edb [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-66.xml auth v8 ap=1 s=5982 n(v0 rc2024-09-19T05:21:21.541101+0000 b5982 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@3},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d726b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001edb:[<0x10000001eda/article-66.xml v8>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001edb:[<0x10000001eda/article-66.xml v8>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.922 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.629+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fcb [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-16.jpg auth v1126 ap=1 s=12490 n(v0 rc2024-09-19T05:21:25.129581+0000 b12490 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d727080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fcb:[<0x10000001eda/picture-16.jpg v1126>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fcb:[<0x10000001eda/picture-16.jpg v1126>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.923 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.629+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f39 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-23.xml auth v1162 ap=1 s=21458 n(v0 rc2024-09-19T05:21:22.626249+0000 b21458 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d727600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f39:[<0x10000001eda/article-23.xml v1162>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f39:[<0x10000001eda/article-23.xml v1162>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.923 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.629+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f46 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-17.xml auth v1134 ap=1 s=6656 n(v0 rc2024-09-19T05:21:22.838218+0000 b6656 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d727b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f46:[<0x10000001eda/article-17.xml v1134>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f46:[<0x10000001eda/article-17.xml v1134>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.923 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.630+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fa0 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-32.jpg auth v818 ap=1 s=24290 n(v0 rc2024-09-19T05:21:24.435104+0000 b24290 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d728100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fa0:[<0x10000001eda/picture-32.jpg v818>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fa0:[<0x10000001eda/picture-32.jpg v818>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.923 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.630+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ee2 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-63.xml auth v1278 ap=1 s=5919 n(v0 rc2024-09-19T05:21:21.595293+0000 b5919 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d728680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ee2:[<0x10000001eda/article-63.xml v1278>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ee2:[<0x10000001eda/article-63.xml v1278>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.923 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.630+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f7d [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-48.jpg auth v672 ap=1 s=32291 n(v0 rc2024-09-19T05:21:23.737749+0000 b32291 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d728c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f7d:[<0x10000001eda/picture-48.jpg v672>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f7d:[<0x10000001eda/picture-48.jpg v672>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.923 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.630+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fbc [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-21.jpg auth v1148 ap=1 s=60548 n(v0 rc2024-09-19T05:21:24.917132+0000 b60548 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d729700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fbc:[<0x10000001eda/picture-21.jpg v1148>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fbc:[<0x10000001eda/picture-21.jpg v1148>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.923 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.631+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f20 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-35.xml auth v1202 ap=1 s=7778 n(v0 rc2024-09-19T05:21:22.238520+0000 b7778 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8c2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f20:[<0x10000001eda/article-35.xml v1202>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f20:[<0x10000001eda/article-35.xml v1202>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.923 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.631+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fa4 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-30.jpg auth v834 ap=1 s=16345 n(v0 rc2024-09-19T05:21:24.507784+0000 b16345 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8c2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fa4:[<0x10000001eda/picture-30.jpg v834>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fa4:[<0x10000001eda/picture-30.jpg v834>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.923 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.632+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f16 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-40.xml auth v1220 ap=1 s=15747 n(v0 rc2024-09-19T05:21:22.124992+0000 b15747 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8c2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f16:[<0x10000001eda/article-40.xml v1220>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f16:[<0x10000001eda/article-40.xml v1220>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.923 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.633+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f98 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-36.jpg auth v1206 ap=1 s=17094 n(v0 rc2024-09-19T05:21:24.243115+0000 b17094 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8c3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f98:[<0x10000001eda/picture-36.jpg v1206>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f98:[<0x10000001eda/picture-36.jpg v1206>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.923 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.633+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f4a [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-15.xml auth v1124 ap=1 s=8074 n(v0 rc2024-09-19T05:21:22.911724+0000 b8074 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8c3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f4a:[<0x10000001eda/article-15.xml v1124>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f4a:[<0x10000001eda/article-15.xml v1124>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.923 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.633+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f88 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-43.jpg auth v1230 ap=1 s=17278 n(v0 rc2024-09-19T05:21:23.929691+0000 b17278 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8c3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f88:[<0x10000001eda/picture-43.jpg v1230>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f88:[<0x10000001eda/picture-43.jpg v1230>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.924 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.633+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f42 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-19.xml auth v436 ap=1 s=18119 n(v0 rc2024-09-19T05:21:22.769638+0000 b18119 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8c4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f42:[<0x10000001eda/article-19.xml v436>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f42:[<0x10000001eda/article-19.xml v436>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.924 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.633+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fbe [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-20.jpg auth v1144 ap=1 s=39483 n(v0 rc2024-09-19T05:21:24.958569+0000 b39483 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8c4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fbe:[<0x10000001eda/picture-20.jpg v1144>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fbe:[<0x10000001eda/picture-20.jpg v1144>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.924 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.633+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f0f [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-42.xml auth v1226 ap=1 s=11400 n(v0 rc2024-09-19T05:21:22.061537+0000 b11400 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8c4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f0f:[<0x10000001eda/article-42.xml v1226>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f0f:[<0x10000001eda/article-42.xml v1226>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.924 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.634+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f94 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-38.jpg auth v760 ap=1 s=42873 n(v0 rc2024-09-19T05:21:24.156587+0000 b42873 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8c5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f94:[<0x10000001eda/picture-38.jpg v760>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f94:[<0x10000001eda/picture-38.jpg v760>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.924 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.634+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fb6 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-23.jpg auth v1160 ap=1 s=32401 n(v0 rc2024-09-19T05:21:24.828079+0000 b32401 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8c5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fb6:[<0x10000001eda/picture-23.jpg v1160>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fb6:[<0x10000001eda/picture-23.jpg v1160>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.924 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.634+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f4c [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-14.xml auth v484 ap=1 s=21261 n(v0 rc2024-09-19T05:21:22.948938+0000 b21261 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8cc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f4c:[<0x10000001eda/article-14.xml v484>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f4c:[<0x10000001eda/article-14.xml v484>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.924 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.634+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f85 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-45.jpg auth v1234 ap=1 s=18091 n(v0 rc2024-09-19T05:21:23.857288+0000 b18091 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8cc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f85:[<0x10000001eda/picture-45.jpg v1234>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f85:[<0x10000001eda/picture-45.jpg v1234>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.924 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.634+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f8d [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-41.jpg auth v736 ap=1 s=42897 n(v0 rc2024-09-19T05:21:24.038052+0000 b42897 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@2},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8ccb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f8d:[<0x10000001eda/picture-41.jpg v736>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f8d:[<0x10000001eda/picture-41.jpg v736>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.924 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.634+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f07 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-46.xml auth v190 ap=1 s=26673 n(v0 rc2024-09-19T05:21:21.974724+0000 b26673 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8cd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f07:[<0x10000001eda/article-46.xml v190>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f07:[<0x10000001eda/article-46.xml v190>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.924 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.635+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f06 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-47.xml auth v1242 ap=1 s=8897 n(v0 rc2024-09-19T05:21:21.946786+0000 b8897 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8cd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f06:[<0x10000001eda/article-47.xml v1242>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f06:[<0x10000001eda/article-47.xml v1242>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.924 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.635+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fb9 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-22.jpg auth v908 ap=1 s=21347 n(v0 rc2024-09-19T05:21:24.878073+0000 b21347 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8cdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fb9:[<0x10000001eda/picture-22.jpg v908>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fb9:[<0x10000001eda/picture-22.jpg v908>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.925 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.635+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f54 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-11.xml auth v1122 ap=1 s=4794 n(v0 rc2024-09-19T05:21:23.018167+0000 b4794 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8ce100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f54:[<0x10000001eda/article-11.xml v1122>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f54:[<0x10000001eda/article-11.xml v1122>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.925 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.635+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f48 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-16.xml auth v1130 ap=1 s=14228 n(v0 rc2024-09-19T05:21:22.873710+0000 b14228 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8ce680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f48:[<0x10000001eda/article-16.xml v1130>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f48:[<0x10000001eda/article-16.xml v1130>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.925 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.636+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ef8 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-54.xml auth v120 ap=1 s=12580 n(v0 rc2024-09-19T05:21:21.808489+0000 b12580 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8cec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ef8:[<0x10000001eda/article-54.xml v120>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ef8:[<0x10000001eda/article-54.xml v120>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.925 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.636+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f33 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-26.xml auth v1176 ap=1 s=18164 n(v0 rc2024-09-19T05:21:22.517722+0000 b18164 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8cf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f33:[<0x10000001eda/article-26.xml v1176>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f33:[<0x10000001eda/article-26.xml v1176>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.925 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.636+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fcf [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-15.jpg auth v972 ap=1 s=25103 n(v0 rc2024-09-19T05:21:25.182083+0000 b25103 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8cf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fcf:[<0x10000001eda/picture-15.jpg v972>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fcf:[<0x10000001eda/picture-15.jpg v972>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.925 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.636+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f7f [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-47.jpg auth v680 ap=1 s=16352 n(v0 rc2024-09-19T05:21:23.768143+0000 b16352 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8d6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f7f:[<0x10000001eda/picture-47.jpg v680>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f7f:[<0x10000001eda/picture-47.jpg v680>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.925 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.636+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f57 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-10.xml auth v518 ap=1 s=2172 n(v0 rc2024-09-19T05:21:23.064286+0000 b2172 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@2},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8d6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f57:[<0x10000001eda/article-10.xml v518>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f57:[<0x10000001eda/article-10.xml v518>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.925 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.636+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fd9 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-12.jpg auth v996 ap=1 s=58173 n(v0 rc2024-09-19T05:21:25.327946+0000 b58173 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8d6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fd9:[<0x10000001eda/picture-12.jpg v996>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fd9:[<0x10000001eda/picture-12.jpg v996>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.925 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.637+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f04 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-48.xml auth v172 ap=1 s=4657 n(v0 rc2024-09-19T05:21:21.931888+0000 b4657 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8d7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f04:[<0x10000001eda/article-48.xml v172>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f04:[<0x10000001eda/article-48.xml v172>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.926 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.637+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f87 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-44.jpg auth v708 ap=1 s=10393 n(v0 rc2024-09-19T05:21:23.902199+0000 b10393 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8d7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f87:[<0x10000001eda/picture-44.jpg v708>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f87:[<0x10000001eda/picture-44.jpg v708>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.926 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.637+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f67 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-4.xml auth v1110 ap=1 s=9366 n(v0 rc2024-09-19T05:21:23.259142+0000 b9366 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8d7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f67:[<0x10000001eda/article-4.xml v1110>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f67:[<0x10000001eda/article-4.xml v1110>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.926 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.637+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f35 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-25.xml auth v1172 ap=1 s=30760 n(v0 rc2024-09-19T05:21:22.554725+0000 b30760 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8d8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f35:[<0x10000001eda/article-25.xml v1172>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f35:[<0x10000001eda/article-25.xml v1172>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.926 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.637+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ff3 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-3.jpg auth v1070 ap=1 s=54473 n(v0 rc2024-09-19T05:21:25.667831+0000 b54473 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8d8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ff3:[<0x10000001eda/picture-3.jpg v1070>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ff3:[<0x10000001eda/picture-3.jpg v1070>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.926 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.637+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f1a [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-38.xml auth v1218 ap=1 s=23866 n(v0 rc2024-09-19T05:21:22.166029+0000 b23866 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8d8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f1a:[<0x10000001eda/article-38.xml v1218>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f1a:[<0x10000001eda/article-38.xml v1218>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.926 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.638+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f70 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-55.jpg auth v1256 ap=1 s=22577 n(v0 rc2024-09-19T05:21:23.437230+0000 b22577 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8d9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f70:[<0x10000001eda/picture-55.jpg v1256>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f70:[<0x10000001eda/picture-55.jpg v1256>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.926 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.638+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fdc [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-11.jpg auth v1004 ap=1 s=40756 n(v0 rc2024-09-19T05:21:25.372908+0000 b40756 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d8d9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fdc:[<0x10000001eda/picture-11.jpg v1004>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fdc:[<0x10000001eda/picture-11.jpg v1004>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.926 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.638+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f65 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-5.xml auth v1114 ap=1 s=12445 n(v0 rc2024-09-19T05:21:23.219875+0000 b12445 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d748000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f65:[<0x10000001eda/article-5.xml v1114>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f65:[<0x10000001eda/article-5.xml v1114>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.926 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.639+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f22 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-34.xml auth v1196 ap=1 s=32257 n(v0 rc2024-09-19T05:21:22.270478+0000 b32257 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d748580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f22:[<0x10000001eda/article-34.xml v1196>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f22:[<0x10000001eda/article-34.xml v1196>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.926 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.639+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f2c [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-29.xml auth v342 ap=1 s=29414 n(v0 rc2024-09-19T05:21:22.410507+0000 b29414 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d748b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f2c:[<0x10000001eda/article-29.xml v342>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f2c:[<0x10000001eda/article-29.xml v342>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.927 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.639+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eeb [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-60.xml auth v1268 ap=1 s=14636 n(v0 rc2024-09-19T05:21:21.677997+0000 b14636 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d749080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eeb:[<0x10000001eda/article-60.xml v1268>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001eeb:[<0x10000001eda/article-60.xml v1268>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.927 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.639+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f8e [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-40.jpg auth v744 ap=1 s=31737 n(v0 rc2024-09-19T05:21:24.083133+0000 b31737 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d749600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f8e:[<0x10000001eda/picture-40.jpg v744>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f8e:[<0x10000001eda/picture-40.jpg v744>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.927 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.640+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f3c [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-22.xml auth v1156 ap=1 s=6577 n(v0 rc2024-09-19T05:21:22.665236+0000 b6577 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d749b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f3c:[<0x10000001eda/article-22.xml v1156>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f3c:[<0x10000001eda/article-22.xml v1156>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.927 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.640+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f02 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-49.xml auth v1246 ap=1 s=26215 n(v0 rc2024-09-19T05:21:21.905877+0000 b26215 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d74a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f02:[<0x10000001eda/article-49.xml v1246>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f02:[<0x10000001eda/article-49.xml v1246>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.927 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.640+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f0d [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-43.xml auth v214 ap=1 s=23951 n(v0 rc2024-09-19T05:21:22.046491+0000 b23951 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d74a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f0d:[<0x10000001eda/article-43.xml v214>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f0d:[<0x10000001eda/article-43.xml v214>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.927 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.640+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f24 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-33.xml auth v308 ap=1 s=29050 n(v0 rc2024-09-19T05:21:22.303173+0000 b29050 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d74ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f24:[<0x10000001eda/article-33.xml v308>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f24:[<0x10000001eda/article-33.xml v308>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.927 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.641+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fee [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-5.jpg auth v1054 ap=1 s=8590 n(v0 rc2024-09-19T05:21:25.590749+0000 b8590 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d74b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fee:[<0x10000001eda/picture-5.jpg v1054>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fee:[<0x10000001eda/picture-5.jpg v1054>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.927 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.641+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f79 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-50.jpg auth v654 ap=1 s=14555 n(v0 rc2024-09-19T05:21:23.640912+0000 b14555 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d74b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f79:[<0x10000001eda/picture-50.jpg v654>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f79:[<0x10000001eda/picture-50.jpg v654>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.927 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.641+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ef3 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-57.xml auth v1260 ap=1 s=18964 n(v0 rc2024-09-19T05:21:21.747488+0000 b18964 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d754000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ef3:[<0x10000001eda/article-57.xml v1260>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ef3:[<0x10000001eda/article-57.xml v1260>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.927 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.641+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ef0 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-58.xml auth v1264 ap=1 s=23630 n(v0 rc2024-09-19T05:21:21.724421+0000 b23630 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d754580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ef0:[<0x10000001eda/article-58.xml v1264>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ef0:[<0x10000001eda/article-58.xml v1264>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.927 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.641+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001efa [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-53.xml auth v1250 ap=1 s=8074 n(v0 rc2024-09-19T05:21:21.821451+0000 b8074 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d754b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001efa:[<0x10000001eda/article-53.xml v1250>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001efa:[<0x10000001eda/article-53.xml v1250>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.927 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.641+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f2f [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-28.xml auth v1186 ap=1 s=3583 n(v0 rc2024-09-19T05:21:22.441906+0000 b3583 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d755080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f2f:[<0x10000001eda/article-28.xml v1186>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f2f:[<0x10000001eda/article-28.xml v1186>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.928 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.642+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001efc [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-52.xml auth v138 ap=1 s=7679 n(v0 rc2024-09-19T05:21:21.843339+0000 b7679 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d755600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001efc:[<0x10000001eda/article-52.xml v138>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001efc:[<0x10000001eda/article-52.xml v138>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.928 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.642+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f77 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-51.jpg auth v646 ap=1 s=62049 n(v0 rc2024-09-19T05:21:23.608341+0000 b62049 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d755b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f77:[<0x10000001eda/picture-51.jpg v646>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f77:[<0x10000001eda/picture-51.jpg v646>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.928 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.642+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f81 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-46.jpg auth v1238 ap=1 s=24669 n(v0 rc2024-09-19T05:21:23.802428+0000 b24669 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d756100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f81:[<0x10000001eda/picture-46.jpg v1238>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f81:[<0x10000001eda/picture-46.jpg v1238>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.928 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.642+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ef6 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-55.xml auth v1258 ap=1 s=15370 n(v0 rc2024-09-19T05:21:21.784585+0000 b15370 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d756680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ef6:[<0x10000001eda/article-55.xml v1258>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ef6:[<0x10000001eda/article-55.xml v1258>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.928 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.642+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fb0 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-25.jpg auth v1168 ap=1 s=43022 n(v0 rc2024-09-19T05:21:24.734729+0000 b43022 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d756c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fb0:[<0x10000001eda/picture-25.jpg v1168>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fb0:[<0x10000001eda/picture-25.jpg v1168>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.928 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.643+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f5d [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-8.xml auth v534 ap=1 s=7578 n(v0 rc2024-09-19T05:21:23.115672+0000 b7578 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d757180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f5d:[<0x10000001eda/article-8.xml v534>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f5d:[<0x10000001eda/article-8.xml v534>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.928 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.643+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fa2 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-31.jpg auth v826 ap=1 s=65329 n(v0 rc2024-09-19T05:21:24.474579+0000 b65329 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d757700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fa2:[<0x10000001eda/picture-31.jpg v826>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fa2:[<0x10000001eda/picture-31.jpg v826>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.928 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.643+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fe5 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-8.jpg auth v1118 ap=1 s=19042 n(v0 rc2024-09-19T05:21:25.482089+0000 b19042 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d762580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fe5:[<0x10000001eda/picture-8.jpg v1118>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fe5:[<0x10000001eda/picture-8.jpg v1118>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.928 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.643+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fac [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-26.jpg auth v1174 ap=1 s=14969 n(v0 rc2024-09-19T05:21:24.674548+0000 b14969 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d762b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fac:[<0x10000001eda/picture-26.jpg v1174>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fac:[<0x10000001eda/picture-26.jpg v1174>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.928 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.643+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f7b [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-49.jpg auth v1244 ap=1 s=22640 n(v0 rc2024-09-19T05:21:23.684766+0000 b22640 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d762000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f7b:[<0x10000001eda/picture-49.jpg v1244>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f7b:[<0x10000001eda/picture-49.jpg v1244>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.928 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.643+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f26 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-32.xml auth v1188 ap=1 s=9286 n(v0 rc2024-09-19T05:21:22.322987+0000 b9286 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d763080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f26:[<0x10000001eda/article-32.xml v1188>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f26:[<0x10000001eda/article-32.xml v1188>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.929 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.643+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f3e [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-21.xml auth v1152 ap=1 s=9175 n(v0 rc2024-09-19T05:21:22.703556+0000 b9175 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d763600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f3e:[<0x10000001eda/article-21.xml v1152>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f3e:[<0x10000001eda/article-21.xml v1152>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.929 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.644+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f00 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-50.xml auth v154 ap=1 s=21466 n(v0 rc2024-09-19T05:21:21.883589+0000 b21466 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d764680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f00:[<0x10000001eda/article-50.xml v154>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f00:[<0x10000001eda/article-50.xml v154>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.929 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.644+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f2a [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-30.xml auth v334 ap=1 s=21051 n(v0 rc2024-09-19T05:21:22.389471+0000 b21051 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@2},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d763b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f2a:[<0x10000001eda/article-30.xml v334>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f2a:[<0x10000001eda/article-30.xml v334>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.929 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.644+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f6b [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-2.xml auth v1104 ap=1 s=2706 n(v0 rc2024-09-19T05:21:23.337500+0000 b2706 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d765180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f6b:[<0x10000001eda/article-2.xml v1104>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f6b:[<0x10000001eda/article-2.xml v1104>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.929 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.644+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f4f [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-13.xml auth v492 ap=1 s=16619 n(v0 rc2024-09-19T05:21:22.973669+0000 b16619 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d764100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f4f:[<0x10000001eda/article-13.xml v492>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f4f:[<0x10000001eda/article-13.xml v492>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.929 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.644+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f61 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-6.xml auth v1116 ap=1 s=26132 n(v0 rc2024-09-19T05:21:23.175714+0000 b26132 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d764c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f61:[<0x10000001eda/article-6.xml v1116>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f61:[<0x10000001eda/article-6.xml v1116>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.929 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.644+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f72 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-54.jpg auth v1254 ap=1 s=50337 n(v0 rc2024-09-19T05:21:23.477968+0000 b50337 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d765700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f72:[<0x10000001eda/picture-54.jpg v1254>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f72:[<0x10000001eda/picture-54.jpg v1254>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.929 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.644+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fa6 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-29.jpg auth v842 ap=1 s=28056 n(v0 rc2024-09-19T05:21:24.543977+0000 b28056 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d76c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fa6:[<0x10000001eda/picture-29.jpg v842>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fa6:[<0x10000001eda/picture-29.jpg v842>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.929 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.645+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ef5 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-56.xml auth v102 ap=1 s=1952 n(v0 rc2024-09-19T05:21:21.768331+0000 b1952 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d76c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ef5:[<0x10000001eda/article-56.xml v102>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ef5:[<0x10000001eda/article-56.xml v102>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.929 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.645+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fdf [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-10.jpg auth v1012 ap=1 s=12158 n(v0 rc2024-09-19T05:21:25.409288+0000 b12158 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d76cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fdf:[<0x10000001eda/picture-10.jpg v1012>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fdf:[<0x10000001eda/picture-10.jpg v1012>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.929 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.645+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ff9 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-1.jpg auth v1094 ap=1 s=53932 n(v0 rc2024-09-19T05:21:25.749179+0000 b53932 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d76d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ff9:[<0x10000001eda/picture-1.jpg v1094>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ff9:[<0x10000001eda/picture-1.jpg v1094>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.929 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.645+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f5a [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-9.xml auth v526 ap=1 s=1824 n(v0 rc2024-09-19T05:21:23.090594+0000 b1824 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@2},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d76d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f5a:[<0x10000001eda/article-9.xml v526>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f5a:[<0x10000001eda/article-9.xml v526>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.930 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.645+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f0b [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-44.xml auth v206 ap=1 s=26460 n(v0 rc2024-09-19T05:21:22.017133+0000 b26460 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d76db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f0b:[<0x10000001eda/article-44.xml v206>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f0b:[<0x10000001eda/article-44.xml v206>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.930 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.645+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001feb [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-6.jpg auth v1046 ap=1 s=36690 n(v0 rc2024-09-19T05:21:25.562148+0000 b36690 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d76e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001feb:[<0x10000001eda/picture-6.jpg v1046>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001feb:[<0x10000001eda/picture-6.jpg v1046>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.930 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.645+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001edd [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-65.xml auth v16 ap=1 s=14339 n(v0 rc2024-09-19T05:21:21.557353+0000 b14339 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d76e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001edd:[<0x10000001eda/article-65.xml v16>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001edd:[<0x10000001eda/article-65.xml v16>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.930 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.646+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ee5 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-62.xml auth v1274 ap=1 s=22518 n(v0 rc2024-09-19T05:21:21.626729+0000 b22518 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d76ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ee5:[<0x10000001eda/article-62.xml v1274>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ee5:[<0x10000001eda/article-62.xml v1274>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.930 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.646+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f37 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-24.xml auth v390 ap=1 s=2352 n(v0 rc2024-09-19T05:21:22.595902+0000 b2352 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d76f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f37:[<0x10000001eda/article-24.xml v390>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f37:[<0x10000001eda/article-24.xml v390>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.930 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.646+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fa8 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-28.jpg auth v850 ap=1 s=46867 n(v0 rc2024-09-19T05:21:24.576679+0000 b46867 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d76f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fa8:[<0x10000001eda/picture-28.jpg v850>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fa8:[<0x10000001eda/picture-28.jpg v850>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.930 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.646+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f96 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-37.jpg auth v1210 ap=1 s=56981 n(v0 rc2024-09-19T05:21:24.196583+0000 b56981 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d77e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f96:[<0x10000001eda/picture-37.jpg v1210>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f96:[<0x10000001eda/picture-37.jpg v1210>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.930 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.646+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fc8 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-17.jpg auth v954 ap=1 s=30661 n(v0 rc2024-09-19T05:21:25.103066+0000 b30661 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d77e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fc8:[<0x10000001eda/picture-17.jpg v954>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fc8:[<0x10000001eda/picture-17.jpg v954>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.930 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.646+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f69 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-3.xml auth v1108 ap=1 s=21042 n(v0 rc2024-09-19T05:21:23.296033+0000 b21042 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d77eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f69:[<0x10000001eda/article-3.xml v1108>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f69:[<0x10000001eda/article-3.xml v1108>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.930 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.647+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fb3 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-24.jpg auth v1166 ap=1 s=17845 n(v0 rc2024-09-19T05:21:24.780351+0000 b17845 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d77f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fb3:[<0x10000001eda/picture-24.jpg v1166>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fb3:[<0x10000001eda/picture-24.jpg v1166>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.930 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.647+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f9e [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-33.jpg auth v1190 ap=1 s=52466 n(v0 rc2024-09-19T05:21:24.379978+0000 b52466 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d77f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f9e:[<0x10000001eda/picture-33.jpg v1190>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f9e:[<0x10000001eda/picture-33.jpg v1190>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.931 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.647+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f60 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-7.xml auth v542 ap=1 s=25832 n(v0 rc2024-09-19T05:21:23.143758+0000 b25832 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d77fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f60:[<0x10000001eda/article-7.xml v542>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f60:[<0x10000001eda/article-7.xml v542>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.931 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.647+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f8b [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-42.jpg auth v1224 ap=1 s=48016 n(v0 rc2024-09-19T05:21:23.985890+0000 b48016 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d780100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f8b:[<0x10000001eda/picture-42.jpg v1224>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f8b:[<0x10000001eda/picture-42.jpg v1224>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.931 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.647+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f91 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-39.jpg auth v752 ap=1 s=47930 n(v0 rc2024-09-19T05:21:24.120402+0000 b47930 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@3},l=15168 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d780680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f91:[<0x10000001eda/picture-39.jpg v752>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f91:[<0x10000001eda/picture-39.jpg v752>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.931 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.647+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eee [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-59.xml auth v74 ap=1 s=18801 n(v0 rc2024-09-19T05:21:21.705667+0000 b18801 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d780c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eee:[<0x10000001eda/article-59.xml v74>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001eee:[<0x10000001eda/article-59.xml v74>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.931 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.648+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fd6 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-13.jpg auth v988 ap=1 s=18157 n(v0 rc2024-09-19T05:21:25.271157+0000 b18157 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d781180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fd6:[<0x10000001eda/picture-13.jpg v988>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fd6:[<0x10000001eda/picture-13.jpg v988>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.931 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.648+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fc4 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-18.jpg auth v944 ap=1 s=54067 n(v0 rc2024-09-19T05:21:25.043149+0000 b54067 1=1+0)/n(v0 rc2024-09-19T05:21:25.038974+0000 b54067 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/Fxcb@2},l=15168 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d781700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fc4:[<0x10000001eda/picture-18.jpg v944>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fc4:[<0x10000001eda/picture-18.jpg v944>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.931 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.648+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f44 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-18.xml auth v1138 ap=1 s=32564 n(v0 rc2024-09-19T05:21:22.800668+0000 b32564 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d78c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f44:[<0x10000001eda/article-18.xml v1138>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f44:[<0x10000001eda/article-18.xml v1138>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.931 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.648+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fc1 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-19.jpg auth v1140 ap=1 s=23873 n(v0 rc2024-09-19T05:21:25.002118+0000 b23873 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d78c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fc1:[<0x10000001eda/picture-19.jpg v1140>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fc1:[<0x10000001eda/picture-19.jpg v1140>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.931 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.648+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001efe [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-51.xml auth v146 ap=1 s=13737 n(v0 rc2024-09-19T05:21:21.857783+0000 b13737 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d78cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001efe:[<0x10000001eda/article-51.xml v146>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001efe:[<0x10000001eda/article-51.xml v146>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.931 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.648+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f31 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-27.xml auth v1182 ap=1 s=21074 n(v0 rc2024-09-19T05:21:22.481884+0000 b21074 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d78d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f31:[<0x10000001eda/article-27.xml v1182>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f31:[<0x10000001eda/article-27.xml v1182>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.931 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.649+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ff1 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-4.jpg auth v1062 ap=1 s=50646 n(v0 rc2024-09-19T05:21:25.629652+0000 b50646 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d78d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ff1:[<0x10000001eda/picture-4.jpg v1062>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ff1:[<0x10000001eda/picture-4.jpg v1062>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.931 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.649+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ff6 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-2.jpg auth v1100 ap=1 s=21148 n(v0 rc2024-09-19T05:21:25.696757+0000 b21148 1=1+0) caps={15168=pAsLsXsFscr/-@2} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d78e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ff6:[<0x10000001eda/picture-2.jpg v1100>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ff6:[<0x10000001eda/picture-2.jpg v1100>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.932 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.649+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f40 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-20.xml auth v428 ap=1 s=9102 n(v0 rc2024-09-19T05:21:22.742774+0000 b9102 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d78e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f40:[<0x10000001eda/article-20.xml v428>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f40:[<0x10000001eda/article-20.xml v428>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.932 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.649+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f9a [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-35.jpg auth v1200 ap=1 s=24301 n(v0 rc2024-09-19T05:21:24.280801+0000 b24301 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d78db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f9a:[<0x10000001eda/picture-35.jpg v1200>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f9a:[<0x10000001eda/picture-35.jpg v1200>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.932 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.649+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f13 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-41.xml auth v1222 ap=1 s=32299 n(v0 rc2024-09-19T05:21:22.092160+0000 b32299 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d78f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f13:[<0x10000001eda/article-41.xml v1222>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f13:[<0x10000001eda/article-41.xml v1222>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.932 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.649+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fd3 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-14.jpg auth v980 ap=1 s=59382 n(v0 rc2024-09-19T05:21:25.223458+0000 b59382 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d78ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fd3:[<0x10000001eda/picture-14.jpg v980>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fd3:[<0x10000001eda/picture-14.jpg v980>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.932 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.649+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ee8 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-61.xml auth v1272 ap=1 s=23577 n(v0 rc2024-09-19T05:21:21.652527+0000 b23577 1=1+0) caps={15168=pAsLsXsFscr/-@3} | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d78f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ee8:[<0x10000001eda/article-61.xml v1272>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001ee8:[<0x10000001eda/article-61.xml v1272>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.932 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.650+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f09 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-45.xml auth v198 ap=1 s=20508 n(v0 rc2024-09-19T05:21:21.992382+0000 b20508 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@3},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d796000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f09:[<0x10000001eda/article-45.xml v198>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f09:[<0x10000001eda/article-45.xml v198>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.932 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.650+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fe8 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-7.jpg auth v1038 ap=1 s=40651 n(v0 rc2024-09-19T05:21:25.527520+0000 b40651 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d796580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fe8:[<0x10000001eda/picture-7.jpg v1038>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fe8:[<0x10000001eda/picture-7.jpg v1038>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.932 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.650+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f28 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-31.xml auth v326 ap=1 s=19520 n(v0 rc2024-09-19T05:21:22.364483+0000 b19520 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d796b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f28:[<0x10000001eda/article-31.xml v326>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001f28:[<0x10000001eda/article-31.xml v326>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:36.932 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:21:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:21:36.650+0000 7fe3e04cc640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001fe2 [4,head] /volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-9.jpg auth v1020 ap=1 s=30241 n(v0 rc2024-09-19T05:21:25.451443+0000 b30241 1=1+0) (ifile excl) cr={15168=0-4194304@3} caps={15168=pAsLsXsFsxcrwb/-@2},l=15168(-1) | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561d2d797080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001fe2:[<0x10000001eda/picture-9.jpg v1020>,<0x10000000399/blog-62 v67916>,<0x10000000208/blogtest_in v2982>,<0x10000000201/src v3029>,<0x10000000006/blogbench-1.0 v2750>,<0x10000000005/tmp v152>,<0x10000000003/client.0 v135>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v148>,<0x10000000001/sv_0 v157>,<0x10000000000/qa v145>,<0x1/volumes v138>]//[]","memoryvalue":"(3)0x10000001fe2:[<0x10000001eda/picture-9.jpg v1020>,<0x10000000399/blog-62 v73687>,<0x10000000208/blogtest_in v3123>,<0x10000000201/src v3032>,<0x10000000006/blogbench-1.0 v2753>,<0x10000000005/tmp v154>,<0x10000000003/client.0 v125>,<0x10000000002/a415fa0b-c3dd-4e11-a8fc-38d15375e70f v151>,<0x10000000001/sv_0 v160>,<0x10000000000/qa v148>,<0x1/volumes v140>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-19T05:21:37.293 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:21:37.450 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: scrub queued for path: / 2024-09-19T05:21:37.450 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T05:21:37.450 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: scrub summary: active paths [/] 2024-09-19T05:21:37.450 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: scrub summary: active paths [/] 2024-09-19T05:21:37.450 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T05:21:37.450 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: scrub summary: active paths [/] 2024-09-19T05:21:37.450 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e22 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.450 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e34 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.450 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001dc1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.450 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e2a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.450 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d76 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-44.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.451 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d9e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.451 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d52 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-62.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.451 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001dfa (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.451 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001de7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-37.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.451 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e11 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.451 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001dce (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.451 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e02 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.451 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001df0 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-33.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.451 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001dc4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.451 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001dd8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-42.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.451 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001de1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-39.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.451 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d59 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-59.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.451 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e1c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.452 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001dae (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.452 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e0f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.452 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e0e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.452 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d69 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-51.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.452 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d98 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.452 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e2e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.452 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001dec (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-35.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.452 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e32 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.452 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001da8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.452 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e19 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.452 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d54 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-61.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.452 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d7b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-41.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.452 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d75 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-45.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.453 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e28 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.453 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d90 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-31.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.453 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e24 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.453 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T05:21:37.453 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: scrub summary: active paths [/] 2024-09-19T05:21:37.453 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f5f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.453 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ed4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-79.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.453 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: scrub summary: active paths [/] 2024-09-19T05:21:37.453 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001eb1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-14.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.453 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f27 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-45.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.453 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f30 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-41.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.453 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f03 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-60.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.453 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e6e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-46.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.454 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ef7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-66.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.454 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ed2 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-80.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.454 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e6c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-47.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.454 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e3b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-71.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.454 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f62 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.454 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001eb7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.454 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ead (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-16.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.454 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e5f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-54.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.454 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e99 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-26.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.454 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f6f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.454 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f0c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-56.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.454 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f23 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-47.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.454 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001eb9 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.454 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f75 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.455 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f29 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-44.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.455 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e6a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-48.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.455 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ec5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.455 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e9b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-25.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.455 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ee7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-72.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.455 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f05 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-59.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.455 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e7e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-38.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.455 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f8a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.455 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f10 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-55.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.455 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f78 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.455 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001eed (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-70.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.455 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ec4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.455 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e86 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-34.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.456 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001eea (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-71.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.456 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e90 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.456 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e53 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-60.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.456 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001efd (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-63.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.456 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f32 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-40.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.456 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ea1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.456 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e68 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-49.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.456 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e55 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-59.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.456 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f6a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.456 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f73 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.456 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ea9 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.456 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e64 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-51.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.456 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f68 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.457 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ece (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-82.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.457 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e96 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.457 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f89 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.457 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f3d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-35.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.457 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f8c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.457 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e3d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-70.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.457 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ed7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-78.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.457 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f71 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.457 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e50 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-61.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.457 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ea5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.457 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e78 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-41.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.457 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e70 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-45.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.457 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f01 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-61.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.458 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e3f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-69.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.458 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f82 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.458 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001e8c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-31.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.458 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f7c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.458 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000000798 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7) see mds.i log and `damage ls` output for details 2024-09-19T05:21:37.458 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fa5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.458 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fc6 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.458 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fb5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.458 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001faf (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.458 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fbf (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.458 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fab (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.458 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fc9 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.458 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fb8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.459 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f9f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.459 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f97 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.459 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f95 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.459 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fb2 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.459 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f99 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.459 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fa1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.459 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fbb (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.459 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fc3 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.459 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001faa (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.459 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f9b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.459 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fa7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.459 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f9d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.459 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fa3 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.459 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002000 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-51.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.460 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x1000000204e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-27.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.460 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002064 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-20.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.460 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002020 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-41.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.460 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002013 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-45.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.460 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002042 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-31.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.460 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002016 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-44.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.460 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002057 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-24.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.460 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x1000000203f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-32.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.460 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002061 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-21.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.460 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002044 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-30.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.460 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002003 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-50.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.460 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x1000000201b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-43.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.460 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x1000000203c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-33.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.461 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x1000000204b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-28.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.461 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002039 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-34.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.461 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002048 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-29.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.461 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x1000000205e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-22.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.461 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002007 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-49.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.461 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002010 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-46.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.461 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x1000000200d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-47.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.461 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002051 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-26.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.461 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x1000000200a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-48.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.461 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002035 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-35.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.461 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002029 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-38.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.461 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002054 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-25.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.461 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002024 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-40.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.461 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x1000000201e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-42.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.462 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x1000000202e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-37.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.462 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002027 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-39.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.462 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002031 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-36.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.462 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x1000000205b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-23.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.462 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ff8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.462 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ffe (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.462 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fec (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.462 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fce (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.462 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fe3 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.462 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fd1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.462 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ff0 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.462 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002001 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.462 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fcd (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-18.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.463 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fb4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-27.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.463 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fc7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-20.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.463 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002015 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-61.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.463 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x1000000200c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-64.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.463 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fea (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-9.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.463 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fd5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.463 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fbd (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-24.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.463 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fda (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.463 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002060 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-37.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.463 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ffa (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-3.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.463 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fe6 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.463 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fef (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-7.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.463 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002021 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-57.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.463 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002052 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-42.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.464 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x1000000205a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-39.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.464 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fed (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-8.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.464 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x1000000203b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-49.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.466 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fc5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-21.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.466 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fde (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-13.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.466 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ff2 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-6.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.466 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ffc (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-2.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.466 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x1000000202a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-54.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.466 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002038 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-50.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.467 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x1000000201d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-58.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.467 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002008 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-65.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.467 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fb1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-28.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.467 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002034 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-51.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.467 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002012 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-62.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.467 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002046 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-46.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.467 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002026 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-55.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.467 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ff5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-5.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.467 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fae (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-29.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.467 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x1000000200f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-63.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.467 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002058 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-40.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.467 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fc2 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-22.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.467 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fdb (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-14.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.468 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002049 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-45.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.468 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ff4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.468 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002055 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-41.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.468 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ffb (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.468 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002005 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-66.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.468 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002018 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-60.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.468 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fdd (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.468 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fe4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-11.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.468 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fd4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-16.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.468 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fb7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-26.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.468 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002023 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-56.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.468 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fe0 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.468 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002041 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-47.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.469 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fe7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-10.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.469 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x1000000204d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-44.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.469 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fe9 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.469 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fba (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-25.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.469 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ff7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-4.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.469 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x1000000201a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-59.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.469 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fd8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-15.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.469 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002063 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-36.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.469 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x1000000204f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-43.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.469 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fca (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-19.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.469 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x1000000205d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-38.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.469 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x1000000202f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-52.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.469 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fe1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-12.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.469 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fff (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-1.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.470 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x1000000202c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-53.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.470 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000002002 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-67.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.470 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fd0 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-17.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.470 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x1000000203e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-48.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.470 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001b5f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-77.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.470 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T05:21:37.470 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: scrub summary: active paths [/] 2024-09-19T05:21:37.470 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T05:21:37.470 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: scrub summary: active paths [/] 2024-09-19T05:21:37.470 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000000c5b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14) see mds.i log and `damage ls` output for details 2024-09-19T05:21:37.470 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T05:21:37.470 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001de5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-37/picture-48.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.470 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f55 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-37/article-62.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.470 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d72 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.471 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d68 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.471 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d66 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.471 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d88 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.471 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d44 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-35.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.471 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d70 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.471 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d80 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.471 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d8c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.471 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d7c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.471 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d79 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.471 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d8f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.471 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d82 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.471 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d6a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.471 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d55 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.472 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d5d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.472 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d4a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-33.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.472 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d40 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-37.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.472 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d36 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-42.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.472 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d5b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-25.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.472 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d3c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-39.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.472 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d7e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.472 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d4e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-31.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.472 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d28 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-49.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.472 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d58 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-26.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.472 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d53 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-29.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.472 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d86 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.472 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d24 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-51.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.472 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d26 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-50.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.473 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d2e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-46.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.473 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d8a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.473 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d77 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.473 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d3a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-40.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.473 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d5e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.473 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d30 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-45.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.473 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d38 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-41.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.473 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d60 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.473 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d6e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.473 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d2c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-47.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.473 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d74 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.473 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d32 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-44.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.473 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d62 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.473 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d50 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-30.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.474 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d42 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-36.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.474 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d34 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-43.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.474 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d64 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-20.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.474 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d3e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-38.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.474 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d56 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.474 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d22 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-52.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.474 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d48 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-34.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.474 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d1e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.474 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d20 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-53.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.474 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d6c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.474 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d2a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-48.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.474 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001d4c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-32.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.474 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001edf (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-64.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.475 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f1c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-37.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.475 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fa9 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.475 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f18 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-39.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.475 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f1e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-36.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.475 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f52 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.475 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f76 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-52.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.475 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f6e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.475 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f9c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-34.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.475 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f74 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-53.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.475 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001edb (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-66.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.475 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fcb (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.475 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f39 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.475 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f46 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.475 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fa0 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-32.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.476 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ee2 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-63.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.476 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f7d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-48.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.476 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fbc (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.476 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f20 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-35.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.476 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fa4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-30.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.476 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f16 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-40.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.476 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f98 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-36.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.476 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f4a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-15.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.476 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f88 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-43.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.476 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f42 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-19.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.476 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fbe (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-20.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.476 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f0f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-42.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.476 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f94 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-38.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.477 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fb6 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.477 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f4c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-14.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.477 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f85 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-45.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.477 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f8d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-41.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.477 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f07 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-46.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.477 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f06 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-47.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.477 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fb9 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.477 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f54 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.477 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f48 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-16.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.477 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ef8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-54.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.477 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f33 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-26.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.477 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fcf (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.477 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f7f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-47.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.477 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f57 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.478 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fd9 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.478 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f04 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-48.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.478 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f87 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-44.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.478 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f67 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.478 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f35 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-25.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.478 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ff3 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.478 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f1a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-38.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.478 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f70 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-55.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.478 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fdc (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.478 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f65 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.478 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f22 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-34.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.479 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f2c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.479 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001eeb (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-60.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.479 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f8e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-40.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.479 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f3c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.479 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f02 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-49.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.479 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f0d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-43.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.479 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f24 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-33.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.479 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fee (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.479 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f79 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-50.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.479 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ef3 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-57.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.479 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ef0 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-58.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.479 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001efa (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-53.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.479 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f2f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-28.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.479 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001efc (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-52.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.480 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f77 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-51.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.480 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f81 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-46.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.480 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ef6 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-55.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.480 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fb0 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-25.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.480 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f5d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.480 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fa2 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-31.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.480 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fe5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.480 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fac (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-26.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.480 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f7b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-49.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.480 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f26 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-32.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.480 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f3e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-21.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.480 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f00 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-50.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.480 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f2a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-30.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.481 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f6b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.481 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f4f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.481 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f61 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.481 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f72 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-54.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.481 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fa6 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-29.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.481 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ef5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-56.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.481 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fdf (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.481 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ff9 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.481 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f5a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.481 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f0b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-44.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.481 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001feb (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.481 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001edd (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-65.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.481 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ee5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-62.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.481 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f37 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.482 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fa8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.482 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f96 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-37.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.482 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fc8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.482 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f69 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.482 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fb3 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.482 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f9e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-33.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.482 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f60 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.482 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f8b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-42.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.482 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f91 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-39.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.482 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001eee (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-59.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.482 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fd6 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.482 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fc4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.482 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f44 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.482 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fc1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.483 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001efe (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-51.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.483 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f31 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.483 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ff1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.483 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ff6 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.483 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f40 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.483 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f9a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-35.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.483 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f13 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-41.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.483 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fd3 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.483 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001ee8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-61.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.483 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f09 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-45.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.483 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fe8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.483 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001f28 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-31.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.483 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: Scrub error on inode 0x10000001fe2 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.483 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:37 smithi120 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T05:21:37.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: scrub queued for path: / 2024-09-19T05:21:37.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: scrub summary: idle+waiting paths [/] 2024-09-19T05:21:37.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: scrub summary: active paths [/] 2024-09-19T05:21:37.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: scrub summary: active paths [/] 2024-09-19T05:21:37.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: scrub summary: idle+waiting paths [/] 2024-09-19T05:21:37.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: scrub summary: active paths [/] 2024-09-19T05:21:37.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e22 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e34 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001dc1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e2a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d76 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-44.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d9e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d52 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-62.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001dfa (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001de7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-37.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e11 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001dce (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e02 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001df0 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-33.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001dc4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001dd8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-42.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001de1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-39.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d59 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-59.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.907 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e1c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001dae (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e0f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e0e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d69 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-51.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d98 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e2e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001dec (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-35.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e32 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001da8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e19 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d54 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-61.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d7b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-41.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d75 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-45.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.910 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e28 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.910 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d90 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-31.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.910 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e24 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.911 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: scrub summary: idle+waiting paths [/] 2024-09-19T05:21:37.911 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: scrub summary: active paths [/] 2024-09-19T05:21:37.911 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f5f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.911 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ed4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-79.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.911 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: scrub summary: active paths [/] 2024-09-19T05:21:37.911 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001eb1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-14.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.911 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f27 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-45.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.911 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f30 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-41.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.911 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f03 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-60.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.911 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e6e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-46.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.911 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ef7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-66.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.911 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ed2 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-80.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.911 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e6c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-47.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.912 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e3b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-71.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.912 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f62 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.912 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001eb7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.912 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ead (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-16.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.912 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e5f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-54.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.912 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e99 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-26.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.912 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f6f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.912 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f0c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-56.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.912 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f23 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-47.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.912 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001eb9 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.912 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f75 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.912 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f29 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-44.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.912 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e6a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-48.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.913 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ec5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.913 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e9b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-25.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.913 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ee7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-72.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.913 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f05 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-59.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.913 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e7e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-38.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.913 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f8a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.913 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f10 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-55.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.913 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f78 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.913 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001eed (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-70.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.913 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ec4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.913 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e86 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-34.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.913 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001eea (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-71.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.913 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e90 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.914 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e53 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-60.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.914 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001efd (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-63.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.914 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f32 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-40.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.914 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ea1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.914 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e68 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-49.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.914 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e55 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-59.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.914 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f6a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.914 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f73 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.914 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ea9 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.914 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e64 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-51.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.914 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f68 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.914 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ece (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-82.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.914 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e96 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.914 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f89 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.915 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f3d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-35.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.915 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f8c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.915 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e3d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-70.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.915 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ed7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-78.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.915 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f71 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.915 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e50 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-61.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.915 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ea5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.915 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e78 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-41.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.915 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e70 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-45.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.915 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f01 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-61.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.915 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e3f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-69.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.915 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f82 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.915 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001e8c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-31.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.915 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f7c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.916 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000000798 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7) see mds.i log and `damage ls` output for details 2024-09-19T05:21:37.916 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fa5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.916 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fc6 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.916 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fb5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.916 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001faf (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.916 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fbf (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.916 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fab (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.916 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fc9 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.916 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fb8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.916 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f9f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.916 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f97 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.916 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f95 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.916 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fb2 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.917 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f99 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.917 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fa1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.917 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fbb (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.917 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fc3 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.917 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001faa (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.917 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f9b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.917 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fa7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.917 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f9d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.917 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fa3 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.917 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002000 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-51.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.917 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x1000000204e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-27.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.917 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002064 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-20.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.917 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002020 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-41.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.917 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002013 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-45.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.918 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002042 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-31.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.918 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002016 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-44.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.918 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002057 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-24.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.918 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x1000000203f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-32.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.918 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002061 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-21.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.918 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002044 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-30.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.918 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002003 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-50.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.918 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x1000000201b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-43.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.918 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x1000000203c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-33.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.918 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x1000000204b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-28.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.918 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002039 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-34.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.919 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002048 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-29.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.919 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x1000000205e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-22.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.919 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002007 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-49.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.919 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002010 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-46.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.919 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x1000000200d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-47.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.919 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002051 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-26.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.919 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x1000000200a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-48.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.920 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002035 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-35.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.920 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002029 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-38.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.920 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002054 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-25.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.920 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002024 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-40.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.920 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x1000000201e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-42.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.920 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x1000000202e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-37.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.920 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002027 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-39.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.920 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002031 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-36.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.920 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x1000000205b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-23.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.921 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ff8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.921 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ffe (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.921 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fec (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.921 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fce (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.921 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fe3 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.921 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fd1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.921 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ff0 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.921 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002001 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.921 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fcd (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-18.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.921 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fb4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-27.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.921 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fc7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-20.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.921 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002015 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-61.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.921 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x1000000200c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-64.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.922 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fea (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-9.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.922 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fd5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.922 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fbd (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-24.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.922 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fda (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.922 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002060 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-37.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.922 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ffa (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-3.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.922 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fe6 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.922 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fef (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-7.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.922 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002021 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-57.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.922 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002052 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-42.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.922 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x1000000205a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-39.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.922 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fed (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-8.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.922 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x1000000203b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-49.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.923 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fc5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-21.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.923 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fde (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-13.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.923 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ff2 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-6.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.923 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ffc (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-2.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.923 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x1000000202a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-54.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.923 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002038 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-50.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.923 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x1000000201d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-58.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.923 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002008 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-65.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.923 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fb1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-28.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.923 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002034 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-51.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.923 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002012 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-62.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.924 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002046 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-46.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.924 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002026 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-55.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.924 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ff5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-5.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.924 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fae (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-29.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.924 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x1000000200f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-63.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.924 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002058 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-40.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.924 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fc2 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-22.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.924 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fdb (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-14.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.924 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002049 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-45.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.924 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ff4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.924 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002055 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-41.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.925 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ffb (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.925 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002005 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-66.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.925 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002018 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-60.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.925 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fdd (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.925 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fe4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-11.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.925 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fd4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-16.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.925 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fb7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-26.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.925 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002023 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-56.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.925 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fe0 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.925 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002041 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-47.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.925 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fe7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-10.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.925 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x1000000204d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-44.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.925 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fe9 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.926 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fba (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-25.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.926 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ff7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-4.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.926 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x1000000201a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-59.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.926 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fd8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-15.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.926 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002063 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-36.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.926 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x1000000204f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-43.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.926 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fca (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-19.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.926 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x1000000205d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-38.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.926 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x1000000202f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-52.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.926 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fe1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-12.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.926 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fff (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-1.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.926 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x1000000202c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-53.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.926 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000002002 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-67.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.926 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fd0 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-17.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.927 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x1000000203e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-48.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.927 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001b5f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-77.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.927 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: scrub summary: idle+waiting paths [/] 2024-09-19T05:21:37.927 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: scrub summary: active paths [/] 2024-09-19T05:21:37.927 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: scrub summary: idle+waiting paths [/] 2024-09-19T05:21:37.927 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: scrub summary: active paths [/] 2024-09-19T05:21:37.927 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000000c5b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14) see mds.i log and `damage ls` output for details 2024-09-19T05:21:37.927 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: scrub summary: idle+waiting paths [/] 2024-09-19T05:21:37.927 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001de5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-37/picture-48.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.927 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f55 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-37/article-62.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.927 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d72 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.927 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d68 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.927 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d66 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.928 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d88 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.928 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d44 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-35.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.928 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d70 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.928 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d80 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.928 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d8c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.928 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d7c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.928 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d79 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.930 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d8f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.930 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d82 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.930 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d6a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.930 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d55 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.930 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d5d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.930 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d4a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-33.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.930 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d40 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-37.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.930 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d36 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-42.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.930 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d5b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-25.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.930 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d3c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-39.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.930 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d7e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.930 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d4e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-31.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.930 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d28 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-49.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.931 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d58 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-26.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.931 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d53 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-29.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.931 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d86 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.931 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d24 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-51.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.931 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d26 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-50.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.931 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d2e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-46.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.931 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d8a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.931 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d77 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.931 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d3a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-40.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.931 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d5e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.931 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d30 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-45.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.931 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d38 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-41.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.931 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d60 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.932 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d6e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.932 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d2c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-47.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.932 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d74 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.932 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d32 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-44.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.932 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d62 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.932 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d50 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-30.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.932 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d42 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-36.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.932 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d34 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-43.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.932 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d64 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-20.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.932 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d3e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-38.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.932 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d56 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.932 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d22 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-52.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.933 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d48 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-34.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.933 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d1e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.933 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d20 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-53.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.933 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d6c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.933 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d2a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-48.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.933 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001d4c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-32.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.933 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001edf (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-64.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.933 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f1c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-37.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.933 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fa9 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.933 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f18 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-39.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.933 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f1e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-36.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.933 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f52 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.933 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f76 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-52.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.934 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f6e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.934 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f9c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-34.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.934 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f74 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-53.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.934 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001edb (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-66.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.934 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fcb (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.934 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f39 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.934 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f46 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.934 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fa0 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-32.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.934 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ee2 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-63.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.934 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f7d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-48.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.934 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fbc (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.934 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f20 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-35.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.934 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fa4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-30.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.934 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f16 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-40.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.935 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f98 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-36.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.935 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f4a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-15.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.935 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f88 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-43.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.935 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f42 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-19.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.935 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fbe (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-20.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.935 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f0f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-42.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.935 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f94 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-38.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.935 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fb6 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.935 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f4c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-14.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.935 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f85 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-45.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.935 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f8d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-41.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.935 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f07 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-46.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.935 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f06 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-47.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.935 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fb9 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.936 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f54 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.936 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f48 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-16.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.936 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ef8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-54.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.936 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f33 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-26.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.936 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fcf (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.936 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f7f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-47.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.936 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f57 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.936 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fd9 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.936 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f04 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-48.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.936 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f87 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-44.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.936 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f67 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.936 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f35 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-25.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.936 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ff3 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.937 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f1a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-38.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.937 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f70 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-55.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.937 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fdc (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.937 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f65 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.937 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f22 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-34.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.937 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f2c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.937 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001eeb (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-60.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.937 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f8e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-40.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.937 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f3c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.937 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f02 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-49.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.937 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f0d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-43.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.937 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f24 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-33.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.937 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fee (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.937 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f79 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-50.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ef3 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-57.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ef0 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-58.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001efa (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-53.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f2f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-28.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001efc (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-52.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f77 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-51.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f81 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-46.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ef6 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-55.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fb0 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-25.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f5d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fa2 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-31.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fe5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fac (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-26.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.939 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f7b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-49.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.939 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f26 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-32.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.939 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f3e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-21.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.939 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f00 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-50.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.939 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f2a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-30.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.939 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f6b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.939 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f4f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.939 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f61 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.939 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f72 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-54.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.939 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fa6 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-29.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.939 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ef5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-56.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.939 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fdf (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.940 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ff9 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.940 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f5a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.940 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f0b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-44.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.940 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001feb (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.940 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001edd (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-65.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.940 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ee5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-62.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.940 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f37 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.940 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fa8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.940 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f96 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-37.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.940 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fc8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.940 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f69 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fb3 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f9e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-33.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f60 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f8b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-42.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f91 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-39.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001eee (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-59.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fd6 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fc4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f44 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fc1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001efe (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-51.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f31 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ff1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ff6 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f40 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f9a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-35.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f13 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-41.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fd3 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001ee8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-61.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f09 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-45.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fe8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001f28 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-31.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: Scrub error on inode 0x10000001fe2 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:37 smithi194 ceph-mon[35228]: scrub summary: idle+waiting paths [/] 2024-09-19T05:21:37.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: scrub queued for path: / 2024-09-19T05:21:37.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: scrub summary: idle+waiting paths [/] 2024-09-19T05:21:37.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: scrub summary: active paths [/] 2024-09-19T05:21:37.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: scrub summary: active paths [/] 2024-09-19T05:21:37.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: scrub summary: idle+waiting paths [/] 2024-09-19T05:21:37.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: scrub summary: active paths [/] 2024-09-19T05:21:37.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e22 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e34 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001dc1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e2a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d76 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-44.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d9e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d52 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-62.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001dfa (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001de7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-37.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e11 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001dce (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e02 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001df0 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-33.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001dc4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001dd8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-42.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001de1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-39.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d59 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-59.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e1c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001dae (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e0f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e0e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d69 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-51.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d98 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e2e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001dec (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-35.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e32 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001da8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e19 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d54 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-61.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d7b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-41.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.946 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d75 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-45.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e28 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d90 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-31.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e24 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: scrub summary: idle+waiting paths [/] 2024-09-19T05:21:37.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: scrub summary: active paths [/] 2024-09-19T05:21:37.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f5f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ed4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-79.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: scrub summary: active paths [/] 2024-09-19T05:21:37.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001eb1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-14.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f27 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-45.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f30 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-41.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f03 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-60.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.947 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e6e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-46.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.948 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ef7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-66.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.948 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ed2 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-80.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.948 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e6c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-47.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.948 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e3b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-71.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.948 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f62 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.948 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001eb7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.948 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ead (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-16.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.948 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e5f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-54.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.948 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e99 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-26.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.948 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f6f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.949 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f0c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-56.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.949 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f23 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-47.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.949 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001eb9 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.949 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f75 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.949 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f29 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-44.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.949 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e6a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-48.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.949 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ec5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.949 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e9b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-25.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.949 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ee7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-72.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.949 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f05 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-59.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.949 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e7e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-38.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.949 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f8a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.949 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f10 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-55.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.950 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f78 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.950 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001eed (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-70.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.950 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ec4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.950 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e86 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-34.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.950 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001eea (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-71.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.950 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e90 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.950 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e53 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-60.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.950 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001efd (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-63.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.950 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f32 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-40.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.950 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ea1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.950 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e68 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-49.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.950 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e55 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-59.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.950 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f6a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.950 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f73 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ea9 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e64 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-51.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f68 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ece (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-82.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e96 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f89 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f3d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-35.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f8c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e3d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-70.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ed7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-78.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f71 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e50 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-61.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.951 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ea5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e78 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-41.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e70 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-45.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f01 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-61.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e3f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-69.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f82 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001e8c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-31.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f7c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000000798 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7) see mds.i log and `damage ls` output for details 2024-09-19T05:21:37.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fa5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fc6 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fb5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001faf (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.952 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fbf (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.953 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fab (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.953 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fc9 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.953 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fb8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.953 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f9f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.953 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f97 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.953 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f95 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.953 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fb2 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.953 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f99 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.953 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fa1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.953 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fbb (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.953 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fc3 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.953 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001faa (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.953 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f9b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.953 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fa7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.954 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f9d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.954 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fa3 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.954 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002000 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-51.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.954 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x1000000204e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-27.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.954 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002064 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-20.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.954 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002020 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-41.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.954 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002013 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-45.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.954 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002042 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-31.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.954 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002016 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-44.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.954 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002057 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-24.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.954 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x1000000203f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-32.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.954 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002061 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-21.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.954 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002044 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-30.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.955 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002003 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-50.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.955 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x1000000201b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-43.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.955 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x1000000203c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-33.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.955 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x1000000204b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-28.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.955 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002039 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-34.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.955 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002048 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-29.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.955 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x1000000205e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-22.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.955 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002007 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-49.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.955 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002010 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-46.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.955 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x1000000200d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-47.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.955 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002051 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-26.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.955 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x1000000200a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-48.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.955 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002035 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-35.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.956 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002029 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-38.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.956 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002054 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-25.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.956 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002024 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-40.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.956 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x1000000201e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-42.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.956 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x1000000202e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-37.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.956 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002027 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-39.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.956 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002031 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-36.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.956 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x1000000205b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-23.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.956 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ff8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.956 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ffe (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.956 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fec (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.956 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fce (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.956 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fe3 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.956 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fd1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.957 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ff0 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.957 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002001 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.957 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fcd (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-18.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.961 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fb4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-27.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.961 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fc7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-20.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.961 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002015 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-61.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.961 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x1000000200c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-64.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.961 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fea (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-9.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.961 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fd5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.961 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fbd (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-24.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.961 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fda (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.961 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002060 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-37.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.961 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ffa (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-3.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.961 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fe6 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fef (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-7.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002021 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-57.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002052 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-42.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x1000000205a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-39.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fed (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-8.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x1000000203b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-49.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fc5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-21.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fde (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-13.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ff2 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-6.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ffc (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-2.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x1000000202a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-54.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002038 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-50.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.962 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x1000000201d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-58.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002008 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-65.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fb1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-28.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002034 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-51.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002012 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-62.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002046 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-46.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002026 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-55.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ff5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-5.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fae (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-29.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x1000000200f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-63.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002058 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-40.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fc2 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-22.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fdb (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-14.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.963 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002049 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-45.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ff4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002055 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-41.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ffb (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002005 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-66.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002018 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-60.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fdd (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fe4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-11.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fd4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-16.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fb7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-26.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002023 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-56.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fe0 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002041 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-47.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.964 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fe7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-10.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.965 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x1000000204d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-44.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.965 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fe9 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.965 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fba (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-25.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.965 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ff7 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-4.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.965 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x1000000201a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-59.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.965 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fd8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-15.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.965 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002063 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-36.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.965 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x1000000204f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-43.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.965 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fca (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-19.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.965 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x1000000205d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-38.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.965 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x1000000202f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-52.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.965 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fe1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-12.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.965 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fff (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-1.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.965 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x1000000202c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-53.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.966 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000002002 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-67.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.966 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fd0 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-17.xml) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.966 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x1000000203e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-48.jpg) see mds.b log and `damage ls` output for details 2024-09-19T05:21:37.966 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001b5f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-77.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.966 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: scrub summary: idle+waiting paths [/] 2024-09-19T05:21:37.966 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: scrub summary: active paths [/] 2024-09-19T05:21:37.966 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: scrub summary: idle+waiting paths [/] 2024-09-19T05:21:37.966 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: scrub summary: active paths [/] 2024-09-19T05:21:37.966 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000000c5b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14) see mds.i log and `damage ls` output for details 2024-09-19T05:21:37.966 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: scrub summary: idle+waiting paths [/] 2024-09-19T05:21:37.966 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001de5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-37/picture-48.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.966 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f55 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-37/article-62.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.966 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d72 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.967 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d68 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.967 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d66 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.967 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d88 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.967 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d44 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-35.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.967 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d70 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.967 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d80 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.967 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d8c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.967 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d7c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.967 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d79 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.967 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d8f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.967 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d82 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.967 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d6a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.967 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d55 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.968 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d5d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.968 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d4a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-33.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.968 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d40 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-37.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.968 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d36 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-42.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.968 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d5b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-25.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.968 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d3c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-39.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.968 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d7e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.968 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d4e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-31.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.968 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d28 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-49.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.968 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d58 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-26.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.968 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d53 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-29.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.968 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d86 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.968 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d24 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-51.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d26 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-50.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d2e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-46.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d8a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d77 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d3a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-40.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d5e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d30 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-45.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d38 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-41.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d60 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d6e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d2c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-47.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d74 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.969 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d32 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-44.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d62 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d50 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-30.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d42 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-36.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d34 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-43.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d64 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-20.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d3e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-38.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d56 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d22 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-52.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d48 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-34.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d1e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d20 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-53.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d6c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.970 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d2a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-48.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001d4c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-32.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001edf (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-64.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f1c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-37.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fa9 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-27.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f18 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-39.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f1e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-36.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f52 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-12.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f76 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-52.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f6e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-1.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f9c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-34.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f74 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-53.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001edb (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-66.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fcb (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-16.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.971 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f39 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-23.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f46 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-17.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fa0 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-32.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ee2 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-63.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f7d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-48.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fbc (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-21.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f20 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-35.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fa4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-30.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f16 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-40.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f98 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-36.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f4a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-15.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f88 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-43.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f42 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-19.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.972 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fbe (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-20.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f0f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-42.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f94 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-38.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fb6 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-23.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f4c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-14.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f85 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-45.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f8d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-41.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f07 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-46.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f06 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-47.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fb9 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-22.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f54 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-11.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f48 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-16.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ef8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-54.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.973 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f33 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-26.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.974 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fcf (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-15.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.974 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f7f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-47.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.974 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f57 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-10.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.974 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fd9 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-12.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.974 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f04 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-48.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.974 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f87 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-44.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.974 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f67 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-4.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.974 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f35 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-25.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.974 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ff3 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-3.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.974 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f1a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-38.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.974 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f70 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-55.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.974 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fdc (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-11.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.974 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f65 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-5.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.975 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f22 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-34.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.975 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f2c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-29.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.975 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001eeb (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-60.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.975 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f8e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-40.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.975 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f3c (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-22.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.975 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f02 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-49.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.975 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f0d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-43.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.975 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f24 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-33.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.975 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fee (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-5.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.975 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f79 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-50.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.975 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ef3 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-57.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.975 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ef0 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-58.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.975 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001efa (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-53.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.975 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f2f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-28.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.976 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001efc (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-52.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.976 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f77 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-51.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.976 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f81 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-46.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.976 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ef6 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-55.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.976 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fb0 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-25.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.976 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f5d (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-8.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.976 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fa2 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-31.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.976 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fe5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-8.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.976 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fac (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-26.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.976 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f7b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-49.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.976 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f26 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-32.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.976 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f3e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-21.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.976 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f00 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-50.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.977 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f2a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-30.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.977 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f6b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-2.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.977 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f4f (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-13.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.977 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f61 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-6.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.977 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f72 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-54.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.977 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fa6 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-29.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.977 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ef5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-56.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.977 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fdf (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.977 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ff9 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-1.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.977 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f5a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-9.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.977 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f0b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-44.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.977 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001feb (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-6.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.977 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001edd (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-65.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.978 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ee5 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-62.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.978 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f37 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-24.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.978 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fa8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-28.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.978 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f96 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-37.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.978 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fc8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-17.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.978 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f69 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-3.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.978 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fb3 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-24.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.978 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f9e (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-33.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.978 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f60 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-7.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.978 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f8b (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-42.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.978 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f91 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-39.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.978 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001eee (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-59.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.978 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fd6 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-13.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.979 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fc4 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-18.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.979 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f44 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-18.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.979 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fc1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-19.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.979 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001efe (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-51.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.979 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f31 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-27.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.979 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ff1 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-4.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.979 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ff6 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-2.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.979 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f40 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-20.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.979 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f9a (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-35.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.979 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f13 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-41.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.979 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fd3 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-14.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.979 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001ee8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-61.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.979 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f09 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-45.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.979 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fe8 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-7.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.980 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001f28 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-31.xml) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.980 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: Scrub error on inode 0x10000001fe2 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-9.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:21:37.980 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:37 smithi178 ceph-mon[34347]: scrub summary: idle+waiting paths [/] 2024-09-19T05:21:37.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.946+0000 7f1d31a29640 1 -- 172.21.15.120:0/1864265130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d2c074f40 msgr2=0x7f1d2c10de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:37.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.946+0000 7f1d31a29640 1 --2- 172.21.15.120:0/1864265130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d2c074f40 0x7f1d2c10de90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009860 tx=0x7f1d1402a3d0 comp rx=0 tx=0).stop 2024-09-19T05:21:37.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.946+0000 7f1d31a29640 1 -- 172.21.15.120:0/1864265130 shutdown_connections 2024-09-19T05:21:37.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.946+0000 7f1d31a29640 1 --2- 172.21.15.120:0/1864265130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d2c10e3d0 0x7f1d2c110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:37.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.946+0000 7f1d31a29640 1 --2- 172.21.15.120:0/1864265130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d2c074f40 0x7f1d2c10de90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:37.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.946+0000 7f1d31a29640 1 --2- 172.21.15.120:0/1864265130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d2c074620 0x7f1d2c074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.946+0000 7f1d31a29640 1 -- 172.21.15.120:0/1864265130 >> 172.21.15.120:0/1864265130 conn(0x7f1d2c0fd8f0 msgr2=0x7f1d2c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.946+0000 7f1d31a29640 1 -- 172.21.15.120:0/1864265130 shutdown_connections 2024-09-19T05:21:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.946+0000 7f1d31a29640 1 -- 172.21.15.120:0/1864265130 wait complete. 2024-09-19T05:21:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.947+0000 7f1d31a29640 1 Processor -- start 2024-09-19T05:21:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.947+0000 7f1d31a29640 1 -- start start 2024-09-19T05:21:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.947+0000 7f1d31a29640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d2c074620 0x7f1d2c19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.947+0000 7f1d31a29640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d2c074f40 0x7f1d2c19a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.947+0000 7f1d31a29640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d2c10e3d0 0x7f1d2c19ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.947+0000 7f1d31a29640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c114050 con 0x7f1d2c074f40 2024-09-19T05:21:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.947+0000 7f1d31a29640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c113ed0 con 0x7f1d2c10e3d0 2024-09-19T05:21:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.947+0000 7f1d31a29640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c1141d0 con 0x7f1d2c074620 2024-09-19T05:21:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.947+0000 7f1d23fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d2c074f40 0x7f1d2c19a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:37.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.947+0000 7f1d23fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d2c074f40 0x7f1d2c19a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54790/0 (socket says 172.21.15.120:54790) 2024-09-19T05:21:37.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.947+0000 7f1d23fff640 1 -- 172.21.15.120:0/4029829671 learned_addr learned my addr 172.21.15.120:0/4029829671 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:37.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.947+0000 7f1d2affd640 1 --2- 172.21.15.120:0/4029829671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d2c074620 0x7f1d2c19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:37.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.948+0000 7f1d2b7fe640 1 --2- 172.21.15.120:0/4029829671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d2c10e3d0 0x7f1d2c19ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:37.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.948+0000 7f1d23fff640 1 -- 172.21.15.120:0/4029829671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d2c074620 msgr2=0x7f1d2c19a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:37.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.948+0000 7f1d23fff640 1 --2- 172.21.15.120:0/4029829671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d2c074620 0x7f1d2c19a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:37.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.948+0000 7f1d23fff640 1 -- 172.21.15.120:0/4029829671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d2c10e3d0 msgr2=0x7f1d2c19ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:37.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.948+0000 7f1d23fff640 1 --2- 172.21.15.120:0/4029829671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d2c10e3d0 0x7f1d2c19ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:37.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.948+0000 7f1d23fff640 1 -- 172.21.15.120:0/4029829671 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d2c19f400 con 0x7f1d2c074f40 2024-09-19T05:21:37.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.948+0000 7f1d2affd640 1 --2- 172.21.15.120:0/4029829671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d2c074620 0x7f1d2c19a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:37.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.948+0000 7f1d2b7fe640 1 --2- 172.21.15.120:0/4029829671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d2c10e3d0 0x7f1d2c19ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:37.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.948+0000 7f1d23fff640 1 --2- 172.21.15.120:0/4029829671 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d2c074f40 0x7f1d2c19a990 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1d1402a9c0 tx=0x7f1d140052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:37.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.948+0000 7f1d30a27640 1 -- 172.21.15.120:0/4029829671 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d14031400 con 0x7f1d2c074f40 2024-09-19T05:21:37.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.948+0000 7f1d30a27640 1 -- 172.21.15.120:0/4029829671 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1d14031a50 con 0x7f1d2c074f40 2024-09-19T05:21:37.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.948+0000 7f1d30a27640 1 -- 172.21.15.120:0/4029829671 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d1403c680 con 0x7f1d2c074f40 2024-09-19T05:21:37.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.948+0000 7f1d31a29640 1 -- 172.21.15.120:0/4029829671 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d2c19f690 con 0x7f1d2c074f40 2024-09-19T05:21:37.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.948+0000 7f1d31a29640 1 -- 172.21.15.120:0/4029829671 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d2c19fb20 con 0x7f1d2c074f40 2024-09-19T05:21:37.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.952+0000 7f1d30a27640 1 -- 172.21.15.120:0/4029829671 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f1d14039040 con 0x7f1d2c074f40 2024-09-19T05:21:37.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.953+0000 7f1d33e02740 1 Processor -- start 2024-09-19T05:21:37.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.953+0000 7f1d33e02740 1 -- start start 2024-09-19T05:21:37.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.953+0000 7f1d33e02740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56459e6544a0 0x56459e654880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:37.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.953+0000 7f1d33e02740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56459e654dc0 0x56459e65f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:37.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.953+0000 7f1d33e02740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56459e65f680 0x56459e661a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:37.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.953+0000 7f1d33e02740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56459e5ba2e0 con 0x56459e65f680 2024-09-19T05:21:37.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.953+0000 7f1d33e02740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56459e561ce0 con 0x56459e654dc0 2024-09-19T05:21:37.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.953+0000 7f1d33e02740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56459e5b62a0 con 0x56459e6544a0 2024-09-19T05:21:37.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.954+0000 7f1d2b7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56459e6544a0 0x56459e654880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:37.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.954+0000 7f1d30a27640 1 --2- 172.21.15.120:0/4029829671 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1d180a3430 0x7f1d180a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:37.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.954+0000 7f1d2b7fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56459e6544a0 0x56459e654880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:33140/0 (socket says 172.21.15.120:33140) 2024-09-19T05:21:37.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.954+0000 7f1d2affd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56459e654dc0 0x56459e65f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:37.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.954+0000 7f1d2b7fe640 1 -- 172.21.15.120:0/4069791980 learned_addr learned my addr 172.21.15.120:0/4069791980 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:37.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.954+0000 7f1d23fff640 1 --2- 172.21.15.120:0/4069791980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56459e65f680 0x56459e661a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:37.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.954+0000 7f1d2affd640 1 -- 172.21.15.120:0/4069791980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56459e6544a0 msgr2=0x56459e654880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:37.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.954+0000 7f1d2affd640 1 --2- 172.21.15.120:0/4069791980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56459e6544a0 0x56459e654880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:37.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.954+0000 7f1d2affd640 1 -- 172.21.15.120:0/4069791980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56459e65f680 msgr2=0x56459e661a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:37.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.954+0000 7f1d2affd640 1 --2- 172.21.15.120:0/4069791980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56459e65f680 0x56459e661a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:37.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.954+0000 7f1d2affd640 1 -- 172.21.15.120:0/4069791980 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56459e546440 con 0x56459e654dc0 2024-09-19T05:21:37.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.954+0000 7f1d30a27640 1 -- 172.21.15.120:0/4029829671 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f1d140f0a80 con 0x7f1d2c074f40 2024-09-19T05:21:37.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.954+0000 7f1d2b7fe640 1 --2- 172.21.15.120:0/4029829671 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1d180a3430 0x7f1d180a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:37.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.955+0000 7f1d2affd640 1 --2- 172.21.15.120:0/4069791980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56459e654dc0 0x56459e65f140 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c009fd0 tx=0x7f1d1c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4685b8a85026a77f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:37.988 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.955+0000 7f1d21ffb640 1 -- 172.21.15.120:0/4069791980 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c004020 con 0x56459e654dc0 2024-09-19T05:21:37.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.955+0000 7f1d21ffb640 1 -- 172.21.15.120:0/4069791980 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1d1c0054d0 con 0x56459e654dc0 2024-09-19T05:21:37.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.955+0000 7f1d21ffb640 1 -- 172.21.15.120:0/4069791980 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c004c80 con 0x56459e654dc0 2024-09-19T05:21:37.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.956+0000 7f1d33e02740 1 -- 172.21.15.120:0/4069791980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56459e654dc0 msgr2=0x56459e65f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:37.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.956+0000 7f1d2b7fe640 1 --2- 172.21.15.120:0/4029829671 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1d180a3430 0x7f1d180a58f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1d24009c50 tx=0x7f1d24004ab0 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:37.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.956+0000 7f1d33e02740 1 --2- 172.21.15.120:0/4069791980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56459e654dc0 0x56459e65f140 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c009fd0 tx=0x7f1d1c0118d0 comp rx=0 tx=0).stop 2024-09-19T05:21:37.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.956+0000 7f1d33e02740 1 -- 172.21.15.120:0/4069791980 shutdown_connections 2024-09-19T05:21:37.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.956+0000 7f1d33e02740 1 --2- 172.21.15.120:0/4069791980 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56459e65f680 0x56459e661a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:37.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.956+0000 7f1d33e02740 1 --2- 172.21.15.120:0/4069791980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56459e654dc0 0x56459e65f140 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:37.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.956+0000 7f1d33e02740 1 --2- 172.21.15.120:0/4069791980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56459e6544a0 0x56459e654880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:37.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.956+0000 7f1d33e02740 1 -- 172.21.15.120:0/4069791980 >> 172.21.15.120:0/4069791980 conn(0x56459e650a30 msgr2=0x56459e650e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:37.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.956+0000 7f1d33e02740 1 -- 172.21.15.120:0/4069791980 shutdown_connections 2024-09-19T05:21:37.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.956+0000 7f1d33e02740 1 -- 172.21.15.120:0/4069791980 wait complete. 2024-09-19T05:21:37.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.956+0000 7f1d33e02740 1 -- start start 2024-09-19T05:21:37.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.957+0000 7f1d33e02740 1 Processor -- start 2024-09-19T05:21:37.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.957+0000 7f1d33e02740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56459e6544a0 0x56459e65ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:37.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.957+0000 7f1d33e02740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56459e654dc0 0x56459e65c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:37.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.957+0000 7f1d33e02740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56459e65f680 0x56459e65c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:37.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.957+0000 7f1d23fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56459e654dc0 0x56459e65c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:37.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.957+0000 7f1d23fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56459e654dc0 0x56459e65c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54808/0 (socket says 172.21.15.120:54808) 2024-09-19T05:21:37.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.957+0000 7f1d2affd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56459e6544a0 0x56459e65ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:37.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.957+0000 7f1d23fff640 1 -- 172.21.15.120:0/2153934011 learned_addr learned my addr 172.21.15.120:0/2153934011 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:37.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.957+0000 7f1d33e02740 1 -- 172.21.15.120:0/2153934011 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56459e6622a0 con 0x56459e654dc0 2024-09-19T05:21:37.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.957+0000 7f1d33e02740 1 -- 172.21.15.120:0/2153934011 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56459e575050 con 0x56459e65f680 2024-09-19T05:21:37.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.957+0000 7f1d33e02740 1 -- 172.21.15.120:0/2153934011 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56459e662420 con 0x56459e6544a0 2024-09-19T05:21:37.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.957+0000 7f1d2b7fe640 1 --2- 172.21.15.120:0/2153934011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56459e65f680 0x56459e65c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:37.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.957+0000 7f1d33e02740 10 client.0 _ll_register_callbacks cb 0x56459e5b5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:37.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.958+0000 7f1d23fff640 1 -- 172.21.15.120:0/2153934011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56459e6544a0 msgr2=0x56459e65ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:37.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.958+0000 7f1d23fff640 1 --2- 172.21.15.120:0/2153934011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56459e6544a0 0x56459e65ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:37.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.958+0000 7f1d23fff640 1 -- 172.21.15.120:0/2153934011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56459e65f680 msgr2=0x56459e65c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:37.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.958+0000 7f1d23fff640 1 --2- 172.21.15.120:0/2153934011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56459e65f680 0x56459e65c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:37.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.958+0000 7f1d23fff640 1 -- 172.21.15.120:0/2153934011 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56459e32b3c0 con 0x56459e654dc0 2024-09-19T05:21:37.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.958+0000 7f1d2b7fe640 1 --2- 172.21.15.120:0/2153934011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56459e65f680 0x56459e65c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:37.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.958+0000 7f1d23fff640 1 --2- 172.21.15.120:0/2153934011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56459e654dc0 0x56459e65c1e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1d14031c20 tx=0x7f1d1402a3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d38dd960bd470a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:37.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.958+0000 7f1d0affd640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:21:37.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.958+0000 7f1d0affd640 1 -- 172.21.15.120:0/2153934011 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d140f8040 con 0x56459e654dc0 2024-09-19T05:21:37.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.958+0000 7f1d33e02740 1 -- 172.21.15.120:0/2153934011 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d1c0054d0 con 0x56459e654dc0 2024-09-19T05:21:37.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.958+0000 7f1d0affd640 1 -- 172.21.15.120:0/2153934011 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f1d140b8a60 con 0x56459e654dc0 2024-09-19T05:21:37.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.958+0000 7f1d0affd640 1 -- 172.21.15.120:0/2153934011 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1d140bcae0 con 0x56459e654dc0 2024-09-19T05:21:37.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.958+0000 7f1d33e02740 10 client.15843 fetch_fsmap learned FSMap version 27 2024-09-19T05:21:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.958+0000 7f1d33e02740 1 -- 172.21.15.120:0/2153934011 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56459e6763d0 con 0x56459e654dc0 2024-09-19T05:21:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.959+0000 7f1d0affd640 1 -- 172.21.15.120:0/2153934011 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1d1c0054d0 con 0x56459e654dc0 2024-09-19T05:21:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.959+0000 7f1d0affd640 1 -- 172.21.15.120:0/2153934011 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f1d1404c030 con 0x56459e654dc0 2024-09-19T05:21:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.959+0000 7f1d33e02740 10 client.15843 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:21:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.959+0000 7f1d33e02740 10 client.15843 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:21:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.959+0000 7f1d33e02740 20 client.15843 populate_metadata read hostname 'smithi120' 2024-09-19T05:21:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.959+0000 7f1d33e02740 1 --2- 172.21.15.120:0/2153934011 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56459e6779f0 0x56459e679de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.959+0000 7f1d33e02740 4 client.15843 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:21:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.959+0000 7f1d33e02740 1 -- 172.21.15.120:0/2153934011 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56459e5c7850 con 0x56459e6779f0 2024-09-19T05:21:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.959+0000 7f1d2affd640 1 --2- 172.21.15.120:0/2153934011 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56459e6779f0 0x56459e679de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.960+0000 7f1d0affd640 10 client.15843 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.960+0000 7f1d2affd640 1 --2- 172.21.15.120:0/2153934011 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56459e6779f0 0x56459e679de0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=281d3b7b0de3cf00 server_cookie=b619d7f45cfd5228 in_seq=0 out_seq=0 2024-09-19T05:21:37.992 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.960+0000 7f1d0affd640 1 -- 172.21.15.120:0/2153934011 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56459e5c7850 con 0x56459e6779f0 2024-09-19T05:21:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.960+0000 7f1d0affd640 10 client.15843 handle_command_reply: tid=0 2024-09-19T05:21:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.960+0000 7f1d33e02740 1 client.15843 shutdown 2024-09-19T05:21:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.961+0000 7f1d33e02740 1 -- 172.21.15.120:0/2153934011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56459e654dc0 msgr2=0x56459e65c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.961+0000 7f1d33e02740 1 --2- 172.21.15.120:0/2153934011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56459e654dc0 0x56459e65c1e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1d14031c20 tx=0x7f1d1402a3d0 comp rx=0 tx=0).stop 2024-09-19T05:21:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.961+0000 7f1d33e02740 1 -- 172.21.15.120:0/2153934011 shutdown_connections 2024-09-19T05:21:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.961+0000 7f1d33e02740 1 --2- 172.21.15.120:0/2153934011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56459e65f680 0x56459e65c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.961+0000 7f1d33e02740 1 --2- 172.21.15.120:0/2153934011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56459e654dc0 0x56459e65c1e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.961+0000 7f1d33e02740 1 --2- 172.21.15.120:0/2153934011 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56459e6779f0 0x56459e679de0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.961+0000 7f1d33e02740 1 --2- 172.21.15.120:0/2153934011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56459e6544a0 0x56459e65ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.961+0000 7f1d33e02740 1 -- 172.21.15.120:0/2153934011 >> 172.21.15.120:0/2153934011 conn(0x56459e650a30 msgr2=0x56459e656710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.961+0000 7f1d0affd640 0 client.15843 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.961+0000 7f1d33e02740 1 -- 172.21.15.120:0/2153934011 shutdown_connections 2024-09-19T05:21:37.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.961+0000 7f1d33e02740 1 -- 172.21.15.120:0/2153934011 wait complete. 2024-09-19T05:21:37.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.961+0000 7f1d33e02740 20 client.15843 trim_cache size 0 max 16384 2024-09-19T05:21:37.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.994+0000 7f1d33e02740 1 Processor -- start 2024-09-19T05:21:37.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.994+0000 7f1d33e02740 1 -- start start 2024-09-19T05:21:37.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.994+0000 7f1d33e02740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56459e6544a0 0x56459e66b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:37.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.994+0000 7f1d33e02740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56459e654dc0 0x56459e67f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:37.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.995+0000 7f1d33e02740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56459e65f680 0x56459e67fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:37.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.995+0000 7f1d33e02740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c1adff0 con 0x56459e654dc0 2024-09-19T05:21:37.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.995+0000 7f1d23fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56459e654dc0 0x56459e67f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:37.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.995+0000 7f1d33e02740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c1ab8c0 con 0x56459e6544a0 2024-09-19T05:21:37.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.995+0000 7f1d33e02740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c1a9750 con 0x56459e65f680 2024-09-19T05:21:37.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.995+0000 7f1d23fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56459e654dc0 0x56459e67f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54820/0 (socket says 172.21.15.120:54820) 2024-09-19T05:21:37.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.995+0000 7f1d23fff640 1 -- 172.21.15.120:0/2269539544 learned_addr learned my addr 172.21.15.120:0/2269539544 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:37.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.995+0000 7f1d2affd640 1 --2- 172.21.15.120:0/2269539544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56459e6544a0 0x56459e66b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:37.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.995+0000 7f1d2b7fe640 1 --2- 172.21.15.120:0/2269539544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56459e65f680 0x56459e67fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:37.998 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.995+0000 7f1d23fff640 1 -- 172.21.15.120:0/2269539544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56459e65f680 msgr2=0x56459e67fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:37.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.995+0000 7f1d23fff640 1 --2- 172.21.15.120:0/2269539544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56459e65f680 0x56459e67fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:37.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.995+0000 7f1d23fff640 1 -- 172.21.15.120:0/2269539544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56459e6544a0 msgr2=0x56459e66b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:37.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.995+0000 7f1d23fff640 1 --2- 172.21.15.120:0/2269539544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56459e6544a0 0x56459e66b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:37.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.995+0000 7f1d23fff640 1 -- 172.21.15.120:0/2269539544 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56459e654bf0 con 0x56459e654dc0 2024-09-19T05:21:37.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.995+0000 7f1d23fff640 1 --2- 172.21.15.120:0/2269539544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56459e654dc0 0x56459e67f550 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1d140c5450 tx=0x7f1d140057e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0fb50a30307d10 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:37.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.995+0000 7f1d217fa640 1 -- 172.21.15.120:0/2269539544 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d140bc670 con 0x56459e654dc0 2024-09-19T05:21:37.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.995+0000 7f1d217fa640 1 -- 172.21.15.120:0/2269539544 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1d1400b0b0 con 0x56459e654dc0 2024-09-19T05:21:37.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.995+0000 7f1d217fa640 1 -- 172.21.15.120:0/2269539544 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d140bc850 con 0x56459e654dc0 2024-09-19T05:21:37.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.996+0000 7f1d33e02740 1 -- 172.21.15.120:0/2269539544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56459e654dc0 msgr2=0x56459e67f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:37.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.996+0000 7f1d33e02740 1 --2- 172.21.15.120:0/2269539544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56459e654dc0 0x56459e67f550 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1d140c5450 tx=0x7f1d140057e0 comp rx=0 tx=0).stop 2024-09-19T05:21:37.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.996+0000 7f1d33e02740 1 -- 172.21.15.120:0/2269539544 shutdown_connections 2024-09-19T05:21:37.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.996+0000 7f1d33e02740 1 --2- 172.21.15.120:0/2269539544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56459e65f680 0x56459e67fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:37.999 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.996+0000 7f1d33e02740 1 --2- 172.21.15.120:0/2269539544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56459e654dc0 0x56459e67f550 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:38.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.996+0000 7f1d33e02740 1 --2- 172.21.15.120:0/2269539544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56459e6544a0 0x56459e66b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:38.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.996+0000 7f1d33e02740 1 -- 172.21.15.120:0/2269539544 >> 172.21.15.120:0/2269539544 conn(0x56459e650a30 msgr2=0x56459e657870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:38.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.997+0000 7f1d33e02740 1 -- 172.21.15.120:0/2269539544 shutdown_connections 2024-09-19T05:21:38.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.997+0000 7f1d33e02740 1 -- 172.21.15.120:0/2269539544 wait complete. 2024-09-19T05:21:38.000 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.997+0000 7f1d33e02740 1 -- start start 2024-09-19T05:21:38.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.997+0000 7f1d33e02740 1 Processor -- start 2024-09-19T05:21:38.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.998+0000 7f1d33e02740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56459e6544a0 0x56459e667b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:38.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.998+0000 7f1d33e02740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56459e654dc0 0x56459e662e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:38.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.998+0000 7f1d33e02740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56459e65f680 0x56459e663390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:38.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.998+0000 7f1d33e02740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c1a9da0 con 0x56459e6544a0 2024-09-19T05:21:38.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.998+0000 7f1d33e02740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c1ab1f0 con 0x56459e65f680 2024-09-19T05:21:38.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.998+0000 7f1d33e02740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c1aa450 con 0x56459e654dc0 2024-09-19T05:21:38.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.998+0000 7f1d2b7fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56459e65f680 0x56459e663390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:38.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.998+0000 7f1d2affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56459e6544a0 0x56459e667b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:38.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.998+0000 7f1d2b7fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56459e65f680 0x56459e663390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:43334/0 (socket says 172.21.15.120:43334) 2024-09-19T05:21:38.002 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.998+0000 7f1d23fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56459e654dc0 0x56459e662e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:38.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.998+0000 7f1d2b7fe640 1 -- 172.21.15.120:0/135389640 learned_addr learned my addr 172.21.15.120:0/135389640 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:38.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.998+0000 7f1d33e02740 10 client.0 _ll_register_callbacks cb 0x7f1d140b8970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:38.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.998+0000 7f1d2b7fe640 1 -- 172.21.15.120:0/135389640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56459e654dc0 msgr2=0x56459e662e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:38.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.998+0000 7f1d2b7fe640 1 --2- 172.21.15.120:0/135389640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56459e654dc0 0x56459e662e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:38.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.998+0000 7f1d2b7fe640 1 -- 172.21.15.120:0/135389640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56459e6544a0 msgr2=0x56459e667b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:38.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.998+0000 7f1d2b7fe640 1 --2- 172.21.15.120:0/135389640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56459e6544a0 0x56459e667b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:38.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.998+0000 7f1d2b7fe640 1 -- 172.21.15.120:0/135389640 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56459e663900 con 0x56459e65f680 2024-09-19T05:21:38.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.998+0000 7f1d2affd640 1 --2- 172.21.15.120:0/135389640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56459e6544a0 0x56459e667b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:38.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.999+0000 7f1d2b7fe640 1 --2- 172.21.15.120:0/135389640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56459e65f680 0x56459e663390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1d24005c40 tx=0x7f1d240095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d7cbe483b70357c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:38.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.999+0000 7f1d0affd640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:21:38.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.999+0000 7f1d0affd640 1 -- 172.21.15.120:0/135389640 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d2402e060 con 0x56459e65f680 2024-09-19T05:21:38.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.999+0000 7f1d0affd640 1 -- 172.21.15.120:0/135389640 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f1d240293f0 con 0x56459e65f680 2024-09-19T05:21:38.003 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.999+0000 7f1d33e02740 1 -- 172.21.15.120:0/135389640 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d1400b0b0 con 0x56459e65f680 2024-09-19T05:21:38.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.999+0000 7f1d0affd640 1 -- 172.21.15.120:0/135389640 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1d24017040 con 0x56459e65f680 2024-09-19T05:21:38.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.999+0000 7f1d33e02740 10 client.25301 fetch_fsmap learned FSMap version 27 2024-09-19T05:21:38.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.999+0000 7f1d33e02740 1 -- 172.21.15.120:0/135389640 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56459e6e22d0 con 0x56459e65f680 2024-09-19T05:21:38.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:37.999+0000 7f1d0affd640 1 -- 172.21.15.120:0/135389640 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1d24029aa0 con 0x56459e65f680 2024-09-19T05:21:38.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.000+0000 7f1d0affd640 1 -- 172.21.15.120:0/135389640 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 27) ==== 8354+0+0 (secure 0 0 0) 0x7f1d2400b040 con 0x56459e65f680 2024-09-19T05:21:38.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.000+0000 7f1d33e02740 10 client.25301 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T05:21:38.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.000+0000 7f1d33e02740 10 client.25301 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:21:38.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.000+0000 7f1d33e02740 20 client.25301 populate_metadata read hostname 'smithi120' 2024-09-19T05:21:38.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.000+0000 7f1d33e02740 1 --2- 172.21.15.120:0/135389640 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56459e6e2a60 0x56459e6e4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:38.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.000+0000 7f1d33e02740 4 client.25301 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:21:38.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.000+0000 7f1d33e02740 1 -- 172.21.15.120:0/135389640 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f1d1400b0b0 con 0x56459e6e2a60 2024-09-19T05:21:38.004 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.000+0000 7f1d2affd640 1 --2- 172.21.15.120:0/135389640 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56459e6e2a60 0x56459e6e4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:38.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.000+0000 7f1d2affd640 1 --2- 172.21.15.120:0/135389640 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56459e6e2a60 0x56459e6e4e80 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57862fb7773611eb server_cookie=d53f38737e2cd71d in_seq=0 out_seq=0 2024-09-19T05:21:38.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.000+0000 7f1d0affd640 10 client.25301 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:38.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.001+0000 7f1d0affd640 1 -- 172.21.15.120:0/135389640 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f1d1400b0b0 con 0x56459e6e2a60 2024-09-19T05:21:38.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.001+0000 7f1d0affd640 10 client.25301 handle_command_reply: tid=0 2024-09-19T05:21:38.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.001+0000 7f1d33e02740 1 client.25301 shutdown 2024-09-19T05:21:38.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.001+0000 7f1d33e02740 1 -- 172.21.15.120:0/135389640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56459e65f680 msgr2=0x56459e663390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:38.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.001+0000 7f1d33e02740 1 --2- 172.21.15.120:0/135389640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56459e65f680 0x56459e663390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1d24005c40 tx=0x7f1d240095c0 comp rx=0 tx=0).stop 2024-09-19T05:21:38.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.001+0000 7f1d33e02740 1 -- 172.21.15.120:0/135389640 shutdown_connections 2024-09-19T05:21:38.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.001+0000 7f1d33e02740 1 --2- 172.21.15.120:0/135389640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56459e65f680 0x56459e663390 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:38.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.001+0000 7f1d33e02740 1 --2- 172.21.15.120:0/135389640 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56459e6e2a60 0x56459e6e4e80 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:38.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.001+0000 7f1d33e02740 1 --2- 172.21.15.120:0/135389640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56459e654dc0 0x56459e662e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:38.006 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.001+0000 7f1d33e02740 1 --2- 172.21.15.120:0/135389640 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56459e6544a0 0x56459e667b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:38.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.001+0000 7f1d33e02740 1 -- 172.21.15.120:0/135389640 >> 172.21.15.120:0/135389640 conn(0x56459e650a30 msgr2=0x56459e655ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:38.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.001+0000 7f1d0affd640 0 client.25301 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:38.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.001+0000 7f1d33e02740 1 -- 172.21.15.120:0/135389640 shutdown_connections 2024-09-19T05:21:38.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.001+0000 7f1d33e02740 1 -- 172.21.15.120:0/135389640 wait complete. 2024-09-19T05:21:38.007 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.001+0000 7f1d33e02740 20 client.25301 trim_cache size 0 max 16384 2024-09-19T05:21:38.007 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T05:21:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T05:21:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: "scrubs": { 2024-09-19T05:21:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: "99695ca2-1ecb-4f92-a55b-f4c722f61271": { 2024-09-19T05:21:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/", 2024-09-19T05:21:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: "tag": "99695ca2-1ecb-4f92-a55b-f4c722f61271", 2024-09-19T05:21:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: "options": "recursive,force" 2024-09-19T05:21:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:21:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:21:38.008 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T05:21:38.008 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.002+0000 7f1d31a29640 1 -- 172.21.15.120:0/4029829671 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1d180a3430 msgr2=0x7f1d180a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:38.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.002+0000 7f1d31a29640 1 --2- 172.21.15.120:0/4029829671 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1d180a3430 0x7f1d180a58f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1d24009c50 tx=0x7f1d24004ab0 comp rx=0 tx=0).stop 2024-09-19T05:21:38.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.002+0000 7f1d31a29640 1 -- 172.21.15.120:0/4029829671 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d2c074f40 msgr2=0x7f1d2c19a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:38.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.002+0000 7f1d31a29640 1 --2- 172.21.15.120:0/4029829671 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d2c074f40 0x7f1d2c19a990 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1d1402a9c0 tx=0x7f1d140052f0 comp rx=0 tx=0).stop 2024-09-19T05:21:38.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.002+0000 7f1d31a29640 1 -- 172.21.15.120:0/4029829671 shutdown_connections 2024-09-19T05:21:38.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.002+0000 7f1d31a29640 1 --2- 172.21.15.120:0/4029829671 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1d180a3430 0x7f1d180a58f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:38.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.002+0000 7f1d31a29640 1 --2- 172.21.15.120:0/4029829671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d2c10e3d0 0x7f1d2c19ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:38.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.002+0000 7f1d31a29640 1 --2- 172.21.15.120:0/4029829671 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1d2c074f40 0x7f1d2c19a990 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:38.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.002+0000 7f1d31a29640 1 --2- 172.21.15.120:0/4029829671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d2c074620 0x7f1d2c19a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:38.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.002+0000 7f1d31a29640 1 -- 172.21.15.120:0/4029829671 >> 172.21.15.120:0/4029829671 conn(0x7f1d2c0fd8f0 msgr2=0x7f1d2c0fe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:38.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.002+0000 7f1d31a29640 1 -- 172.21.15.120:0/4029829671 shutdown_connections 2024-09-19T05:21:38.009 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:21:38.002+0000 7f1d31a29640 1 -- 172.21.15.120:0/4029829671 wait complete. 2024-09-19T05:21:38.314 INFO:tasks.workunit.client.0.smithi120.stdout: 67 12961 205 7551 117 2684 137 2024-09-19T05:21:38.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:38 smithi120 ceph-mon[30956]: scrub summary: idle+waiting paths [/] 2024-09-19T05:21:38.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:38 smithi120 ceph-mon[30956]: pgmap v75: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 404 op/s 2024-09-19T05:21:38.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:38 smithi194 ceph-mon[35228]: scrub summary: idle+waiting paths [/] 2024-09-19T05:21:38.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:38 smithi194 ceph-mon[35228]: pgmap v75: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 404 op/s 2024-09-19T05:21:38.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:38 smithi178 ceph-mon[34347]: scrub summary: idle+waiting paths [/] 2024-09-19T05:21:38.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:38 smithi178 ceph-mon[34347]: pgmap v75: 97 pgs: 97 active+clean; 187 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 404 op/s 2024-09-19T05:21:39.703 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:39 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-a[30952]: 2024-09-19T05:21:39.443+0000 7fab408dd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T05:21:39.703 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:39 smithi120 ceph-mon[30956]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T05:21:39.703 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:39 smithi120 ceph-mon[30956]: mds.? [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] up:active 2024-09-19T05:21:39.703 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:39 smithi120 ceph-mon[30956]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:21:39.739 INFO:tasks.cephfs.filesystem:scrub status for tag:99695ca2-1ecb-4f92-a55b-f4c722f61271 - {'path': '/', 'tag': '99695ca2-1ecb-4f92-a55b-f4c722f61271', 'options': 'recursive,force'} 2024-09-19T05:21:39.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:39 smithi194 ceph-mon[35228]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T05:21:39.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:39 smithi194 ceph-mon[35228]: mds.? [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] up:active 2024-09-19T05:21:39.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:39 smithi194 ceph-mon[35228]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:21:39.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:39 smithi178 ceph-mon[34347]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T05:21:39.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:39 smithi178 ceph-mon[34347]: mds.? [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] up:active 2024-09-19T05:21:39.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:39 smithi178 ceph-mon[34347]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:21:40.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:40 smithi120 ceph-mon[30956]: pgmap v76: 97 pgs: 97 active+clean; 198 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 858 op/s 2024-09-19T05:21:40.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:40 smithi194 ceph-mon[35228]: pgmap v76: 97 pgs: 97 active+clean; 198 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 858 op/s 2024-09-19T05:21:40.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:40 smithi178 ceph-mon[34347]: pgmap v76: 97 pgs: 97 active+clean; 198 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 858 op/s 2024-09-19T05:21:41.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.386+0000 7f1e3a065640 1 -- 172.21.15.120:0/1786417848 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e34101140 msgr2=0x7f1e3410de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:41.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.386+0000 7f1e3a065640 1 --2- 172.21.15.120:0/1786417848 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e34101140 0x7f1e3410de90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1e28009900 tx=0x7f1e2802a410 comp rx=0 tx=0).stop 2024-09-19T05:21:41.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.386+0000 7f1e3a065640 1 -- 172.21.15.120:0/1786417848 shutdown_connections 2024-09-19T05:21:41.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.386+0000 7f1e3a065640 1 --2- 172.21.15.120:0/1786417848 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e3410e3d0 0x7f1e341107c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.386+0000 7f1e3a065640 1 --2- 172.21.15.120:0/1786417848 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e34101140 0x7f1e3410de90 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.386+0000 7f1e3a065640 1 --2- 172.21.15.120:0/1786417848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e34100820 0x7f1e34100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.386+0000 7f1e3a065640 1 -- 172.21.15.120:0/1786417848 >> 172.21.15.120:0/1786417848 conn(0x7f1e340fc6f0 msgr2=0x7f1e340feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:41.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.386+0000 7f1e3a065640 1 -- 172.21.15.120:0/1786417848 shutdown_connections 2024-09-19T05:21:41.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.386+0000 7f1e3a065640 1 -- 172.21.15.120:0/1786417848 wait complete. 2024-09-19T05:21:41.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.387+0000 7f1e3a065640 1 Processor -- start 2024-09-19T05:21:41.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.387+0000 7f1e3a065640 1 -- start start 2024-09-19T05:21:41.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.388+0000 7f1e3a065640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e34100820 0x7f1e3419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:41.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.388+0000 7f1e3a065640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e34101140 0x7f1e3419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:41.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.388+0000 7f1e3a065640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e3410e3d0 0x7f1e3419ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:41.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.388+0000 7f1e3a065640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1e34113f70 con 0x7f1e3410e3d0 2024-09-19T05:21:41.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.388+0000 7f1e3a065640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1e34113df0 con 0x7f1e34101140 2024-09-19T05:21:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.388+0000 7f1e3a065640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1e341140f0 con 0x7f1e34100820 2024-09-19T05:21:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.388+0000 7f1e33fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e3410e3d0 0x7f1e3419ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.388+0000 7f1e32ffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e34101140 0x7f1e3419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.388+0000 7f1e33fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e3410e3d0 0x7f1e3419ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54852/0 (socket says 172.21.15.120:54852) 2024-09-19T05:21:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.388+0000 7f1e32ffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e34101140 0x7f1e3419a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:43344/0 (socket says 172.21.15.120:43344) 2024-09-19T05:21:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.388+0000 7f1e33fff640 1 -- 172.21.15.120:0/218586463 learned_addr learned my addr 172.21.15.120:0/218586463 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.388+0000 7f1e337fe640 1 --2- 172.21.15.120:0/218586463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e34100820 0x7f1e3419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.388+0000 7f1e33fff640 1 -- 172.21.15.120:0/218586463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e34100820 msgr2=0x7f1e3419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.388+0000 7f1e33fff640 1 --2- 172.21.15.120:0/218586463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e34100820 0x7f1e3419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.388+0000 7f1e33fff640 1 -- 172.21.15.120:0/218586463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e34101140 msgr2=0x7f1e3419a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.388+0000 7f1e33fff640 1 --2- 172.21.15.120:0/218586463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e34101140 0x7f1e3419a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.388+0000 7f1e33fff640 1 -- 172.21.15.120:0/218586463 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e3419f490 con 0x7f1e3410e3d0 2024-09-19T05:21:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.388+0000 7f1e32ffd640 1 --2- 172.21.15.120:0/218586463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e34101140 0x7f1e3419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.388+0000 7f1e33fff640 1 --2- 172.21.15.120:0/218586463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e3410e3d0 0x7f1e3419ed60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c009c90 tx=0x7f1e2c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.389+0000 7f1e30ff9640 1 -- 172.21.15.120:0/218586463 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c003b70 con 0x7f1e3410e3d0 2024-09-19T05:21:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.389+0000 7f1e3a065640 1 -- 172.21.15.120:0/218586463 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e3419f780 con 0x7f1e3410e3d0 2024-09-19T05:21:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.389+0000 7f1e3a065640 1 -- 172.21.15.120:0/218586463 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e341a7010 con 0x7f1e3410e3d0 2024-09-19T05:21:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.389+0000 7f1e30ff9640 1 -- 172.21.15.120:0/218586463 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1e2c003d10 con 0x7f1e3410e3d0 2024-09-19T05:21:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.389+0000 7f1e30ff9640 1 -- 172.21.15.120:0/218586463 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c0108f0 con 0x7f1e3410e3d0 2024-09-19T05:21:41.395 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.392+0000 7f1e30ff9640 1 -- 172.21.15.120:0/218586463 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f1e2c004020 con 0x7f1e3410e3d0 2024-09-19T05:21:41.395 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.392+0000 7f1e3ce02740 1 Processor -- start 2024-09-19T05:21:41.395 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.392+0000 7f1e3ce02740 1 -- start start 2024-09-19T05:21:41.395 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.392+0000 7f1e3ce02740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da9969eaf0 0x55da9969eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:41.395 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.392+0000 7f1e3ce02740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da9969f410 0x55da996a9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:41.395 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.392+0000 7f1e3ce02740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da996a9cb0 0x55da996ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:41.396 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.392+0000 7f1e3ce02740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55da996032f0 con 0x55da9969f410 2024-09-19T05:21:41.396 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.392+0000 7f1e3ce02740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55da995ab270 con 0x55da996a9cb0 2024-09-19T05:21:41.396 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.392+0000 7f1e3ce02740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55da995ff2b0 con 0x55da9969eaf0 2024-09-19T05:21:41.396 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.393+0000 7f1e32ffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da996a9cb0 0x55da996ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:41.396 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.393+0000 7f1e337fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da9969f410 0x55da996a9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:41.396 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.393+0000 7f1e32ffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da996a9cb0 0x55da996ac0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:43360/0 (socket says 172.21.15.120:43360) 2024-09-19T05:21:41.396 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.393+0000 7f1e32ffd640 1 -- 172.21.15.120:0/1967719551 learned_addr learned my addr 172.21.15.120:0/1967719551 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:41.396 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.393+0000 7f1e32ffd640 1 --2- 172.21.15.120:0/1967719551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da9969eaf0 0x55da9969eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:41.396 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.393+0000 7f1e32ffd640 1 -- 172.21.15.120:0/1967719551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da9969eaf0 msgr2=0x55da9969eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:41.396 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.393+0000 7f1e32ffd640 1 --2- 172.21.15.120:0/1967719551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da9969eaf0 0x55da9969eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.396 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.393+0000 7f1e32ffd640 1 -- 172.21.15.120:0/1967719551 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da9969f410 msgr2=0x55da996a9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:41.396 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.393+0000 7f1e32ffd640 1 --2- 172.21.15.120:0/1967719551 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da9969f410 0x55da996a9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.396 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.393+0000 7f1e32ffd640 1 -- 172.21.15.120:0/1967719551 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da995aa340 con 0x55da996a9cb0 2024-09-19T05:21:41.397 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.393+0000 7f1e30ff9640 1 --2- 172.21.15.120:0/218586463 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1e1c0a34e0 0x7f1e1c0a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:41.397 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.393+0000 7f1e32ffd640 1 --2- 172.21.15.120:0/1967719551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da996a9cb0 0x55da996ac0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1e28005ec0 tx=0x7f1e28005780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eeca2ccefb62a7e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:41.397 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.393+0000 7f1e337fe640 1 --2- 172.21.15.120:0/218586463 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1e1c0a34e0 0x7f1e1c0a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:41.397 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.393+0000 7f1e19ffb640 1 -- 172.21.15.120:0/1967719551 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e28035070 con 0x55da996a9cb0 2024-09-19T05:21:41.397 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.393+0000 7f1e30ff9640 1 -- 172.21.15.120:0/218586463 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f1e2c0d0130 con 0x7f1e3410e3d0 2024-09-19T05:21:41.397 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.393+0000 7f1e19ffb640 1 -- 172.21.15.120:0/1967719551 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1e28004230 con 0x55da996a9cb0 2024-09-19T05:21:41.397 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.393+0000 7f1e19ffb640 1 -- 172.21.15.120:0/1967719551 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2803d6b0 con 0x55da996a9cb0 2024-09-19T05:21:41.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.394+0000 7f1e3ce02740 1 -- 172.21.15.120:0/1967719551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da996a9cb0 msgr2=0x55da996ac0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:41.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.394+0000 7f1e337fe640 1 --2- 172.21.15.120:0/218586463 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1e1c0a34e0 0x7f1e1c0a59a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55da9969bec0 tx=0x7f1e24005f90 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:41.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.394+0000 7f1e3ce02740 1 --2- 172.21.15.120:0/1967719551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da996a9cb0 0x55da996ac0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1e28005ec0 tx=0x7f1e28005780 comp rx=0 tx=0).stop 2024-09-19T05:21:41.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.394+0000 7f1e3ce02740 1 -- 172.21.15.120:0/1967719551 shutdown_connections 2024-09-19T05:21:41.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.394+0000 7f1e3ce02740 1 --2- 172.21.15.120:0/1967719551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da996a9cb0 0x55da996ac0a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.394+0000 7f1e3ce02740 1 --2- 172.21.15.120:0/1967719551 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da9969f410 0x55da996a9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.394+0000 7f1e3ce02740 1 --2- 172.21.15.120:0/1967719551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da9969eaf0 0x55da9969eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.401 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.394+0000 7f1e3ce02740 1 -- 172.21.15.120:0/1967719551 >> 172.21.15.120:0/1967719551 conn(0x55da9969b060 msgr2=0x55da9969b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.394+0000 7f1e3ce02740 1 -- 172.21.15.120:0/1967719551 shutdown_connections 2024-09-19T05:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.394+0000 7f1e3ce02740 1 -- 172.21.15.120:0/1967719551 wait complete. 2024-09-19T05:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.395+0000 7f1e3ce02740 1 -- start start 2024-09-19T05:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.395+0000 7f1e3ce02740 1 Processor -- start 2024-09-19T05:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.395+0000 7f1e3ce02740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9969eaf0 0x55da996a6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.395+0000 7f1e3ce02740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da9969f410 0x55da996a70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.395+0000 7f1e3ce02740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da996a9cb0 0x55da996a7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.395+0000 7f1e3ce02740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55da996ac880 con 0x55da996a9cb0 2024-09-19T05:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.395+0000 7f1e3ce02740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55da9958c290 con 0x55da9969eaf0 2024-09-19T05:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.395+0000 7f1e3ce02740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55da996aca00 con 0x55da9969f410 2024-09-19T05:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.395+0000 7f1e3ce02740 10 client.0 _ll_register_callbacks cb 0x55da995bd140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.395+0000 7f1e337fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9969eaf0 0x55da996a6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.395+0000 7f1e32ffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da9969f410 0x55da996a70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.395+0000 7f1e337fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9969eaf0 0x55da996a6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:43362/0 (socket says 172.21.15.120:43362) 2024-09-19T05:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.395+0000 7f1e337fe640 1 -- 172.21.15.120:0/23971454 learned_addr learned my addr 172.21.15.120:0/23971454 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.395+0000 7f1e33fff640 1 --2- 172.21.15.120:0/23971454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da996a9cb0 0x55da996a7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.396+0000 7f1e337fe640 1 -- 172.21.15.120:0/23971454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da9969f410 msgr2=0x55da996a70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.396+0000 7f1e337fe640 1 --2- 172.21.15.120:0/23971454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da9969f410 0x55da996a70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.396+0000 7f1e337fe640 1 -- 172.21.15.120:0/23971454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da996a9cb0 msgr2=0x55da996a7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.396+0000 7f1e337fe640 1 --2- 172.21.15.120:0/23971454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da996a9cb0 0x55da996a7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.396+0000 7f1e337fe640 1 -- 172.21.15.120:0/23971454 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da99316210 con 0x55da9969eaf0 2024-09-19T05:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.396+0000 7f1e33fff640 1 --2- 172.21.15.120:0/23971454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da996a9cb0 0x55da996a7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.396+0000 7f1e337fe640 1 --2- 172.21.15.120:0/23971454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9969eaf0 0x55da996a6b90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009730 tx=0x7f1e24004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f47802c4141ee58e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.396+0000 7f1e12ffd640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.396+0000 7f1e12ffd640 1 -- 172.21.15.120:0/23971454 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2401f640 con 0x55da9969eaf0 2024-09-19T05:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.396+0000 7f1e12ffd640 1 -- 172.21.15.120:0/23971454 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f1e2401f7e0 con 0x55da9969eaf0 2024-09-19T05:21:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.396+0000 7f1e3ce02740 1 -- 172.21.15.120:0/23971454 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e28004230 con 0x55da9969eaf0 2024-09-19T05:21:41.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.396+0000 7f1e12ffd640 1 -- 172.21.15.120:0/23971454 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1e2401f9e0 con 0x55da9969eaf0 2024-09-19T05:21:41.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.396+0000 7f1e3ce02740 10 client.25313 fetch_fsmap learned FSMap version 28 2024-09-19T05:21:41.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.396+0000 7f1e3ce02740 1 -- 172.21.15.120:0/23971454 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55da993e2620 con 0x55da9969eaf0 2024-09-19T05:21:41.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.396+0000 7f1e12ffd640 1 -- 172.21.15.120:0/23971454 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1e28004230 con 0x55da9969eaf0 2024-09-19T05:21:41.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.397+0000 7f1e12ffd640 1 -- 172.21.15.120:0/23971454 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f1e24027070 con 0x55da9969eaf0 2024-09-19T05:21:41.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.397+0000 7f1e3ce02740 10 client.25313 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T05:21:41.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.397+0000 7f1e3ce02740 10 client.25313 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:21:41.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.397+0000 7f1e3ce02740 20 client.25313 populate_metadata read hostname 'smithi120' 2024-09-19T05:21:41.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.397+0000 7f1e3ce02740 1 --2- 172.21.15.120:0/23971454 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55da996b9df0 0x55da996bc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:41.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.397+0000 7f1e3ce02740 4 client.25313 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:21:41.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.397+0000 7f1e3ce02740 1 -- 172.21.15.120:0/23971454 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da99610a20 con 0x55da996b9df0 2024-09-19T05:21:41.404 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.397+0000 7f1e32ffd640 1 --2- 172.21.15.120:0/23971454 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55da996b9df0 0x55da996bc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.397+0000 7f1e12ffd640 10 client.25313 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.397+0000 7f1e32ffd640 1 --2- 172.21.15.120:0/23971454 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55da996b9df0 0x55da996bc250 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=275d91ce42a93b39 server_cookie=ebccbed1eed862b6 in_seq=0 out_seq=0 2024-09-19T05:21:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.398+0000 7f1e12ffd640 1 -- 172.21.15.120:0/23971454 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55da99610a20 con 0x55da996b9df0 2024-09-19T05:21:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.398+0000 7f1e12ffd640 10 client.25313 handle_command_reply: tid=0 2024-09-19T05:21:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.398+0000 7f1e3ce02740 1 client.25313 shutdown 2024-09-19T05:21:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.398+0000 7f1e3ce02740 1 -- 172.21.15.120:0/23971454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9969eaf0 msgr2=0x55da996a6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.398+0000 7f1e3ce02740 1 --2- 172.21.15.120:0/23971454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9969eaf0 0x55da996a6b90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009730 tx=0x7f1e24004730 comp rx=0 tx=0).stop 2024-09-19T05:21:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.398+0000 7f1e3ce02740 1 -- 172.21.15.120:0/23971454 shutdown_connections 2024-09-19T05:21:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.398+0000 7f1e3ce02740 1 --2- 172.21.15.120:0/23971454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da996a9cb0 0x55da996a7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.398+0000 7f1e3ce02740 1 --2- 172.21.15.120:0/23971454 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55da996b9df0 0x55da996bc250 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.398+0000 7f1e3ce02740 1 --2- 172.21.15.120:0/23971454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da9969f410 0x55da996a70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.398+0000 7f1e3ce02740 1 --2- 172.21.15.120:0/23971454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da9969eaf0 0x55da996a6b90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.398+0000 7f1e3ce02740 1 -- 172.21.15.120:0/23971454 >> 172.21.15.120:0/23971454 conn(0x55da9969b060 msgr2=0x55da996a0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.398+0000 7f1e12ffd640 0 client.25313 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.399+0000 7f1e3ce02740 1 -- 172.21.15.120:0/23971454 shutdown_connections 2024-09-19T05:21:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.399+0000 7f1e3ce02740 1 -- 172.21.15.120:0/23971454 wait complete. 2024-09-19T05:21:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.399+0000 7f1e3ce02740 20 client.25313 trim_cache size 0 max 16384 2024-09-19T05:21:41.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.419+0000 7f1e3ce02740 1 Processor -- start 2024-09-19T05:21:41.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.419+0000 7f1e3ce02740 1 -- start start 2024-09-19T05:21:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.419+0000 7f1e3ce02740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da9969eaf0 0x55da996a7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.419+0000 7f1e3ce02740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da9969f410 0x55da996c1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.419+0000 7f1e3ce02740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da996a9cb0 0x55da996c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.419+0000 7f1e3ce02740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1e20011160 con 0x55da9969f410 2024-09-19T05:21:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.419+0000 7f1e3ce02740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2000ea30 con 0x55da996a9cb0 2024-09-19T05:21:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.419+0000 7f1e3ce02740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2000c880 con 0x55da9969eaf0 2024-09-19T05:21:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.419+0000 7f1e33fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da996a9cb0 0x55da996c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.419+0000 7f1e32ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da9969f410 0x55da996c1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.419+0000 7f1e33fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da996a9cb0 0x55da996c20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:43374/0 (socket says 172.21.15.120:43374) 2024-09-19T05:21:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.419+0000 7f1e33fff640 1 -- 172.21.15.120:0/3007087491 learned_addr learned my addr 172.21.15.120:0/3007087491 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.419+0000 7f1e337fe640 1 --2- 172.21.15.120:0/3007087491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da9969eaf0 0x55da996a7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.420+0000 7f1e33fff640 1 -- 172.21.15.120:0/3007087491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da9969eaf0 msgr2=0x55da996a7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:41.422 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.420+0000 7f1e33fff640 1 --2- 172.21.15.120:0/3007087491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da9969eaf0 0x55da996a7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.420+0000 7f1e33fff640 1 -- 172.21.15.120:0/3007087491 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da9969f410 msgr2=0x55da996c1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:41.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.420+0000 7f1e33fff640 1 --2- 172.21.15.120:0/3007087491 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da9969f410 0x55da996c1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.420+0000 7f1e33fff640 1 -- 172.21.15.120:0/3007087491 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da996b8850 con 0x55da996a9cb0 2024-09-19T05:21:41.423 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.420+0000 7f1e33fff640 1 --2- 172.21.15.120:0/3007087491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da996a9cb0 0x55da996c20a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c098d90 tx=0x7f1e2c09bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de9de9382800c8ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.420+0000 7f1e197fa640 1 -- 172.21.15.120:0/3007087491 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c0b5070 con 0x55da996a9cb0 2024-09-19T05:21:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.420+0000 7f1e197fa640 1 -- 172.21.15.120:0/3007087491 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1e2c09c3c0 con 0x55da996a9cb0 2024-09-19T05:21:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.420+0000 7f1e197fa640 1 -- 172.21.15.120:0/3007087491 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c0b5210 con 0x55da996a9cb0 2024-09-19T05:21:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.421+0000 7f1e3ce02740 1 -- 172.21.15.120:0/3007087491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da996a9cb0 msgr2=0x55da996c20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.421+0000 7f1e3ce02740 1 --2- 172.21.15.120:0/3007087491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da996a9cb0 0x55da996c20a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c098d90 tx=0x7f1e2c09bf00 comp rx=0 tx=0).stop 2024-09-19T05:21:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.421+0000 7f1e3ce02740 1 -- 172.21.15.120:0/3007087491 shutdown_connections 2024-09-19T05:21:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.421+0000 7f1e3ce02740 1 --2- 172.21.15.120:0/3007087491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da996a9cb0 0x55da996c20a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.421+0000 7f1e3ce02740 1 --2- 172.21.15.120:0/3007087491 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da9969f410 0x55da996c1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.421+0000 7f1e3ce02740 1 --2- 172.21.15.120:0/3007087491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da9969eaf0 0x55da996a7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.421+0000 7f1e3ce02740 1 -- 172.21.15.120:0/3007087491 >> 172.21.15.120:0/3007087491 conn(0x55da9969b060 msgr2=0x55da996a8c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.421+0000 7f1e3ce02740 1 -- 172.21.15.120:0/3007087491 shutdown_connections 2024-09-19T05:21:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.421+0000 7f1e3ce02740 1 -- 172.21.15.120:0/3007087491 wait complete. 2024-09-19T05:21:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.422+0000 7f1e3ce02740 1 -- start start 2024-09-19T05:21:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.422+0000 7f1e3ce02740 1 Processor -- start 2024-09-19T05:21:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.422+0000 7f1e3ce02740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da9969eaf0 0x55da996adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.422+0000 7f1e3ce02740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da9969f410 0x55da996ae130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.422+0000 7f1e3ce02740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da996a9cb0 0x55da996ae670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.422+0000 7f1e3ce02740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2000cef0 con 0x55da9969f410 2024-09-19T05:21:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.422+0000 7f1e3ce02740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2000e360 con 0x55da996a9cb0 2024-09-19T05:21:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.422+0000 7f1e3ce02740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2000d5c0 con 0x55da9969eaf0 2024-09-19T05:21:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.422+0000 7f1e3ce02740 10 client.0 _ll_register_callbacks cb 0x7f1e24009ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.422+0000 7f1e337fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da9969eaf0 0x55da996adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.422+0000 7f1e337fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da9969eaf0 0x55da996adbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:33214/0 (socket says 172.21.15.120:33214) 2024-09-19T05:21:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.422+0000 7f1e337fe640 1 -- 172.21.15.120:0/2612353361 learned_addr learned my addr 172.21.15.120:0/2612353361 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.422+0000 7f1e32ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da9969f410 0x55da996ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.422+0000 7f1e33fff640 1 --2- 172.21.15.120:0/2612353361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da996a9cb0 0x55da996ae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.423+0000 7f1e337fe640 1 -- 172.21.15.120:0/2612353361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da996a9cb0 msgr2=0x55da996ae670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.423+0000 7f1e337fe640 1 --2- 172.21.15.120:0/2612353361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da996a9cb0 0x55da996ae670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.423+0000 7f1e337fe640 1 -- 172.21.15.120:0/2612353361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da9969f410 msgr2=0x55da996ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.423+0000 7f1e337fe640 1 --2- 172.21.15.120:0/2612353361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da9969f410 0x55da996ae130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.423+0000 7f1e337fe640 1 -- 172.21.15.120:0/2612353361 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da99723cd0 con 0x55da9969eaf0 2024-09-19T05:21:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.423+0000 7f1e33fff640 1 --2- 172.21.15.120:0/2612353361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da996a9cb0 0x55da996ae670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:21:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.423+0000 7f1e337fe640 1 --2- 172.21.15.120:0/2612353361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da9969eaf0 0x55da996adbf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1e240058c0 tx=0x7f1e24029670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=157b64c65a3d0c91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.423+0000 7f1e12ffd640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:21:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.423+0000 7f1e12ffd640 1 -- 172.21.15.120:0/2612353361 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e240297e0 con 0x55da9969eaf0 2024-09-19T05:21:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.423+0000 7f1e12ffd640 1 -- 172.21.15.120:0/2612353361 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f1e24029980 con 0x55da9969eaf0 2024-09-19T05:21:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.423+0000 7f1e3ce02740 1 -- 172.21.15.120:0/2612353361 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e2c09c3c0 con 0x55da9969eaf0 2024-09-19T05:21:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.423+0000 7f1e12ffd640 1 -- 172.21.15.120:0/2612353361 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1e24029b80 con 0x55da9969eaf0 2024-09-19T05:21:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.423+0000 7f1e3ce02740 10 client.25390 fetch_fsmap learned FSMap version 28 2024-09-19T05:21:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.423+0000 7f1e3ce02740 1 -- 172.21.15.120:0/2612353361 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55da9972d7b0 con 0x55da9969eaf0 2024-09-19T05:21:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.423+0000 7f1e12ffd640 1 -- 172.21.15.120:0/2612353361 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1e2403a920 con 0x55da9969eaf0 2024-09-19T05:21:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.424+0000 7f1e12ffd640 1 -- 172.21.15.120:0/2612353361 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f1e24038070 con 0x55da9969eaf0 2024-09-19T05:21:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.424+0000 7f1e3ce02740 10 client.25390 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T05:21:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.424+0000 7f1e3ce02740 10 client.25390 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:21:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.424+0000 7f1e3ce02740 20 client.25390 populate_metadata read hostname 'smithi120' 2024-09-19T05:21:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.424+0000 7f1e3ce02740 1 --2- 172.21.15.120:0/2612353361 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55da9972df30 0x55da99730350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.424+0000 7f1e3ce02740 4 client.25390 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:21:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.424+0000 7f1e3ce02740 1 -- 172.21.15.120:0/2612353361 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f1e2c09c3c0 con 0x55da9972df30 2024-09-19T05:21:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.424+0000 7f1e32ffd640 1 --2- 172.21.15.120:0/2612353361 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55da9972df30 0x55da99730350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.424+0000 7f1e12ffd640 10 client.25390 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.424+0000 7f1e32ffd640 1 --2- 172.21.15.120:0/2612353361 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55da9972df30 0x55da99730350 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c77cd24989b3c2dc server_cookie=58e9e4e7e3c044dd in_seq=0 out_seq=0 2024-09-19T05:21:41.579 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.577+0000 7f1e12ffd640 1 -- 172.21.15.120:0/2612353361 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f1e2c09c3c0 con 0x55da9972df30 2024-09-19T05:21:41.579 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.577+0000 7f1e12ffd640 10 client.25390 handle_command_reply: tid=0 2024-09-19T05:21:41.579 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.577+0000 7f1e3ce02740 1 client.25390 shutdown 2024-09-19T05:21:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.578+0000 7f1e3ce02740 1 -- 172.21.15.120:0/2612353361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da9969eaf0 msgr2=0x55da996adbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.578+0000 7f1e3ce02740 1 --2- 172.21.15.120:0/2612353361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da9969eaf0 0x55da996adbf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1e240058c0 tx=0x7f1e24029670 comp rx=0 tx=0).stop 2024-09-19T05:21:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.578+0000 7f1e3ce02740 1 -- 172.21.15.120:0/2612353361 shutdown_connections 2024-09-19T05:21:41.580 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.578+0000 7f1e3ce02740 1 --2- 172.21.15.120:0/2612353361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55da996a9cb0 0x55da996ae670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.581 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.578+0000 7f1e3ce02740 1 --2- 172.21.15.120:0/2612353361 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55da9969f410 0x55da996ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.581 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.578+0000 7f1e3ce02740 1 --2- 172.21.15.120:0/2612353361 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55da9972df30 0x55da99730350 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.581 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.578+0000 7f1e3ce02740 1 --2- 172.21.15.120:0/2612353361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da9969eaf0 0x55da996adbf0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.581 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.578+0000 7f1e3ce02740 1 -- 172.21.15.120:0/2612353361 >> 172.21.15.120:0/2612353361 conn(0x55da9969b060 msgr2=0x55da996a05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:41.581 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.578+0000 7f1e12ffd640 0 client.25390 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:41.581 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.578+0000 7f1e3ce02740 1 -- 172.21.15.120:0/2612353361 shutdown_connections 2024-09-19T05:21:41.581 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.578+0000 7f1e3ce02740 1 -- 172.21.15.120:0/2612353361 wait complete. 2024-09-19T05:21:41.581 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.578+0000 7f1e3ce02740 20 client.25390 trim_cache size 0 max 16384 2024-09-19T05:21:41.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:21:41.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:21:41.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:21:41.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:21:41.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.579+0000 7f1e3a065640 1 -- 172.21.15.120:0/218586463 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1e1c0a34e0 msgr2=0x7f1e1c0a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:41.582 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.579+0000 7f1e3a065640 1 --2- 172.21.15.120:0/218586463 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1e1c0a34e0 0x7f1e1c0a59a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55da9969bec0 tx=0x7f1e24005f90 comp rx=0 tx=0).stop 2024-09-19T05:21:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.579+0000 7f1e3a065640 1 -- 172.21.15.120:0/218586463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e3410e3d0 msgr2=0x7f1e3419ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.579+0000 7f1e3a065640 1 --2- 172.21.15.120:0/218586463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e3410e3d0 0x7f1e3419ed60 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c009c90 tx=0x7f1e2c00c6a0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.579+0000 7f1e3a065640 1 -- 172.21.15.120:0/218586463 shutdown_connections 2024-09-19T05:21:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.579+0000 7f1e3a065640 1 --2- 172.21.15.120:0/218586463 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1e1c0a34e0 0x7f1e1c0a59a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.579+0000 7f1e3a065640 1 --2- 172.21.15.120:0/218586463 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1e3410e3d0 0x7f1e3419ed60 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.579+0000 7f1e3a065640 1 --2- 172.21.15.120:0/218586463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e34101140 0x7f1e3419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.579+0000 7f1e3a065640 1 --2- 172.21.15.120:0/218586463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e34100820 0x7f1e3419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.579+0000 7f1e3a065640 1 -- 172.21.15.120:0/218586463 >> 172.21.15.120:0/218586463 conn(0x7f1e340fc6f0 msgr2=0x7f1e340feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.580+0000 7f1e3a065640 1 -- 172.21.15.120:0/218586463 shutdown_connections 2024-09-19T05:21:41.583 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:41.580+0000 7f1e3a065640 1 -- 172.21.15.120:0/218586463 wait complete. 2024-09-19T05:21:42.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:42 smithi120 ceph-mon[30956]: scrub summary: idle 2024-09-19T05:21:42.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:42 smithi194 ceph-mon[35228]: scrub summary: idle 2024-09-19T05:21:42.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:42 smithi178 ceph-mon[34347]: scrub summary: idle 2024-09-19T05:21:43.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:43 smithi120 ceph-mon[30956]: scrub summary: idle 2024-09-19T05:21:43.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:43 smithi120 ceph-mon[30956]: scrub summary: idle 2024-09-19T05:21:43.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:43 smithi120 ceph-mon[30956]: pgmap v77: 97 pgs: 97 active+clean; 198 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 542 op/s 2024-09-19T05:21:43.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:43 smithi194 ceph-mon[35228]: scrub summary: idle 2024-09-19T05:21:43.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:43 smithi194 ceph-mon[35228]: scrub summary: idle 2024-09-19T05:21:43.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:43 smithi194 ceph-mon[35228]: pgmap v77: 97 pgs: 97 active+clean; 198 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 542 op/s 2024-09-19T05:21:43.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:43 smithi178 ceph-mon[34347]: scrub summary: idle 2024-09-19T05:21:43.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:43 smithi178 ceph-mon[34347]: scrub summary: idle 2024-09-19T05:21:43.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:43 smithi178 ceph-mon[34347]: pgmap v77: 97 pgs: 97 active+clean; 198 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 542 op/s 2024-09-19T05:21:44.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:44 smithi120 ceph-mon[30956]: mds.? [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] up:active 2024-09-19T05:21:44.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:44 smithi120 ceph-mon[30956]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:21:44.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:44 smithi194 ceph-mon[35228]: mds.? [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] up:active 2024-09-19T05:21:44.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:44 smithi194 ceph-mon[35228]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:21:44.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:44 smithi178 ceph-mon[34347]: mds.? [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] up:active 2024-09-19T05:21:44.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:44 smithi178 ceph-mon[34347]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:21:45.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:45 smithi120 ceph-mon[30956]: pgmap v78: 97 pgs: 97 active+clean; 198 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 542 op/s 2024-09-19T05:21:45.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:45 smithi194 ceph-mon[35228]: pgmap v78: 97 pgs: 97 active+clean; 198 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 542 op/s 2024-09-19T05:21:45.441 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:45 smithi178 ceph-mon[34347]: pgmap v78: 97 pgs: 97 active+clean; 198 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 542 op/s 2024-09-19T05:21:46.306 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:46 smithi194 ceph-mon[35228]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T05:21:46.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:46 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-a[30952]: 2024-09-19T05:21:46.009+0000 7fab408dd640 -1 log_channel(cluster) log [ERR] : Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T05:21:46.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:46 smithi120 ceph-mon[30956]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T05:21:46.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:46 smithi178 ceph-mon[34347]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-19T05:21:47.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:47 smithi120 ceph-mon[30956]: pgmap v79: 97 pgs: 97 active+clean; 194 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 707 op/s 2024-09-19T05:21:47.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:47 smithi194 ceph-mon[35228]: pgmap v79: 97 pgs: 97 active+clean; 194 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 707 op/s 2024-09-19T05:21:47.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:47 smithi178 ceph-mon[34347]: pgmap v79: 97 pgs: 97 active+clean; 194 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 707 op/s 2024-09-19T05:21:48.314 INFO:tasks.workunit.client.0.smithi120.stdout: 68 13815 133 7595 185 2243 124 2024-09-19T05:21:48.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:48 smithi178 ceph-mon[34347]: pgmap v80: 97 pgs: 97 active+clean; 194 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 619 op/s 2024-09-19T05:21:48.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:48 smithi120 ceph-mon[30956]: pgmap v80: 97 pgs: 97 active+clean; 194 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 619 op/s 2024-09-19T05:21:48.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:48 smithi194 ceph-mon[35228]: pgmap v80: 97 pgs: 97 active+clean; 194 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 619 op/s 2024-09-19T05:21:50.691 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:50 smithi178 ceph-mon[34347]: pgmap v81: 97 pgs: 97 active+clean; 206 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 699 op/s 2024-09-19T05:21:50.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:50 smithi120 ceph-mon[30956]: pgmap v81: 97 pgs: 97 active+clean; 206 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 699 op/s 2024-09-19T05:21:50.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:50 smithi194 ceph-mon[35228]: pgmap v81: 97 pgs: 97 active+clean; 206 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 699 op/s 2024-09-19T05:21:52.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:52 smithi178 ceph-mon[34347]: pgmap v82: 97 pgs: 97 active+clean; 206 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 245 op/s 2024-09-19T05:21:52.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:52 smithi120 ceph-mon[30956]: pgmap v82: 97 pgs: 97 active+clean; 206 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 245 op/s 2024-09-19T05:21:52.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:52 smithi194 ceph-mon[35228]: pgmap v82: 97 pgs: 97 active+clean; 206 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 245 op/s 2024-09-19T05:21:54.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:54 smithi178 ceph-mon[34347]: pgmap v83: 97 pgs: 97 active+clean; 206 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 245 op/s 2024-09-19T05:21:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.700+0000 7f30ff6dd640 1 -- 172.21.15.120:0/32435832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30f81069c0 msgr2=0x7f30f8106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.700+0000 7f30ff6dd640 1 --2- 172.21.15.120:0/32435832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30f81069c0 0x7f30f8106da0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009930 tx=0x7f30f402a420 comp rx=0 tx=0).stop 2024-09-19T05:21:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.700+0000 7f30ff6dd640 1 -- 172.21.15.120:0/32435832 shutdown_connections 2024-09-19T05:21:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.700+0000 7f30ff6dd640 1 --2- 172.21.15.120:0/32435832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30f8101350 0x7f30f810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.700+0000 7f30ff6dd640 1 --2- 172.21.15.120:0/32435832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30f81009b0 0x7f30f8100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.702 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.700+0000 7f30ff6dd640 1 --2- 172.21.15.120:0/32435832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30f81069c0 0x7f30f8106da0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.700+0000 7f30ff6dd640 1 -- 172.21.15.120:0/32435832 >> 172.21.15.120:0/32435832 conn(0x7f30f8077990 msgr2=0x7f30f80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.700+0000 7f30ff6dd640 1 -- 172.21.15.120:0/32435832 shutdown_connections 2024-09-19T05:21:54.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.700+0000 7f30ff6dd640 1 -- 172.21.15.120:0/32435832 wait complete. 2024-09-19T05:21:54.704 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.701+0000 7f30ff6dd640 1 Processor -- start 2024-09-19T05:21:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.701+0000 7f30ff6dd640 1 -- start start 2024-09-19T05:21:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.701+0000 7f30ff6dd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30f81009b0 0x7f30f8196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.701+0000 7f30ff6dd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30f8101350 0x7f30f81974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.701+0000 7f30ff6dd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30f81069c0 0x7f30f81979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.701+0000 7f30ff6dd640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f30f8110cb0 con 0x7f30f81069c0 2024-09-19T05:21:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.701+0000 7f30ff6dd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f30f8110b30 con 0x7f30f81009b0 2024-09-19T05:21:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.701+0000 7f30ff6dd640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f30f8110e30 con 0x7f30f8101350 2024-09-19T05:21:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.701+0000 7f30fdc7a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30f81069c0 0x7f30f81979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.701+0000 7f30fcc78640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30f8101350 0x7f30f81974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.701+0000 7f30fcc78640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30f8101350 0x7f30f81974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:51732/0 (socket says 172.21.15.120:51732) 2024-09-19T05:21:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.701+0000 7f30fdc7a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30f81069c0 0x7f30f81979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46712/0 (socket says 172.21.15.120:46712) 2024-09-19T05:21:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.701+0000 7f30fcc78640 1 -- 172.21.15.120:0/1622192055 learned_addr learned my addr 172.21.15.120:0/1622192055 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:54.705 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.701+0000 7f30fd479640 1 --2- 172.21.15.120:0/1622192055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30f81009b0 0x7f30f8196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.702+0000 7f30fcc78640 1 -- 172.21.15.120:0/1622192055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30f81009b0 msgr2=0x7f30f8196f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.702+0000 7f30fcc78640 1 --2- 172.21.15.120:0/1622192055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30f81009b0 0x7f30f8196f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.702+0000 7f30fcc78640 1 -- 172.21.15.120:0/1622192055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30f81069c0 msgr2=0x7f30f81979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.702+0000 7f30fcc78640 1 --2- 172.21.15.120:0/1622192055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30f81069c0 0x7f30f81979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.702+0000 7f30fcc78640 1 -- 172.21.15.120:0/1622192055 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f81a67d0 con 0x7f30f8101350 2024-09-19T05:21:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.702+0000 7f30fcc78640 1 --2- 172.21.15.120:0/1622192055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30f8101350 0x7f30f81974a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f30e800e9f0 tx=0x7f30e800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.702+0000 7f30ee7fc640 1 -- 172.21.15.120:0/1622192055 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e800cd80 con 0x7f30f8101350 2024-09-19T05:21:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.702+0000 7f30ff6dd640 1 -- 172.21.15.120:0/1622192055 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f81a6ac0 con 0x7f30f8101350 2024-09-19T05:21:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.702+0000 7f30ee7fc640 1 -- 172.21.15.120:0/1622192055 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f30e80108e0 con 0x7f30f8101350 2024-09-19T05:21:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.702+0000 7f30ee7fc640 1 -- 172.21.15.120:0/1622192055 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e8018920 con 0x7f30f8101350 2024-09-19T05:21:54.706 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.702+0000 7f30ff6dd640 1 -- 172.21.15.120:0/1622192055 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f81a7060 con 0x7f30f8101350 2024-09-19T05:21:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.705+0000 7f30ee7fc640 1 -- 172.21.15.120:0/1622192055 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f30e8010a90 con 0x7f30f8101350 2024-09-19T05:21:54.707 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.706+0000 7f310247a740 1 Processor -- start 2024-09-19T05:21:54.708 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.706+0000 7f310247a740 1 -- start start 2024-09-19T05:21:54.709 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.706+0000 7f310247a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e45ed3af0 0x560e45ed3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:54.709 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.706+0000 7f310247a740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e45ed4410 0x560e45ede770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.706+0000 7f310247a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560e45edecb0 0x560e45ee10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.706+0000 7f310247a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560e45e382f0 con 0x560e45edecb0 2024-09-19T05:21:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.706+0000 7f310247a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x560e45de0270 con 0x560e45ed3af0 2024-09-19T05:21:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.706+0000 7f310247a740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560e45e342b0 con 0x560e45ed4410 2024-09-19T05:21:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.706+0000 7f30ee7fc640 1 --2- 172.21.15.120:0/1622192055 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f30e40a34e0 0x7f30e40a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.706+0000 7f30fd479640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e45ed4410 0x560e45ede770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.707+0000 7f30fdc7a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e45ed3af0 0x560e45ed3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.707+0000 7f30fcc78640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560e45edecb0 0x560e45ee10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.707+0000 7f30fdc7a640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e45ed3af0 0x560e45ed3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:55960/0 (socket says 172.21.15.120:55960) 2024-09-19T05:21:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.707+0000 7f30fd479640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e45ed4410 0x560e45ede770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:51748/0 (socket says 172.21.15.120:51748) 2024-09-19T05:21:54.710 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.707+0000 7f30fdc7a640 1 -- 172.21.15.120:0/1102011982 learned_addr learned my addr 172.21.15.120:0/1102011982 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.707+0000 7f30fdc7a640 1 --2- 172.21.15.120:0/1622192055 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f30e40a34e0 0x7f30e40a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.707+0000 7f30fd479640 1 -- 172.21.15.120:0/1102011982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e45ed3af0 msgr2=0x560e45ed3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.707+0000 7f30fd479640 1 --2- 172.21.15.120:0/1102011982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e45ed3af0 0x560e45ed3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.707+0000 7f30fd479640 1 -- 172.21.15.120:0/1102011982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560e45edecb0 msgr2=0x560e45ee10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.707+0000 7f30fd479640 1 --2- 172.21.15.120:0/1102011982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560e45edecb0 0x560e45ee10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.707+0000 7f30fd479640 1 -- 172.21.15.120:0/1102011982 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e45ddf340 con 0x560e45ed4410 2024-09-19T05:21:54.711 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.707+0000 7f30fcc78640 1 --2- 172.21.15.120:0/1102011982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560e45edecb0 0x560e45ee10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.707+0000 7f30ee7fc640 1 -- 172.21.15.120:0/1622192055 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f30e80cffa0 con 0x7f30f8101350 2024-09-19T05:21:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.707+0000 7f30fdc7a640 1 --2- 172.21.15.120:0/1622192055 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f30e40a34e0 0x7f30e40a59a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f30f0005c40 tx=0x7f30f0009500 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.707+0000 7f30fd479640 1 --2- 172.21.15.120:0/1102011982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e45ed4410 0x560e45ede770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f30f4031440 tx=0x7f30f4005be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53d8fa0d44ae8d02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.707+0000 7f30e37fe640 1 -- 172.21.15.120:0/1102011982 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4040070 con 0x560e45ed4410 2024-09-19T05:21:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.708+0000 7f30e37fe640 1 -- 172.21.15.120:0/1102011982 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f30f4004030 con 0x560e45ed4410 2024-09-19T05:21:54.712 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.708+0000 7f30e37fe640 1 -- 172.21.15.120:0/1102011982 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4035040 con 0x560e45ed4410 2024-09-19T05:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.708+0000 7f310247a740 1 -- 172.21.15.120:0/1102011982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e45ed4410 msgr2=0x560e45ede770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.708+0000 7f310247a740 1 --2- 172.21.15.120:0/1102011982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e45ed4410 0x560e45ede770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f30f4031440 tx=0x7f30f4005be0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.708+0000 7f310247a740 1 -- 172.21.15.120:0/1102011982 shutdown_connections 2024-09-19T05:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.708+0000 7f310247a740 1 --2- 172.21.15.120:0/1102011982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560e45edecb0 0x560e45ee10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.708+0000 7f310247a740 1 --2- 172.21.15.120:0/1102011982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e45ed4410 0x560e45ede770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.708+0000 7f310247a740 1 --2- 172.21.15.120:0/1102011982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e45ed3af0 0x560e45ed3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.709+0000 7f310247a740 1 -- 172.21.15.120:0/1102011982 >> 172.21.15.120:0/1102011982 conn(0x560e45ed0060 msgr2=0x560e45ed0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.709+0000 7f310247a740 1 -- 172.21.15.120:0/1102011982 shutdown_connections 2024-09-19T05:21:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.709+0000 7f310247a740 1 -- 172.21.15.120:0/1102011982 wait complete. 2024-09-19T05:21:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.709+0000 7f310247a740 1 -- start start 2024-09-19T05:21:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.709+0000 7f310247a740 1 Processor -- start 2024-09-19T05:21:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.710+0000 7f310247a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560e45ed3af0 0x560e45edbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.710+0000 7f310247a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e45ed4410 0x560e45edc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.710+0000 7f310247a740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e45edecb0 0x560e45edc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.710+0000 7f310247a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560e45ee1880 con 0x560e45ed3af0 2024-09-19T05:21:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.710+0000 7f30fd479640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560e45ed3af0 0x560e45edbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.710+0000 7f310247a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x560e45dc1290 con 0x560e45ed4410 2024-09-19T05:21:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.710+0000 7f310247a740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560e45ee1a00 con 0x560e45edecb0 2024-09-19T05:21:54.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.710+0000 7f30fd479640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560e45ed3af0 0x560e45edbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46722/0 (socket says 172.21.15.120:46722) 2024-09-19T05:21:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.710+0000 7f30fd479640 1 -- 172.21.15.120:0/307997790 learned_addr learned my addr 172.21.15.120:0/307997790 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.710+0000 7f30fdc7a640 1 --2- 172.21.15.120:0/307997790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e45edecb0 0x560e45edc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.710+0000 7f310247a740 10 client.0 _ll_register_callbacks cb 0x560e45df2140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.710+0000 7f30fcc78640 1 --2- 172.21.15.120:0/307997790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e45ed4410 0x560e45edc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.710+0000 7f30fd479640 1 -- 172.21.15.120:0/307997790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e45edecb0 msgr2=0x560e45edc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.710+0000 7f30fd479640 1 --2- 172.21.15.120:0/307997790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e45edecb0 0x560e45edc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.710+0000 7f30fd479640 1 -- 172.21.15.120:0/307997790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e45ed4410 msgr2=0x560e45edc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.710+0000 7f30fd479640 1 --2- 172.21.15.120:0/307997790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e45ed4410 0x560e45edc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.710+0000 7f30fd479640 1 -- 172.21.15.120:0/307997790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e45b4b210 con 0x560e45ed3af0 2024-09-19T05:21:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.710+0000 7f30fd479640 1 --2- 172.21.15.120:0/307997790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560e45ed3af0 0x560e45edbb90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f30f402a940 tx=0x7f30f4032f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=672d83489d57be89 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.710+0000 7f30e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:21:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.711+0000 7f30e0ff9640 1 -- 172.21.15.120:0/307997790 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4035070 con 0x560e45ed3af0 2024-09-19T05:21:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.711+0000 7f310247a740 1 -- 172.21.15.120:0/307997790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30f4004030 con 0x560e45ed3af0 2024-09-19T05:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.711+0000 7f30e0ff9640 1 -- 172.21.15.120:0/307997790 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f30f40314a0 con 0x560e45ed3af0 2024-09-19T05:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.711+0000 7f30e0ff9640 1 -- 172.21.15.120:0/307997790 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f30f4040040 con 0x560e45ed3af0 2024-09-19T05:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.711+0000 7f310247a740 10 client.15879 fetch_fsmap learned FSMap version 29 2024-09-19T05:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.711+0000 7f310247a740 1 -- 172.21.15.120:0/307997790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560e45c17620 con 0x560e45ed3af0 2024-09-19T05:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.711+0000 7f30e0ff9640 1 -- 172.21.15.120:0/307997790 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f30f4004030 con 0x560e45ed3af0 2024-09-19T05:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.711+0000 7f30e0ff9640 1 -- 172.21.15.120:0/307997790 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f30f4004940 con 0x560e45ed3af0 2024-09-19T05:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.711+0000 7f310247a740 10 client.15879 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.711+0000 7f310247a740 10 client.15879 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.711+0000 7f310247a740 20 client.15879 populate_metadata read hostname 'smithi120' 2024-09-19T05:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.712+0000 7f310247a740 1 --2- 172.21.15.120:0/307997790 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x560e45eeea60 0x560e45ef0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.712+0000 7f310247a740 4 client.15879 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.712+0000 7f310247a740 1 -- 172.21.15.120:0/307997790 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e45e45a20 con 0x560e45eeea60 2024-09-19T05:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.712+0000 7f30fcc78640 1 --2- 172.21.15.120:0/307997790 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x560e45eeea60 0x560e45ef0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.712+0000 7f30fcc78640 1 --2- 172.21.15.120:0/307997790 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x560e45eeea60 0x560e45ef0e50 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=607a9d9da21ad33c server_cookie=41924f70d2f2d1e0 in_seq=0 out_seq=0 2024-09-19T05:21:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.712+0000 7f30e0ff9640 10 client.15879 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.713+0000 7f30e0ff9640 1 -- 172.21.15.120:0/307997790 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560e45e45a20 con 0x560e45eeea60 2024-09-19T05:21:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.713+0000 7f30e0ff9640 10 client.15879 handle_command_reply: tid=0 2024-09-19T05:21:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.713+0000 7f310247a740 1 client.15879 shutdown 2024-09-19T05:21:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.713+0000 7f310247a740 1 -- 172.21.15.120:0/307997790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560e45ed3af0 msgr2=0x560e45edbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.713+0000 7f310247a740 1 --2- 172.21.15.120:0/307997790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560e45ed3af0 0x560e45edbb90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f30f402a940 tx=0x7f30f4032f50 comp rx=0 tx=0).stop 2024-09-19T05:21:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.713+0000 7f310247a740 1 -- 172.21.15.120:0/307997790 shutdown_connections 2024-09-19T05:21:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.713+0000 7f310247a740 1 --2- 172.21.15.120:0/307997790 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x560e45eeea60 0x560e45ef0e50 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.713+0000 7f310247a740 1 --2- 172.21.15.120:0/307997790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e45edecb0 0x560e45edc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.713+0000 7f310247a740 1 --2- 172.21.15.120:0/307997790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e45ed4410 0x560e45edc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.713+0000 7f310247a740 1 --2- 172.21.15.120:0/307997790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560e45ed3af0 0x560e45edbb90 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.713+0000 7f310247a740 1 -- 172.21.15.120:0/307997790 >> 172.21.15.120:0/307997790 conn(0x560e45ed0060 msgr2=0x560e45ed5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.713+0000 7f30e0ff9640 0 client.15879 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:54.721 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.714+0000 7f310247a740 1 -- 172.21.15.120:0/307997790 shutdown_connections 2024-09-19T05:21:54.721 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.714+0000 7f310247a740 1 -- 172.21.15.120:0/307997790 wait complete. 2024-09-19T05:21:54.721 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.714+0000 7f310247a740 20 client.15879 trim_cache size 0 max 16384 2024-09-19T05:21:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.735+0000 7f310247a740 1 Processor -- start 2024-09-19T05:21:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.735+0000 7f310247a740 1 -- start start 2024-09-19T05:21:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.735+0000 7f310247a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560e45ed3af0 0x560e45ed6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.735+0000 7f310247a740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e45ed4410 0x560e45edc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.735+0000 7f30fd479640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560e45ed3af0 0x560e45ed6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:54.738 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.735+0000 7f30fd479640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560e45ed3af0 0x560e45ed6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46726/0 (socket says 172.21.15.120:46726) 2024-09-19T05:21:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.735+0000 7f30fd479640 1 -- 172.21.15.120:0/1378295732 learned_addr learned my addr 172.21.15.120:0/1378295732 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.735+0000 7f310247a740 1 --2- 172.21.15.120:0/1378295732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e45edecb0 0x560e45eddb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.735+0000 7f310247a740 1 -- 172.21.15.120:0/1378295732 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f30f81b2310 con 0x560e45ed3af0 2024-09-19T05:21:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.735+0000 7f310247a740 1 -- 172.21.15.120:0/1378295732 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f30f81afbe0 con 0x560e45edecb0 2024-09-19T05:21:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.735+0000 7f310247a740 1 -- 172.21.15.120:0/1378295732 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f30f81ada30 con 0x560e45ed4410 2024-09-19T05:21:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.735+0000 7f30fcc78640 1 --2- 172.21.15.120:0/1378295732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e45ed4410 0x560e45edc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.736+0000 7f30fdc7a640 1 --2- 172.21.15.120:0/1378295732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e45edecb0 0x560e45eddb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.736+0000 7f30fd479640 1 -- 172.21.15.120:0/1378295732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e45ed4410 msgr2=0x560e45edc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.736+0000 7f30fd479640 1 --2- 172.21.15.120:0/1378295732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e45ed4410 0x560e45edc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.736+0000 7f30fd479640 1 -- 172.21.15.120:0/1378295732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e45edecb0 msgr2=0x560e45eddb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.736+0000 7f30fd479640 1 --2- 172.21.15.120:0/1378295732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e45edecb0 0x560e45eddb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.739 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.736+0000 7f30fd479640 1 -- 172.21.15.120:0/1378295732 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e45ecb2d0 con 0x560e45ed3af0 2024-09-19T05:21:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.736+0000 7f30fcc78640 1 --2- 172.21.15.120:0/1378295732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e45ed4410 0x560e45edc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.736+0000 7f30fd479640 1 --2- 172.21.15.120:0/1378295732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560e45ed3af0 0x560e45ed6560 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f30f402a460 tx=0x7f30f4005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb5ebc5da404d90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.736+0000 7f30e2ffd640 1 -- 172.21.15.120:0/1378295732 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4035040 con 0x560e45ed3af0 2024-09-19T05:21:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.736+0000 7f30e2ffd640 1 -- 172.21.15.120:0/1378295732 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f30f40035f0 con 0x560e45ed3af0 2024-09-19T05:21:54.740 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.736+0000 7f30e2ffd640 1 -- 172.21.15.120:0/1378295732 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4003c90 con 0x560e45ed3af0 2024-09-19T05:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.737+0000 7f310247a740 1 -- 172.21.15.120:0/1378295732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560e45ed3af0 msgr2=0x560e45ed6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.737+0000 7f310247a740 1 --2- 172.21.15.120:0/1378295732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560e45ed3af0 0x560e45ed6560 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f30f402a460 tx=0x7f30f4005850 comp rx=0 tx=0).stop 2024-09-19T05:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.737+0000 7f310247a740 1 -- 172.21.15.120:0/1378295732 shutdown_connections 2024-09-19T05:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.737+0000 7f310247a740 1 --2- 172.21.15.120:0/1378295732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e45edecb0 0x560e45eddb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.737+0000 7f310247a740 1 --2- 172.21.15.120:0/1378295732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e45ed4410 0x560e45edc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.737+0000 7f310247a740 1 --2- 172.21.15.120:0/1378295732 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560e45ed3af0 0x560e45ed6560 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.744 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.737+0000 7f310247a740 1 -- 172.21.15.120:0/1378295732 >> 172.21.15.120:0/1378295732 conn(0x560e45ed0060 msgr2=0x560e45edd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.738+0000 7f310247a740 1 -- 172.21.15.120:0/1378295732 shutdown_connections 2024-09-19T05:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.738+0000 7f310247a740 1 -- 172.21.15.120:0/1378295732 wait complete. 2024-09-19T05:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.738+0000 7f310247a740 1 -- start start 2024-09-19T05:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.738+0000 7f310247a740 1 Processor -- start 2024-09-19T05:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.738+0000 7f310247a740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e45ed3af0 0x560e45ee2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.738+0000 7f310247a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e45ed4410 0x560e45ee2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.739+0000 7f310247a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560e45edecb0 0x560e45f57440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.739+0000 7f310247a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f30f81ae0a0 con 0x560e45edecb0 2024-09-19T05:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.739+0000 7f310247a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f30f81af510 con 0x560e45ed4410 2024-09-19T05:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.739+0000 7f310247a740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f30f81ae770 con 0x560e45ed3af0 2024-09-19T05:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.739+0000 7f30fcc78640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e45ed4410 0x560e45ee2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:54.745 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.739+0000 7f30fcc78640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e45ed4410 0x560e45ee2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:55978/0 (socket says 172.21.15.120:55978) 2024-09-19T05:21:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.739+0000 7f30fcc78640 1 -- 172.21.15.120:0/2462494860 learned_addr learned my addr 172.21.15.120:0/2462494860 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:21:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.739+0000 7f310247a740 10 client.0 _ll_register_callbacks cb 0x7f30e809be20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:21:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.739+0000 7f30fdc7a640 1 --2- 172.21.15.120:0/2462494860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560e45edecb0 0x560e45f57440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.739+0000 7f30fd479640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e45ed3af0 0x560e45ee2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.739+0000 7f30fcc78640 1 -- 172.21.15.120:0/2462494860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e45ed3af0 msgr2=0x560e45ee2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.739+0000 7f30fcc78640 1 --2- 172.21.15.120:0/2462494860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e45ed3af0 0x560e45ee2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.739+0000 7f30fcc78640 1 -- 172.21.15.120:0/2462494860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560e45edecb0 msgr2=0x560e45f57440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:21:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.739+0000 7f30fcc78640 1 --2- 172.21.15.120:0/2462494860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560e45edecb0 0x560e45f57440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.739+0000 7f30fcc78640 1 -- 172.21.15.120:0/2462494860 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e45f57980 con 0x560e45ed4410 2024-09-19T05:21:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.739+0000 7f30fd479640 1 --2- 172.21.15.120:0/2462494860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e45ed3af0 0x560e45ee2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:21:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.739+0000 7f30fcc78640 1 --2- 172.21.15.120:0/2462494860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e45ed4410 0x560e45ee2750 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f30e800e9c0 tx=0x7f30e80bc040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23714f2dba45d34e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:21:54.746 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.739+0000 7f30e0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.740+0000 7f30e0ff9640 1 -- 172.21.15.120:0/2462494860 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e80b4070 con 0x560e45ed4410 2024-09-19T05:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.740+0000 7f310247a740 1 -- 172.21.15.120:0/2462494860 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30f40035f0 con 0x560e45ed4410 2024-09-19T05:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.740+0000 7f30e0ff9640 1 -- 172.21.15.120:0/2462494860 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f30e80cd920 con 0x560e45ed4410 2024-09-19T05:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.740+0000 7f30e0ff9640 1 -- 172.21.15.120:0/2462494860 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f30e8098950 con 0x560e45ed4410 2024-09-19T05:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.740+0000 7f310247a740 10 client.25337 fetch_fsmap learned FSMap version 29 2024-09-19T05:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.740+0000 7f310247a740 1 -- 172.21.15.120:0/2462494860 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560e45f58d70 con 0x560e45ed4410 2024-09-19T05:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.740+0000 7f30e0ff9640 1 -- 172.21.15.120:0/2462494860 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f30f40035f0 con 0x560e45ed4410 2024-09-19T05:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.740+0000 7f30e0ff9640 1 -- 172.21.15.120:0/2462494860 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f30e80a5470 con 0x560e45ed4410 2024-09-19T05:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.741+0000 7f310247a740 10 client.25337 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.741+0000 7f310247a740 10 client.25337 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.741+0000 7f310247a740 20 client.25337 populate_metadata read hostname 'smithi120' 2024-09-19T05:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.741+0000 7f310247a740 1 --2- 172.21.15.120:0/2462494860 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x560e45f59550 0x560e45f5b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.741+0000 7f310247a740 4 client.25337 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:21:54.747 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.741+0000 7f310247a740 1 -- 172.21.15.120:0/2462494860 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560e45e3fd70 con 0x560e45f59550 2024-09-19T05:21:54.748 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.741+0000 7f30fd479640 1 --2- 172.21.15.120:0/2462494860 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x560e45f59550 0x560e45f5b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:21:54.748 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.741+0000 7f30fd479640 1 --2- 172.21.15.120:0/2462494860 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x560e45f59550 0x560e45f5b970 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50cdc850a8fe7240 server_cookie=64f0e3daf23c9e17 in_seq=0 out_seq=0 2024-09-19T05:21:54.748 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.741+0000 7f30e0ff9640 10 client.25337 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:54.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:54 smithi120 ceph-mon[30956]: pgmap v83: 97 pgs: 97 active+clean; 206 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 245 op/s 2024-09-19T05:21:54.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:54 smithi194 ceph-mon[35228]: pgmap v83: 97 pgs: 97 active+clean; 206 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.2 MiB/s wr, 245 op/s 2024-09-19T05:21:54.916 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.914+0000 7f30e0ff9640 1 -- 172.21.15.120:0/2462494860 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560e45e3fd70 con 0x560e45f59550 2024-09-19T05:21:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.914+0000 7f30e0ff9640 10 client.25337 handle_command_reply: tid=0 2024-09-19T05:21:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.914+0000 7f310247a740 1 client.25337 shutdown 2024-09-19T05:21:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.914+0000 7f310247a740 1 -- 172.21.15.120:0/2462494860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e45ed4410 msgr2=0x560e45ee2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.914+0000 7f310247a740 1 --2- 172.21.15.120:0/2462494860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e45ed4410 0x560e45ee2750 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f30e800e9c0 tx=0x7f30e80bc040 comp rx=0 tx=0).stop 2024-09-19T05:21:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.914+0000 7f310247a740 1 -- 172.21.15.120:0/2462494860 shutdown_connections 2024-09-19T05:21:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.914+0000 7f310247a740 1 --2- 172.21.15.120:0/2462494860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560e45edecb0 0x560e45f57440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.914+0000 7f310247a740 1 --2- 172.21.15.120:0/2462494860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e45ed4410 0x560e45ee2750 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.914+0000 7f310247a740 1 --2- 172.21.15.120:0/2462494860 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x560e45f59550 0x560e45f5b970 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.914+0000 7f310247a740 1 --2- 172.21.15.120:0/2462494860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e45ed3af0 0x560e45ee2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.914+0000 7f30e0ff9640 0 client.25337 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:21:54.917 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.914+0000 7f310247a740 1 -- 172.21.15.120:0/2462494860 >> 172.21.15.120:0/2462494860 conn(0x560e45ed0060 msgr2=0x560e45ecf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:54.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.914+0000 7f310247a740 1 -- 172.21.15.120:0/2462494860 shutdown_connections 2024-09-19T05:21:54.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.914+0000 7f310247a740 1 -- 172.21.15.120:0/2462494860 wait complete. 2024-09-19T05:21:54.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.915+0000 7f310247a740 20 client.25337 trim_cache size 0 max 16384 2024-09-19T05:21:54.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:21:54.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:21:54.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:21:54.918 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:21:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.915+0000 7f30ff6dd640 1 -- 172.21.15.120:0/1622192055 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f30e40a34e0 msgr2=0x7f30e40a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.915+0000 7f30ff6dd640 1 --2- 172.21.15.120:0/1622192055 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f30e40a34e0 0x7f30e40a59a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f30f0005c40 tx=0x7f30f0009500 comp rx=0 tx=0).stop 2024-09-19T05:21:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.915+0000 7f30ff6dd640 1 -- 172.21.15.120:0/1622192055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30f8101350 msgr2=0x7f30f81974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:21:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.915+0000 7f30ff6dd640 1 --2- 172.21.15.120:0/1622192055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30f8101350 0x7f30f81974a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f30e800e9f0 tx=0x7f30e800eeb0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.916+0000 7f30ff6dd640 1 -- 172.21.15.120:0/1622192055 shutdown_connections 2024-09-19T05:21:54.919 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.916+0000 7f30ff6dd640 1 --2- 172.21.15.120:0/1622192055 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f30e40a34e0 0x7f30e40a59a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.916+0000 7f30ff6dd640 1 --2- 172.21.15.120:0/1622192055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30f81069c0 0x7f30f81979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.916+0000 7f30ff6dd640 1 --2- 172.21.15.120:0/1622192055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30f8101350 0x7f30f81974a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.916+0000 7f30ff6dd640 1 --2- 172.21.15.120:0/1622192055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30f81009b0 0x7f30f8196f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:21:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.916+0000 7f30ff6dd640 1 -- 172.21.15.120:0/1622192055 >> 172.21.15.120:0/1622192055 conn(0x7f30f8077990 msgr2=0x7f30f81039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:21:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.916+0000 7f30ff6dd640 1 -- 172.21.15.120:0/1622192055 shutdown_connections 2024-09-19T05:21:54.920 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:21:54.916+0000 7f30ff6dd640 1 -- 172.21.15.120:0/1622192055 wait complete. 2024-09-19T05:21:57.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:57 smithi120 ceph-mon[30956]: pgmap v84: 97 pgs: 97 active+clean; 208 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 350 op/s 2024-09-19T05:21:57.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:57 smithi194 ceph-mon[35228]: pgmap v84: 97 pgs: 97 active+clean; 208 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 350 op/s 2024-09-19T05:21:57.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:57 smithi178 ceph-mon[34347]: pgmap v84: 97 pgs: 97 active+clean; 208 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 350 op/s 2024-09-19T05:21:58.314 INFO:tasks.workunit.client.0.smithi120.stdout: 69 14402 114 8874 66 2708 66 2024-09-19T05:21:58.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:21:58 smithi178 ceph-mon[34347]: pgmap v85: 97 pgs: 97 active+clean; 208 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 184 op/s 2024-09-19T05:21:58.767 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:21:58 smithi120 ceph-mon[30956]: pgmap v85: 97 pgs: 97 active+clean; 208 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 184 op/s 2024-09-19T05:21:58.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:21:58 smithi194 ceph-mon[35228]: pgmap v85: 97 pgs: 97 active+clean; 208 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 184 op/s 2024-09-19T05:22:00.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:00 smithi178 ceph-mon[34347]: pgmap v86: 97 pgs: 97 active+clean; 217 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 219 op/s 2024-09-19T05:22:00.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:00 smithi120 ceph-mon[30956]: pgmap v86: 97 pgs: 97 active+clean; 217 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 219 op/s 2024-09-19T05:22:00.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:00 smithi194 ceph-mon[35228]: pgmap v86: 97 pgs: 97 active+clean; 217 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 219 op/s 2024-09-19T05:22:02.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:02 smithi178 ceph-mon[34347]: pgmap v87: 97 pgs: 97 active+clean; 217 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 138 op/s 2024-09-19T05:22:02.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:02 smithi120 ceph-mon[30956]: pgmap v87: 97 pgs: 97 active+clean; 217 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 138 op/s 2024-09-19T05:22:02.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:02 smithi194 ceph-mon[35228]: pgmap v87: 97 pgs: 97 active+clean; 217 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 138 op/s 2024-09-19T05:22:04.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:04 smithi178 ceph-mon[34347]: pgmap v88: 97 pgs: 97 active+clean; 217 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 138 op/s 2024-09-19T05:22:04.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:04 smithi120 ceph-mon[30956]: pgmap v88: 97 pgs: 97 active+clean; 217 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 138 op/s 2024-09-19T05:22:04.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:04 smithi194 ceph-mon[35228]: pgmap v88: 97 pgs: 97 active+clean; 217 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 138 op/s 2024-09-19T05:22:06.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:06 smithi178 ceph-mon[34347]: pgmap v89: 97 pgs: 97 active+clean; 226 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 190 op/s 2024-09-19T05:22:06.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:06 smithi120 ceph-mon[30956]: pgmap v89: 97 pgs: 97 active+clean; 226 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 190 op/s 2024-09-19T05:22:06.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:06 smithi194 ceph-mon[35228]: pgmap v89: 97 pgs: 97 active+clean; 226 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 190 op/s 2024-09-19T05:22:08.042 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.040+0000 7f0e3114b640 1 -- 172.21.15.120:0/2357604745 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e2c10c0b0 msgr2=0x7f0e2c10e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:08.042 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.040+0000 7f0e3114b640 1 --2- 172.21.15.120:0/2357604745 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e2c10c0b0 0x7f0e2c10e550 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0e24009ca0 tx=0x7f0e2402a950 comp rx=0 tx=0).stop 2024-09-19T05:22:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.040+0000 7f0e3114b640 1 -- 172.21.15.120:0/2357604745 shutdown_connections 2024-09-19T05:22:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.040+0000 7f0e3114b640 1 --2- 172.21.15.120:0/2357604745 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e2c10c0b0 0x7f0e2c10e550 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.040+0000 7f0e3114b640 1 --2- 172.21.15.120:0/2357604745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e2c103600 0x7f0e2c10bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.040+0000 7f0e3114b640 1 --2- 172.21.15.120:0/2357604745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e2c102ce0 0x7f0e2c1030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.040+0000 7f0e3114b640 1 -- 172.21.15.120:0/2357604745 >> 172.21.15.120:0/2357604745 conn(0x7f0e2c077990 msgr2=0x7f0e2c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.040+0000 7f0e3114b640 1 -- 172.21.15.120:0/2357604745 shutdown_connections 2024-09-19T05:22:08.043 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.040+0000 7f0e3114b640 1 -- 172.21.15.120:0/2357604745 wait complete. 2024-09-19T05:22:08.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.041+0000 7f0e3114b640 1 Processor -- start 2024-09-19T05:22:08.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.041+0000 7f0e3114b640 1 -- start start 2024-09-19T05:22:08.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.041+0000 7f0e3114b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e2c102ce0 0x7f0e2c108010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:08.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.041+0000 7f0e3114b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e2c103600 0x7f0e2c108550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:08.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.042+0000 7f0e3114b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e2c10c0b0 0x7f0e2c1aa690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:08.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.042+0000 7f0e3114b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c1018b0 con 0x7f0e2c102ce0 2024-09-19T05:22:08.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.042+0000 7f0e3114b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c101730 con 0x7f0e2c103600 2024-09-19T05:22:08.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.042+0000 7f0e3114b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c101a30 con 0x7f0e2c10c0b0 2024-09-19T05:22:08.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.042+0000 7f0e2ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e2c102ce0 0x7f0e2c108010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:08.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.042+0000 7f0e2ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e2c102ce0 0x7f0e2c108010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42418/0 (socket says 172.21.15.120:42418) 2024-09-19T05:22:08.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.042+0000 7f0e2ad9d640 1 -- 172.21.15.120:0/903300824 learned_addr learned my addr 172.21.15.120:0/903300824 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:08.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.042+0000 7f0e2b59e640 1 --2- 172.21.15.120:0/903300824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e2c10c0b0 0x7f0e2c1aa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:08.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.042+0000 7f0e2a59c640 1 --2- 172.21.15.120:0/903300824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e2c103600 0x7f0e2c108550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:08.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.042+0000 7f0e2ad9d640 1 -- 172.21.15.120:0/903300824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e2c10c0b0 msgr2=0x7f0e2c1aa690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:08.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.042+0000 7f0e2ad9d640 1 --2- 172.21.15.120:0/903300824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e2c10c0b0 0x7f0e2c1aa690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:08.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.042+0000 7f0e2ad9d640 1 -- 172.21.15.120:0/903300824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e2c103600 msgr2=0x7f0e2c108550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:08.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.042+0000 7f0e2ad9d640 1 --2- 172.21.15.120:0/903300824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e2c103600 0x7f0e2c108550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:08.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.042+0000 7f0e2ad9d640 1 -- 172.21.15.120:0/903300824 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e2c1aabd0 con 0x7f0e2c102ce0 2024-09-19T05:22:08.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.042+0000 7f0e2a59c640 1 --2- 172.21.15.120:0/903300824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e2c103600 0x7f0e2c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:22:08.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.042+0000 7f0e2b59e640 1 --2- 172.21.15.120:0/903300824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e2c10c0b0 0x7f0e2c1aa690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:08.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.042+0000 7f0e2ad9d640 1 --2- 172.21.15.120:0/903300824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e2c102ce0 0x7f0e2c108010 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00e9f0 tx=0x7f0e1c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:08.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.043+0000 7f0e13fff640 1 -- 172.21.15.120:0/903300824 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c00cd80 con 0x7f0e2c102ce0 2024-09-19T05:22:08.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.043+0000 7f0e3114b640 1 -- 172.21.15.120:0/903300824 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e2c1aada0 con 0x7f0e2c102ce0 2024-09-19T05:22:08.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.043+0000 7f0e13fff640 1 -- 172.21.15.120:0/903300824 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0e1c0108e0 con 0x7f0e2c102ce0 2024-09-19T05:22:08.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.043+0000 7f0e13fff640 1 -- 172.21.15.120:0/903300824 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c018920 con 0x7f0e2c102ce0 2024-09-19T05:22:08.047 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.043+0000 7f0e3114b640 1 -- 172.21.15.120:0/903300824 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e2c1ab2c0 con 0x7f0e2c102ce0 2024-09-19T05:22:08.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.046+0000 7f0e13fff640 1 -- 172.21.15.120:0/903300824 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f0e1c010a90 con 0x7f0e2c102ce0 2024-09-19T05:22:08.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.046+0000 7f0e33b22740 1 Processor -- start 2024-09-19T05:22:08.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.046+0000 7f0e33b22740 1 -- start start 2024-09-19T05:22:08.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.047+0000 7f0e33b22740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f690969af0 0x55f690969ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:08.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.047+0000 7f0e33b22740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f69096a410 0x55f690974770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:08.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.047+0000 7f0e33b22740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f690974cb0 0x55f6909770a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:08.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.047+0000 7f0e33b22740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f6908ce2f0 con 0x55f690969af0 2024-09-19T05:22:08.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.047+0000 7f0e33b22740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55f690876270 con 0x55f69096a410 2024-09-19T05:22:08.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.047+0000 7f0e33b22740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55f6908ca2b0 con 0x55f690974cb0 2024-09-19T05:22:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.047+0000 7f0e2b59e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f690969af0 0x55f690969ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.047+0000 7f0e13fff640 1 --2- 172.21.15.120:0/903300824 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0e140a3460 0x7f0e140a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.047+0000 7f0e2ad9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f69096a410 0x55f690974770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.047+0000 7f0e2b59e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f690969af0 0x55f690969ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42432/0 (socket says 172.21.15.120:42432) 2024-09-19T05:22:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.047+0000 7f0e2b59e640 1 -- 172.21.15.120:0/2745405881 learned_addr learned my addr 172.21.15.120:0/2745405881 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.047+0000 7f0e2a59c640 1 --2- 172.21.15.120:0/2745405881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f690974cb0 0x55f6909770a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.047+0000 7f0e13fff640 1 -- 172.21.15.120:0/903300824 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f0e1c0d00f0 con 0x7f0e2c102ce0 2024-09-19T05:22:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.047+0000 7f0e2ad9d640 1 -- 172.21.15.120:0/2745405881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f690974cb0 msgr2=0x55f6909770a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.047+0000 7f0e2ad9d640 1 --2- 172.21.15.120:0/2745405881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f690974cb0 0x55f6909770a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.047+0000 7f0e2ad9d640 1 -- 172.21.15.120:0/2745405881 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f690969af0 msgr2=0x55f690969ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.047+0000 7f0e2ad9d640 1 --2- 172.21.15.120:0/2745405881 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f690969af0 0x55f690969ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.047+0000 7f0e2ad9d640 1 -- 172.21.15.120:0/2745405881 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f690875340 con 0x55f69096a410 2024-09-19T05:22:08.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.047+0000 7f0e2b59e640 1 --2- 172.21.15.120:0/2745405881 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f690969af0 0x55f690969ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:08.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.048+0000 7f0e2b59e640 1 --2- 172.21.15.120:0/903300824 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0e140a3460 0x7f0e140a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:08.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.048+0000 7f0e2ad9d640 1 --2- 172.21.15.120:0/2745405881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f69096a410 0x55f690974770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0cd7f0 tx=0x7f0e1c09bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b61733f8024fb5a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:08.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.048+0000 7f0e117fa640 1 -- 172.21.15.120:0/2745405881 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c09c380 con 0x55f69096a410 2024-09-19T05:22:08.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.048+0000 7f0e117fa640 1 -- 172.21.15.120:0/2745405881 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0e1c0a0730 con 0x55f69096a410 2024-09-19T05:22:08.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.048+0000 7f0e117fa640 1 -- 172.21.15.120:0/2745405881 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c09b7d0 con 0x55f69096a410 2024-09-19T05:22:08.055 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.049+0000 7f0e33b22740 1 -- 172.21.15.120:0/2745405881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f69096a410 msgr2=0x55f690974770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:08.055 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.049+0000 7f0e2b59e640 1 --2- 172.21.15.120:0/903300824 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0e140a3460 0x7f0e140a5920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0e2402fc80 tx=0x7f0e2403c040 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:08.055 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.049+0000 7f0e33b22740 1 --2- 172.21.15.120:0/2745405881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f69096a410 0x55f690974770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0cd7f0 tx=0x7f0e1c09bce0 comp rx=0 tx=0).stop 2024-09-19T05:22:08.055 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.049+0000 7f0e33b22740 1 -- 172.21.15.120:0/2745405881 shutdown_connections 2024-09-19T05:22:08.055 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.049+0000 7f0e33b22740 1 --2- 172.21.15.120:0/2745405881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f690974cb0 0x55f6909770a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:08.055 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.049+0000 7f0e33b22740 1 --2- 172.21.15.120:0/2745405881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f69096a410 0x55f690974770 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:08.055 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.049+0000 7f0e33b22740 1 --2- 172.21.15.120:0/2745405881 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f690969af0 0x55f690969ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:08.055 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.049+0000 7f0e33b22740 1 -- 172.21.15.120:0/2745405881 >> 172.21.15.120:0/2745405881 conn(0x55f690966060 msgr2=0x55f690966440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:08.055 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.049+0000 7f0e33b22740 1 -- 172.21.15.120:0/2745405881 shutdown_connections 2024-09-19T05:22:08.055 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.049+0000 7f0e33b22740 1 -- 172.21.15.120:0/2745405881 wait complete. 2024-09-19T05:22:08.055 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.049+0000 7f0e33b22740 1 -- start start 2024-09-19T05:22:08.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.049+0000 7f0e33b22740 1 Processor -- start 2024-09-19T05:22:08.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.050+0000 7f0e33b22740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f690969af0 0x55f690971b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:08.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.050+0000 7f0e2ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f690969af0 0x55f690971b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:08.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.050+0000 7f0e2ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f690969af0 0x55f690971b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42438/0 (socket says 172.21.15.120:42438) 2024-09-19T05:22:08.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.050+0000 7f0e2ad9d640 1 -- 172.21.15.120:0/3775133245 learned_addr learned my addr 172.21.15.120:0/3775133245 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:08.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.050+0000 7f0e33b22740 1 --2- 172.21.15.120:0/3775133245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f69096a410 0x55f6909720c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:08.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.050+0000 7f0e33b22740 1 --2- 172.21.15.120:0/3775133245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f690974cb0 0x55f690972600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:08.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.050+0000 7f0e33b22740 1 -- 172.21.15.120:0/3775133245 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f690977920 con 0x55f690969af0 2024-09-19T05:22:08.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.050+0000 7f0e33b22740 1 -- 172.21.15.120:0/3775133245 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55f690857290 con 0x55f690974cb0 2024-09-19T05:22:08.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.050+0000 7f0e33b22740 1 -- 172.21.15.120:0/3775133245 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55f690977aa0 con 0x55f69096a410 2024-09-19T05:22:08.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.050+0000 7f0e33b22740 10 client.0 _ll_register_callbacks cb 0x55f690888140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:22:08.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.050+0000 7f0e2a59c640 1 --2- 172.21.15.120:0/3775133245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f69096a410 0x55f6909720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:08.056 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.050+0000 7f0e2b59e640 1 --2- 172.21.15.120:0/3775133245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f690974cb0 0x55f690972600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:08.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.050+0000 7f0e2ad9d640 1 -- 172.21.15.120:0/3775133245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f69096a410 msgr2=0x55f6909720c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:08.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.050+0000 7f0e2ad9d640 1 --2- 172.21.15.120:0/3775133245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f69096a410 0x55f6909720c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:08.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.050+0000 7f0e2ad9d640 1 -- 172.21.15.120:0/3775133245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f690974cb0 msgr2=0x55f690972600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:08.057 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.050+0000 7f0e2ad9d640 1 --2- 172.21.15.120:0/3775133245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f690974cb0 0x55f690972600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:08.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.051+0000 7f0e2ad9d640 1 -- 172.21.15.120:0/3775133245 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6905e1210 con 0x55f690969af0 2024-09-19T05:22:08.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.051+0000 7f0e2ad9d640 1 --2- 172.21.15.120:0/3775133245 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f690969af0 0x55f690971b80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c09c080 tx=0x7f0e1c0989f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6d78f2c68d2555 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:08.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.051+0000 7f0e0eff5640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:22:08.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.051+0000 7f0e0eff5640 1 -- 172.21.15.120:0/3775133245 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c010630 con 0x55f690969af0 2024-09-19T05:22:08.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.051+0000 7f0e0eff5640 1 -- 172.21.15.120:0/3775133245 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f0e1c09b7d0 con 0x55f690969af0 2024-09-19T05:22:08.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.051+0000 7f0e33b22740 1 -- 172.21.15.120:0/3775133245 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e1c0a0730 con 0x55f690969af0 2024-09-19T05:22:08.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.051+0000 7f0e0eff5640 1 -- 172.21.15.120:0/3775133245 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0e1c09b9d0 con 0x55f690969af0 2024-09-19T05:22:08.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.051+0000 7f0e33b22740 10 client.15897 fetch_fsmap learned FSMap version 29 2024-09-19T05:22:08.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.051+0000 7f0e33b22740 1 -- 172.21.15.120:0/3775133245 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f6906ad620 con 0x55f690969af0 2024-09-19T05:22:08.058 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.052+0000 7f0e0eff5640 1 -- 172.21.15.120:0/3775133245 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0e1c0a0730 con 0x55f690969af0 2024-09-19T05:22:08.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.052+0000 7f0e0eff5640 1 -- 172.21.15.120:0/3775133245 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f0e1c0bc110 con 0x55f690969af0 2024-09-19T05:22:08.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.052+0000 7f0e33b22740 10 client.15897 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:22:08.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.052+0000 7f0e33b22740 10 client.15897 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:22:08.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.052+0000 7f0e33b22740 20 client.15897 populate_metadata read hostname 'smithi120' 2024-09-19T05:22:08.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.052+0000 7f0e33b22740 1 --2- 172.21.15.120:0/3775133245 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55f690984e00 0x55f690987220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:08.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.052+0000 7f0e33b22740 4 client.15897 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:22:08.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.052+0000 7f0e33b22740 1 -- 172.21.15.120:0/3775133245 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6908dba20 con 0x55f690984e00 2024-09-19T05:22:08.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.052+0000 7f0e2a59c640 1 --2- 172.21.15.120:0/3775133245 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55f690984e00 0x55f690987220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:08.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.053+0000 7f0e0eff5640 10 client.15897 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:22:08.059 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.053+0000 7f0e2a59c640 1 --2- 172.21.15.120:0/3775133245 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55f690984e00 0x55f690987220 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d90859d60268798 server_cookie=5e63baf451808f98 in_seq=0 out_seq=0 2024-09-19T05:22:08.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.053+0000 7f0e0eff5640 1 -- 172.21.15.120:0/3775133245 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f6908dba20 con 0x55f690984e00 2024-09-19T05:22:08.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.053+0000 7f0e0eff5640 10 client.15897 handle_command_reply: tid=0 2024-09-19T05:22:08.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.053+0000 7f0e33b22740 1 client.15897 shutdown 2024-09-19T05:22:08.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.054+0000 7f0e33b22740 1 -- 172.21.15.120:0/3775133245 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f690969af0 msgr2=0x55f690971b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:08.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.054+0000 7f0e33b22740 1 --2- 172.21.15.120:0/3775133245 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f690969af0 0x55f690971b80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c09c080 tx=0x7f0e1c0989f0 comp rx=0 tx=0).stop 2024-09-19T05:22:08.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.054+0000 7f0e33b22740 1 -- 172.21.15.120:0/3775133245 shutdown_connections 2024-09-19T05:22:08.061 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.054+0000 7f0e33b22740 1 --2- 172.21.15.120:0/3775133245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f690974cb0 0x55f690972600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:08.062 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.054+0000 7f0e33b22740 1 --2- 172.21.15.120:0/3775133245 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55f690984e00 0x55f690987220 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:08.062 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.054+0000 7f0e33b22740 1 --2- 172.21.15.120:0/3775133245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f69096a410 0x55f6909720c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:08.062 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.054+0000 7f0e33b22740 1 --2- 172.21.15.120:0/3775133245 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f690969af0 0x55f690971b80 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:08.062 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.054+0000 7f0e33b22740 1 -- 172.21.15.120:0/3775133245 >> 172.21.15.120:0/3775133245 conn(0x55f690966060 msgr2=0x55f69096bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:08.062 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.054+0000 7f0e0eff5640 0 client.15897 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:22:08.062 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.054+0000 7f0e33b22740 1 -- 172.21.15.120:0/3775133245 shutdown_connections 2024-09-19T05:22:08.062 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.054+0000 7f0e33b22740 1 -- 172.21.15.120:0/3775133245 wait complete. 2024-09-19T05:22:08.062 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.054+0000 7f0e33b22740 20 client.15897 trim_cache size 0 max 16384 2024-09-19T05:22:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.077+0000 7f0e33b22740 1 Processor -- start 2024-09-19T05:22:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.077+0000 7f0e33b22740 1 -- start start 2024-09-19T05:22:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.078+0000 7f0e33b22740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f690969af0 0x55f690972430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:08.080 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.078+0000 7f0e33b22740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f69096a410 0x55f690973af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:08.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.078+0000 7f0e33b22740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f690974cb0 0x55f69098caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:08.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.078+0000 7f0e33b22740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c1b6800 con 0x55f690974cb0 2024-09-19T05:22:08.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.078+0000 7f0e33b22740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c1b40d0 con 0x55f690969af0 2024-09-19T05:22:08.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.078+0000 7f0e33b22740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c1b1f20 con 0x55f69096a410 2024-09-19T05:22:08.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.078+0000 7f0e2b59e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f690974cb0 0x55f69098caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:08.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.078+0000 7f0e2a59c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f69096a410 0x55f690973af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:08.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.078+0000 7f0e2a59c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f69096a410 0x55f690973af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:40178/0 (socket says 172.21.15.120:40178) 2024-09-19T05:22:08.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.078+0000 7f0e2b59e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f690974cb0 0x55f69098caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42442/0 (socket says 172.21.15.120:42442) 2024-09-19T05:22:08.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.078+0000 7f0e2a59c640 1 -- 172.21.15.120:0/3019782202 learned_addr learned my addr 172.21.15.120:0/3019782202 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:08.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.078+0000 7f0e2a59c640 1 -- 172.21.15.120:0/3019782202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f690969af0 msgr2=0x55f690972430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:08.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.078+0000 7f0e2a59c640 1 --2- 172.21.15.120:0/3019782202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f690969af0 0x55f690972430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:08.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.078+0000 7f0e2a59c640 1 -- 172.21.15.120:0/3019782202 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f690974cb0 msgr2=0x55f69098caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:08.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.078+0000 7f0e2a59c640 1 --2- 172.21.15.120:0/3019782202 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f690974cb0 0x55f69098caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:08.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.078+0000 7f0e2a59c640 1 -- 172.21.15.120:0/3019782202 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f690970b10 con 0x55f69096a410 2024-09-19T05:22:08.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.079+0000 7f0e2a59c640 1 --2- 172.21.15.120:0/3019782202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f69096a410 0x55f690973af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55f69096c690 tx=0x7f0e20009c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=175d469f7c1a6239 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:08.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.079+0000 7f0e10ff9640 1 -- 172.21.15.120:0/3019782202 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e20004230 con 0x55f69096a410 2024-09-19T05:22:08.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.079+0000 7f0e10ff9640 1 -- 172.21.15.120:0/3019782202 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0e200043d0 con 0x55f69096a410 2024-09-19T05:22:08.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.079+0000 7f0e10ff9640 1 -- 172.21.15.120:0/3019782202 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e2001e890 con 0x55f69096a410 2024-09-19T05:22:08.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.080+0000 7f0e33b22740 1 -- 172.21.15.120:0/3019782202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f69096a410 msgr2=0x55f690973af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:08.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.080+0000 7f0e33b22740 1 --2- 172.21.15.120:0/3019782202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f69096a410 0x55f690973af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55f69096c690 tx=0x7f0e20009c70 comp rx=0 tx=0).stop 2024-09-19T05:22:08.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.080+0000 7f0e33b22740 1 -- 172.21.15.120:0/3019782202 shutdown_connections 2024-09-19T05:22:08.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.080+0000 7f0e33b22740 1 --2- 172.21.15.120:0/3019782202 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f690974cb0 0x55f69098caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:08.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.080+0000 7f0e33b22740 1 --2- 172.21.15.120:0/3019782202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f69096a410 0x55f690973af0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:08.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.080+0000 7f0e33b22740 1 --2- 172.21.15.120:0/3019782202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f690969af0 0x55f690972430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:08.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.080+0000 7f0e33b22740 1 -- 172.21.15.120:0/3019782202 >> 172.21.15.120:0/3019782202 conn(0x55f690966060 msgr2=0x55f6909733e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:08.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.080+0000 7f0e33b22740 1 -- 172.21.15.120:0/3019782202 shutdown_connections 2024-09-19T05:22:08.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.080+0000 7f0e33b22740 1 -- 172.21.15.120:0/3019782202 wait complete. 2024-09-19T05:22:08.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.080+0000 7f0e33b22740 1 -- start start 2024-09-19T05:22:08.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.080+0000 7f0e33b22740 1 Processor -- start 2024-09-19T05:22:08.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.081+0000 7f0e33b22740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f690969af0 0x55f690977cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:08.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.081+0000 7f0e33b22740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f69096a410 0x55f690978230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:08.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.081+0000 7f0e33b22740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f690974cb0 0x55f690978770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:08.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.081+0000 7f0e33b22740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c1b2590 con 0x55f69096a410 2024-09-19T05:22:08.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.081+0000 7f0e33b22740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c1b3a00 con 0x55f690974cb0 2024-09-19T05:22:08.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.081+0000 7f0e33b22740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c1b2c60 con 0x55f690969af0 2024-09-19T05:22:08.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.081+0000 7f0e2ad9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f690969af0 0x55f690977cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:08.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.081+0000 7f0e33b22740 10 client.0 _ll_register_callbacks cb 0x7f0e1c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:22:08.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.081+0000 7f0e2ad9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f690969af0 0x55f690977cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:40180/0 (socket says 172.21.15.120:40180) 2024-09-19T05:22:08.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.081+0000 7f0e2a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f69096a410 0x55f690978230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:08.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.081+0000 7f0e2ad9d640 1 -- 172.21.15.120:0/2506983113 learned_addr learned my addr 172.21.15.120:0/2506983113 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:08.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.081+0000 7f0e2b59e640 1 --2- 172.21.15.120:0/2506983113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f690974cb0 0x55f690978770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:08.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.081+0000 7f0e2ad9d640 1 -- 172.21.15.120:0/2506983113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f690974cb0 msgr2=0x55f690978770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:08.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.081+0000 7f0e2ad9d640 1 --2- 172.21.15.120:0/2506983113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f690974cb0 0x55f690978770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:08.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.081+0000 7f0e2ad9d640 1 -- 172.21.15.120:0/2506983113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f69096a410 msgr2=0x55f690978230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:08.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.081+0000 7f0e2ad9d640 1 --2- 172.21.15.120:0/2506983113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f69096a410 0x55f690978230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:08.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.081+0000 7f0e2ad9d640 1 -- 172.21.15.120:0/2506983113 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6909edb80 con 0x55f690969af0 2024-09-19T05:22:08.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.081+0000 7f0e2b59e640 1 --2- 172.21.15.120:0/2506983113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f690974cb0 0x55f690978770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:22:08.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.082+0000 7f0e2ad9d640 1 --2- 172.21.15.120:0/2506983113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f690969af0 0x55f690977cf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0987e0 tx=0x7f0e1c0984a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1daa3e14b12874f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:08.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.082+0000 7f0e0eff5640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:22:08.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.082+0000 7f0e0eff5640 1 -- 172.21.15.120:0/2506983113 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c098620 con 0x55f690969af0 2024-09-19T05:22:08.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.082+0000 7f0e0eff5640 1 -- 172.21.15.120:0/2506983113 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f0e1c010640 con 0x55f690969af0 2024-09-19T05:22:08.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.082+0000 7f0e33b22740 1 -- 172.21.15.120:0/2506983113 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e200043d0 con 0x55f690969af0 2024-09-19T05:22:08.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.082+0000 7f0e0eff5640 1 -- 172.21.15.120:0/2506983113 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0e1c010de0 con 0x55f690969af0 2024-09-19T05:22:08.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.082+0000 7f0e33b22740 10 client.25426 fetch_fsmap learned FSMap version 29 2024-09-19T05:22:08.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.082+0000 7f0e33b22740 1 -- 172.21.15.120:0/2506983113 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f6909eee70 con 0x55f690969af0 2024-09-19T05:22:08.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.082+0000 7f0e0eff5640 1 -- 172.21.15.120:0/2506983113 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0e200043d0 con 0x55f690969af0 2024-09-19T05:22:08.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.082+0000 7f0e0eff5640 1 -- 172.21.15.120:0/2506983113 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f0e1c01ab80 con 0x55f690969af0 2024-09-19T05:22:08.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.082+0000 7f0e33b22740 10 client.25426 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:22:08.090 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.082+0000 7f0e33b22740 10 client.25426 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:22:08.090 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.082+0000 7f0e33b22740 20 client.25426 populate_metadata read hostname 'smithi120' 2024-09-19T05:22:08.090 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.082+0000 7f0e33b22740 1 --2- 172.21.15.120:0/2506983113 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55f6909ef3d0 0x55f6909f17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:08.090 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.082+0000 7f0e33b22740 4 client.25426 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:22:08.090 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.082+0000 7f0e33b22740 1 -- 172.21.15.120:0/2506983113 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f6908d5d70 con 0x55f6909ef3d0 2024-09-19T05:22:08.090 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.083+0000 7f0e2a59c640 1 --2- 172.21.15.120:0/2506983113 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55f6909ef3d0 0x55f6909f17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:08.090 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.083+0000 7f0e0eff5640 10 client.25426 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:22:08.090 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:08.083+0000 7f0e2a59c640 1 --2- 172.21.15.120:0/2506983113 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55f6909ef3d0 0x55f6909f17f0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9be114bcbcaf2112 server_cookie=e1aed73034ab7d81 in_seq=0 out_seq=0 2024-09-19T05:22:08.314 INFO:tasks.workunit.client.0.smithi120.stdout: 70 14966 76 9520 27 2747 60 2024-09-19T05:22:08.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:08 smithi178 ceph-mon[34347]: pgmap v90: 97 pgs: 97 active+clean; 226 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 85 op/s 2024-09-19T05:22:08.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:08 smithi120 ceph-mon[30956]: pgmap v90: 97 pgs: 97 active+clean; 226 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 85 op/s 2024-09-19T05:22:08.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:08 smithi194 ceph-mon[35228]: pgmap v90: 97 pgs: 97 active+clean; 226 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 85 op/s 2024-09-19T05:22:09.741 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T05:22:10.094 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:22:10.550 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:10 smithi120 ceph-mon[30956]: pgmap v91: 97 pgs: 97 active+clean; 237 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 160 op/s 2024-09-19T05:22:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.669+0000 7ff8af046640 1 -- 172.21.15.120:0/4243271871 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8a81008c0 msgr2=0x7ff8a8100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.669+0000 7ff8af046640 1 --2- 172.21.15.120:0/4243271871 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8a81008c0 0x7ff8a8100ca0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff89c009900 tx=0x7ff89c02a410 comp rx=0 tx=0).stop 2024-09-19T05:22:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.669+0000 7ff8af046640 1 -- 172.21.15.120:0/4243271871 shutdown_connections 2024-09-19T05:22:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.669+0000 7ff8af046640 1 --2- 172.21.15.120:0/4243271871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8a8105ec0 0x7ff8a8106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.669+0000 7ff8af046640 1 --2- 172.21.15.120:0/4243271871 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8a81011e0 0x7ff8a8105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.669+0000 7ff8af046640 1 --2- 172.21.15.120:0/4243271871 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8a81008c0 0x7ff8a8100ca0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.669+0000 7ff8af046640 1 -- 172.21.15.120:0/4243271871 >> 172.21.15.120:0/4243271871 conn(0x7ff8a80fc7d0 msgr2=0x7ff8a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.670+0000 7ff8af046640 1 -- 172.21.15.120:0/4243271871 shutdown_connections 2024-09-19T05:22:10.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.670+0000 7ff8af046640 1 -- 172.21.15.120:0/4243271871 wait complete. 2024-09-19T05:22:10.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.671+0000 7ff8af046640 1 Processor -- start 2024-09-19T05:22:10.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.671+0000 7ff8af046640 1 -- start start 2024-09-19T05:22:10.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.671+0000 7ff8af046640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8a81008c0 0x7ff8a81a4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:10.673 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.671+0000 7ff8af046640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8a81011e0 0x7ff8a81a4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:10.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.672+0000 7ff8af046640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8a8105ec0 0x7ff8a819e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:10.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.672+0000 7ff8af046640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a81184e0 con 0x7ff8a81011e0 2024-09-19T05:22:10.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.672+0000 7ff8af046640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a8118360 con 0x7ff8a8105ec0 2024-09-19T05:22:10.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.672+0000 7ff8af046640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a8118660 con 0x7ff8a81008c0 2024-09-19T05:22:10.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.672+0000 7ff8a7fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8a81011e0 0x7ff8a81a4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:10.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.672+0000 7ff8a7fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8a81011e0 0x7ff8a81a4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42470/0 (socket says 172.21.15.120:42470) 2024-09-19T05:22:10.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.672+0000 7ff8a7fff640 1 -- 172.21.15.120:0/1509970436 learned_addr learned my addr 172.21.15.120:0/1509970436 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:10.674 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.672+0000 7ff8ad5e3640 1 --2- 172.21.15.120:0/1509970436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8a8105ec0 0x7ff8a819e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:10.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.672+0000 7ff8acde2640 1 --2- 172.21.15.120:0/1509970436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8a81008c0 0x7ff8a81a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:10.675 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.672+0000 7ff8ad5e3640 1 -- 172.21.15.120:0/1509970436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8a81008c0 msgr2=0x7ff8a81a4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:10.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.672+0000 7ff8ad5e3640 1 --2- 172.21.15.120:0/1509970436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8a81008c0 0x7ff8a81a4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.672+0000 7ff8ad5e3640 1 -- 172.21.15.120:0/1509970436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8a81011e0 msgr2=0x7ff8a81a4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:10.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.672+0000 7ff8ad5e3640 1 --2- 172.21.15.120:0/1509970436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8a81011e0 0x7ff8a81a4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.672+0000 7ff8ad5e3640 1 -- 172.21.15.120:0/1509970436 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8a819f060 con 0x7ff8a8105ec0 2024-09-19T05:22:10.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.672+0000 7ff8acde2640 1 --2- 172.21.15.120:0/1509970436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8a81008c0 0x7ff8a81a4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:22:10.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.672+0000 7ff8ad5e3640 1 --2- 172.21.15.120:0/1509970436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8a8105ec0 0x7ff8a819e930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009fd0 tx=0x7ff8a000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:10.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.673+0000 7ff8a5ffb640 1 -- 172.21.15.120:0/1509970436 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a000ce20 con 0x7ff8a8105ec0 2024-09-19T05:22:10.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.673+0000 7ff8a5ffb640 1 -- 172.21.15.120:0/1509970436 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff8a0005020 con 0x7ff8a8105ec0 2024-09-19T05:22:10.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.673+0000 7ff8a5ffb640 1 -- 172.21.15.120:0/1509970436 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0010690 con 0x7ff8a8105ec0 2024-09-19T05:22:10.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.673+0000 7ff8af046640 1 -- 172.21.15.120:0/1509970436 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8a819f350 con 0x7ff8a8105ec0 2024-09-19T05:22:10.676 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.673+0000 7ff8af046640 1 -- 172.21.15.120:0/1509970436 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8a81ab640 con 0x7ff8a8105ec0 2024-09-19T05:22:10.678 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.676+0000 7ff8a5ffb640 1 -- 172.21.15.120:0/1509970436 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7ff8a00051d0 con 0x7ff8a8105ec0 2024-09-19T05:22:10.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.677+0000 7ff8a5ffb640 1 --2- 172.21.15.120:0/1509970436 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ff8980a3430 0x7ff8980a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:10.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.677+0000 7ff8a5ffb640 1 -- 172.21.15.120:0/1509970436 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7ff8a00d03e0 con 0x7ff8a8105ec0 2024-09-19T05:22:10.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.677+0000 7ff8acde2640 1 --2- 172.21.15.120:0/1509970436 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ff8980a3430 0x7ff8980a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:10.679 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.677+0000 7ff8b141f740 1 Processor -- start 2024-09-19T05:22:10.680 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.677+0000 7ff8b141f740 1 -- start start 2024-09-19T05:22:10.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.678+0000 7ff8b141f740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8f4bbc4a0 0x55b8f4bbc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:10.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.678+0000 7ff8b141f740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b8f4bbcdc0 0x55b8f4bc7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:10.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.678+0000 7ff8b141f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b8f4bc7680 0x55b8f4bc9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:10.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.678+0000 7ff8b141f740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b8f4b222e0 con 0x55b8f4bbcdc0 2024-09-19T05:22:10.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.678+0000 7ff8b141f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55b8f4ac9ce0 con 0x55b8f4bc7680 2024-09-19T05:22:10.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.678+0000 7ff8b141f740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55b8f4b1e2a0 con 0x55b8f4bbc4a0 2024-09-19T05:22:10.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.678+0000 7ff8ad5e3640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b8f4bc7680 0x55b8f4bc9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:10.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.678+0000 7ff8ad5e3640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b8f4bc7680 0x55b8f4bc9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:43404/0 (socket says 172.21.15.120:43404) 2024-09-19T05:22:10.681 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.678+0000 7ff8ad5e3640 1 -- 172.21.15.120:0/1784514036 learned_addr learned my addr 172.21.15.120:0/1784514036 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:10.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.678+0000 7ff8a7fff640 1 --2- 172.21.15.120:0/1784514036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b8f4bbcdc0 0x55b8f4bc7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:10.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.678+0000 7ff8acde2640 1 --2- 172.21.15.120:0/1784514036 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8f4bbc4a0 0x55b8f4bbc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:10.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.678+0000 7ff8acde2640 1 --2- 172.21.15.120:0/1509970436 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ff8980a3430 0x7ff8980a58f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff89c000c00 tx=0x7ff89c005a20 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:10.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.678+0000 7ff8ad5e3640 1 -- 172.21.15.120:0/1784514036 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8f4bbc4a0 msgr2=0x55b8f4bbc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:10.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.678+0000 7ff8ad5e3640 1 --2- 172.21.15.120:0/1784514036 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8f4bbc4a0 0x55b8f4bbc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.678+0000 7ff8ad5e3640 1 -- 172.21.15.120:0/1784514036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b8f4bbcdc0 msgr2=0x55b8f4bc7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:10.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.678+0000 7ff8ad5e3640 1 --2- 172.21.15.120:0/1784514036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b8f4bbcdc0 0x55b8f4bc7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.678+0000 7ff8ad5e3640 1 -- 172.21.15.120:0/1784514036 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8f4aae440 con 0x55b8f4bc7680 2024-09-19T05:22:10.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.679+0000 7ff8ad5e3640 1 --2- 172.21.15.120:0/1784514036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b8f4bc7680 0x55b8f4bc9a70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff8a00a4db0 tx=0x7ff8a009ceb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d829420e98bdf1e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:10.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.679+0000 7ff892ffd640 1 -- 172.21.15.120:0/1784514036 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a009a970 con 0x55b8f4bc7680 2024-09-19T05:22:10.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.679+0000 7ff892ffd640 1 -- 172.21.15.120:0/1784514036 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff8a00b5070 con 0x55b8f4bc7680 2024-09-19T05:22:10.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.679+0000 7ff892ffd640 1 -- 172.21.15.120:0/1784514036 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00a4e50 con 0x55b8f4bc7680 2024-09-19T05:22:10.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.680+0000 7ff8b141f740 1 -- 172.21.15.120:0/1784514036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b8f4bc7680 msgr2=0x55b8f4bc9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:10.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.680+0000 7ff8b141f740 1 --2- 172.21.15.120:0/1784514036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b8f4bc7680 0x55b8f4bc9a70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff8a00a4db0 tx=0x7ff8a009ceb0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.680+0000 7ff8b141f740 1 -- 172.21.15.120:0/1784514036 shutdown_connections 2024-09-19T05:22:10.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.680+0000 7ff8b141f740 1 --2- 172.21.15.120:0/1784514036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b8f4bc7680 0x55b8f4bc9a70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.680+0000 7ff8b141f740 1 --2- 172.21.15.120:0/1784514036 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b8f4bbcdc0 0x55b8f4bc7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.680+0000 7ff8b141f740 1 --2- 172.21.15.120:0/1784514036 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8f4bbc4a0 0x55b8f4bbc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.680+0000 7ff8b141f740 1 -- 172.21.15.120:0/1784514036 >> 172.21.15.120:0/1784514036 conn(0x55b8f4bb8a30 msgr2=0x55b8f4bb8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:10.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.680+0000 7ff8b141f740 1 -- 172.21.15.120:0/1784514036 shutdown_connections 2024-09-19T05:22:10.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.681+0000 7ff8b141f740 1 -- 172.21.15.120:0/1784514036 wait complete. 2024-09-19T05:22:10.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.681+0000 7ff8b141f740 1 -- start start 2024-09-19T05:22:10.684 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.681+0000 7ff8b141f740 1 Processor -- start 2024-09-19T05:22:10.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.682+0000 7ff8b141f740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b8f4bbc4a0 0x55b8f4bc70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:10.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.682+0000 7ff8b141f740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8f4bbcdc0 0x55b8f4bc4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:10.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.682+0000 7ff8b141f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b8f4bc7680 0x55b8f4bc4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:10.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.682+0000 7ff8b141f740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55b8f4bca250 con 0x55b8f4bbc4a0 2024-09-19T05:22:10.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.682+0000 7ff8b141f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55b8f4add050 con 0x55b8f4bc7680 2024-09-19T05:22:10.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.682+0000 7ff8b141f740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55b8f4bca3d0 con 0x55b8f4bbcdc0 2024-09-19T05:22:10.686 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.682+0000 7ff8b141f740 10 client.0 _ll_register_callbacks cb 0x55b8f4b1d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:22:10.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.682+0000 7ff8acde2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b8f4bbc4a0 0x55b8f4bc70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:10.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.682+0000 7ff8a7fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8f4bbcdc0 0x55b8f4bc4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:10.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.682+0000 7ff8a7fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8f4bbcdc0 0x55b8f4bc4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:40206/0 (socket says 172.21.15.120:40206) 2024-09-19T05:22:10.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.682+0000 7ff8a7fff640 1 -- 172.21.15.120:0/1812694968 learned_addr learned my addr 172.21.15.120:0/1812694968 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:10.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.682+0000 7ff8ad5e3640 1 --2- 172.21.15.120:0/1812694968 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b8f4bc7680 0x55b8f4bc4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:10.687 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.683+0000 7ff8a7fff640 1 -- 172.21.15.120:0/1812694968 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b8f4bc7680 msgr2=0x55b8f4bc4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:10.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.683+0000 7ff8a7fff640 1 --2- 172.21.15.120:0/1812694968 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b8f4bc7680 0x55b8f4bc4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.683+0000 7ff8a7fff640 1 -- 172.21.15.120:0/1812694968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b8f4bbc4a0 msgr2=0x55b8f4bc70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:10.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.683+0000 7ff8a7fff640 1 --2- 172.21.15.120:0/1812694968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b8f4bbc4a0 0x55b8f4bc70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.683+0000 7ff8a7fff640 1 -- 172.21.15.120:0/1812694968 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8f48933c0 con 0x55b8f4bbcdc0 2024-09-19T05:22:10.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.683+0000 7ff8a7fff640 1 --2- 172.21.15.120:0/1812694968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8f4bbcdc0 0x55b8f4bc4350 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff8940126b0 tx=0x7ff894012b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edbc06c3efd406a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:10.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.683+0000 7ff887fff640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:22:10.688 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.683+0000 7ff887fff640 1 -- 172.21.15.120:0/1812694968 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89400f920 con 0x55b8f4bbcdc0 2024-09-19T05:22:10.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.683+0000 7ff8b141f740 1 -- 172.21.15.120:0/1812694968 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8a00b5070 con 0x55b8f4bbcdc0 2024-09-19T05:22:10.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.683+0000 7ff887fff640 1 -- 172.21.15.120:0/1812694968 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7ff89400fac0 con 0x55b8f4bbcdc0 2024-09-19T05:22:10.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.683+0000 7ff887fff640 1 -- 172.21.15.120:0/1812694968 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff89400fcc0 con 0x55b8f4bbcdc0 2024-09-19T05:22:10.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.683+0000 7ff8b141f740 10 client.25438 fetch_fsmap learned FSMap version 29 2024-09-19T05:22:10.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.683+0000 7ff8b141f740 1 -- 172.21.15.120:0/1812694968 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b8f4bd5d90 con 0x55b8f4bbcdc0 2024-09-19T05:22:10.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.684+0000 7ff887fff640 1 -- 172.21.15.120:0/1812694968 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff8a00b5070 con 0x55b8f4bbcdc0 2024-09-19T05:22:10.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.684+0000 7ff887fff640 1 -- 172.21.15.120:0/1812694968 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7ff894010430 con 0x55b8f4bbcdc0 2024-09-19T05:22:10.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.684+0000 7ff8b141f740 10 client.25438 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:22:10.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.684+0000 7ff8b141f740 10 client.25438 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:22:10.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.684+0000 7ff8b141f740 20 client.25438 populate_metadata read hostname 'smithi120' 2024-09-19T05:22:10.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.684+0000 7ff8b141f740 1 --2- 172.21.15.120:0/1812694968 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55b8f4bd7270 0x55b8f4bd9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:10.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.684+0000 7ff8b141f740 4 client.25438 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:22:10.689 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.684+0000 7ff8b141f740 1 -- 172.21.15.120:0/1812694968 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8f4b2f850 con 0x55b8f4bd7270 2024-09-19T05:22:10.690 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.684+0000 7ff8acde2640 1 --2- 172.21.15.120:0/1812694968 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55b8f4bd7270 0x55b8f4bd9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:10.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.685+0000 7ff8acde2640 1 --2- 172.21.15.120:0/1812694968 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55b8f4bd7270 0x55b8f4bd9690 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e90be0be7187b11 server_cookie=53321a312fe40119 in_seq=0 out_seq=0 2024-09-19T05:22:10.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.685+0000 7ff887fff640 10 client.25438 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:22:10.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.685+0000 7ff887fff640 1 -- 172.21.15.120:0/1812694968 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b8f4b2f850 con 0x55b8f4bd7270 2024-09-19T05:22:10.691 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.685+0000 7ff887fff640 10 client.25438 handle_command_reply: tid=0 2024-09-19T05:22:10.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.686+0000 7ff8b141f740 1 client.25438 shutdown 2024-09-19T05:22:10.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.686+0000 7ff8b141f740 1 -- 172.21.15.120:0/1812694968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8f4bbcdc0 msgr2=0x55b8f4bc4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:10.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.686+0000 7ff8b141f740 1 --2- 172.21.15.120:0/1812694968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8f4bbcdc0 0x55b8f4bc4350 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff8940126b0 tx=0x7ff894012b70 comp rx=0 tx=0).stop 2024-09-19T05:22:10.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.686+0000 7ff8b141f740 1 -- 172.21.15.120:0/1812694968 shutdown_connections 2024-09-19T05:22:10.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.686+0000 7ff8b141f740 1 --2- 172.21.15.120:0/1812694968 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b8f4bc7680 0x55b8f4bc4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.686+0000 7ff8b141f740 1 --2- 172.21.15.120:0/1812694968 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55b8f4bd7270 0x55b8f4bd9690 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.686+0000 7ff8b141f740 1 --2- 172.21.15.120:0/1812694968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8f4bbcdc0 0x55b8f4bc4350 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.686+0000 7ff887fff640 0 client.25438 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:22:10.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.686+0000 7ff8b141f740 1 --2- 172.21.15.120:0/1812694968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b8f4bbc4a0 0x55b8f4bc70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.686+0000 7ff8b141f740 1 -- 172.21.15.120:0/1812694968 >> 172.21.15.120:0/1812694968 conn(0x55b8f4bb8a30 msgr2=0x55b8f4bbe760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:10.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.687+0000 7ff8b141f740 1 -- 172.21.15.120:0/1812694968 shutdown_connections 2024-09-19T05:22:10.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.687+0000 7ff8b141f740 1 -- 172.21.15.120:0/1812694968 wait complete. 2024-09-19T05:22:10.692 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.687+0000 7ff8b141f740 20 client.25438 trim_cache size 0 max 16384 2024-09-19T05:22:10.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.714+0000 7ff8b141f740 1 Processor -- start 2024-09-19T05:22:10.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.714+0000 7ff8b141f740 1 -- start start 2024-09-19T05:22:10.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.714+0000 7ff8b141f740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8f4bbc4a0 0x55b8f4bc2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:10.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.714+0000 7ff8b141f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b8f4bbcdc0 0x55b8f4bd34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:10.717 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.714+0000 7ff8b141f740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b8f4bc7680 0x55b8f4bdefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:10.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.714+0000 7ff8b141f740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a81ada50 con 0x55b8f4bc7680 2024-09-19T05:22:10.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.714+0000 7ff8b141f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a81ae120 con 0x55b8f4bbcdc0 2024-09-19T05:22:10.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.714+0000 7ff8b141f740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a81ab9f0 con 0x55b8f4bbc4a0 2024-09-19T05:22:10.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.715+0000 7ff8ad5e3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b8f4bc7680 0x55b8f4bdefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:10.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.715+0000 7ff8acde2640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8f4bbc4a0 0x55b8f4bc2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:10.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.715+0000 7ff8acde2640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8f4bbc4a0 0x55b8f4bc2c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:40220/0 (socket says 172.21.15.120:40220) 2024-09-19T05:22:10.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.715+0000 7ff8acde2640 1 -- 172.21.15.120:0/1676974765 learned_addr learned my addr 172.21.15.120:0/1676974765 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:10.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.715+0000 7ff8ad5e3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b8f4bc7680 0x55b8f4bdefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42488/0 (socket says 172.21.15.120:42488) 2024-09-19T05:22:10.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.715+0000 7ff8a7fff640 1 --2- 172.21.15.120:0/1676974765 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b8f4bbcdc0 0x55b8f4bd34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:10.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.715+0000 7ff8acde2640 1 -- 172.21.15.120:0/1676974765 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b8f4bbcdc0 msgr2=0x55b8f4bd34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:10.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.715+0000 7ff8acde2640 1 --2- 172.21.15.120:0/1676974765 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b8f4bbcdc0 0x55b8f4bd34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.715+0000 7ff8acde2640 1 -- 172.21.15.120:0/1676974765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b8f4bc7680 msgr2=0x55b8f4bdefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:10.718 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.715+0000 7ff8acde2640 1 --2- 172.21.15.120:0/1676974765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b8f4bc7680 0x55b8f4bdefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.715+0000 7ff8acde2640 1 -- 172.21.15.120:0/1676974765 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8f4bc3300 con 0x55b8f4bbc4a0 2024-09-19T05:22:10.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.715+0000 7ff8a7fff640 1 --2- 172.21.15.120:0/1676974765 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b8f4bbcdc0 0x55b8f4bd34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:22:10.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.715+0000 7ff8acde2640 1 --2- 172.21.15.120:0/1676974765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8f4bbc4a0 0x55b8f4bc2c20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff89c009900 tx=0x7ff89c03f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33f520ecf4b5841a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:10.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.715+0000 7ff8927fc640 1 -- 172.21.15.120:0/1676974765 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89c035050 con 0x55b8f4bbc4a0 2024-09-19T05:22:10.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.715+0000 7ff8927fc640 1 -- 172.21.15.120:0/1676974765 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff89c057070 con 0x55b8f4bbc4a0 2024-09-19T05:22:10.719 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.715+0000 7ff8927fc640 1 -- 172.21.15.120:0/1676974765 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89c004920 con 0x55b8f4bbc4a0 2024-09-19T05:22:10.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.716+0000 7ff8b141f740 1 -- 172.21.15.120:0/1676974765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8f4bbc4a0 msgr2=0x55b8f4bc2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:10.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.716+0000 7ff8b141f740 1 --2- 172.21.15.120:0/1676974765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8f4bbc4a0 0x55b8f4bc2c20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff89c009900 tx=0x7ff89c03f000 comp rx=0 tx=0).stop 2024-09-19T05:22:10.721 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.716+0000 7ff8b141f740 1 -- 172.21.15.120:0/1676974765 shutdown_connections 2024-09-19T05:22:10.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.716+0000 7ff8b141f740 1 --2- 172.21.15.120:0/1676974765 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b8f4bc7680 0x55b8f4bdefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.716+0000 7ff8b141f740 1 --2- 172.21.15.120:0/1676974765 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b8f4bbcdc0 0x55b8f4bd34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.716+0000 7ff8b141f740 1 --2- 172.21.15.120:0/1676974765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8f4bbc4a0 0x55b8f4bc2c20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.716+0000 7ff8b141f740 1 -- 172.21.15.120:0/1676974765 >> 172.21.15.120:0/1676974765 conn(0x55b8f4bb8a30 msgr2=0x55b8f4bc63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:10.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.716+0000 7ff8b141f740 1 -- 172.21.15.120:0/1676974765 shutdown_connections 2024-09-19T05:22:10.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.717+0000 7ff8b141f740 1 -- 172.21.15.120:0/1676974765 wait complete. 2024-09-19T05:22:10.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.717+0000 7ff8b141f740 1 -- start start 2024-09-19T05:22:10.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.717+0000 7ff8b141f740 1 Processor -- start 2024-09-19T05:22:10.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.718+0000 7ff8b141f740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b8f4bbc4a0 0x55b8f4bcff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:10.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.718+0000 7ff8b141f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b8f4bbcdc0 0x55b8f4bcb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:10.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.718+0000 7ff8b141f740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8f4bc7680 0x55b8f4bcba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:10.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.718+0000 7ff8b141f740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a810dd80 con 0x55b8f4bbc4a0 2024-09-19T05:22:10.722 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.718+0000 7ff8acde2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b8f4bbc4a0 0x55b8f4bcff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:10.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.718+0000 7ff8acde2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b8f4bbc4a0 0x55b8f4bcff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42498/0 (socket says 172.21.15.120:42498) 2024-09-19T05:22:10.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.718+0000 7ff8acde2640 1 -- 172.21.15.120:0/138967766 learned_addr learned my addr 172.21.15.120:0/138967766 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:10.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.718+0000 7ff8a7fff640 1 --2- 172.21.15.120:0/138967766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b8f4bbcdc0 0x55b8f4bcb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:10.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.718+0000 7ff8ad5e3640 1 --2- 172.21.15.120:0/138967766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8f4bc7680 0x55b8f4bcba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:10.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.718+0000 7ff8b141f740 1 -- 172.21.15.120:0/138967766 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a810f1f0 con 0x55b8f4bbcdc0 2024-09-19T05:22:10.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.718+0000 7ff8b141f740 1 -- 172.21.15.120:0/138967766 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a810e450 con 0x55b8f4bc7680 2024-09-19T05:22:10.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.718+0000 7ff8b141f740 10 client.0 _ll_register_callbacks cb 0x7ff894009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:22:10.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.719+0000 7ff8acde2640 1 -- 172.21.15.120:0/138967766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8f4bc7680 msgr2=0x55b8f4bcba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:10.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.719+0000 7ff8acde2640 1 --2- 172.21.15.120:0/138967766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8f4bc7680 0x55b8f4bcba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.719+0000 7ff8acde2640 1 -- 172.21.15.120:0/138967766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b8f4bbcdc0 msgr2=0x55b8f4bcb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:10.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.719+0000 7ff8acde2640 1 --2- 172.21.15.120:0/138967766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b8f4bbcdc0 0x55b8f4bcb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.719+0000 7ff8acde2640 1 -- 172.21.15.120:0/138967766 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8f4bc4cd0 con 0x55b8f4bbc4a0 2024-09-19T05:22:10.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.719+0000 7ff8a7fff640 1 --2- 172.21.15.120:0/138967766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b8f4bbcdc0 0x55b8f4bcb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:10.723 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.719+0000 7ff8acde2640 1 --2- 172.21.15.120:0/138967766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b8f4bbc4a0 0x55b8f4bcff40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff89c02a930 tx=0x7ff89c0316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378ab4de08a69e71 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:10.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.719+0000 7ff887fff640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:22:10.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.719+0000 7ff887fff640 1 -- 172.21.15.120:0/138967766 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89c060060 con 0x55b8f4bbc4a0 2024-09-19T05:22:10.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.719+0000 7ff887fff640 1 -- 172.21.15.120:0/138967766 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7ff89c004450 con 0x55b8f4bbc4a0 2024-09-19T05:22:10.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.719+0000 7ff8b141f740 1 -- 172.21.15.120:0/138967766 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff89c057070 con 0x55b8f4bbc4a0 2024-09-19T05:22:10.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.720+0000 7ff887fff640 1 -- 172.21.15.120:0/138967766 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff89c035030 con 0x55b8f4bbc4a0 2024-09-19T05:22:10.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.720+0000 7ff8b141f740 10 client.15921 fetch_fsmap learned FSMap version 29 2024-09-19T05:22:10.724 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.720+0000 7ff8b141f740 1 -- 172.21.15.120:0/138967766 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b8f4bd9a00 con 0x55b8f4bbc4a0 2024-09-19T05:22:10.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.720+0000 7ff887fff640 1 -- 172.21.15.120:0/138967766 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ff89c057070 con 0x55b8f4bbc4a0 2024-09-19T05:22:10.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.720+0000 7ff887fff640 1 -- 172.21.15.120:0/138967766 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7ff89c0035f0 con 0x55b8f4bbc4a0 2024-09-19T05:22:10.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.720+0000 7ff8b141f740 10 client.15921 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:22:10.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.720+0000 7ff8b141f740 10 client.15921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:22:10.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.720+0000 7ff8b141f740 20 client.15921 populate_metadata read hostname 'smithi120' 2024-09-19T05:22:10.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.720+0000 7ff8b141f740 1 --2- 172.21.15.120:0/138967766 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55b8f4bd7270 0x55b8f4c444b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:10.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.720+0000 7ff8b141f740 4 client.15921 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T05:22:10.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.720+0000 7ff8b141f740 1 -- 172.21.15.120:0/138967766 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b8f4b29d60 con 0x55b8f4bd7270 2024-09-19T05:22:10.726 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.721+0000 7ff8a7fff640 1 --2- 172.21.15.120:0/138967766 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55b8f4bd7270 0x55b8f4c444b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:10.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.721+0000 7ff887fff640 10 client.15921 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:22:10.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.721+0000 7ff8a7fff640 1 --2- 172.21.15.120:0/138967766 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55b8f4bd7270 0x55b8f4c444b0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=216f0aef7cb25d53 server_cookie=48646ed951c26694 in_seq=0 out_seq=0 2024-09-19T05:22:10.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.721+0000 7ff887fff640 1 -- 172.21.15.120:0/138967766 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b8f4b29d60 con 0x55b8f4bd7270 2024-09-19T05:22:10.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.721+0000 7ff887fff640 10 client.15921 handle_command_reply: tid=0 2024-09-19T05:22:10.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.721+0000 7ff8b141f740 1 client.15921 shutdown 2024-09-19T05:22:10.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.721+0000 7ff8b141f740 1 -- 172.21.15.120:0/138967766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b8f4bbc4a0 msgr2=0x55b8f4bcff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:10.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.721+0000 7ff8b141f740 1 --2- 172.21.15.120:0/138967766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b8f4bbc4a0 0x55b8f4bcff40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff89c02a930 tx=0x7ff89c0316f0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.722+0000 7ff8b141f740 1 -- 172.21.15.120:0/138967766 shutdown_connections 2024-09-19T05:22:10.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.722+0000 7ff8b141f740 1 --2- 172.21.15.120:0/138967766 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55b8f4bd7270 0x55b8f4c444b0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.722+0000 7ff887fff640 0 client.15921 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:22:10.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.722+0000 7ff8b141f740 1 --2- 172.21.15.120:0/138967766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8f4bc7680 0x55b8f4bcba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.722+0000 7ff8b141f740 1 --2- 172.21.15.120:0/138967766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b8f4bbcdc0 0x55b8f4bcb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.727 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.722+0000 7ff8b141f740 1 --2- 172.21.15.120:0/138967766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55b8f4bbc4a0 0x55b8f4bcff40 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.722+0000 7ff8b141f740 1 -- 172.21.15.120:0/138967766 >> 172.21.15.120:0/138967766 conn(0x55b8f4bb8a30 msgr2=0x55b8f4bbf8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:10.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.722+0000 7ff8b141f740 1 -- 172.21.15.120:0/138967766 shutdown_connections 2024-09-19T05:22:10.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.722+0000 7ff8b141f740 1 -- 172.21.15.120:0/138967766 wait complete. 2024-09-19T05:22:10.728 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.722+0000 7ff8b141f740 20 client.15921 trim_cache size 0 max 16384 2024-09-19T05:22:10.728 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T05:22:10.728 INFO:teuthology.orchestra.run.smithi120.stdout: "status": "no active scrubs running", 2024-09-19T05:22:10.728 INFO:teuthology.orchestra.run.smithi120.stdout: "scrubs": {} 2024-09-19T05:22:10.728 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T05:22:10.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.723+0000 7ff8af046640 1 -- 172.21.15.120:0/1509970436 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ff8980a3430 msgr2=0x7ff8980a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:10.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.723+0000 7ff8af046640 1 --2- 172.21.15.120:0/1509970436 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ff8980a3430 0x7ff8980a58f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff89c000c00 tx=0x7ff89c005a20 comp rx=0 tx=0).stop 2024-09-19T05:22:10.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.723+0000 7ff8af046640 1 -- 172.21.15.120:0/1509970436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8a8105ec0 msgr2=0x7ff8a819e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:10.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.723+0000 7ff8af046640 1 --2- 172.21.15.120:0/1509970436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8a8105ec0 0x7ff8a819e930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009fd0 tx=0x7ff8a000ef10 comp rx=0 tx=0).stop 2024-09-19T05:22:10.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.723+0000 7ff8af046640 1 -- 172.21.15.120:0/1509970436 shutdown_connections 2024-09-19T05:22:10.729 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.723+0000 7ff8af046640 1 --2- 172.21.15.120:0/1509970436 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ff8980a3430 0x7ff8980a58f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.723+0000 7ff8af046640 1 --2- 172.21.15.120:0/1509970436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8a8105ec0 0x7ff8a819e930 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.723+0000 7ff8af046640 1 --2- 172.21.15.120:0/1509970436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8a81011e0 0x7ff8a81a4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.723+0000 7ff8af046640 1 --2- 172.21.15.120:0/1509970436 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8a81008c0 0x7ff8a81a4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:10.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.723+0000 7ff8af046640 1 -- 172.21.15.120:0/1509970436 >> 172.21.15.120:0/1509970436 conn(0x7ff8a80fc7d0 msgr2=0x7ff8a80fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:10.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.723+0000 7ff8af046640 1 -- 172.21.15.120:0/1509970436 shutdown_connections 2024-09-19T05:22:10.730 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:10.723+0000 7ff8af046640 1 -- 172.21.15.120:0/1509970436 wait complete. 2024-09-19T05:22:10.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:10 smithi194 ceph-mon[35228]: pgmap v91: 97 pgs: 97 active+clean; 237 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 160 op/s 2024-09-19T05:22:10.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:10 smithi178 ceph-mon[34347]: pgmap v91: 97 pgs: 97 active+clean; 237 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 160 op/s 2024-09-19T05:22:11.860 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T05:22:11.861 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T05:22:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.042+0000 7f0e0eff5640 1 -- 172.21.15.120:0/2506983113 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f6908d5d70 con 0x55f6909ef3d0 2024-09-19T05:22:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.042+0000 7f0e0eff5640 10 client.25426 handle_command_reply: tid=0 2024-09-19T05:22:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.042+0000 7f0e33b22740 1 client.25426 shutdown 2024-09-19T05:22:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.042+0000 7f0e33b22740 1 -- 172.21.15.120:0/2506983113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f690969af0 msgr2=0x55f690977cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.042+0000 7f0e33b22740 1 --2- 172.21.15.120:0/2506983113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f690969af0 0x55f690977cf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0987e0 tx=0x7f0e1c0984a0 comp rx=0 tx=0).stop 2024-09-19T05:22:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.042+0000 7f0e33b22740 1 -- 172.21.15.120:0/2506983113 shutdown_connections 2024-09-19T05:22:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.042+0000 7f0e33b22740 1 --2- 172.21.15.120:0/2506983113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f690974cb0 0x55f690978770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.042+0000 7f0e33b22740 1 --2- 172.21.15.120:0/2506983113 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f69096a410 0x55f690978230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.042+0000 7f0e33b22740 1 --2- 172.21.15.120:0/2506983113 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55f6909ef3d0 0x55f6909f17f0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:12.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.042+0000 7f0e33b22740 1 --2- 172.21.15.120:0/2506983113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f690969af0 0x55f690977cf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:12.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.042+0000 7f0e0eff5640 0 client.25426 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:22:12.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.042+0000 7f0e33b22740 1 -- 172.21.15.120:0/2506983113 >> 172.21.15.120:0/2506983113 conn(0x55f690966060 msgr2=0x55f69096bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:12.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.043+0000 7f0e33b22740 1 -- 172.21.15.120:0/2506983113 shutdown_connections 2024-09-19T05:22:12.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.043+0000 7f0e33b22740 1 -- 172.21.15.120:0/2506983113 wait complete. 2024-09-19T05:22:12.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.043+0000 7f0e33b22740 20 client.25426 trim_cache size 0 max 16384 2024-09-19T05:22:12.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:22:12.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:22:12.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:22:12.046 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:22:12.048 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.044+0000 7f0e3114b640 1 -- 172.21.15.120:0/903300824 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0e140a3460 msgr2=0x7f0e140a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:12.048 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.044+0000 7f0e3114b640 1 --2- 172.21.15.120:0/903300824 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0e140a3460 0x7f0e140a5920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0e2402fc80 tx=0x7f0e2403c040 comp rx=0 tx=0).stop 2024-09-19T05:22:12.048 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.044+0000 7f0e3114b640 1 -- 172.21.15.120:0/903300824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e2c102ce0 msgr2=0x7f0e2c108010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:12.048 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.044+0000 7f0e3114b640 1 --2- 172.21.15.120:0/903300824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e2c102ce0 0x7f0e2c108010 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00e9f0 tx=0x7f0e1c00eeb0 comp rx=0 tx=0).stop 2024-09-19T05:22:12.048 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.044+0000 7f0e3114b640 1 -- 172.21.15.120:0/903300824 shutdown_connections 2024-09-19T05:22:12.048 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.044+0000 7f0e3114b640 1 --2- 172.21.15.120:0/903300824 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0e140a3460 0x7f0e140a5920 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:12.048 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.044+0000 7f0e3114b640 1 --2- 172.21.15.120:0/903300824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e2c10c0b0 0x7f0e2c1aa690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:12.048 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.044+0000 7f0e3114b640 1 --2- 172.21.15.120:0/903300824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e2c103600 0x7f0e2c108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:12.048 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.044+0000 7f0e3114b640 1 --2- 172.21.15.120:0/903300824 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0e2c102ce0 0x7f0e2c108010 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:12.049 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.044+0000 7f0e3114b640 1 -- 172.21.15.120:0/903300824 >> 172.21.15.120:0/903300824 conn(0x7f0e2c077990 msgr2=0x7f0e2c0ff150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:12.049 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.044+0000 7f0e3114b640 1 -- 172.21.15.120:0/903300824 shutdown_connections 2024-09-19T05:22:12.049 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:12.045+0000 7f0e3114b640 1 -- 172.21.15.120:0/903300824 wait complete. 2024-09-19T05:22:12.262 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:22:12.598 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:12 smithi120 ceph-mon[30956]: pgmap v92: 97 pgs: 97 active+clean; 237 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 126 op/s 2024-09-19T05:22:12.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:12 smithi178 ceph-mon[34347]: pgmap v92: 97 pgs: 97 active+clean; 237 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 126 op/s 2024-09-19T05:22:12.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.852+0000 7f0c844ac640 1 -- 172.21.15.120:0/3496967982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c7c106b80 msgr2=0x7f0c7c106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:12.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.852+0000 7f0c844ac640 1 --2- 172.21.15.120:0/3496967982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c7c106b80 0x7f0c7c106f60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0c78009900 tx=0x7f0c7802a410 comp rx=0 tx=0).stop 2024-09-19T05:22:12.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.852+0000 7f0c844ac640 1 -- 172.21.15.120:0/3496967982 shutdown_connections 2024-09-19T05:22:12.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.852+0000 7f0c844ac640 1 --2- 172.21.15.120:0/3496967982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c7c100aa0 0x7f0c7c10ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:12.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.852+0000 7f0c844ac640 1 --2- 172.21.15.120:0/3496967982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c7c100100 0x7f0c7c100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:12.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.852+0000 7f0c844ac640 1 --2- 172.21.15.120:0/3496967982 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c7c106b80 0x7f0c7c106f60 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:12.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.852+0000 7f0c844ac640 1 -- 172.21.15.120:0/3496967982 >> 172.21.15.120:0/3496967982 conn(0x7f0c7c077230 msgr2=0x7f0c7c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:12.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.852+0000 7f0c844ac640 1 -- 172.21.15.120:0/3496967982 shutdown_connections 2024-09-19T05:22:12.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.852+0000 7f0c844ac640 1 -- 172.21.15.120:0/3496967982 wait complete. 2024-09-19T05:22:12.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.852+0000 7f0c844ac640 1 Processor -- start 2024-09-19T05:22:12.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.853+0000 7f0c844ac640 1 -- start start 2024-09-19T05:22:12.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.853+0000 7f0c844ac640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c7c100100 0x7f0c7c1a4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:12.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.853+0000 7f0c844ac640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c7c100aa0 0x7f0c7c1a4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:12.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.853+0000 7f0c844ac640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c7c106b80 0x7f0c7c10dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:12.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.853+0000 7f0c844ac640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c111f50 con 0x7f0c7c100aa0 2024-09-19T05:22:12.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.853+0000 7f0c844ac640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c111dd0 con 0x7f0c7c106b80 2024-09-19T05:22:12.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.853+0000 7f0c844ac640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c1120d0 con 0x7f0c7c100100 2024-09-19T05:22:12.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.853+0000 7f0c81a47640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c7c100aa0 0x7f0c7c1a4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:12.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.853+0000 7f0c82a49640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c7c106b80 0x7f0c7c10dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:12.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.853+0000 7f0c82a49640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c7c106b80 0x7f0c7c10dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:43466/0 (socket says 172.21.15.120:43466) 2024-09-19T05:22:12.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.853+0000 7f0c81a47640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c7c100aa0 0x7f0c7c1a4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42510/0 (socket says 172.21.15.120:42510) 2024-09-19T05:22:12.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.853+0000 7f0c82a49640 1 -- 172.21.15.120:0/3174000577 learned_addr learned my addr 172.21.15.120:0/3174000577 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:12.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.853+0000 7f0c82248640 1 --2- 172.21.15.120:0/3174000577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c7c100100 0x7f0c7c1a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:12.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.853+0000 7f0c82a49640 1 -- 172.21.15.120:0/3174000577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c7c100100 msgr2=0x7f0c7c1a4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:12.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.853+0000 7f0c82a49640 1 --2- 172.21.15.120:0/3174000577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c7c100100 0x7f0c7c1a4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:12.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.854+0000 7f0c82a49640 1 -- 172.21.15.120:0/3174000577 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c7c100aa0 msgr2=0x7f0c7c1a4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:12.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.854+0000 7f0c82a49640 1 --2- 172.21.15.120:0/3174000577 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c7c100aa0 0x7f0c7c1a4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:12.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.854+0000 7f0c82a49640 1 -- 172.21.15.120:0/3174000577 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c7c10e380 con 0x7f0c7c106b80 2024-09-19T05:22:12.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.854+0000 7f0c81a47640 1 --2- 172.21.15.120:0/3174000577 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c7c100aa0 0x7f0c7c1a4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:12.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.854+0000 7f0c82a49640 1 --2- 172.21.15.120:0/3174000577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c7c106b80 0x7f0c7c10dc00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0c74009c90 tx=0x7f0c7400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:12.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.854+0000 7f0c737fe640 1 -- 172.21.15.120:0/3174000577 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c74010630 con 0x7f0c7c106b80 2024-09-19T05:22:12.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.854+0000 7f0c737fe640 1 -- 172.21.15.120:0/3174000577 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0c74010c80 con 0x7f0c7c106b80 2024-09-19T05:22:12.858 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.854+0000 7f0c844ac640 1 -- 172.21.15.120:0/3174000577 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c7c10e670 con 0x7f0c7c106b80 2024-09-19T05:22:12.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.855+0000 7f0c737fe640 1 -- 172.21.15.120:0/3174000577 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c74017c60 con 0x7f0c7c106b80 2024-09-19T05:22:12.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.855+0000 7f0c844ac640 1 -- 172.21.15.120:0/3174000577 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c7c1ab580 con 0x7f0c7c106b80 2024-09-19T05:22:12.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.856+0000 7f0c844ac640 1 -- 172.21.15.120:0/3174000577 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c7c100560 con 0x7f0c7c106b80 2024-09-19T05:22:12.859 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.857+0000 7f0c737fe640 1 -- 172.21.15.120:0/3174000577 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f0c740107d0 con 0x7f0c7c106b80 2024-09-19T05:22:12.860 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.858+0000 7f0c737fe640 1 --2- 172.21.15.120:0/3174000577 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0c680a3430 0x7f0c680a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:12.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.858+0000 7f0c737fe640 1 -- 172.21.15.120:0/3174000577 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f0c740d0640 con 0x7f0c7c106b80 2024-09-19T05:22:12.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.859+0000 7f0c82248640 1 --2- 172.21.15.120:0/3174000577 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0c680a3430 0x7f0c680a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:12.861 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.859+0000 7f0c82248640 1 --2- 172.21.15.120:0/3174000577 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0c680a3430 0x7f0c680a58f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0c78000c00 tx=0x7f0c78031400 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:12.864 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:12.862+0000 7f0c737fe640 1 -- 172.21.15.120:0/3174000577 <== mon.2 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0c7409cf70 con 0x7f0c7c106b80 2024-09-19T05:22:12.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:12 smithi194 ceph-mon[35228]: pgmap v92: 97 pgs: 97 active+clean; 237 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 126 op/s 2024-09-19T05:22:13.219 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:13.218+0000 7f0c844ac640 1 -- 172.21.15.120:0/3174000577 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c7c1ab840 con 0x7f0c7c106b80 2024-09-19T05:22:13.220 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:13.219+0000 7f0c737fe640 1 -- 172.21.15.120:0/3174000577 <== mon.2 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11925 (secure 0 0 0) 0x7f0c7409c870 con 0x7f0c7c106b80 2024-09-19T05:22:13.221 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:22:13.221 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":29,"btime":"2024-09-19T05:21:43:032475+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6835/93472898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":93472898},{"type":"v1","addr":"172.21.15.120:6835","nonce":93472898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14568,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1976835398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6836","nonce":1976835398},{"type":"v1","addr":"172.21.15.120:6837","nonce":1976835398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6839/2975851469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6838","nonce":2975851469},{"type":"v1","addr":"172.21.15.120:6839","nonce":2975851469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6841/2837552754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6840","nonce":2837552754},{"type":"v1","addr":"172.21.15.120:6841","nonce":2837552754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24368,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/61682954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":61682954},{"type":"v1","addr":"172.21.15.178:6833","nonce":61682954}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24394,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1778722040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1778722040},{"type":"v1","addr":"172.21.15.194:6833","nonce":1778722040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T05:17:30.796197+0000","modified":"2024-09-19T05:21:42.247553+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24445,"mds_1":24443,"mds_2":24430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24401":{"gid":24401,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6835/890775592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":890775592},{"type":"v1","addr":"172.21.15.178:6835","nonce":890775592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.178:6837/3960720164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3960720164},{"type":"v1","addr":"172.21.15.178:6837","nonce":3960720164}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6835/3268846994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3268846994},{"type":"v1","addr":"172.21.15.194:6835","nonce":3268846994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":70,"addr":"172.21.15.194:6837/378729335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":378729335},{"type":"v1","addr":"172.21.15.194:6837","nonce":378729335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24443":{"gid":24443,"name":"b","rank":1,"incarnation":19,"state":"up:active","state_seq":67,"addr":"172.21.15.178:6839/3389137566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6838","nonce":3389137566},{"type":"v1","addr":"172.21.15.178:6839","nonce":3389137566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24445":{"gid":24445,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6839/3817420679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":3817420679},{"type":"v1","addr":"172.21.15.194:6839","nonce":3817420679}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24445,"qdb_cluster":[24445,24443,24430]},"id":1}]} 2024-09-19T05:22:13.221 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 29 2024-09-19T05:22:13.224 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:13.222+0000 7f0c844ac640 1 -- 172.21.15.120:0/3174000577 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0c680a3430 msgr2=0x7f0c680a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:13.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:13.222+0000 7f0c844ac640 1 --2- 172.21.15.120:0/3174000577 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0c680a3430 0x7f0c680a58f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0c78000c00 tx=0x7f0c78031400 comp rx=0 tx=0).stop 2024-09-19T05:22:13.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:13.222+0000 7f0c844ac640 1 -- 172.21.15.120:0/3174000577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c7c106b80 msgr2=0x7f0c7c10dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:13.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:13.222+0000 7f0c844ac640 1 --2- 172.21.15.120:0/3174000577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c7c106b80 0x7f0c7c10dc00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0c74009c90 tx=0x7f0c7400c6a0 comp rx=0 tx=0).stop 2024-09-19T05:22:13.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:13.222+0000 7f0c844ac640 1 -- 172.21.15.120:0/3174000577 shutdown_connections 2024-09-19T05:22:13.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:13.222+0000 7f0c844ac640 1 --2- 172.21.15.120:0/3174000577 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0c680a3430 0x7f0c680a58f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:13.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:13.222+0000 7f0c844ac640 1 --2- 172.21.15.120:0/3174000577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c7c106b80 0x7f0c7c10dc00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:13.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:13.222+0000 7f0c844ac640 1 --2- 172.21.15.120:0/3174000577 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c7c100aa0 0x7f0c7c1a4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:13.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:13.222+0000 7f0c844ac640 1 --2- 172.21.15.120:0/3174000577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c7c100100 0x7f0c7c1a4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:13.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:13.222+0000 7f0c844ac640 1 -- 172.21.15.120:0/3174000577 >> 172.21.15.120:0/3174000577 conn(0x7f0c7c077230 msgr2=0x7f0c7c104b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:13.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:13.222+0000 7f0c844ac640 1 -- 172.21.15.120:0/3174000577 shutdown_connections 2024-09-19T05:22:13.225 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:13.222+0000 7f0c844ac640 1 -- 172.21.15.120:0/3174000577 wait complete. 2024-09-19T05:22:13.601 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:13 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/3174000577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:22:13.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:13 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/3174000577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:22:13.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:13 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/3174000577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T05:22:14.050 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T05:22:14.403 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:22:14.699 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:14 smithi120 ceph-mon[30956]: pgmap v93: 97 pgs: 97 active+clean; 237 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 126 op/s 2024-09-19T05:22:14.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:14 smithi194 ceph-mon[35228]: pgmap v93: 97 pgs: 97 active+clean; 237 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 126 op/s 2024-09-19T05:22:14.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:14 smithi178 ceph-mon[34347]: pgmap v93: 97 pgs: 97 active+clean; 237 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 126 op/s 2024-09-19T05:22:14.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.977+0000 7f5edb588640 1 -- 172.21.15.120:0/2578428035 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ed4100b60 msgr2=0x7f5ed4100f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:14.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.978+0000 7f5edb588640 1 --2- 172.21.15.120:0/2578428035 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ed4100b60 0x7f5ed4100f40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0009900 tx=0x7f5ed002a410 comp rx=0 tx=0).stop 2024-09-19T05:22:14.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.978+0000 7f5edb588640 1 -- 172.21.15.120:0/2578428035 shutdown_connections 2024-09-19T05:22:14.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.978+0000 7f5edb588640 1 --2- 172.21.15.120:0/2578428035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ed410e540 0x7f5ed4110930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:14.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.978+0000 7f5edb588640 1 --2- 172.21.15.120:0/2578428035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ed4101480 0x7f5ed410df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:14.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.978+0000 7f5edb588640 1 --2- 172.21.15.120:0/2578428035 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ed4100b60 0x7f5ed4100f40 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:14.980 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.978+0000 7f5edb588640 1 -- 172.21.15.120:0/2578428035 >> 172.21.15.120:0/2578428035 conn(0x7f5ed40fc7d0 msgr2=0x7f5ed40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:14.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.978+0000 7f5edb588640 1 -- 172.21.15.120:0/2578428035 shutdown_connections 2024-09-19T05:22:14.981 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.978+0000 7f5edb588640 1 -- 172.21.15.120:0/2578428035 wait complete. 2024-09-19T05:22:14.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.978+0000 7f5edb588640 1 Processor -- start 2024-09-19T05:22:14.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.979+0000 7f5edb588640 1 -- start start 2024-09-19T05:22:14.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.979+0000 7f5edb588640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ed4100b60 0x7f5ed419a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:14.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.979+0000 7f5edb588640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ed4101480 0x7f5ed419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:14.982 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.979+0000 7f5edb588640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ed410e540 0x7f5ed419ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:14.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.979+0000 7f5edb588640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed4114100 con 0x7f5ed410e540 2024-09-19T05:22:14.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.979+0000 7f5edb588640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed4113f80 con 0x7f5ed4101480 2024-09-19T05:22:14.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.979+0000 7f5edb588640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed4114280 con 0x7f5ed4100b60 2024-09-19T05:22:14.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.979+0000 7f5ed8b23640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ed4101480 0x7f5ed419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:14.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.979+0000 7f5ed8b23640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ed4101480 0x7f5ed419abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:43484/0 (socket says 172.21.15.120:43484) 2024-09-19T05:22:14.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.979+0000 7f5ed8b23640 1 -- 172.21.15.120:0/258686156 learned_addr learned my addr 172.21.15.120:0/258686156 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:14.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.979+0000 7f5ed9324640 1 --2- 172.21.15.120:0/258686156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ed4100b60 0x7f5ed419a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:14.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.979+0000 7f5ed9b25640 1 --2- 172.21.15.120:0/258686156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ed410e540 0x7f5ed419ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:14.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.980+0000 7f5ed8b23640 1 -- 172.21.15.120:0/258686156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ed4100b60 msgr2=0x7f5ed419a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:14.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.980+0000 7f5ed8b23640 1 --2- 172.21.15.120:0/258686156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ed4100b60 0x7f5ed419a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:14.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.980+0000 7f5ed8b23640 1 -- 172.21.15.120:0/258686156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ed410e540 msgr2=0x7f5ed419ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:14.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.980+0000 7f5ed8b23640 1 --2- 172.21.15.120:0/258686156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ed410e540 0x7f5ed419ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:14.983 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.980+0000 7f5ed8b23640 1 -- 172.21.15.120:0/258686156 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed419f650 con 0x7f5ed4101480 2024-09-19T05:22:14.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.980+0000 7f5ed9b25640 1 --2- 172.21.15.120:0/258686156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ed410e540 0x7f5ed419ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:14.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.980+0000 7f5ed9324640 1 --2- 172.21.15.120:0/258686156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ed4100b60 0x7f5ed419a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:14.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.980+0000 7f5ed8b23640 1 --2- 172.21.15.120:0/258686156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ed4101480 0x7f5ed419abe0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400ea60 tx=0x7f5ec400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:14.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.980+0000 7f5eca7fc640 1 -- 172.21.15.120:0/258686156 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec400cde0 con 0x7f5ed4101480 2024-09-19T05:22:14.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.980+0000 7f5edb588640 1 -- 172.21.15.120:0/258686156 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ed419f940 con 0x7f5ed4101480 2024-09-19T05:22:14.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.980+0000 7f5eca7fc640 1 -- 172.21.15.120:0/258686156 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5ec40035f0 con 0x7f5ed4101480 2024-09-19T05:22:14.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.980+0000 7f5edb588640 1 -- 172.21.15.120:0/258686156 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ed41a7220 con 0x7f5ed4101480 2024-09-19T05:22:14.984 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.980+0000 7f5eca7fc640 1 -- 172.21.15.120:0/258686156 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec400cde0 con 0x7f5ed4101480 2024-09-19T05:22:14.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.983+0000 7f5eca7fc640 1 -- 172.21.15.120:0/258686156 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f5ec40037a0 con 0x7f5ed4101480 2024-09-19T05:22:14.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.983+0000 7f5edd961740 1 Processor -- start 2024-09-19T05:22:14.985 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.984+0000 7f5edd961740 1 -- start start 2024-09-19T05:22:14.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.984+0000 7f5edd961740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a405a6ab40 0x55a405a69090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:14.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.984+0000 7f5edd961740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a405a695d0 0x55a405a69a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:14.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.984+0000 7f5edd961740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a7cb80 0x55a405a7ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:14.986 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.984+0000 7f5edd961740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a4059cf2f0 con 0x55a405a695d0 2024-09-19T05:22:14.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.984+0000 7f5edd961740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a405976cf0 con 0x55a405a6ab40 2024-09-19T05:22:14.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.984+0000 7f5edd961740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55a4059cb2b0 con 0x55a405a7cb80 2024-09-19T05:22:14.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.984+0000 7f5ed9324640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a405a695d0 0x55a405a69a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:14.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.984+0000 7f5ed9b25640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a405a6ab40 0x55a405a69090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:14.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.984+0000 7f5ed9324640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a405a695d0 0x55a405a69a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42522/0 (socket says 172.21.15.120:42522) 2024-09-19T05:22:14.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.984+0000 7f5ed9324640 1 -- 172.21.15.120:0/3624928994 learned_addr learned my addr 172.21.15.120:0/3624928994 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:14.987 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.985+0000 7f5ed8b23640 1 --2- 172.21.15.120:0/3624928994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a7cb80 0x55a405a7ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:14.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.985+0000 7f5ed9b25640 1 -- 172.21.15.120:0/3624928994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a7cb80 msgr2=0x55a405a7ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:14.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.985+0000 7f5ed9b25640 1 --2- 172.21.15.120:0/3624928994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a7cb80 0x55a405a7ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:14.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.985+0000 7f5eca7fc640 1 --2- 172.21.15.120:0/258686156 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f5ec00a37b0 0x7f5ec00a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:14.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.985+0000 7f5ed9b25640 1 -- 172.21.15.120:0/3624928994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a405a695d0 msgr2=0x55a405a69a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:14.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.985+0000 7f5ed9b25640 1 --2- 172.21.15.120:0/3624928994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a405a695d0 0x55a405a69a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:14.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.985+0000 7f5ed9b25640 1 -- 172.21.15.120:0/3624928994 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a40595b3a0 con 0x55a405a6ab40 2024-09-19T05:22:14.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.985+0000 7f5ed8b23640 1 --2- 172.21.15.120:0/3624928994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a7cb80 0x55a405a7ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:22:14.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.985+0000 7f5eca7fc640 1 -- 172.21.15.120:0/258686156 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f5ec400cbe0 con 0x7f5ed4101480 2024-09-19T05:22:14.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.985+0000 7f5ed9b25640 1 --2- 172.21.15.120:0/3624928994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a405a6ab40 0x55a405a69090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5ed40699f0 tx=0x7f5ecc011bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd8cdef3e0d21e27 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:14.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.985+0000 7f5ed9b25640 1 --2- 172.21.15.120:0/258686156 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f5ec00a37b0 0x7f5ec00a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:14.989 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.986+0000 7f5ebf7fe640 1 -- 172.21.15.120:0/3624928994 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc003ad0 con 0x55a405a6ab40 2024-09-19T05:22:14.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.986+0000 7f5ebf7fe640 1 -- 172.21.15.120:0/3624928994 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5ecc00fe20 con 0x55a405a6ab40 2024-09-19T05:22:14.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.986+0000 7f5ebf7fe640 1 -- 172.21.15.120:0/3624928994 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc01a3f0 con 0x55a405a6ab40 2024-09-19T05:22:14.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.986+0000 7f5edd961740 1 -- 172.21.15.120:0/3624928994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a405a6ab40 msgr2=0x55a405a69090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:14.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.986+0000 7f5ed9b25640 1 --2- 172.21.15.120:0/258686156 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f5ec00a37b0 0x7f5ec00a5c70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc01c040 tx=0x7f5ecc01a690 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:14.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.986+0000 7f5edd961740 1 --2- 172.21.15.120:0/3624928994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a405a6ab40 0x55a405a69090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5ed40699f0 tx=0x7f5ecc011bf0 comp rx=0 tx=0).stop 2024-09-19T05:22:14.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.987+0000 7f5edd961740 1 -- 172.21.15.120:0/3624928994 shutdown_connections 2024-09-19T05:22:14.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.987+0000 7f5edd961740 1 --2- 172.21.15.120:0/3624928994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a7cb80 0x55a405a7ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:14.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.987+0000 7f5edd961740 1 --2- 172.21.15.120:0/3624928994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a405a695d0 0x55a405a69a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:14.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.987+0000 7f5edd961740 1 --2- 172.21.15.120:0/3624928994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a405a6ab40 0x55a405a69090 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:14.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.987+0000 7f5edd961740 1 -- 172.21.15.120:0/3624928994 >> 172.21.15.120:0/3624928994 conn(0x55a405a32310 msgr2=0x55a405a65c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:14.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.987+0000 7f5edd961740 1 -- 172.21.15.120:0/3624928994 shutdown_connections 2024-09-19T05:22:14.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.987+0000 7f5edd961740 1 -- 172.21.15.120:0/3624928994 wait complete. 2024-09-19T05:22:14.990 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.987+0000 7f5edd961740 1 -- start start 2024-09-19T05:22:14.991 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.987+0000 7f5edd961740 1 Processor -- start 2024-09-19T05:22:14.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.988+0000 7f5edd961740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a405a695d0 0x55a405a7c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:14.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.988+0000 7f5edd961740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a6ab40 0x55a405a797e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:14.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.988+0000 7f5edd961740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a405a7cb80 0x55a405a79d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:14.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.988+0000 7f5edd961740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55a405a7f880 con 0x55a405a7cb80 2024-09-19T05:22:14.993 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.988+0000 7f5edd961740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55a40598a060 con 0x55a405a695d0 2024-09-19T05:22:14.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.988+0000 7f5edd961740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55a405a7fa00 con 0x55a405a6ab40 2024-09-19T05:22:14.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.988+0000 7f5edd961740 10 client.0 _ll_register_callbacks cb 0x55a4056dd8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:22:14.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.988+0000 7f5ed8b23640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a6ab40 0x55a405a797e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:14.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.988+0000 7f5ed8b23640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a6ab40 0x55a405a797e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:40292/0 (socket says 172.21.15.120:40292) 2024-09-19T05:22:14.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.988+0000 7f5ed8b23640 1 -- 172.21.15.120:0/2386730158 learned_addr learned my addr 172.21.15.120:0/2386730158 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:14.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.988+0000 7f5ed9b25640 1 --2- 172.21.15.120:0/2386730158 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a405a7cb80 0x55a405a79d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:14.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.988+0000 7f5ed9324640 1 --2- 172.21.15.120:0/2386730158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a405a695d0 0x55a405a7c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:14.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.988+0000 7f5ed8b23640 1 -- 172.21.15.120:0/2386730158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a405a695d0 msgr2=0x55a405a7c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:14.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.988+0000 7f5ed8b23640 1 --2- 172.21.15.120:0/2386730158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a405a695d0 0x55a405a7c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:14.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.988+0000 7f5ed8b23640 1 -- 172.21.15.120:0/2386730158 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a405a7cb80 msgr2=0x55a405a79d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:14.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.988+0000 7f5ed8b23640 1 --2- 172.21.15.120:0/2386730158 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a405a7cb80 0x55a405a79d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:14.994 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.988+0000 7f5ed8b23640 1 -- 172.21.15.120:0/2386730158 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4057403c0 con 0x55a405a6ab40 2024-09-19T05:22:14.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.989+0000 7f5ed8b23640 1 --2- 172.21.15.120:0/2386730158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a6ab40 0x55a405a797e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400ea30 tx=0x7f5ec409b6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24ea7ced29b60cac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:14.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.989+0000 7f5ebcff9640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:22:14.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.989+0000 7f5ebcff9640 1 -- 172.21.15.120:0/2386730158 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4003af0 con 0x55a405a6ab40 2024-09-19T05:22:14.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.989+0000 7f5ebcff9640 1 -- 172.21.15.120:0/2386730158 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f5ec40cd3b0 con 0x55a405a6ab40 2024-09-19T05:22:14.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.989+0000 7f5edd961740 1 -- 172.21.15.120:0/2386730158 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ecc00fe20 con 0x55a405a6ab40 2024-09-19T05:22:14.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.989+0000 7f5ebcff9640 1 -- 172.21.15.120:0/2386730158 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5ec409c3c0 con 0x55a405a6ab40 2024-09-19T05:22:14.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.989+0000 7f5edd961740 10 client.25459 fetch_fsmap learned FSMap version 29 2024-09-19T05:22:14.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.989+0000 7f5edd961740 1 -- 172.21.15.120:0/2386730158 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a405a8b2f0 con 0x55a405a6ab40 2024-09-19T05:22:14.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.989+0000 7f5ebcff9640 1 -- 172.21.15.120:0/2386730158 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5ecc00fe20 con 0x55a405a6ab40 2024-09-19T05:22:14.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.989+0000 7f5ebcff9640 1 -- 172.21.15.120:0/2386730158 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f5ec40cfce0 con 0x55a405a6ab40 2024-09-19T05:22:14.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.990+0000 7f5edd961740 10 client.25459 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:22:14.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.990+0000 7f5edd961740 10 client.25459 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T05:22:14.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.990+0000 7f5edd961740 20 client.25459 populate_metadata read hostname 'smithi120' 2024-09-19T05:22:14.995 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.990+0000 7f5edd961740 1 --2- 172.21.15.120:0/2386730158 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55a405a8cc80 0x55a405a8f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:14.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.990+0000 7f5edd961740 4 client.25459 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:22:14.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.990+0000 7f5edd961740 1 -- 172.21.15.120:0/2386730158 --> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4059dc860 con 0x55a405a8cc80 2024-09-19T05:22:14.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.990+0000 7f5ed9324640 1 --2- 172.21.15.120:0/2386730158 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55a405a8cc80 0x55a405a8f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:14.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.990+0000 7f5ed9324640 1 --2- 172.21.15.120:0/2386730158 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55a405a8cc80 0x55a405a8f100 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=159afc210dd21c5a server_cookie=3623e65f854430f0 in_seq=0 out_seq=0 2024-09-19T05:22:14.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.990+0000 7f5ebcff9640 10 client.25459 ms_handle_connect on v2:172.21.15.194:6836/378729335 2024-09-19T05:22:14.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.991+0000 7f5ebcff9640 1 -- 172.21.15.120:0/2386730158 <== mds.2 v2:172.21.15.194:6836/378729335 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a4059dc860 con 0x55a405a8cc80 2024-09-19T05:22:14.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.991+0000 7f5ebcff9640 10 client.25459 handle_command_reply: tid=0 2024-09-19T05:22:14.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.991+0000 7f5edd961740 1 client.25459 shutdown 2024-09-19T05:22:14.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.991+0000 7f5edd961740 1 -- 172.21.15.120:0/2386730158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a6ab40 msgr2=0x55a405a797e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:14.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.991+0000 7f5edd961740 1 --2- 172.21.15.120:0/2386730158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a6ab40 0x55a405a797e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400ea30 tx=0x7f5ec409b6e0 comp rx=0 tx=0).stop 2024-09-19T05:22:14.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.991+0000 7f5edd961740 1 -- 172.21.15.120:0/2386730158 shutdown_connections 2024-09-19T05:22:14.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.991+0000 7f5edd961740 1 --2- 172.21.15.120:0/2386730158 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55a405a8cc80 0x55a405a8f100 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:14.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.991+0000 7f5edd961740 1 --2- 172.21.15.120:0/2386730158 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a405a7cb80 0x55a405a79d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:14.996 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.991+0000 7f5edd961740 1 --2- 172.21.15.120:0/2386730158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a6ab40 0x55a405a797e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:14.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.991+0000 7f5edd961740 1 --2- 172.21.15.120:0/2386730158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a405a695d0 0x55a405a7c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:14.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.991+0000 7f5edd961740 1 -- 172.21.15.120:0/2386730158 >> 172.21.15.120:0/2386730158 conn(0x55a405a32310 msgr2=0x55a405a6b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:14.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.991+0000 7f5ebcff9640 0 client.25459 ms_handle_reset on v2:172.21.15.194:6836/378729335 2024-09-19T05:22:14.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.992+0000 7f5edd961740 1 -- 172.21.15.120:0/2386730158 shutdown_connections 2024-09-19T05:22:14.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.992+0000 7f5edd961740 1 -- 172.21.15.120:0/2386730158 wait complete. 2024-09-19T05:22:14.997 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:14.992+0000 7f5edd961740 20 client.25459 trim_cache size 0 max 16384 2024-09-19T05:22:15.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.009+0000 7f5edd961740 1 Processor -- start 2024-09-19T05:22:15.010 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.009+0000 7f5edd961740 1 -- start start 2024-09-19T05:22:15.012 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.009+0000 7f5edd961740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a405a695d0 0x55a405a88b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:15.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.009+0000 7f5edd961740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a405a6ab40 0x55a405a6a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:15.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.009+0000 7f5edd961740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a7cb80 0x55a405a780b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:15.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.009+0000 7f5edd961740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed41ae110 con 0x55a405a695d0 2024-09-19T05:22:15.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.009+0000 7f5edd961740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed41ab9e0 con 0x55a405a6ab40 2024-09-19T05:22:15.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.009+0000 7f5edd961740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed41a9830 con 0x55a405a7cb80 2024-09-19T05:22:15.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.009+0000 7f5ed8b23640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a405a6ab40 0x55a405a6a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:15.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.009+0000 7f5ed9b25640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a7cb80 0x55a405a780b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:15.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.009+0000 7f5ed8b23640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a405a6ab40 0x55a405a6a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:60898/0 (socket says 172.21.15.120:60898) 2024-09-19T05:22:15.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.009+0000 7f5ed8b23640 1 -- 172.21.15.120:0/2140181129 learned_addr learned my addr 172.21.15.120:0/2140181129 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:15.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.009+0000 7f5ed9324640 1 --2- 172.21.15.120:0/2140181129 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a405a695d0 0x55a405a88b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:15.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.009+0000 7f5ed9b25640 1 -- 172.21.15.120:0/2140181129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a405a6ab40 msgr2=0x55a405a6a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:15.013 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.009+0000 7f5ed9b25640 1 --2- 172.21.15.120:0/2140181129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a405a6ab40 0x55a405a6a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.009+0000 7f5ed9b25640 1 -- 172.21.15.120:0/2140181129 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a405a695d0 msgr2=0x55a405a88b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.009+0000 7f5ed9b25640 1 --2- 172.21.15.120:0/2140181129 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a405a695d0 0x55a405a88b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.009+0000 7f5ed9b25640 1 -- 172.21.15.120:0/2140181129 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a405a7a0f0 con 0x55a405a7cb80 2024-09-19T05:22:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.009+0000 7f5ed9324640 1 --2- 172.21.15.120:0/2140181129 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a405a695d0 0x55a405a88b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:22:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.010+0000 7f5ed9b25640 1 --2- 172.21.15.120:0/2140181129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a7cb80 0x55a405a780b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc011730 tx=0x7f5ecc027000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf3e59164f9fa913 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.010+0000 7f5ebeffd640 1 -- 172.21.15.120:0/2140181129 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc009570 con 0x55a405a7cb80 2024-09-19T05:22:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.010+0000 7f5ebeffd640 1 -- 172.21.15.120:0/2140181129 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5ecc038070 con 0x55a405a7cb80 2024-09-19T05:22:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.010+0000 7f5ebeffd640 1 -- 172.21.15.120:0/2140181129 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc00fbd0 con 0x55a405a7cb80 2024-09-19T05:22:15.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.011+0000 7f5edd961740 1 -- 172.21.15.120:0/2140181129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a7cb80 msgr2=0x55a405a780b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:15.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.011+0000 7f5edd961740 1 --2- 172.21.15.120:0/2140181129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a7cb80 0x55a405a780b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc011730 tx=0x7f5ecc027000 comp rx=0 tx=0).stop 2024-09-19T05:22:15.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.011+0000 7f5edd961740 1 -- 172.21.15.120:0/2140181129 shutdown_connections 2024-09-19T05:22:15.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.011+0000 7f5edd961740 1 --2- 172.21.15.120:0/2140181129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a7cb80 0x55a405a780b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:15.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.011+0000 7f5edd961740 1 --2- 172.21.15.120:0/2140181129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a405a6ab40 0x55a405a6a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:15.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.011+0000 7f5edd961740 1 --2- 172.21.15.120:0/2140181129 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a405a695d0 0x55a405a88b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:15.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.011+0000 7f5edd961740 1 -- 172.21.15.120:0/2140181129 >> 172.21.15.120:0/2140181129 conn(0x55a405a32310 msgr2=0x55a405a60a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:15.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.011+0000 7f5edd961740 1 -- 172.21.15.120:0/2140181129 shutdown_connections 2024-09-19T05:22:15.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.011+0000 7f5edd961740 1 -- 172.21.15.120:0/2140181129 wait complete. 2024-09-19T05:22:15.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.012+0000 7f5edd961740 1 -- start start 2024-09-19T05:22:15.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.012+0000 7f5edd961740 1 Processor -- start 2024-09-19T05:22:15.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.012+0000 7f5edd961740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a695d0 0x55a405a84c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:15.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.012+0000 7f5edd961740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a405a6ab40 0x55a405a851d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:15.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.013+0000 7f5edd961740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a405a7cb80 0x55a405a75bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:15.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.013+0000 7f5edd961740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed41a9ea0 con 0x55a405a6ab40 2024-09-19T05:22:15.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.013+0000 7f5edd961740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed41ab310 con 0x55a405a7cb80 2024-09-19T05:22:15.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.013+0000 7f5edd961740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed41aa570 con 0x55a405a695d0 2024-09-19T05:22:15.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.013+0000 7f5ed9324640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a695d0 0x55a405a84c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:15.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.013+0000 7f5edd961740 10 client.0 _ll_register_callbacks cb 0x7f5ec4003df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:22:15.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.013+0000 7f5ed9324640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a695d0 0x55a405a84c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:60598/0 (socket says 172.21.15.120:60598) 2024-09-19T05:22:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.013+0000 7f5ed9324640 1 -- 172.21.15.120:0/428842048 learned_addr learned my addr 172.21.15.120:0/428842048 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.013+0000 7f5ed8b23640 1 --2- 172.21.15.120:0/428842048 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a405a6ab40 0x55a405a851d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.013+0000 7f5ed9b25640 1 --2- 172.21.15.120:0/428842048 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a405a7cb80 0x55a405a75bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.013+0000 7f5ed9324640 1 -- 172.21.15.120:0/428842048 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a405a7cb80 msgr2=0x55a405a75bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.013+0000 7f5ed9324640 1 --2- 172.21.15.120:0/428842048 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a405a7cb80 0x55a405a75bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.013+0000 7f5ed9324640 1 -- 172.21.15.120:0/428842048 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a405a6ab40 msgr2=0x55a405a851d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.013+0000 7f5ed9324640 1 --2- 172.21.15.120:0/428842048 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a405a6ab40 0x55a405a851d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.013+0000 7f5ed9324640 1 -- 172.21.15.120:0/428842048 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a405a76110 con 0x55a405a695d0 2024-09-19T05:22:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.013+0000 7f5ed9b25640 1 --2- 172.21.15.120:0/428842048 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a405a7cb80 0x55a405a75bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:22:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.013+0000 7f5ed9324640 1 --2- 172.21.15.120:0/428842048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a695d0 0x55a405a84c90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5ed002a930 tx=0x7f5ed002a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc45a1130d911d65 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.013+0000 7f5ebcff9640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:22:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.013+0000 7f5ebcff9640 1 -- 172.21.15.120:0/428842048 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0035040 con 0x55a405a695d0 2024-09-19T05:22:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.013+0000 7f5ebcff9640 1 -- 172.21.15.120:0/428842048 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f5ed0005240 con 0x55a405a695d0 2024-09-19T05:22:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.013+0000 7f5edd961740 1 -- 172.21.15.120:0/428842048 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ecc038070 con 0x55a405a695d0 2024-09-19T05:22:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.014+0000 7f5ebcff9640 1 -- 172.21.15.120:0/428842048 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5ed0053050 con 0x55a405a695d0 2024-09-19T05:22:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.014+0000 7f5edd961740 10 client.25465 fetch_fsmap learned FSMap version 29 2024-09-19T05:22:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.014+0000 7f5edd961740 1 -- 172.21.15.120:0/428842048 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a405af70f0 con 0x55a405a695d0 2024-09-19T05:22:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.014+0000 7f5ebcff9640 1 -- 172.21.15.120:0/428842048 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f5ecc038070 con 0x55a405a695d0 2024-09-19T05:22:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.014+0000 7f5ebcff9640 1 -- 172.21.15.120:0/428842048 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f5ed0031600 con 0x55a405a695d0 2024-09-19T05:22:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.014+0000 7f5edd961740 10 client.25465 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:22:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.014+0000 7f5edd961740 10 client.25465 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T05:22:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.014+0000 7f5edd961740 20 client.25465 populate_metadata read hostname 'smithi120' 2024-09-19T05:22:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.014+0000 7f5edd961740 1 --2- 172.21.15.120:0/428842048 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55a405af78c0 0x55a405af9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.014+0000 7f5edd961740 4 client.25465 mds_command: new command op to 24430 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T05:22:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.014+0000 7f5edd961740 1 -- 172.21.15.120:0/428842048 --> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a4059d6d70 con 0x55a405af78c0 2024-09-19T05:22:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.014+0000 7f5ed8b23640 1 --2- 172.21.15.120:0/428842048 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55a405af78c0 0x55a405af9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.015+0000 7f5ebcff9640 10 client.25465 ms_handle_connect on v2:172.21.15.194:6836/378729335 2024-09-19T05:22:15.021 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.015+0000 7f5ed8b23640 1 --2- 172.21.15.120:0/428842048 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55a405af78c0 0x55a405af9ce0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fa28154dd280e548 server_cookie=ff3a92393fc5890f in_seq=0 out_seq=0 2024-09-19T05:22:15.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.016+0000 7f5ebcff9640 1 -- 172.21.15.120:0/428842048 <== mds.2 v2:172.21.15.194:6836/378729335 1 ==== command_reply(tid 0: 0 ) ==== 8+0+75907 (crc 0 0 0) 0x55a4059d6d70 con 0x55a405af78c0 2024-09-19T05:22:15.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.016+0000 7f5ebcff9640 10 client.25465 handle_command_reply: tid=0 2024-09-19T05:22:15.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.017+0000 7f5edd961740 1 client.25465 shutdown 2024-09-19T05:22:15.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.017+0000 7f5edd961740 1 -- 172.21.15.120:0/428842048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a695d0 msgr2=0x55a405a84c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:15.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.017+0000 7f5edd961740 1 --2- 172.21.15.120:0/428842048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a695d0 0x55a405a84c90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5ed002a930 tx=0x7f5ed002a410 comp rx=0 tx=0).stop 2024-09-19T05:22:15.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.017+0000 7f5edd961740 1 -- 172.21.15.120:0/428842048 shutdown_connections 2024-09-19T05:22:15.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.017+0000 7f5edd961740 1 --2- 172.21.15.120:0/428842048 >> [v2:172.21.15.194:6836/378729335,v1:172.21.15.194:6837/378729335] conn(0x55a405af78c0 0x55a405af9ce0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:15.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.017+0000 7f5edd961740 1 --2- 172.21.15.120:0/428842048 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a405a7cb80 0x55a405a75bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:15.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.017+0000 7f5edd961740 1 --2- 172.21.15.120:0/428842048 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55a405a6ab40 0x55a405a851d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:15.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.017+0000 7f5edd961740 1 --2- 172.21.15.120:0/428842048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a405a695d0 0x55a405a84c90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:15.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.017+0000 7f5ebcff9640 0 client.25465 ms_handle_reset on v2:172.21.15.194:6836/378729335 2024-09-19T05:22:15.022 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.017+0000 7f5edd961740 1 -- 172.21.15.120:0/428842048 >> 172.21.15.120:0/428842048 conn(0x55a405a32310 msgr2=0x55a405a7b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:15.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.017+0000 7f5edd961740 1 -- 172.21.15.120:0/428842048 shutdown_connections 2024-09-19T05:22:15.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.017+0000 7f5edd961740 1 -- 172.21.15.120:0/428842048 wait complete. 2024-09-19T05:22:15.023 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.017+0000 7f5edd961740 20 client.25465 trim_cache size 0 max 16384 2024-09-19T05:22:15.023 INFO:teuthology.orchestra.run.smithi120.stdout:[ 2024-09-19T05:22:15.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.023 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.023 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2831299, 2024-09-19T05:22:15.023 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635393, 2024-09-19T05:22:15.024 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-9.xml" 2024-09-19T05:22:15.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.024 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.024 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 5086807, 2024-09-19T05:22:15.024 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635872, 2024-09-19T05:22:15.024 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-32.jpg" 2024-09-19T05:22:15.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.024 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.024 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 22161668, 2024-09-19T05:22:15.024 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635883, 2024-09-19T05:22:15.025 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-10.jpg" 2024-09-19T05:22:15.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.025 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.025 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 25581820, 2024-09-19T05:22:15.025 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635871, 2024-09-19T05:22:15.025 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-3.xml" 2024-09-19T05:22:15.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.025 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.025 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 35511651, 2024-09-19T05:22:15.025 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635450, 2024-09-19T05:22:15.025 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-28.jpg" 2024-09-19T05:22:15.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.026 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.026 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 63473628, 2024-09-19T05:22:15.026 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635894, 2024-09-19T05:22:15.026 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-23.jpg" 2024-09-19T05:22:15.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.026 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.026 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 66544084, 2024-09-19T05:22:15.026 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635715, 2024-09-19T05:22:15.026 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-60.jpg" 2024-09-19T05:22:15.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.026 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.027 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 70189308, 2024-09-19T05:22:15.027 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635234, 2024-09-19T05:22:15.027 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-52.jpg" 2024-09-19T05:22:15.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.027 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.027 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 114480566, 2024-09-19T05:22:15.027 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635862, 2024-09-19T05:22:15.027 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-37.jpg" 2024-09-19T05:22:15.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.027 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.027 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 157798956, 2024-09-19T05:22:15.027 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635668, 2024-09-19T05:22:15.028 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-79.jpg" 2024-09-19T05:22:15.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.028 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.028 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 184375122, 2024-09-19T05:22:15.028 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635778, 2024-09-19T05:22:15.028 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-19.xml" 2024-09-19T05:22:15.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.028 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.028 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 221745295, 2024-09-19T05:22:15.028 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635285, 2024-09-19T05:22:15.028 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-28.jpg" 2024-09-19T05:22:15.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.029 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.029 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 227104261, 2024-09-19T05:22:15.029 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635830, 2024-09-19T05:22:15.029 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-52.jpg" 2024-09-19T05:22:15.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.029 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.029 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 227383510, 2024-09-19T05:22:15.029 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635845, 2024-09-19T05:22:15.029 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-45.jpg" 2024-09-19T05:22:15.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.029 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.030 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 256287027, 2024-09-19T05:22:15.030 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635805, 2024-09-19T05:22:15.030 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-8.xml" 2024-09-19T05:22:15.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.030 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.030 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 257406397, 2024-09-19T05:22:15.030 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635921, 2024-09-19T05:22:15.030 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-8.xml" 2024-09-19T05:22:15.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.030 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.030 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 259070226, 2024-09-19T05:22:15.030 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635736, 2024-09-19T05:22:15.031 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-39.xml" 2024-09-19T05:22:15.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.031 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.031 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 286099739, 2024-09-19T05:22:15.031 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635481, 2024-09-19T05:22:15.031 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-14.jpg" 2024-09-19T05:22:15.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.031 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.031 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 287207373, 2024-09-19T05:22:15.031 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635809, 2024-09-19T05:22:15.031 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-6.xml" 2024-09-19T05:22:15.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.032 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.032 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 308671111, 2024-09-19T05:22:15.032 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635685, 2024-09-19T05:22:15.032 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-62.xml" 2024-09-19T05:22:15.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.032 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.032 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 318323911, 2024-09-19T05:22:15.032 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635687, 2024-09-19T05:22:15.032 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-72.jpg" 2024-09-19T05:22:15.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.032 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.032 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 324300956, 2024-09-19T05:22:15.033 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635863, 2024-09-19T05:22:15.033 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-7.xml" 2024-09-19T05:22:15.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.033 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.033 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 331771554, 2024-09-19T05:22:15.033 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635832, 2024-09-19T05:22:15.033 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-11.jpg" 2024-09-19T05:22:15.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.033 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.033 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 344175608, 2024-09-19T05:22:15.033 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635682, 2024-09-19T05:22:15.033 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-63.xml" 2024-09-19T05:22:15.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.034 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.034 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 348671565, 2024-09-19T05:22:15.034 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635291, 2024-09-19T05:22:15.034 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-25.jpg" 2024-09-19T05:22:15.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.034 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.034 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 365490141, 2024-09-19T05:22:15.034 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635343, 2024-09-19T05:22:15.034 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-1.jpg" 2024-09-19T05:22:15.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.035 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.035 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 381013420, 2024-09-19T05:22:15.035 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635321, 2024-09-19T05:22:15.035 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-10.jpg" 2024-09-19T05:22:15.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.035 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.035 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 388820922, 2024-09-19T05:22:15.035 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635734, 2024-09-19T05:22:15.035 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-40.xml" 2024-09-19T05:22:15.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.035 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.035 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 410636599, 2024-09-19T05:22:15.036 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635910, 2024-09-19T05:22:15.036 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-2.jpg" 2024-09-19T05:22:15.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.036 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.036 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 418263546, 2024-09-19T05:22:15.036 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635887, 2024-09-19T05:22:15.036 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-9.jpg" 2024-09-19T05:22:15.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.036 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.036 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 419198158, 2024-09-19T05:22:15.036 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635864, 2024-09-19T05:22:15.036 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-36.jpg" 2024-09-19T05:22:15.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.037 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.037 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 470154329, 2024-09-19T05:22:15.037 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635966, 2024-09-19T05:22:15.037 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-2.jpg" 2024-09-19T05:22:15.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.037 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.037 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 488476914, 2024-09-19T05:22:15.037 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635797, 2024-09-19T05:22:15.037 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-37/article-62.xml" 2024-09-19T05:22:15.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.038 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.038 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 490972605, 2024-09-19T05:22:15.038 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635310, 2024-09-19T05:22:15.038 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-15.jpg" 2024-09-19T05:22:15.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.038 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.038 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 500768407, 2024-09-19T05:22:15.038 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635582, 2024-09-19T05:22:15.038 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-38.xml" 2024-09-19T05:22:15.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.038 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.038 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 514875933, 2024-09-19T05:22:15.039 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635767, 2024-09-19T05:22:15.039 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-24.xml" 2024-09-19T05:22:15.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.039 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.039 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 538317364, 2024-09-19T05:22:15.039 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635851, 2024-09-19T05:22:15.039 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-42.jpg" 2024-09-19T05:22:15.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.039 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.039 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 539933344, 2024-09-19T05:22:15.039 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635866, 2024-09-19T05:22:15.039 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-35.jpg" 2024-09-19T05:22:15.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.040 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.040 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 561898740, 2024-09-19T05:22:15.040 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635714, 2024-09-19T05:22:15.040 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-49.xml" 2024-09-19T05:22:15.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.040 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.040 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 569085257, 2024-09-19T05:22:15.040 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635815, 2024-09-19T05:22:15.040 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-4.xml" 2024-09-19T05:22:15.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.041 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.041 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 588336430, 2024-09-19T05:22:15.041 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635869, 2024-09-19T05:22:15.041 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-4.xml" 2024-09-19T05:22:15.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.041 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.041 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 596271357, 2024-09-19T05:22:15.041 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635416, 2024-09-19T05:22:15.041 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-42.jpg" 2024-09-19T05:22:15.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.042 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.042 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 599315877, 2024-09-19T05:22:15.042 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635317, 2024-09-19T05:22:15.042 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-45.xml" 2024-09-19T05:22:15.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.042 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.042 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 639005006, 2024-09-19T05:22:15.042 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635717, 2024-09-19T05:22:15.042 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-59.jpg" 2024-09-19T05:22:15.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.042 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.042 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 681540618, 2024-09-19T05:22:15.043 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635719, 2024-09-19T05:22:15.043 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-46.xml" 2024-09-19T05:22:15.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.043 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.043 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 688201069, 2024-09-19T05:22:15.043 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635266, 2024-09-19T05:22:15.043 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-36.jpg" 2024-09-19T05:22:15.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.043 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.043 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 692225414, 2024-09-19T05:22:15.043 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635606, 2024-09-19T05:22:15.044 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-27.xml" 2024-09-19T05:22:15.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.044 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.044 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 693540267, 2024-09-19T05:22:15.044 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635827, 2024-09-19T05:22:15.044 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-13.jpg" 2024-09-19T05:22:15.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.044 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.044 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 695520799, 2024-09-19T05:22:15.044 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635338, 2024-09-19T05:22:15.044 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-3.jpg" 2024-09-19T05:22:15.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.045 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.045 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 726740037, 2024-09-19T05:22:15.045 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635754, 2024-09-19T05:22:15.045 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-30.xml" 2024-09-19T05:22:15.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.045 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.045 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 730494631, 2024-09-19T05:22:15.045 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635677, 2024-09-19T05:22:15.045 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-65.xml" 2024-09-19T05:22:15.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.045 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.046 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 730681560, 2024-09-19T05:22:15.046 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635756, 2024-09-19T05:22:15.046 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-29.xml" 2024-09-19T05:22:15.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.046 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.046 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 744493619, 2024-09-19T05:22:15.046 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635854, 2024-09-19T05:22:15.046 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-40.jpg" 2024-09-19T05:22:15.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.047 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.047 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 760058626, 2024-09-19T05:22:15.047 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635865, 2024-09-19T05:22:15.047 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-6.xml" 2024-09-19T05:22:15.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.047 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.047 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 781138270, 2024-09-19T05:22:15.047 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635340, 2024-09-19T05:22:15.047 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-2.jpg" 2024-09-19T05:22:15.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.048 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.048 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 812662498, 2024-09-19T05:22:15.048 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635484, 2024-09-19T05:22:15.048 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-13.jpg" 2024-09-19T05:22:15.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.048 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.048 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 819196186, 2024-09-19T05:22:15.048 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635308, 2024-09-19T05:22:15.048 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-16.jpg" 2024-09-19T05:22:15.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.048 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.048 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 842448551, 2024-09-19T05:22:15.049 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635728, 2024-09-19T05:22:15.049 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-55.jpg" 2024-09-19T05:22:15.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.049 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.049 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 859172463, 2024-09-19T05:22:15.049 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635576, 2024-09-19T05:22:15.049 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-41.xml" 2024-09-19T05:22:15.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.049 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.049 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 860367617, 2024-09-19T05:22:15.049 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635969, 2024-09-19T05:22:15.050 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-1.jpg" 2024-09-19T05:22:15.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.050 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.050 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 881528757, 2024-09-19T05:22:15.050 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635896, 2024-09-19T05:22:15.050 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-6.jpg" 2024-09-19T05:22:15.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.050 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.050 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 892470546, 2024-09-19T05:22:15.050 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635888, 2024-09-19T05:22:15.050 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-25.jpg" 2024-09-19T05:22:15.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.051 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.051 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 900142355, 2024-09-19T05:22:15.051 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635828, 2024-09-19T05:22:15.051 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-53.jpg" 2024-09-19T05:22:15.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.051 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.051 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 949751403, 2024-09-19T05:22:15.051 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635294, 2024-09-19T05:22:15.051 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-23.jpg" 2024-09-19T05:22:15.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.051 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.051 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 957801564, 2024-09-19T05:22:15.052 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635947, 2024-09-19T05:22:15.052 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-6.jpg" 2024-09-19T05:22:15.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.052 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.052 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 962029128, 2024-09-19T05:22:15.052 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635458, 2024-09-19T05:22:15.052 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-24.jpg" 2024-09-19T05:22:15.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.052 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.052 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 968075001, 2024-09-19T05:22:15.052 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635833, 2024-09-19T05:22:15.052 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-50.jpg" 2024-09-19T05:22:15.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.053 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.053 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 981737678, 2024-09-19T05:22:15.053 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635272, 2024-09-19T05:22:15.053 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-34.jpg" 2024-09-19T05:22:15.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.054 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.054 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1015800634, 2024-09-19T05:22:15.054 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635870, 2024-09-19T05:22:15.054 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-33.jpg" 2024-09-19T05:22:15.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.054 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.054 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1017764659, 2024-09-19T05:22:15.054 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635694, 2024-09-19T05:22:15.054 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-59.xml" 2024-09-19T05:22:15.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.055 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.055 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1028388924, 2024-09-19T05:22:15.055 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635918, 2024-09-19T05:22:15.055 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-9.xml" 2024-09-19T05:22:15.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.055 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.055 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1046580855, 2024-09-19T05:22:15.055 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635902, 2024-09-19T05:22:15.055 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-20.jpg" 2024-09-19T05:22:15.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.055 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.055 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1049345148, 2024-09-19T05:22:15.056 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635915, 2024-09-19T05:22:15.056 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-16.jpg" 2024-09-19T05:22:15.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.056 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.056 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1059344224, 2024-09-19T05:22:15.056 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635242, 2024-09-19T05:22:15.056 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-48.jpg" 2024-09-19T05:22:15.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.056 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.056 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1061425018, 2024-09-19T05:22:15.056 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635323, 2024-09-19T05:22:15.057 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-41.xml" 2024-09-19T05:22:15.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.057 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.057 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1070228156, 2024-09-19T05:22:15.057 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635930, 2024-09-19T05:22:15.057 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-6.xml" 2024-09-19T05:22:15.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.057 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.057 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1092033741, 2024-09-19T05:22:15.057 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635344, 2024-09-19T05:22:15.057 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-31.xml" 2024-09-19T05:22:15.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.058 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.058 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1095195686, 2024-09-19T05:22:15.058 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635961, 2024-09-19T05:22:15.058 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-1.jpg" 2024-09-19T05:22:15.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.058 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.058 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1097702359, 2024-09-19T05:22:15.058 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635857, 2024-09-19T05:22:15.058 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-39.jpg" 2024-09-19T05:22:15.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.059 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.059 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1101014197, 2024-09-19T05:22:15.059 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635316, 2024-09-19T05:22:15.059 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-12.jpg" 2024-09-19T05:22:15.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.059 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.059 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1146808131, 2024-09-19T05:22:15.059 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635262, 2024-09-19T05:22:15.059 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-38.jpg" 2024-09-19T05:22:15.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.059 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.059 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1169391192, 2024-09-19T05:22:15.060 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635508, 2024-09-19T05:22:15.060 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-1.jpg" 2024-09-19T05:22:15.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.060 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.060 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1171149442, 2024-09-19T05:22:15.060 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635300, 2024-09-19T05:22:15.060 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-20.jpg" 2024-09-19T05:22:15.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.060 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.060 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1171581867, 2024-09-19T05:22:15.060 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635252, 2024-09-19T05:22:15.060 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-43.jpg" 2024-09-19T05:22:15.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.061 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.061 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1175449796, 2024-09-19T05:22:15.061 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635679, 2024-09-19T05:22:15.061 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-64.xml" 2024-09-19T05:22:15.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.061 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.061 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1176980220, 2024-09-19T05:22:15.061 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635568, 2024-09-19T05:22:15.061 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-45.xml" 2024-09-19T05:22:15.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.062 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.062 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1199483615, 2024-09-19T05:22:15.062 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635747, 2024-09-19T05:22:15.062 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-47.jpg" 2024-09-19T05:22:15.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.062 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.062 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1238007282, 2024-09-19T05:22:15.062 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635861, 2024-09-19T05:22:15.062 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-8.xml" 2024-09-19T05:22:15.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.062 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.062 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1246221824, 2024-09-19T05:22:15.063 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635942, 2024-09-19T05:22:15.063 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-2.xml" 2024-09-19T05:22:15.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.063 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.063 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1246627726, 2024-09-19T05:22:15.063 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635473, 2024-09-19T05:22:15.063 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-17.jpg" 2024-09-19T05:22:15.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.063 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.063 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1321480612, 2024-09-19T05:22:15.063 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635842, 2024-09-19T05:22:15.064 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-7.jpg" 2024-09-19T05:22:15.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.064 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.064 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1340082768, 2024-09-19T05:22:15.064 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635773, 2024-09-19T05:22:15.064 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-35.jpg" 2024-09-19T05:22:15.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.064 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.064 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1342946181, 2024-09-19T05:22:15.064 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635374, 2024-09-19T05:22:15.064 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-18.xml" 2024-09-19T05:22:15.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.065 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.065 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1351779975, 2024-09-19T05:22:15.065 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635238, 2024-09-19T05:22:15.065 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-50.jpg" 2024-09-19T05:22:15.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.065 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.065 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1356679070, 2024-09-19T05:22:15.065 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635841, 2024-09-19T05:22:15.065 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-46.jpg" 2024-09-19T05:22:15.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.065 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.066 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1359229366, 2024-09-19T05:22:15.066 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635519, 2024-09-19T05:22:15.066 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-69.xml" 2024-09-19T05:22:15.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.066 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.066 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1362891840, 2024-09-19T05:22:15.066 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635609, 2024-09-19T05:22:15.066 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-26.xml" 2024-09-19T05:22:15.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.066 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.066 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1403736647, 2024-09-19T05:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635929, 2024-09-19T05:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-12.jpg" 2024-09-19T05:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1437194815, 2024-09-19T05:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635429, 2024-09-19T05:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-37/picture-48.jpg" 2024-09-19T05:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1442870414, 2024-09-19T05:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635436, 2024-09-19T05:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-35.jpg" 2024-09-19T05:22:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1444431085, 2024-09-19T05:22:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635653, 2024-09-19T05:22:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-4.xml" 2024-09-19T05:22:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1445148065, 2024-09-19T05:22:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635938, 2024-09-19T05:22:15.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.019+0000 7f5edb588640 1 -- 172.21.15.120:0/258686156 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f5ec00a37b0 msgr2=0x7f5ec00a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:15.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.019+0000 7f5edb588640 1 --2- 172.21.15.120:0/258686156 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f5ec00a37b0 0x7f5ec00a5c70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc01c040 tx=0x7f5ecc01a690 comp rx=0 tx=0).stop 2024-09-19T05:22:15.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.019+0000 7f5edb588640 1 -- 172.21.15.120:0/258686156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ed4101480 msgr2=0x7f5ed419abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:15.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.019+0000 7f5edb588640 1 --2- 172.21.15.120:0/258686156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ed4101480 0x7f5ed419abe0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400ea60 tx=0x7f5ec400ef20 comp rx=0 tx=0).stop 2024-09-19T05:22:15.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.019+0000 7f5edb588640 1 -- 172.21.15.120:0/258686156 shutdown_connections 2024-09-19T05:22:15.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.019+0000 7f5edb588640 1 --2- 172.21.15.120:0/258686156 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f5ec00a37b0 0x7f5ec00a5c70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:15.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.019+0000 7f5edb588640 1 --2- 172.21.15.120:0/258686156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5ed410e540 0x7f5ed419ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:15.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.019+0000 7f5edb588640 1 --2- 172.21.15.120:0/258686156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ed4101480 0x7f5ed419abe0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:15.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.019+0000 7f5edb588640 1 --2- 172.21.15.120:0/258686156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ed4100b60 0x7f5ed419a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:15.069 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.019+0000 7f5edb588640 1 -- 172.21.15.120:0/258686156 >> 172.21.15.120:0/258686156 conn(0x7f5ed40fc7d0 msgr2=0x7f5ed40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:15.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.019+0000 7f5edb588640 1 -- 172.21.15.120:0/258686156 shutdown_connections 2024-09-19T05:22:15.070 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:15.019+0000 7f5edb588640 1 -- 172.21.15.120:0/258686156 wait complete. 2024-09-19T05:22:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-9.jpg" 2024-09-19T05:22:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1450631617, 2024-09-19T05:22:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635258, 2024-09-19T05:22:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-40.jpg" 2024-09-19T05:22:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1450914503, 2024-09-19T05:22:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635945, 2024-09-19T05:22:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-1.xml" 2024-09-19T05:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1475901220, 2024-09-19T05:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635748, 2024-09-19T05:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-33.xml" 2024-09-19T05:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1478344868, 2024-09-19T05:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635876, 2024-09-19T05:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-30.jpg" 2024-09-19T05:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1490594318, 2024-09-19T05:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635825, 2024-09-19T05:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-14.jpg" 2024-09-19T05:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1503267373, 2024-09-19T05:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635328, 2024-09-19T05:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-7.jpg" 2024-09-19T05:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1517298733, 2024-09-19T05:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635566, 2024-09-19T05:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-46.xml" 2024-09-19T05:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1526755333, 2024-09-19T05:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635890, 2024-09-19T05:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-8.jpg" 2024-09-19T05:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1542786581, 2024-09-19T05:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635829, 2024-09-19T05:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-12.jpg" 2024-09-19T05:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1551178418, 2024-09-19T05:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635808, 2024-09-19T05:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-7.xml" 2024-09-19T05:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1560528242, 2024-09-19T05:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635868, 2024-09-19T05:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-34.jpg" 2024-09-19T05:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1584688449, 2024-09-19T05:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635897, 2024-09-19T05:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-22.jpg" 2024-09-19T05:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1604164697, 2024-09-19T05:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635810, 2024-09-19T05:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-22.jpg" 2024-09-19T05:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1627699719, 2024-09-19T05:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635440, 2024-09-19T05:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-33.jpg" 2024-09-19T05:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1632720295, 2024-09-19T05:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635850, 2024-09-19T05:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-3.jpg" 2024-09-19T05:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1648882112, 2024-09-19T05:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635799, 2024-09-19T05:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-10.xml" 2024-09-19T05:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1663772827, 2024-09-19T05:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635839, 2024-09-19T05:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-47.jpg" 2024-09-19T05:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1682386794, 2024-09-19T05:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635891, 2024-09-19T05:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-24.jpg" 2024-09-19T05:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1698617677, 2024-09-19T05:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635847, 2024-09-19T05:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-44.jpg" 2024-09-19T05:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1728452558, 2024-09-19T05:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635786, 2024-09-19T05:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-15.xml" 2024-09-19T05:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1746811140, 2024-09-19T05:22:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635716, 2024-09-19T05:22:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-48.xml" 2024-09-19T05:22:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1751357283, 2024-09-19T05:22:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635718, 2024-09-19T05:22:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-47.xml" 2024-09-19T05:22:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1776152632, 2024-09-19T05:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635908, 2024-09-19T05:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-18.jpg" 2024-09-19T05:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1790090703, 2024-09-19T05:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635490, 2024-09-19T05:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-10.jpg" 2024-09-19T05:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1817343820, 2024-09-19T05:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635935, 2024-09-19T05:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-10.jpg" 2024-09-19T05:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1823665092, 2024-09-19T05:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635675, 2024-09-19T05:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-66.xml" 2024-09-19T05:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1846824323, 2024-09-19T05:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635867, 2024-09-19T05:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-5.xml" 2024-09-19T05:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1866867135, 2024-09-19T05:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635690, 2024-09-19T05:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-71.jpg" 2024-09-19T05:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1878231334, 2024-09-19T05:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635431, 2024-09-19T05:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-37.jpg" 2024-09-19T05:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1962827401, 2024-09-19T05:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635709, 2024-09-19T05:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-63.jpg" 2024-09-19T05:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1963056156, 2024-09-19T05:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635731, 2024-09-19T05:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-41.xml" 2024-09-19T05:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1972394003, 2024-09-19T05:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635878, 2024-09-19T05:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-29.jpg" 2024-09-19T05:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1977132132, 2024-09-19T05:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635240, 2024-09-19T05:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-49.jpg" 2024-09-19T05:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2002793466, 2024-09-19T05:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635260, 2024-09-19T05:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-39.jpg" 2024-09-19T05:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2017710665, 2024-09-19T05:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635498, 2024-09-19T05:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-6.jpg" 2024-09-19T05:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2057498550, 2024-09-19T05:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635314, 2024-09-19T05:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-13.jpg" 2024-09-19T05:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2078799518, 2024-09-19T05:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635708, 2024-09-19T05:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-52.xml" 2024-09-19T05:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2078821489, 2024-09-19T05:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635248, 2024-09-19T05:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-45.jpg" 2024-09-19T05:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2086813812, 2024-09-19T05:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635296, 2024-09-19T05:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-22.jpg" 2024-09-19T05:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2093289796, 2024-09-19T05:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635268, 2024-09-19T05:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-35.jpg" 2024-09-19T05:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2120792376, 2024-09-19T05:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635232, 2024-09-19T05:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-53.jpg" 2024-09-19T05:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2121574137, 2024-09-19T05:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635284, 2024-09-19T05:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-61.xml" 2024-09-19T05:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2148310562, 2024-09-19T05:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635492, 2024-09-19T05:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-9.jpg" 2024-09-19T05:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2166540970, 2024-09-19T05:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635289, 2024-09-19T05:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-59.xml" 2024-09-19T05:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2169660242, 2024-09-19T05:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635629, 2024-09-19T05:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-16.xml" 2024-09-19T05:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2194903410, 2024-09-19T05:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635782, 2024-09-19T05:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-17.xml" 2024-09-19T05:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2210117846, 2024-09-19T05:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635772, 2024-09-19T05:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-22.xml" 2024-09-19T05:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2321885914, 2024-09-19T05:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635600, 2024-09-19T05:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-29.xml" 2024-09-19T05:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2351005250, 2024-09-19T05:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635760, 2024-09-19T05:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-41.jpg" 2024-09-19T05:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2356148856, 2024-09-19T05:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635853, 2024-09-19T05:22:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-41.jpg" 2024-09-19T05:22:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2360647913, 2024-09-19T05:22:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635246, 2024-09-19T05:22:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-46.jpg" 2024-09-19T05:22:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2372543600, 2024-09-19T05:22:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635283, 2024-09-19T05:22:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-29.jpg" 2024-09-19T05:22:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2377913994, 2024-09-19T05:22:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635706, 2024-09-19T05:22:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-53.xml" 2024-09-19T05:22:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2379146078, 2024-09-19T05:22:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635286, 2024-09-19T05:22:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-27.jpg" 2024-09-19T05:22:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2401992373, 2024-09-19T05:22:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635318, 2024-09-19T05:22:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-44.xml" 2024-09-19T05:22:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2451820016, 2024-09-19T05:22:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635710, 2024-09-19T05:22:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-51.xml" 2024-09-19T05:22:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2453303839, 2024-09-19T05:22:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635541, 2024-09-19T05:22:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-59.xml" 2024-09-19T05:22:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2481287035, 2024-09-19T05:22:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635907, 2024-09-19T05:22:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-3.jpg" 2024-09-19T05:22:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2484666798, 2024-09-19T05:22:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635671, 2024-09-19T05:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-78.jpg" 2024-09-19T05:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2500108689, 2024-09-19T05:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635953, 2024-09-19T05:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-4.jpg" 2024-09-19T05:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2529030369, 2024-09-19T05:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635611, 2024-09-19T05:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-25.xml" 2024-09-19T05:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2533364378, 2024-09-19T05:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635788, 2024-09-19T05:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-14.xml" 2024-09-19T05:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2548613982, 2024-09-19T05:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635824, 2024-09-19T05:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-55.jpg" 2024-09-19T05:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2578242624, 2024-09-19T05:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635280, 2024-09-19T05:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-30.jpg" 2024-09-19T05:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2579198025, 2024-09-19T05:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635746, 2024-09-19T05:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-34.xml" 2024-09-19T05:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2582281956, 2024-09-19T05:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635874, 2024-09-19T05:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-31.jpg" 2024-09-19T05:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2616526877, 2024-09-19T05:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635721, 2024-09-19T05:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-45.xml" 2024-09-19T05:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2634278721, 2024-09-19T05:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635926, 2024-09-19T05:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-13.jpg" 2024-09-19T05:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2637413392, 2024-09-19T05:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635633, 2024-09-19T05:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-14.xml" 2024-09-19T05:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2648951020, 2024-09-19T05:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635536, 2024-09-19T05:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-61.xml" 2024-09-19T05:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2650519191, 2024-09-19T05:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635701, 2024-09-19T05:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-56.xml" 2024-09-19T05:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2651285521, 2024-09-19T05:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635944, 2024-09-19T05:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-7.jpg" 2024-09-19T05:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2670412688, 2024-09-19T05:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635823, 2024-09-19T05:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-15.jpg" 2024-09-19T05:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2671723947, 2024-09-19T05:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635502, 2024-09-19T05:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-4.jpg" 2024-09-19T05:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2673599017, 2024-09-19T05:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635763, 2024-09-19T05:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-26.xml" 2024-09-19T05:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2677524551, 2024-09-19T05:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635952, 2024-09-19T05:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-6.jpg" 2024-09-19T05:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2687611938, 2024-09-19T05:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635336, 2024-09-19T05:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-4.jpg" 2024-09-19T05:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2688467862, 2024-09-19T05:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635802, 2024-09-19T05:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-9.xml" 2024-09-19T05:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2718544723, 2024-09-19T05:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635751, 2024-09-19T05:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-45.jpg" 2024-09-19T05:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2750699393, 2024-09-19T05:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635941, 2024-09-19T05:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-8.jpg" 2024-09-19T05:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2761884899, 2024-09-19T05:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635932, 2024-09-19T05:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-11.jpg" 2024-09-19T05:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2776987408, 2024-09-19T05:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635305, 2024-09-19T05:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-51.xml" 2024-09-19T05:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2790213428, 2024-09-19T05:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635860, 2024-09-19T05:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-38.jpg" 2024-09-19T05:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2793049376, 2024-09-19T05:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635900, 2024-09-19T05:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-21.jpg" 2024-09-19T05:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2794662459, 2024-09-19T05:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635822, 2024-09-19T05:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-1.xml" 2024-09-19T05:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2797639791, 2024-09-19T05:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635819, 2024-09-19T05:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-2.xml" 2024-09-19T05:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2812691328, 2024-09-19T05:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635396, 2024-09-19T05:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-7.xml" 2024-09-19T05:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2824507438, 2024-09-19T05:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635302, 2024-09-19T05:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-19.jpg" 2024-09-19T05:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2826464876, 2024-09-19T05:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635905, 2024-09-19T05:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-19.jpg" 2024-09-19T05:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2879103880, 2024-09-19T05:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635837, 2024-09-19T05:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-48.jpg" 2024-09-19T05:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2879773629, 2024-09-19T05:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635919, 2024-09-19T05:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-15.jpg" 2024-09-19T05:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2913633328, 2024-09-19T05:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635744, 2024-09-19T05:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-35.xml" 2024-09-19T05:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2925668138, 2024-09-19T05:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635835, 2024-09-19T05:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-49.jpg" 2024-09-19T05:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2929226558, 2024-09-19T05:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635562, 2024-09-19T05:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-48.xml" 2024-09-19T05:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2930542479, 2024-09-19T05:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635639, 2024-09-19T05:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-11.xml" 2024-09-19T05:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2943585396, 2024-09-19T05:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635740, 2024-09-19T05:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-37.xml" 2024-09-19T05:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2944062642, 2024-09-19T05:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635691, 2024-09-19T05:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-60.xml" 2024-09-19T05:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2953289299, 2024-09-19T05:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635774, 2024-09-19T05:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-21.xml" 2024-09-19T05:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2954056973, 2024-09-19T05:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635471, 2024-09-19T05:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-18.jpg" 2024-09-19T05:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2971569173, 2024-09-19T05:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635933, 2024-09-19T05:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-5.xml" 2024-09-19T05:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2990425652, 2024-09-19T05:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635791, 2024-09-19T05:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-13.xml" 2024-09-19T05:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2998402556, 2024-09-19T05:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635956, 2024-09-19T05:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-5.jpg" 2024-09-19T05:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3003260475, 2024-09-19T05:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635884, 2024-09-19T05:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-26.jpg" 2024-09-19T05:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3007373720, 2024-09-19T05:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635712, 2024-09-19T05:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-50.xml" 2024-09-19T05:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3009305724, 2024-09-19T05:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635324, 2024-09-19T05:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-9.jpg" 2024-09-19T05:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3033158244, 2024-09-19T05:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635625, 2024-09-19T05:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-18.xml" 2024-09-19T05:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3067718740, 2024-09-19T05:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635759, 2024-09-19T05:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-28.xml" 2024-09-19T05:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3090497215, 2024-09-19T05:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635738, 2024-09-19T05:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-38.xml" 2024-09-19T05:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3095880726, 2024-09-19T05:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635780, 2024-09-19T05:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-18.xml" 2024-09-19T05:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3096954307, 2024-09-19T05:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635963, 2024-09-19T05:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-3.jpg" 2024-09-19T05:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3121246901, 2024-09-19T05:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635590, 2024-09-19T05:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-34.xml" 2024-09-19T05:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3132881731, 2024-09-19T05:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635752, 2024-09-19T05:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-31.xml" 2024-09-19T05:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3138695072, 2024-09-19T05:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635703, 2024-09-19T05:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-66.jpg" 2024-09-19T05:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3139029636, 2024-09-19T05:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635925, 2024-09-19T05:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-7.xml" 2024-09-19T05:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3142717083, 2024-09-19T05:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635881, 2024-09-19T05:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-27.jpg" 2024-09-19T05:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3192729720, 2024-09-19T05:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635836, 2024-09-19T05:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-9.jpg" 2024-09-19T05:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3209374403, 2024-09-19T05:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635704, 2024-09-19T05:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-54.xml" 2024-09-19T05:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3211677577, 2024-09-19T05:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635723, 2024-09-19T05:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-44.xml" 2024-09-19T05:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3250256928, 2024-09-19T05:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635693, 2024-09-19T05:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-70.jpg" 2024-09-19T05:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3259713478, 2024-09-19T05:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635551, 2024-09-19T05:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-54.xml" 2024-09-19T05:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3263683875, 2024-09-19T05:22:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635699, 2024-09-19T05:22:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-57.xml" 2024-09-19T05:22:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3266871414, 2024-09-19T05:22:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635848, 2024-09-19T05:22:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-43.jpg" 2024-09-19T05:22:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3278148484, 2024-09-19T05:22:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635880, 2024-09-19T05:22:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-28.jpg" 2024-09-19T05:22:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3296441780, 2024-09-19T05:22:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635515, 2024-09-19T05:22:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-71.xml" 2024-09-19T05:22:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3307967780, 2024-09-19T05:22:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635470, 2024-09-19T05:22:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-19.jpg" 2024-09-19T05:22:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3318782382, 2024-09-19T05:22:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635939, 2024-09-19T05:22:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-3.xml" 2024-09-19T05:22:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3320233575, 2024-09-19T05:22:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635765, 2024-09-19T05:22:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-25.xml" 2024-09-19T05:22:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3324434344, 2024-09-19T05:22:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635312, 2024-09-19T05:22:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-14.jpg" 2024-09-19T05:22:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3325373490, 2024-09-19T05:22:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635816, 2024-09-19T05:22:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-19.jpg" 2024-09-19T05:22:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3325580599, 2024-09-19T05:22:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635276, 2024-09-19T05:22:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-32.jpg" 2024-09-19T05:22:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3331970855, 2024-09-19T05:22:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635725, 2024-09-19T05:22:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-43.xml" 2024-09-19T05:22:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3344271704, 2024-09-19T05:22:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635517, 2024-09-19T05:22:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-70.xml" 2024-09-19T05:22:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3359613682, 2024-09-19T05:22:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635425, 2024-09-19T05:22:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-39.jpg" 2024-09-19T05:22:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3378497665, 2024-09-19T05:22:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635753, 2024-09-19T05:22:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-44.jpg" 2024-09-19T05:22:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3380646064, 2024-09-19T05:22:15.130 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635282, 2024-09-19T05:22:15.130 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-62.xml" 2024-09-19T05:22:15.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.130 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.130 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3405740654, 2024-09-19T05:22:15.130 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635274, 2024-09-19T05:22:15.130 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-33.jpg" 2024-09-19T05:22:15.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.130 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.130 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3422902728, 2024-09-19T05:22:15.131 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635936, 2024-09-19T05:22:15.131 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-4.xml" 2024-09-19T05:22:15.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.131 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.131 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3425860682, 2024-09-19T05:22:15.131 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635882, 2024-09-19T05:22:15.131 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-11.jpg" 2024-09-19T05:22:15.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.131 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.131 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3426358874, 2024-09-19T05:22:15.131 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635784, 2024-09-19T05:22:15.131 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-16.xml" 2024-09-19T05:22:15.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.132 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.132 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3451845947, 2024-09-19T05:22:15.132 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635560, 2024-09-19T05:22:15.132 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-49.xml" 2024-09-19T05:22:15.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.132 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.132 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3455349484, 2024-09-19T05:22:15.132 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635796, 2024-09-19T05:22:15.132 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-11.xml" 2024-09-19T05:22:15.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3482527503, 2024-09-19T05:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635899, 2024-09-19T05:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-5.jpg" 2024-09-19T05:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3482867637, 2024-09-19T05:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635236, 2024-09-19T05:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-51.jpg" 2024-09-19T05:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3501559448, 2024-09-19T05:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635288, 2024-09-19T05:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-26.jpg" 2024-09-19T05:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3504964389, 2024-09-19T05:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635244, 2024-09-19T05:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-47.jpg" 2024-09-19T05:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3507545140, 2024-09-19T05:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635742, 2024-09-19T05:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-36.xml" 2024-09-19T05:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3520940096, 2024-09-19T05:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635319, 2024-09-19T05:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-11.jpg" 2024-09-19T05:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3524018793, 2024-09-19T05:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511634783, 2024-09-19T05:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-77.xml" 2024-09-19T05:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3552221995, 2024-09-19T05:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635948, 2024-09-19T05:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-7.jpg" 2024-09-19T05:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3553466558, 2024-09-19T05:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635873, 2024-09-19T05:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-2.xml" 2024-09-19T05:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3556912153, 2024-09-19T05:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635727, 2024-09-19T05:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-42.xml" 2024-09-19T05:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3590684289, 2024-09-19T05:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635724, 2024-09-19T05:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-56.jpg" 2024-09-19T05:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3592459402, 2024-09-19T05:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635358, 2024-09-19T05:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-24.xml" 2024-09-19T05:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3608417904, 2024-09-19T05:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635334, 2024-09-19T05:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-5.jpg" 2024-09-19T05:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3617648566, 2024-09-19T05:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635539, 2024-09-19T05:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-60.xml" 2024-09-19T05:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3628842542, 2024-09-19T05:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635666, 2024-09-19T05:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-80.jpg" 2024-09-19T05:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3636809336, 2024-09-19T05:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635960, 2024-09-19T05:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-4.jpg" 2024-09-19T05:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3648694576, 2024-09-19T05:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635621, 2024-09-19T05:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-20.xml" 2024-09-19T05:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3657979872, 2024-09-19T05:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635817, 2024-09-19T05:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-3.xml" 2024-09-19T05:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3668447111, 2024-09-19T05:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635761, 2024-09-19T05:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-27.xml" 2024-09-19T05:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3678955289, 2024-09-19T05:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635958, 2024-09-19T05:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-2.jpg" 2024-09-19T05:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3688582080, 2024-09-19T05:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635950, 2024-09-19T05:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-5.jpg" 2024-09-19T05:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3698692446, 2024-09-19T05:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635831, 2024-09-19T05:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-51.jpg" 2024-09-19T05:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3734648395, 2024-09-19T05:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635256, 2024-09-19T05:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-41.jpg" 2024-09-19T05:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3741956831, 2024-09-19T05:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635696, 2024-09-19T05:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-58.xml" 2024-09-19T05:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3758175641, 2024-09-19T05:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635652, 2024-09-19T05:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-5.xml" 2024-09-19T05:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3772620694, 2024-09-19T05:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635326, 2024-09-19T05:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-8.jpg" 2024-09-19T05:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3774375214, 2024-09-19T05:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635564, 2024-09-19T05:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-47.xml" 2024-09-19T05:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.145 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.145 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3785147535, 2024-09-19T05:22:15.145 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635893, 2024-09-19T05:22:15.145 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-7.jpg" 2024-09-19T05:22:15.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3785169642, 2024-09-19T05:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635641, 2024-09-19T05:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-10.xml" 2024-09-19T05:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3794585754, 2024-09-19T05:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635293, 2024-09-19T05:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-24.jpg" 2024-09-19T05:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3794701777, 2024-09-19T05:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635556, 2024-09-19T05:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-51.xml" 2024-09-19T05:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3802819988, 2024-09-19T05:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635877, 2024-09-19T05:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-13.jpg" 2024-09-19T05:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3829148551, 2024-09-19T05:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635368, 2024-09-19T05:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-20.xml" 2024-09-19T05:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3844406361, 2024-09-19T05:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635852, 2024-09-19T05:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-2.jpg" 2024-09-19T05:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3846117340, 2024-09-19T05:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635794, 2024-09-19T05:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-12.xml" 2024-09-19T05:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3851016412, 2024-09-19T05:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635298, 2024-09-19T05:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-21.jpg" 2024-09-19T05:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3866970432, 2024-09-19T05:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635912, 2024-09-19T05:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-17.jpg" 2024-09-19T05:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3903662580, 2024-09-19T05:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635875, 2024-09-19T05:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-1.xml" 2024-09-19T05:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3935190222, 2024-09-19T05:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635230, 2024-09-19T05:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-1.xml" 2024-09-19T05:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3936676788, 2024-09-19T05:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635807, 2024-09-19T05:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-23.jpg" 2024-09-19T05:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3936971581, 2024-09-19T05:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635903, 2024-09-19T05:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-4.jpg" 2024-09-19T05:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3945470858, 2024-09-19T05:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635955, 2024-09-19T05:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-3.jpg" 2024-09-19T05:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3955740144, 2024-09-19T05:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635879, 2024-09-19T05:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-12.jpg" 2024-09-19T05:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3960817759, 2024-09-19T05:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635617, 2024-09-19T05:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-22.xml" 2024-09-19T05:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3962150734, 2024-09-19T05:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635306, 2024-09-19T05:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-17.jpg" 2024-09-19T05:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3967525177, 2024-09-19T05:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635406, 2024-09-19T05:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-3.xml" 2024-09-19T05:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3969528496, 2024-09-19T05:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635304, 2024-09-19T05:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-18.jpg" 2024-09-19T05:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3979433183, 2024-09-19T05:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635688, 2024-09-19T05:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-61.xml" 2024-09-19T05:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4008947695, 2024-09-19T05:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635330, 2024-09-19T05:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-6.jpg" 2024-09-19T05:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4016355399, 2024-09-19T05:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635762, 2024-09-19T05:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-40.jpg" 2024-09-19T05:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4036186965, 2024-09-19T05:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635264, 2024-09-19T05:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-37.jpg" 2024-09-19T05:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4042115383, 2024-09-19T05:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635254, 2024-09-19T05:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-42.jpg" 2024-09-19T05:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4053583522, 2024-09-19T05:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635662, 2024-09-19T05:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-82.jpg" 2024-09-19T05:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4055037534, 2024-09-19T05:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635818, 2024-09-19T05:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-18.jpg" 2024-09-19T05:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4062894365, 2024-09-19T05:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635702, 2024-09-19T05:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-55.xml" 2024-09-19T05:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4064336330, 2024-09-19T05:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635923, 2024-09-19T05:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-14.jpg" 2024-09-19T05:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4076399013, 2024-09-19T05:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635769, 2024-09-19T05:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-23.xml" 2024-09-19T05:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4097603790, 2024-09-19T05:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635596, 2024-09-19T05:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-31.xml" 2024-09-19T05:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4117875200, 2024-09-19T05:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635278, 2024-09-19T05:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-31.jpg" 2024-09-19T05:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4127079114, 2024-09-19T05:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635913, 2024-09-19T05:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-1.jpg" 2024-09-19T05:22:15.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.160 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.160 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4144117217, 2024-09-19T05:22:15.160 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635250, 2024-09-19T05:22:15.160 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-44.jpg" 2024-09-19T05:22:15.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.160 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.160 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4179556698, 2024-09-19T05:22:15.160 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635352, 2024-09-19T05:22:15.160 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-27.xml" 2024-09-19T05:22:15.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4206050696, 2024-09-19T05:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635713, 2024-09-19T05:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-61.jpg" 2024-09-19T05:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4222623626, 2024-09-19T05:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635506, 2024-09-19T05:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-2.jpg" 2024-09-19T05:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4240179484, 2024-09-19T05:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635826, 2024-09-19T05:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-54.jpg" 2024-09-19T05:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4244568500, 2024-09-19T05:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635750, 2024-09-19T05:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-32.xml" 2024-09-19T05:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4255496986, 2024-09-19T05:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635776, 2024-09-19T05:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-20.xml" 2024-09-19T05:22:15.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.163 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.163 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4259636184, 2024-09-19T05:22:15.163 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635813, 2024-09-19T05:22:15.163 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-5.xml" 2024-09-19T05:22:15.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.163 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.163 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4264012027, 2024-09-19T05:22:15.163 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635849, 2024-09-19T05:22:15.163 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-4.jpg" 2024-09-19T05:22:15.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:15.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:15.164 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:15.164 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4276068719, 2024-09-19T05:22:15.164 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635496, 2024-09-19T05:22:15.164 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-7.jpg" 2024-09-19T05:22:15.164 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:22:15.164 INFO:teuthology.orchestra.run.smithi120.stdout:] 2024-09-19T05:22:16.210 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T05:22:16.566 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:22:16.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:16 smithi178 ceph-mon[34347]: pgmap v94: 97 pgs: 97 active+clean; 235 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 192 op/s 2024-09-19T05:22:16.693 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:16 smithi120 ceph-mon[30956]: pgmap v94: 97 pgs: 97 active+clean; 235 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 192 op/s 2024-09-19T05:22:16.707 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:16 smithi194 ceph-mon[35228]: pgmap v94: 97 pgs: 97 active+clean; 235 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 192 op/s 2024-09-19T05:22:18.314 INFO:tasks.workunit.client.0.smithi120.stdout: 70 13612 51 7984 78 2303 80 2024-09-19T05:22:18.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:18 smithi178 ceph-mon[34347]: pgmap v95: 97 pgs: 97 active+clean; 235 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 140 op/s 2024-09-19T05:22:18.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:18 smithi120 ceph-mon[30956]: pgmap v95: 97 pgs: 97 active+clean; 235 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 140 op/s 2024-09-19T05:22:18.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:18 smithi194 ceph-mon[35228]: pgmap v95: 97 pgs: 97 active+clean; 235 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 140 op/s 2024-09-19T05:22:19.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.148+0000 7f2549bf3640 1 -- 172.21.15.120:0/4086523855 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2544101de0 msgr2=0x7f25441021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:19.102 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.148+0000 7f2549bf3640 1 --2- 172.21.15.120:0/4086523855 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2544101de0 0x7f25441021c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2534009900 tx=0x7f253402a410 comp rx=0 tx=0).stop 2024-09-19T05:22:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.148+0000 7f2549bf3640 1 -- 172.21.15.120:0/4086523855 shutdown_connections 2024-09-19T05:22:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.148+0000 7f2549bf3640 1 --2- 172.21.15.120:0/4086523855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2544106f10 0x7f254410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.148+0000 7f2549bf3640 1 --2- 172.21.15.120:0/4086523855 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2544102790 0x7f25441067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.148+0000 7f2549bf3640 1 --2- 172.21.15.120:0/4086523855 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2544101de0 0x7f25441021c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.148+0000 7f2549bf3640 1 -- 172.21.15.120:0/4086523855 >> 172.21.15.120:0/4086523855 conn(0x7f25440fd8e0 msgr2=0x7f25440ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.148+0000 7f2549bf3640 1 -- 172.21.15.120:0/4086523855 shutdown_connections 2024-09-19T05:22:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.148+0000 7f2549bf3640 1 -- 172.21.15.120:0/4086523855 wait complete. 2024-09-19T05:22:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.149+0000 7f2549bf3640 1 Processor -- start 2024-09-19T05:22:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.149+0000 7f2549bf3640 1 -- start start 2024-09-19T05:22:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.150+0000 7f2549bf3640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2544101de0 0x7f25440744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.150+0000 7f2549bf3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2544102790 0x7f2544074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.150+0000 7f2549bf3640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2544106f10 0x7f2544074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:19.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.150+0000 7f2549bf3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f2544111de0 con 0x7f2544102790 2024-09-19T05:22:19.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.150+0000 7f2549bf3640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f2544111c60 con 0x7f2544101de0 2024-09-19T05:22:19.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.150+0000 7f2549bf3640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2544111f60 con 0x7f2544106f10 2024-09-19T05:22:19.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.150+0000 7f2542ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2544102790 0x7f2544074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:19.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.150+0000 7f2542ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2544102790 0x7f2544074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40874/0 (socket says 172.21.15.120:40874) 2024-09-19T05:22:19.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.150+0000 7f2542ffd640 1 -- 172.21.15.120:0/198734493 learned_addr learned my addr 172.21.15.120:0/198734493 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:19.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.150+0000 7f25437fe640 1 --2- 172.21.15.120:0/198734493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2544101de0 0x7f25440744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:19.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.150+0000 7f2543fff640 1 --2- 172.21.15.120:0/198734493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2544106f10 0x7f2544074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:19.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.150+0000 7f2542ffd640 1 -- 172.21.15.120:0/198734493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2544106f10 msgr2=0x7f2544074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:19.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.150+0000 7f2542ffd640 1 --2- 172.21.15.120:0/198734493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2544106f10 0x7f2544074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.104 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.150+0000 7f2542ffd640 1 -- 172.21.15.120:0/198734493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2544101de0 msgr2=0x7f25440744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:19.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.150+0000 7f2542ffd640 1 --2- 172.21.15.120:0/198734493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2544101de0 0x7f25440744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.150+0000 7f2542ffd640 1 -- 172.21.15.120:0/198734493 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25441a6800 con 0x7f2544102790 2024-09-19T05:22:19.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.150+0000 7f2542ffd640 1 --2- 172.21.15.120:0/198734493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2544102790 0x7f2544074a30 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f253800d950 tx=0x7f253800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:19.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.151+0000 7f2540ff9640 1 -- 172.21.15.120:0/198734493 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2538017030 con 0x7f2544102790 2024-09-19T05:22:19.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.151+0000 7f2540ff9640 1 -- 172.21.15.120:0/198734493 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2538004020 con 0x7f2544102790 2024-09-19T05:22:19.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.151+0000 7f2540ff9640 1 -- 172.21.15.120:0/198734493 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25380047a0 con 0x7f2544102790 2024-09-19T05:22:19.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.151+0000 7f2549bf3640 1 -- 172.21.15.120:0/198734493 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25441a6af0 con 0x7f2544102790 2024-09-19T05:22:19.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.151+0000 7f2549bf3640 1 -- 172.21.15.120:0/198734493 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25441a6fe0 con 0x7f2544102790 2024-09-19T05:22:19.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.154+0000 7f2540ff9640 1 -- 172.21.15.120:0/198734493 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f25380041d0 con 0x7f2544102790 2024-09-19T05:22:19.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.154+0000 7f254bfcc740 1 Processor -- start 2024-09-19T05:22:19.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.155+0000 7f254bfcc740 1 -- start start 2024-09-19T05:22:19.105 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.155+0000 7f2540ff9640 1 --2- 172.21.15.120:0/198734493 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f252c0a3430 0x7f252c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:19.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.155+0000 7f254bfcc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7979d3b40 0x55e7979d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:19.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.155+0000 7f254bfcc740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e7979d25d0 0x55e7979d2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:19.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.155+0000 7f254bfcc740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e7979dd370 0x55e7979df760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:19.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.155+0000 7f254bfcc740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55e7979382f0 con 0x55e7979dd370 2024-09-19T05:22:19.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.155+0000 7f254bfcc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55e7978dfcf0 con 0x55e7979d3b40 2024-09-19T05:22:19.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.155+0000 7f2540ff9640 1 -- 172.21.15.120:0/198734493 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f25380cf6d0 con 0x7f2544102790 2024-09-19T05:22:19.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.155+0000 7f254bfcc740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55e7979342b0 con 0x55e7979d25d0 2024-09-19T05:22:19.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.155+0000 7f2543fff640 1 --2- 172.21.15.120:0/198734493 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f252c0a3430 0x7f252c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:19.106 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.155+0000 7f25437fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7979d3b40 0x55e7979d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:19.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.155+0000 7f2542ffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e7979d25d0 0x55e7979d2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:19.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.155+0000 7f25437fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7979d3b40 0x55e7979d2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:60936/0 (socket says 172.21.15.120:60936) 2024-09-19T05:22:19.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.155+0000 7f25437fe640 1 -- 172.21.15.120:0/468331670 learned_addr learned my addr 172.21.15.120:0/468331670 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:19.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.155+0000 7f25437fe640 1 -- 172.21.15.120:0/468331670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e7979d25d0 msgr2=0x55e7979d2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:19.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.155+0000 7f25437fe640 1 --2- 172.21.15.120:0/468331670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e7979d25d0 0x55e7979d2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.155+0000 7f25437fe640 1 -- 172.21.15.120:0/468331670 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e7979dd370 msgr2=0x55e7979df760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:19.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.155+0000 7f25437fe640 1 --2- 172.21.15.120:0/468331670 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e7979dd370 0x55e7979df760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.155+0000 7f25437fe640 1 -- 172.21.15.120:0/468331670 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7978c43a0 con 0x55e7979d3b40 2024-09-19T05:22:19.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.156+0000 7f25437fe640 1 --2- 172.21.15.120:0/468331670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7979d3b40 0x55e7979d2090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2534009900 tx=0x7f2534032bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31bc5cbe43e900e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:19.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.156+0000 7f2543fff640 1 --2- 172.21.15.120:0/198734493 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f252c0a3430 0x7f252c0a58f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f253c005fd0 tx=0x7f253c009aa0 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:19.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.156+0000 7f2529ffb640 1 -- 172.21.15.120:0/468331670 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534040070 con 0x55e7979d3b40 2024-09-19T05:22:19.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.156+0000 7f2529ffb640 1 -- 172.21.15.120:0/468331670 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2534004030 con 0x55e7979d3b40 2024-09-19T05:22:19.107 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.156+0000 7f2529ffb640 1 -- 172.21.15.120:0/468331670 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534035040 con 0x55e7979d3b40 2024-09-19T05:22:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.157+0000 7f254bfcc740 1 -- 172.21.15.120:0/468331670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7979d3b40 msgr2=0x55e7979d2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.157+0000 7f254bfcc740 1 --2- 172.21.15.120:0/468331670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7979d3b40 0x55e7979d2090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2534009900 tx=0x7f2534032bb0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.157+0000 7f254bfcc740 1 -- 172.21.15.120:0/468331670 shutdown_connections 2024-09-19T05:22:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.157+0000 7f254bfcc740 1 --2- 172.21.15.120:0/468331670 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e7979dd370 0x55e7979df760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.157+0000 7f254bfcc740 1 --2- 172.21.15.120:0/468331670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e7979d25d0 0x55e7979d2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.157+0000 7f254bfcc740 1 --2- 172.21.15.120:0/468331670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7979d3b40 0x55e7979d2090 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.157+0000 7f254bfcc740 1 -- 172.21.15.120:0/468331670 >> 172.21.15.120:0/468331670 conn(0x55e79799b310 msgr2=0x55e7979cec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.157+0000 7f254bfcc740 1 -- 172.21.15.120:0/468331670 shutdown_connections 2024-09-19T05:22:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.157+0000 7f254bfcc740 1 -- 172.21.15.120:0/468331670 wait complete. 2024-09-19T05:22:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.158+0000 7f254bfcc740 1 -- start start 2024-09-19T05:22:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.158+0000 7f254bfcc740 1 Processor -- start 2024-09-19T05:22:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.158+0000 7f254bfcc740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e7979d25d0 0x55e7979dcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.158+0000 7f254bfcc740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e7979d3b40 0x55e7979d9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.158+0000 7f254bfcc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7979dd370 0x55e7979da530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:19.108 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.158+0000 7f254bfcc740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55e7979e0010 con 0x55e7979d3b40 2024-09-19T05:22:19.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.158+0000 7f254bfcc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55e7978f3060 con 0x55e7979dd370 2024-09-19T05:22:19.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.158+0000 7f254bfcc740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55e7979e0190 con 0x55e7979d25d0 2024-09-19T05:22:19.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.158+0000 7f254bfcc740 10 client.0 _ll_register_callbacks cb 0x55e7976468c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:22:19.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.159+0000 7f2542ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e7979d3b40 0x55e7979d9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:19.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.159+0000 7f2543fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7979dd370 0x55e7979da530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:19.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.159+0000 7f2542ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e7979d3b40 0x55e7979d9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:40898/0 (socket says 172.21.15.120:40898) 2024-09-19T05:22:19.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.159+0000 7f2542ffd640 1 -- 172.21.15.120:0/1483600502 learned_addr learned my addr 172.21.15.120:0/1483600502 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:19.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.159+0000 7f25437fe640 1 --2- 172.21.15.120:0/1483600502 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e7979d25d0 0x55e7979dcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:19.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.159+0000 7f2542ffd640 1 -- 172.21.15.120:0/1483600502 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e7979d25d0 msgr2=0x55e7979dcd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:19.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.159+0000 7f2542ffd640 1 --2- 172.21.15.120:0/1483600502 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e7979d25d0 0x55e7979dcd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.159+0000 7f2542ffd640 1 -- 172.21.15.120:0/1483600502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7979dd370 msgr2=0x55e7979da530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:19.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.159+0000 7f2542ffd640 1 --2- 172.21.15.120:0/1483600502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7979dd370 0x55e7979da530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.159+0000 7f2542ffd640 1 -- 172.21.15.120:0/1483600502 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7976a93c0 con 0x55e7979d3b40 2024-09-19T05:22:19.109 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.159+0000 7f2542ffd640 1 --2- 172.21.15.120:0/1483600502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e7979d3b40 0x55e7979d9fb0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2538098330 tx=0x7f253809c1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b650578fd1b372 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.159+0000 7f2522ffd640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:22:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.159+0000 7f2522ffd640 1 -- 172.21.15.120:0/1483600502 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25380b4060 con 0x55e7979d3b40 2024-09-19T05:22:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.159+0000 7f2522ffd640 1 -- 172.21.15.120:0/1483600502 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f2538097fd0 con 0x55e7979d3b40 2024-09-19T05:22:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.159+0000 7f254bfcc740 1 -- 172.21.15.120:0/1483600502 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2534004030 con 0x55e7979d3b40 2024-09-19T05:22:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.160+0000 7f2522ffd640 1 -- 172.21.15.120:0/1483600502 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f25380ba170 con 0x55e7979d3b40 2024-09-19T05:22:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.160+0000 7f254bfcc740 10 client.15954 fetch_fsmap learned FSMap version 29 2024-09-19T05:22:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.160+0000 7f254bfcc740 1 -- 172.21.15.120:0/1483600502 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e7979eba40 con 0x55e7979d3b40 2024-09-19T05:22:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.160+0000 7f2522ffd640 1 -- 172.21.15.120:0/1483600502 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f25380ba310 con 0x55e7979d3b40 2024-09-19T05:22:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.160+0000 7f2522ffd640 1 -- 172.21.15.120:0/1483600502 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f25380976b0 con 0x55e7979d3b40 2024-09-19T05:22:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.160+0000 7f254bfcc740 10 client.15954 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:22:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.160+0000 7f254bfcc740 10 client.15954 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T05:22:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.160+0000 7f254bfcc740 20 client.15954 populate_metadata read hostname 'smithi120' 2024-09-19T05:22:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.160+0000 7f254bfcc740 1 --2- 172.21.15.120:0/1483600502 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55e7979ece50 0x55e7979ef240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.160+0000 7f254bfcc740 4 client.15954 mds_command: new command op to 24443 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:22:19.110 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.160+0000 7f254bfcc740 1 -- 172.21.15.120:0/1483600502 --> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2534004030 con 0x55e7979ece50 2024-09-19T05:22:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.160+0000 7f25437fe640 1 --2- 172.21.15.120:0/1483600502 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55e7979ece50 0x55e7979ef240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.161+0000 7f25437fe640 1 --2- 172.21.15.120:0/1483600502 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55e7979ece50 0x55e7979ef240 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ab8466b754d854ab server_cookie=4968d8e25f4beadf in_seq=0 out_seq=0 2024-09-19T05:22:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.161+0000 7f2522ffd640 10 client.15954 ms_handle_connect on v2:172.21.15.178:6838/3389137566 2024-09-19T05:22:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.161+0000 7f2522ffd640 1 -- 172.21.15.120:0/1483600502 <== mds.1 v2:172.21.15.178:6838/3389137566 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f2534004030 con 0x55e7979ece50 2024-09-19T05:22:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.161+0000 7f2522ffd640 10 client.15954 handle_command_reply: tid=0 2024-09-19T05:22:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.161+0000 7f254bfcc740 1 client.15954 shutdown 2024-09-19T05:22:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.162+0000 7f254bfcc740 1 -- 172.21.15.120:0/1483600502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e7979d3b40 msgr2=0x55e7979d9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.162+0000 7f254bfcc740 1 --2- 172.21.15.120:0/1483600502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e7979d3b40 0x55e7979d9fb0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2538098330 tx=0x7f253809c1a0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.162+0000 7f254bfcc740 1 -- 172.21.15.120:0/1483600502 shutdown_connections 2024-09-19T05:22:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.162+0000 7f254bfcc740 1 --2- 172.21.15.120:0/1483600502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7979dd370 0x55e7979da530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.162+0000 7f254bfcc740 1 --2- 172.21.15.120:0/1483600502 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e7979d3b40 0x55e7979d9fb0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.162+0000 7f254bfcc740 1 --2- 172.21.15.120:0/1483600502 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55e7979ece50 0x55e7979ef240 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.162+0000 7f254bfcc740 1 --2- 172.21.15.120:0/1483600502 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e7979d25d0 0x55e7979dcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.162+0000 7f254bfcc740 1 -- 172.21.15.120:0/1483600502 >> 172.21.15.120:0/1483600502 conn(0x55e79799b310 msgr2=0x55e7979d4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:19.111 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.162+0000 7f2522ffd640 0 client.15954 ms_handle_reset on v2:172.21.15.178:6838/3389137566 2024-09-19T05:22:19.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.162+0000 7f254bfcc740 1 -- 172.21.15.120:0/1483600502 shutdown_connections 2024-09-19T05:22:19.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.162+0000 7f254bfcc740 1 -- 172.21.15.120:0/1483600502 wait complete. 2024-09-19T05:22:19.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.162+0000 7f254bfcc740 20 client.15954 trim_cache size 0 max 16384 2024-09-19T05:22:19.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.181+0000 7f254bfcc740 1 Processor -- start 2024-09-19T05:22:19.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.181+0000 7f254bfcc740 1 -- start start 2024-09-19T05:22:19.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.181+0000 7f254bfcc740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e7979d25d0 0x55e7979d9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:19.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.182+0000 7f254bfcc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7979d3b40 0x55e7979e92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:19.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.182+0000 7f254bfcc740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e7979dd370 0x55e7979d5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:19.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.182+0000 7f254bfcc740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f25441b2370 con 0x55e7979dd370 2024-09-19T05:22:19.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.182+0000 7f254bfcc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f25441afc40 con 0x55e7979d3b40 2024-09-19T05:22:19.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.182+0000 7f254bfcc740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f25441ada90 con 0x55e7979d25d0 2024-09-19T05:22:19.112 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.182+0000 7f25437fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e7979d25d0 0x55e7979d9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.182+0000 7f25437fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e7979d25d0 0x55e7979d9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:60636/0 (socket says 172.21.15.120:60636) 2024-09-19T05:22:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.182+0000 7f25437fe640 1 -- 172.21.15.120:0/3793250297 learned_addr learned my addr 172.21.15.120:0/3793250297 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.182+0000 7f2543fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e7979dd370 0x55e7979d5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.182+0000 7f2542ffd640 1 --2- 172.21.15.120:0/3793250297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7979d3b40 0x55e7979e92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.182+0000 7f25437fe640 1 -- 172.21.15.120:0/3793250297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7979d3b40 msgr2=0x55e7979e92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.182+0000 7f25437fe640 1 --2- 172.21.15.120:0/3793250297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7979d3b40 0x55e7979e92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.182+0000 7f25437fe640 1 -- 172.21.15.120:0/3793250297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e7979dd370 msgr2=0x55e7979d5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.182+0000 7f25437fe640 1 --2- 172.21.15.120:0/3793250297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e7979dd370 0x55e7979d5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.182+0000 7f25437fe640 1 -- 172.21.15.120:0/3793250297 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7979ceed0 con 0x55e7979d25d0 2024-09-19T05:22:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.182+0000 7f25437fe640 1 --2- 172.21.15.120:0/3793250297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e7979d25d0 0x55e7979d9f80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2534009900 tx=0x7f2534031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4edf1350f35f5fea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.183+0000 7f25297fa640 1 -- 172.21.15.120:0/3793250297 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534040050 con 0x55e7979d25d0 2024-09-19T05:22:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.183+0000 7f25297fa640 1 -- 172.21.15.120:0/3793250297 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2534031730 con 0x55e7979d25d0 2024-09-19T05:22:19.113 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.183+0000 7f25297fa640 1 -- 172.21.15.120:0/3793250297 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534035040 con 0x55e7979d25d0 2024-09-19T05:22:19.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.183+0000 7f254bfcc740 1 -- 172.21.15.120:0/3793250297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e7979d25d0 msgr2=0x55e7979d9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:19.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.183+0000 7f254bfcc740 1 --2- 172.21.15.120:0/3793250297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e7979d25d0 0x55e7979d9f80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2534009900 tx=0x7f2534031400 comp rx=0 tx=0).stop 2024-09-19T05:22:19.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.184+0000 7f254bfcc740 1 -- 172.21.15.120:0/3793250297 shutdown_connections 2024-09-19T05:22:19.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.184+0000 7f254bfcc740 1 --2- 172.21.15.120:0/3793250297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e7979dd370 0x55e7979d5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.184+0000 7f254bfcc740 1 --2- 172.21.15.120:0/3793250297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7979d3b40 0x55e7979e92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.184+0000 7f254bfcc740 1 --2- 172.21.15.120:0/3793250297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e7979d25d0 0x55e7979d9f80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.184+0000 7f254bfcc740 1 -- 172.21.15.120:0/3793250297 >> 172.21.15.120:0/3793250297 conn(0x55e79799b310 msgr2=0x55e7979d9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:19.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.184+0000 7f254bfcc740 1 -- 172.21.15.120:0/3793250297 shutdown_connections 2024-09-19T05:22:19.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.184+0000 7f254bfcc740 1 -- 172.21.15.120:0/3793250297 wait complete. 2024-09-19T05:22:19.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.184+0000 7f254bfcc740 1 -- start start 2024-09-19T05:22:19.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.184+0000 7f254bfcc740 1 Processor -- start 2024-09-19T05:22:19.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.185+0000 7f254bfcc740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e7979d25d0 0x55e7979e5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:19.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.185+0000 7f254bfcc740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e7979d3b40 0x55e7979e0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:19.114 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.185+0000 7f254bfcc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7979dd370 0x55e7979e10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:19.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.185+0000 7f254bfcc740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f25441ae100 con 0x55e7979d3b40 2024-09-19T05:22:19.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.185+0000 7f254bfcc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f25441af570 con 0x55e7979dd370 2024-09-19T05:22:19.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.185+0000 7f254bfcc740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f25441ae7d0 con 0x55e7979d25d0 2024-09-19T05:22:19.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.185+0000 7f254bfcc740 10 client.0 _ll_register_callbacks cb 0x7f253809b4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:22:19.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.185+0000 7f25437fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e7979d25d0 0x55e7979e5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:19.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.185+0000 7f25437fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e7979d25d0 0x55e7979e5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:60648/0 (socket says 172.21.15.120:60648) 2024-09-19T05:22:19.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.185+0000 7f25437fe640 1 -- 172.21.15.120:0/1211770302 learned_addr learned my addr 172.21.15.120:0/1211770302 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:19.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.185+0000 7f2543fff640 1 --2- 172.21.15.120:0/1211770302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7979dd370 0x55e7979e10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:19.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.185+0000 7f2542ffd640 1 --2- 172.21.15.120:0/1211770302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e7979d3b40 0x55e7979e0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:19.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.185+0000 7f25437fe640 1 -- 172.21.15.120:0/1211770302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7979dd370 msgr2=0x55e7979e10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:19.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.185+0000 7f25437fe640 1 --2- 172.21.15.120:0/1211770302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7979dd370 0x55e7979e10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.115 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.185+0000 7f25437fe640 1 -- 172.21.15.120:0/1211770302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e7979d3b40 msgr2=0x55e7979e0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:19.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.185+0000 7f25437fe640 1 --2- 172.21.15.120:0/1211770302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e7979d3b40 0x55e7979e0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.185+0000 7f25437fe640 1 -- 172.21.15.120:0/1211770302 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7979d8f60 con 0x55e7979d25d0 2024-09-19T05:22:19.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.185+0000 7f2542ffd640 1 --2- 172.21.15.120:0/1211770302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e7979d3b40 0x55e7979e0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:22:19.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.185+0000 7f25437fe640 1 --2- 172.21.15.120:0/1211770302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e7979d25d0 0x55e7979e5880 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f253402a930 tx=0x7f2534032c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edf2cc4f06bf420c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:19.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.185+0000 7f2522ffd640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:22:19.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.186+0000 7f2522ffd640 1 -- 172.21.15.120:0/1211770302 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253405c060 con 0x55e7979d25d0 2024-09-19T05:22:19.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.186+0000 7f254bfcc740 1 -- 172.21.15.120:0/1211770302 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2534031730 con 0x55e7979d25d0 2024-09-19T05:22:19.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.186+0000 7f2522ffd640 1 -- 172.21.15.120:0/1211770302 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f2534004250 con 0x55e7979d25d0 2024-09-19T05:22:19.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.186+0000 7f2522ffd640 1 -- 172.21.15.120:0/1211770302 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2534040020 con 0x55e7979d25d0 2024-09-19T05:22:19.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.186+0000 7f254bfcc740 10 client.25483 fetch_fsmap learned FSMap version 29 2024-09-19T05:22:19.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.186+0000 7f254bfcc740 1 -- 172.21.15.120:0/1211770302 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e797a57600 con 0x55e7979d25d0 2024-09-19T05:22:19.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.186+0000 7f2522ffd640 1 -- 172.21.15.120:0/1211770302 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f2534031730 con 0x55e7979d25d0 2024-09-19T05:22:19.116 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.186+0000 7f2522ffd640 1 -- 172.21.15.120:0/1211770302 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f2534031c30 con 0x55e7979d25d0 2024-09-19T05:22:19.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.186+0000 7f254bfcc740 10 client.25483 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:22:19.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.186+0000 7f254bfcc740 10 client.25483 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-19T05:22:19.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.186+0000 7f254bfcc740 20 client.25483 populate_metadata read hostname 'smithi120' 2024-09-19T05:22:19.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.186+0000 7f254bfcc740 1 --2- 172.21.15.120:0/1211770302 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55e797a57880 0x55e797a59c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:19.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.186+0000 7f254bfcc740 4 client.25483 mds_command: new command op to 24443 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T05:22:19.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.186+0000 7f254bfcc740 1 -- 172.21.15.120:0/1211770302 --> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e797945860 con 0x55e797a57880 2024-09-19T05:22:19.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.186+0000 7f2542ffd640 1 --2- 172.21.15.120:0/1211770302 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55e797a57880 0x55e797a59c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:19.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.187+0000 7f2522ffd640 10 client.25483 ms_handle_connect on v2:172.21.15.178:6838/3389137566 2024-09-19T05:22:19.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.187+0000 7f2542ffd640 1 --2- 172.21.15.120:0/1211770302 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55e797a57880 0x55e797a59c70 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f14ebf9a0cd2fa2c server_cookie=33b059fa2f05a895 in_seq=0 out_seq=0 2024-09-19T05:22:19.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.188+0000 7f2522ffd640 1 -- 172.21.15.120:0/1211770302 <== mds.1 v2:172.21.15.178:6838/3389137566 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22320 (crc 0 0 0) 0x55e797945860 con 0x55e797a57880 2024-09-19T05:22:19.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.188+0000 7f2522ffd640 10 client.25483 handle_command_reply: tid=0 2024-09-19T05:22:19.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.188+0000 7f254bfcc740 1 client.25483 shutdown 2024-09-19T05:22:19.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.188+0000 7f254bfcc740 1 -- 172.21.15.120:0/1211770302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e7979d25d0 msgr2=0x55e7979e5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:19.117 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.188+0000 7f254bfcc740 1 --2- 172.21.15.120:0/1211770302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e7979d25d0 0x55e7979e5880 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f253402a930 tx=0x7f2534032c30 comp rx=0 tx=0).stop 2024-09-19T05:22:19.118 INFO:teuthology.orchestra.run.smithi120.stdout:[ 2024-09-19T05:22:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 9255872, 2024-09-19T05:22:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635886, 2024-09-19T05:22:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-29.xml" 2024-09-19T05:22:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 11755929, 2024-09-19T05:22:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635973, 2024-09-19T05:22:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-66.jpg" 2024-09-19T05:22:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 38064809, 2024-09-19T05:22:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636055, 2024-09-19T05:22:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-24.xml" 2024-09-19T05:22:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 63921766, 2024-09-19T05:22:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635992, 2024-09-19T05:22:19.120 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-60.jpg" 2024-09-19T05:22:19.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.120 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.120 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 118762432, 2024-09-19T05:22:19.120 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636025, 2024-09-19T05:22:19.120 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-34.xml" 2024-09-19T05:22:19.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.120 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.120 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 138594602, 2024-09-19T05:22:19.121 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635986, 2024-09-19T05:22:19.121 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-62.jpg" 2024-09-19T05:22:19.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.121 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.121 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 195364697, 2024-09-19T05:22:19.121 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635895, 2024-09-19T05:22:19.121 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-26.xml" 2024-09-19T05:22:19.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.121 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.121 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 275180769, 2024-09-19T05:22:19.122 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636031, 2024-09-19T05:22:19.122 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-32.xml" 2024-09-19T05:22:19.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.122 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.122 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 277203963, 2024-09-19T05:22:19.122 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635998, 2024-09-19T05:22:19.122 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-42.xml" 2024-09-19T05:22:19.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.122 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.122 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 348147912, 2024-09-19T05:22:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635990, 2024-09-19T05:22:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-44.xml" 2024-09-19T05:22:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 435455316, 2024-09-19T05:22:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635989, 2024-09-19T05:22:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-61.jpg" 2024-09-19T05:22:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 501139569, 2024-09-19T05:22:19.123 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635980, 2024-09-19T05:22:19.124 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-64.jpg" 2024-09-19T05:22:19.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.124 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.124 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 510975870, 2024-09-19T05:22:19.124 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635978, 2024-09-19T05:22:19.124 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-48.xml" 2024-09-19T05:22:19.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.124 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.124 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 647392547, 2024-09-19T05:22:19.124 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635959, 2024-09-19T05:22:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-4.xml" 2024-09-19T05:22:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 652267840, 2024-09-19T05:22:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635892, 2024-09-19T05:22:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-27.xml" 2024-09-19T05:22:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 695942420, 2024-09-19T05:22:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635911, 2024-09-19T05:22:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-20.xml" 2024-09-19T05:22:19.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 726333116, 2024-09-19T05:22:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636045, 2024-09-19T05:22:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-44.jpg" 2024-09-19T05:22:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 749675290, 2024-09-19T05:22:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635962, 2024-09-19T05:22:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-3.xml" 2024-09-19T05:22:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 755510361, 2024-09-19T05:22:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635934, 2024-09-19T05:22:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-13.xml" 2024-09-19T05:22:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 835114633, 2024-09-19T05:22:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636043, 2024-09-19T05:22:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-28.xml" 2024-09-19T05:22:19.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.128 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.128 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 845753443, 2024-09-19T05:22:19.128 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635943, 2024-09-19T05:22:19.128 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-10.xml" 2024-09-19T05:22:19.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.128 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.128 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 868359169, 2024-09-19T05:22:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636017, 2024-09-19T05:22:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-36.xml" 2024-09-19T05:22:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 968788724, 2024-09-19T05:22:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636020, 2024-09-19T05:22:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-51.jpg" 2024-09-19T05:22:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.129 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 973105798, 2024-09-19T05:22:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635984, 2024-09-19T05:22:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-46.xml" 2024-09-19T05:22:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 990338973, 2024-09-19T05:22:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635914, 2024-09-19T05:22:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-19.xml" 2024-09-19T05:22:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1006699031, 2024-09-19T05:22:19.130 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635967, 2024-09-19T05:22:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-1.xml" 2024-09-19T05:22:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1039401575, 2024-09-19T05:22:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636064, 2024-09-19T05:22:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-37.jpg" 2024-09-19T05:22:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1075097426, 2024-09-19T05:22:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635928, 2024-09-19T05:22:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-15.xml" 2024-09-19T05:22:19.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.132 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.132 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1150268861, 2024-09-19T05:22:19.132 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636059, 2024-09-19T05:22:19.132 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-23.xml" 2024-09-19T05:22:19.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.132 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.132 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1170269440, 2024-09-19T05:22:19.132 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635994, 2024-09-19T05:22:19.132 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-59.jpg" 2024-09-19T05:22:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1204540536, 2024-09-19T05:22:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636030, 2024-09-19T05:22:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-48.jpg" 2024-09-19T05:22:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1258402083, 2024-09-19T05:22:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636067, 2024-09-19T05:22:19.133 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-36.jpg" 2024-09-19T05:22:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1264475799, 2024-09-19T05:22:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635946, 2024-09-19T05:22:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-9.xml" 2024-09-19T05:22:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1278182282, 2024-09-19T05:22:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635987, 2024-09-19T05:22:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-45.xml" 2024-09-19T05:22:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1296488495, 2024-09-19T05:22:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635951, 2024-09-19T05:22:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-7.xml" 2024-09-19T05:22:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1301433350, 2024-09-19T05:22:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636046, 2024-09-19T05:22:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-27.xml" 2024-09-19T05:22:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.135 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1473361558, 2024-09-19T05:22:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635968, 2024-09-19T05:22:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-51.xml" 2024-09-19T05:22:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1541003579, 2024-09-19T05:22:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635931, 2024-09-19T05:22:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-14.xml" 2024-09-19T05:22:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1586626450, 2024-09-19T05:22:19.136 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636056, 2024-09-19T05:22:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-40.jpg" 2024-09-19T05:22:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1737715705, 2024-09-19T05:22:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636028, 2024-09-19T05:22:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-33.xml" 2024-09-19T05:22:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1756896437, 2024-09-19T05:22:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635889, 2024-09-19T05:22:19.137 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-28.xml" 2024-09-19T05:22:19.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.138 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.138 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1757772959, 2024-09-19T05:22:19.138 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635995, 2024-09-19T05:22:19.138 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-43.xml" 2024-09-19T05:22:19.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.139 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.139 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1802476464, 2024-09-19T05:22:19.139 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636047, 2024-09-19T05:22:19.139 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-43.jpg" 2024-09-19T05:22:19.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.139 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.139 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1815445813, 2024-09-19T05:22:19.139 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635940, 2024-09-19T05:22:19.140 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-11.xml" 2024-09-19T05:22:19.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.140 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.140 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1859437033, 2024-09-19T05:22:19.140 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636021, 2024-09-19T05:22:19.140 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-35.xml" 2024-09-19T05:22:19.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.140 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.140 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1886475159, 2024-09-19T05:22:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636006, 2024-09-19T05:22:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-55.jpg" 2024-09-19T05:22:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1916759396, 2024-09-19T05:22:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635901, 2024-09-19T05:22:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-24.xml" 2024-09-19T05:22:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 1984266703, 2024-09-19T05:22:19.141 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635970, 2024-09-19T05:22:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-67.jpg" 2024-09-19T05:22:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2004516296, 2024-09-19T05:22:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635957, 2024-09-19T05:22:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-5.xml" 2024-09-19T05:22:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2010121622, 2024-09-19T05:22:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636015, 2024-09-19T05:22:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-52.jpg" 2024-09-19T05:22:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2023144583, 2024-09-19T05:22:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635909, 2024-09-19T05:22:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-21.xml" 2024-09-19T05:22:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2034627491, 2024-09-19T05:22:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636052, 2024-09-19T05:22:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-25.xml" 2024-09-19T05:22:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.143 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2061984236, 2024-09-19T05:22:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635981, 2024-09-19T05:22:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-47.xml" 2024-09-19T05:22:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2126462266, 2024-09-19T05:22:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636010, 2024-09-19T05:22:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-54.jpg" 2024-09-19T05:22:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2190774388, 2024-09-19T05:22:19.144 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636058, 2024-09-19T05:22:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-39.jpg" 2024-09-19T05:22:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2280099463, 2024-09-19T05:22:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635983, 2024-09-19T05:22:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-63.jpg" 2024-09-19T05:22:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2306469190, 2024-09-19T05:22:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636061, 2024-09-19T05:22:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-38.jpg" 2024-09-19T05:22:19.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.146 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.146 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2417479637, 2024-09-19T05:22:19.146 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636000, 2024-09-19T05:22:19.146 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-41.xml" 2024-09-19T05:22:19.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.146 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.146 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2417982811, 2024-09-19T05:22:19.147 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635964, 2024-09-19T05:22:19.147 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-2.xml" 2024-09-19T05:22:19.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.147 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.147 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2508023855, 2024-09-19T05:22:19.147 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636001, 2024-09-19T05:22:19.147 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-57.jpg" 2024-09-19T05:22:19.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.148 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.148 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2514881607, 2024-09-19T05:22:19.148 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636024, 2024-09-19T05:22:19.148 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-50.jpg" 2024-09-19T05:22:19.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.148 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.148 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2578769072, 2024-09-19T05:22:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635954, 2024-09-19T05:22:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-6.xml" 2024-09-19T05:22:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2709067020, 2024-09-19T05:22:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636053, 2024-09-19T05:22:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-41.jpg" 2024-09-19T05:22:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2768273669, 2024-09-19T05:22:19.149 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636014, 2024-09-19T05:22:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-37.xml" 2024-09-19T05:22:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2769796578, 2024-09-19T05:22:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635997, 2024-09-19T05:22:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-58.jpg" 2024-09-19T05:22:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2816023436, 2024-09-19T05:22:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636033, 2024-09-19T05:22:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-47.jpg" 2024-09-19T05:22:19.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.151 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.151 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2856777650, 2024-09-19T05:22:19.151 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635920, 2024-09-19T05:22:19.151 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-17.xml" 2024-09-19T05:22:19.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.151 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.151 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 2898249422, 2024-09-19T05:22:19.151 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636034, 2024-09-19T05:22:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.188+0000 7f254bfcc740 1 -- 172.21.15.120:0/1211770302 shutdown_connections 2024-09-19T05:22:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.188+0000 7f254bfcc740 1 --2- 172.21.15.120:0/1211770302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7979dd370 0x55e7979e10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.188+0000 7f254bfcc740 1 --2- 172.21.15.120:0/1211770302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e7979d3b40 0x55e7979e0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.188+0000 7f254bfcc740 1 --2- 172.21.15.120:0/1211770302 >> [v2:172.21.15.178:6838/3389137566,v1:172.21.15.178:6839/3389137566] conn(0x55e797a57880 0x55e797a59c70 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.188+0000 7f254bfcc740 1 --2- 172.21.15.120:0/1211770302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e7979d25d0 0x55e7979e5880 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.188+0000 7f254bfcc740 1 -- 172.21.15.120:0/1211770302 >> 172.21.15.120:0/1211770302 conn(0x55e79799b310 msgr2=0x55e7979db810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.188+0000 7f2522ffd640 0 client.25483 ms_handle_reset on v2:172.21.15.178:6838/3389137566 2024-09-19T05:22:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.188+0000 7f254bfcc740 1 -- 172.21.15.120:0/1211770302 shutdown_connections 2024-09-19T05:22:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.188+0000 7f254bfcc740 1 -- 172.21.15.120:0/1211770302 wait complete. 2024-09-19T05:22:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.188+0000 7f254bfcc740 20 client.25483 trim_cache size 0 max 16384 2024-09-19T05:22:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.189+0000 7f2549bf3640 1 -- 172.21.15.120:0/198734493 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f252c0a3430 msgr2=0x7f252c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.189+0000 7f2549bf3640 1 --2- 172.21.15.120:0/198734493 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f252c0a3430 0x7f252c0a58f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f253c005fd0 tx=0x7f253c009aa0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.189+0000 7f2549bf3640 1 -- 172.21.15.120:0/198734493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2544102790 msgr2=0x7f2544074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:19.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.189+0000 7f2549bf3640 1 --2- 172.21.15.120:0/198734493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2544102790 0x7f2544074a30 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f253800d950 tx=0x7f253800de10 comp rx=0 tx=0).stop 2024-09-19T05:22:19.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.189+0000 7f2549bf3640 1 -- 172.21.15.120:0/198734493 shutdown_connections 2024-09-19T05:22:19.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.189+0000 7f2549bf3640 1 --2- 172.21.15.120:0/198734493 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f252c0a3430 0x7f252c0a58f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.189+0000 7f2549bf3640 1 --2- 172.21.15.120:0/198734493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2544106f10 0x7f2544074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.189+0000 7f2549bf3640 1 --2- 172.21.15.120:0/198734493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2544102790 0x7f2544074a30 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.189+0000 7f2549bf3640 1 --2- 172.21.15.120:0/198734493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2544101de0 0x7f25440744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:19.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.189+0000 7f2549bf3640 1 -- 172.21.15.120:0/198734493 >> 172.21.15.120:0/198734493 conn(0x7f25440fd8e0 msgr2=0x7f25440fe7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:19.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.190+0000 7f2549bf3640 1 -- 172.21.15.120:0/198734493 shutdown_connections 2024-09-19T05:22:19.153 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:18.190+0000 7f2549bf3640 1 -- 172.21.15.120:0/198734493 wait complete. 2024-09-19T05:22:19.153 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-31.xml" 2024-09-19T05:22:19.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.154 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.154 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3019982436, 2024-09-19T05:22:19.154 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636068, 2024-09-19T05:22:19.154 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-20.xml" 2024-09-19T05:22:19.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.154 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.155 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3079278371, 2024-09-19T05:22:19.155 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636041, 2024-09-19T05:22:19.155 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-45.jpg" 2024-09-19T05:22:19.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.155 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.155 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3142404993, 2024-09-19T05:22:19.155 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636036, 2024-09-19T05:22:19.155 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-30.xml" 2024-09-19T05:22:19.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3204770106, 2024-09-19T05:22:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635971, 2024-09-19T05:22:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-50.xml" 2024-09-19T05:22:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3244600461, 2024-09-19T05:22:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636003, 2024-09-19T05:22:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-56.jpg" 2024-09-19T05:22:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3356516524, 2024-09-19T05:22:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636062, 2024-09-19T05:22:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-22.xml" 2024-09-19T05:22:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3373971670, 2024-09-19T05:22:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635937, 2024-09-19T05:22:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-12.xml" 2024-09-19T05:22:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3480806332, 2024-09-19T05:22:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636004, 2024-09-19T05:22:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-40.xml" 2024-09-19T05:22:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3530139713, 2024-09-19T05:22:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636009, 2024-09-19T05:22:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-38.xml" 2024-09-19T05:22:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.158 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3561178759, 2024-09-19T05:22:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636007, 2024-09-19T05:22:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-39.xml" 2024-09-19T05:22:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3576229381, 2024-09-19T05:22:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635898, 2024-09-19T05:22:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-25.xml" 2024-09-19T05:22:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.159 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3642184546, 2024-09-19T05:22:19.160 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635975, 2024-09-19T05:22:19.160 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-49.xml" 2024-09-19T05:22:19.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.160 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.160 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3735991060, 2024-09-19T05:22:19.160 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635976, 2024-09-19T05:22:19.161 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-65.jpg" 2024-09-19T05:22:19.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.161 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.161 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3760933153, 2024-09-19T05:22:19.161 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636040, 2024-09-19T05:22:19.161 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-29.xml" 2024-09-19T05:22:19.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.161 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3768550779, 2024-09-19T05:22:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636049, 2024-09-19T05:22:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-26.xml" 2024-09-19T05:22:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3919873532, 2024-09-19T05:22:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636065, 2024-09-19T05:22:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-21.xml" 2024-09-19T05:22:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.162 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 3938503680, 2024-09-19T05:22:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636012, 2024-09-19T05:22:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-53.jpg" 2024-09-19T05:22:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4000372206, 2024-09-19T05:22:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635949, 2024-09-19T05:22:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-8.xml" 2024-09-19T05:22:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4010060609, 2024-09-19T05:22:19.163 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635924, 2024-09-19T05:22:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-16.xml" 2024-09-19T05:22:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4031765096, 2024-09-19T05:22:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635917, 2024-09-19T05:22:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-18.xml" 2024-09-19T05:22:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4037716167, 2024-09-19T05:22:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636050, 2024-09-19T05:22:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-42.jpg" 2024-09-19T05:22:19.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.165 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.165 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4187223915, 2024-09-19T05:22:19.165 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636038, 2024-09-19T05:22:19.165 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-46.jpg" 2024-09-19T05:22:19.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.165 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.165 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4239093493, 2024-09-19T05:22:19.165 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511635906, 2024-09-19T05:22:19.165 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-22.xml" 2024-09-19T05:22:19.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:22:19.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:22:19.166 INFO:teuthology.orchestra.run.smithi120.stdout: "damage_type": "backtrace", 2024-09-19T05:22:19.166 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4272878620, 2024-09-19T05:22:19.166 INFO:teuthology.orchestra.run.smithi120.stdout: "ino": 1099511636027, 2024-09-19T05:22:19.166 INFO:teuthology.orchestra.run.smithi120.stdout: "path": "/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-49.jpg" 2024-09-19T05:22:19.166 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:22:19.166 INFO:teuthology.orchestra.run.smithi120.stdout:] 2024-09-19T05:22:20.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:20 smithi178 ceph-mon[34347]: pgmap v96: 97 pgs: 97 active+clean; 245 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 197 op/s 2024-09-19T05:22:20.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:20 smithi120 ceph-mon[30956]: pgmap v96: 97 pgs: 97 active+clean; 245 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 197 op/s 2024-09-19T05:22:20.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:20 smithi194 ceph-mon[35228]: pgmap v96: 97 pgs: 97 active+clean; 245 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.7 MiB/s wr, 197 op/s 2024-09-19T05:22:22.498 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:22 smithi120 ceph-mon[30956]: pgmap v97: 97 pgs: 97 active+clean; 245 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 122 op/s 2024-09-19T05:22:22.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:22 smithi178 ceph-mon[34347]: pgmap v97: 97 pgs: 97 active+clean; 245 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 122 op/s 2024-09-19T05:22:22.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:22 smithi194 ceph-mon[35228]: pgmap v97: 97 pgs: 97 active+clean; 245 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 122 op/s 2024-09-19T05:22:24.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:24 smithi178 ceph-mon[34347]: pgmap v98: 97 pgs: 97 active+clean; 245 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 122 op/s 2024-09-19T05:22:24.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:24 smithi120 ceph-mon[30956]: pgmap v98: 97 pgs: 97 active+clean; 245 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 122 op/s 2024-09-19T05:22:24.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:24 smithi194 ceph-mon[35228]: pgmap v98: 97 pgs: 97 active+clean; 245 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 122 op/s 2024-09-19T05:22:25.172 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.170+0000 7ffaf794b640 1 -- 172.21.15.120:0/3210005054 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffaf0106a00 msgr2=0x7ffaf0106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:25.172 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.170+0000 7ffaf794b640 1 --2- 172.21.15.120:0/3210005054 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffaf0106a00 0x7ffaf0106de0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ffaec009930 tx=0x7ffaec02a420 comp rx=0 tx=0).stop 2024-09-19T05:22:25.172 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.170+0000 7ffaf794b640 1 -- 172.21.15.120:0/3210005054 shutdown_connections 2024-09-19T05:22:25.172 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.170+0000 7ffaf794b640 1 --2- 172.21.15.120:0/3210005054 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffaf0101390 0x7ffaf010d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.172 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.170+0000 7ffaf794b640 1 --2- 172.21.15.120:0/3210005054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffaf01009f0 0x7ffaf0100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.170+0000 7ffaf794b640 1 --2- 172.21.15.120:0/3210005054 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffaf0106a00 0x7ffaf0106de0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.170+0000 7ffaf794b640 1 -- 172.21.15.120:0/3210005054 >> 172.21.15.120:0/3210005054 conn(0x7ffaf00fc6b0 msgr2=0x7ffaf00fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.170+0000 7ffaf794b640 1 -- 172.21.15.120:0/3210005054 shutdown_connections 2024-09-19T05:22:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.170+0000 7ffaf794b640 1 -- 172.21.15.120:0/3210005054 wait complete. 2024-09-19T05:22:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.171+0000 7ffaf794b640 1 Processor -- start 2024-09-19T05:22:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.171+0000 7ffaf794b640 1 -- start start 2024-09-19T05:22:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.171+0000 7ffaf794b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffaf01009f0 0x7ffaf01101c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.171+0000 7ffaf794b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffaf0101390 0x7ffaf0110700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.171+0000 7ffaf794b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffaf0106a00 0x7ffaf0110c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.171+0000 7ffaf794b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf006af50 con 0x7ffaf01009f0 2024-09-19T05:22:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.171+0000 7ffaf794b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf006add0 con 0x7ffaf0106a00 2024-09-19T05:22:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.171+0000 7ffaf794b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf006b0d0 con 0x7ffaf0101390 2024-09-19T05:22:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.171+0000 7ffaf4ee6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffaf0101390 0x7ffaf0110700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.171+0000 7ffaf5ee8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffaf0106a00 0x7ffaf0110c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.171+0000 7ffaf56e7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffaf01009f0 0x7ffaf01101c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.172+0000 7ffaf4ee6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffaf0101390 0x7ffaf0110700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:54774/0 (socket says 172.21.15.120:54774) 2024-09-19T05:22:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.172+0000 7ffaf5ee8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffaf0106a00 0x7ffaf0110c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:36564/0 (socket says 172.21.15.120:36564) 2024-09-19T05:22:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.172+0000 7ffaf4ee6640 1 -- 172.21.15.120:0/3883808073 learned_addr learned my addr 172.21.15.120:0/3883808073 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.172+0000 7ffaf5ee8640 1 -- 172.21.15.120:0/3883808073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffaf0101390 msgr2=0x7ffaf0110700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.172+0000 7ffaf5ee8640 1 --2- 172.21.15.120:0/3883808073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffaf0101390 0x7ffaf0110700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.172+0000 7ffaf5ee8640 1 -- 172.21.15.120:0/3883808073 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffaf01009f0 msgr2=0x7ffaf01101c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.172+0000 7ffaf5ee8640 1 --2- 172.21.15.120:0/3883808073 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffaf01009f0 0x7ffaf01101c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.172+0000 7ffaf5ee8640 1 -- 172.21.15.120:0/3883808073 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf01a6830 con 0x7ffaf0106a00 2024-09-19T05:22:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.172+0000 7ffaf5ee8640 1 --2- 172.21.15.120:0/3883808073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffaf0106a00 0x7ffaf0110c40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ffae8009fd0 tx=0x7ffae800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.172+0000 7ffae67fc640 1 -- 172.21.15.120:0/3883808073 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae800ce20 con 0x7ffaf0106a00 2024-09-19T05:22:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.172+0000 7ffaf794b640 1 -- 172.21.15.120:0/3883808073 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaf01a6b20 con 0x7ffaf0106a00 2024-09-19T05:22:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.172+0000 7ffae67fc640 1 -- 172.21.15.120:0/3883808073 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffae8005020 con 0x7ffaf0106a00 2024-09-19T05:22:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.172+0000 7ffae67fc640 1 -- 172.21.15.120:0/3883808073 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae8010690 con 0x7ffaf0106a00 2024-09-19T05:22:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.172+0000 7ffaf794b640 1 -- 172.21.15.120:0/3883808073 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaf01a70c0 con 0x7ffaf0106a00 2024-09-19T05:22:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.175+0000 7ffae67fc640 1 -- 172.21.15.120:0/3883808073 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7ffae80051d0 con 0x7ffaf0106a00 2024-09-19T05:22:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.175+0000 7ffafa7c4740 1 Processor -- start 2024-09-19T05:22:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.176+0000 7ffafa7c4740 1 -- start start 2024-09-19T05:22:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.176+0000 7ffafa7c4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6300 0x56139f0a66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.176+0000 7ffafa7c4740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56139f0a6c20 0x56139f0b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.176+0000 7ffafa7c4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56139f0b14c0 0x56139f0b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.176+0000 7ffafa7c4740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56139f0022f0 con 0x56139f0a6c20 2024-09-19T05:22:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.176+0000 7ffafa7c4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56139efaa270 con 0x56139f0b14c0 2024-09-19T05:22:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.176+0000 7ffafa7c4740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56139effe2b0 con 0x56139f0a6300 2024-09-19T05:22:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.176+0000 7ffaf4ee6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6300 0x56139f0a66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.176+0000 7ffaf4ee6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6300 0x56139f0a66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:54782/0 (socket says 172.21.15.120:54782) 2024-09-19T05:22:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.176+0000 7ffaf4ee6640 1 -- 172.21.15.120:0/452211666 learned_addr learned my addr 172.21.15.120:0/452211666 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.176+0000 7ffaf56e7640 1 --2- 172.21.15.120:0/452211666 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56139f0a6c20 0x56139f0b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.176+0000 7ffaf4ee6640 1 --2- 172.21.15.120:0/452211666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56139f0b14c0 0x56139f0b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.176+0000 7ffaf4ee6640 1 -- 172.21.15.120:0/452211666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56139f0b14c0 msgr2=0x56139f0b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.176+0000 7ffaf4ee6640 1 --2- 172.21.15.120:0/452211666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56139f0b14c0 0x56139f0b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.176+0000 7ffaf4ee6640 1 -- 172.21.15.120:0/452211666 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56139f0a6c20 msgr2=0x56139f0b0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.176+0000 7ffae67fc640 1 --2- 172.21.15.120:0/3883808073 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ffadc0a3460 0x7ffadc0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.180 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.176+0000 7ffaf4ee6640 1 --2- 172.21.15.120:0/452211666 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56139f0a6c20 0x56139f0b0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.176+0000 7ffaf4ee6640 1 -- 172.21.15.120:0/452211666 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56139efa9340 con 0x56139f0a6300 2024-09-19T05:22:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.176+0000 7ffaf56e7640 1 --2- 172.21.15.120:0/452211666 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56139f0a6c20 0x56139f0b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.177+0000 7ffaf4ee6640 1 --2- 172.21.15.120:0/3883808073 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ffadc0a3460 0x7ffadc0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.177+0000 7ffae67fc640 1 -- 172.21.15.120:0/3883808073 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7ffae80d0490 con 0x7ffaf0106a00 2024-09-19T05:22:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.177+0000 7ffaf4ee6640 1 --2- 172.21.15.120:0/3883808073 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ffadc0a3460 0x7ffadc0a5920 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009dd0 tx=0x7ffae0005f90 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.178+0000 7ffaf4ee6640 1 --2- 172.21.15.120:0/452211666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6300 0x56139f0a66e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffae00118d0 tx=0x7ffae0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37263d10024d927e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.178+0000 7ffadb7fe640 1 -- 172.21.15.120:0/452211666 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae0024070 con 0x56139f0a6300 2024-09-19T05:22:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.178+0000 7ffadb7fe640 1 -- 172.21.15.120:0/452211666 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffae000ecb0 con 0x56139f0a6300 2024-09-19T05:22:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.178+0000 7ffadb7fe640 1 -- 172.21.15.120:0/452211666 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae001fa60 con 0x56139f0a6300 2024-09-19T05:22:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.179+0000 7ffafa7c4740 1 -- 172.21.15.120:0/452211666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6300 msgr2=0x56139f0a66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.179+0000 7ffafa7c4740 1 --2- 172.21.15.120:0/452211666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6300 0x56139f0a66e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffae00118d0 tx=0x7ffae0004730 comp rx=0 tx=0).stop 2024-09-19T05:22:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.179+0000 7ffafa7c4740 1 -- 172.21.15.120:0/452211666 shutdown_connections 2024-09-19T05:22:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.179+0000 7ffafa7c4740 1 --2- 172.21.15.120:0/452211666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56139f0b14c0 0x56139f0b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.179+0000 7ffafa7c4740 1 --2- 172.21.15.120:0/452211666 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56139f0a6c20 0x56139f0b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.179+0000 7ffafa7c4740 1 --2- 172.21.15.120:0/452211666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6300 0x56139f0a66e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.179+0000 7ffafa7c4740 1 -- 172.21.15.120:0/452211666 >> 172.21.15.120:0/452211666 conn(0x56139f0a2870 msgr2=0x56139f0a2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.179+0000 7ffafa7c4740 1 -- 172.21.15.120:0/452211666 shutdown_connections 2024-09-19T05:22:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.179+0000 7ffafa7c4740 1 -- 172.21.15.120:0/452211666 wait complete. 2024-09-19T05:22:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.179+0000 7ffafa7c4740 1 -- start start 2024-09-19T05:22:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.179+0000 7ffafa7c4740 1 Processor -- start 2024-09-19T05:22:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.180+0000 7ffafa7c4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6300 0x56139f0ae400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.180+0000 7ffafa7c4740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56139f0a6c20 0x56139f0ae940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.180+0000 7ffafa7c4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56139f0b14c0 0x56139f0aee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.180+0000 7ffaf4ee6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56139f0a6c20 0x56139f0ae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.180+0000 7ffafa7c4740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56139f0b4090 con 0x56139f0a6c20 2024-09-19T05:22:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.180+0000 7ffafa7c4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56139ef8b290 con 0x56139f0b14c0 2024-09-19T05:22:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.180+0000 7ffaf4ee6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56139f0a6c20 0x56139f0ae940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56966/0 (socket says 172.21.15.120:56966) 2024-09-19T05:22:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.180+0000 7ffaf4ee6640 1 -- 172.21.15.120:0/69212391 learned_addr learned my addr 172.21.15.120:0/69212391 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.180+0000 7ffafa7c4740 1 -- 172.21.15.120:0/69212391 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56139f0b4210 con 0x56139f0a6300 2024-09-19T05:22:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.180+0000 7ffaf56e7640 1 --2- 172.21.15.120:0/69212391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6300 0x56139f0ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.180+0000 7ffafa7c4740 10 client.0 _ll_register_callbacks cb 0x56139efbc140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:22:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.180+0000 7ffaf5ee8640 1 --2- 172.21.15.120:0/69212391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56139f0b14c0 0x56139f0aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.181+0000 7ffaf56e7640 1 -- 172.21.15.120:0/69212391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56139f0b14c0 msgr2=0x56139f0aee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.181+0000 7ffaf56e7640 1 --2- 172.21.15.120:0/69212391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56139f0b14c0 0x56139f0aee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.181+0000 7ffaf56e7640 1 -- 172.21.15.120:0/69212391 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56139f0a6c20 msgr2=0x56139f0ae940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.181+0000 7ffaf56e7640 1 --2- 172.21.15.120:0/69212391 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56139f0a6c20 0x56139f0ae940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.181+0000 7ffaf56e7640 1 -- 172.21.15.120:0/69212391 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56139ed15210 con 0x56139f0a6300 2024-09-19T05:22:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.181+0000 7ffaf5ee8640 1 --2- 172.21.15.120:0/69212391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56139f0b14c0 0x56139f0aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:22:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.181+0000 7ffaf4ee6640 1 --2- 172.21.15.120:0/69212391 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56139f0a6c20 0x56139f0ae940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.181+0000 7ffad8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:22:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.181+0000 7ffaf56e7640 1 --2- 172.21.15.120:0/69212391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6300 0x56139f0ae400 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffaec009230 tx=0x7ffaec0052e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b3ea723cfa5d522 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.181+0000 7ffad8ff9640 1 -- 172.21.15.120:0/69212391 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec035040 con 0x56139f0a6300 2024-09-19T05:22:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.181+0000 7ffad8ff9640 1 -- 172.21.15.120:0/69212391 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7ffaec0048c0 con 0x56139f0a6300 2024-09-19T05:22:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.181+0000 7ffafa7c4740 1 -- 172.21.15.120:0/69212391 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffae000ecb0 con 0x56139f0a6300 2024-09-19T05:22:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.181+0000 7ffad8ff9640 1 -- 172.21.15.120:0/69212391 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffaec004ac0 con 0x56139f0a6300 2024-09-19T05:22:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.182+0000 7ffafa7c4740 10 client.25495 fetch_fsmap learned FSMap version 29 2024-09-19T05:22:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.182+0000 7ffafa7c4740 1 -- 172.21.15.120:0/69212391 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56139ede1620 con 0x56139f0a6300 2024-09-19T05:22:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.182+0000 7ffad8ff9640 1 -- 172.21.15.120:0/69212391 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffae000ecb0 con 0x56139f0a6300 2024-09-19T05:22:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.182+0000 7ffad8ff9640 1 -- 172.21.15.120:0/69212391 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7ffaec0314a0 con 0x56139f0a6300 2024-09-19T05:22:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.182+0000 7ffafa7c4740 10 client.25495 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:22:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.182+0000 7ffafa7c4740 10 client.25495 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:22:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.182+0000 7ffafa7c4740 20 client.25495 populate_metadata read hostname 'smithi120' 2024-09-19T05:22:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.182+0000 7ffafa7c4740 1 --2- 172.21.15.120:0/69212391 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56139f0c1880 0x56139f0c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.182+0000 7ffafa7c4740 4 client.25495 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:22:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.182+0000 7ffafa7c4740 1 -- 172.21.15.120:0/69212391 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56139f00fa20 con 0x56139f0c1880 2024-09-19T05:22:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.182+0000 7ffaf4ee6640 1 --2- 172.21.15.120:0/69212391 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56139f0c1880 0x56139f0c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.183+0000 7ffad8ff9640 10 client.25495 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:22:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.183+0000 7ffaf4ee6640 1 --2- 172.21.15.120:0/69212391 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56139f0c1880 0x56139f0c3d40 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18e3812a9cdcb29d server_cookie=d791d87571f02013 in_seq=0 out_seq=0 2024-09-19T05:22:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.183+0000 7ffad8ff9640 1 -- 172.21.15.120:0/69212391 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56139f00fa20 con 0x56139f0c1880 2024-09-19T05:22:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.183+0000 7ffad8ff9640 10 client.25495 handle_command_reply: tid=0 2024-09-19T05:22:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.184+0000 7ffafa7c4740 1 client.25495 shutdown 2024-09-19T05:22:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.184+0000 7ffafa7c4740 1 -- 172.21.15.120:0/69212391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6300 msgr2=0x56139f0ae400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.184+0000 7ffafa7c4740 1 --2- 172.21.15.120:0/69212391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6300 0x56139f0ae400 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffaec009230 tx=0x7ffaec0052e0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.184+0000 7ffafa7c4740 1 -- 172.21.15.120:0/69212391 shutdown_connections 2024-09-19T05:22:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.184+0000 7ffafa7c4740 1 --2- 172.21.15.120:0/69212391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56139f0b14c0 0x56139f0aee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.184+0000 7ffafa7c4740 1 --2- 172.21.15.120:0/69212391 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56139f0a6c20 0x56139f0ae940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.184+0000 7ffafa7c4740 1 --2- 172.21.15.120:0/69212391 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56139f0c1880 0x56139f0c3d40 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.184+0000 7ffafa7c4740 1 --2- 172.21.15.120:0/69212391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6300 0x56139f0ae400 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.184+0000 7ffafa7c4740 1 -- 172.21.15.120:0/69212391 >> 172.21.15.120:0/69212391 conn(0x56139f0a2870 msgr2=0x56139f0a85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.184+0000 7ffad8ff9640 0 client.25495 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:22:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.184+0000 7ffafa7c4740 1 -- 172.21.15.120:0/69212391 shutdown_connections 2024-09-19T05:22:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.184+0000 7ffafa7c4740 1 -- 172.21.15.120:0/69212391 wait complete. 2024-09-19T05:22:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.184+0000 7ffafa7c4740 20 client.25495 trim_cache size 0 max 16384 2024-09-19T05:22:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.206+0000 7ffafa7c4740 1 Processor -- start 2024-09-19T05:22:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.206+0000 7ffafa7c4740 1 -- start start 2024-09-19T05:22:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.207+0000 7ffafa7c4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6300 0x56139f0b0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.207+0000 7ffafa7c4740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56139f0a6c20 0x56139f0c9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.207+0000 7ffafa7c4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56139f0b14c0 0x56139f0c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.207+0000 7ffafa7c4740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf01adf90 con 0x56139f0a6c20 2024-09-19T05:22:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.207+0000 7ffafa7c4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf01ab860 con 0x56139f0b14c0 2024-09-19T05:22:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.207+0000 7ffafa7c4740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf01a96d0 con 0x56139f0a6300 2024-09-19T05:22:25.209 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.207+0000 7ffaf56e7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6300 0x56139f0b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.207+0000 7ffaf56e7640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6300 0x56139f0b0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:54804/0 (socket says 172.21.15.120:54804) 2024-09-19T05:22:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.207+0000 7ffaf56e7640 1 -- 172.21.15.120:0/1750185542 learned_addr learned my addr 172.21.15.120:0/1750185542 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.207+0000 7ffaf4ee6640 1 --2- 172.21.15.120:0/1750185542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56139f0a6c20 0x56139f0c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.207+0000 7ffaf5ee8640 1 --2- 172.21.15.120:0/1750185542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56139f0b14c0 0x56139f0c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.207+0000 7ffaf56e7640 1 -- 172.21.15.120:0/1750185542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56139f0b14c0 msgr2=0x56139f0c9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.207+0000 7ffaf56e7640 1 --2- 172.21.15.120:0/1750185542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56139f0b14c0 0x56139f0c9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.207+0000 7ffaf56e7640 1 -- 172.21.15.120:0/1750185542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56139f0a6c20 msgr2=0x56139f0c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.207+0000 7ffaf56e7640 1 --2- 172.21.15.120:0/1750185542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56139f0a6c20 0x56139f0c9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.210 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.207+0000 7ffaf56e7640 1 -- 172.21.15.120:0/1750185542 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56139f0a26a0 con 0x56139f0a6300 2024-09-19T05:22:25.211 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.207+0000 7ffaf56e7640 1 --2- 172.21.15.120:0/1750185542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6300 0x56139f0b0370 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffaec0092a0 tx=0x7ffaec000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0b0f5f3a1057551 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.208+0000 7ffadaffd640 1 -- 172.21.15.120:0/1750185542 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec035070 con 0x56139f0a6300 2024-09-19T05:22:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.208+0000 7ffadaffd640 1 -- 172.21.15.120:0/1750185542 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffaec040070 con 0x56139f0a6300 2024-09-19T05:22:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.208+0000 7ffadaffd640 1 -- 172.21.15.120:0/1750185542 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec031d40 con 0x56139f0a6300 2024-09-19T05:22:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.209+0000 7ffafa7c4740 1 -- 172.21.15.120:0/1750185542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6300 msgr2=0x56139f0b0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.209+0000 7ffafa7c4740 1 --2- 172.21.15.120:0/1750185542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6300 0x56139f0b0370 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffaec0092a0 tx=0x7ffaec000bc0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.209+0000 7ffafa7c4740 1 -- 172.21.15.120:0/1750185542 shutdown_connections 2024-09-19T05:22:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.209+0000 7ffafa7c4740 1 --2- 172.21.15.120:0/1750185542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56139f0b14c0 0x56139f0c9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.209+0000 7ffafa7c4740 1 --2- 172.21.15.120:0/1750185542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56139f0a6c20 0x56139f0c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.209+0000 7ffafa7c4740 1 --2- 172.21.15.120:0/1750185542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6300 0x56139f0b0370 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.209+0000 7ffafa7c4740 1 -- 172.21.15.120:0/1750185542 >> 172.21.15.120:0/1750185542 conn(0x56139f0a2870 msgr2=0x56139f0afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.209+0000 7ffafa7c4740 1 -- 172.21.15.120:0/1750185542 shutdown_connections 2024-09-19T05:22:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.209+0000 7ffafa7c4740 1 -- 172.21.15.120:0/1750185542 wait complete. 2024-09-19T05:22:25.213 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.209+0000 7ffafa7c4740 1 -- start start 2024-09-19T05:22:25.213 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.209+0000 7ffafa7c4740 1 Processor -- start 2024-09-19T05:22:25.213 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.210+0000 7ffafa7c4740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56139f0a6300 0x56139f0b9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.213 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.210+0000 7ffafa7c4740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6c20 0x56139f0b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.210+0000 7ffafa7c4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56139f0b14c0 0x56139f0b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.210+0000 7ffaf56e7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56139f0a6300 0x56139f0b9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.210+0000 7ffaf56e7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56139f0a6300 0x56139f0b9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56980/0 (socket says 172.21.15.120:56980) 2024-09-19T05:22:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.210+0000 7ffaf4ee6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6c20 0x56139f0b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.210+0000 7ffaf4ee6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6c20 0x56139f0b4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:54816/0 (socket says 172.21.15.120:54816) 2024-09-19T05:22:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.210+0000 7ffaf56e7640 1 -- 172.21.15.120:0/3309550772 learned_addr learned my addr 172.21.15.120:0/3309550772 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.211+0000 7ffafa7c4740 1 -- 172.21.15.120:0/3309550772 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf01a9d20 con 0x56139f0a6300 2024-09-19T05:22:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.211+0000 7ffafa7c4740 1 -- 172.21.15.120:0/3309550772 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf01ab190 con 0x56139f0b14c0 2024-09-19T05:22:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.211+0000 7ffaf5ee8640 1 --2- 172.21.15.120:0/3309550772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56139f0b14c0 0x56139f0b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.211+0000 7ffafa7c4740 1 -- 172.21.15.120:0/3309550772 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf01aa3f0 con 0x56139f0a6c20 2024-09-19T05:22:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.211+0000 7ffafa7c4740 10 client.0 _ll_register_callbacks cb 0x7ffae0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:22:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.211+0000 7ffaf4ee6640 1 -- 172.21.15.120:0/3309550772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56139f0b14c0 msgr2=0x56139f0b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.211+0000 7ffaf4ee6640 1 --2- 172.21.15.120:0/3309550772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56139f0b14c0 0x56139f0b5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.211+0000 7ffaf4ee6640 1 -- 172.21.15.120:0/3309550772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56139f0a6300 msgr2=0x56139f0b9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.211+0000 7ffaf4ee6640 1 --2- 172.21.15.120:0/3309550772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56139f0a6300 0x56139f0b9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.211+0000 7ffaf4ee6640 1 -- 172.21.15.120:0/3309550772 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56139f0a9150 con 0x56139f0a6c20 2024-09-19T05:22:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.211+0000 7ffaf5ee8640 1 --2- 172.21.15.120:0/3309550772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56139f0b14c0 0x56139f0b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.211+0000 7ffaf56e7640 1 --2- 172.21.15.120:0/3309550772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56139f0a6300 0x56139f0b9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.211+0000 7ffaf4ee6640 1 --2- 172.21.15.120:0/3309550772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6c20 0x56139f0b4ee0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009570 tx=0x7ffae00116d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2746ebcea5621ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.211+0000 7ffad8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:22:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.212+0000 7ffad8ff9640 1 -- 172.21.15.120:0/3309550772 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae0024040 con 0x56139f0a6c20 2024-09-19T05:22:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.212+0000 7ffafa7c4740 1 -- 172.21.15.120:0/3309550772 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffaec040070 con 0x56139f0a6c20 2024-09-19T05:22:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.212+0000 7ffad8ff9640 1 -- 172.21.15.120:0/3309550772 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7ffae000eb10 con 0x56139f0a6c20 2024-09-19T05:22:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.212+0000 7ffad8ff9640 1 -- 172.21.15.120:0/3309550772 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffae0046050 con 0x56139f0a6c20 2024-09-19T05:22:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.212+0000 7ffafa7c4740 10 client.25501 fetch_fsmap learned FSMap version 29 2024-09-19T05:22:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.212+0000 7ffafa7c4740 1 -- 172.21.15.120:0/3309550772 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56139f0a39e0 con 0x56139f0a6c20 2024-09-19T05:22:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.212+0000 7ffad8ff9640 1 -- 172.21.15.120:0/3309550772 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7ffaec040070 con 0x56139f0a6c20 2024-09-19T05:22:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.212+0000 7ffad8ff9640 1 -- 172.21.15.120:0/3309550772 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7ffae001f530 con 0x56139f0a6c20 2024-09-19T05:22:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.212+0000 7ffafa7c4740 10 client.25501 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:22:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.212+0000 7ffafa7c4740 10 client.25501 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:22:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.212+0000 7ffafa7c4740 20 client.25501 populate_metadata read hostname 'smithi120' 2024-09-19T05:22:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.212+0000 7ffafa7c4740 1 --2- 172.21.15.120:0/3309550772 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56139f12c800 0x56139f12ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.212+0000 7ffafa7c4740 4 client.25501 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:22:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.212+0000 7ffafa7c4740 1 -- 172.21.15.120:0/3309550772 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56139f009d70 con 0x56139f12c800 2024-09-19T05:22:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.213+0000 7ffaf56e7640 1 --2- 172.21.15.120:0/3309550772 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56139f12c800 0x56139f12ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.213+0000 7ffaf56e7640 1 --2- 172.21.15.120:0/3309550772 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56139f12c800 0x56139f12ec20 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f832186fe1003119 server_cookie=e61b3591f04af05f in_seq=0 out_seq=0 2024-09-19T05:22:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.213+0000 7ffad8ff9640 10 client.25501 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:22:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.331+0000 7ffad8ff9640 1 -- 172.21.15.120:0/3309550772 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56139f009d70 con 0x56139f12c800 2024-09-19T05:22:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.331+0000 7ffad8ff9640 10 client.25501 handle_command_reply: tid=0 2024-09-19T05:22:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.331+0000 7ffafa7c4740 1 client.25501 shutdown 2024-09-19T05:22:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.331+0000 7ffafa7c4740 1 -- 172.21.15.120:0/3309550772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6c20 msgr2=0x56139f0b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.331+0000 7ffafa7c4740 1 --2- 172.21.15.120:0/3309550772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6c20 0x56139f0b4ee0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009570 tx=0x7ffae00116d0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.332+0000 7ffafa7c4740 1 -- 172.21.15.120:0/3309550772 shutdown_connections 2024-09-19T05:22:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.332+0000 7ffafa7c4740 1 --2- 172.21.15.120:0/3309550772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56139f0b14c0 0x56139f0b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.332+0000 7ffafa7c4740 1 --2- 172.21.15.120:0/3309550772 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56139f12c800 0x56139f12ec20 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.334 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.332+0000 7ffafa7c4740 1 --2- 172.21.15.120:0/3309550772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56139f0a6c20 0x56139f0b4ee0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.332+0000 7ffafa7c4740 1 --2- 172.21.15.120:0/3309550772 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56139f0a6300 0x56139f0b9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.332+0000 7ffafa7c4740 1 -- 172.21.15.120:0/3309550772 >> 172.21.15.120:0/3309550772 conn(0x56139f0a2870 msgr2=0x56139f0a85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.332+0000 7ffad8ff9640 0 client.25501 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:22:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.332+0000 7ffafa7c4740 1 -- 172.21.15.120:0/3309550772 shutdown_connections 2024-09-19T05:22:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.332+0000 7ffafa7c4740 1 -- 172.21.15.120:0/3309550772 wait complete. 2024-09-19T05:22:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.332+0000 7ffafa7c4740 20 client.25501 trim_cache size 0 max 16384 2024-09-19T05:22:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:22:25.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:22:25.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:22:25.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:22:25.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.334+0000 7ffaf794b640 1 -- 172.21.15.120:0/3883808073 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ffadc0a3460 msgr2=0x7ffadc0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:25.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.334+0000 7ffaf794b640 1 --2- 172.21.15.120:0/3883808073 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ffadc0a3460 0x7ffadc0a5920 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009dd0 tx=0x7ffae0005f90 comp rx=0 tx=0).stop 2024-09-19T05:22:25.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.334+0000 7ffaf794b640 1 -- 172.21.15.120:0/3883808073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffaf0106a00 msgr2=0x7ffaf0110c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:25.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.334+0000 7ffaf794b640 1 --2- 172.21.15.120:0/3883808073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffaf0106a00 0x7ffaf0110c40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ffae8009fd0 tx=0x7ffae800ef10 comp rx=0 tx=0).stop 2024-09-19T05:22:25.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.334+0000 7ffaf794b640 1 -- 172.21.15.120:0/3883808073 shutdown_connections 2024-09-19T05:22:25.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.334+0000 7ffaf794b640 1 --2- 172.21.15.120:0/3883808073 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7ffadc0a3460 0x7ffadc0a5920 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.334+0000 7ffaf794b640 1 --2- 172.21.15.120:0/3883808073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffaf0106a00 0x7ffaf0110c40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.334+0000 7ffaf794b640 1 --2- 172.21.15.120:0/3883808073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffaf0101390 0x7ffaf0110700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.334+0000 7ffaf794b640 1 --2- 172.21.15.120:0/3883808073 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffaf01009f0 0x7ffaf01101c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:25.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.334+0000 7ffaf794b640 1 -- 172.21.15.120:0/3883808073 >> 172.21.15.120:0/3883808073 conn(0x7ffaf00fc6b0 msgr2=0x7ffaf00fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:25.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.334+0000 7ffaf794b640 1 -- 172.21.15.120:0/3883808073 shutdown_connections 2024-09-19T05:22:25.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:25.334+0000 7ffaf794b640 1 -- 172.21.15.120:0/3883808073 wait complete. 2024-09-19T05:22:26.617 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T05:22:26.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:26 smithi178 ceph-mon[34347]: pgmap v99: 97 pgs: 97 active+clean; 240 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 234 op/s 2024-09-19T05:22:26.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:26 smithi120 ceph-mon[30956]: pgmap v99: 97 pgs: 97 active+clean; 240 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 234 op/s 2024-09-19T05:22:26.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:26 smithi194 ceph-mon[35228]: pgmap v99: 97 pgs: 97 active+clean; 240 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 234 op/s 2024-09-19T05:22:26.960 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:22:28.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:27 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:22:28.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:27 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:22:28.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:27 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:22:28.314 INFO:tasks.workunit.client.0.smithi120.stdout: 72 12878 68 7232 114 1929 57 2024-09-19T05:22:29.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:28 smithi120 ceph-mon[30956]: pgmap v100: 97 pgs: 97 active+clean; 240 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 168 op/s 2024-09-19T05:22:29.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:28 smithi194 ceph-mon[35228]: pgmap v100: 97 pgs: 97 active+clean; 240 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 168 op/s 2024-09-19T05:22:29.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:28 smithi178 ceph-mon[34347]: pgmap v100: 97 pgs: 97 active+clean; 240 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 168 op/s 2024-09-19T05:22:30.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:29 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:22:30.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:29 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:22:30.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:29 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:22:30.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:29 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:22:30.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:29 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:22:30.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:29 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:22:30.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:29 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:22:30.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:29 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:22:30.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:29 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:22:31.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:30 smithi120 ceph-mon[30956]: pgmap v101: 97 pgs: 97 active+clean; 250 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 228 op/s 2024-09-19T05:22:31.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:30 smithi194 ceph-mon[35228]: pgmap v101: 97 pgs: 97 active+clean; 250 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 228 op/s 2024-09-19T05:22:31.191 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:30 smithi178 ceph-mon[34347]: pgmap v101: 97 pgs: 97 active+clean; 250 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 228 op/s 2024-09-19T05:22:31.422 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.490+0000 7f479117d640 1 -- 172.21.15.120:0/1203022567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f478c102d30 msgr2=0x7f478c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:31.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.490+0000 7f479117d640 1 --2- 172.21.15.120:0/1203022567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f478c102d30 0x7f478c103110 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f477c009930 tx=0x7f477c02a420 comp rx=0 tx=0).stop 2024-09-19T05:22:31.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.490+0000 7f479117d640 1 -- 172.21.15.120:0/1203022567 shutdown_connections 2024-09-19T05:22:31.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.490+0000 7f479117d640 1 --2- 172.21.15.120:0/1203022567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f478c1082a0 0x7f478c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.490+0000 7f479117d640 1 --2- 172.21.15.120:0/1203022567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f478c1036e0 0x7f478c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.490+0000 7f479117d640 1 --2- 172.21.15.120:0/1203022567 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f478c102d30 0x7f478c103110 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.490+0000 7f479117d640 1 -- 172.21.15.120:0/1203022567 >> 172.21.15.120:0/1203022567 conn(0x7f478c0fc7d0 msgr2=0x7f478c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:31.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.490+0000 7f479117d640 1 -- 172.21.15.120:0/1203022567 shutdown_connections 2024-09-19T05:22:31.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.490+0000 7f479117d640 1 -- 172.21.15.120:0/1203022567 wait complete. 2024-09-19T05:22:31.423 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.491+0000 7f479117d640 1 Processor -- start 2024-09-19T05:22:31.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.491+0000 7f479117d640 1 -- start start 2024-09-19T05:22:31.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.492+0000 7f479117d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f478c102d30 0x7f478c19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:31.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.492+0000 7f479117d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f478c1036e0 0x7f478c19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:31.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.492+0000 7f479117d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f478c1082a0 0x7f478c19efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:31.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.492+0000 7f479117d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f478c111f90 con 0x7f478c1082a0 2024-09-19T05:22:31.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.492+0000 7f479117d640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f478c111e10 con 0x7f478c1036e0 2024-09-19T05:22:31.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.492+0000 7f479117d640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f478c112110 con 0x7f478c102d30 2024-09-19T05:22:31.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.492+0000 7f478ad9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f478c102d30 0x7f478c19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:31.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.492+0000 7f478ad9d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f478c102d30 0x7f478c19a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:54836/0 (socket says 172.21.15.120:54836) 2024-09-19T05:22:31.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.492+0000 7f478ad9d640 1 -- 172.21.15.120:0/3367048933 learned_addr learned my addr 172.21.15.120:0/3367048933 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:31.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.492+0000 7f478a59c640 1 --2- 172.21.15.120:0/3367048933 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f478c1036e0 0x7f478c19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:31.424 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.492+0000 7f478b59e640 1 --2- 172.21.15.120:0/3367048933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f478c1082a0 0x7f478c19efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:31.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.492+0000 7f478ad9d640 1 -- 172.21.15.120:0/3367048933 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f478c1036e0 msgr2=0x7f478c19ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:31.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.492+0000 7f478ad9d640 1 --2- 172.21.15.120:0/3367048933 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f478c1036e0 0x7f478c19ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.492+0000 7f478ad9d640 1 -- 172.21.15.120:0/3367048933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f478c1082a0 msgr2=0x7f478c19efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:31.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.492+0000 7f478ad9d640 1 --2- 172.21.15.120:0/3367048933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f478c1082a0 0x7f478c19efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.492+0000 7f478ad9d640 1 -- 172.21.15.120:0/3367048933 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478c19f6a0 con 0x7f478c102d30 2024-09-19T05:22:31.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.492+0000 7f478b59e640 1 --2- 172.21.15.120:0/3367048933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f478c1082a0 0x7f478c19efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:22:31.425 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.492+0000 7f478a59c640 1 --2- 172.21.15.120:0/3367048933 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f478c1036e0 0x7f478c19ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:31.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.493+0000 7f478ad9d640 1 --2- 172.21.15.120:0/3367048933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f478c102d30 0x7f478c19a6f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f477c005ab0 tx=0x7f477c003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:31.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.493+0000 7f4773fff640 1 -- 172.21.15.120:0/3367048933 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c03f070 con 0x7f478c102d30 2024-09-19T05:22:31.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.493+0000 7f4773fff640 1 -- 172.21.15.120:0/3367048933 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f477c031b50 con 0x7f478c102d30 2024-09-19T05:22:31.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.493+0000 7f479117d640 1 -- 172.21.15.120:0/3367048933 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f478c19f930 con 0x7f478c102d30 2024-09-19T05:22:31.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.493+0000 7f4773fff640 1 -- 172.21.15.120:0/3367048933 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c035030 con 0x7f478c102d30 2024-09-19T05:22:31.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.493+0000 7f479117d640 1 -- 172.21.15.120:0/3367048933 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f478c1a7270 con 0x7f478c102d30 2024-09-19T05:22:31.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.496+0000 7f4773fff640 1 -- 172.21.15.120:0/3367048933 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f477c042070 con 0x7f478c102d30 2024-09-19T05:22:31.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.497+0000 7f4773fff640 1 --2- 172.21.15.120:0/3367048933 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f47740a33b0 0x7f47740a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:31.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.497+0000 7f4793556740 1 Processor -- start 2024-09-19T05:22:31.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.497+0000 7f4793556740 1 -- start start 2024-09-19T05:22:31.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.497+0000 7f478a59c640 1 --2- 172.21.15.120:0/3367048933 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f47740a33b0 0x7f47740a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:31.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.497+0000 7f4773fff640 1 -- 172.21.15.120:0/3367048933 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f477c0f00d0 con 0x7f478c102d30 2024-09-19T05:22:31.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.497+0000 7f4793556740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e778b40 0x56330e777090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:31.426 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.497+0000 7f4793556740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56330e7775d0 0x56330e777a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:31.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.497+0000 7f4793556740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56330e782370 0x56330e784760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:31.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.497+0000 7f4793556740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56330e6dd2f0 con 0x56330e778b40 2024-09-19T05:22:31.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.497+0000 7f4793556740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56330e684cf0 con 0x56330e7775d0 2024-09-19T05:22:31.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.497+0000 7f4793556740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56330e6d92b0 con 0x56330e782370 2024-09-19T05:22:31.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.497+0000 7f478ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e778b40 0x56330e777090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:31.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.497+0000 7f478ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e778b40 0x56330e777090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57014/0 (socket says 172.21.15.120:57014) 2024-09-19T05:22:31.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.497+0000 7f478ad9d640 1 -- 172.21.15.120:0/231996137 learned_addr learned my addr 172.21.15.120:0/231996137 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:31.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.497+0000 7f478a59c640 1 --2- 172.21.15.120:0/231996137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56330e7775d0 0x56330e777a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:31.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.497+0000 7f478b59e640 1 --2- 172.21.15.120:0/231996137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56330e782370 0x56330e784760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:31.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.498+0000 7f478a59c640 1 --2- 172.21.15.120:0/3367048933 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f47740a33b0 0x7f47740a5870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f478c0fe570 tx=0x7f4780011860 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:31.427 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.498+0000 7f478a59c640 1 -- 172.21.15.120:0/231996137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56330e782370 msgr2=0x56330e784760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:31.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.498+0000 7f478a59c640 1 --2- 172.21.15.120:0/231996137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56330e782370 0x56330e784760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.498+0000 7f478a59c640 1 -- 172.21.15.120:0/231996137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e778b40 msgr2=0x56330e777090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:31.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.498+0000 7f478a59c640 1 --2- 172.21.15.120:0/231996137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e778b40 0x56330e777090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.498+0000 7f478a59c640 1 -- 172.21.15.120:0/231996137 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56330e6693a0 con 0x56330e7775d0 2024-09-19T05:22:31.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.498+0000 7f478a59c640 1 --2- 172.21.15.120:0/231996137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56330e7775d0 0x56330e777a10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f478c0697d0 tx=0x7f478001c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87b38c3a9aaacf26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:31.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.498+0000 7f47717fa640 1 -- 172.21.15.120:0/231996137 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4780017040 con 0x56330e7775d0 2024-09-19T05:22:31.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.498+0000 7f47717fa640 1 -- 172.21.15.120:0/231996137 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4780019050 con 0x56330e7775d0 2024-09-19T05:22:31.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.498+0000 7f47717fa640 1 -- 172.21.15.120:0/231996137 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478001d440 con 0x56330e7775d0 2024-09-19T05:22:31.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.499+0000 7f4793556740 1 -- 172.21.15.120:0/231996137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56330e7775d0 msgr2=0x56330e777a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:31.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.499+0000 7f4793556740 1 --2- 172.21.15.120:0/231996137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56330e7775d0 0x56330e777a10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f478c0697d0 tx=0x7f478001c000 comp rx=0 tx=0).stop 2024-09-19T05:22:31.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.499+0000 7f4793556740 1 -- 172.21.15.120:0/231996137 shutdown_connections 2024-09-19T05:22:31.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.499+0000 7f4793556740 1 --2- 172.21.15.120:0/231996137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56330e782370 0x56330e784760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.428 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.499+0000 7f4793556740 1 --2- 172.21.15.120:0/231996137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56330e7775d0 0x56330e777a10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.499+0000 7f4793556740 1 --2- 172.21.15.120:0/231996137 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e778b40 0x56330e777090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.499+0000 7f4793556740 1 -- 172.21.15.120:0/231996137 >> 172.21.15.120:0/231996137 conn(0x56330e740310 msgr2=0x56330e773c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:31.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.499+0000 7f4793556740 1 -- 172.21.15.120:0/231996137 shutdown_connections 2024-09-19T05:22:31.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.499+0000 7f4793556740 1 -- 172.21.15.120:0/231996137 wait complete. 2024-09-19T05:22:31.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.500+0000 7f4793556740 1 -- start start 2024-09-19T05:22:31.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.500+0000 7f4793556740 1 Processor -- start 2024-09-19T05:22:31.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.500+0000 7f4793556740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e7775d0 0x56330e781d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:31.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.500+0000 7f4793556740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56330e778b40 0x56330e77f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:31.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.500+0000 7f4793556740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56330e782370 0x56330e77f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:31.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.500+0000 7f4793556740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x56330e785070 con 0x56330e7775d0 2024-09-19T05:22:31.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.500+0000 7f4793556740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x56330e698060 con 0x56330e778b40 2024-09-19T05:22:31.429 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.500+0000 7f4793556740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56330e7851f0 con 0x56330e782370 2024-09-19T05:22:31.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.500+0000 7f4793556740 10 client.0 _ll_register_callbacks cb 0x56330e3eb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:22:31.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.500+0000 7f478ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e7775d0 0x56330e781d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:31.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.501+0000 7f478ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e7775d0 0x56330e781d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57026/0 (socket says 172.21.15.120:57026) 2024-09-19T05:22:31.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.501+0000 7f478ad9d640 1 -- 172.21.15.120:0/2196916331 learned_addr learned my addr 172.21.15.120:0/2196916331 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:31.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.501+0000 7f478b59e640 1 --2- 172.21.15.120:0/2196916331 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56330e782370 0x56330e77f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:31.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.501+0000 7f478b59e640 1 -- 172.21.15.120:0/2196916331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56330e778b40 msgr2=0x56330e77f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:31.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.501+0000 7f478b59e640 1 --2- 172.21.15.120:0/2196916331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56330e778b40 0x56330e77f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.501+0000 7f478b59e640 1 -- 172.21.15.120:0/2196916331 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e7775d0 msgr2=0x56330e781d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:31.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.501+0000 7f478b59e640 1 --2- 172.21.15.120:0/2196916331 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e7775d0 0x56330e781d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.501+0000 7f478b59e640 1 -- 172.21.15.120:0/2196916331 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56330e44e3c0 con 0x56330e782370 2024-09-19T05:22:31.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.501+0000 7f478b59e640 1 --2- 172.21.15.120:0/2196916331 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56330e782370 0x56330e77f640 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4784005fd0 tx=0x7f4784012b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df859739790398e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:31.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.501+0000 7f476eff5640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:22:31.430 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.501+0000 7f476eff5640 1 -- 172.21.15.120:0/2196916331 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4784010ce0 con 0x56330e782370 2024-09-19T05:22:31.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.501+0000 7f476eff5640 1 -- 172.21.15.120:0/2196916331 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f478401a3e0 con 0x56330e782370 2024-09-19T05:22:31.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.501+0000 7f4793556740 1 -- 172.21.15.120:0/2196916331 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4780019050 con 0x56330e782370 2024-09-19T05:22:31.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.502+0000 7f476eff5640 1 -- 172.21.15.120:0/2196916331 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4784010e80 con 0x56330e782370 2024-09-19T05:22:31.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.502+0000 7f4793556740 10 client.25513 fetch_fsmap learned FSMap version 29 2024-09-19T05:22:31.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.502+0000 7f4793556740 1 -- 172.21.15.120:0/2196916331 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56330e7993b0 con 0x56330e782370 2024-09-19T05:22:31.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.502+0000 7f476eff5640 1 -- 172.21.15.120:0/2196916331 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4780019050 con 0x56330e782370 2024-09-19T05:22:31.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.502+0000 7f476eff5640 1 -- 172.21.15.120:0/2196916331 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4784019070 con 0x56330e782370 2024-09-19T05:22:31.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.502+0000 7f4793556740 10 client.25513 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:22:31.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.502+0000 7f4793556740 10 client.25513 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:22:31.431 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.502+0000 7f4793556740 20 client.25513 populate_metadata read hostname 'smithi120' 2024-09-19T05:22:31.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.502+0000 7f4793556740 1 --2- 172.21.15.120:0/2196916331 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56330e79ad90 0x56330e79d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:31.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.502+0000 7f4793556740 4 client.25513 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:22:31.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.502+0000 7f4793556740 1 -- 172.21.15.120:0/2196916331 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56330e6ea860 con 0x56330e79ad90 2024-09-19T05:22:31.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.502+0000 7f478ad9d640 1 --2- 172.21.15.120:0/2196916331 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56330e79ad90 0x56330e79d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:31.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.503+0000 7f476eff5640 10 client.25513 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:22:31.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.503+0000 7f478ad9d640 1 --2- 172.21.15.120:0/2196916331 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56330e79ad90 0x56330e79d230 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1201ec083091e34 server_cookie=e23d5138c64d1e08 in_seq=0 out_seq=0 2024-09-19T05:22:31.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.504+0000 7f476eff5640 1 -- 172.21.15.120:0/2196916331 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56330e6ea860 con 0x56330e79ad90 2024-09-19T05:22:31.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.504+0000 7f476eff5640 10 client.25513 handle_command_reply: tid=0 2024-09-19T05:22:31.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.504+0000 7f4793556740 1 client.25513 shutdown 2024-09-19T05:22:31.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.504+0000 7f4793556740 1 -- 172.21.15.120:0/2196916331 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56330e782370 msgr2=0x56330e77f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:31.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.504+0000 7f4793556740 1 --2- 172.21.15.120:0/2196916331 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56330e782370 0x56330e77f640 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4784005fd0 tx=0x7f4784012b60 comp rx=0 tx=0).stop 2024-09-19T05:22:31.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.504+0000 7f4793556740 1 -- 172.21.15.120:0/2196916331 shutdown_connections 2024-09-19T05:22:31.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.504+0000 7f4793556740 1 --2- 172.21.15.120:0/2196916331 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56330e79ad90 0x56330e79d230 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.432 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.504+0000 7f4793556740 1 --2- 172.21.15.120:0/2196916331 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56330e782370 0x56330e77f640 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.504+0000 7f4793556740 1 --2- 172.21.15.120:0/2196916331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56330e778b40 0x56330e77f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.504+0000 7f4793556740 1 --2- 172.21.15.120:0/2196916331 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e7775d0 0x56330e781d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.504+0000 7f4793556740 1 -- 172.21.15.120:0/2196916331 >> 172.21.15.120:0/2196916331 conn(0x56330e740310 msgr2=0x56330e779930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:31.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.504+0000 7f476eff5640 0 client.25513 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:22:31.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.504+0000 7f4793556740 1 -- 172.21.15.120:0/2196916331 shutdown_connections 2024-09-19T05:22:31.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.504+0000 7f4793556740 1 -- 172.21.15.120:0/2196916331 wait complete. 2024-09-19T05:22:31.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.505+0000 7f4793556740 20 client.25513 trim_cache size 0 max 16384 2024-09-19T05:22:31.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.526+0000 7f4793556740 1 Processor -- start 2024-09-19T05:22:31.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.526+0000 7f4793556740 1 -- start start 2024-09-19T05:22:31.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.526+0000 7f4793556740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56330e7775d0 0x56330e796ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:31.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.526+0000 7f4793556740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e778b40 0x56330e773700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:31.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.526+0000 7f4793556740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56330e782370 0x56330e773c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:31.433 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.526+0000 7f4793556740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f478c1ae030 con 0x56330e778b40 2024-09-19T05:22:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.526+0000 7f4793556740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f478c1ab900 con 0x56330e782370 2024-09-19T05:22:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.526+0000 7f4793556740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f478c1a9770 con 0x56330e7775d0 2024-09-19T05:22:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.526+0000 7f478a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e778b40 0x56330e773700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.526+0000 7f478a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e778b40 0x56330e773700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57032/0 (socket says 172.21.15.120:57032) 2024-09-19T05:22:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.526+0000 7f478a59c640 1 -- 172.21.15.120:0/72600873 learned_addr learned my addr 172.21.15.120:0/72600873 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.527+0000 7f478ad9d640 1 --2- 172.21.15.120:0/72600873 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56330e7775d0 0x56330e796ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.527+0000 7f478b59e640 1 --2- 172.21.15.120:0/72600873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56330e782370 0x56330e773c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.527+0000 7f478a59c640 1 -- 172.21.15.120:0/72600873 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56330e7775d0 msgr2=0x56330e796ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.527+0000 7f478a59c640 1 --2- 172.21.15.120:0/72600873 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56330e7775d0 0x56330e796ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.527+0000 7f478a59c640 1 -- 172.21.15.120:0/72600873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56330e782370 msgr2=0x56330e773c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.527+0000 7f478a59c640 1 --2- 172.21.15.120:0/72600873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56330e782370 0x56330e773c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.527+0000 7f478a59c640 1 -- 172.21.15.120:0/72600873 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56330e774180 con 0x56330e778b40 2024-09-19T05:22:31.434 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.527+0000 7f478a59c640 1 --2- 172.21.15.120:0/72600873 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e778b40 0x56330e773700 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f47800039c0 tx=0x7f4780011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98dce7753a4e70cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:31.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.527+0000 7f4770ff9640 1 -- 172.21.15.120:0/72600873 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4780017070 con 0x56330e778b40 2024-09-19T05:22:31.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.527+0000 7f4770ff9640 1 -- 172.21.15.120:0/72600873 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47800054f0 con 0x56330e778b40 2024-09-19T05:22:31.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.527+0000 7f4770ff9640 1 -- 172.21.15.120:0/72600873 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4780004ba0 con 0x56330e778b40 2024-09-19T05:22:31.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.528+0000 7f4793556740 1 -- 172.21.15.120:0/72600873 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e778b40 msgr2=0x56330e773700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:31.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.528+0000 7f4793556740 1 --2- 172.21.15.120:0/72600873 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e778b40 0x56330e773700 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f47800039c0 tx=0x7f4780011ea0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.528+0000 7f4793556740 1 -- 172.21.15.120:0/72600873 shutdown_connections 2024-09-19T05:22:31.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.528+0000 7f4793556740 1 --2- 172.21.15.120:0/72600873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56330e782370 0x56330e773c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.528+0000 7f4793556740 1 --2- 172.21.15.120:0/72600873 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e778b40 0x56330e773700 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.435 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.528+0000 7f4793556740 1 --2- 172.21.15.120:0/72600873 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56330e7775d0 0x56330e796ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.528+0000 7f4793556740 1 -- 172.21.15.120:0/72600873 >> 172.21.15.120:0/72600873 conn(0x56330e740310 msgr2=0x56330e77eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.528+0000 7f4793556740 1 -- 172.21.15.120:0/72600873 shutdown_connections 2024-09-19T05:22:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.528+0000 7f4793556740 1 -- 172.21.15.120:0/72600873 wait complete. 2024-09-19T05:22:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.529+0000 7f4793556740 1 -- start start 2024-09-19T05:22:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.529+0000 7f4793556740 1 Processor -- start 2024-09-19T05:22:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.529+0000 7f4793556740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e7775d0 0x56330e78e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.529+0000 7f4793556740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56330e778b40 0x56330e78e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.529+0000 7f4793556740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56330e782370 0x56330e7fdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.529+0000 7f4793556740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f478c1a9dc0 con 0x56330e7775d0 2024-09-19T05:22:31.436 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.529+0000 7f4793556740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f478c1ab230 con 0x56330e782370 2024-09-19T05:22:31.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.529+0000 7f4793556740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f478c1aa490 con 0x56330e778b40 2024-09-19T05:22:31.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.529+0000 7f4793556740 10 client.0 _ll_register_callbacks cb 0x7f4784009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:22:31.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.529+0000 7f478ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e7775d0 0x56330e78e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:31.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.529+0000 7f478ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e7775d0 0x56330e78e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:57048/0 (socket says 172.21.15.120:57048) 2024-09-19T05:22:31.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.529+0000 7f478ad9d640 1 -- 172.21.15.120:0/3170517525 learned_addr learned my addr 172.21.15.120:0/3170517525 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:31.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.530+0000 7f478a59c640 1 --2- 172.21.15.120:0/3170517525 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56330e778b40 0x56330e78e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:31.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.530+0000 7f478b59e640 1 --2- 172.21.15.120:0/3170517525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56330e782370 0x56330e7fdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:31.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.530+0000 7f478ad9d640 1 -- 172.21.15.120:0/3170517525 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56330e778b40 msgr2=0x56330e78e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:31.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.530+0000 7f478ad9d640 1 --2- 172.21.15.120:0/3170517525 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56330e778b40 0x56330e78e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.530+0000 7f478ad9d640 1 -- 172.21.15.120:0/3170517525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56330e782370 msgr2=0x56330e7fdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:31.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.530+0000 7f478ad9d640 1 --2- 172.21.15.120:0/3170517525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56330e782370 0x56330e7fdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.530+0000 7f478ad9d640 1 -- 172.21.15.120:0/3170517525 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56330e7fe110 con 0x56330e7775d0 2024-09-19T05:22:31.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.530+0000 7f478ad9d640 1 --2- 172.21.15.120:0/3170517525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e7775d0 0x56330e78e450 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f477c0b8760 tx=0x7f477c0dc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e5e82b3c43c486 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:31.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.530+0000 7f476eff5640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:22:31.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.530+0000 7f476eff5640 1 -- 172.21.15.120:0/3170517525 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477c049040 con 0x56330e7775d0 2024-09-19T05:22:31.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.530+0000 7f476eff5640 1 -- 172.21.15.120:0/3170517525 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f477c031d00 con 0x56330e7775d0 2024-09-19T05:22:31.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.530+0000 7f4793556740 1 -- 172.21.15.120:0/3170517525 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47800054f0 con 0x56330e7775d0 2024-09-19T05:22:31.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.530+0000 7f476eff5640 1 -- 172.21.15.120:0/3170517525 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f477c0c06b0 con 0x56330e7775d0 2024-09-19T05:22:31.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.530+0000 7f4793556740 10 client.15993 fetch_fsmap learned FSMap version 29 2024-09-19T05:22:31.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.530+0000 7f4793556740 1 -- 172.21.15.120:0/3170517525 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56330e8054e0 con 0x56330e7775d0 2024-09-19T05:22:31.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.531+0000 7f476eff5640 1 -- 172.21.15.120:0/3170517525 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47800054f0 con 0x56330e7775d0 2024-09-19T05:22:31.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.531+0000 7f476eff5640 1 -- 172.21.15.120:0/3170517525 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f477c04c060 con 0x56330e7775d0 2024-09-19T05:22:31.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.531+0000 7f4793556740 10 client.15993 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:22:31.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.531+0000 7f4793556740 10 client.15993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-19T05:22:31.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.531+0000 7f4793556740 20 client.15993 populate_metadata read hostname 'smithi120' 2024-09-19T05:22:31.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.531+0000 7f4793556740 1 --2- 172.21.15.120:0/3170517525 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56330e805be0 0x56330e808000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:31.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.531+0000 7f4793556740 4 client.15993 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T05:22:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.531+0000 7f4793556740 1 -- 172.21.15.120:0/3170517525 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56330e6e4d70 con 0x56330e805be0 2024-09-19T05:22:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.531+0000 7f478a59c640 1 --2- 172.21.15.120:0/3170517525 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56330e805be0 0x56330e808000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.532+0000 7f478a59c640 1 --2- 172.21.15.120:0/3170517525 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56330e805be0 0x56330e808000 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=540062c9faab4927 server_cookie=36d427a8699f6bbf in_seq=0 out_seq=0 2024-09-19T05:22:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.532+0000 7f476eff5640 10 client.15993 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:22:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.532+0000 7f476eff5640 1 -- 172.21.15.120:0/3170517525 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56330e6e4d70 con 0x56330e805be0 2024-09-19T05:22:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.532+0000 7f476eff5640 10 client.15993 handle_command_reply: tid=0 2024-09-19T05:22:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.532+0000 7f4793556740 1 client.15993 shutdown 2024-09-19T05:22:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.532+0000 7f4793556740 1 -- 172.21.15.120:0/3170517525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e7775d0 msgr2=0x56330e78e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.532+0000 7f4793556740 1 --2- 172.21.15.120:0/3170517525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e7775d0 0x56330e78e450 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f477c0b8760 tx=0x7f477c0dc040 comp rx=0 tx=0).stop 2024-09-19T05:22:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.532+0000 7f4793556740 1 -- 172.21.15.120:0/3170517525 shutdown_connections 2024-09-19T05:22:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.532+0000 7f4793556740 1 --2- 172.21.15.120:0/3170517525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56330e782370 0x56330e7fdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.532+0000 7f4793556740 1 --2- 172.21.15.120:0/3170517525 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56330e805be0 0x56330e808000 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.440 INFO:teuthology.orchestra.run.smithi120.stdout:[] 2024-09-19T05:22:31.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.532+0000 7f4793556740 1 --2- 172.21.15.120:0/3170517525 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56330e778b40 0x56330e78e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.532+0000 7f4793556740 1 --2- 172.21.15.120:0/3170517525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x56330e7775d0 0x56330e78e450 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.532+0000 7f476eff5640 0 client.15993 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:22:31.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.532+0000 7f4793556740 1 -- 172.21.15.120:0/3170517525 >> 172.21.15.120:0/3170517525 conn(0x56330e740310 msgr2=0x56330e77eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:31.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.532+0000 7f4793556740 1 -- 172.21.15.120:0/3170517525 shutdown_connections 2024-09-19T05:22:31.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.532+0000 7f4793556740 1 -- 172.21.15.120:0/3170517525 wait complete. 2024-09-19T05:22:31.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.532+0000 7f4793556740 20 client.15993 trim_cache size 0 max 16384 2024-09-19T05:22:31.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.533+0000 7f479117d640 1 -- 172.21.15.120:0/3367048933 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f47740a33b0 msgr2=0x7f47740a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:31.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.533+0000 7f479117d640 1 --2- 172.21.15.120:0/3367048933 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f47740a33b0 0x7f47740a5870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f478c0fe570 tx=0x7f4780011860 comp rx=0 tx=0).stop 2024-09-19T05:22:31.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.533+0000 7f479117d640 1 -- 172.21.15.120:0/3367048933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f478c102d30 msgr2=0x7f478c19a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:31.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.533+0000 7f479117d640 1 --2- 172.21.15.120:0/3367048933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f478c102d30 0x7f478c19a6f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f477c005ab0 tx=0x7f477c003b90 comp rx=0 tx=0).stop 2024-09-19T05:22:31.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.533+0000 7f479117d640 1 -- 172.21.15.120:0/3367048933 shutdown_connections 2024-09-19T05:22:31.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.533+0000 7f479117d640 1 --2- 172.21.15.120:0/3367048933 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f47740a33b0 0x7f47740a5870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.533+0000 7f479117d640 1 --2- 172.21.15.120:0/3367048933 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f478c1082a0 0x7f478c19efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.533+0000 7f479117d640 1 --2- 172.21.15.120:0/3367048933 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f478c1036e0 0x7f478c19ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.533+0000 7f479117d640 1 --2- 172.21.15.120:0/3367048933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f478c102d30 0x7f478c19a6f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:31.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.533+0000 7f479117d640 1 -- 172.21.15.120:0/3367048933 >> 172.21.15.120:0/3367048933 conn(0x7f478c0fc7d0 msgr2=0x7f478c100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:31.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.533+0000 7f479117d640 1 -- 172.21.15.120:0/3367048933 shutdown_connections 2024-09-19T05:22:31.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:22:30.533+0000 7f479117d640 1 -- 172.21.15.120:0/3367048933 wait complete. 2024-09-19T05:22:32.801 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:32 smithi120 ceph-mon[30956]: pgmap v102: 97 pgs: 97 active+clean; 250 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 171 op/s 2024-09-19T05:22:32.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:32 smithi194 ceph-mon[35228]: pgmap v102: 97 pgs: 97 active+clean; 250 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 171 op/s 2024-09-19T05:22:32.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:32 smithi178 ceph-mon[34347]: pgmap v102: 97 pgs: 97 active+clean; 250 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 171 op/s 2024-09-19T05:22:33.257 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 2831299, 'ino': 1099511635393, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-9.xml'}, {'damage_type': 'backtrace', 'id': 5086807, 'ino': 1099511635872, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 22161668, 'ino': 1099511635883, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 25581820, 'ino': 1099511635871, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-3.xml'}, {'damage_type': 'backtrace', 'id': 35511651, 'ino': 1099511635450, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 63473628, 'ino': 1099511635894, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 66544084, 'ino': 1099511635715, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 70189308, 'ino': 1099511635234, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 114480566, 'ino': 1099511635862, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 157798956, 'ino': 1099511635668, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-79.jpg'}, {'damage_type': 'backtrace', 'id': 184375122, 'ino': 1099511635778, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-19.xml'}, {'damage_type': 'backtrace', 'id': 221745295, 'ino': 1099511635285, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 227104261, 'ino': 1099511635830, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 227383510, 'ino': 1099511635845, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 256287027, 'ino': 1099511635805, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-8.xml'}, {'damage_type': 'backtrace', 'id': 257406397, 'ino': 1099511635921, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-8.xml'}, {'damage_type': 'backtrace', 'id': 259070226, 'ino': 1099511635736, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-39.xml'}, {'damage_type': 'backtrace', 'id': 286099739, 'ino': 1099511635481, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 287207373, 'ino': 1099511635809, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-6.xml'}, {'damage_type': 'backtrace', 'id': 308671111, 'ino': 1099511635685, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-62.xml'}, {'damage_type': 'backtrace', 'id': 318323911, 'ino': 1099511635687, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-72.jpg'}, {'damage_type': 'backtrace', 'id': 324300956, 'ino': 1099511635863, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-7.xml'}, {'damage_type': 'backtrace', 'id': 331771554, 'ino': 1099511635832, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 344175608, 'ino': 1099511635682, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-63.xml'}, {'damage_type': 'backtrace', 'id': 348671565, 'ino': 1099511635291, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 365490141, 'ino': 1099511635343, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 381013420, 'ino': 1099511635321, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 388820922, 'ino': 1099511635734, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-40.xml'}, {'damage_type': 'backtrace', 'id': 410636599, 'ino': 1099511635910, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 418263546, 'ino': 1099511635887, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 419198158, 'ino': 1099511635864, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 470154329, 'ino': 1099511635966, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 488476914, 'ino': 1099511635797, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-37/article-62.xml'}, {'damage_type': 'backtrace', 'id': 490972605, 'ino': 1099511635310, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 500768407, 'ino': 1099511635582, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-38.xml'}, {'damage_type': 'backtrace', 'id': 514875933, 'ino': 1099511635767, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-24.xml'}, {'damage_type': 'backtrace', 'id': 538317364, 'ino': 1099511635851, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 539933344, 'ino': 1099511635866, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 561898740, 'ino': 1099511635714, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-49.xml'}, {'damage_type': 'backtrace', 'id': 569085257, 'ino': 1099511635815, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-4.xml'}, {'damage_type': 'backtrace', 'id': 588336430, 'ino': 1099511635869, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-4.xml'}, {'damage_type': 'backtrace', 'id': 596271357, 'ino': 1099511635416, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 599315877, 'ino': 1099511635317, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-45.xml'}, {'damage_type': 'backtrace', 'id': 639005006, 'ino': 1099511635717, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 681540618, 'ino': 1099511635719, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-46.xml'}, {'damage_type': 'backtrace', 'id': 688201069, 'ino': 1099511635266, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 692225414, 'ino': 1099511635606, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-27.xml'}, {'damage_type': 'backtrace', 'id': 693540267, 'ino': 1099511635827, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 695520799, 'ino': 1099511635338, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 726740037, 'ino': 1099511635754, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-30.xml'}, {'damage_type': 'backtrace', 'id': 730494631, 'ino': 1099511635677, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-65.xml'}, {'damage_type': 'backtrace', 'id': 730681560, 'ino': 1099511635756, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-29.xml'}, {'damage_type': 'backtrace', 'id': 744493619, 'ino': 1099511635854, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 760058626, 'ino': 1099511635865, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-6.xml'}, {'damage_type': 'backtrace', 'id': 781138270, 'ino': 1099511635340, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 812662498, 'ino': 1099511635484, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 819196186, 'ino': 1099511635308, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 842448551, 'ino': 1099511635728, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 859172463, 'ino': 1099511635576, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-41.xml'}, {'damage_type': 'backtrace', 'id': 860367617, 'ino': 1099511635969, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 881528757, 'ino': 1099511635896, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 892470546, 'ino': 1099511635888, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 900142355, 'ino': 1099511635828, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 949751403, 'ino': 1099511635294, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 957801564, 'ino': 1099511635947, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 962029128, 'ino': 1099511635458, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 968075001, 'ino': 1099511635833, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 981737678, 'ino': 1099511635272, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 1015800634, 'ino': 1099511635870, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 1017764659, 'ino': 1099511635694, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-59.xml'}, {'damage_type': 'backtrace', 'id': 1028388924, 'ino': 1099511635918, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-9.xml'}, {'damage_type': 'backtrace', 'id': 1046580855, 'ino': 1099511635902, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 1049345148, 'ino': 1099511635915, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 1059344224, 'ino': 1099511635242, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 1061425018, 'ino': 1099511635323, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-41.xml'}, {'damage_type': 'backtrace', 'id': 1070228156, 'ino': 1099511635930, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-6.xml'}, {'damage_type': 'backtrace', 'id': 1092033741, 'ino': 1099511635344, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-31.xml'}, {'damage_type': 'backtrace', 'id': 1095195686, 'ino': 1099511635961, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 1097702359, 'ino': 1099511635857, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 1101014197, 'ino': 1099511635316, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 1146808131, 'ino': 1099511635262, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 1169391192, 'ino': 1099511635508, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 1171149442, 'ino': 1099511635300, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 1171581867, 'ino': 1099511635252, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 1175449796, 'ino': 1099511635679, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-64.xml'}, {'damage_type': 'backtrace', 'id': 1176980220, 'ino': 1099511635568, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-45.xml'}, {'damage_type': 'backtrace', 'id': 1199483615, 'ino': 1099511635747, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 1238007282, 'ino': 1099511635861, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-8.xml'}, {'damage_type': 'backtrace', 'id': 1246221824, 'ino': 1099511635942, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-2.xml'}, {'damage_type': 'backtrace', 'id': 1246627726, 'ino': 1099511635473, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 1321480612, 'ino': 1099511635842, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 1340082768, 'ino': 1099511635773, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 1342946181, 'ino': 1099511635374, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-18.xml'}, {'damage_type': 'backtrace', 'id': 1351779975, 'ino': 1099511635238, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 1356679070, 'ino': 1099511635841, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 1359229366, 'ino': 1099511635519, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-69.xml'}, {'damage_type': 'backtrace', 'id': 1362891840, 'ino': 1099511635609, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-26.xml'}, {'damage_type': 'backtrace', 'id': 1403736647, 'ino': 1099511635929, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 1437194815, 'ino': 1099511635429, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-37/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 1442870414, 'ino': 1099511635436, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 1444431085, 'ino': 1099511635653, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-4.xml'}, {'damage_type': 'backtrace', 'id': 1445148065, 'ino': 1099511635938, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 1450631617, 'ino': 1099511635258, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 1450914503, 'ino': 1099511635945, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-1.xml'}, {'damage_type': 'backtrace', 'id': 1475901220, 'ino': 1099511635748, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-33.xml'}, {'damage_type': 'backtrace', 'id': 1478344868, 'ino': 1099511635876, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 1490594318, 'ino': 1099511635825, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 1503267373, 'ino': 1099511635328, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 1517298733, 'ino': 1099511635566, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-46.xml'}, {'damage_type': 'backtrace', 'id': 1526755333, 'ino': 1099511635890, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 1542786581, 'ino': 1099511635829, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 1551178418, 'ino': 1099511635808, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-7.xml'}, {'damage_type': 'backtrace', 'id': 1560528242, 'ino': 1099511635868, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 1584688449, 'ino': 1099511635897, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 1604164697, 'ino': 1099511635810, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 1627699719, 'ino': 1099511635440, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 1632720295, 'ino': 1099511635850, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 1648882112, 'ino': 1099511635799, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-10.xml'}, {'damage_type': 'backtrace', 'id': 1663772827, 'ino': 1099511635839, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 1682386794, 'ino': 1099511635891, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 1698617677, 'ino': 1099511635847, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 1728452558, 'ino': 1099511635786, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-15.xml'}, {'damage_type': 'backtrace', 'id': 1746811140, 'ino': 1099511635716, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-48.xml'}, {'damage_type': 'backtrace', 'id': 1751357283, 'ino': 1099511635718, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-47.xml'}, {'damage_type': 'backtrace', 'id': 1776152632, 'ino': 1099511635908, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 1790090703, 'ino': 1099511635490, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 1817343820, 'ino': 1099511635935, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 1823665092, 'ino': 1099511635675, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-66.xml'}, {'damage_type': 'backtrace', 'id': 1846824323, 'ino': 1099511635867, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-5.xml'}, {'damage_type': 'backtrace', 'id': 1866867135, 'ino': 1099511635690, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-71.jpg'}, {'damage_type': 'backtrace', 'id': 1878231334, 'ino': 1099511635431, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 1962827401, 'ino': 1099511635709, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 1963056156, 'ino': 1099511635731, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-41.xml'}, {'damage_type': 'backtrace', 'id': 1972394003, 'ino': 1099511635878, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 1977132132, 'ino': 1099511635240, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 2002793466, 'ino': 1099511635260, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 2017710665, 'ino': 1099511635498, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 2057498550, 'ino': 1099511635314, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 2078799518, 'ino': 1099511635708, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-52.xml'}, {'damage_type': 'backtrace', 'id': 2078821489, 'ino': 1099511635248, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 2086813812, 'ino': 1099511635296, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 2093289796, 'ino': 1099511635268, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 2120792376, 'ino': 1099511635232, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 2121574137, 'ino': 1099511635284, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-61.xml'}, {'damage_type': 'backtrace', 'id': 2148310562, 'ino': 1099511635492, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 2166540970, 'ino': 1099511635289, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-59.xml'}, {'damage_type': 'backtrace', 'id': 2169660242, 'ino': 1099511635629, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-16.xml'}, {'damage_type': 'backtrace', 'id': 2194903410, 'ino': 1099511635782, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-17.xml'}, {'damage_type': 'backtrace', 'id': 2210117846, 'ino': 1099511635772, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-22.xml'}, {'damage_type': 'backtrace', 'id': 2321885914, 'ino': 1099511635600, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-29.xml'}, {'damage_type': 'backtrace', 'id': 2351005250, 'ino': 1099511635760, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 2356148856, 'ino': 1099511635853, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 2360647913, 'ino': 1099511635246, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 2372543600, 'ino': 1099511635283, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 2377913994, 'ino': 1099511635706, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-53.xml'}, {'damage_type': 'backtrace', 'id': 2379146078, 'ino': 1099511635286, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 2401992373, 'ino': 1099511635318, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-44.xml'}, {'damage_type': 'backtrace', 'id': 2451820016, 'ino': 1099511635710, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-51.xml'}, {'damage_type': 'backtrace', 'id': 2453303839, 'ino': 1099511635541, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-59.xml'}, {'damage_type': 'backtrace', 'id': 2481287035, 'ino': 1099511635907, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 2484666798, 'ino': 1099511635671, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-78.jpg'}, {'damage_type': 'backtrace', 'id': 2500108689, 'ino': 1099511635953, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 2529030369, 'ino': 1099511635611, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-25.xml'}, {'damage_type': 'backtrace', 'id': 2533364378, 'ino': 1099511635788, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-14.xml'}, {'damage_type': 'backtrace', 'id': 2548613982, 'ino': 1099511635824, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 2578242624, 'ino': 1099511635280, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 2579198025, 'ino': 1099511635746, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-34.xml'}, {'damage_type': 'backtrace', 'id': 2582281956, 'ino': 1099511635874, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 2616526877, 'ino': 1099511635721, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-45.xml'}, {'damage_type': 'backtrace', 'id': 2634278721, 'ino': 1099511635926, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 2637413392, 'ino': 1099511635633, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-14.xml'}, {'damage_type': 'backtrace', 'id': 2648951020, 'ino': 1099511635536, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-61.xml'}, {'damage_type': 'backtrace', 'id': 2650519191, 'ino': 1099511635701, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-56.xml'}, {'damage_type': 'backtrace', 'id': 2651285521, 'ino': 1099511635944, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 2670412688, 'ino': 1099511635823, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 2671723947, 'ino': 1099511635502, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 2673599017, 'ino': 1099511635763, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-26.xml'}, {'damage_type': 'backtrace', 'id': 2677524551, 'ino': 1099511635952, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 2687611938, 'ino': 1099511635336, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 2688467862, 'ino': 1099511635802, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-9.xml'}, {'damage_type': 'backtrace', 'id': 2718544723, 'ino': 1099511635751, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 2750699393, 'ino': 1099511635941, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 2761884899, 'ino': 1099511635932, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 2776987408, 'ino': 1099511635305, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-51.xml'}, {'damage_type': 'backtrace', 'id': 2790213428, 'ino': 1099511635860, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 2793049376, 'ino': 1099511635900, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 2794662459, 'ino': 1099511635822, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-1.xml'}, {'damage_type': 'backtrace', 'id': 2797639791, 'ino': 1099511635819, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-2.xml'}, {'damage_type': 'backtrace', 'id': 2812691328, 'ino': 1099511635396, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-7.xml'}, {'damage_type': 'backtrace', 'id': 2824507438, 'ino': 1099511635302, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 2826464876, 'ino': 1099511635905, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 2879103880, 'ino': 1099511635837, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 2879773629, 'ino': 1099511635919, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 2913633328, 'ino': 1099511635744, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-35.xml'}, {'damage_type': 'backtrace', 'id': 2925668138, 'ino': 1099511635835, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 2929226558, 'ino': 1099511635562, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-48.xml'}, {'damage_type': 'backtrace', 'id': 2930542479, 'ino': 1099511635639, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-11.xml'}, {'damage_type': 'backtrace', 'id': 2943585396, 'ino': 1099511635740, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-37.xml'}, {'damage_type': 'backtrace', 'id': 2944062642, 'ino': 1099511635691, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-60.xml'}, {'damage_type': 'backtrace', 'id': 2953289299, 'ino': 1099511635774, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-21.xml'}, {'damage_type': 'backtrace', 'id': 2954056973, 'ino': 1099511635471, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 2971569173, 'ino': 1099511635933, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-5.xml'}, {'damage_type': 'backtrace', 'id': 2990425652, 'ino': 1099511635791, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-13.xml'}, {'damage_type': 'backtrace', 'id': 2998402556, 'ino': 1099511635956, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 3003260475, 'ino': 1099511635884, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 3007373720, 'ino': 1099511635712, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-50.xml'}, {'damage_type': 'backtrace', 'id': 3009305724, 'ino': 1099511635324, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 3033158244, 'ino': 1099511635625, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-18.xml'}, {'damage_type': 'backtrace', 'id': 3067718740, 'ino': 1099511635759, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-28.xml'}, {'damage_type': 'backtrace', 'id': 3090497215, 'ino': 1099511635738, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-38.xml'}, {'damage_type': 'backtrace', 'id': 3095880726, 'ino': 1099511635780, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-18.xml'}, {'damage_type': 'backtrace', 'id': 3096954307, 'ino': 1099511635963, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 3121246901, 'ino': 1099511635590, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-34.xml'}, {'damage_type': 'backtrace', 'id': 3132881731, 'ino': 1099511635752, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-31.xml'}, {'damage_type': 'backtrace', 'id': 3138695072, 'ino': 1099511635703, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-66.jpg'}, {'damage_type': 'backtrace', 'id': 3139029636, 'ino': 1099511635925, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-7.xml'}, {'damage_type': 'backtrace', 'id': 3142717083, 'ino': 1099511635881, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 3192729720, 'ino': 1099511635836, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 3209374403, 'ino': 1099511635704, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-54.xml'}, {'damage_type': 'backtrace', 'id': 3211677577, 'ino': 1099511635723, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-44.xml'}, {'damage_type': 'backtrace', 'id': 3250256928, 'ino': 1099511635693, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-70.jpg'}, {'damage_type': 'backtrace', 'id': 3259713478, 'ino': 1099511635551, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-54.xml'}, {'damage_type': 'backtrace', 'id': 3263683875, 'ino': 1099511635699, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-57.xml'}, {'damage_type': 'backtrace', 'id': 3266871414, 'ino': 1099511635848, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 3278148484, 'ino': 1099511635880, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 3296441780, 'ino': 1099511635515, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-71.xml'}, {'damage_type': 'backtrace', 'id': 3307967780, 'ino': 1099511635470, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 3318782382, 'ino': 1099511635939, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-3.xml'}, {'damage_type': 'backtrace', 'id': 3320233575, 'ino': 1099511635765, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-25.xml'}, {'damage_type': 'backtrace', 'id': 3324434344, 'ino': 1099511635312, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 3325373490, 'ino': 1099511635816, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 3325580599, 'ino': 1099511635276, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 3331970855, 'ino': 1099511635725, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-43.xml'}, {'damage_type': 'backtrace', 'id': 3344271704, 'ino': 1099511635517, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-70.xml'}, {'damage_type': 'backtrace', 'id': 3359613682, 'ino': 1099511635425, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 3378497665, 'ino': 1099511635753, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 3380646064, 'ino': 1099511635282, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-62.xml'}, {'damage_type': 'backtrace', 'id': 3405740654, 'ino': 1099511635274, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 3422902728, 'ino': 1099511635936, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/article-4.xml'}, {'damage_type': 'backtrace', 'id': 3425860682, 'ino': 1099511635882, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 3426358874, 'ino': 1099511635784, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-16.xml'}, {'damage_type': 'backtrace', 'id': 3451845947, 'ino': 1099511635560, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-49.xml'}, {'damage_type': 'backtrace', 'id': 3455349484, 'ino': 1099511635796, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-11.xml'}, {'damage_type': 'backtrace', 'id': 3482527503, 'ino': 1099511635899, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 3482867637, 'ino': 1099511635236, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 3501559448, 'ino': 1099511635288, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 3504964389, 'ino': 1099511635244, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 3507545140, 'ino': 1099511635742, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-36.xml'}, {'damage_type': 'backtrace', 'id': 3520940096, 'ino': 1099511635319, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 3524018793, 'ino': 1099511634783, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-25/article-77.xml'}, {'damage_type': 'backtrace', 'id': 3552221995, 'ino': 1099511635948, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 3553466558, 'ino': 1099511635873, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-2.xml'}, {'damage_type': 'backtrace', 'id': 3556912153, 'ino': 1099511635727, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-42.xml'}, {'damage_type': 'backtrace', 'id': 3590684289, 'ino': 1099511635724, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 3592459402, 'ino': 1099511635358, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-24.xml'}, {'damage_type': 'backtrace', 'id': 3608417904, 'ino': 1099511635334, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 3617648566, 'ino': 1099511635539, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-60.xml'}, {'damage_type': 'backtrace', 'id': 3628842542, 'ino': 1099511635666, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-80.jpg'}, {'damage_type': 'backtrace', 'id': 3636809336, 'ino': 1099511635960, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-65/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 3648694576, 'ino': 1099511635621, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-20.xml'}, {'damage_type': 'backtrace', 'id': 3657979872, 'ino': 1099511635817, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-3.xml'}, {'damage_type': 'backtrace', 'id': 3668447111, 'ino': 1099511635761, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-27.xml'}, {'damage_type': 'backtrace', 'id': 3678955289, 'ino': 1099511635958, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 3688582080, 'ino': 1099511635950, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 3698692446, 'ino': 1099511635831, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 3734648395, 'ino': 1099511635256, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 3741956831, 'ino': 1099511635696, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-58.xml'}, {'damage_type': 'backtrace', 'id': 3758175641, 'ino': 1099511635652, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-5.xml'}, {'damage_type': 'backtrace', 'id': 3772620694, 'ino': 1099511635326, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 3774375214, 'ino': 1099511635564, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-47.xml'}, {'damage_type': 'backtrace', 'id': 3785147535, 'ino': 1099511635893, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 3785169642, 'ino': 1099511635641, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-10.xml'}, {'damage_type': 'backtrace', 'id': 3794585754, 'ino': 1099511635293, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 3794701777, 'ino': 1099511635556, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-51.xml'}, {'damage_type': 'backtrace', 'id': 3802819988, 'ino': 1099511635877, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 3829148551, 'ino': 1099511635368, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-20.xml'}, {'damage_type': 'backtrace', 'id': 3844406361, 'ino': 1099511635852, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 3846117340, 'ino': 1099511635794, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-12.xml'}, {'damage_type': 'backtrace', 'id': 3851016412, 'ino': 1099511635298, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 3866970432, 'ino': 1099511635912, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 3903662580, 'ino': 1099511635875, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-1.xml'}, {'damage_type': 'backtrace', 'id': 3935190222, 'ino': 1099511635230, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-1.xml'}, {'damage_type': 'backtrace', 'id': 3936676788, 'ino': 1099511635807, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 3936971581, 'ino': 1099511635903, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 3945470858, 'ino': 1099511635955, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 3955740144, 'ino': 1099511635879, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 3960817759, 'ino': 1099511635617, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-22.xml'}, {'damage_type': 'backtrace', 'id': 3962150734, 'ino': 1099511635306, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 3967525177, 'ino': 1099511635406, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-3.xml'}, {'damage_type': 'backtrace', 'id': 3969528496, 'ino': 1099511635304, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 3979433183, 'ino': 1099511635688, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-61.xml'}, {'damage_type': 'backtrace', 'id': 4008947695, 'ino': 1099511635330, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 4016355399, 'ino': 1099511635762, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 4036186965, 'ino': 1099511635264, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 4042115383, 'ino': 1099511635254, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 4053583522, 'ino': 1099511635662, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-82.jpg'}, {'damage_type': 'backtrace', 'id': 4055037534, 'ino': 1099511635818, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 4062894365, 'ino': 1099511635702, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-55.xml'}, {'damage_type': 'backtrace', 'id': 4064336330, 'ino': 1099511635923, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 4076399013, 'ino': 1099511635769, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-23.xml'}, {'damage_type': 'backtrace', 'id': 4097603790, 'ino': 1099511635596, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/article-31.xml'}, {'damage_type': 'backtrace', 'id': 4117875200, 'ino': 1099511635278, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 4127079114, 'ino': 1099511635913, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 4144117217, 'ino': 1099511635250, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 4179556698, 'ino': 1099511635352, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/article-27.xml'}, {'damage_type': 'backtrace', 'id': 4206050696, 'ino': 1099511635713, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 4222623626, 'ino': 1099511635506, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 4240179484, 'ino': 1099511635826, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 4244568500, 'ino': 1099511635750, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-32.xml'}, {'damage_type': 'backtrace', 'id': 4255496986, 'ino': 1099511635776, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-20.xml'}, {'damage_type': 'backtrace', 'id': 4259636184, 'ino': 1099511635813, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-62/article-5.xml'}, {'damage_type': 'backtrace', 'id': 4264012027, 'ino': 1099511635849, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-61/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 4276068719, 'ino': 1099511635496, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-7.jpg'}] 2024-09-19T05:22:33.257 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 9255872, 'ino': 1099511635886, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-29.xml'}, {'damage_type': 'backtrace', 'id': 11755929, 'ino': 1099511635973, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-66.jpg'}, {'damage_type': 'backtrace', 'id': 38064809, 'ino': 1099511636055, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-24.xml'}, {'damage_type': 'backtrace', 'id': 63921766, 'ino': 1099511635992, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 118762432, 'ino': 1099511636025, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-34.xml'}, {'damage_type': 'backtrace', 'id': 138594602, 'ino': 1099511635986, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-62.jpg'}, {'damage_type': 'backtrace', 'id': 195364697, 'ino': 1099511635895, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-26.xml'}, {'damage_type': 'backtrace', 'id': 275180769, 'ino': 1099511636031, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-32.xml'}, {'damage_type': 'backtrace', 'id': 277203963, 'ino': 1099511635998, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-42.xml'}, {'damage_type': 'backtrace', 'id': 348147912, 'ino': 1099511635990, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-44.xml'}, {'damage_type': 'backtrace', 'id': 435455316, 'ino': 1099511635989, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 501139569, 'ino': 1099511635980, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-64.jpg'}, {'damage_type': 'backtrace', 'id': 510975870, 'ino': 1099511635978, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-48.xml'}, {'damage_type': 'backtrace', 'id': 647392547, 'ino': 1099511635959, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-4.xml'}, {'damage_type': 'backtrace', 'id': 652267840, 'ino': 1099511635892, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-27.xml'}, {'damage_type': 'backtrace', 'id': 695942420, 'ino': 1099511635911, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-20.xml'}, {'damage_type': 'backtrace', 'id': 726333116, 'ino': 1099511636045, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 749675290, 'ino': 1099511635962, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-3.xml'}, {'damage_type': 'backtrace', 'id': 755510361, 'ino': 1099511635934, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-13.xml'}, {'damage_type': 'backtrace', 'id': 835114633, 'ino': 1099511636043, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-28.xml'}, {'damage_type': 'backtrace', 'id': 845753443, 'ino': 1099511635943, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-10.xml'}, {'damage_type': 'backtrace', 'id': 868359169, 'ino': 1099511636017, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-36.xml'}, {'damage_type': 'backtrace', 'id': 968788724, 'ino': 1099511636020, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 973105798, 'ino': 1099511635984, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-46.xml'}, {'damage_type': 'backtrace', 'id': 990338973, 'ino': 1099511635914, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-19.xml'}, {'damage_type': 'backtrace', 'id': 1006699031, 'ino': 1099511635967, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-1.xml'}, {'damage_type': 'backtrace', 'id': 1039401575, 'ino': 1099511636064, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 1075097426, 'ino': 1099511635928, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-15.xml'}, {'damage_type': 'backtrace', 'id': 1150268861, 'ino': 1099511636059, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-23.xml'}, {'damage_type': 'backtrace', 'id': 1170269440, 'ino': 1099511635994, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 1204540536, 'ino': 1099511636030, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 1258402083, 'ino': 1099511636067, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 1264475799, 'ino': 1099511635946, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-9.xml'}, {'damage_type': 'backtrace', 'id': 1278182282, 'ino': 1099511635987, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-45.xml'}, {'damage_type': 'backtrace', 'id': 1296488495, 'ino': 1099511635951, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-7.xml'}, {'damage_type': 'backtrace', 'id': 1301433350, 'ino': 1099511636046, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-27.xml'}, {'damage_type': 'backtrace', 'id': 1473361558, 'ino': 1099511635968, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-51.xml'}, {'damage_type': 'backtrace', 'id': 1541003579, 'ino': 1099511635931, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-14.xml'}, {'damage_type': 'backtrace', 'id': 1586626450, 'ino': 1099511636056, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 1737715705, 'ino': 1099511636028, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-33.xml'}, {'damage_type': 'backtrace', 'id': 1756896437, 'ino': 1099511635889, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-28.xml'}, {'damage_type': 'backtrace', 'id': 1757772959, 'ino': 1099511635995, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-43.xml'}, {'damage_type': 'backtrace', 'id': 1802476464, 'ino': 1099511636047, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 1815445813, 'ino': 1099511635940, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-11.xml'}, {'damage_type': 'backtrace', 'id': 1859437033, 'ino': 1099511636021, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-35.xml'}, {'damage_type': 'backtrace', 'id': 1886475159, 'ino': 1099511636006, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 1916759396, 'ino': 1099511635901, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-24.xml'}, {'damage_type': 'backtrace', 'id': 1984266703, 'ino': 1099511635970, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-67.jpg'}, {'damage_type': 'backtrace', 'id': 2004516296, 'ino': 1099511635957, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-5.xml'}, {'damage_type': 'backtrace', 'id': 2010121622, 'ino': 1099511636015, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 2023144583, 'ino': 1099511635909, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-21.xml'}, {'damage_type': 'backtrace', 'id': 2034627491, 'ino': 1099511636052, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-25.xml'}, {'damage_type': 'backtrace', 'id': 2061984236, 'ino': 1099511635981, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-47.xml'}, {'damage_type': 'backtrace', 'id': 2126462266, 'ino': 1099511636010, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 2190774388, 'ino': 1099511636058, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 2280099463, 'ino': 1099511635983, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 2306469190, 'ino': 1099511636061, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 2417479637, 'ino': 1099511636000, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-41.xml'}, {'damage_type': 'backtrace', 'id': 2417982811, 'ino': 1099511635964, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-2.xml'}, {'damage_type': 'backtrace', 'id': 2508023855, 'ino': 1099511636001, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 2514881607, 'ino': 1099511636024, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 2578769072, 'ino': 1099511635954, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-6.xml'}, {'damage_type': 'backtrace', 'id': 2709067020, 'ino': 1099511636053, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 2768273669, 'ino': 1099511636014, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-37.xml'}, {'damage_type': 'backtrace', 'id': 2769796578, 'ino': 1099511635997, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 2816023436, 'ino': 1099511636033, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 2856777650, 'ino': 1099511635920, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-17.xml'}, {'damage_type': 'backtrace', 'id': 2898249422, 'ino': 1099511636034, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-31.xml'}, {'damage_type': 'backtrace', 'id': 3019982436, 'ino': 1099511636068, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-20.xml'}, {'damage_type': 'backtrace', 'id': 3079278371, 'ino': 1099511636041, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 3142404993, 'ino': 1099511636036, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-30.xml'}, {'damage_type': 'backtrace', 'id': 3204770106, 'ino': 1099511635971, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-50.xml'}, {'damage_type': 'backtrace', 'id': 3244600461, 'ino': 1099511636003, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 3356516524, 'ino': 1099511636062, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-22.xml'}, {'damage_type': 'backtrace', 'id': 3373971670, 'ino': 1099511635937, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-12.xml'}, {'damage_type': 'backtrace', 'id': 3480806332, 'ino': 1099511636004, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-40.xml'}, {'damage_type': 'backtrace', 'id': 3530139713, 'ino': 1099511636009, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-38.xml'}, {'damage_type': 'backtrace', 'id': 3561178759, 'ino': 1099511636007, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-39.xml'}, {'damage_type': 'backtrace', 'id': 3576229381, 'ino': 1099511635898, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-25.xml'}, {'damage_type': 'backtrace', 'id': 3642184546, 'ino': 1099511635975, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-49.xml'}, {'damage_type': 'backtrace', 'id': 3735991060, 'ino': 1099511635976, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-65.jpg'}, {'damage_type': 'backtrace', 'id': 3760933153, 'ino': 1099511636040, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-29.xml'}, {'damage_type': 'backtrace', 'id': 3768550779, 'ino': 1099511636049, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-26.xml'}, {'damage_type': 'backtrace', 'id': 3919873532, 'ino': 1099511636065, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-66/article-21.xml'}, {'damage_type': 'backtrace', 'id': 3938503680, 'ino': 1099511636012, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 4000372206, 'ino': 1099511635949, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-8.xml'}, {'damage_type': 'backtrace', 'id': 4010060609, 'ino': 1099511635924, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-16.xml'}, {'damage_type': 'backtrace', 'id': 4031765096, 'ino': 1099511635917, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-18.xml'}, {'damage_type': 'backtrace', 'id': 4037716167, 'ino': 1099511636050, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 4187223915, 'ino': 1099511636038, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 4239093493, 'ino': 1099511635906, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/article-22.xml'}, {'damage_type': 'backtrace', 'id': 4272878620, 'ino': 1099511636027, 'path': '/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-64/picture-49.jpg'}] 2024-09-19T05:22:33.257 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 48, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 70, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 81, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-09-19T05:22:34.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:34 smithi120 ceph-mon[30956]: pgmap v103: 97 pgs: 97 active+clean; 250 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 171 op/s 2024-09-19T05:22:34.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:34 smithi194 ceph-mon[35228]: pgmap v103: 97 pgs: 97 active+clean; 250 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 171 op/s 2024-09-19T05:22:34.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:34 smithi178 ceph-mon[34347]: pgmap v103: 97 pgs: 97 active+clean; 250 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.9 MiB/s wr, 171 op/s 2024-09-19T05:22:36.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:36 smithi120 ceph-mon[30956]: pgmap v104: 97 pgs: 97 active+clean; 262 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 224 op/s 2024-09-19T05:22:36.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:36 smithi194 ceph-mon[35228]: pgmap v104: 97 pgs: 97 active+clean; 262 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 224 op/s 2024-09-19T05:22:36.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:36 smithi178 ceph-mon[34347]: pgmap v104: 97 pgs: 97 active+clean; 262 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.9 MiB/s wr, 224 op/s 2024-09-19T05:22:38.314 INFO:tasks.workunit.client.0.smithi120.stdout: 73 13536 105 8095 112 2584 79 2024-09-19T05:22:38.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.459+0000 7f8229e3c640 1 -- 172.21.15.120:0/2593438904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8224101350 msgr2=0x7f822410d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:38.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.459+0000 7f8229e3c640 1 --2- 172.21.15.120:0/2593438904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8224101350 0x7f822410d880 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f821c009c10 tx=0x7f821c02a6e0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.459+0000 7f8229e3c640 1 -- 172.21.15.120:0/2593438904 shutdown_connections 2024-09-19T05:22:38.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.459+0000 7f8229e3c640 1 --2- 172.21.15.120:0/2593438904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8224101350 0x7f822410d880 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.459+0000 7f8229e3c640 1 --2- 172.21.15.120:0/2593438904 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f82241009b0 0x7f8224100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.459+0000 7f8229e3c640 1 --2- 172.21.15.120:0/2593438904 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82241069c0 0x7f8224106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.459+0000 7f8229e3c640 1 -- 172.21.15.120:0/2593438904 >> 172.21.15.120:0/2593438904 conn(0x7f8224077990 msgr2=0x7f82240fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:38.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.459+0000 7f8229e3c640 1 -- 172.21.15.120:0/2593438904 shutdown_connections 2024-09-19T05:22:38.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.459+0000 7f8229e3c640 1 -- 172.21.15.120:0/2593438904 wait complete. 2024-09-19T05:22:38.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.460+0000 7f8229e3c640 1 Processor -- start 2024-09-19T05:22:38.462 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.460+0000 7f8229e3c640 1 -- start start 2024-09-19T05:22:38.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.460+0000 7f8229e3c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82241009b0 0x7f8224198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:38.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.460+0000 7f8229e3c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8224101350 0x7f8224198790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:38.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.460+0000 7f8229e3c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82241069c0 0x7f822419cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:38.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.460+0000 7f8229e3c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f8224110cb0 con 0x7f8224101350 2024-09-19T05:22:38.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.460+0000 7f8229e3c640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f8224110b30 con 0x7f82241069c0 2024-09-19T05:22:38.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.460+0000 7f8229e3c640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8224110e30 con 0x7f82241009b0 2024-09-19T05:22:38.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.460+0000 7f8222ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8224101350 0x7f8224198790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:38.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.460+0000 7f82237fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82241009b0 0x7f8224198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:38.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.460+0000 7f8222ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8224101350 0x7f8224198790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37626/0 (socket says 172.21.15.120:37626) 2024-09-19T05:22:38.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.460+0000 7f8222ffd640 1 -- 172.21.15.120:0/2769857444 learned_addr learned my addr 172.21.15.120:0/2769857444 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:38.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.460+0000 7f8223fff640 1 --2- 172.21.15.120:0/2769857444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82241069c0 0x7f822419cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:38.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.461+0000 7f82237fe640 1 -- 172.21.15.120:0/2769857444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82241069c0 msgr2=0x7f822419cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:38.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.461+0000 7f82237fe640 1 --2- 172.21.15.120:0/2769857444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82241069c0 0x7f822419cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.461+0000 7f82237fe640 1 -- 172.21.15.120:0/2769857444 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8224101350 msgr2=0x7f8224198790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:38.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.461+0000 7f82237fe640 1 --2- 172.21.15.120:0/2769857444 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8224101350 0x7f8224198790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.461+0000 7f82237fe640 1 -- 172.21.15.120:0/2769857444 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822419d240 con 0x7f82241009b0 2024-09-19T05:22:38.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.461+0000 7f8223fff640 1 --2- 172.21.15.120:0/2769857444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82241069c0 0x7f822419cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:22:38.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.461+0000 7f82237fe640 1 --2- 172.21.15.120:0/2769857444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82241009b0 0x7f8224198250 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f821400e9f0 tx=0x7f821400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:38.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.461+0000 7f8220ff9640 1 -- 172.21.15.120:0/2769857444 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821400ccc0 con 0x7f82241009b0 2024-09-19T05:22:38.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.461+0000 7f8220ff9640 1 -- 172.21.15.120:0/2769857444 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8214005020 con 0x7f82241009b0 2024-09-19T05:22:38.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.461+0000 7f8229e3c640 1 -- 172.21.15.120:0/2769857444 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f822419d530 con 0x7f82241009b0 2024-09-19T05:22:38.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.461+0000 7f8220ff9640 1 -- 172.21.15.120:0/2769857444 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8214004a00 con 0x7f82241009b0 2024-09-19T05:22:38.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.461+0000 7f8229e3c640 1 -- 172.21.15.120:0/2769857444 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82241a4dc0 con 0x7f82241009b0 2024-09-19T05:22:38.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.464+0000 7f8220ff9640 1 -- 172.21.15.120:0/2769857444 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f8214004ba0 con 0x7f82241009b0 2024-09-19T05:22:38.467 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.466+0000 7f822cbd5740 1 Processor -- start 2024-09-19T05:22:38.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.466+0000 7f822cbd5740 1 -- start start 2024-09-19T05:22:38.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.466+0000 7f8220ff9640 1 --2- 172.21.15.120:0/2769857444 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f820c0a78f0 0x7f820c0a9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:38.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.466+0000 7f8223fff640 1 --2- 172.21.15.120:0/2769857444 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f820c0a78f0 0x7f820c0a9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:38.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.466+0000 7f8220ff9640 1 -- 172.21.15.120:0/2769857444 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f82140cfc70 con 0x7f82241009b0 2024-09-19T05:22:38.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.466+0000 7f822cbd5740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634ae6db9d0 0x5634ae6dbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:38.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.467+0000 7f822cbd5740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634ae6dc2f0 0x5634ae6eef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:38.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.467+0000 7f822cbd5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6ef4c0 0x5634ae6f18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.467+0000 7f822cbd5740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5634ae6402f0 con 0x5634ae6db9d0 2024-09-19T05:22:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.467+0000 7f822cbd5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5634ae5e8270 con 0x5634ae6ef4c0 2024-09-19T05:22:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.467+0000 7f822cbd5740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5634ae63c2b0 con 0x5634ae6dc2f0 2024-09-19T05:22:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.467+0000 7f8223fff640 1 --2- 172.21.15.120:0/2769857444 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f820c0a78f0 0x7f820c0a9db0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f821c02ac00 tx=0x7f821c009840 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.467+0000 7f8223fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6ef4c0 0x5634ae6f18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.467+0000 7f8223fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6ef4c0 0x5634ae6f18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:41448/0 (socket says 172.21.15.120:41448) 2024-09-19T05:22:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.467+0000 7f8223fff640 1 -- 172.21.15.120:0/2823435014 learned_addr learned my addr 172.21.15.120:0/2823435014 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.467+0000 7f82237fe640 1 --2- 172.21.15.120:0/2823435014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634ae6db9d0 0x5634ae6dbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.467+0000 7f8222ffd640 1 --2- 172.21.15.120:0/2823435014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634ae6dc2f0 0x5634ae6eef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.467+0000 7f8223fff640 1 -- 172.21.15.120:0/2823435014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634ae6dc2f0 msgr2=0x5634ae6eef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.467+0000 7f8223fff640 1 --2- 172.21.15.120:0/2823435014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634ae6dc2f0 0x5634ae6eef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.467+0000 7f8223fff640 1 -- 172.21.15.120:0/2823435014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634ae6db9d0 msgr2=0x5634ae6dbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.467+0000 7f8223fff640 1 --2- 172.21.15.120:0/2823435014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634ae6db9d0 0x5634ae6dbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.471 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.467+0000 7f8223fff640 1 -- 172.21.15.120:0/2823435014 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634ae5e7340 con 0x5634ae6ef4c0 2024-09-19T05:22:38.471 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.468+0000 7f8223fff640 1 --2- 172.21.15.120:0/2823435014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6ef4c0 0x5634ae6f18b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f821c033000 tx=0x7f821c03c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ef34cd632a7c3f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.468+0000 7f82237fe640 1 --2- 172.21.15.120:0/2823435014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634ae6db9d0 0x5634ae6dbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:22:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.468+0000 7f8209ffb640 1 -- 172.21.15.120:0/2823435014 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c042070 con 0x5634ae6ef4c0 2024-09-19T05:22:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.468+0000 7f8209ffb640 1 -- 172.21.15.120:0/2823435014 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f821c04e070 con 0x5634ae6ef4c0 2024-09-19T05:22:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.468+0000 7f8209ffb640 1 -- 172.21.15.120:0/2823435014 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c036050 con 0x5634ae6ef4c0 2024-09-19T05:22:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.469+0000 7f822cbd5740 1 -- 172.21.15.120:0/2823435014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6ef4c0 msgr2=0x5634ae6f18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.469+0000 7f822cbd5740 1 --2- 172.21.15.120:0/2823435014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6ef4c0 0x5634ae6f18b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f821c033000 tx=0x7f821c03c000 comp rx=0 tx=0).stop 2024-09-19T05:22:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.470+0000 7f822cbd5740 1 -- 172.21.15.120:0/2823435014 shutdown_connections 2024-09-19T05:22:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.470+0000 7f822cbd5740 1 --2- 172.21.15.120:0/2823435014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6ef4c0 0x5634ae6f18b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.470+0000 7f822cbd5740 1 --2- 172.21.15.120:0/2823435014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634ae6dc2f0 0x5634ae6eef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.470+0000 7f822cbd5740 1 --2- 172.21.15.120:0/2823435014 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634ae6db9d0 0x5634ae6dbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.470+0000 7f822cbd5740 1 -- 172.21.15.120:0/2823435014 >> 172.21.15.120:0/2823435014 conn(0x5634ae6d8060 msgr2=0x5634ae6d8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.470+0000 7f822cbd5740 1 -- 172.21.15.120:0/2823435014 shutdown_connections 2024-09-19T05:22:38.473 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.470+0000 7f822cbd5740 1 -- 172.21.15.120:0/2823435014 wait complete. 2024-09-19T05:22:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.470+0000 7f822cbd5740 1 -- start start 2024-09-19T05:22:38.477 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.471+0000 7f822cbd5740 1 Processor -- start 2024-09-19T05:22:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.471+0000 7f822cbd5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6db9d0 0x5634ae6ec4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:38.478 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.471+0000 7f822cbd5740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634ae6dc2f0 0x5634ae6ec9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.471+0000 7f822cbd5740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634ae6ef4c0 0x5634ae6ecf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.471+0000 7f822cbd5740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5634ae6f2090 con 0x5634ae6dc2f0 2024-09-19T05:22:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.471+0000 7f822cbd5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5634ae5c9290 con 0x5634ae6db9d0 2024-09-19T05:22:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.471+0000 7f822cbd5740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5634ae6f2210 con 0x5634ae6ef4c0 2024-09-19T05:22:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.471+0000 7f82237fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6db9d0 0x5634ae6ec4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.471+0000 7f82237fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6db9d0 0x5634ae6ec4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:41464/0 (socket says 172.21.15.120:41464) 2024-09-19T05:22:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.471+0000 7f82237fe640 1 -- 172.21.15.120:0/4067666750 learned_addr learned my addr 172.21.15.120:0/4067666750 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.471+0000 7f822cbd5740 10 client.0 _ll_register_callbacks cb 0x5634ae5fa140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:22:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.471+0000 7f8223fff640 1 --2- 172.21.15.120:0/4067666750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634ae6ef4c0 0x5634ae6ecf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.472+0000 7f8222ffd640 1 --2- 172.21.15.120:0/4067666750 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634ae6dc2f0 0x5634ae6ec9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:38.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.472+0000 7f8223fff640 1 -- 172.21.15.120:0/4067666750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6db9d0 msgr2=0x5634ae6ec4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:38.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.472+0000 7f8223fff640 1 --2- 172.21.15.120:0/4067666750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6db9d0 0x5634ae6ec4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.472+0000 7f8223fff640 1 -- 172.21.15.120:0/4067666750 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634ae6dc2f0 msgr2=0x5634ae6ec9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:38.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.472+0000 7f8223fff640 1 --2- 172.21.15.120:0/4067666750 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634ae6dc2f0 0x5634ae6ec9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.472+0000 7f8223fff640 1 -- 172.21.15.120:0/4067666750 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634ae353210 con 0x5634ae6ef4c0 2024-09-19T05:22:38.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.472+0000 7f82237fe640 1 --2- 172.21.15.120:0/4067666750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6db9d0 0x5634ae6ec4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:38.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.472+0000 7f8222ffd640 1 --2- 172.21.15.120:0/4067666750 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634ae6dc2f0 0x5634ae6ec9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:22:38.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.472+0000 7f8223fff640 1 --2- 172.21.15.120:0/4067666750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634ae6ef4c0 0x5634ae6ecf20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x5634ae6d93e0 tx=0x7f821c009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=266d8bbd2a2dcd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:38.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.472+0000 7f8202ffd640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:22:38.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.472+0000 7f8202ffd640 1 -- 172.21.15.120:0/4067666750 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c036070 con 0x5634ae6ef4c0 2024-09-19T05:22:38.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.472+0000 7f822cbd5740 1 -- 172.21.15.120:0/4067666750 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f821c04e070 con 0x5634ae6ef4c0 2024-09-19T05:22:38.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.472+0000 7f8202ffd640 1 -- 172.21.15.120:0/4067666750 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f821c049470 con 0x5634ae6ef4c0 2024-09-19T05:22:38.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.473+0000 7f8202ffd640 1 -- 172.21.15.120:0/4067666750 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f821c061050 con 0x5634ae6ef4c0 2024-09-19T05:22:38.480 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.473+0000 7f822cbd5740 10 client.25531 fetch_fsmap learned FSMap version 29 2024-09-19T05:22:38.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.473+0000 7f822cbd5740 1 -- 172.21.15.120:0/4067666750 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5634ae41f620 con 0x5634ae6ef4c0 2024-09-19T05:22:38.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.473+0000 7f8202ffd640 1 -- 172.21.15.120:0/4067666750 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f821c04e070 con 0x5634ae6ef4c0 2024-09-19T05:22:38.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.473+0000 7f8202ffd640 1 -- 172.21.15.120:0/4067666750 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f821c031440 con 0x5634ae6ef4c0 2024-09-19T05:22:38.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.473+0000 7f822cbd5740 10 client.25531 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:22:38.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.473+0000 7f822cbd5740 10 client.25531 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:22:38.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.473+0000 7f822cbd5740 20 client.25531 populate_metadata read hostname 'smithi120' 2024-09-19T05:22:38.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.473+0000 7f822cbd5740 1 --2- 172.21.15.120:0/4067666750 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5634ae6ff390 0x5634ae701780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:38.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.473+0000 7f822cbd5740 4 client.25531 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:22:38.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.473+0000 7f822cbd5740 1 -- 172.21.15.120:0/4067666750 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634ae64da20 con 0x5634ae6ff390 2024-09-19T05:22:38.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.473+0000 7f82237fe640 1 --2- 172.21.15.120:0/4067666750 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5634ae6ff390 0x5634ae701780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:38.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.474+0000 7f8202ffd640 10 client.25531 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:22:38.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.474+0000 7f82237fe640 1 --2- 172.21.15.120:0/4067666750 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5634ae6ff390 0x5634ae701780 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94f1e3b8d575e2cd server_cookie=32e54f580de3aef1 in_seq=0 out_seq=0 2024-09-19T05:22:38.481 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.474+0000 7f8202ffd640 1 -- 172.21.15.120:0/4067666750 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5634ae64da20 con 0x5634ae6ff390 2024-09-19T05:22:38.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.475+0000 7f8202ffd640 10 client.25531 handle_command_reply: tid=0 2024-09-19T05:22:38.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.475+0000 7f822cbd5740 1 client.25531 shutdown 2024-09-19T05:22:38.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.475+0000 7f822cbd5740 1 -- 172.21.15.120:0/4067666750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634ae6ef4c0 msgr2=0x5634ae6ecf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:38.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.475+0000 7f822cbd5740 1 --2- 172.21.15.120:0/4067666750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634ae6ef4c0 0x5634ae6ecf20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x5634ae6d93e0 tx=0x7f821c009500 comp rx=0 tx=0).stop 2024-09-19T05:22:38.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.475+0000 7f822cbd5740 1 -- 172.21.15.120:0/4067666750 shutdown_connections 2024-09-19T05:22:38.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.475+0000 7f822cbd5740 1 --2- 172.21.15.120:0/4067666750 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5634ae6ff390 0x5634ae701780 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.475+0000 7f822cbd5740 1 --2- 172.21.15.120:0/4067666750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634ae6ef4c0 0x5634ae6ecf20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.475+0000 7f822cbd5740 1 --2- 172.21.15.120:0/4067666750 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634ae6dc2f0 0x5634ae6ec9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.475+0000 7f822cbd5740 1 --2- 172.21.15.120:0/4067666750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6db9d0 0x5634ae6ec4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.475+0000 7f822cbd5740 1 -- 172.21.15.120:0/4067666750 >> 172.21.15.120:0/4067666750 conn(0x5634ae6d8060 msgr2=0x5634ae6dddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:38.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.475+0000 7f8202ffd640 0 client.25531 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:22:38.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.475+0000 7f822cbd5740 1 -- 172.21.15.120:0/4067666750 shutdown_connections 2024-09-19T05:22:38.482 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.475+0000 7f822cbd5740 1 -- 172.21.15.120:0/4067666750 wait complete. 2024-09-19T05:22:38.483 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.475+0000 7f822cbd5740 20 client.25531 trim_cache size 0 max 16384 2024-09-19T05:22:38.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.495+0000 7f822cbd5740 1 Processor -- start 2024-09-19T05:22:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.495+0000 7f822cbd5740 1 -- start start 2024-09-19T05:22:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.496+0000 7f822cbd5740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634ae6db9d0 0x5634ae706d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.496+0000 7f822cbd5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6dc2f0 0x5634ae7072c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.496+0000 7f822cbd5740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634ae6ef4c0 0x5634ae6e96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.496+0000 7f822cbd5740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f82241adf50 con 0x5634ae6db9d0 2024-09-19T05:22:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.496+0000 7f822cbd5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f82241ab820 con 0x5634ae6dc2f0 2024-09-19T05:22:38.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.496+0000 7f822cbd5740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f82241a9670 con 0x5634ae6ef4c0 2024-09-19T05:22:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.496+0000 7f82237fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634ae6db9d0 0x5634ae706d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.496+0000 7f82237fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634ae6db9d0 0x5634ae706d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:37654/0 (socket says 172.21.15.120:37654) 2024-09-19T05:22:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.496+0000 7f82237fe640 1 -- 172.21.15.120:0/2418256688 learned_addr learned my addr 172.21.15.120:0/2418256688 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.496+0000 7f8222ffd640 1 --2- 172.21.15.120:0/2418256688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6dc2f0 0x5634ae7072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.496+0000 7f8223fff640 1 --2- 172.21.15.120:0/2418256688 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634ae6ef4c0 0x5634ae6e96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.496+0000 7f82237fe640 1 -- 172.21.15.120:0/2418256688 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634ae6ef4c0 msgr2=0x5634ae6e96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.496+0000 7f82237fe640 1 --2- 172.21.15.120:0/2418256688 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634ae6ef4c0 0x5634ae6e96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.496+0000 7f82237fe640 1 -- 172.21.15.120:0/2418256688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6dc2f0 msgr2=0x5634ae7072c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.496+0000 7f82237fe640 1 --2- 172.21.15.120:0/2418256688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6dc2f0 0x5634ae7072c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.501 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.496+0000 7f82237fe640 1 -- 172.21.15.120:0/2418256688 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634ae6f21b0 con 0x5634ae6db9d0 2024-09-19T05:22:38.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.497+0000 7f82237fe640 1 --2- 172.21.15.120:0/2418256688 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634ae6db9d0 0x5634ae706d80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f82140cd970 tx=0x7f82140bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df053ffc274b8c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:38.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.497+0000 7f82097fa640 1 -- 172.21.15.120:0/2418256688 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821401c040 con 0x5634ae6db9d0 2024-09-19T05:22:38.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.497+0000 7f82097fa640 1 -- 172.21.15.120:0/2418256688 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f82140a02b0 con 0x5634ae6db9d0 2024-09-19T05:22:38.502 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.497+0000 7f82097fa640 1 -- 172.21.15.120:0/2418256688 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8214098570 con 0x5634ae6db9d0 2024-09-19T05:22:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.498+0000 7f822cbd5740 1 -- 172.21.15.120:0/2418256688 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634ae6db9d0 msgr2=0x5634ae706d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.498+0000 7f822cbd5740 1 --2- 172.21.15.120:0/2418256688 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634ae6db9d0 0x5634ae706d80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f82140cd970 tx=0x7f82140bc040 comp rx=0 tx=0).stop 2024-09-19T05:22:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.498+0000 7f822cbd5740 1 -- 172.21.15.120:0/2418256688 shutdown_connections 2024-09-19T05:22:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.498+0000 7f822cbd5740 1 --2- 172.21.15.120:0/2418256688 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634ae6ef4c0 0x5634ae6e96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.498+0000 7f822cbd5740 1 --2- 172.21.15.120:0/2418256688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6dc2f0 0x5634ae7072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.498+0000 7f822cbd5740 1 --2- 172.21.15.120:0/2418256688 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634ae6db9d0 0x5634ae706d80 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.498+0000 7f822cbd5740 1 -- 172.21.15.120:0/2418256688 >> 172.21.15.120:0/2418256688 conn(0x5634ae6d8060 msgr2=0x5634ae6d8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.498+0000 7f822cbd5740 1 -- 172.21.15.120:0/2418256688 shutdown_connections 2024-09-19T05:22:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.498+0000 7f822cbd5740 1 -- 172.21.15.120:0/2418256688 wait complete. 2024-09-19T05:22:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.498+0000 7f822cbd5740 1 -- start start 2024-09-19T05:22:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.498+0000 7f822cbd5740 1 Processor -- start 2024-09-19T05:22:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.499+0000 7f822cbd5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6dc2f0 0x5634ae6f2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.499+0000 7f822cbd5740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634ae6ef4c0 0x5634ae6f2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.499+0000 7f822cbd5740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634ae761d10 0x5634ae762190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.499+0000 7f822cbd5740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f82241a9ce0 con 0x5634ae761d10 2024-09-19T05:22:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.499+0000 7f822cbd5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f82241ab150 con 0x5634ae6dc2f0 2024-09-19T05:22:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.499+0000 7f822cbd5740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f82241aa3b0 con 0x5634ae6ef4c0 2024-09-19T05:22:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.499+0000 7f822cbd5740 10 client.0 _ll_register_callbacks cb 0x7f8218005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:22:38.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.499+0000 7f82237fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6dc2f0 0x5634ae6f2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.499+0000 7f8222ffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634ae6ef4c0 0x5634ae6f2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.499+0000 7f82237fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6dc2f0 0x5634ae6f2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:41496/0 (socket says 172.21.15.120:41496) 2024-09-19T05:22:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.499+0000 7f8222ffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634ae6ef4c0 0x5634ae6f2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:33500/0 (socket says 172.21.15.120:33500) 2024-09-19T05:22:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.499+0000 7f82237fe640 1 -- 172.21.15.120:0/2857185596 learned_addr learned my addr 172.21.15.120:0/2857185596 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.499+0000 7f8223fff640 1 --2- 172.21.15.120:0/2857185596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634ae761d10 0x5634ae762190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.499+0000 7f8222ffd640 1 -- 172.21.15.120:0/2857185596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6dc2f0 msgr2=0x5634ae6f2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.499+0000 7f8222ffd640 1 --2- 172.21.15.120:0/2857185596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6dc2f0 0x5634ae6f2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.499+0000 7f8222ffd640 1 -- 172.21.15.120:0/2857185596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634ae761d10 msgr2=0x5634ae762190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.499+0000 7f8222ffd640 1 --2- 172.21.15.120:0/2857185596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634ae761d10 0x5634ae762190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.499+0000 7f8222ffd640 1 -- 172.21.15.120:0/2857185596 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634ae7626d0 con 0x5634ae6ef4c0 2024-09-19T05:22:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.499+0000 7f82237fe640 1 --2- 172.21.15.120:0/2857185596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6dc2f0 0x5634ae6f2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.499+0000 7f8223fff640 1 --2- 172.21.15.120:0/2857185596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634ae761d10 0x5634ae762190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:38.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.500+0000 7f8222ffd640 1 --2- 172.21.15.120:0/2857185596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634ae6ef4c0 0x5634ae6f2f40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x5634ae6edae0 tx=0x7f8218010bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=434ccde64191821d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.500+0000 7f8202ffd640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:22:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.500+0000 7f8202ffd640 1 -- 172.21.15.120:0/2857185596 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218022060 con 0x5634ae6ef4c0 2024-09-19T05:22:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.500+0000 7f8202ffd640 1 -- 172.21.15.120:0/2857185596 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f8218004460 con 0x5634ae6ef4c0 2024-09-19T05:22:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.500+0000 7f822cbd5740 1 -- 172.21.15.120:0/2857185596 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82140a02b0 con 0x5634ae6ef4c0 2024-09-19T05:22:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.500+0000 7f8202ffd640 1 -- 172.21.15.120:0/2857185596 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f821800f8f0 con 0x5634ae6ef4c0 2024-09-19T05:22:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.500+0000 7f822cbd5740 10 client.25537 fetch_fsmap learned FSMap version 29 2024-09-19T05:22:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.500+0000 7f822cbd5740 1 -- 172.21.15.120:0/2857185596 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5634ae769ac0 con 0x5634ae6ef4c0 2024-09-19T05:22:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.500+0000 7f8202ffd640 1 -- 172.21.15.120:0/2857185596 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f82140a02b0 con 0x5634ae6ef4c0 2024-09-19T05:22:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.500+0000 7f8202ffd640 1 -- 172.21.15.120:0/2857185596 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f821801d410 con 0x5634ae6ef4c0 2024-09-19T05:22:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.500+0000 7f822cbd5740 10 client.25537 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:22:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.500+0000 7f822cbd5740 10 client.25537 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:22:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.500+0000 7f822cbd5740 20 client.25537 populate_metadata read hostname 'smithi120' 2024-09-19T05:22:38.508 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.501+0000 7f822cbd5740 1 --2- 172.21.15.120:0/2857185596 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5634ae76a200 0x5634ae76c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.501+0000 7f822cbd5740 4 client.25537 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:22:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.501+0000 7f822cbd5740 1 -- 172.21.15.120:0/2857185596 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5634ae647d70 con 0x5634ae76a200 2024-09-19T05:22:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.501+0000 7f82237fe640 1 --2- 172.21.15.120:0/2857185596 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5634ae76a200 0x5634ae76c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.501+0000 7f82237fe640 1 --2- 172.21.15.120:0/2857185596 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5634ae76a200 0x5634ae76c620 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c95b91af90084a43 server_cookie=34c412849627e139 in_seq=0 out_seq=0 2024-09-19T05:22:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.501+0000 7f8202ffd640 10 client.25537 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:22:38.637 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.635+0000 7f8202ffd640 1 -- 172.21.15.120:0/2857185596 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5634ae647d70 con 0x5634ae76a200 2024-09-19T05:22:38.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.635+0000 7f8202ffd640 10 client.25537 handle_command_reply: tid=0 2024-09-19T05:22:38.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.635+0000 7f822cbd5740 1 client.25537 shutdown 2024-09-19T05:22:38.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.635+0000 7f822cbd5740 1 -- 172.21.15.120:0/2857185596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634ae6ef4c0 msgr2=0x5634ae6f2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:38.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.635+0000 7f822cbd5740 1 --2- 172.21.15.120:0/2857185596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634ae6ef4c0 0x5634ae6f2f40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x5634ae6edae0 tx=0x7f8218010bb0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.635+0000 7f822cbd5740 1 -- 172.21.15.120:0/2857185596 shutdown_connections 2024-09-19T05:22:38.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.635+0000 7f822cbd5740 1 --2- 172.21.15.120:0/2857185596 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5634ae761d10 0x5634ae762190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.635+0000 7f822cbd5740 1 --2- 172.21.15.120:0/2857185596 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5634ae76a200 0x5634ae76c620 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.635+0000 7f822cbd5740 1 --2- 172.21.15.120:0/2857185596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634ae6ef4c0 0x5634ae6f2f40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.638 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.635+0000 7f822cbd5740 1 --2- 172.21.15.120:0/2857185596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5634ae6dc2f0 0x5634ae6f2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.635+0000 7f822cbd5740 1 -- 172.21.15.120:0/2857185596 >> 172.21.15.120:0/2857185596 conn(0x5634ae6d8060 msgr2=0x5634ae6ec460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:38.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.635+0000 7f8202ffd640 0 client.25537 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:22:38.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.635+0000 7f822cbd5740 1 -- 172.21.15.120:0/2857185596 shutdown_connections 2024-09-19T05:22:38.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.635+0000 7f822cbd5740 1 -- 172.21.15.120:0/2857185596 wait complete. 2024-09-19T05:22:38.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.635+0000 7f822cbd5740 20 client.25537 trim_cache size 0 max 16384 2024-09-19T05:22:38.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:22:38.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:22:38.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:22:38.639 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:22:38.642 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.636+0000 7f8229e3c640 1 -- 172.21.15.120:0/2769857444 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f820c0a78f0 msgr2=0x7f820c0a9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:38.642 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.636+0000 7f8229e3c640 1 --2- 172.21.15.120:0/2769857444 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f820c0a78f0 0x7f820c0a9db0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f821c02ac00 tx=0x7f821c009840 comp rx=0 tx=0).stop 2024-09-19T05:22:38.642 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.637+0000 7f8229e3c640 1 -- 172.21.15.120:0/2769857444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82241009b0 msgr2=0x7f8224198250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:38.642 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.637+0000 7f8229e3c640 1 --2- 172.21.15.120:0/2769857444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82241009b0 0x7f8224198250 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f821400e9f0 tx=0x7f821400eeb0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.642 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.637+0000 7f8229e3c640 1 -- 172.21.15.120:0/2769857444 shutdown_connections 2024-09-19T05:22:38.642 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.637+0000 7f8229e3c640 1 --2- 172.21.15.120:0/2769857444 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f820c0a78f0 0x7f820c0a9db0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.642 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.637+0000 7f8229e3c640 1 --2- 172.21.15.120:0/2769857444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82241069c0 0x7f822419cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.642 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.637+0000 7f8229e3c640 1 --2- 172.21.15.120:0/2769857444 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8224101350 0x7f8224198790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.642 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.637+0000 7f8229e3c640 1 --2- 172.21.15.120:0/2769857444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82241009b0 0x7f8224198250 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.637+0000 7f8229e3c640 1 -- 172.21.15.120:0/2769857444 >> 172.21.15.120:0/2769857444 conn(0x7f8224077990 msgr2=0x7f82240699e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.637+0000 7f8229e3c640 1 -- 172.21.15.120:0/2769857444 shutdown_connections 2024-09-19T05:22:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:38.637+0000 7f8229e3c640 1 -- 172.21.15.120:0/2769857444 wait complete. 2024-09-19T05:22:38.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:38 smithi120 ceph-mon[30956]: pgmap v105: 97 pgs: 97 active+clean; 262 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 113 op/s 2024-09-19T05:22:38.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:38 smithi194 ceph-mon[35228]: pgmap v105: 97 pgs: 97 active+clean; 262 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 113 op/s 2024-09-19T05:22:38.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:38 smithi178 ceph-mon[34347]: pgmap v105: 97 pgs: 97 active+clean; 262 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.9 MiB/s wr, 113 op/s 2024-09-19T05:22:40.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:40 smithi120 ceph-mon[30956]: pgmap v106: 97 pgs: 97 active+clean; 262 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 233 op/s 2024-09-19T05:22:40.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:40 smithi194 ceph-mon[35228]: pgmap v106: 97 pgs: 97 active+clean; 262 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 233 op/s 2024-09-19T05:22:40.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:40 smithi178 ceph-mon[34347]: pgmap v106: 97 pgs: 97 active+clean; 262 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 233 op/s 2024-09-19T05:22:42.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:42 smithi120 ceph-mon[30956]: pgmap v107: 97 pgs: 97 active+clean; 262 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 173 op/s 2024-09-19T05:22:42.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:42 smithi194 ceph-mon[35228]: pgmap v107: 97 pgs: 97 active+clean; 262 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 173 op/s 2024-09-19T05:22:42.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:42 smithi178 ceph-mon[34347]: pgmap v107: 97 pgs: 97 active+clean; 262 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 173 op/s 2024-09-19T05:22:44.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:44 smithi120 ceph-mon[30956]: pgmap v108: 97 pgs: 97 active+clean; 262 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 173 op/s 2024-09-19T05:22:44.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:44 smithi194 ceph-mon[35228]: pgmap v108: 97 pgs: 97 active+clean; 262 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 173 op/s 2024-09-19T05:22:44.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:44 smithi178 ceph-mon[34347]: pgmap v108: 97 pgs: 97 active+clean; 262 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 173 op/s 2024-09-19T05:22:46.707 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:46 smithi194 ceph-mon[35228]: pgmap v109: 97 pgs: 97 active+clean; 275 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 233 op/s 2024-09-19T05:22:46.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:46 smithi120 ceph-mon[30956]: pgmap v109: 97 pgs: 97 active+clean; 275 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 233 op/s 2024-09-19T05:22:46.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:46 smithi178 ceph-mon[34347]: pgmap v109: 97 pgs: 97 active+clean; 275 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 233 op/s 2024-09-19T05:22:48.314 INFO:tasks.workunit.client.0.smithi120.stdout: 74 13317 71 8242 109 3670 120 2024-09-19T05:22:48.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:48 smithi120 ceph-mon[30956]: pgmap v110: 97 pgs: 97 active+clean; 275 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 179 op/s 2024-09-19T05:22:48.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:48 smithi194 ceph-mon[35228]: pgmap v110: 97 pgs: 97 active+clean; 275 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 179 op/s 2024-09-19T05:22:48.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:48 smithi178 ceph-mon[34347]: pgmap v110: 97 pgs: 97 active+clean; 275 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 179 op/s 2024-09-19T05:22:50.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:50 smithi120 ceph-mon[30956]: pgmap v111: 97 pgs: 97 active+clean; 287 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 248 op/s 2024-09-19T05:22:50.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:50 smithi194 ceph-mon[35228]: pgmap v111: 97 pgs: 97 active+clean; 287 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 248 op/s 2024-09-19T05:22:50.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:50 smithi178 ceph-mon[34347]: pgmap v111: 97 pgs: 97 active+clean; 287 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 248 op/s 2024-09-19T05:22:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.765+0000 7f6a975b0640 1 -- 172.21.15.120:0/3814233790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a901009b0 msgr2=0x7f6a90100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.765+0000 7f6a975b0640 1 --2- 172.21.15.120:0/3814233790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a901009b0 0x7f6a90100e10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6a84009cd0 tx=0x7f6a8402a8e0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.765+0000 7f6a975b0640 1 -- 172.21.15.120:0/3814233790 shutdown_connections 2024-09-19T05:22:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.765+0000 7f6a975b0640 1 --2- 172.21.15.120:0/3814233790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a90101350 0x7f6a9010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.765+0000 7f6a975b0640 1 --2- 172.21.15.120:0/3814233790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a901009b0 0x7f6a90100e10 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.768 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.765+0000 7f6a975b0640 1 --2- 172.21.15.120:0/3814233790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a901069c0 0x7f6a90106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.769 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.765+0000 7f6a975b0640 1 -- 172.21.15.120:0/3814233790 >> 172.21.15.120:0/3814233790 conn(0x7f6a90077990 msgr2=0x7f6a900fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:51.769 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.766+0000 7f6a975b0640 1 -- 172.21.15.120:0/3814233790 shutdown_connections 2024-09-19T05:22:51.769 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.766+0000 7f6a975b0640 1 -- 172.21.15.120:0/3814233790 wait complete. 2024-09-19T05:22:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.766+0000 7f6a975b0640 1 Processor -- start 2024-09-19T05:22:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.766+0000 7f6a975b0640 1 -- start start 2024-09-19T05:22:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.767+0000 7f6a975b0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a901009b0 0x7f6a90199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.767+0000 7f6a975b0640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a90101350 0x7f6a90199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.767+0000 7f6a975b0640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a901069c0 0x7f6a901a41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.767+0000 7f6a975b0640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6a90110c70 con 0x7f6a901009b0 2024-09-19T05:22:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.767+0000 7f6a975b0640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6a90110af0 con 0x7f6a90101350 2024-09-19T05:22:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.767+0000 7f6a975b0640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6a90110df0 con 0x7f6a901069c0 2024-09-19T05:22:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.767+0000 7f6a9534c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a901009b0 0x7f6a90199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.767+0000 7f6a9534c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a901009b0 0x7f6a90199120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53784/0 (socket says 172.21.15.120:53784) 2024-09-19T05:22:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.767+0000 7f6a9534c640 1 -- 172.21.15.120:0/1140089302 learned_addr learned my addr 172.21.15.120:0/1140089302 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:51.771 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.767+0000 7f6a95b4d640 1 --2- 172.21.15.120:0/1140089302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a901069c0 0x7f6a901a41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:51.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.767+0000 7f6a94b4b640 1 --2- 172.21.15.120:0/1140089302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a90101350 0x7f6a90199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:51.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.767+0000 7f6a9534c640 1 -- 172.21.15.120:0/1140089302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a901069c0 msgr2=0x7f6a901a41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:51.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.767+0000 7f6a9534c640 1 --2- 172.21.15.120:0/1140089302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a901069c0 0x7f6a901a41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.767+0000 7f6a9534c640 1 -- 172.21.15.120:0/1140089302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a90101350 msgr2=0x7f6a90199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:51.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.767+0000 7f6a9534c640 1 --2- 172.21.15.120:0/1140089302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a90101350 0x7f6a90199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.767+0000 7f6a9534c640 1 -- 172.21.15.120:0/1140089302 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a901a46e0 con 0x7f6a901009b0 2024-09-19T05:22:51.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.767+0000 7f6a9534c640 1 --2- 172.21.15.120:0/1140089302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a901009b0 0x7f6a90199120 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800e9f0 tx=0x7f6a8800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:51.773 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.767+0000 7f6a8e7fc640 1 -- 172.21.15.120:0/1140089302 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8800cd80 con 0x7f6a901009b0 2024-09-19T05:22:51.773 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.767+0000 7f6a8e7fc640 1 -- 172.21.15.120:0/1140089302 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a880108e0 con 0x7f6a901009b0 2024-09-19T05:22:51.773 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.767+0000 7f6a8e7fc640 1 -- 172.21.15.120:0/1140089302 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a88018920 con 0x7f6a901009b0 2024-09-19T05:22:51.773 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.767+0000 7f6a975b0640 1 -- 172.21.15.120:0/1140089302 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a901a48b0 con 0x7f6a901009b0 2024-09-19T05:22:51.773 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.768+0000 7f6a975b0640 1 -- 172.21.15.120:0/1140089302 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a901a4d80 con 0x7f6a901009b0 2024-09-19T05:22:51.774 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.771+0000 7f6a8e7fc640 1 -- 172.21.15.120:0/1140089302 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f6a88010a90 con 0x7f6a901009b0 2024-09-19T05:22:51.774 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.771+0000 7f6a9a425740 1 Processor -- start 2024-09-19T05:22:51.774 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.771+0000 7f6a9a425740 1 -- start start 2024-09-19T05:22:51.774 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.771+0000 7f6a9a425740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6eaf0 0x5604b5b6eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:51.774 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.771+0000 7f6a9a425740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5604b5b6f410 0x5604b5b79770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:51.774 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.771+0000 7f6a9a425740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5604b5b79cb0 0x5604b5b7c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.771+0000 7f6a9a425740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5604b5ad32f0 con 0x5604b5b6f410 2024-09-19T05:22:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.771+0000 7f6a9a425740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5604b5a7b270 con 0x5604b5b79cb0 2024-09-19T05:22:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.771+0000 7f6a9a425740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5604b5acf2b0 con 0x5604b5b6eaf0 2024-09-19T05:22:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.772+0000 7f6a95b4d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6eaf0 0x5604b5b6eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.772+0000 7f6a95b4d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6eaf0 0x5604b5b6eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:41000/0 (socket says 172.21.15.120:41000) 2024-09-19T05:22:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.772+0000 7f6a95b4d640 1 -- 172.21.15.120:0/329285057 learned_addr learned my addr 172.21.15.120:0/329285057 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.772+0000 7f6a94b4b640 1 --2- 172.21.15.120:0/329285057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5604b5b79cb0 0x5604b5b7c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.772+0000 7f6a9534c640 1 --2- 172.21.15.120:0/329285057 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5604b5b6f410 0x5604b5b79770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.772+0000 7f6a95b4d640 1 -- 172.21.15.120:0/329285057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5604b5b79cb0 msgr2=0x5604b5b7c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.772+0000 7f6a8e7fc640 1 --2- 172.21.15.120:0/1140089302 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f6a780a3460 0x7f6a780a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.772+0000 7f6a95b4d640 1 --2- 172.21.15.120:0/329285057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5604b5b79cb0 0x5604b5b7c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.772+0000 7f6a95b4d640 1 -- 172.21.15.120:0/329285057 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5604b5b6f410 msgr2=0x5604b5b79770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.772+0000 7f6a95b4d640 1 --2- 172.21.15.120:0/329285057 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5604b5b6f410 0x5604b5b79770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.777 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.772+0000 7f6a95b4d640 1 -- 172.21.15.120:0/329285057 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604b5a7a340 con 0x5604b5b6eaf0 2024-09-19T05:22:51.778 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.772+0000 7f6a94b4b640 1 --2- 172.21.15.120:0/329285057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5604b5b79cb0 0x5604b5b7c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:51.778 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.772+0000 7f6a95b4d640 1 --2- 172.21.15.120:0/1140089302 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f6a780a3460 0x7f6a780a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:51.778 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.772+0000 7f6a8e7fc640 1 -- 172.21.15.120:0/1140089302 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f6a880d00b0 con 0x7f6a901009b0 2024-09-19T05:22:51.778 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.772+0000 7f6a95b4d640 1 --2- 172.21.15.120:0/329285057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6eaf0 0x5604b5b6eed0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009ca0 tx=0x7f6a80011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c36ea08e1a3f8d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:51.778 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.773+0000 7f6a777fe640 1 -- 172.21.15.120:0/329285057 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8001b870 con 0x5604b5b6eaf0 2024-09-19T05:22:51.778 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.773+0000 7f6a777fe640 1 -- 172.21.15.120:0/329285057 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a80019d80 con 0x5604b5b6eaf0 2024-09-19T05:22:51.778 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.773+0000 7f6a777fe640 1 -- 172.21.15.120:0/329285057 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8000ebf0 con 0x5604b5b6eaf0 2024-09-19T05:22:51.778 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.774+0000 7f6a9a425740 1 -- 172.21.15.120:0/329285057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6eaf0 msgr2=0x5604b5b6eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:51.779 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.774+0000 7f6a9a425740 1 --2- 172.21.15.120:0/329285057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6eaf0 0x5604b5b6eed0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009ca0 tx=0x7f6a80011810 comp rx=0 tx=0).stop 2024-09-19T05:22:51.779 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.774+0000 7f6a95b4d640 1 --2- 172.21.15.120:0/1140089302 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f6a780a3460 0x7f6a780a5920 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6a80020000 tx=0x7f6a80021000 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:51.779 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.774+0000 7f6a9a425740 1 -- 172.21.15.120:0/329285057 shutdown_connections 2024-09-19T05:22:51.779 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.774+0000 7f6a9a425740 1 --2- 172.21.15.120:0/329285057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5604b5b79cb0 0x5604b5b7c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.779 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.774+0000 7f6a9a425740 1 --2- 172.21.15.120:0/329285057 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5604b5b6f410 0x5604b5b79770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.779 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.774+0000 7f6a9a425740 1 --2- 172.21.15.120:0/329285057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6eaf0 0x5604b5b6eed0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.779 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.774+0000 7f6a9a425740 1 -- 172.21.15.120:0/329285057 >> 172.21.15.120:0/329285057 conn(0x5604b5b6b060 msgr2=0x5604b5b6b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:51.779 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.774+0000 7f6a9a425740 1 -- 172.21.15.120:0/329285057 shutdown_connections 2024-09-19T05:22:51.779 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.774+0000 7f6a9a425740 1 -- 172.21.15.120:0/329285057 wait complete. 2024-09-19T05:22:51.779 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.774+0000 7f6a9a425740 1 -- start start 2024-09-19T05:22:51.779 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.774+0000 7f6a9a425740 1 Processor -- start 2024-09-19T05:22:51.780 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.775+0000 7f6a9a425740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6eaf0 0x5604b5b76c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:51.780 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.775+0000 7f6a9a425740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5604b5b6f410 0x5604b5b771a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:51.780 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.775+0000 7f6a9a425740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5604b5b79cb0 0x5604b5b776e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:51.780 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.775+0000 7f6a9534c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6eaf0 0x5604b5b76c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:51.780 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.775+0000 7f6a9534c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6eaf0 0x5604b5b76c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:41002/0 (socket says 172.21.15.120:41002) 2024-09-19T05:22:51.780 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.775+0000 7f6a9534c640 1 -- 172.21.15.120:0/2169002236 learned_addr learned my addr 172.21.15.120:0/2169002236 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:51.780 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.775+0000 7f6a9a425740 1 -- 172.21.15.120:0/2169002236 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5604b5b7c880 con 0x5604b5b6f410 2024-09-19T05:22:51.780 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.775+0000 7f6a9a425740 1 -- 172.21.15.120:0/2169002236 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5604b5a5c290 con 0x5604b5b79cb0 2024-09-19T05:22:51.780 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.775+0000 7f6a94b4b640 1 --2- 172.21.15.120:0/2169002236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5604b5b6f410 0x5604b5b771a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:51.780 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.775+0000 7f6a9a425740 1 -- 172.21.15.120:0/2169002236 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5604b5b7ca00 con 0x5604b5b6eaf0 2024-09-19T05:22:51.780 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.775+0000 7f6a95b4d640 1 --2- 172.21.15.120:0/2169002236 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5604b5b79cb0 0x5604b5b776e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.776+0000 7f6a9534c640 1 -- 172.21.15.120:0/2169002236 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5604b5b79cb0 msgr2=0x5604b5b776e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.776+0000 7f6a9534c640 1 --2- 172.21.15.120:0/2169002236 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5604b5b79cb0 0x5604b5b776e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.776+0000 7f6a9534c640 1 -- 172.21.15.120:0/2169002236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5604b5b6f410 msgr2=0x5604b5b771a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.776+0000 7f6a9534c640 1 --2- 172.21.15.120:0/2169002236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5604b5b6f410 0x5604b5b771a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.776+0000 7f6a9534c640 1 -- 172.21.15.120:0/2169002236 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604b57e6210 con 0x5604b5b6eaf0 2024-09-19T05:22:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.776+0000 7f6a94b4b640 1 --2- 172.21.15.120:0/2169002236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5604b5b6f410 0x5604b5b771a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.776+0000 7f6a9a425740 10 client.0 _ll_register_callbacks cb 0x5604b5a8d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:22:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.776+0000 7f6a9a425740 1 -- 172.21.15.120:0/2169002236 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a80019d80 con 0x5604b5b6eaf0 2024-09-19T05:22:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.776+0000 7f6a9534c640 1 --2- 172.21.15.120:0/2169002236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6eaf0 0x5604b5b76c60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6a88000c00 tx=0x7f6a8809bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e011dedcea38f936 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.776+0000 7f6a74ff9640 10 client.25549 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:22:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.776+0000 7f6a74ff9640 1 -- 172.21.15.120:0/2169002236 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a880d22d0 con 0x5604b5b6eaf0 2024-09-19T05:22:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.776+0000 7f6a74ff9640 1 -- 172.21.15.120:0/2169002236 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f6a88010430 con 0x5604b5b6eaf0 2024-09-19T05:22:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.776+0000 7f6a74ff9640 1 -- 172.21.15.120:0/2169002236 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6a88010670 con 0x5604b5b6eaf0 2024-09-19T05:22:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.776+0000 7f6a9a425740 10 client.25549 fetch_fsmap learned FSMap version 29 2024-09-19T05:22:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.776+0000 7f6a9a425740 1 -- 172.21.15.120:0/2169002236 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5604b58b2620 con 0x5604b5b6eaf0 2024-09-19T05:22:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.777+0000 7f6a74ff9640 1 -- 172.21.15.120:0/2169002236 <== mon.1 v2:172.21.15.194:3300/0 4 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f6a8809b790 con 0x5604b5b6eaf0 2024-09-19T05:22:51.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.777+0000 7f6a9a425740 10 client.25549 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:22:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.777+0000 7f6a9a425740 10 client.25549 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:22:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.777+0000 7f6a9a425740 20 client.25549 populate_metadata read hostname 'smithi120' 2024-09-19T05:22:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.777+0000 7f6a9a425740 1 --2- 172.21.15.120:0/2169002236 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5604b5b89a50 0x5604b5b8bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.777+0000 7f6a9a425740 4 client.25549 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:22:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.777+0000 7f6a9a425740 1 -- 172.21.15.120:0/2169002236 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604b5ae0a20 con 0x5604b5b89a50 2024-09-19T05:22:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.777+0000 7f6a94b4b640 1 --2- 172.21.15.120:0/2169002236 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5604b5b89a50 0x5604b5b8bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.778+0000 7f6a94b4b640 1 --2- 172.21.15.120:0/2169002236 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5604b5b89a50 0x5604b5b8bee0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89751ee12aaa6894 server_cookie=1278fed64161c21b in_seq=0 out_seq=0 2024-09-19T05:22:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.778+0000 7f6a74ff9640 10 client.25549 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:22:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.778+0000 7f6a74ff9640 1 -- 172.21.15.120:0/2169002236 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5604b5ae0a20 con 0x5604b5b89a50 2024-09-19T05:22:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.778+0000 7f6a74ff9640 10 client.25549 handle_command_reply: tid=0 2024-09-19T05:22:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.778+0000 7f6a9a425740 1 client.25549 shutdown 2024-09-19T05:22:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.778+0000 7f6a9a425740 1 -- 172.21.15.120:0/2169002236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6eaf0 msgr2=0x5604b5b76c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.778+0000 7f6a9a425740 1 --2- 172.21.15.120:0/2169002236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6eaf0 0x5604b5b76c60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6a88000c00 tx=0x7f6a8809bf40 comp rx=0 tx=0).stop 2024-09-19T05:22:51.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.779+0000 7f6a9a425740 1 -- 172.21.15.120:0/2169002236 shutdown_connections 2024-09-19T05:22:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.779+0000 7f6a9a425740 1 --2- 172.21.15.120:0/2169002236 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5604b5b79cb0 0x5604b5b776e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.779+0000 7f6a9a425740 1 --2- 172.21.15.120:0/2169002236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5604b5b6f410 0x5604b5b771a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.779+0000 7f6a9a425740 1 --2- 172.21.15.120:0/2169002236 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5604b5b89a50 0x5604b5b8bee0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.779+0000 7f6a9a425740 1 --2- 172.21.15.120:0/2169002236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6eaf0 0x5604b5b76c60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.779+0000 7f6a9a425740 1 -- 172.21.15.120:0/2169002236 >> 172.21.15.120:0/2169002236 conn(0x5604b5b6b060 msgr2=0x5604b5b70d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.779+0000 7f6a74ff9640 0 client.25549 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:22:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.779+0000 7f6a9a425740 1 -- 172.21.15.120:0/2169002236 shutdown_connections 2024-09-19T05:22:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.779+0000 7f6a9a425740 1 -- 172.21.15.120:0/2169002236 wait complete. 2024-09-19T05:22:51.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.779+0000 7f6a9a425740 20 client.25549 trim_cache size 0 max 16384 2024-09-19T05:22:51.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.802+0000 7f6a9a425740 1 Processor -- start 2024-09-19T05:22:51.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.802+0000 7f6a9a425740 1 -- start start 2024-09-19T05:22:51.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.802+0000 7f6a9a425740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5604b5b6eaf0 0x5604b5b75b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:51.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.802+0000 7f6a9a425740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6f410 0x5604b5b71560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.802+0000 7f6a9a425740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5604b5b79cb0 0x5604b5b77190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.802+0000 7f6a9a425740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6a901ae070 con 0x5604b5b79cb0 2024-09-19T05:22:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.802+0000 7f6a9a425740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6a901ab940 con 0x5604b5b6eaf0 2024-09-19T05:22:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.802+0000 7f6a9a425740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6a901a9790 con 0x5604b5b6f410 2024-09-19T05:22:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.802+0000 7f6a95b4d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5604b5b79cb0 0x5604b5b77190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.802+0000 7f6a95b4d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5604b5b79cb0 0x5604b5b77190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53812/0 (socket says 172.21.15.120:53812) 2024-09-19T05:22:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.802+0000 7f6a95b4d640 1 -- 172.21.15.120:0/2330643062 learned_addr learned my addr 172.21.15.120:0/2330643062 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.802+0000 7f6a94b4b640 1 --2- 172.21.15.120:0/2330643062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6f410 0x5604b5b71560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.802+0000 7f6a9534c640 1 --2- 172.21.15.120:0/2330643062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5604b5b6eaf0 0x5604b5b75b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.802+0000 7f6a94b4b640 1 -- 172.21.15.120:0/2330643062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5604b5b6eaf0 msgr2=0x5604b5b75b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.802+0000 7f6a94b4b640 1 --2- 172.21.15.120:0/2330643062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5604b5b6eaf0 0x5604b5b75b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.802+0000 7f6a94b4b640 1 -- 172.21.15.120:0/2330643062 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5604b5b79cb0 msgr2=0x5604b5b77190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.802+0000 7f6a94b4b640 1 --2- 172.21.15.120:0/2330643062 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5604b5b79cb0 0x5604b5b77190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.802+0000 7f6a94b4b640 1 -- 172.21.15.120:0/2330643062 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604b5b75190 con 0x5604b5b6f410 2024-09-19T05:22:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.803+0000 7f6a9534c640 1 --2- 172.21.15.120:0/2330643062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5604b5b6eaf0 0x5604b5b75b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.803+0000 7f6a95b4d640 1 --2- 172.21.15.120:0/2330643062 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5604b5b79cb0 0x5604b5b77190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.803+0000 7f6a94b4b640 1 --2- 172.21.15.120:0/2330643062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6f410 0x5604b5b71560 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6a84006010 tx=0x7f6a84005c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f542b2ae86babfa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.803+0000 7f6a76ffd640 1 -- 172.21.15.120:0/2330643062 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a84031a10 con 0x5604b5b6f410 2024-09-19T05:22:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.803+0000 7f6a76ffd640 1 -- 172.21.15.120:0/2330643062 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a84036040 con 0x5604b5b6f410 2024-09-19T05:22:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.803+0000 7f6a76ffd640 1 -- 172.21.15.120:0/2330643062 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8403dd50 con 0x5604b5b6f410 2024-09-19T05:22:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.804+0000 7f6a9a425740 1 -- 172.21.15.120:0/2330643062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6f410 msgr2=0x5604b5b71560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.804+0000 7f6a9a425740 1 --2- 172.21.15.120:0/2330643062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6f410 0x5604b5b71560 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6a84006010 tx=0x7f6a84005c30 comp rx=0 tx=0).stop 2024-09-19T05:22:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.804+0000 7f6a9a425740 1 -- 172.21.15.120:0/2330643062 shutdown_connections 2024-09-19T05:22:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.804+0000 7f6a9a425740 1 --2- 172.21.15.120:0/2330643062 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5604b5b79cb0 0x5604b5b77190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.804+0000 7f6a9a425740 1 --2- 172.21.15.120:0/2330643062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6f410 0x5604b5b71560 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.804+0000 7f6a9a425740 1 --2- 172.21.15.120:0/2330643062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5604b5b6eaf0 0x5604b5b75b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.804+0000 7f6a9a425740 1 -- 172.21.15.120:0/2330643062 >> 172.21.15.120:0/2330643062 conn(0x5604b5b6b060 msgr2=0x5604b5b78ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.804+0000 7f6a9a425740 1 -- 172.21.15.120:0/2330643062 shutdown_connections 2024-09-19T05:22:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.804+0000 7f6a9a425740 1 -- 172.21.15.120:0/2330643062 wait complete. 2024-09-19T05:22:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.804+0000 7f6a9a425740 1 -- start start 2024-09-19T05:22:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.805+0000 7f6a9a425740 1 Processor -- start 2024-09-19T05:22:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.805+0000 7f6a9a425740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5604b5b6eaf0 0x5604b5b7d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.805+0000 7f6a9a425740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6f410 0x5604b5b7d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.805+0000 7f6a9a425740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5604b5b79cb0 0x5604b5bf27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.805+0000 7f6a9a425740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f6a901a9e00 con 0x5604b5b6eaf0 2024-09-19T05:22:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.805+0000 7f6a9a425740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f6a901ab270 con 0x5604b5b79cb0 2024-09-19T05:22:51.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.805+0000 7f6a9a425740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6a901aa4d0 con 0x5604b5b6f410 2024-09-19T05:22:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.805+0000 7f6a9a425740 10 client.0 _ll_register_callbacks cb 0x7f6a88009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:22:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.805+0000 7f6a9534c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5604b5b6eaf0 0x5604b5b7d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.805+0000 7f6a94b4b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6f410 0x5604b5b7d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.805+0000 7f6a9534c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5604b5b6eaf0 0x5604b5b7d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53814/0 (socket says 172.21.15.120:53814) 2024-09-19T05:22:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.805+0000 7f6a95b4d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5604b5b79cb0 0x5604b5bf27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.805+0000 7f6a9534c640 1 -- 172.21.15.120:0/441639241 learned_addr learned my addr 172.21.15.120:0/441639241 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:22:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.806+0000 7f6a94b4b640 1 -- 172.21.15.120:0/441639241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5604b5b79cb0 msgr2=0x5604b5bf27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.806+0000 7f6a94b4b640 1 --2- 172.21.15.120:0/441639241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5604b5b79cb0 0x5604b5bf27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.806+0000 7f6a94b4b640 1 -- 172.21.15.120:0/441639241 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5604b5b6eaf0 msgr2=0x5604b5b7d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:22:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.806+0000 7f6a94b4b640 1 --2- 172.21.15.120:0/441639241 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5604b5b6eaf0 0x5604b5b7d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.806+0000 7f6a94b4b640 1 -- 172.21.15.120:0/441639241 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604b5bf2df0 con 0x5604b5b6f410 2024-09-19T05:22:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.806+0000 7f6a9534c640 1 --2- 172.21.15.120:0/441639241 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5604b5b6eaf0 0x5604b5b7d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:51.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.806+0000 7f6a95b4d640 1 --2- 172.21.15.120:0/441639241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5604b5b79cb0 0x5604b5bf27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:22:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.806+0000 7f6a94b4b640 1 --2- 172.21.15.120:0/441639241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6f410 0x5604b5b7d960 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x5604b5b79aa0 tx=0x7f6a8403d7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e349e0b681654ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:22:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.806+0000 7f6a74ff9640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:22:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.806+0000 7f6a74ff9640 1 -- 172.21.15.120:0/441639241 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a84058070 con 0x5604b5b6f410 2024-09-19T05:22:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.806+0000 7f6a74ff9640 1 -- 172.21.15.120:0/441639241 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f6a84031c20 con 0x5604b5b6f410 2024-09-19T05:22:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.806+0000 7f6a9a425740 1 -- 172.21.15.120:0/441639241 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a84036040 con 0x5604b5b6f410 2024-09-19T05:22:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.806+0000 7f6a74ff9640 1 -- 172.21.15.120:0/441639241 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6a8403d9f0 con 0x5604b5b6f410 2024-09-19T05:22:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.806+0000 7f6a9a425740 10 client.25555 fetch_fsmap learned FSMap version 29 2024-09-19T05:22:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.806+0000 7f6a9a425740 1 -- 172.21.15.120:0/441639241 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5604b5bf4100 con 0x5604b5b6f410 2024-09-19T05:22:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.807+0000 7f6a74ff9640 1 -- 172.21.15.120:0/441639241 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f6a84003e20 con 0x5604b5b6f410 2024-09-19T05:22:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.807+0000 7f6a74ff9640 1 -- 172.21.15.120:0/441639241 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f6a84030070 con 0x5604b5b6f410 2024-09-19T05:22:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.807+0000 7f6a9a425740 10 client.25555 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:22:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.807+0000 7f6a9a425740 10 client.25555 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:22:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.807+0000 7f6a9a425740 20 client.25555 populate_metadata read hostname 'smithi120' 2024-09-19T05:22:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.807+0000 7f6a9a425740 1 --2- 172.21.15.120:0/441639241 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5604b5bf47d0 0x5604b5bf6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:22:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.807+0000 7f6a9a425740 4 client.25555 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:22:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.807+0000 7f6a9a425740 1 -- 172.21.15.120:0/441639241 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f6a84036040 con 0x5604b5bf47d0 2024-09-19T05:22:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.807+0000 7f6a9534c640 1 --2- 172.21.15.120:0/441639241 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5604b5bf47d0 0x5604b5bf6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:22:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.808+0000 7f6a74ff9640 10 client.25555 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:22:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.808+0000 7f6a9534c640 1 --2- 172.21.15.120:0/441639241 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5604b5bf47d0 0x5604b5bf6bf0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=664cebb16ed9a6fd server_cookie=d6eb94e0ad4c9fa in_seq=0 out_seq=0 2024-09-19T05:22:51.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.956+0000 7f6a74ff9640 1 -- 172.21.15.120:0/441639241 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f6a84036040 con 0x5604b5bf47d0 2024-09-19T05:22:51.958 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.956+0000 7f6a74ff9640 10 client.25555 handle_command_reply: tid=0 2024-09-19T05:22:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.956+0000 7f6a9a425740 1 client.25555 shutdown 2024-09-19T05:22:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.956+0000 7f6a9a425740 1 -- 172.21.15.120:0/441639241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6f410 msgr2=0x5604b5b7d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.956+0000 7f6a9a425740 1 --2- 172.21.15.120:0/441639241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6f410 0x5604b5b7d960 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x5604b5b79aa0 tx=0x7f6a8403d7b0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.957+0000 7f6a9a425740 1 -- 172.21.15.120:0/441639241 shutdown_connections 2024-09-19T05:22:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.957+0000 7f6a9a425740 1 --2- 172.21.15.120:0/441639241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5604b5b79cb0 0x5604b5bf27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.957+0000 7f6a9a425740 1 --2- 172.21.15.120:0/441639241 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5604b5bf47d0 0x5604b5bf6bf0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.957+0000 7f6a9a425740 1 --2- 172.21.15.120:0/441639241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604b5b6f410 0x5604b5b7d960 secure :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0x5604b5b79aa0 tx=0x7f6a8403d7b0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.957+0000 7f6a9a425740 1 --2- 172.21.15.120:0/441639241 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5604b5b6eaf0 0x5604b5b7d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.957+0000 7f6a9a425740 1 -- 172.21.15.120:0/441639241 >> 172.21.15.120:0/441639241 conn(0x5604b5b6b060 msgr2=0x5604b5b84b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.957+0000 7f6a74ff9640 0 client.25555 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:22:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.957+0000 7f6a9a425740 1 -- 172.21.15.120:0/441639241 shutdown_connections 2024-09-19T05:22:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.957+0000 7f6a9a425740 1 -- 172.21.15.120:0/441639241 wait complete. 2024-09-19T05:22:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.957+0000 7f6a9a425740 20 client.25555 trim_cache size 0 max 16384 2024-09-19T05:22:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:22:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:22:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:22:51.961 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:22:51.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.958+0000 7f6a975b0640 1 -- 172.21.15.120:0/1140089302 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f6a780a3460 msgr2=0x7f6a780a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:51.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.958+0000 7f6a975b0640 1 --2- 172.21.15.120:0/1140089302 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f6a780a3460 0x7f6a780a5920 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6a80020000 tx=0x7f6a80021000 comp rx=0 tx=0).stop 2024-09-19T05:22:51.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.958+0000 7f6a975b0640 1 -- 172.21.15.120:0/1140089302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a901009b0 msgr2=0x7f6a90199120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:22:51.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.958+0000 7f6a975b0640 1 --2- 172.21.15.120:0/1140089302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a901009b0 0x7f6a90199120 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800e9f0 tx=0x7f6a8800eeb0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.959+0000 7f6a975b0640 1 -- 172.21.15.120:0/1140089302 shutdown_connections 2024-09-19T05:22:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.959+0000 7f6a975b0640 1 --2- 172.21.15.120:0/1140089302 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f6a780a3460 0x7f6a780a5920 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.959+0000 7f6a975b0640 1 --2- 172.21.15.120:0/1140089302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a901069c0 0x7f6a901a41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.959+0000 7f6a975b0640 1 --2- 172.21.15.120:0/1140089302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a90101350 0x7f6a90199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.959+0000 7f6a975b0640 1 --2- 172.21.15.120:0/1140089302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6a901009b0 0x7f6a90199120 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:22:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.959+0000 7f6a975b0640 1 -- 172.21.15.120:0/1140089302 >> 172.21.15.120:0/1140089302 conn(0x7f6a90077990 msgr2=0x7f6a90103990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:22:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.959+0000 7f6a975b0640 1 -- 172.21.15.120:0/1140089302 shutdown_connections 2024-09-19T05:22:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:22:51.959+0000 7f6a975b0640 1 -- 172.21.15.120:0/1140089302 wait complete. 2024-09-19T05:22:52.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:52 smithi120 ceph-mon[30956]: pgmap v112: 97 pgs: 97 active+clean; 287 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 128 op/s 2024-09-19T05:22:52.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:52 smithi194 ceph-mon[35228]: pgmap v112: 97 pgs: 97 active+clean; 287 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 128 op/s 2024-09-19T05:22:52.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:52 smithi178 ceph-mon[34347]: pgmap v112: 97 pgs: 97 active+clean; 287 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 128 op/s 2024-09-19T05:22:54.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:54 smithi120 ceph-mon[30956]: pgmap v113: 97 pgs: 97 active+clean; 287 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 128 op/s 2024-09-19T05:22:54.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:54 smithi194 ceph-mon[35228]: pgmap v113: 97 pgs: 97 active+clean; 287 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 128 op/s 2024-09-19T05:22:54.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:54 smithi178 ceph-mon[34347]: pgmap v113: 97 pgs: 97 active+clean; 287 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 128 op/s 2024-09-19T05:22:56.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:56 smithi120 ceph-mon[30956]: pgmap v114: 97 pgs: 97 active+clean; 288 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.3 MiB/s wr, 240 op/s 2024-09-19T05:22:56.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:56 smithi194 ceph-mon[35228]: pgmap v114: 97 pgs: 97 active+clean; 288 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.3 MiB/s wr, 240 op/s 2024-09-19T05:22:56.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:56 smithi178 ceph-mon[34347]: pgmap v114: 97 pgs: 97 active+clean; 288 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.3 MiB/s wr, 240 op/s 2024-09-19T05:22:58.314 INFO:tasks.workunit.client.0.smithi120.stdout: 77 14607 91 8975 81 2185 93 2024-09-19T05:22:58.743 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:22:58 smithi178 ceph-mon[34347]: pgmap v115: 97 pgs: 97 active+clean; 288 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 180 op/s 2024-09-19T05:22:58.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:22:58 smithi120 ceph-mon[30956]: pgmap v115: 97 pgs: 97 active+clean; 288 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 180 op/s 2024-09-19T05:22:58.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:22:58 smithi194 ceph-mon[35228]: pgmap v115: 97 pgs: 97 active+clean; 288 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 180 op/s 2024-09-19T05:23:00.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:00 smithi120 ceph-mon[30956]: pgmap v116: 97 pgs: 97 active+clean; 299 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 237 op/s 2024-09-19T05:23:00.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:00 smithi194 ceph-mon[35228]: pgmap v116: 97 pgs: 97 active+clean; 299 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 237 op/s 2024-09-19T05:23:00.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:00 smithi178 ceph-mon[34347]: pgmap v116: 97 pgs: 97 active+clean; 299 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.2 MiB/s wr, 237 op/s 2024-09-19T05:23:02.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:02 smithi120 ceph-mon[30956]: pgmap v117: 97 pgs: 97 active+clean; 299 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 168 op/s 2024-09-19T05:23:02.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:02 smithi194 ceph-mon[35228]: pgmap v117: 97 pgs: 97 active+clean; 299 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 168 op/s 2024-09-19T05:23:02.941 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:02 smithi178 ceph-mon[34347]: pgmap v117: 97 pgs: 97 active+clean; 299 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 168 op/s 2024-09-19T05:23:04.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:04 smithi120 ceph-mon[30956]: pgmap v118: 97 pgs: 97 active+clean; 299 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 168 op/s 2024-09-19T05:23:04.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:04 smithi194 ceph-mon[35228]: pgmap v118: 97 pgs: 97 active+clean; 299 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 168 op/s 2024-09-19T05:23:04.941 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:04 smithi178 ceph-mon[34347]: pgmap v118: 97 pgs: 97 active+clean; 299 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 168 op/s 2024-09-19T05:23:05.090 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.088+0000 7fe7935e8640 1 -- 172.21.15.120:0/2728871559 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe78c1035a0 msgr2=0x7fe78c10ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:05.090 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.088+0000 7fe7935e8640 1 --2- 172.21.15.120:0/2728871559 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe78c1035a0 0x7fe78c10ba80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009900 tx=0x7fe77c02a480 comp rx=0 tx=0).stop 2024-09-19T05:23:05.090 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.088+0000 7fe7935e8640 1 -- 172.21.15.120:0/2728871559 shutdown_connections 2024-09-19T05:23:05.091 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.088+0000 7fe7935e8640 1 --2- 172.21.15.120:0/2728871559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe78c10c0d0 0x7fe78c10e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.091 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.088+0000 7fe7935e8640 1 --2- 172.21.15.120:0/2728871559 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe78c1035a0 0x7fe78c10ba80 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.091 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.088+0000 7fe7935e8640 1 --2- 172.21.15.120:0/2728871559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe78c102c80 0x7fe78c103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.091 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.088+0000 7fe7935e8640 1 -- 172.21.15.120:0/2728871559 >> 172.21.15.120:0/2728871559 conn(0x7fe78c077990 msgr2=0x7fe78c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:05.091 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.088+0000 7fe7935e8640 1 -- 172.21.15.120:0/2728871559 shutdown_connections 2024-09-19T05:23:05.091 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.089+0000 7fe7935e8640 1 -- 172.21.15.120:0/2728871559 wait complete. 2024-09-19T05:23:05.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.089+0000 7fe7935e8640 1 Processor -- start 2024-09-19T05:23:05.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.089+0000 7fe7935e8640 1 -- start start 2024-09-19T05:23:05.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.090+0000 7fe7935e8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe78c102c80 0x7fe78c198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:05.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.090+0000 7fe7935e8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe78c1035a0 0x7fe78c1987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:05.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.090+0000 7fe7935e8640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe78c10c0d0 0x7fe78c19cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:05.093 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.090+0000 7fe7935e8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe78c111d60 con 0x7fe78c102c80 2024-09-19T05:23:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.090+0000 7fe7935e8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe78c111be0 con 0x7fe78c1035a0 2024-09-19T05:23:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.090+0000 7fe7935e8640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe78c111ee0 con 0x7fe78c10c0d0 2024-09-19T05:23:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.090+0000 7fe791384640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe78c102c80 0x7fe78c198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.090+0000 7fe790b83640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe78c1035a0 0x7fe78c1987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.090+0000 7fe791b85640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe78c10c0d0 0x7fe78c19cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.090+0000 7fe791b85640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe78c10c0d0 0x7fe78c19cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:47376/0 (socket says 172.21.15.120:47376) 2024-09-19T05:23:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.090+0000 7fe791384640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe78c102c80 0x7fe78c198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35470/0 (socket says 172.21.15.120:35470) 2024-09-19T05:23:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.090+0000 7fe791b85640 1 -- 172.21.15.120:0/3172633234 learned_addr learned my addr 172.21.15.120:0/3172633234 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:23:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.090+0000 7fe790b83640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe78c1035a0 0x7fe78c1987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:39262/0 (socket says 172.21.15.120:39262) 2024-09-19T05:23:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.090+0000 7fe791384640 1 -- 172.21.15.120:0/3172633234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe78c10c0d0 msgr2=0x7fe78c19cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.090+0000 7fe791384640 1 --2- 172.21.15.120:0/3172633234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe78c10c0d0 0x7fe78c19cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.090+0000 7fe791384640 1 -- 172.21.15.120:0/3172633234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe78c1035a0 msgr2=0x7fe78c1987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.090+0000 7fe791384640 1 --2- 172.21.15.120:0/3172633234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe78c1035a0 0x7fe78c1987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.090+0000 7fe791384640 1 -- 172.21.15.120:0/3172633234 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe78c19d260 con 0x7fe78c102c80 2024-09-19T05:23:05.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.090+0000 7fe790b83640 1 --2- 172.21.15.120:0/3172633234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe78c1035a0 0x7fe78c1987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:23:05.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.090+0000 7fe791384640 1 --2- 172.21.15.120:0/3172633234 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe78c102c80 0x7fe78c198270 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe78800e9f0 tx=0x7fe78800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:05.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.091+0000 7fe7827fc640 1 -- 172.21.15.120:0/3172633234 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78800ccc0 con 0x7fe78c102c80 2024-09-19T05:23:05.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.091+0000 7fe7935e8640 1 -- 172.21.15.120:0/3172633234 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe78c19d550 con 0x7fe78c102c80 2024-09-19T05:23:05.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.091+0000 7fe7827fc640 1 -- 172.21.15.120:0/3172633234 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe7880108e0 con 0x7fe78c102c80 2024-09-19T05:23:05.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.091+0000 7fe7827fc640 1 -- 172.21.15.120:0/3172633234 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe788018880 con 0x7fe78c102c80 2024-09-19T05:23:05.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.091+0000 7fe7935e8640 1 -- 172.21.15.120:0/3172633234 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe78c1a4de0 con 0x7fe78c102c80 2024-09-19T05:23:05.095 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.094+0000 7fe7827fc640 1 -- 172.21.15.120:0/3172633234 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fe788010a90 con 0x7fe78c102c80 2024-09-19T05:23:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.094+0000 7fe796461740 1 Processor -- start 2024-09-19T05:23:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.094+0000 7fe796461740 1 -- start start 2024-09-19T05:23:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.095+0000 7fe796461740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d90053f00 0x561d900542e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.095+0000 7fe796461740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d90054820 0x561d9005eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.095+0000 7fe796461740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d9005f0c0 0x561d900614b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.095+0000 7fe796461740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561d8ffb42f0 con 0x561d90054820 2024-09-19T05:23:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.095+0000 7fe796461740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561d8ff5c270 con 0x561d9005f0c0 2024-09-19T05:23:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.095+0000 7fe796461740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x561d8ffb02b0 con 0x561d90053f00 2024-09-19T05:23:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.095+0000 7fe790b83640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d9005f0c0 0x561d900614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:05.099 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.095+0000 7fe791b85640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d90053f00 0x561d900542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:05.099 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.095+0000 7fe791b85640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d90053f00 0x561d900542e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:47386/0 (socket says 172.21.15.120:47386) 2024-09-19T05:23:05.099 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.095+0000 7fe791b85640 1 -- 172.21.15.120:0/2503670579 learned_addr learned my addr 172.21.15.120:0/2503670579 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:23:05.099 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.095+0000 7fe791384640 1 --2- 172.21.15.120:0/2503670579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d90054820 0x561d9005eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:05.099 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.095+0000 7fe7827fc640 1 --2- 172.21.15.120:0/3172633234 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fe7780a34e0 0x7fe7780a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:05.099 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.095+0000 7fe791b85640 1 -- 172.21.15.120:0/2503670579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d9005f0c0 msgr2=0x561d900614b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:05.099 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.095+0000 7fe791b85640 1 --2- 172.21.15.120:0/2503670579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d9005f0c0 0x561d900614b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.099 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.095+0000 7fe791b85640 1 -- 172.21.15.120:0/2503670579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d90054820 msgr2=0x561d9005eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:05.099 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.095+0000 7fe791b85640 1 --2- 172.21.15.120:0/2503670579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d90054820 0x561d9005eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.099 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.095+0000 7fe791b85640 1 -- 172.21.15.120:0/2503670579 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d8ff5b340 con 0x561d90053f00 2024-09-19T05:23:05.099 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.095+0000 7fe790b83640 1 --2- 172.21.15.120:0/2503670579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d9005f0c0 0x561d900614b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:23:05.099 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.095+0000 7fe7827fc640 1 -- 172.21.15.120:0/3172633234 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fe7880d0120 con 0x7fe78c102c80 2024-09-19T05:23:05.100 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.096+0000 7fe791b85640 1 --2- 172.21.15.120:0/3172633234 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fe7780a34e0 0x7fe7780a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:05.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.096+0000 7fe791b85640 1 --2- 172.21.15.120:0/2503670579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d90053f00 0x561d900542e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe784011470 tx=0x7fe784011930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae0886292b20828e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:05.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.096+0000 7fe7777fe640 1 -- 172.21.15.120:0/2503670579 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78400fa60 con 0x561d90053f00 2024-09-19T05:23:05.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.096+0000 7fe7777fe640 1 -- 172.21.15.120:0/2503670579 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe78400e3b0 con 0x561d90053f00 2024-09-19T05:23:05.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.096+0000 7fe7777fe640 1 -- 172.21.15.120:0/2503670579 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7840235a0 con 0x561d90053f00 2024-09-19T05:23:05.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.097+0000 7fe791b85640 1 --2- 172.21.15.120:0/3172633234 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fe7780a34e0 0x7fe7780a59a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe784020000 tx=0x7fe784021000 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:05.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.097+0000 7fe796461740 1 -- 172.21.15.120:0/2503670579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d90053f00 msgr2=0x561d900542e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:05.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.097+0000 7fe796461740 1 --2- 172.21.15.120:0/2503670579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d90053f00 0x561d900542e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe784011470 tx=0x7fe784011930 comp rx=0 tx=0).stop 2024-09-19T05:23:05.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.097+0000 7fe796461740 1 -- 172.21.15.120:0/2503670579 shutdown_connections 2024-09-19T05:23:05.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.097+0000 7fe796461740 1 --2- 172.21.15.120:0/2503670579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d9005f0c0 0x561d900614b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.097+0000 7fe796461740 1 --2- 172.21.15.120:0/2503670579 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d90054820 0x561d9005eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.097+0000 7fe796461740 1 --2- 172.21.15.120:0/2503670579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d90053f00 0x561d900542e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.097+0000 7fe796461740 1 -- 172.21.15.120:0/2503670579 >> 172.21.15.120:0/2503670579 conn(0x561d90050470 msgr2=0x561d90050850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:05.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.097+0000 7fe796461740 1 -- 172.21.15.120:0/2503670579 shutdown_connections 2024-09-19T05:23:05.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.097+0000 7fe796461740 1 -- 172.21.15.120:0/2503670579 wait complete. 2024-09-19T05:23:05.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.098+0000 7fe796461740 1 -- start start 2024-09-19T05:23:05.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.098+0000 7fe796461740 1 Processor -- start 2024-09-19T05:23:05.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.098+0000 7fe796461740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d90053f00 0x561d9005bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:05.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.098+0000 7fe796461740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d90054820 0x561d9005c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:05.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.099+0000 7fe796461740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d9005f0c0 0x561d9005c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:05.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.099+0000 7fe791384640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d90053f00 0x561d9005bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:05.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.099+0000 7fe791384640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d90053f00 0x561d9005bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:47398/0 (socket says 172.21.15.120:47398) 2024-09-19T05:23:05.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.099+0000 7fe791384640 1 -- 172.21.15.120:0/4207923710 learned_addr learned my addr 172.21.15.120:0/4207923710 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:23:05.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.099+0000 7fe796461740 1 -- 172.21.15.120:0/4207923710 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x561d90061c90 con 0x561d9005f0c0 2024-09-19T05:23:05.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.099+0000 7fe796461740 1 -- 172.21.15.120:0/4207923710 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x561d8ff3d290 con 0x561d90054820 2024-09-19T05:23:05.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.099+0000 7fe796461740 1 -- 172.21.15.120:0/4207923710 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x561d90061e10 con 0x561d90053f00 2024-09-19T05:23:05.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.099+0000 7fe796461740 10 client.0 _ll_register_callbacks cb 0x561d8ff6e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:23:05.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.099+0000 7fe791b85640 1 --2- 172.21.15.120:0/4207923710 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d9005f0c0 0x561d9005c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:05.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.099+0000 7fe790b83640 1 --2- 172.21.15.120:0/4207923710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d90054820 0x561d9005c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:05.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.099+0000 7fe791b85640 1 -- 172.21.15.120:0/4207923710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d90053f00 msgr2=0x561d9005bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:05.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.099+0000 7fe791b85640 1 --2- 172.21.15.120:0/4207923710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d90053f00 0x561d9005bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.099+0000 7fe791b85640 1 -- 172.21.15.120:0/4207923710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d90054820 msgr2=0x561d9005c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:05.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.099+0000 7fe791b85640 1 --2- 172.21.15.120:0/4207923710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d90054820 0x561d9005c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.099+0000 7fe791b85640 1 -- 172.21.15.120:0/4207923710 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d8fcc7210 con 0x561d9005f0c0 2024-09-19T05:23:05.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.099+0000 7fe791384640 1 --2- 172.21.15.120:0/4207923710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d90053f00 0x561d9005bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:23:05.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.099+0000 7fe791b85640 1 --2- 172.21.15.120:0/4207923710 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d9005f0c0 0x561d9005c970 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe784019fd0 tx=0x7fe784028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1392d8a24d4e1c34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:05.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.099+0000 7fe774ff9640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:23:05.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.100+0000 7fe774ff9640 1 -- 172.21.15.120:0/4207923710 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe784033020 con 0x561d9005f0c0 2024-09-19T05:23:05.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.100+0000 7fe774ff9640 1 -- 172.21.15.120:0/4207923710 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fe784019ab0 con 0x561d9005f0c0 2024-09-19T05:23:05.107 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.100+0000 7fe796461740 1 -- 172.21.15.120:0/4207923710 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe78400e3b0 con 0x561d9005f0c0 2024-09-19T05:23:05.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.100+0000 7fe774ff9640 1 -- 172.21.15.120:0/4207923710 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe78403e050 con 0x561d9005f0c0 2024-09-19T05:23:05.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.100+0000 7fe796461740 10 client.16041 fetch_fsmap learned FSMap version 29 2024-09-19T05:23:05.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.100+0000 7fe796461740 1 -- 172.21.15.120:0/4207923710 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561d8fd93620 con 0x561d9005f0c0 2024-09-19T05:23:05.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.100+0000 7fe774ff9640 1 -- 172.21.15.120:0/4207923710 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe78400e3b0 con 0x561d9005f0c0 2024-09-19T05:23:05.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.100+0000 7fe774ff9640 1 -- 172.21.15.120:0/4207923710 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fe7840238a0 con 0x561d9005f0c0 2024-09-19T05:23:05.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.101+0000 7fe796461740 10 client.16041 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:23:05.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.101+0000 7fe796461740 10 client.16041 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:23:05.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.101+0000 7fe796461740 20 client.16041 populate_metadata read hostname 'smithi120' 2024-09-19T05:23:05.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.101+0000 7fe796461740 1 --2- 172.21.15.120:0/4207923710 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x561d9006eef0 0x561d900712e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:05.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.101+0000 7fe796461740 4 client.16041 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:23:05.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.101+0000 7fe796461740 1 -- 172.21.15.120:0/4207923710 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d8ffc1a20 con 0x561d9006eef0 2024-09-19T05:23:05.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.101+0000 7fe791384640 1 --2- 172.21.15.120:0/4207923710 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x561d9006eef0 0x561d900712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:05.108 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.101+0000 7fe774ff9640 10 client.16041 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:23:05.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.101+0000 7fe791384640 1 --2- 172.21.15.120:0/4207923710 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x561d9006eef0 0x561d900712e0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a511d799d895682 server_cookie=389fa2f48e88f58e in_seq=0 out_seq=0 2024-09-19T05:23:05.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.102+0000 7fe774ff9640 1 -- 172.21.15.120:0/4207923710 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561d8ffc1a20 con 0x561d9006eef0 2024-09-19T05:23:05.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.102+0000 7fe774ff9640 10 client.16041 handle_command_reply: tid=0 2024-09-19T05:23:05.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.102+0000 7fe796461740 1 client.16041 shutdown 2024-09-19T05:23:05.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.102+0000 7fe796461740 1 -- 172.21.15.120:0/4207923710 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d9005f0c0 msgr2=0x561d9005c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:05.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.102+0000 7fe796461740 1 --2- 172.21.15.120:0/4207923710 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d9005f0c0 0x561d9005c970 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe784019fd0 tx=0x7fe784028000 comp rx=0 tx=0).stop 2024-09-19T05:23:05.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.102+0000 7fe796461740 1 -- 172.21.15.120:0/4207923710 shutdown_connections 2024-09-19T05:23:05.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.102+0000 7fe796461740 1 --2- 172.21.15.120:0/4207923710 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d9005f0c0 0x561d9005c970 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.102+0000 7fe796461740 1 --2- 172.21.15.120:0/4207923710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d90054820 0x561d9005c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.102+0000 7fe796461740 1 --2- 172.21.15.120:0/4207923710 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x561d9006eef0 0x561d900712e0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.102+0000 7fe796461740 1 --2- 172.21.15.120:0/4207923710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d90053f00 0x561d9005bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.102+0000 7fe796461740 1 -- 172.21.15.120:0/4207923710 >> 172.21.15.120:0/4207923710 conn(0x561d90050470 msgr2=0x561d9004b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:05.109 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.102+0000 7fe774ff9640 0 client.16041 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:23:05.110 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.103+0000 7fe796461740 1 -- 172.21.15.120:0/4207923710 shutdown_connections 2024-09-19T05:23:05.110 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.103+0000 7fe796461740 1 -- 172.21.15.120:0/4207923710 wait complete. 2024-09-19T05:23:05.110 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.103+0000 7fe796461740 20 client.16041 trim_cache size 0 max 16384 2024-09-19T05:23:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.130+0000 7fe796461740 1 Processor -- start 2024-09-19T05:23:05.132 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.130+0000 7fe796461740 1 -- start start 2024-09-19T05:23:05.133 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.130+0000 7fe796461740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d90053f00 0x561d90076a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:05.133 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.130+0000 7fe796461740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d90054820 0x561d90076f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:05.133 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.130+0000 7fe796461740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d9005f0c0 0x561d90067090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:05.133 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.130+0000 7fe796461740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe78c1adf60 con 0x561d9005f0c0 2024-09-19T05:23:05.133 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.130+0000 7fe796461740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe78c1ab830 con 0x561d90054820 2024-09-19T05:23:05.133 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.130+0000 7fe796461740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe78c1a9680 con 0x561d90053f00 2024-09-19T05:23:05.133 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.130+0000 7fe790b83640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d90054820 0x561d90076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:05.133 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.130+0000 7fe790b83640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d90054820 0x561d90076f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:39294/0 (socket says 172.21.15.120:39294) 2024-09-19T05:23:05.133 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.130+0000 7fe790b83640 1 -- 172.21.15.120:0/4199893919 learned_addr learned my addr 172.21.15.120:0/4199893919 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:23:05.133 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.130+0000 7fe791384640 1 --2- 172.21.15.120:0/4199893919 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d90053f00 0x561d90076a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:05.133 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.130+0000 7fe791b85640 1 --2- 172.21.15.120:0/4199893919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d9005f0c0 0x561d90067090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:05.133 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.131+0000 7fe790b83640 1 -- 172.21.15.120:0/4199893919 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d90053f00 msgr2=0x561d90076a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:05.133 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.131+0000 7fe790b83640 1 --2- 172.21.15.120:0/4199893919 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d90053f00 0x561d90076a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.131+0000 7fe790b83640 1 -- 172.21.15.120:0/4199893919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d9005f0c0 msgr2=0x561d90067090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:05.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.131+0000 7fe790b83640 1 --2- 172.21.15.120:0/4199893919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d9005f0c0 0x561d90067090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.134 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.131+0000 7fe790b83640 1 -- 172.21.15.120:0/4199893919 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d9005ce40 con 0x561d90054820 2024-09-19T05:23:05.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.131+0000 7fe790b83640 1 --2- 172.21.15.120:0/4199893919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d90054820 0x561d90076f90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009900 tx=0x7fe77c005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93213e5d0a880058 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:05.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.131+0000 7fe776ffd640 1 -- 172.21.15.120:0/4199893919 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c035040 con 0x561d90054820 2024-09-19T05:23:05.135 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.131+0000 7fe776ffd640 1 -- 172.21.15.120:0/4199893919 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fe77c005040 con 0x561d90054820 2024-09-19T05:23:05.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.131+0000 7fe776ffd640 1 -- 172.21.15.120:0/4199893919 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c031880 con 0x561d90054820 2024-09-19T05:23:05.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.132+0000 7fe796461740 1 -- 172.21.15.120:0/4199893919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d90054820 msgr2=0x561d90076f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:05.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.132+0000 7fe796461740 1 --2- 172.21.15.120:0/4199893919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d90054820 0x561d90076f90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009900 tx=0x7fe77c005d50 comp rx=0 tx=0).stop 2024-09-19T05:23:05.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.132+0000 7fe796461740 1 -- 172.21.15.120:0/4199893919 shutdown_connections 2024-09-19T05:23:05.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.132+0000 7fe796461740 1 --2- 172.21.15.120:0/4199893919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d9005f0c0 0x561d90067090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.132+0000 7fe796461740 1 --2- 172.21.15.120:0/4199893919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d90054820 0x561d90076f90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.132+0000 7fe796461740 1 --2- 172.21.15.120:0/4199893919 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d90053f00 0x561d90076a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.132+0000 7fe796461740 1 -- 172.21.15.120:0/4199893919 >> 172.21.15.120:0/4199893919 conn(0x561d90050470 msgr2=0x561d9005df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:05.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.133+0000 7fe796461740 1 -- 172.21.15.120:0/4199893919 shutdown_connections 2024-09-19T05:23:05.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.133+0000 7fe796461740 1 -- 172.21.15.120:0/4199893919 wait complete. 2024-09-19T05:23:05.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.133+0000 7fe796461740 1 -- start start 2024-09-19T05:23:05.136 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.133+0000 7fe796461740 1 Processor -- start 2024-09-19T05:23:05.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.134+0000 7fe796461740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d90053f00 0x561d90064070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:05.139 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.134+0000 7fe796461740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d90054820 0x561d900645b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:05.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.134+0000 7fe790b83640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d90054820 0x561d900645b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:05.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.134+0000 7fe791384640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d90053f00 0x561d90064070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:05.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.134+0000 7fe790b83640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d90054820 0x561d900645b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:35498/0 (socket says 172.21.15.120:35498) 2024-09-19T05:23:05.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.134+0000 7fe790b83640 1 -- 172.21.15.120:0/3353765015 learned_addr learned my addr 172.21.15.120:0/3353765015 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:23:05.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.134+0000 7fe791384640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d90053f00 0x561d90064070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:39308/0 (socket says 172.21.15.120:39308) 2024-09-19T05:23:05.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.134+0000 7fe796461740 1 --2- 172.21.15.120:0/3353765015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d9005f0c0 0x561d90064af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:05.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.134+0000 7fe796461740 1 -- 172.21.15.120:0/3353765015 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fe78c1a9cf0 con 0x561d90054820 2024-09-19T05:23:05.140 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.134+0000 7fe796461740 1 -- 172.21.15.120:0/3353765015 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fe78c1ab160 con 0x561d90053f00 2024-09-19T05:23:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.134+0000 7fe796461740 1 -- 172.21.15.120:0/3353765015 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe78c1aa3c0 con 0x561d9005f0c0 2024-09-19T05:23:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.135+0000 7fe791b85640 1 --2- 172.21.15.120:0/3353765015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d9005f0c0 0x561d90064af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.135+0000 7fe791384640 1 -- 172.21.15.120:0/3353765015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d9005f0c0 msgr2=0x561d90064af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.135+0000 7fe791384640 1 --2- 172.21.15.120:0/3353765015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d9005f0c0 0x561d90064af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.135+0000 7fe791384640 1 -- 172.21.15.120:0/3353765015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d90054820 msgr2=0x561d900645b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.135+0000 7fe791384640 1 --2- 172.21.15.120:0/3353765015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d90054820 0x561d900645b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.135+0000 7fe791384640 1 -- 172.21.15.120:0/3353765015 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d900d7c10 con 0x561d90053f00 2024-09-19T05:23:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.135+0000 7fe791b85640 1 --2- 172.21.15.120:0/3353765015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d9005f0c0 0x561d90064af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:23:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.135+0000 7fe790b83640 1 --2- 172.21.15.120:0/3353765015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d90054820 0x561d900645b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:23:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.135+0000 7fe791384640 1 --2- 172.21.15.120:0/3353765015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d90053f00 0x561d90064070 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe78809c100 tx=0x7fe7880bc040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30f6208519ca2af7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.135+0000 7fe774ff9640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:23:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.135+0000 7fe796461740 10 client.0 _ll_register_callbacks cb 0x7fe784011e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:23:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.135+0000 7fe774ff9640 1 -- 172.21.15.120:0/3353765015 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78809c400 con 0x561d90053f00 2024-09-19T05:23:05.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.135+0000 7fe796461740 1 -- 172.21.15.120:0/3353765015 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe77c005040 con 0x561d90053f00 2024-09-19T05:23:05.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.135+0000 7fe774ff9640 1 -- 172.21.15.120:0/3353765015 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fe7880a4b30 con 0x561d90053f00 2024-09-19T05:23:05.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.136+0000 7fe774ff9640 1 -- 172.21.15.120:0/3353765015 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe7880a0700 con 0x561d90053f00 2024-09-19T05:23:05.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.136+0000 7fe796461740 10 client.25499 fetch_fsmap learned FSMap version 29 2024-09-19T05:23:05.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.136+0000 7fe796461740 1 -- 172.21.15.120:0/3353765015 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({fsmap=29}) -- 0x561d900d8d50 con 0x561d90053f00 2024-09-19T05:23:05.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.136+0000 7fe774ff9640 1 -- 172.21.15.120:0/3353765015 <== mon.2 v2:172.21.15.178:3300/0 4 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fe7880b5140 con 0x561d90053f00 2024-09-19T05:23:05.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.136+0000 7fe796461740 10 client.25499 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:23:05.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.136+0000 7fe796461740 10 client.25499 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:23:05.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.136+0000 7fe796461740 20 client.25499 populate_metadata read hostname 'smithi120' 2024-09-19T05:23:05.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.136+0000 7fe796461740 1 --2- 172.21.15.120:0/3353765015 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x561d900d9490 0x561d900db950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:05.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.136+0000 7fe796461740 4 client.25499 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:23:05.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.136+0000 7fe796461740 1 -- 172.21.15.120:0/3353765015 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561d8ffbbd70 con 0x561d900d9490 2024-09-19T05:23:05.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.137+0000 7fe790b83640 1 --2- 172.21.15.120:0/3353765015 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x561d900d9490 0x561d900db950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:05.142 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.137+0000 7fe774ff9640 10 client.25499 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:23:05.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.137+0000 7fe790b83640 1 --2- 172.21.15.120:0/3353765015 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x561d900d9490 0x561d900db950 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5910f0d96a4f96c server_cookie=79158f00086a1a72 in_seq=0 out_seq=0 2024-09-19T05:23:05.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.333+0000 7fe774ff9640 1 -- 172.21.15.120:0/3353765015 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561d8ffbbd70 con 0x561d900d9490 2024-09-19T05:23:05.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.333+0000 7fe774ff9640 10 client.25499 handle_command_reply: tid=0 2024-09-19T05:23:05.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.333+0000 7fe796461740 1 client.25499 shutdown 2024-09-19T05:23:05.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.333+0000 7fe796461740 1 -- 172.21.15.120:0/3353765015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d90053f00 msgr2=0x561d90064070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:05.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.333+0000 7fe796461740 1 --2- 172.21.15.120:0/3353765015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d90053f00 0x561d90064070 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe78809c100 tx=0x7fe7880bc040 comp rx=0 tx=0).stop 2024-09-19T05:23:05.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.334+0000 7fe796461740 1 -- 172.21.15.120:0/3353765015 shutdown_connections 2024-09-19T05:23:05.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.334+0000 7fe796461740 1 --2- 172.21.15.120:0/3353765015 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x561d900d9490 0x561d900db950 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.334+0000 7fe796461740 1 --2- 172.21.15.120:0/3353765015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d9005f0c0 0x561d90064af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.334+0000 7fe796461740 1 --2- 172.21.15.120:0/3353765015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x561d90054820 0x561d900645b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.334+0000 7fe774ff9640 0 client.25499 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:23:05.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.334+0000 7fe796461740 1 --2- 172.21.15.120:0/3353765015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561d90053f00 0x561d90064070 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.334+0000 7fe796461740 1 -- 172.21.15.120:0/3353765015 >> 172.21.15.120:0/3353765015 conn(0x561d90050470 msgr2=0x561d9004a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:05.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.334+0000 7fe796461740 1 -- 172.21.15.120:0/3353765015 shutdown_connections 2024-09-19T05:23:05.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.334+0000 7fe796461740 1 -- 172.21.15.120:0/3353765015 wait complete. 2024-09-19T05:23:05.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.334+0000 7fe796461740 20 client.25499 trim_cache size 0 max 16384 2024-09-19T05:23:05.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:23:05.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:23:05.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:23:05.337 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:23:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.335+0000 7fe7935e8640 1 -- 172.21.15.120:0/3172633234 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fe7780a34e0 msgr2=0x7fe7780a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.335+0000 7fe7935e8640 1 --2- 172.21.15.120:0/3172633234 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fe7780a34e0 0x7fe7780a59a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe784020000 tx=0x7fe784021000 comp rx=0 tx=0).stop 2024-09-19T05:23:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.335+0000 7fe7935e8640 1 -- 172.21.15.120:0/3172633234 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe78c102c80 msgr2=0x7fe78c198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:05.338 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.335+0000 7fe7935e8640 1 --2- 172.21.15.120:0/3172633234 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe78c102c80 0x7fe78c198270 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe78800e9f0 tx=0x7fe78800eeb0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.335+0000 7fe7935e8640 1 -- 172.21.15.120:0/3172633234 shutdown_connections 2024-09-19T05:23:05.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.335+0000 7fe7935e8640 1 --2- 172.21.15.120:0/3172633234 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fe7780a34e0 0x7fe7780a59a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.335+0000 7fe7935e8640 1 --2- 172.21.15.120:0/3172633234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe78c10c0d0 0x7fe78c19cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.335+0000 7fe7935e8640 1 --2- 172.21.15.120:0/3172633234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe78c1035a0 0x7fe78c1987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.335+0000 7fe7935e8640 1 --2- 172.21.15.120:0/3172633234 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe78c102c80 0x7fe78c198270 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:05.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.335+0000 7fe7935e8640 1 -- 172.21.15.120:0/3172633234 >> 172.21.15.120:0/3172633234 conn(0x7fe78c077990 msgr2=0x7fe78c0fd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:05.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.335+0000 7fe7935e8640 1 -- 172.21.15.120:0/3172633234 shutdown_connections 2024-09-19T05:23:05.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:05.335+0000 7fe7935e8640 1 -- 172.21.15.120:0/3172633234 wait complete. 2024-09-19T05:23:06.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:06 smithi120 ceph-mon[30956]: pgmap v119: 97 pgs: 97 active+clean; 299 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 277 op/s 2024-09-19T05:23:06.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:06 smithi194 ceph-mon[35228]: pgmap v119: 97 pgs: 97 active+clean; 299 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 277 op/s 2024-09-19T05:23:06.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:06 smithi178 ceph-mon[34347]: pgmap v119: 97 pgs: 97 active+clean; 299 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.2 MiB/s wr, 277 op/s 2024-09-19T05:23:08.314 INFO:tasks.workunit.client.0.smithi120.stdout: 77 14635 36 9136 122 2323 50 2024-09-19T05:23:08.877 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:08 smithi120 ceph-mon[30956]: pgmap v120: 97 pgs: 97 active+clean; 299 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 165 op/s 2024-09-19T05:23:08.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:08 smithi194 ceph-mon[35228]: pgmap v120: 97 pgs: 97 active+clean; 299 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 165 op/s 2024-09-19T05:23:08.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:08 smithi178 ceph-mon[34347]: pgmap v120: 97 pgs: 97 active+clean; 299 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 165 op/s 2024-09-19T05:23:10.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:10 smithi120 ceph-mon[30956]: pgmap v121: 97 pgs: 97 active+clean; 310 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 207 op/s 2024-09-19T05:23:10.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:10 smithi194 ceph-mon[35228]: pgmap v121: 97 pgs: 97 active+clean; 310 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 207 op/s 2024-09-19T05:23:10.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:10 smithi178 ceph-mon[34347]: pgmap v121: 97 pgs: 97 active+clean; 310 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.9 MiB/s wr, 207 op/s 2024-09-19T05:23:12.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:12 smithi120 ceph-mon[30956]: pgmap v122: 97 pgs: 97 active+clean; 310 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 151 op/s 2024-09-19T05:23:12.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:12 smithi194 ceph-mon[35228]: pgmap v122: 97 pgs: 97 active+clean; 310 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 151 op/s 2024-09-19T05:23:12.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:12 smithi178 ceph-mon[34347]: pgmap v122: 97 pgs: 97 active+clean; 310 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 151 op/s 2024-09-19T05:23:14.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:14 smithi120 ceph-mon[30956]: pgmap v123: 97 pgs: 97 active+clean; 310 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 151 op/s 2024-09-19T05:23:14.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:14 smithi194 ceph-mon[35228]: pgmap v123: 97 pgs: 97 active+clean; 310 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 151 op/s 2024-09-19T05:23:14.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:14 smithi178 ceph-mon[34347]: pgmap v123: 97 pgs: 97 active+clean; 310 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 151 op/s 2024-09-19T05:23:16.707 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:16 smithi194 ceph-mon[35228]: pgmap v124: 97 pgs: 97 active+clean; 320 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 197 op/s 2024-09-19T05:23:16.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:16 smithi120 ceph-mon[30956]: pgmap v124: 97 pgs: 97 active+clean; 320 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 197 op/s 2024-09-19T05:23:16.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:16 smithi178 ceph-mon[34347]: pgmap v124: 97 pgs: 97 active+clean; 320 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.8 MiB/s wr, 197 op/s 2024-09-19T05:23:18.314 INFO:tasks.workunit.client.0.smithi120.stdout: 80 14217 181 9654 34 2685 152 2024-09-19T05:23:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.458+0000 7f46fe8d0640 1 -- 172.21.15.120:0/2763052935 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46f8109080 msgr2=0x7f46f8110bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.458+0000 7f46fe8d0640 1 --2- 172.21.15.120:0/2763052935 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46f8109080 0x7f46f8110bd0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009ca0 tx=0x7f46f002a8c0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.459+0000 7f46fe8d0640 1 -- 172.21.15.120:0/2763052935 shutdown_connections 2024-09-19T05:23:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.459+0000 7f46fe8d0640 1 --2- 172.21.15.120:0/2763052935 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46f8109080 0x7f46f8110bd0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.459+0000 7f46fe8d0640 1 --2- 172.21.15.120:0/2763052935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46f81048e0 0x7f46f8108920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.459+0000 7f46fe8d0640 1 --2- 172.21.15.120:0/2763052935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46f8103f30 0x7f46f8104310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.459+0000 7f46fe8d0640 1 -- 172.21.15.120:0/2763052935 >> 172.21.15.120:0/2763052935 conn(0x7f46f80ff980 msgr2=0x7f46f8101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.459+0000 7f46fe8d0640 1 -- 172.21.15.120:0/2763052935 shutdown_connections 2024-09-19T05:23:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.459+0000 7f46fe8d0640 1 -- 172.21.15.120:0/2763052935 wait complete. 2024-09-19T05:23:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.459+0000 7f46fe8d0640 1 Processor -- start 2024-09-19T05:23:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.459+0000 7f46fe8d0640 1 -- start start 2024-09-19T05:23:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.460+0000 7f46fe8d0640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46f8103f30 0x7f46f8076700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.460+0000 7f46fe8d0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46f8109080 0x7f46f8076c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.460+0000 7f46fe8d0640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46f8077180 0x7f46f81aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.460+0000 7f46fe8d0640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f46f8113f70 con 0x7f46f8109080 2024-09-19T05:23:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.460+0000 7f46fe8d0640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f46f8113df0 con 0x7f46f8103f30 2024-09-19T05:23:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.460+0000 7f46fe8d0640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f46f81140f0 con 0x7f46f8077180 2024-09-19T05:23:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.460+0000 7f46f77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46f8109080 0x7f46f8076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.460+0000 7f46f77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46f8109080 0x7f46f8076c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38804/0 (socket says 172.21.15.120:38804) 2024-09-19T05:23:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.460+0000 7f46f77fe640 1 -- 172.21.15.120:0/3388884181 learned_addr learned my addr 172.21.15.120:0/3388884181 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:23:18.463 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.460+0000 7f46f7fff640 1 --2- 172.21.15.120:0/3388884181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46f8103f30 0x7f46f8076700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:18.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.460+0000 7f46fce6d640 1 --2- 172.21.15.120:0/3388884181 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46f8077180 0x7f46f81aa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:18.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.460+0000 7f46f7fff640 1 -- 172.21.15.120:0/3388884181 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46f8077180 msgr2=0x7f46f81aa9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:18.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.460+0000 7f46f7fff640 1 --2- 172.21.15.120:0/3388884181 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46f8077180 0x7f46f81aa9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.460+0000 7f46f7fff640 1 -- 172.21.15.120:0/3388884181 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46f8109080 msgr2=0x7f46f8076c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:18.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.460+0000 7f46f7fff640 1 --2- 172.21.15.120:0/3388884181 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46f8109080 0x7f46f8076c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.460+0000 7f46f7fff640 1 -- 172.21.15.120:0/3388884181 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f81aaf30 con 0x7f46f8103f30 2024-09-19T05:23:18.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.460+0000 7f46f77fe640 1 --2- 172.21.15.120:0/3388884181 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46f8109080 0x7f46f8076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:23:18.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.461+0000 7f46f7fff640 1 --2- 172.21.15.120:0/3388884181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46f8103f30 0x7f46f8076700 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f46e000e9f0 tx=0x7f46e000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:18.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.461+0000 7f46f57fa640 1 -- 172.21.15.120:0/3388884181 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e000cd80 con 0x7f46f8103f30 2024-09-19T05:23:18.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.461+0000 7f46fe8d0640 1 -- 172.21.15.120:0/3388884181 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46f81ab220 con 0x7f46f8103f30 2024-09-19T05:23:18.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.461+0000 7f46f57fa640 1 -- 172.21.15.120:0/3388884181 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f46e00035f0 con 0x7f46f8103f30 2024-09-19T05:23:18.464 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.461+0000 7f46f57fa640 1 -- 172.21.15.120:0/3388884181 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e0010690 con 0x7f46f8103f30 2024-09-19T05:23:18.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.461+0000 7f46fe8d0640 1 -- 172.21.15.120:0/3388884181 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46f81ab790 con 0x7f46f8103f30 2024-09-19T05:23:18.465 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.463+0000 7f46f57fa640 1 -- 172.21.15.120:0/3388884181 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f46e0004020 con 0x7f46f8103f30 2024-09-19T05:23:18.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.464+0000 7f4701668740 1 Processor -- start 2024-09-19T05:23:18.466 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.464+0000 7f4701668740 1 -- start start 2024-09-19T05:23:18.467 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.464+0000 7f46f57fa640 1 --2- 172.21.15.120:0/3388884181 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f46d80a3460 0x7f46d80a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:18.467 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.464+0000 7f4701668740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556d87d1af0 0x5556d87d1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:18.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.464+0000 7f4701668740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5556d87d2410 0x5556d87dc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:18.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.464+0000 7f4701668740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556d87dccb0 0x5556d87df0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:18.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.464+0000 7f4701668740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5556d87362f0 con 0x5556d87d2410 2024-09-19T05:23:18.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.464+0000 7f4701668740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5556d86de270 con 0x5556d87dccb0 2024-09-19T05:23:18.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.464+0000 7f4701668740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5556d87322b0 con 0x5556d87d1af0 2024-09-19T05:23:18.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.464+0000 7f46f57fa640 1 -- 172.21.15.120:0/3388884181 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f46e00d0040 con 0x7f46f8103f30 2024-09-19T05:23:18.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.465+0000 7f46f77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5556d87d2410 0x5556d87dc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:18.468 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.465+0000 7f46fce6d640 1 --2- 172.21.15.120:0/3388884181 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f46d80a3460 0x7f46d80a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.465+0000 7f46f77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5556d87d2410 0x5556d87dc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38820/0 (socket says 172.21.15.120:38820) 2024-09-19T05:23:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.465+0000 7f46f77fe640 1 -- 172.21.15.120:0/3135668790 learned_addr learned my addr 172.21.15.120:0/3135668790 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:23:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.465+0000 7f46f7fff640 1 --2- 172.21.15.120:0/3135668790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556d87d1af0 0x5556d87d1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.465+0000 7f46fce6d640 1 --2- 172.21.15.120:0/3135668790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556d87dccb0 0x5556d87df0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.465+0000 7f46f77fe640 1 -- 172.21.15.120:0/3135668790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556d87d1af0 msgr2=0x5556d87d1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.465+0000 7f46f77fe640 1 --2- 172.21.15.120:0/3135668790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556d87d1af0 0x5556d87d1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.465+0000 7f46f77fe640 1 -- 172.21.15.120:0/3135668790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556d87dccb0 msgr2=0x5556d87df0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.465+0000 7f46f77fe640 1 --2- 172.21.15.120:0/3135668790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556d87dccb0 0x5556d87df0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.469 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.465+0000 7f46f77fe640 1 -- 172.21.15.120:0/3135668790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556d86dd340 con 0x5556d87d2410 2024-09-19T05:23:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.465+0000 7f46f77fe640 1 --2- 172.21.15.120:0/3135668790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5556d87d2410 0x5556d87dc770 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f46e80114c0 tx=0x7f46e8011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98092524a0a91331 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.465+0000 7f46fce6d640 1 --2- 172.21.15.120:0/3388884181 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f46d80a3460 0x7f46d80a5920 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009430 tx=0x7f46f0009360 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.465+0000 7f46ee7fc640 1 -- 172.21.15.120:0/3135668790 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e8005020 con 0x5556d87d2410 2024-09-19T05:23:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.466+0000 7f46ee7fc640 1 -- 172.21.15.120:0/3135668790 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f46e80047a0 con 0x5556d87d2410 2024-09-19T05:23:18.470 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.466+0000 7f46ee7fc640 1 -- 172.21.15.120:0/3135668790 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e800fa20 con 0x5556d87d2410 2024-09-19T05:23:18.473 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.466+0000 7f4701668740 1 -- 172.21.15.120:0/3135668790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5556d87d2410 msgr2=0x5556d87dc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:18.473 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.466+0000 7f4701668740 1 --2- 172.21.15.120:0/3135668790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5556d87d2410 0x5556d87dc770 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f46e80114c0 tx=0x7f46e8011980 comp rx=0 tx=0).stop 2024-09-19T05:23:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.467+0000 7f4701668740 1 -- 172.21.15.120:0/3135668790 shutdown_connections 2024-09-19T05:23:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.467+0000 7f4701668740 1 --2- 172.21.15.120:0/3135668790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556d87dccb0 0x5556d87df0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.467+0000 7f4701668740 1 --2- 172.21.15.120:0/3135668790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5556d87d2410 0x5556d87dc770 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.467+0000 7f4701668740 1 --2- 172.21.15.120:0/3135668790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556d87d1af0 0x5556d87d1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.467+0000 7f4701668740 1 -- 172.21.15.120:0/3135668790 >> 172.21.15.120:0/3135668790 conn(0x5556d87ce060 msgr2=0x5556d87ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.467+0000 7f4701668740 1 -- 172.21.15.120:0/3135668790 shutdown_connections 2024-09-19T05:23:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.467+0000 7f4701668740 1 -- 172.21.15.120:0/3135668790 wait complete. 2024-09-19T05:23:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.467+0000 7f4701668740 1 -- start start 2024-09-19T05:23:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.468+0000 7f4701668740 1 Processor -- start 2024-09-19T05:23:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.468+0000 7f4701668740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556d87d1af0 0x5556d87d9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.468+0000 7f4701668740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5556d87d2410 0x5556d87da110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:18.474 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.468+0000 7f4701668740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556d87dccb0 0x5556d87da650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.468+0000 7f4701668740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5556d87df880 con 0x5556d87d2410 2024-09-19T05:23:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.468+0000 7f4701668740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5556d86bf290 con 0x5556d87d1af0 2024-09-19T05:23:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.468+0000 7f4701668740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5556d87dfa00 con 0x5556d87dccb0 2024-09-19T05:23:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.468+0000 7f4701668740 10 client.0 _ll_register_callbacks cb 0x5556d86f0140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:23:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.468+0000 7f46f7fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556d87d1af0 0x5556d87d9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.468+0000 7f46fce6d640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556d87dccb0 0x5556d87da650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.468+0000 7f46f7fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556d87d1af0 0x5556d87d9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:47360/0 (socket says 172.21.15.120:47360) 2024-09-19T05:23:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.468+0000 7f46f7fff640 1 -- 172.21.15.120:0/3483916244 learned_addr learned my addr 172.21.15.120:0/3483916244 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:23:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.469+0000 7f46f77fe640 1 --2- 172.21.15.120:0/3483916244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5556d87d2410 0x5556d87da110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.469+0000 7f46f7fff640 1 -- 172.21.15.120:0/3483916244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556d87dccb0 msgr2=0x5556d87da650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.469+0000 7f46f7fff640 1 --2- 172.21.15.120:0/3483916244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556d87dccb0 0x5556d87da650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.469+0000 7f46f7fff640 1 -- 172.21.15.120:0/3483916244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5556d87d2410 msgr2=0x5556d87da110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.469+0000 7f46f7fff640 1 --2- 172.21.15.120:0/3483916244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5556d87d2410 0x5556d87da110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.469+0000 7f46f7fff640 1 -- 172.21.15.120:0/3483916244 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556d8449210 con 0x5556d87d1af0 2024-09-19T05:23:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.469+0000 7f46f77fe640 1 --2- 172.21.15.120:0/3483916244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5556d87d2410 0x5556d87da110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:23:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.470+0000 7f46f7fff640 1 --2- 172.21.15.120:0/3483916244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556d87d1af0 0x5556d87d9bd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f46e009c260 tx=0x7f46e0003bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8d14c31e68056cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.470+0000 7f46e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:23:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.470+0000 7f46e77fe640 1 -- 172.21.15.120:0/3483916244 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e0014230 con 0x5556d87d1af0 2024-09-19T05:23:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.470+0000 7f4701668740 1 -- 172.21.15.120:0/3483916244 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46e80047a0 con 0x5556d87d1af0 2024-09-19T05:23:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.470+0000 7f46e77fe640 1 -- 172.21.15.120:0/3483916244 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f46e0009310 con 0x5556d87d1af0 2024-09-19T05:23:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.470+0000 7f46e77fe640 1 -- 172.21.15.120:0/3483916244 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f46e009c2d0 con 0x5556d87d1af0 2024-09-19T05:23:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.470+0000 7f4701668740 10 client.25511 fetch_fsmap learned FSMap version 29 2024-09-19T05:23:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.470+0000 7f4701668740 1 -- 172.21.15.120:0/3483916244 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5556d8515620 con 0x5556d87d1af0 2024-09-19T05:23:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.471+0000 7f46e77fe640 1 -- 172.21.15.120:0/3483916244 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f46e00a0680 con 0x5556d87d1af0 2024-09-19T05:23:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.471+0000 7f46e77fe640 1 -- 172.21.15.120:0/3483916244 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f46e0098940 con 0x5556d87d1af0 2024-09-19T05:23:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.471+0000 7f4701668740 10 client.25511 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:23:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.471+0000 7f4701668740 10 client.25511 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:23:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.471+0000 7f4701668740 20 client.25511 populate_metadata read hostname 'smithi120' 2024-09-19T05:23:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.471+0000 7f4701668740 1 --2- 172.21.15.120:0/3483916244 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5556d87fdcc0 0x5556d8800110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.471+0000 7f4701668740 4 client.25511 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:23:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.471+0000 7f4701668740 1 -- 172.21.15.120:0/3483916244 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f46e80047a0 con 0x5556d87fdcc0 2024-09-19T05:23:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.471+0000 7f46f77fe640 1 --2- 172.21.15.120:0/3483916244 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5556d87fdcc0 0x5556d8800110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.472+0000 7f46f77fe640 1 --2- 172.21.15.120:0/3483916244 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5556d87fdcc0 0x5556d8800110 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b78c3b8f51066f72 server_cookie=a5a352b07488ef9d in_seq=0 out_seq=0 2024-09-19T05:23:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.472+0000 7f46e77fe640 10 client.25511 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:23:18.478 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.473+0000 7f46e77fe640 1 -- 172.21.15.120:0/3483916244 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f46e80047a0 con 0x5556d87fdcc0 2024-09-19T05:23:18.478 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.473+0000 7f46e77fe640 10 client.25511 handle_command_reply: tid=0 2024-09-19T05:23:18.478 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.473+0000 7f4701668740 1 client.25511 shutdown 2024-09-19T05:23:18.478 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.473+0000 7f4701668740 1 -- 172.21.15.120:0/3483916244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556d87d1af0 msgr2=0x5556d87d9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.473+0000 7f4701668740 1 --2- 172.21.15.120:0/3483916244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556d87d1af0 0x5556d87d9bd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f46e009c260 tx=0x7f46e0003bf0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.473+0000 7f4701668740 1 -- 172.21.15.120:0/3483916244 shutdown_connections 2024-09-19T05:23:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.473+0000 7f4701668740 1 --2- 172.21.15.120:0/3483916244 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5556d87fdcc0 0x5556d8800110 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.473+0000 7f4701668740 1 --2- 172.21.15.120:0/3483916244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556d87dccb0 0x5556d87da650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.473+0000 7f4701668740 1 --2- 172.21.15.120:0/3483916244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5556d87d2410 0x5556d87da110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.473+0000 7f4701668740 1 --2- 172.21.15.120:0/3483916244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556d87d1af0 0x5556d87d9bd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.473+0000 7f4701668740 1 -- 172.21.15.120:0/3483916244 >> 172.21.15.120:0/3483916244 conn(0x5556d87ce060 msgr2=0x5556d87d3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.473+0000 7f46e77fe640 0 client.25511 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:23:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.474+0000 7f4701668740 1 -- 172.21.15.120:0/3483916244 shutdown_connections 2024-09-19T05:23:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.474+0000 7f4701668740 1 -- 172.21.15.120:0/3483916244 wait complete. 2024-09-19T05:23:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.474+0000 7f4701668740 20 client.25511 trim_cache size 0 max 16384 2024-09-19T05:23:18.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.495+0000 7f4701668740 1 Processor -- start 2024-09-19T05:23:18.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.495+0000 7f4701668740 1 -- start start 2024-09-19T05:23:18.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.495+0000 7f4701668740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556d87d1af0 0x5556d87da480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:18.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.495+0000 7f4701668740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5556d87d2410 0x5556d87dbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:18.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.495+0000 7f4701668740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556d87dccb0 0x5556d8805a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:18.498 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.495+0000 7f4701668740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f46f81adee0 con 0x5556d87d2410 2024-09-19T05:23:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.495+0000 7f4701668740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f46f81a2730 con 0x5556d87dccb0 2024-09-19T05:23:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.495+0000 7f4701668740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f46f81a0580 con 0x5556d87d1af0 2024-09-19T05:23:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.496+0000 7f46f77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5556d87d2410 0x5556d87dbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.496+0000 7f46f7fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556d87d1af0 0x5556d87da480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.496+0000 7f46f77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5556d87d2410 0x5556d87dbb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38850/0 (socket says 172.21.15.120:38850) 2024-09-19T05:23:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.496+0000 7f46f77fe640 1 -- 172.21.15.120:0/2058244637 learned_addr learned my addr 172.21.15.120:0/2058244637 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:23:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.496+0000 7f46fce6d640 1 --2- 172.21.15.120:0/2058244637 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556d87dccb0 0x5556d8805a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.496+0000 7f46f7fff640 1 -- 172.21.15.120:0/2058244637 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556d87dccb0 msgr2=0x5556d8805a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.496+0000 7f46f7fff640 1 --2- 172.21.15.120:0/2058244637 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556d87dccb0 0x5556d8805a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.496+0000 7f46f7fff640 1 -- 172.21.15.120:0/2058244637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5556d87d2410 msgr2=0x5556d87dbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.496+0000 7f46f7fff640 1 --2- 172.21.15.120:0/2058244637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5556d87d2410 0x5556d87dbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.496+0000 7f46f7fff640 1 -- 172.21.15.120:0/2058244637 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556d87d1920 con 0x5556d87d1af0 2024-09-19T05:23:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.496+0000 7f46f77fe640 1 --2- 172.21.15.120:0/2058244637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5556d87d2410 0x5556d87dbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:23:18.499 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.496+0000 7f46f7fff640 1 --2- 172.21.15.120:0/2058244637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556d87d1af0 0x5556d87da480 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f46e00cdd40 tx=0x7f46e001cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4a4593251296695 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:18.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.496+0000 7f46edffb640 1 -- 172.21.15.120:0/2058244637 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e0014230 con 0x5556d87d1af0 2024-09-19T05:23:18.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.496+0000 7f46edffb640 1 -- 172.21.15.120:0/2058244637 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f46e00a0680 con 0x5556d87d1af0 2024-09-19T05:23:18.500 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.496+0000 7f46edffb640 1 -- 172.21.15.120:0/2058244637 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e0004310 con 0x5556d87d1af0 2024-09-19T05:23:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.497+0000 7f4701668740 1 -- 172.21.15.120:0/2058244637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556d87d1af0 msgr2=0x5556d87da480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.497+0000 7f4701668740 1 --2- 172.21.15.120:0/2058244637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556d87d1af0 0x5556d87da480 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f46e00cdd40 tx=0x7f46e001cf60 comp rx=0 tx=0).stop 2024-09-19T05:23:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.497+0000 7f4701668740 1 -- 172.21.15.120:0/2058244637 shutdown_connections 2024-09-19T05:23:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.497+0000 7f4701668740 1 --2- 172.21.15.120:0/2058244637 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556d87dccb0 0x5556d8805a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.497+0000 7f4701668740 1 --2- 172.21.15.120:0/2058244637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5556d87d2410 0x5556d87dbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.497+0000 7f4701668740 1 --2- 172.21.15.120:0/2058244637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556d87d1af0 0x5556d87da480 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.497+0000 7f4701668740 1 -- 172.21.15.120:0/2058244637 >> 172.21.15.120:0/2058244637 conn(0x5556d87ce060 msgr2=0x5556d87db430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.497+0000 7f4701668740 1 -- 172.21.15.120:0/2058244637 shutdown_connections 2024-09-19T05:23:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.497+0000 7f4701668740 1 -- 172.21.15.120:0/2058244637 wait complete. 2024-09-19T05:23:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.498+0000 7f4701668740 1 -- start start 2024-09-19T05:23:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.498+0000 7f4701668740 1 Processor -- start 2024-09-19T05:23:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.498+0000 7f4701668740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556d87d1af0 0x5556d87e53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.498+0000 7f4701668740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556d87d2410 0x5556d87e06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.498+0000 7f4701668740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5556d87dccb0 0x5556d87e0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.498+0000 7f4701668740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f46f81a0bf0 con 0x5556d87dccb0 2024-09-19T05:23:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.498+0000 7f4701668740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f46f81a2060 con 0x5556d87d2410 2024-09-19T05:23:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.498+0000 7f4701668740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f46f81a12c0 con 0x5556d87d1af0 2024-09-19T05:23:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.499+0000 7f46f7fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556d87d1af0 0x5556d87e53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.499+0000 7f46f7fff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556d87d1af0 0x5556d87e53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:55622/0 (socket says 172.21.15.120:55622) 2024-09-19T05:23:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.499+0000 7f46f77fe640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556d87d2410 0x5556d87e06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.499+0000 7f4701668740 10 client.0 _ll_register_callbacks cb 0x7f46e0097f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:23:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.499+0000 7f46f7fff640 1 -- 172.21.15.120:0/1112632111 learned_addr learned my addr 172.21.15.120:0/1112632111 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:23:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.499+0000 7f46fce6d640 1 --2- 172.21.15.120:0/1112632111 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5556d87dccb0 0x5556d87e0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.499+0000 7f46f77fe640 1 -- 172.21.15.120:0/1112632111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556d87d1af0 msgr2=0x5556d87e53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.499+0000 7f46f77fe640 1 --2- 172.21.15.120:0/1112632111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556d87d1af0 0x5556d87e53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.499+0000 7f46f77fe640 1 -- 172.21.15.120:0/1112632111 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5556d87dccb0 msgr2=0x5556d87e0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.499+0000 7f46f77fe640 1 --2- 172.21.15.120:0/1112632111 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5556d87dccb0 0x5556d87e0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.499+0000 7f46f77fe640 1 -- 172.21.15.120:0/1112632111 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556d87c92d0 con 0x5556d87d2410 2024-09-19T05:23:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.499+0000 7f46f7fff640 1 --2- 172.21.15.120:0/1112632111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556d87d1af0 0x5556d87e53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:23:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.499+0000 7f46f77fe640 1 --2- 172.21.15.120:0/1112632111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556d87d2410 0x5556d87e06c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f46e8009e30 tx=0x7f46e8009740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f551c1c1bff24b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.499+0000 7f46e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:23:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.499+0000 7f46e77fe640 1 -- 172.21.15.120:0/1112632111 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e801d040 con 0x5556d87d2410 2024-09-19T05:23:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.499+0000 7f46e77fe640 1 -- 172.21.15.120:0/1112632111 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f46e8004700 con 0x5556d87d2410 2024-09-19T05:23:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.499+0000 7f4701668740 1 -- 172.21.15.120:0/1112632111 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46e00a0680 con 0x5556d87d2410 2024-09-19T05:23:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.500+0000 7f46e77fe640 1 -- 172.21.15.120:0/1112632111 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f46e803e050 con 0x5556d87d2410 2024-09-19T05:23:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.500+0000 7f4701668740 10 client.25517 fetch_fsmap learned FSMap version 29 2024-09-19T05:23:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.500+0000 7f4701668740 1 -- 172.21.15.120:0/1112632111 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5556d8868800 con 0x5556d87d2410 2024-09-19T05:23:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.500+0000 7f46e77fe640 1 -- 172.21.15.120:0/1112632111 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f46e00a0680 con 0x5556d87d2410 2024-09-19T05:23:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.500+0000 7f46e77fe640 1 -- 172.21.15.120:0/1112632111 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f46e802f070 con 0x5556d87d2410 2024-09-19T05:23:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.500+0000 7f4701668740 10 client.25517 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:23:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.500+0000 7f4701668740 10 client.25517 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:23:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.500+0000 7f4701668740 20 client.25517 populate_metadata read hostname 'smithi120' 2024-09-19T05:23:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.500+0000 7f4701668740 1 --2- 172.21.15.120:0/1112632111 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5556d8868dc0 0x5556d886b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.500+0000 7f4701668740 4 client.25517 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:23:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.500+0000 7f4701668740 1 -- 172.21.15.120:0/1112632111 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5556d8743a20 con 0x5556d8868dc0 2024-09-19T05:23:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.500+0000 7f46f7fff640 1 --2- 172.21.15.120:0/1112632111 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5556d8868dc0 0x5556d886b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.501+0000 7f46e77fe640 10 client.25517 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:23:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.501+0000 7f46f7fff640 1 --2- 172.21.15.120:0/1112632111 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5556d8868dc0 0x5556d886b1e0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8932bb8a1ea42c2a server_cookie=ef320e2e41bd6ac9 in_seq=0 out_seq=0 2024-09-19T05:23:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.662+0000 7f46e77fe640 1 -- 172.21.15.120:0/1112632111 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5556d8743a20 con 0x5556d8868dc0 2024-09-19T05:23:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.662+0000 7f46e77fe640 10 client.25517 handle_command_reply: tid=0 2024-09-19T05:23:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.663+0000 7f4701668740 1 client.25517 shutdown 2024-09-19T05:23:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.663+0000 7f4701668740 1 -- 172.21.15.120:0/1112632111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556d87d2410 msgr2=0x5556d87e06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.663+0000 7f4701668740 1 --2- 172.21.15.120:0/1112632111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556d87d2410 0x5556d87e06c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f46e8009e30 tx=0x7f46e8009740 comp rx=0 tx=0).stop 2024-09-19T05:23:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.663+0000 7f4701668740 1 -- 172.21.15.120:0/1112632111 shutdown_connections 2024-09-19T05:23:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.663+0000 7f4701668740 1 --2- 172.21.15.120:0/1112632111 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5556d87dccb0 0x5556d87e0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.663+0000 7f4701668740 1 --2- 172.21.15.120:0/1112632111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556d87d2410 0x5556d87e06c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.663+0000 7f4701668740 1 --2- 172.21.15.120:0/1112632111 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5556d8868dc0 0x5556d886b1e0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.663+0000 7f4701668740 1 --2- 172.21.15.120:0/1112632111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5556d87d1af0 0x5556d87e53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.663+0000 7f4701668740 1 -- 172.21.15.120:0/1112632111 >> 172.21.15.120:0/1112632111 conn(0x5556d87ce060 msgr2=0x5556d87d3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.663+0000 7f46e77fe640 0 client.25517 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:23:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.663+0000 7f4701668740 1 -- 172.21.15.120:0/1112632111 shutdown_connections 2024-09-19T05:23:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.663+0000 7f4701668740 1 -- 172.21.15.120:0/1112632111 wait complete. 2024-09-19T05:23:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.664+0000 7f4701668740 20 client.25517 trim_cache size 0 max 16384 2024-09-19T05:23:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:23:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:23:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:23:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:23:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.665+0000 7f46fe8d0640 1 -- 172.21.15.120:0/3388884181 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f46d80a3460 msgr2=0x7f46d80a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.665+0000 7f46fe8d0640 1 --2- 172.21.15.120:0/3388884181 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f46d80a3460 0x7f46d80a5920 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009430 tx=0x7f46f0009360 comp rx=0 tx=0).stop 2024-09-19T05:23:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.665+0000 7f46fe8d0640 1 -- 172.21.15.120:0/3388884181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46f8103f30 msgr2=0x7f46f8076700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.665+0000 7f46fe8d0640 1 --2- 172.21.15.120:0/3388884181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46f8103f30 0x7f46f8076700 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f46e000e9f0 tx=0x7f46e000eeb0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.665+0000 7f46fe8d0640 1 -- 172.21.15.120:0/3388884181 shutdown_connections 2024-09-19T05:23:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.665+0000 7f46fe8d0640 1 --2- 172.21.15.120:0/3388884181 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f46d80a3460 0x7f46d80a5920 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.665+0000 7f46fe8d0640 1 --2- 172.21.15.120:0/3388884181 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46f8077180 0x7f46f81aa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.665+0000 7f46fe8d0640 1 --2- 172.21.15.120:0/3388884181 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f46f8109080 0x7f46f8076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.666+0000 7f46fe8d0640 1 --2- 172.21.15.120:0/3388884181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46f8103f30 0x7f46f8076700 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.666+0000 7f46fe8d0640 1 -- 172.21.15.120:0/3388884181 >> 172.21.15.120:0/3388884181 conn(0x7f46f80ff980 msgr2=0x7f46f8100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.666+0000 7f46fe8d0640 1 -- 172.21.15.120:0/3388884181 shutdown_connections 2024-09-19T05:23:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:18.666+0000 7f46fe8d0640 1 -- 172.21.15.120:0/3388884181 wait complete. 2024-09-19T05:23:18.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:18 smithi120 ceph-mon[30956]: pgmap v125: 97 pgs: 97 active+clean; 320 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 89 op/s 2024-09-19T05:23:18.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:18 smithi194 ceph-mon[35228]: pgmap v125: 97 pgs: 97 active+clean; 320 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 89 op/s 2024-09-19T05:23:18.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:18 smithi178 ceph-mon[34347]: pgmap v125: 97 pgs: 97 active+clean; 320 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 89 op/s 2024-09-19T05:23:20.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:20 smithi120 ceph-mon[30956]: pgmap v126: 97 pgs: 97 active+clean; 321 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 201 op/s 2024-09-19T05:23:20.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:20 smithi194 ceph-mon[35228]: pgmap v126: 97 pgs: 97 active+clean; 321 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 201 op/s 2024-09-19T05:23:20.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:20 smithi178 ceph-mon[34347]: pgmap v126: 97 pgs: 97 active+clean; 321 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.9 MiB/s wr, 201 op/s 2024-09-19T05:23:22.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:22 smithi120 ceph-mon[30956]: pgmap v127: 97 pgs: 97 active+clean; 321 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 158 op/s 2024-09-19T05:23:22.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:22 smithi194 ceph-mon[35228]: pgmap v127: 97 pgs: 97 active+clean; 321 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 158 op/s 2024-09-19T05:23:22.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:22 smithi178 ceph-mon[34347]: pgmap v127: 97 pgs: 97 active+clean; 321 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 158 op/s 2024-09-19T05:23:24.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:24 smithi120 ceph-mon[30956]: pgmap v128: 97 pgs: 97 active+clean; 321 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 158 op/s 2024-09-19T05:23:24.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:24 smithi194 ceph-mon[35228]: pgmap v128: 97 pgs: 97 active+clean; 321 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 158 op/s 2024-09-19T05:23:24.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:24 smithi178 ceph-mon[34347]: pgmap v128: 97 pgs: 97 active+clean; 321 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 158 op/s 2024-09-19T05:23:26.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:26 smithi120 ceph-mon[30956]: pgmap v129: 97 pgs: 97 active+clean; 332 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 197 op/s 2024-09-19T05:23:26.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:26 smithi194 ceph-mon[35228]: pgmap v129: 97 pgs: 97 active+clean; 332 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 197 op/s 2024-09-19T05:23:26.941 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:26 smithi178 ceph-mon[34347]: pgmap v129: 97 pgs: 97 active+clean; 332 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.0 MiB/s wr, 197 op/s 2024-09-19T05:23:28.314 INFO:tasks.workunit.client.0.smithi120.stdout: 80 14229 76 9153 69 4127 78 2024-09-19T05:23:28.743 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:28 smithi178 ceph-mon[34347]: pgmap v130: 97 pgs: 97 active+clean; 332 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 151 op/s 2024-09-19T05:23:28.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:28 smithi120 ceph-mon[30956]: pgmap v130: 97 pgs: 97 active+clean; 332 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 151 op/s 2024-09-19T05:23:28.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:28 smithi194 ceph-mon[35228]: pgmap v130: 97 pgs: 97 active+clean; 332 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 151 op/s 2024-09-19T05:23:29.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:29 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:23:30.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:29 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:23:30.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:29 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:23:30.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:30 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:23:30.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:30 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:23:30.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:30 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:23:30.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:30 smithi178 ceph-mon[34347]: pgmap v131: 97 pgs: 97 active+clean; 344 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.1 MiB/s wr, 200 op/s 2024-09-19T05:23:31.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:30 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:23:31.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:30 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:23:31.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:30 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:23:31.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:30 smithi120 ceph-mon[30956]: pgmap v131: 97 pgs: 97 active+clean; 344 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.1 MiB/s wr, 200 op/s 2024-09-19T05:23:31.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:30 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:23:31.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:30 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:23:31.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:30 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:23:31.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:30 smithi194 ceph-mon[35228]: pgmap v131: 97 pgs: 97 active+clean; 344 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.1 MiB/s wr, 200 op/s 2024-09-19T05:23:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.787+0000 7fc92cfcd640 1 -- 172.21.15.120:0/799827489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc928101350 msgr2=0x7fc92810d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.787+0000 7fc92cfcd640 1 --2- 172.21.15.120:0/799827489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc928101350 0x7fc92810d880 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc920009be0 tx=0x7fc92002a480 comp rx=0 tx=0).stop 2024-09-19T05:23:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.787+0000 7fc92cfcd640 1 -- 172.21.15.120:0/799827489 shutdown_connections 2024-09-19T05:23:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.787+0000 7fc92cfcd640 1 --2- 172.21.15.120:0/799827489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc928101350 0x7fc92810d880 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.787+0000 7fc92cfcd640 1 --2- 172.21.15.120:0/799827489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9281009b0 0x7fc928100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.787+0000 7fc92cfcd640 1 --2- 172.21.15.120:0/799827489 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc9281069c0 0x7fc928106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.787+0000 7fc92cfcd640 1 -- 172.21.15.120:0/799827489 >> 172.21.15.120:0/799827489 conn(0x7fc928077990 msgr2=0x7fc9280fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.787+0000 7fc92cfcd640 1 -- 172.21.15.120:0/799827489 shutdown_connections 2024-09-19T05:23:31.790 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.787+0000 7fc92cfcd640 1 -- 172.21.15.120:0/799827489 wait complete. 2024-09-19T05:23:31.793 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.788+0000 7fc92cfcd640 1 Processor -- start 2024-09-19T05:23:31.793 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.788+0000 7fc92cfcd640 1 -- start start 2024-09-19T05:23:31.793 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.788+0000 7fc92cfcd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9281009b0 0x7fc928195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:31.793 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.788+0000 7fc92cfcd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc928101350 0x7fc9281963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:31.793 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.788+0000 7fc92cfcd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc9281069c0 0x7fc92819a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:31.793 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.788+0000 7fc925d9b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc928101350 0x7fc9281963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.788+0000 7fc92659c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9281009b0 0x7fc928195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.788+0000 7fc92cfcd640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc92810fbb0 con 0x7fc9281069c0 2024-09-19T05:23:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.788+0000 7fc92cfcd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc92810fa30 con 0x7fc9281009b0 2024-09-19T05:23:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.788+0000 7fc925d9b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc928101350 0x7fc9281963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:51760/0 (socket says 172.21.15.120:51760) 2024-09-19T05:23:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.788+0000 7fc925d9b640 1 -- 172.21.15.120:0/4182900622 learned_addr learned my addr 172.21.15.120:0/4182900622 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:23:31.794 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.788+0000 7fc926d9d640 1 --2- 172.21.15.120:0/4182900622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc9281069c0 0x7fc92819a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:31.795 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.789+0000 7fc92cfcd640 1 -- 172.21.15.120:0/4182900622 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc92810fd30 con 0x7fc928101350 2024-09-19T05:23:31.795 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.789+0000 7fc925d9b640 1 -- 172.21.15.120:0/4182900622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9281009b0 msgr2=0x7fc928195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:31.795 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.789+0000 7fc925d9b640 1 --2- 172.21.15.120:0/4182900622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9281009b0 0x7fc928195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.795 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.789+0000 7fc925d9b640 1 -- 172.21.15.120:0/4182900622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc9281069c0 msgr2=0x7fc92819a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:31.795 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.789+0000 7fc925d9b640 1 --2- 172.21.15.120:0/4182900622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc9281069c0 0x7fc92819a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.795 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.789+0000 7fc925d9b640 1 -- 172.21.15.120:0/4182900622 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92819ae50 con 0x7fc928101350 2024-09-19T05:23:31.795 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.789+0000 7fc92659c640 1 --2- 172.21.15.120:0/4182900622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9281009b0 0x7fc928195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:23:31.795 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.789+0000 7fc925d9b640 1 --2- 172.21.15.120:0/4182900622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc928101350 0x7fc9281963a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc91c009ca0 tx=0x7fc91c007590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:31.796 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.789+0000 7fc9177fe640 1 -- 172.21.15.120:0/4182900622 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c0195f0 con 0x7fc928101350 2024-09-19T05:23:31.796 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.789+0000 7fc9177fe640 1 -- 172.21.15.120:0/4182900622 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc91c01e070 con 0x7fc928101350 2024-09-19T05:23:31.796 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.789+0000 7fc9177fe640 1 -- 172.21.15.120:0/4182900622 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c0188e0 con 0x7fc928101350 2024-09-19T05:23:31.796 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.789+0000 7fc92cfcd640 1 -- 172.21.15.120:0/4182900622 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc92819b140 con 0x7fc928101350 2024-09-19T05:23:31.796 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.790+0000 7fc92cfcd640 1 -- 172.21.15.120:0/4182900622 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9281a29d0 con 0x7fc928101350 2024-09-19T05:23:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.792+0000 7fc9177fe640 1 -- 172.21.15.120:0/4182900622 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fc91c019790 con 0x7fc928101350 2024-09-19T05:23:31.804 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.793+0000 7fc92fe42740 1 Processor -- start 2024-09-19T05:23:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.793+0000 7fc92fe42740 1 -- start start 2024-09-19T05:23:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.793+0000 7fc92fe42740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1bf45af0 0x55af1bf45ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.793+0000 7fc92fe42740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55af1bf46410 0x55af1bf50770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.793+0000 7fc92fe42740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55af1bf50cb0 0x55af1bf530a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.793+0000 7fc92fe42740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55af1beaa2f0 con 0x55af1bf46410 2024-09-19T05:23:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.793+0000 7fc92fe42740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55af1be52270 con 0x55af1bf45af0 2024-09-19T05:23:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.793+0000 7fc92fe42740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55af1bea62b0 con 0x55af1bf50cb0 2024-09-19T05:23:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.793+0000 7fc926d9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1bf45af0 0x55af1bf45ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.793+0000 7fc92659c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55af1bf46410 0x55af1bf50770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.793+0000 7fc926d9d640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1bf45af0 0x55af1bf45ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:56826/0 (socket says 172.21.15.120:56826) 2024-09-19T05:23:31.805 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.793+0000 7fc926d9d640 1 -- 172.21.15.120:0/3643164773 learned_addr learned my addr 172.21.15.120:0/3643164773 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:23:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.793+0000 7fc925d9b640 1 --2- 172.21.15.120:0/3643164773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55af1bf50cb0 0x55af1bf530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.794+0000 7fc9177fe640 1 --2- 172.21.15.120:0/4182900622 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fc9100a34e0 0x7fc9100a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.794+0000 7fc926d9d640 1 -- 172.21.15.120:0/3643164773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55af1bf50cb0 msgr2=0x55af1bf530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.794+0000 7fc926d9d640 1 --2- 172.21.15.120:0/3643164773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55af1bf50cb0 0x55af1bf530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.794+0000 7fc926d9d640 1 -- 172.21.15.120:0/3643164773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55af1bf46410 msgr2=0x55af1bf50770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.794+0000 7fc926d9d640 1 --2- 172.21.15.120:0/3643164773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55af1bf46410 0x55af1bf50770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.794+0000 7fc926d9d640 1 -- 172.21.15.120:0/3643164773 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af1be51340 con 0x55af1bf45af0 2024-09-19T05:23:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.794+0000 7fc9177fe640 1 -- 172.21.15.120:0/4182900622 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fc91c0d3620 con 0x7fc928101350 2024-09-19T05:23:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.794+0000 7fc926d9d640 1 --2- 172.21.15.120:0/4182900622 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fc9100a34e0 0x7fc9100a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.794+0000 7fc926d9d640 1 --2- 172.21.15.120:0/3643164773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1bf45af0 0x55af1bf45ed0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc920009560 tx=0x7fc92000a0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4227413bb5bb9827 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.794+0000 7fc914ff9640 1 -- 172.21.15.120:0/3643164773 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc920041040 con 0x55af1bf45af0 2024-09-19T05:23:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.794+0000 7fc914ff9640 1 -- 172.21.15.120:0/3643164773 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc920037040 con 0x55af1bf45af0 2024-09-19T05:23:31.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.794+0000 7fc914ff9640 1 -- 172.21.15.120:0/3643164773 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc920036040 con 0x55af1bf45af0 2024-09-19T05:23:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.795+0000 7fc92fe42740 1 -- 172.21.15.120:0/3643164773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1bf45af0 msgr2=0x55af1bf45ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.795+0000 7fc926d9d640 1 --2- 172.21.15.120:0/4182900622 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fc9100a34e0 0x7fc9100a59a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc920049000 tx=0x7fc920004930 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.795+0000 7fc92fe42740 1 --2- 172.21.15.120:0/3643164773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1bf45af0 0x55af1bf45ed0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc920009560 tx=0x7fc92000a0d0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.795+0000 7fc92fe42740 1 -- 172.21.15.120:0/3643164773 shutdown_connections 2024-09-19T05:23:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.795+0000 7fc92fe42740 1 --2- 172.21.15.120:0/3643164773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55af1bf50cb0 0x55af1bf530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.795+0000 7fc92fe42740 1 --2- 172.21.15.120:0/3643164773 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55af1bf46410 0x55af1bf50770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.795+0000 7fc92fe42740 1 --2- 172.21.15.120:0/3643164773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1bf45af0 0x55af1bf45ed0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.795+0000 7fc92fe42740 1 -- 172.21.15.120:0/3643164773 >> 172.21.15.120:0/3643164773 conn(0x55af1bf42060 msgr2=0x55af1bf42440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.796+0000 7fc92fe42740 1 -- 172.21.15.120:0/3643164773 shutdown_connections 2024-09-19T05:23:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.796+0000 7fc92fe42740 1 -- 172.21.15.120:0/3643164773 wait complete. 2024-09-19T05:23:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.796+0000 7fc92fe42740 1 -- start start 2024-09-19T05:23:31.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.796+0000 7fc92fe42740 1 Processor -- start 2024-09-19T05:23:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.796+0000 7fc92fe42740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1bf45af0 0x55af1bf4db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.796+0000 7fc92fe42740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55af1bf46410 0x55af1bf4e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.797+0000 7fc92fe42740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55af1bf50cb0 0x55af1bf4e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.797+0000 7fc92fe42740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55af1bf53880 con 0x55af1bf50cb0 2024-09-19T05:23:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.797+0000 7fc92fe42740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55af1be33290 con 0x55af1bf45af0 2024-09-19T05:23:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.797+0000 7fc92fe42740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55af1bf53a00 con 0x55af1bf46410 2024-09-19T05:23:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.797+0000 7fc92659c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1bf45af0 0x55af1bf4db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.797+0000 7fc92659c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1bf45af0 0x55af1bf4db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:56840/0 (socket says 172.21.15.120:56840) 2024-09-19T05:23:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.797+0000 7fc92659c640 1 -- 172.21.15.120:0/96628665 learned_addr learned my addr 172.21.15.120:0/96628665 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:23:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.797+0000 7fc92fe42740 10 client.0 _ll_register_callbacks cb 0x55af1be64140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:23:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.797+0000 7fc926d9d640 1 --2- 172.21.15.120:0/96628665 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55af1bf50cb0 0x55af1bf4e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:31.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.797+0000 7fc925d9b640 1 --2- 172.21.15.120:0/96628665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55af1bf46410 0x55af1bf4e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.797+0000 7fc92659c640 1 -- 172.21.15.120:0/96628665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55af1bf46410 msgr2=0x55af1bf4e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.797+0000 7fc92659c640 1 --2- 172.21.15.120:0/96628665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55af1bf46410 0x55af1bf4e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.797+0000 7fc92659c640 1 -- 172.21.15.120:0/96628665 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55af1bf50cb0 msgr2=0x55af1bf4e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.797+0000 7fc92659c640 1 --2- 172.21.15.120:0/96628665 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55af1bf50cb0 0x55af1bf4e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.797+0000 7fc92659c640 1 -- 172.21.15.120:0/96628665 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af1bbbd210 con 0x55af1bf45af0 2024-09-19T05:23:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.797+0000 7fc92659c640 1 --2- 172.21.15.120:0/96628665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1bf45af0 0x55af1bf4db90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc918012aa0 tx=0x7fc918012f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43fa8924da9a9e60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.797+0000 7fc90dffb640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:23:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.798+0000 7fc90dffb640 1 -- 172.21.15.120:0/96628665 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91800fd50 con 0x55af1bf45af0 2024-09-19T05:23:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.798+0000 7fc90dffb640 1 -- 172.21.15.120:0/96628665 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fc918005020 con 0x55af1bf45af0 2024-09-19T05:23:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.798+0000 7fc92fe42740 1 -- 172.21.15.120:0/96628665 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc920037040 con 0x55af1bf45af0 2024-09-19T05:23:31.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.798+0000 7fc90dffb640 1 -- 172.21.15.120:0/96628665 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc918005220 con 0x55af1bf45af0 2024-09-19T05:23:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.798+0000 7fc92fe42740 10 client.25529 fetch_fsmap learned FSMap version 29 2024-09-19T05:23:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.798+0000 7fc92fe42740 1 -- 172.21.15.120:0/96628665 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55af1bc89620 con 0x55af1bf45af0 2024-09-19T05:23:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.798+0000 7fc90dffb640 1 -- 172.21.15.120:0/96628665 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc920037040 con 0x55af1bf45af0 2024-09-19T05:23:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.798+0000 7fc90dffb640 1 -- 172.21.15.120:0/96628665 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fc91801b480 con 0x55af1bf45af0 2024-09-19T05:23:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.798+0000 7fc92fe42740 10 client.25529 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:23:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.798+0000 7fc92fe42740 10 client.25529 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:23:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.798+0000 7fc92fe42740 20 client.25529 populate_metadata read hostname 'smithi120' 2024-09-19T05:23:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.798+0000 7fc92fe42740 1 --2- 172.21.15.120:0/96628665 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55af1bf610b0 0x55af1bf63570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:31.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.798+0000 7fc92fe42740 4 client.25529 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:23:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.798+0000 7fc92fe42740 1 -- 172.21.15.120:0/96628665 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af1beb7a20 con 0x55af1bf610b0 2024-09-19T05:23:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.799+0000 7fc925d9b640 1 --2- 172.21.15.120:0/96628665 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55af1bf610b0 0x55af1bf63570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.799+0000 7fc925d9b640 1 --2- 172.21.15.120:0/96628665 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55af1bf610b0 0x55af1bf63570 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72d3154134e66776 server_cookie=dd5ec7fb7dbef4c2 in_seq=0 out_seq=0 2024-09-19T05:23:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.799+0000 7fc90dffb640 10 client.25529 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:23:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.800+0000 7fc90dffb640 1 -- 172.21.15.120:0/96628665 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55af1beb7a20 con 0x55af1bf610b0 2024-09-19T05:23:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.800+0000 7fc90dffb640 10 client.25529 handle_command_reply: tid=0 2024-09-19T05:23:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.800+0000 7fc92fe42740 1 client.25529 shutdown 2024-09-19T05:23:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.800+0000 7fc92fe42740 1 -- 172.21.15.120:0/96628665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1bf45af0 msgr2=0x55af1bf4db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.800+0000 7fc92fe42740 1 --2- 172.21.15.120:0/96628665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1bf45af0 0x55af1bf4db90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc918012aa0 tx=0x7fc918012f60 comp rx=0 tx=0).stop 2024-09-19T05:23:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.800+0000 7fc92fe42740 1 -- 172.21.15.120:0/96628665 shutdown_connections 2024-09-19T05:23:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.800+0000 7fc92fe42740 1 --2- 172.21.15.120:0/96628665 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55af1bf50cb0 0x55af1bf4e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.811 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.800+0000 7fc92fe42740 1 --2- 172.21.15.120:0/96628665 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55af1bf610b0 0x55af1bf63570 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.800+0000 7fc92fe42740 1 --2- 172.21.15.120:0/96628665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55af1bf46410 0x55af1bf4e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.800+0000 7fc92fe42740 1 --2- 172.21.15.120:0/96628665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1bf45af0 0x55af1bf4db90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.800+0000 7fc92fe42740 1 -- 172.21.15.120:0/96628665 >> 172.21.15.120:0/96628665 conn(0x55af1bf42060 msgr2=0x55af1bf47dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:31.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.800+0000 7fc90dffb640 0 client.25529 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:23:31.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.800+0000 7fc92fe42740 1 -- 172.21.15.120:0/96628665 shutdown_connections 2024-09-19T05:23:31.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.800+0000 7fc92fe42740 1 -- 172.21.15.120:0/96628665 wait complete. 2024-09-19T05:23:31.812 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.800+0000 7fc92fe42740 20 client.25529 trim_cache size 0 max 16384 2024-09-19T05:23:31.825 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.822+0000 7fc92fe42740 1 Processor -- start 2024-09-19T05:23:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.822+0000 7fc92fe42740 1 -- start start 2024-09-19T05:23:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.823+0000 7fc92fe42740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55af1bf45af0 0x55af1bf4e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.823+0000 7fc92fe42740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1bf46410 0x55af1bf4fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.823+0000 7fc92fe42740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55af1bf50cb0 0x55af1bf4add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.823+0000 7fc92fe42740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc9281adfa0 con 0x55af1bf50cb0 2024-09-19T05:23:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.823+0000 7fc92fe42740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc9281ab870 con 0x55af1bf46410 2024-09-19T05:23:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.823+0000 7fc92fe42740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc9281a96c0 con 0x55af1bf45af0 2024-09-19T05:23:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.823+0000 7fc92659c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55af1bf45af0 0x55af1bf4e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:31.826 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.823+0000 7fc926d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55af1bf50cb0 0x55af1bf4add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.823+0000 7fc925d9b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1bf46410 0x55af1bf4fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.823+0000 7fc92659c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55af1bf45af0 0x55af1bf4e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:51780/0 (socket says 172.21.15.120:51780) 2024-09-19T05:23:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.823+0000 7fc92659c640 1 -- 172.21.15.120:0/3710275672 learned_addr learned my addr 172.21.15.120:0/3710275672 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:23:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.823+0000 7fc92659c640 1 -- 172.21.15.120:0/3710275672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1bf46410 msgr2=0x55af1bf4fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.823+0000 7fc92659c640 1 --2- 172.21.15.120:0/3710275672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1bf46410 0x55af1bf4fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.823+0000 7fc92659c640 1 -- 172.21.15.120:0/3710275672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55af1bf50cb0 msgr2=0x55af1bf4add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.823+0000 7fc92659c640 1 --2- 172.21.15.120:0/3710275672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55af1bf50cb0 0x55af1bf4add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.823+0000 7fc92659c640 1 -- 172.21.15.120:0/3710275672 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af1bf46240 con 0x55af1bf45af0 2024-09-19T05:23:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.823+0000 7fc92659c640 1 --2- 172.21.15.120:0/3710275672 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55af1bf45af0 0x55af1bf4e440 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc918009430 tx=0x7fc9180122e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdfce65a74fe4971 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.824+0000 7fc90ffff640 1 -- 172.21.15.120:0/3710275672 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918030070 con 0x55af1bf45af0 2024-09-19T05:23:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.824+0000 7fc90ffff640 1 -- 172.21.15.120:0/3710275672 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc91801bae0 con 0x55af1bf45af0 2024-09-19T05:23:31.827 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.824+0000 7fc90ffff640 1 -- 172.21.15.120:0/3710275672 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91802c460 con 0x55af1bf45af0 2024-09-19T05:23:31.831 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.824+0000 7fc92fe42740 1 -- 172.21.15.120:0/3710275672 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55af1bf45af0 msgr2=0x55af1bf4e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:31.831 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.824+0000 7fc92fe42740 1 --2- 172.21.15.120:0/3710275672 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55af1bf45af0 0x55af1bf4e440 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc918009430 tx=0x7fc9180122e0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.831 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.824+0000 7fc92fe42740 1 -- 172.21.15.120:0/3710275672 shutdown_connections 2024-09-19T05:23:31.831 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.824+0000 7fc92fe42740 1 --2- 172.21.15.120:0/3710275672 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55af1bf50cb0 0x55af1bf4add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.831 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.824+0000 7fc92fe42740 1 --2- 172.21.15.120:0/3710275672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1bf46410 0x55af1bf4fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.831 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.824+0000 7fc92fe42740 1 --2- 172.21.15.120:0/3710275672 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55af1bf45af0 0x55af1bf4e440 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.824+0000 7fc92fe42740 1 -- 172.21.15.120:0/3710275672 >> 172.21.15.120:0/3710275672 conn(0x55af1bf42060 msgr2=0x55af1bf4f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:31.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.825+0000 7fc92fe42740 1 -- 172.21.15.120:0/3710275672 shutdown_connections 2024-09-19T05:23:31.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.825+0000 7fc92fe42740 1 -- 172.21.15.120:0/3710275672 wait complete. 2024-09-19T05:23:31.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.825+0000 7fc92fe42740 1 -- start start 2024-09-19T05:23:31.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.825+0000 7fc92fe42740 1 Processor -- start 2024-09-19T05:23:31.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.825+0000 7fc92fe42740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55af1bf45af0 0x55af1bf65da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:31.832 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.825+0000 7fc92fe42740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55af1bf46410 0x55af1bf662e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.825+0000 7fc92fe42740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1bf50cb0 0x55af1bfc9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.825+0000 7fc92fe42740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc9281a9d30 con 0x55af1bf46410 2024-09-19T05:23:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.825+0000 7fc92fe42740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc9281ab1a0 con 0x55af1bf50cb0 2024-09-19T05:23:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.825+0000 7fc925d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55af1bf46410 0x55af1bf662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.825+0000 7fc92659c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55af1bf45af0 0x55af1bf65da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.825+0000 7fc92fe42740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc9281aa400 con 0x55af1bf45af0 2024-09-19T05:23:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.825+0000 7fc925d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55af1bf46410 0x55af1bf662e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56648/0 (socket says 172.21.15.120:56648) 2024-09-19T05:23:31.833 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.825+0000 7fc92659c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55af1bf45af0 0x55af1bf65da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:51796/0 (socket says 172.21.15.120:51796) 2024-09-19T05:23:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.825+0000 7fc925d9b640 1 -- 172.21.15.120:0/38440400 learned_addr learned my addr 172.21.15.120:0/38440400 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:23:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.826+0000 7fc92fe42740 10 client.0 _ll_register_callbacks cb 0x7fc918009c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:23:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.826+0000 7fc926d9d640 1 --2- 172.21.15.120:0/38440400 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1bf50cb0 0x55af1bfc9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.826+0000 7fc926d9d640 1 -- 172.21.15.120:0/38440400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55af1bf45af0 msgr2=0x55af1bf65da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.826+0000 7fc926d9d640 1 --2- 172.21.15.120:0/38440400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55af1bf45af0 0x55af1bf65da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.826+0000 7fc926d9d640 1 -- 172.21.15.120:0/38440400 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55af1bf46410 msgr2=0x55af1bf662e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.826+0000 7fc926d9d640 1 --2- 172.21.15.120:0/38440400 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55af1bf46410 0x55af1bf662e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.826+0000 7fc926d9d640 1 -- 172.21.15.120:0/38440400 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af1bf66bc0 con 0x55af1bf50cb0 2024-09-19T05:23:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.826+0000 7fc92659c640 1 --2- 172.21.15.120:0/38440400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55af1bf45af0 0x55af1bf65da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:23:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.826+0000 7fc925d9b640 1 --2- 172.21.15.120:0/38440400 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55af1bf46410 0x55af1bf662e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:23:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.826+0000 7fc926d9d640 1 --2- 172.21.15.120:0/38440400 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1bf50cb0 0x55af1bfc9cf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc920034040 tx=0x7fc92004e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79b2b1941e881781 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.826+0000 7fc90dffb640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:23:31.834 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.826+0000 7fc90dffb640 1 -- 172.21.15.120:0/38440400 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc920036040 con 0x55af1bf50cb0 2024-09-19T05:23:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.826+0000 7fc92fe42740 1 -- 172.21.15.120:0/38440400 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc91801bae0 con 0x55af1bf50cb0 2024-09-19T05:23:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.826+0000 7fc90dffb640 1 -- 172.21.15.120:0/38440400 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fc92004e070 con 0x55af1bf50cb0 2024-09-19T05:23:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.827+0000 7fc90dffb640 1 -- 172.21.15.120:0/38440400 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc920009800 con 0x55af1bf50cb0 2024-09-19T05:23:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.827+0000 7fc92fe42740 10 client.25535 fetch_fsmap learned FSMap version 29 2024-09-19T05:23:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.827+0000 7fc92fe42740 1 -- 172.21.15.120:0/38440400 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55af1bfcb370 con 0x55af1bf50cb0 2024-09-19T05:23:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.827+0000 7fc90dffb640 1 -- 172.21.15.120:0/38440400 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc91801bae0 con 0x55af1bf50cb0 2024-09-19T05:23:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.827+0000 7fc90dffb640 1 -- 172.21.15.120:0/38440400 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fc92003c040 con 0x55af1bf50cb0 2024-09-19T05:23:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.827+0000 7fc92fe42740 10 client.25535 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:23:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.827+0000 7fc92fe42740 10 client.25535 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:23:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.827+0000 7fc92fe42740 20 client.25535 populate_metadata read hostname 'smithi120' 2024-09-19T05:23:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.827+0000 7fc92fe42740 1 --2- 172.21.15.120:0/38440400 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55af1bfcb700 0x55af1bfcdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.827+0000 7fc92fe42740 4 client.25535 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:23:31.835 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.827+0000 7fc92fe42740 1 -- 172.21.15.120:0/38440400 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55af1beb1d70 con 0x55af1bfcb700 2024-09-19T05:23:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.827+0000 7fc92659c640 1 --2- 172.21.15.120:0/38440400 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55af1bfcb700 0x55af1bfcdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.828+0000 7fc92659c640 1 --2- 172.21.15.120:0/38440400 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55af1bfcb700 0x55af1bfcdaf0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f18a7effb10ac83 server_cookie=cb22c1a281258154 in_seq=0 out_seq=0 2024-09-19T05:23:31.836 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.828+0000 7fc90dffb640 10 client.25535 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:23:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.910+0000 7fc90dffb640 1 -- 172.21.15.120:0/38440400 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55af1beb1d70 con 0x55af1bfcb700 2024-09-19T05:23:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.910+0000 7fc90dffb640 10 client.25535 handle_command_reply: tid=0 2024-09-19T05:23:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.910+0000 7fc92fe42740 1 client.25535 shutdown 2024-09-19T05:23:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.910+0000 7fc92fe42740 1 -- 172.21.15.120:0/38440400 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1bf50cb0 msgr2=0x55af1bfc9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.910+0000 7fc92fe42740 1 --2- 172.21.15.120:0/38440400 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1bf50cb0 0x55af1bfc9cf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc920034040 tx=0x7fc92004e000 comp rx=0 tx=0).stop 2024-09-19T05:23:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.910+0000 7fc92fe42740 1 -- 172.21.15.120:0/38440400 shutdown_connections 2024-09-19T05:23:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.910+0000 7fc92fe42740 1 --2- 172.21.15.120:0/38440400 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1bf50cb0 0x55af1bfc9cf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.910+0000 7fc92fe42740 1 --2- 172.21.15.120:0/38440400 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55af1bf46410 0x55af1bf662e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.910+0000 7fc92fe42740 1 --2- 172.21.15.120:0/38440400 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55af1bfcb700 0x55af1bfcdaf0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.910+0000 7fc92fe42740 1 --2- 172.21.15.120:0/38440400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55af1bf45af0 0x55af1bf65da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.910+0000 7fc92fe42740 1 -- 172.21.15.120:0/38440400 >> 172.21.15.120:0/38440400 conn(0x55af1bf42060 msgr2=0x55af1bf4c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.910+0000 7fc90dffb640 0 client.25535 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:23:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.911+0000 7fc92fe42740 1 -- 172.21.15.120:0/38440400 shutdown_connections 2024-09-19T05:23:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.911+0000 7fc92fe42740 1 -- 172.21.15.120:0/38440400 wait complete. 2024-09-19T05:23:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.911+0000 7fc92fe42740 20 client.25535 trim_cache size 0 max 16384 2024-09-19T05:23:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:23:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:23:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:23:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:23:31.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.911+0000 7fc92cfcd640 1 -- 172.21.15.120:0/4182900622 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fc9100a34e0 msgr2=0x7fc9100a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:31.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.911+0000 7fc92cfcd640 1 --2- 172.21.15.120:0/4182900622 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fc9100a34e0 0x7fc9100a59a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc920049000 tx=0x7fc920004930 comp rx=0 tx=0).stop 2024-09-19T05:23:31.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.911+0000 7fc92cfcd640 1 -- 172.21.15.120:0/4182900622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc928101350 msgr2=0x7fc9281963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:31.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.912+0000 7fc92cfcd640 1 --2- 172.21.15.120:0/4182900622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc928101350 0x7fc9281963a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc91c009ca0 tx=0x7fc91c007590 comp rx=0 tx=0).stop 2024-09-19T05:23:31.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.912+0000 7fc92cfcd640 1 -- 172.21.15.120:0/4182900622 shutdown_connections 2024-09-19T05:23:31.915 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.912+0000 7fc92cfcd640 1 --2- 172.21.15.120:0/4182900622 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fc9100a34e0 0x7fc9100a59a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.916 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.912+0000 7fc92cfcd640 1 --2- 172.21.15.120:0/4182900622 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc9281069c0 0x7fc92819a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.916 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.912+0000 7fc92cfcd640 1 --2- 172.21.15.120:0/4182900622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc928101350 0x7fc9281963a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.916 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.912+0000 7fc92cfcd640 1 --2- 172.21.15.120:0/4182900622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9281009b0 0x7fc928195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:31.916 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.912+0000 7fc92cfcd640 1 -- 172.21.15.120:0/4182900622 >> 172.21.15.120:0/4182900622 conn(0x7fc928077990 msgr2=0x7fc9280fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:31.916 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.912+0000 7fc92cfcd640 1 -- 172.21.15.120:0/4182900622 shutdown_connections 2024-09-19T05:23:31.916 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:31.912+0000 7fc92cfcd640 1 -- 172.21.15.120:0/4182900622 wait complete. 2024-09-19T05:23:32.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:32 smithi120 ceph-mon[30956]: pgmap v132: 97 pgs: 97 active+clean; 344 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 88 op/s 2024-09-19T05:23:32.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:32 smithi194 ceph-mon[35228]: pgmap v132: 97 pgs: 97 active+clean; 344 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 88 op/s 2024-09-19T05:23:32.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:32 smithi178 ceph-mon[34347]: pgmap v132: 97 pgs: 97 active+clean; 344 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 88 op/s 2024-09-19T05:23:34.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:34 smithi120 ceph-mon[30956]: pgmap v133: 97 pgs: 97 active+clean; 344 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 88 op/s 2024-09-19T05:23:34.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:34 smithi194 ceph-mon[35228]: pgmap v133: 97 pgs: 97 active+clean; 344 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 88 op/s 2024-09-19T05:23:34.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:34 smithi178 ceph-mon[34347]: pgmap v133: 97 pgs: 97 active+clean; 344 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 88 op/s 2024-09-19T05:23:36.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:36 smithi120 ceph-mon[30956]: pgmap v134: 97 pgs: 97 active+clean; 346 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 208 op/s 2024-09-19T05:23:36.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:36 smithi194 ceph-mon[35228]: pgmap v134: 97 pgs: 97 active+clean; 346 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 208 op/s 2024-09-19T05:23:36.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:36 smithi178 ceph-mon[34347]: pgmap v134: 97 pgs: 97 active+clean; 346 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 208 op/s 2024-09-19T05:23:38.314 INFO:tasks.workunit.client.0.smithi120.stdout: 81 13552 68 8832 124 3510 108 2024-09-19T05:23:38.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:38 smithi120 ceph-mon[30956]: pgmap v135: 97 pgs: 97 active+clean; 346 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 169 op/s 2024-09-19T05:23:38.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:38 smithi194 ceph-mon[35228]: pgmap v135: 97 pgs: 97 active+clean; 346 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 169 op/s 2024-09-19T05:23:38.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:38 smithi178 ceph-mon[34347]: pgmap v135: 97 pgs: 97 active+clean; 346 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 169 op/s 2024-09-19T05:23:40.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:40 smithi120 ceph-mon[30956]: pgmap v136: 97 pgs: 97 active+clean; 359 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 248 op/s 2024-09-19T05:23:40.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:40 smithi194 ceph-mon[35228]: pgmap v136: 97 pgs: 97 active+clean; 359 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 248 op/s 2024-09-19T05:23:40.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:40 smithi178 ceph-mon[34347]: pgmap v136: 97 pgs: 97 active+clean; 359 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.3 MiB/s wr, 248 op/s 2024-09-19T05:23:42.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:42 smithi120 ceph-mon[30956]: pgmap v137: 97 pgs: 97 active+clean; 359 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 198 op/s 2024-09-19T05:23:42.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:42 smithi194 ceph-mon[35228]: pgmap v137: 97 pgs: 97 active+clean; 359 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 198 op/s 2024-09-19T05:23:42.943 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:42 smithi178 ceph-mon[34347]: pgmap v137: 97 pgs: 97 active+clean; 359 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 198 op/s 2024-09-19T05:23:44.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:44 smithi120 ceph-mon[30956]: pgmap v138: 97 pgs: 97 active+clean; 359 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 198 op/s 2024-09-19T05:23:44.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:44 smithi194 ceph-mon[35228]: pgmap v138: 97 pgs: 97 active+clean; 359 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 198 op/s 2024-09-19T05:23:44.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:44 smithi178 ceph-mon[34347]: pgmap v138: 97 pgs: 97 active+clean; 359 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 198 op/s 2024-09-19T05:23:45.035 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.033+0000 7f173fbf8640 1 -- 172.21.15.120:0/1841181370 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17381035a0 msgr2=0x7f173810ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:45.035 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.033+0000 7f173fbf8640 1 --2- 172.21.15.120:0/1841181370 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17381035a0 0x7f173810ba80 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1728009900 tx=0x7f172802a480 comp rx=0 tx=0).stop 2024-09-19T05:23:45.035 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.033+0000 7f173fbf8640 1 -- 172.21.15.120:0/1841181370 shutdown_connections 2024-09-19T05:23:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.033+0000 7f173fbf8640 1 --2- 172.21.15.120:0/1841181370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f173810c0d0 0x7f173810e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.033+0000 7f173fbf8640 1 --2- 172.21.15.120:0/1841181370 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17381035a0 0x7f173810ba80 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.033+0000 7f173fbf8640 1 --2- 172.21.15.120:0/1841181370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1738102c80 0x7f1738103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.033+0000 7f173fbf8640 1 -- 172.21.15.120:0/1841181370 >> 172.21.15.120:0/1841181370 conn(0x7f1738077990 msgr2=0x7f17380fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.033+0000 7f173fbf8640 1 -- 172.21.15.120:0/1841181370 shutdown_connections 2024-09-19T05:23:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.033+0000 7f173fbf8640 1 -- 172.21.15.120:0/1841181370 wait complete. 2024-09-19T05:23:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.033+0000 7f173fbf8640 1 Processor -- start 2024-09-19T05:23:45.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.034+0000 7f173fbf8640 1 -- start start 2024-09-19T05:23:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.034+0000 7f173fbf8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1738102c80 0x7f17381008d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.034+0000 7f173fbf8640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17381035a0 0x7f1738100e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.034+0000 7f173fbf8640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f173810c0d0 0x7f1738101350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.034+0000 7f173d994640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1738102c80 0x7f17381008d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.034+0000 7f173fbf8640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1738111db0 con 0x7f1738102c80 2024-09-19T05:23:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.034+0000 7f173d994640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1738102c80 0x7f17381008d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53710/0 (socket says 172.21.15.120:53710) 2024-09-19T05:23:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.034+0000 7f173fbf8640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1738111c30 con 0x7f17381035a0 2024-09-19T05:23:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.034+0000 7f173fbf8640 1 -- 172.21.15.120:0/1117370273 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1738111f30 con 0x7f173810c0d0 2024-09-19T05:23:45.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.034+0000 7f173d994640 1 -- 172.21.15.120:0/1117370273 learned_addr learned my addr 172.21.15.120:0/1117370273 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:23:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.034+0000 7f173d193640 1 --2- 172.21.15.120:0/1117370273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17381035a0 0x7f1738100e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.034+0000 7f173e195640 1 --2- 172.21.15.120:0/1117370273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f173810c0d0 0x7f1738101350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.034+0000 7f173d994640 1 -- 172.21.15.120:0/1117370273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f173810c0d0 msgr2=0x7f1738101350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.034+0000 7f173d994640 1 --2- 172.21.15.120:0/1117370273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f173810c0d0 0x7f1738101350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.034+0000 7f173d994640 1 -- 172.21.15.120:0/1117370273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17381035a0 msgr2=0x7f1738100e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.034+0000 7f173d994640 1 --2- 172.21.15.120:0/1117370273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17381035a0 0x7f1738100e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.034+0000 7f173d994640 1 -- 172.21.15.120:0/1117370273 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17381a67a0 con 0x7f1738102c80 2024-09-19T05:23:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.034+0000 7f173d193640 1 --2- 172.21.15.120:0/1117370273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17381035a0 0x7f1738100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:23:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.035+0000 7f173d994640 1 --2- 172.21.15.120:0/1117370273 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1738102c80 0x7f17381008d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f173400ea60 tx=0x7f173400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.035+0000 7f172effd640 1 -- 172.21.15.120:0/1117370273 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173400cde0 con 0x7f1738102c80 2024-09-19T05:23:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.035+0000 7f172effd640 1 -- 172.21.15.120:0/1117370273 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f17340035f0 con 0x7f1738102c80 2024-09-19T05:23:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.035+0000 7f172effd640 1 -- 172.21.15.120:0/1117370273 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734010690 con 0x7f1738102c80 2024-09-19T05:23:45.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.035+0000 7f173fbf8640 1 -- 172.21.15.120:0/1117370273 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17381a6a90 con 0x7f1738102c80 2024-09-19T05:23:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.035+0000 7f173fbf8640 1 -- 172.21.15.120:0/1117370273 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17381a6f60 con 0x7f1738102c80 2024-09-19T05:23:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.039+0000 7f1742a66740 1 Processor -- start 2024-09-19T05:23:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.039+0000 7f1742a66740 1 -- start start 2024-09-19T05:23:45.041 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.040+0000 7f1742a66740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e32717faf0 0x55e32717fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:45.042 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.040+0000 7f1742a66740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e327180410 0x55e32718a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:45.042 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.040+0000 7f1742a66740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e32718acb0 0x55e32718d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:45.042 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.040+0000 7f1742a66740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55e3270e42f0 con 0x55e327180410 2024-09-19T05:23:45.042 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.040+0000 7f1742a66740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55e32708c270 con 0x55e32718acb0 2024-09-19T05:23:45.042 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.040+0000 7f172effd640 1 -- 172.21.15.120:0/1117370273 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f17340037a0 con 0x7f1738102c80 2024-09-19T05:23:45.042 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.040+0000 7f1742a66740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55e3270e02b0 con 0x55e32717faf0 2024-09-19T05:23:45.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.040+0000 7f173d994640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e327180410 0x55e32718a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:45.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.040+0000 7f173d994640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e327180410 0x55e32718a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53712/0 (socket says 172.21.15.120:53712) 2024-09-19T05:23:45.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.040+0000 7f173d994640 1 -- 172.21.15.120:0/1615915951 learned_addr learned my addr 172.21.15.120:0/1615915951 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:23:45.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.040+0000 7f173e195640 1 --2- 172.21.15.120:0/1615915951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e32717faf0 0x55e32717fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:45.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.040+0000 7f173d193640 1 --2- 172.21.15.120:0/1615915951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e32718acb0 0x55e32718d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:45.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.040+0000 7f173e195640 1 -- 172.21.15.120:0/1615915951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e32718acb0 msgr2=0x55e32718d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:45.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.040+0000 7f173e195640 1 --2- 172.21.15.120:0/1615915951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e32718acb0 0x55e32718d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.040+0000 7f173e195640 1 -- 172.21.15.120:0/1615915951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e327180410 msgr2=0x55e32718a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:45.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.041+0000 7f173e195640 1 --2- 172.21.15.120:0/1615915951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e327180410 0x55e32718a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.041+0000 7f173e195640 1 -- 172.21.15.120:0/1615915951 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e32708b340 con 0x55e32717faf0 2024-09-19T05:23:45.044 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.041+0000 7f173d994640 1 --2- 172.21.15.120:0/1615915951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e327180410 0x55e32718a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:23:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.041+0000 7f172effd640 1 --2- 172.21.15.120:0/1117370273 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f17240a3560 0x7f17240a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.041+0000 7f173d994640 1 --2- 172.21.15.120:0/1117370273 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f17240a3560 0x7f17240a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.041+0000 7f172effd640 1 -- 172.21.15.120:0/1117370273 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f17340cffe0 con 0x7f1738102c80 2024-09-19T05:23:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.041+0000 7f173e195640 1 --2- 172.21.15.120:0/1615915951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e32717faf0 0x55e32717fed0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1730009f00 tx=0x7f1730011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa9ddfe49b3761c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.041+0000 7f173d994640 1 --2- 172.21.15.120:0/1117370273 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f17240a3560 0x7f17240a5a20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f173400d010 tx=0x7f173400ef90 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.042+0000 7f1723fff640 1 -- 172.21.15.120:0/1615915951 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730004d20 con 0x55e32717faf0 2024-09-19T05:23:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.042+0000 7f1723fff640 1 -- 172.21.15.120:0/1615915951 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1730004050 con 0x55e32717faf0 2024-09-19T05:23:45.045 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.042+0000 7f1723fff640 1 -- 172.21.15.120:0/1615915951 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730005280 con 0x55e32717faf0 2024-09-19T05:23:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.043+0000 7f1742a66740 1 -- 172.21.15.120:0/1615915951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e32717faf0 msgr2=0x55e32717fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.043+0000 7f1742a66740 1 --2- 172.21.15.120:0/1615915951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e32717faf0 0x55e32717fed0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1730009f00 tx=0x7f1730011810 comp rx=0 tx=0).stop 2024-09-19T05:23:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.043+0000 7f1742a66740 1 -- 172.21.15.120:0/1615915951 shutdown_connections 2024-09-19T05:23:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.043+0000 7f1742a66740 1 --2- 172.21.15.120:0/1615915951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e32718acb0 0x55e32718d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.043+0000 7f1742a66740 1 --2- 172.21.15.120:0/1615915951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e327180410 0x55e32718a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.043+0000 7f1742a66740 1 --2- 172.21.15.120:0/1615915951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e32717faf0 0x55e32717fed0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.048 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.043+0000 7f1742a66740 1 -- 172.21.15.120:0/1615915951 >> 172.21.15.120:0/1615915951 conn(0x55e32717c060 msgr2=0x55e32717c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.043+0000 7f1742a66740 1 -- 172.21.15.120:0/1615915951 shutdown_connections 2024-09-19T05:23:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.043+0000 7f1742a66740 1 -- 172.21.15.120:0/1615915951 wait complete. 2024-09-19T05:23:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.043+0000 7f1742a66740 1 -- start start 2024-09-19T05:23:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.043+0000 7f1742a66740 1 Processor -- start 2024-09-19T05:23:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.044+0000 7f1742a66740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e32717faf0 0x55e327187b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.044+0000 7f1742a66740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e327180410 0x55e3271880c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.044+0000 7f1742a66740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e32718acb0 0x55e327188600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.044+0000 7f1742a66740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55e32718d880 con 0x55e32717faf0 2024-09-19T05:23:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.044+0000 7f1742a66740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55e32706d290 con 0x55e327180410 2024-09-19T05:23:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.044+0000 7f1742a66740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55e32718da00 con 0x55e32718acb0 2024-09-19T05:23:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.044+0000 7f1742a66740 10 client.0 _ll_register_callbacks cb 0x55e32709e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:23:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.044+0000 7f173e195640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e32717faf0 0x55e327187b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:45.049 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.044+0000 7f173d193640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e327180410 0x55e3271880c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.044+0000 7f173e195640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e32717faf0 0x55e327187b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53726/0 (socket says 172.21.15.120:53726) 2024-09-19T05:23:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.044+0000 7f173d193640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e327180410 0x55e3271880c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:59718/0 (socket says 172.21.15.120:59718) 2024-09-19T05:23:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.044+0000 7f173e195640 1 -- 172.21.15.120:0/3234596776 learned_addr learned my addr 172.21.15.120:0/3234596776 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:23:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.044+0000 7f173e195640 1 --2- 172.21.15.120:0/3234596776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e32718acb0 0x55e327188600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.044+0000 7f173e195640 1 -- 172.21.15.120:0/3234596776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e32718acb0 msgr2=0x55e327188600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.044+0000 7f173e195640 1 --2- 172.21.15.120:0/3234596776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e32718acb0 0x55e327188600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.044+0000 7f173e195640 1 -- 172.21.15.120:0/3234596776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e327180410 msgr2=0x55e3271880c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.044+0000 7f173e195640 1 --2- 172.21.15.120:0/3234596776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e327180410 0x55e3271880c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.044+0000 7f173e195640 1 -- 172.21.15.120:0/3234596776 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e326df7210 con 0x55e32717faf0 2024-09-19T05:23:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.044+0000 7f173d193640 1 --2- 172.21.15.120:0/3234596776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e327180410 0x55e3271880c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:23:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.045+0000 7f173e195640 1 --2- 172.21.15.120:0/3234596776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e32717faf0 0x55e327187b80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1730004fd0 tx=0x7f1730009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca988c459fe37ce4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.045+0000 7f17217fa640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:23:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.045+0000 7f17217fa640 1 -- 172.21.15.120:0/3234596776 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730005200 con 0x55e32717faf0 2024-09-19T05:23:45.050 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.045+0000 7f17217fa640 1 -- 172.21.15.120:0/3234596776 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f17300053a0 con 0x55e32717faf0 2024-09-19T05:23:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.045+0000 7f1742a66740 1 -- 172.21.15.120:0/3234596776 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1730004050 con 0x55e32717faf0 2024-09-19T05:23:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.045+0000 7f17217fa640 1 -- 172.21.15.120:0/3234596776 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1730036050 con 0x55e32717faf0 2024-09-19T05:23:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.045+0000 7f1742a66740 10 client.16092 fetch_fsmap learned FSMap version 29 2024-09-19T05:23:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.045+0000 7f1742a66740 1 -- 172.21.15.120:0/3234596776 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e326ec3620 con 0x55e32717faf0 2024-09-19T05:23:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.045+0000 7f17217fa640 1 -- 172.21.15.120:0/3234596776 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f173002d070 con 0x55e32717faf0 2024-09-19T05:23:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.045+0000 7f17217fa640 1 -- 172.21.15.120:0/3234596776 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f1730019850 con 0x55e32717faf0 2024-09-19T05:23:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.046+0000 7f1742a66740 10 client.16092 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:23:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.046+0000 7f1742a66740 10 client.16092 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:23:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.046+0000 7f1742a66740 20 client.16092 populate_metadata read hostname 'smithi120' 2024-09-19T05:23:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.046+0000 7f1742a66740 1 --2- 172.21.15.120:0/3234596776 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55e3271a33a0 0x55e3271a5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.046+0000 7f1742a66740 4 client.16092 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:23:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.046+0000 7f1742a66740 1 -- 172.21.15.120:0/3234596776 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1730004050 con 0x55e3271a33a0 2024-09-19T05:23:45.051 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.046+0000 7f173d193640 1 --2- 172.21.15.120:0/3234596776 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55e3271a33a0 0x55e3271a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.046+0000 7f17217fa640 10 client.16092 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:23:45.052 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.046+0000 7f173d193640 1 --2- 172.21.15.120:0/3234596776 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55e3271a33a0 0x55e3271a5790 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99fe8df6c63cd7e7 server_cookie=62ccc037558d627c in_seq=0 out_seq=0 2024-09-19T05:23:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.048+0000 7f17217fa640 1 -- 172.21.15.120:0/3234596776 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f1730004050 con 0x55e3271a33a0 2024-09-19T05:23:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.048+0000 7f17217fa640 10 client.16092 handle_command_reply: tid=0 2024-09-19T05:23:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.048+0000 7f1742a66740 1 client.16092 shutdown 2024-09-19T05:23:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.048+0000 7f1742a66740 1 -- 172.21.15.120:0/3234596776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e32717faf0 msgr2=0x55e327187b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.048+0000 7f1742a66740 1 --2- 172.21.15.120:0/3234596776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e32717faf0 0x55e327187b80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1730004fd0 tx=0x7f1730009be0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.048+0000 7f1742a66740 1 -- 172.21.15.120:0/3234596776 shutdown_connections 2024-09-19T05:23:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.048+0000 7f1742a66740 1 --2- 172.21.15.120:0/3234596776 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55e3271a33a0 0x55e3271a5790 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.048+0000 7f1742a66740 1 --2- 172.21.15.120:0/3234596776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e32718acb0 0x55e327188600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.048+0000 7f17217fa640 0 client.16092 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:23:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.048+0000 7f1742a66740 1 --2- 172.21.15.120:0/3234596776 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e327180410 0x55e3271880c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.053 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.048+0000 7f1742a66740 1 --2- 172.21.15.120:0/3234596776 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e32717faf0 0x55e327187b80 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.048+0000 7f1742a66740 1 -- 172.21.15.120:0/3234596776 >> 172.21.15.120:0/3234596776 conn(0x55e32717c060 msgr2=0x55e327181dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:45.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.048+0000 7f1742a66740 1 -- 172.21.15.120:0/3234596776 shutdown_connections 2024-09-19T05:23:45.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.048+0000 7f1742a66740 1 -- 172.21.15.120:0/3234596776 wait complete. 2024-09-19T05:23:45.054 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.049+0000 7f1742a66740 20 client.16092 trim_cache size 0 max 16384 2024-09-19T05:23:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.072+0000 7f1742a66740 1 Processor -- start 2024-09-19T05:23:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.072+0000 7f1742a66740 1 -- start start 2024-09-19T05:23:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.072+0000 7f1742a66740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e32717faf0 0x55e327182560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.072+0000 7f1742a66740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e327180410 0x55e327186aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.072+0000 7f1742a66740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e32718acb0 0x55e3271832b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.072+0000 7f1742a66740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f17381ae040 con 0x55e32717faf0 2024-09-19T05:23:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.072+0000 7f1742a66740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f17381ab910 con 0x55e32718acb0 2024-09-19T05:23:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.072+0000 7f1742a66740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f17381a9780 con 0x55e327180410 2024-09-19T05:23:45.076 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.072+0000 7f173e195640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e32717faf0 0x55e327182560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.072+0000 7f173e195640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e32717faf0 0x55e327182560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53732/0 (socket says 172.21.15.120:53732) 2024-09-19T05:23:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.072+0000 7f173e195640 1 -- 172.21.15.120:0/1121032023 learned_addr learned my addr 172.21.15.120:0/1121032023 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:23:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.073+0000 7f173d193640 1 --2- 172.21.15.120:0/1121032023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e327180410 0x55e327186aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.073+0000 7f173e195640 1 --2- 172.21.15.120:0/1121032023 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e32718acb0 0x55e3271832b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.073+0000 7f173e195640 1 -- 172.21.15.120:0/1121032023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e327180410 msgr2=0x55e327186aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.073+0000 7f173e195640 1 --2- 172.21.15.120:0/1121032023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e327180410 0x55e327186aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.073+0000 7f173e195640 1 -- 172.21.15.120:0/1121032023 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e32718acb0 msgr2=0x55e3271832b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.073+0000 7f173e195640 1 --2- 172.21.15.120:0/1121032023 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e32718acb0 0x55e3271832b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.073+0000 7f173e195640 1 -- 172.21.15.120:0/1121032023 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e32717be90 con 0x55e32717faf0 2024-09-19T05:23:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.073+0000 7f173e195640 1 --2- 172.21.15.120:0/1121032023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e32717faf0 0x55e327182560 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1730005d70 tx=0x7f1730004d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f775366482d49b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.073+0000 7f17237fe640 1 -- 172.21.15.120:0/1121032023 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730019e60 con 0x55e32717faf0 2024-09-19T05:23:45.077 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.073+0000 7f17237fe640 1 -- 172.21.15.120:0/1121032023 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f173002d040 con 0x55e32717faf0 2024-09-19T05:23:45.078 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.073+0000 7f17237fe640 1 -- 172.21.15.120:0/1121032023 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17300198e0 con 0x55e32717faf0 2024-09-19T05:23:45.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.074+0000 7f1742a66740 1 -- 172.21.15.120:0/1121032023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e32717faf0 msgr2=0x55e327182560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:45.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.074+0000 7f1742a66740 1 --2- 172.21.15.120:0/1121032023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e32717faf0 0x55e327182560 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1730005d70 tx=0x7f1730004d50 comp rx=0 tx=0).stop 2024-09-19T05:23:45.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.074+0000 7f1742a66740 1 -- 172.21.15.120:0/1121032023 shutdown_connections 2024-09-19T05:23:45.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.074+0000 7f1742a66740 1 --2- 172.21.15.120:0/1121032023 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e32718acb0 0x55e3271832b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.074+0000 7f1742a66740 1 --2- 172.21.15.120:0/1121032023 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e327180410 0x55e327186aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.074+0000 7f1742a66740 1 --2- 172.21.15.120:0/1121032023 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e32717faf0 0x55e327182560 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.074+0000 7f1742a66740 1 -- 172.21.15.120:0/1121032023 >> 172.21.15.120:0/1121032023 conn(0x55e32717c060 msgr2=0x55e327189c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:45.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.074+0000 7f1742a66740 1 -- 172.21.15.120:0/1121032023 shutdown_connections 2024-09-19T05:23:45.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.075+0000 7f1742a66740 1 -- 172.21.15.120:0/1121032023 wait complete. 2024-09-19T05:23:45.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.075+0000 7f1742a66740 1 -- start start 2024-09-19T05:23:45.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.075+0000 7f1742a66740 1 Processor -- start 2024-09-19T05:23:45.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.075+0000 7f1742a66740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e32717faf0 0x55e3272061a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:45.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.075+0000 7f1742a66740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e327180410 0x55e3272066e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:45.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.075+0000 7f1742a66740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e32718acb0 0x55e327196b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:45.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.075+0000 7f1742a66740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f17381a9dd0 con 0x55e32718acb0 2024-09-19T05:23:45.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.075+0000 7f1742a66740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f17381ab240 con 0x55e32717faf0 2024-09-19T05:23:45.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.075+0000 7f1742a66740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f17381aa4a0 con 0x55e327180410 2024-09-19T05:23:45.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.076+0000 7f1742a66740 10 client.0 _ll_register_callbacks cb 0x7f17340d38f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:23:45.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.076+0000 7f173e195640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e32718acb0 0x55e327196b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:45.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.076+0000 7f173e195640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e32718acb0 0x55e327196b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53738/0 (socket says 172.21.15.120:53738) 2024-09-19T05:23:45.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.076+0000 7f173e195640 1 -- 172.21.15.120:0/229771540 learned_addr learned my addr 172.21.15.120:0/229771540 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:23:45.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.076+0000 7f173d193640 1 --2- 172.21.15.120:0/229771540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e327180410 0x55e3272066e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:45.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.076+0000 7f173e195640 1 --2- 172.21.15.120:0/229771540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e32717faf0 0x55e3272061a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:45.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.076+0000 7f173e195640 1 -- 172.21.15.120:0/229771540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e327180410 msgr2=0x55e3272066e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:45.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.076+0000 7f173e195640 1 --2- 172.21.15.120:0/229771540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e327180410 0x55e3272066e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.076+0000 7f173e195640 1 -- 172.21.15.120:0/229771540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e32717faf0 msgr2=0x55e3272061a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:45.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.076+0000 7f173e195640 1 --2- 172.21.15.120:0/229771540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e32717faf0 0x55e3272061a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.076+0000 7f173e195640 1 -- 172.21.15.120:0/229771540 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e327197240 con 0x55e32718acb0 2024-09-19T05:23:45.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.076+0000 7f173e195640 1 --2- 172.21.15.120:0/229771540 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e32718acb0 0x55e327196b00 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1730002230 tx=0x7f17300255a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ec1364422bccd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:45.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.076+0000 7f17217fa640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:23:45.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.076+0000 7f17217fa640 1 -- 172.21.15.120:0/229771540 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730019e60 con 0x55e32718acb0 2024-09-19T05:23:45.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.077+0000 7f17217fa640 1 -- 172.21.15.120:0/229771540 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f1730019630 con 0x55e32718acb0 2024-09-19T05:23:45.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.077+0000 7f1742a66740 1 -- 172.21.15.120:0/229771540 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f173002d040 con 0x55e32718acb0 2024-09-19T05:23:45.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.077+0000 7f17217fa640 1 -- 172.21.15.120:0/229771540 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f173004f050 con 0x55e32718acb0 2024-09-19T05:23:45.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.077+0000 7f1742a66740 10 client.16098 fetch_fsmap learned FSMap version 29 2024-09-19T05:23:45.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.077+0000 7f1742a66740 1 -- 172.21.15.120:0/229771540 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e32720da20 con 0x55e32718acb0 2024-09-19T05:23:45.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.077+0000 7f17217fa640 1 -- 172.21.15.120:0/229771540 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f173002d040 con 0x55e32718acb0 2024-09-19T05:23:45.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.077+0000 7f17217fa640 1 -- 172.21.15.120:0/229771540 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f173003a430 con 0x55e32718acb0 2024-09-19T05:23:45.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.077+0000 7f1742a66740 10 client.16098 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:23:45.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.077+0000 7f1742a66740 10 client.16098 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:23:45.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.077+0000 7f1742a66740 20 client.16098 populate_metadata read hostname 'smithi120' 2024-09-19T05:23:45.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.077+0000 7f1742a66740 1 --2- 172.21.15.120:0/229771540 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55e32720e060 0x55e327210480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:45.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.077+0000 7f1742a66740 4 client.16098 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:23:45.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.077+0000 7f1742a66740 1 -- 172.21.15.120:0/229771540 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e3270f1a20 con 0x55e32720e060 2024-09-19T05:23:45.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.078+0000 7f173d193640 1 --2- 172.21.15.120:0/229771540 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55e32720e060 0x55e327210480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:45.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.078+0000 7f17217fa640 10 client.16098 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:23:45.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.078+0000 7f173d193640 1 --2- 172.21.15.120:0/229771540 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55e32720e060 0x55e327210480 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3486aa6a98227b76 server_cookie=cf075dd21d26f98d in_seq=0 out_seq=0 2024-09-19T05:23:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.241+0000 7f17217fa640 1 -- 172.21.15.120:0/229771540 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e3270f1a20 con 0x55e32720e060 2024-09-19T05:23:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.241+0000 7f17217fa640 10 client.16098 handle_command_reply: tid=0 2024-09-19T05:23:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.241+0000 7f1742a66740 1 client.16098 shutdown 2024-09-19T05:23:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.241+0000 7f1742a66740 1 -- 172.21.15.120:0/229771540 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e32718acb0 msgr2=0x55e327196b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.241+0000 7f1742a66740 1 --2- 172.21.15.120:0/229771540 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e32718acb0 0x55e327196b00 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1730002230 tx=0x7f17300255a0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.242+0000 7f1742a66740 1 -- 172.21.15.120:0/229771540 shutdown_connections 2024-09-19T05:23:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.242+0000 7f1742a66740 1 --2- 172.21.15.120:0/229771540 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55e32718acb0 0x55e327196b00 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.242+0000 7f1742a66740 1 --2- 172.21.15.120:0/229771540 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55e32720e060 0x55e327210480 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.242+0000 7f1742a66740 1 --2- 172.21.15.120:0/229771540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e327180410 0x55e3272066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.245 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.242+0000 7f1742a66740 1 --2- 172.21.15.120:0/229771540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e32717faf0 0x55e3272061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.245 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.242+0000 7f1742a66740 1 -- 172.21.15.120:0/229771540 >> 172.21.15.120:0/229771540 conn(0x55e32717c060 msgr2=0x55e327187b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:45.245 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.242+0000 7f17217fa640 0 client.16098 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:23:45.245 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.242+0000 7f1742a66740 1 -- 172.21.15.120:0/229771540 shutdown_connections 2024-09-19T05:23:45.245 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.242+0000 7f1742a66740 1 -- 172.21.15.120:0/229771540 wait complete. 2024-09-19T05:23:45.245 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.242+0000 7f1742a66740 20 client.16098 trim_cache size 0 max 16384 2024-09-19T05:23:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:23:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:23:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:23:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:23:45.247 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.243+0000 7f173fbf8640 1 -- 172.21.15.120:0/1117370273 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f17240a3560 msgr2=0x7f17240a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:45.247 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.243+0000 7f173fbf8640 1 --2- 172.21.15.120:0/1117370273 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f17240a3560 0x7f17240a5a20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f173400d010 tx=0x7f173400ef90 comp rx=0 tx=0).stop 2024-09-19T05:23:45.247 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.243+0000 7f173fbf8640 1 -- 172.21.15.120:0/1117370273 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1738102c80 msgr2=0x7f17381008d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:45.247 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.243+0000 7f173fbf8640 1 --2- 172.21.15.120:0/1117370273 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1738102c80 0x7f17381008d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f173400ea60 tx=0x7f173400ef20 comp rx=0 tx=0).stop 2024-09-19T05:23:45.247 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.244+0000 7f173fbf8640 1 -- 172.21.15.120:0/1117370273 shutdown_connections 2024-09-19T05:23:45.247 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.244+0000 7f173fbf8640 1 --2- 172.21.15.120:0/1117370273 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f17240a3560 0x7f17240a5a20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.247 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.244+0000 7f173fbf8640 1 --2- 172.21.15.120:0/1117370273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f173810c0d0 0x7f1738101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.247 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.244+0000 7f173fbf8640 1 --2- 172.21.15.120:0/1117370273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17381035a0 0x7f1738100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.244+0000 7f173fbf8640 1 --2- 172.21.15.120:0/1117370273 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1738102c80 0x7f17381008d0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:45.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.244+0000 7f173fbf8640 1 -- 172.21.15.120:0/1117370273 >> 172.21.15.120:0/1117370273 conn(0x7f1738077990 msgr2=0x7f17380fd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:45.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.244+0000 7f173fbf8640 1 -- 172.21.15.120:0/1117370273 shutdown_connections 2024-09-19T05:23:45.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:45.244+0000 7f173fbf8640 1 -- 172.21.15.120:0/1117370273 wait complete. 2024-09-19T05:23:46.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:46 smithi120 ceph-mon[30956]: pgmap v139: 97 pgs: 97 active+clean; 356 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.5 MiB/s wr, 323 op/s 2024-09-19T05:23:46.707 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:46 smithi194 ceph-mon[35228]: pgmap v139: 97 pgs: 97 active+clean; 356 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.5 MiB/s wr, 323 op/s 2024-09-19T05:23:46.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:46 smithi178 ceph-mon[34347]: pgmap v139: 97 pgs: 97 active+clean; 356 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.5 MiB/s wr, 323 op/s 2024-09-19T05:23:48.315 INFO:tasks.workunit.client.0.smithi120.stdout: 83 13366 141 9014 85 2784 180 2024-09-19T05:23:48.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:48 smithi120 ceph-mon[30956]: pgmap v140: 97 pgs: 97 active+clean; 356 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 202 op/s 2024-09-19T05:23:48.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:48 smithi194 ceph-mon[35228]: pgmap v140: 97 pgs: 97 active+clean; 356 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 202 op/s 2024-09-19T05:23:48.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:48 smithi178 ceph-mon[34347]: pgmap v140: 97 pgs: 97 active+clean; 356 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 202 op/s 2024-09-19T05:23:50.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:50 smithi120 ceph-mon[30956]: pgmap v141: 97 pgs: 97 active+clean; 370 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 268 op/s 2024-09-19T05:23:50.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:50 smithi194 ceph-mon[35228]: pgmap v141: 97 pgs: 97 active+clean; 370 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 268 op/s 2024-09-19T05:23:50.941 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:50 smithi178 ceph-mon[34347]: pgmap v141: 97 pgs: 97 active+clean; 370 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.5 MiB/s wr, 268 op/s 2024-09-19T05:23:52.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:52 smithi120 ceph-mon[30956]: pgmap v142: 97 pgs: 97 active+clean; 370 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 190 op/s 2024-09-19T05:23:52.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:52 smithi194 ceph-mon[35228]: pgmap v142: 97 pgs: 97 active+clean; 370 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 190 op/s 2024-09-19T05:23:52.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:52 smithi178 ceph-mon[34347]: pgmap v142: 97 pgs: 97 active+clean; 370 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 190 op/s 2024-09-19T05:23:54.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:54 smithi120 ceph-mon[30956]: pgmap v143: 97 pgs: 97 active+clean; 370 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 190 op/s 2024-09-19T05:23:54.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:54 smithi194 ceph-mon[35228]: pgmap v143: 97 pgs: 97 active+clean; 370 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 190 op/s 2024-09-19T05:23:54.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:54 smithi178 ceph-mon[34347]: pgmap v143: 97 pgs: 97 active+clean; 370 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 190 op/s 2024-09-19T05:23:56.742 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:56 smithi120 ceph-mon[30956]: pgmap v144: 97 pgs: 97 active+clean; 384 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 272 op/s 2024-09-19T05:23:56.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:56 smithi194 ceph-mon[35228]: pgmap v144: 97 pgs: 97 active+clean; 384 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 272 op/s 2024-09-19T05:23:56.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:56 smithi178 ceph-mon[34347]: pgmap v144: 97 pgs: 97 active+clean; 384 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 272 op/s 2024-09-19T05:23:58.315 INFO:tasks.workunit.client.0.smithi120.stdout: 84 13024 117 8254 82 3108 259 2024-09-19T05:23:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.370+0000 7fa00fbcf640 1 -- 172.21.15.120:0/3128154098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0081026f0 msgr2=0x7fa00810d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.370+0000 7fa00fbcf640 1 --2- 172.21.15.120:0/3128154098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0081026f0 0x7fa00810d110 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa000009900 tx=0x7fa00002b620 comp rx=0 tx=0).stop 2024-09-19T05:23:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.370+0000 7fa00fbcf640 1 -- 172.21.15.120:0/3128154098 shutdown_connections 2024-09-19T05:23:58.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.370+0000 7fa00fbcf640 1 --2- 172.21.15.120:0/3128154098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0081026f0 0x7fa00810d110 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.370+0000 7fa00fbcf640 1 --2- 172.21.15.120:0/3128154098 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa008101d70 0x7fa0081021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.370+0000 7fa00fbcf640 1 --2- 172.21.15.120:0/3128154098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa008100490 0x7fa008100870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.370+0000 7fa00fbcf640 1 -- 172.21.15.120:0/3128154098 >> 172.21.15.120:0/3128154098 conn(0x7fa0080770f0 msgr2=0x7fa0080fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:58.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.370+0000 7fa00fbcf640 1 -- 172.21.15.120:0/3128154098 shutdown_connections 2024-09-19T05:23:58.373 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.370+0000 7fa00fbcf640 1 -- 172.21.15.120:0/3128154098 wait complete. 2024-09-19T05:23:58.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.371+0000 7fa00fbcf640 1 Processor -- start 2024-09-19T05:23:58.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.371+0000 7fa00fbcf640 1 -- start start 2024-09-19T05:23:58.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.371+0000 7fa00fbcf640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa008100490 0x7fa00819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:58.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.371+0000 7fa00fbcf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa008101d70 0x7fa00819a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:58.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.371+0000 7fa00fbcf640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0081026f0 0x7fa00819ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:58.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.371+0000 7fa00fbcf640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa00810fc80 con 0x7fa008101d70 2024-09-19T05:23:58.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.371+0000 7fa00fbcf640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa00810fb00 con 0x7fa008100490 2024-09-19T05:23:58.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.371+0000 7fa00fbcf640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa00810fe00 con 0x7fa0081026f0 2024-09-19T05:23:58.375 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.371+0000 7fa00d16a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa008101d70 0x7fa00819a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:58.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.371+0000 7fa00d16a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa008101d70 0x7fa00819a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51100/0 (socket says 172.21.15.120:51100) 2024-09-19T05:23:58.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.371+0000 7fa00d16a640 1 -- 172.21.15.120:0/1634071230 learned_addr learned my addr 172.21.15.120:0/1634071230 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:23:58.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.371+0000 7fa00e16c640 1 --2- 172.21.15.120:0/1634071230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0081026f0 0x7fa00819ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:58.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.371+0000 7fa00d96b640 1 --2- 172.21.15.120:0/1634071230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa008100490 0x7fa00819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:58.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.372+0000 7fa00d16a640 1 -- 172.21.15.120:0/1634071230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0081026f0 msgr2=0x7fa00819ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:58.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.372+0000 7fa00d16a640 1 --2- 172.21.15.120:0/1634071230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0081026f0 0x7fa00819ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.372+0000 7fa00d16a640 1 -- 172.21.15.120:0/1634071230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa008100490 msgr2=0x7fa00819a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:58.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.372+0000 7fa00d16a640 1 --2- 172.21.15.120:0/1634071230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa008100490 0x7fa00819a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.372+0000 7fa00d16a640 1 -- 172.21.15.120:0/1634071230 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00819f430 con 0x7fa008101d70 2024-09-19T05:23:58.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.372+0000 7fa00e16c640 1 --2- 172.21.15.120:0/1634071230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0081026f0 0x7fa00819ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:23:58.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.372+0000 7fa00d96b640 1 --2- 172.21.15.120:0/1634071230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa008100490 0x7fa00819a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:23:58.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.372+0000 7fa00d16a640 1 --2- 172.21.15.120:0/1634071230 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa008101d70 0x7fa00819a980 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800e990 tx=0x7f9ff800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:58.376 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.372+0000 7f9ffeffd640 1 -- 172.21.15.120:0/1634071230 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff800cbe0 con 0x7fa008101d70 2024-09-19T05:23:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.372+0000 7f9ffeffd640 1 -- 172.21.15.120:0/1634071230 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9ff800cd80 con 0x7fa008101d70 2024-09-19T05:23:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.372+0000 7f9ffeffd640 1 -- 172.21.15.120:0/1634071230 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8011470 con 0x7fa008101d70 2024-09-19T05:23:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.372+0000 7fa00fbcf640 1 -- 172.21.15.120:0/1634071230 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa00819f720 con 0x7fa008101d70 2024-09-19T05:23:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.372+0000 7fa00fbcf640 1 -- 172.21.15.120:0/1634071230 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0081a6fb0 con 0x7fa008101d70 2024-09-19T05:23:58.377 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.376+0000 7fa012a43740 1 Processor -- start 2024-09-19T05:23:58.378 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.376+0000 7fa012a43740 1 -- start start 2024-09-19T05:23:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.376+0000 7fa012a43740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563229f2af0 0x5563229f2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.376+0000 7fa012a43740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5563229f3410 0x5563229fd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.376+0000 7fa012a43740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563229fdcb0 0x556322a000a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.376+0000 7fa012a43740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5563229572f0 con 0x5563229fdcb0 2024-09-19T05:23:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.376+0000 7fa012a43740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5563228ff270 con 0x5563229f2af0 2024-09-19T05:23:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.376+0000 7fa012a43740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5563229532b0 con 0x5563229f3410 2024-09-19T05:23:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.377+0000 7f9ffeffd640 1 -- 172.21.15.120:0/1634071230 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f9ff8004f80 con 0x7fa008101d70 2024-09-19T05:23:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.377+0000 7fa00d96b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5563229f3410 0x5563229fd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.377+0000 7fa00d96b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5563229f3410 0x5563229fd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:47468/0 (socket says 172.21.15.120:47468) 2024-09-19T05:23:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.377+0000 7fa00d96b640 1 -- 172.21.15.120:0/2447324793 learned_addr learned my addr 172.21.15.120:0/2447324793 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:23:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.377+0000 7fa00e16c640 1 --2- 172.21.15.120:0/2447324793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563229f2af0 0x5563229f2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:58.379 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.377+0000 7fa00d16a640 1 --2- 172.21.15.120:0/2447324793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563229fdcb0 0x556322a000a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:58.380 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.377+0000 7fa00d96b640 1 -- 172.21.15.120:0/2447324793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563229f2af0 msgr2=0x5563229f2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.377+0000 7fa00d96b640 1 --2- 172.21.15.120:0/2447324793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563229f2af0 0x5563229f2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.377+0000 7fa00d96b640 1 -- 172.21.15.120:0/2447324793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563229fdcb0 msgr2=0x556322a000a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.378+0000 7f9ffeffd640 1 --2- 172.21.15.120:0/1634071230 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f9ff40a3560 0x7f9ff40a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.378+0000 7fa00d96b640 1 --2- 172.21.15.120:0/2447324793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563229fdcb0 0x556322a000a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.378+0000 7fa00d96b640 1 -- 172.21.15.120:0/2447324793 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563228fe340 con 0x5563229f3410 2024-09-19T05:23:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.378+0000 7fa00e16c640 1 --2- 172.21.15.120:0/2447324793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563229f2af0 0x5563229f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:23:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.378+0000 7fa00d16a640 1 --2- 172.21.15.120:0/2447324793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563229fdcb0 0x556322a000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:23:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.378+0000 7f9ffeffd640 1 -- 172.21.15.120:0/1634071230 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f9ff80cfe30 con 0x7fa008101d70 2024-09-19T05:23:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.378+0000 7fa00e16c640 1 --2- 172.21.15.120:0/1634071230 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f9ff40a3560 0x7f9ff40a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.378+0000 7fa00d96b640 1 --2- 172.21.15.120:0/2447324793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5563229f3410 0x5563229fd770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa00400f390 tx=0x7fa00400f850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4467c73360effa81 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.378+0000 7f9ff3fff640 1 -- 172.21.15.120:0/2447324793 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa004003b70 con 0x5563229f3410 2024-09-19T05:23:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.378+0000 7f9ff3fff640 1 -- 172.21.15.120:0/2447324793 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa004003d10 con 0x5563229f3410 2024-09-19T05:23:58.381 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.378+0000 7f9ff3fff640 1 -- 172.21.15.120:0/2447324793 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa004011a10 con 0x5563229f3410 2024-09-19T05:23:58.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.379+0000 7fa012a43740 1 -- 172.21.15.120:0/2447324793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5563229f3410 msgr2=0x5563229fd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:58.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.379+0000 7fa012a43740 1 --2- 172.21.15.120:0/2447324793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5563229f3410 0x5563229fd770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa00400f390 tx=0x7fa00400f850 comp rx=0 tx=0).stop 2024-09-19T05:23:58.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.379+0000 7fa00e16c640 1 --2- 172.21.15.120:0/1634071230 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f9ff40a3560 0x7f9ff40a5a20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa000005c40 tx=0x7fa00000c2d0 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:58.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.379+0000 7fa012a43740 1 -- 172.21.15.120:0/2447324793 shutdown_connections 2024-09-19T05:23:58.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.379+0000 7fa012a43740 1 --2- 172.21.15.120:0/2447324793 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563229fdcb0 0x556322a000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.379+0000 7fa012a43740 1 --2- 172.21.15.120:0/2447324793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5563229f3410 0x5563229fd770 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.379+0000 7fa012a43740 1 --2- 172.21.15.120:0/2447324793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563229f2af0 0x5563229f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.379+0000 7fa012a43740 1 -- 172.21.15.120:0/2447324793 >> 172.21.15.120:0/2447324793 conn(0x5563229ef060 msgr2=0x5563229ef440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:58.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.380+0000 7fa012a43740 1 -- 172.21.15.120:0/2447324793 shutdown_connections 2024-09-19T05:23:58.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.380+0000 7fa012a43740 1 -- 172.21.15.120:0/2447324793 wait complete. 2024-09-19T05:23:58.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.380+0000 7fa012a43740 1 -- start start 2024-09-19T05:23:58.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.380+0000 7fa012a43740 1 Processor -- start 2024-09-19T05:23:58.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.381+0000 7fa012a43740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563229f2af0 0x5563229fab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:58.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.381+0000 7fa012a43740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563229f3410 0x5563229fb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:58.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.381+0000 7fa012a43740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5563229fdcb0 0x5563229fb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:58.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.381+0000 7fa012a43740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556322a00880 con 0x5563229f3410 2024-09-19T05:23:58.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.381+0000 7fa00d96b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563229f2af0 0x5563229fab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:58.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.381+0000 7fa00d96b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563229f2af0 0x5563229fab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:45466/0 (socket says 172.21.15.120:45466) 2024-09-19T05:23:58.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.381+0000 7fa00d96b640 1 -- 172.21.15.120:0/326811565 learned_addr learned my addr 172.21.15.120:0/326811565 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:23:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.381+0000 7fa012a43740 1 -- 172.21.15.120:0/326811565 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5563228e0290 con 0x5563229f2af0 2024-09-19T05:23:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.381+0000 7fa012a43740 1 -- 172.21.15.120:0/326811565 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x556322a00a00 con 0x5563229fdcb0 2024-09-19T05:23:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.381+0000 7fa00e16c640 1 --2- 172.21.15.120:0/326811565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5563229fdcb0 0x5563229fb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.381+0000 7fa00d16a640 1 --2- 172.21.15.120:0/326811565 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563229f3410 0x5563229fb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.381+0000 7fa012a43740 10 client.0 _ll_register_callbacks cb 0x556322911140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:23:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.381+0000 7fa00d96b640 1 -- 172.21.15.120:0/326811565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5563229fdcb0 msgr2=0x5563229fb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.381+0000 7fa00d96b640 1 --2- 172.21.15.120:0/326811565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5563229fdcb0 0x5563229fb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.381+0000 7fa00d96b640 1 -- 172.21.15.120:0/326811565 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563229f3410 msgr2=0x5563229fb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.381+0000 7fa00d96b640 1 --2- 172.21.15.120:0/326811565 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563229f3410 0x5563229fb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.381+0000 7fa00d96b640 1 -- 172.21.15.120:0/326811565 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55632266a210 con 0x5563229f2af0 2024-09-19T05:23:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.382+0000 7fa00d96b640 1 --2- 172.21.15.120:0/326811565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563229f2af0 0x5563229fab50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa004003bd0 tx=0x7fa004003c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16ef20c3fee41dd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.382+0000 7f9ff17fa640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:23:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.382+0000 7f9ff17fa640 1 -- 172.21.15.120:0/326811565 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0040119a0 con 0x5563229f2af0 2024-09-19T05:23:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.382+0000 7f9ff17fa640 1 -- 172.21.15.120:0/326811565 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fa004011b40 con 0x5563229f2af0 2024-09-19T05:23:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.382+0000 7fa012a43740 1 -- 172.21.15.120:0/326811565 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa004003d10 con 0x5563229f2af0 2024-09-19T05:23:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.382+0000 7f9ff17fa640 1 -- 172.21.15.120:0/326811565 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa004011d40 con 0x5563229f2af0 2024-09-19T05:23:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.382+0000 7fa012a43740 10 client.25562 fetch_fsmap learned FSMap version 29 2024-09-19T05:23:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.382+0000 7fa012a43740 1 -- 172.21.15.120:0/326811565 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556322736620 con 0x5563229f2af0 2024-09-19T05:23:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.383+0000 7f9ff17fa640 1 -- 172.21.15.120:0/326811565 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa004003d10 con 0x5563229f2af0 2024-09-19T05:23:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.383+0000 7f9ff17fa640 1 -- 172.21.15.120:0/326811565 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fa0040264b0 con 0x5563229f2af0 2024-09-19T05:23:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.383+0000 7fa012a43740 10 client.25562 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:23:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.383+0000 7fa012a43740 10 client.25562 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:23:58.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.383+0000 7fa012a43740 20 client.25562 populate_metadata read hostname 'smithi120' 2024-09-19T05:23:58.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.383+0000 7fa012a43740 1 --2- 172.21.15.120:0/326811565 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556322a0db40 0x556322a0ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:58.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.383+0000 7fa012a43740 4 client.25562 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:23:58.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.383+0000 7fa012a43740 1 -- 172.21.15.120:0/326811565 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556322964a20 con 0x556322a0db40 2024-09-19T05:23:58.389 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.383+0000 7fa00d16a640 1 --2- 172.21.15.120:0/326811565 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556322a0db40 0x556322a0ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.384+0000 7f9ff17fa640 10 client.25562 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:23:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.384+0000 7fa00d16a640 1 --2- 172.21.15.120:0/326811565 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556322a0db40 0x556322a0ff30 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba5fe36ef11c5773 server_cookie=416a99b8757ae0e2 in_seq=0 out_seq=0 2024-09-19T05:23:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.385+0000 7f9ff17fa640 1 -- 172.21.15.120:0/326811565 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556322964a20 con 0x556322a0db40 2024-09-19T05:23:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.385+0000 7f9ff17fa640 10 client.25562 handle_command_reply: tid=0 2024-09-19T05:23:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.385+0000 7fa012a43740 1 client.25562 shutdown 2024-09-19T05:23:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.385+0000 7fa012a43740 1 -- 172.21.15.120:0/326811565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563229f2af0 msgr2=0x5563229fab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.385+0000 7fa012a43740 1 --2- 172.21.15.120:0/326811565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563229f2af0 0x5563229fab50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa004003bd0 tx=0x7fa004003c00 comp rx=0 tx=0).stop 2024-09-19T05:23:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.385+0000 7fa012a43740 1 -- 172.21.15.120:0/326811565 shutdown_connections 2024-09-19T05:23:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.385+0000 7fa012a43740 1 --2- 172.21.15.120:0/326811565 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556322a0db40 0x556322a0ff30 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.385+0000 7fa012a43740 1 --2- 172.21.15.120:0/326811565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5563229fdcb0 0x5563229fb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.385+0000 7fa012a43740 1 --2- 172.21.15.120:0/326811565 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563229f3410 0x5563229fb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.385+0000 7fa012a43740 1 --2- 172.21.15.120:0/326811565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563229f2af0 0x5563229fab50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.385+0000 7fa012a43740 1 -- 172.21.15.120:0/326811565 >> 172.21.15.120:0/326811565 conn(0x5563229ef060 msgr2=0x5563229f4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.385+0000 7f9ff17fa640 0 client.25562 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:23:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.385+0000 7fa012a43740 1 -- 172.21.15.120:0/326811565 shutdown_connections 2024-09-19T05:23:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.385+0000 7fa012a43740 1 -- 172.21.15.120:0/326811565 wait complete. 2024-09-19T05:23:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.385+0000 7fa012a43740 20 client.25562 trim_cache size 0 max 16384 2024-09-19T05:23:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.409+0000 7fa012a43740 1 Processor -- start 2024-09-19T05:23:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.409+0000 7fa012a43740 1 -- start start 2024-09-19T05:23:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.409+0000 7fa012a43740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563229f2af0 0x5563229f5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.409+0000 7fa012a43740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5563229f3410 0x5563229fb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.409+0000 7fa012a43740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563229fdcb0 0x5563229fb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.409+0000 7fa012a43740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081b22e0 con 0x5563229fdcb0 2024-09-19T05:23:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.409+0000 7fa012a43740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081afbb0 con 0x5563229f2af0 2024-09-19T05:23:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.409+0000 7fa012a43740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081ada00 con 0x5563229f3410 2024-09-19T05:23:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.409+0000 7fa00d96b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563229f2af0 0x5563229f5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.409+0000 7fa00e16c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563229fdcb0 0x5563229fb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.409+0000 7fa00d16a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5563229f3410 0x5563229fb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.410+0000 7fa00d96b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563229f2af0 0x5563229f5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:45476/0 (socket says 172.21.15.120:45476) 2024-09-19T05:23:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.410+0000 7fa00d16a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5563229f3410 0x5563229fb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:47494/0 (socket says 172.21.15.120:47494) 2024-09-19T05:23:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.410+0000 7fa00d96b640 1 -- 172.21.15.120:0/2771141964 learned_addr learned my addr 172.21.15.120:0/2771141964 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:23:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.410+0000 7fa00d96b640 1 -- 172.21.15.120:0/2771141964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5563229f3410 msgr2=0x5563229fb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.410+0000 7fa00d96b640 1 --2- 172.21.15.120:0/2771141964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5563229f3410 0x5563229fb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.410+0000 7fa00d96b640 1 -- 172.21.15.120:0/2771141964 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563229fdcb0 msgr2=0x5563229fb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.410+0000 7fa00d96b640 1 --2- 172.21.15.120:0/2771141964 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563229fdcb0 0x5563229fb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.410+0000 7fa00d96b640 1 -- 172.21.15.120:0/2771141964 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563229f2870 con 0x5563229f2af0 2024-09-19T05:23:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.410+0000 7fa00d96b640 1 --2- 172.21.15.120:0/2771141964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563229f2af0 0x5563229f5560 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa004003ba0 tx=0x7fa004009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d41a0b5ea36ec74 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.410+0000 7f9ff37fe640 1 -- 172.21.15.120:0/2771141964 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa004005b70 con 0x5563229f2af0 2024-09-19T05:23:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.410+0000 7f9ff37fe640 1 -- 172.21.15.120:0/2771141964 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa0040119a0 con 0x5563229f2af0 2024-09-19T05:23:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.410+0000 7f9ff37fe640 1 -- 172.21.15.120:0/2771141964 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa004005750 con 0x5563229f2af0 2024-09-19T05:23:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.412+0000 7fa012a43740 1 -- 172.21.15.120:0/2771141964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563229f2af0 msgr2=0x5563229f5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.412+0000 7fa012a43740 1 --2- 172.21.15.120:0/2771141964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563229f2af0 0x5563229f5560 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa004003ba0 tx=0x7fa004009500 comp rx=0 tx=0).stop 2024-09-19T05:23:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.412+0000 7fa012a43740 1 -- 172.21.15.120:0/2771141964 shutdown_connections 2024-09-19T05:23:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.412+0000 7fa012a43740 1 --2- 172.21.15.120:0/2771141964 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563229fdcb0 0x5563229fb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.412+0000 7fa012a43740 1 --2- 172.21.15.120:0/2771141964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5563229f3410 0x5563229fb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.412+0000 7fa012a43740 1 --2- 172.21.15.120:0/2771141964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563229f2af0 0x5563229f5560 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.412+0000 7fa012a43740 1 -- 172.21.15.120:0/2771141964 >> 172.21.15.120:0/2771141964 conn(0x5563229ef060 msgr2=0x5563229fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.412+0000 7fa012a43740 1 -- 172.21.15.120:0/2771141964 shutdown_connections 2024-09-19T05:23:58.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.412+0000 7fa012a43740 1 -- 172.21.15.120:0/2771141964 wait complete. 2024-09-19T05:23:58.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.413+0000 7fa012a43740 1 -- start start 2024-09-19T05:23:58.416 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.413+0000 7fa012a43740 1 Processor -- start 2024-09-19T05:23:58.418 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.413+0000 7fa012a43740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563229f2af0 0x556322a05c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.414+0000 7fa012a43740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5563229f3410 0x556322a061d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.414+0000 7fa00d96b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563229f2af0 0x556322a05c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.414+0000 7fa00d96b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563229f2af0 0x556322a05c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:51128/0 (socket says 172.21.15.120:51128) 2024-09-19T05:23:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.414+0000 7fa00d96b640 1 -- 172.21.15.120:0/2769354552 learned_addr learned my addr 172.21.15.120:0/2769354552 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:23:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.414+0000 7fa012a43740 1 --2- 172.21.15.120:0/2769354552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563229fdcb0 0x5563229f6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.414+0000 7fa012a43740 1 -- 172.21.15.120:0/2769354552 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081ae070 con 0x5563229f2af0 2024-09-19T05:23:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.414+0000 7fa012a43740 1 -- 172.21.15.120:0/2769354552 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081af4e0 con 0x5563229fdcb0 2024-09-19T05:23:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.414+0000 7fa012a43740 1 -- 172.21.15.120:0/2769354552 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa0081ae740 con 0x5563229f3410 2024-09-19T05:23:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.414+0000 7fa00d16a640 1 --2- 172.21.15.120:0/2769354552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5563229f3410 0x556322a061d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.414+0000 7fa012a43740 10 client.0 _ll_register_callbacks cb 0x7fa004015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:23:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.414+0000 7fa00e16c640 1 --2- 172.21.15.120:0/2769354552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563229fdcb0 0x5563229f6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.414+0000 7fa00d96b640 1 -- 172.21.15.120:0/2769354552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5563229f3410 msgr2=0x556322a061d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.414+0000 7fa00d96b640 1 --2- 172.21.15.120:0/2769354552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5563229f3410 0x556322a061d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.414+0000 7fa00d96b640 1 -- 172.21.15.120:0/2769354552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563229fdcb0 msgr2=0x5563229f6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:23:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.414+0000 7fa00d96b640 1 --2- 172.21.15.120:0/2769354552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563229fdcb0 0x5563229f6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.414+0000 7fa00d96b640 1 -- 172.21.15.120:0/2769354552 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563229f74c0 con 0x5563229f2af0 2024-09-19T05:23:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.414+0000 7fa00d96b640 1 --2- 172.21.15.120:0/2769354552 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563229f2af0 0x556322a05c90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa004009730 tx=0x7fa004026d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b90b85b6660378 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:23:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.414+0000 7f9ff17fa640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:23:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.415+0000 7f9ff17fa640 1 -- 172.21.15.120:0/2769354552 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa004026420 con 0x5563229f2af0 2024-09-19T05:23:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.415+0000 7f9ff17fa640 1 -- 172.21.15.120:0/2769354552 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fa0040265c0 con 0x5563229f2af0 2024-09-19T05:23:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.415+0000 7fa012a43740 1 -- 172.21.15.120:0/2769354552 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0040119a0 con 0x5563229f2af0 2024-09-19T05:23:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.415+0000 7f9ff17fa640 1 -- 172.21.15.120:0/2769354552 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa0040053d0 con 0x5563229f2af0 2024-09-19T05:23:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.415+0000 7fa012a43740 10 client.16116 fetch_fsmap learned FSMap version 29 2024-09-19T05:23:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.415+0000 7fa012a43740 1 -- 172.21.15.120:0/2769354552 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556322a805b0 con 0x5563229f2af0 2024-09-19T05:23:58.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.415+0000 7f9ff17fa640 1 -- 172.21.15.120:0/2769354552 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa0040119a0 con 0x5563229f2af0 2024-09-19T05:23:58.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.415+0000 7f9ff17fa640 1 -- 172.21.15.120:0/2769354552 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fa0040369e0 con 0x5563229f2af0 2024-09-19T05:23:58.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.415+0000 7fa012a43740 10 client.16116 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:23:58.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.415+0000 7fa012a43740 10 client.16116 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:23:58.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.415+0000 7fa012a43740 20 client.16116 populate_metadata read hostname 'smithi120' 2024-09-19T05:23:58.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.415+0000 7fa012a43740 1 --2- 172.21.15.120:0/2769354552 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556322a80be0 0x556322a83000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:23:58.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.415+0000 7fa012a43740 4 client.16116 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:23:58.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.415+0000 7fa012a43740 1 -- 172.21.15.120:0/2769354552 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55632295ed70 con 0x556322a80be0 2024-09-19T05:23:58.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.416+0000 7fa00d16a640 1 --2- 172.21.15.120:0/2769354552 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556322a80be0 0x556322a83000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:23:58.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.416+0000 7f9ff17fa640 10 client.16116 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:23:58.421 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.416+0000 7fa00d16a640 1 --2- 172.21.15.120:0/2769354552 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556322a80be0 0x556322a83000 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a89e27c0ac11b94b server_cookie=a80918aeba45277e in_seq=0 out_seq=0 2024-09-19T05:23:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.592+0000 7f9ff17fa640 1 -- 172.21.15.120:0/2769354552 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55632295ed70 con 0x556322a80be0 2024-09-19T05:23:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.592+0000 7f9ff17fa640 10 client.16116 handle_command_reply: tid=0 2024-09-19T05:23:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.592+0000 7fa012a43740 1 client.16116 shutdown 2024-09-19T05:23:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.592+0000 7fa012a43740 1 -- 172.21.15.120:0/2769354552 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563229f2af0 msgr2=0x556322a05c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.592+0000 7fa012a43740 1 --2- 172.21.15.120:0/2769354552 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563229f2af0 0x556322a05c90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa004009730 tx=0x7fa004026d50 comp rx=0 tx=0).stop 2024-09-19T05:23:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.592+0000 7fa012a43740 1 -- 172.21.15.120:0/2769354552 shutdown_connections 2024-09-19T05:23:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.592+0000 7fa012a43740 1 --2- 172.21.15.120:0/2769354552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563229fdcb0 0x5563229f6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.592+0000 7fa012a43740 1 --2- 172.21.15.120:0/2769354552 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556322a80be0 0x556322a83000 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.592+0000 7fa012a43740 1 --2- 172.21.15.120:0/2769354552 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5563229f3410 0x556322a061d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.592+0000 7fa012a43740 1 --2- 172.21.15.120:0/2769354552 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5563229f2af0 0x556322a05c90 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.592+0000 7fa012a43740 1 -- 172.21.15.120:0/2769354552 >> 172.21.15.120:0/2769354552 conn(0x5563229ef060 msgr2=0x5563229ed9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.592+0000 7f9ff17fa640 0 client.16116 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:23:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.592+0000 7fa012a43740 1 -- 172.21.15.120:0/2769354552 shutdown_connections 2024-09-19T05:23:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.592+0000 7fa012a43740 1 -- 172.21.15.120:0/2769354552 wait complete. 2024-09-19T05:23:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.592+0000 7fa012a43740 20 client.16116 trim_cache size 0 max 16384 2024-09-19T05:23:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:23:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:23:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:23:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:23:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.593+0000 7fa00fbcf640 1 -- 172.21.15.120:0/1634071230 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f9ff40a3560 msgr2=0x7f9ff40a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.593+0000 7fa00fbcf640 1 --2- 172.21.15.120:0/1634071230 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f9ff40a3560 0x7f9ff40a5a20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa000005c40 tx=0x7fa00000c2d0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.593+0000 7fa00fbcf640 1 -- 172.21.15.120:0/1634071230 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa008101d70 msgr2=0x7fa00819a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:23:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.593+0000 7fa00fbcf640 1 --2- 172.21.15.120:0/1634071230 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa008101d70 0x7fa00819a980 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800e990 tx=0x7f9ff800ee50 comp rx=0 tx=0).stop 2024-09-19T05:23:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.593+0000 7fa00fbcf640 1 -- 172.21.15.120:0/1634071230 shutdown_connections 2024-09-19T05:23:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.593+0000 7fa00fbcf640 1 --2- 172.21.15.120:0/1634071230 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f9ff40a3560 0x7f9ff40a5a20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.593+0000 7fa00fbcf640 1 --2- 172.21.15.120:0/1634071230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0081026f0 0x7fa00819ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.593+0000 7fa00fbcf640 1 --2- 172.21.15.120:0/1634071230 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa008101d70 0x7fa00819a980 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.593+0000 7fa00fbcf640 1 --2- 172.21.15.120:0/1634071230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa008100490 0x7fa00819a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:23:58.597 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.593+0000 7fa00fbcf640 1 -- 172.21.15.120:0/1634071230 >> 172.21.15.120:0/1634071230 conn(0x7fa0080770f0 msgr2=0x7fa008103ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:23:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.593+0000 7fa00fbcf640 1 -- 172.21.15.120:0/1634071230 shutdown_connections 2024-09-19T05:23:58.598 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:23:58.593+0000 7fa00fbcf640 1 -- 172.21.15.120:0/1634071230 wait complete. 2024-09-19T05:23:58.743 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:23:58 smithi178 ceph-mon[34347]: pgmap v145: 97 pgs: 97 active+clean; 384 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 147 op/s 2024-09-19T05:23:58.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:23:58 smithi120 ceph-mon[30956]: pgmap v145: 97 pgs: 97 active+clean; 384 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 147 op/s 2024-09-19T05:23:58.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:23:58 smithi194 ceph-mon[35228]: pgmap v145: 97 pgs: 97 active+clean; 384 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 147 op/s 2024-09-19T05:24:00.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:00 smithi120 ceph-mon[30956]: pgmap v146: 97 pgs: 97 active+clean; 385 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 286 op/s 2024-09-19T05:24:00.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:00 smithi194 ceph-mon[35228]: pgmap v146: 97 pgs: 97 active+clean; 385 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 286 op/s 2024-09-19T05:24:00.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:00 smithi178 ceph-mon[34347]: pgmap v146: 97 pgs: 97 active+clean; 385 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 286 op/s 2024-09-19T05:24:02.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:02 smithi120 ceph-mon[30956]: pgmap v147: 97 pgs: 97 active+clean; 385 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 220 op/s 2024-09-19T05:24:02.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:02 smithi194 ceph-mon[35228]: pgmap v147: 97 pgs: 97 active+clean; 385 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 220 op/s 2024-09-19T05:24:02.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:02 smithi178 ceph-mon[34347]: pgmap v147: 97 pgs: 97 active+clean; 385 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 220 op/s 2024-09-19T05:24:04.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:04 smithi120 ceph-mon[30956]: pgmap v148: 97 pgs: 97 active+clean; 385 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 220 op/s 2024-09-19T05:24:04.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:04 smithi194 ceph-mon[35228]: pgmap v148: 97 pgs: 97 active+clean; 385 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 220 op/s 2024-09-19T05:24:04.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:04 smithi178 ceph-mon[34347]: pgmap v148: 97 pgs: 97 active+clean; 385 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 220 op/s 2024-09-19T05:24:06.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:06 smithi120 ceph-mon[30956]: pgmap v149: 97 pgs: 97 active+clean; 387 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 242 op/s 2024-09-19T05:24:06.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:06 smithi194 ceph-mon[35228]: pgmap v149: 97 pgs: 97 active+clean; 387 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 242 op/s 2024-09-19T05:24:06.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:06 smithi178 ceph-mon[34347]: pgmap v149: 97 pgs: 97 active+clean; 387 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 242 op/s 2024-09-19T05:24:08.315 INFO:tasks.workunit.client.0.smithi120.stdout: 85 6855 69 4072 31 1759 98 2024-09-19T05:24:08.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:08 smithi120 ceph-mon[30956]: pgmap v150: 97 pgs: 97 active+clean; 387 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 160 op/s 2024-09-19T05:24:08.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:08 smithi194 ceph-mon[35228]: pgmap v150: 97 pgs: 97 active+clean; 387 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 160 op/s 2024-09-19T05:24:08.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:08 smithi178 ceph-mon[34347]: pgmap v150: 97 pgs: 97 active+clean; 387 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.4 MiB/s wr, 160 op/s 2024-09-19T05:24:10.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:10 smithi120 ceph-mon[30956]: pgmap v151: 97 pgs: 97 active+clean; 399 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 252 op/s 2024-09-19T05:24:10.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:10 smithi194 ceph-mon[35228]: pgmap v151: 97 pgs: 97 active+clean; 399 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 252 op/s 2024-09-19T05:24:10.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:10 smithi178 ceph-mon[34347]: pgmap v151: 97 pgs: 97 active+clean; 399 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 252 op/s 2024-09-19T05:24:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.713+0000 7fedc3daf640 1 -- 172.21.15.120:0/4152021072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedbc10c0d0 msgr2=0x7fedbc10e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.713+0000 7fedc3daf640 1 --2- 172.21.15.120:0/4152021072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedbc10c0d0 0x7fedbc10e550 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fedb0009860 tx=0x7fedb002a3d0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.713+0000 7fedc3daf640 1 -- 172.21.15.120:0/4152021072 shutdown_connections 2024-09-19T05:24:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.713+0000 7fedc3daf640 1 --2- 172.21.15.120:0/4152021072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedbc10c0d0 0x7fedbc10e550 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.713+0000 7fedc3daf640 1 --2- 172.21.15.120:0/4152021072 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedbc1035a0 0x7fedbc10ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.713+0000 7fedc3daf640 1 --2- 172.21.15.120:0/4152021072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedbc102c80 0x7fedbc103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.713+0000 7fedc3daf640 1 -- 172.21.15.120:0/4152021072 >> 172.21.15.120:0/4152021072 conn(0x7fedbc077990 msgr2=0x7fedbc0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.713+0000 7fedc3daf640 1 -- 172.21.15.120:0/4152021072 shutdown_connections 2024-09-19T05:24:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.713+0000 7fedc3daf640 1 -- 172.21.15.120:0/4152021072 wait complete. 2024-09-19T05:24:11.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.714+0000 7fedc3daf640 1 Processor -- start 2024-09-19T05:24:11.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.714+0000 7fedc3daf640 1 -- start start 2024-09-19T05:24:11.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.714+0000 7fedc3daf640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedbc102c80 0x7fedbc1a3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:11.717 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.714+0000 7fedc3daf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedbc1035a0 0x7fedbc1a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:11.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.714+0000 7fedc3daf640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedbc10c0d0 0x7fedbc10acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:11.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.714+0000 7fedc3daf640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc111d60 con 0x7fedbc1035a0 2024-09-19T05:24:11.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.714+0000 7fedc3daf640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc111be0 con 0x7fedbc102c80 2024-09-19T05:24:11.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.714+0000 7fedc3daf640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc111ee0 con 0x7fedbc10c0d0 2024-09-19T05:24:11.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.715+0000 7fedc134a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedbc1035a0 0x7fedbc1a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:11.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.715+0000 7fedc134a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedbc1035a0 0x7fedbc1a3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38074/0 (socket says 172.21.15.120:38074) 2024-09-19T05:24:11.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.715+0000 7fedc134a640 1 -- 172.21.15.120:0/3296489239 learned_addr learned my addr 172.21.15.120:0/3296489239 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:24:11.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.715+0000 7fedc234c640 1 --2- 172.21.15.120:0/3296489239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedbc10c0d0 0x7fedbc10acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:11.718 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.715+0000 7fedc1b4b640 1 --2- 172.21.15.120:0/3296489239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedbc102c80 0x7fedbc1a3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:11.719 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.715+0000 7fedc134a640 1 -- 172.21.15.120:0/3296489239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedbc10c0d0 msgr2=0x7fedbc10acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:11.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.715+0000 7fedc134a640 1 --2- 172.21.15.120:0/3296489239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedbc10c0d0 0x7fedbc10acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.715+0000 7fedc134a640 1 -- 172.21.15.120:0/3296489239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedbc102c80 msgr2=0x7fedbc1a3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:11.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.715+0000 7fedc134a640 1 --2- 172.21.15.120:0/3296489239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedbc102c80 0x7fedbc1a3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.715+0000 7fedc134a640 1 -- 172.21.15.120:0/3296489239 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedbc10b410 con 0x7fedbc1035a0 2024-09-19T05:24:11.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.715+0000 7fedc134a640 1 --2- 172.21.15.120:0/3296489239 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedbc1035a0 0x7fedbc1a3a40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fedb800e910 tx=0x7fedb800edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:11.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.715+0000 7fedaeffd640 1 -- 172.21.15.120:0/3296489239 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb800cd80 con 0x7fedbc1035a0 2024-09-19T05:24:11.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.716+0000 7fedaeffd640 1 -- 172.21.15.120:0/3296489239 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fedb80035f0 con 0x7fedbc1035a0 2024-09-19T05:24:11.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.716+0000 7fedc3daf640 1 -- 172.21.15.120:0/3296489239 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedbc10b700 con 0x7fedbc1035a0 2024-09-19T05:24:11.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.716+0000 7fedaeffd640 1 -- 172.21.15.120:0/3296489239 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb8010690 con 0x7fedbc1035a0 2024-09-19T05:24:11.720 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.716+0000 7fedc3daf640 1 -- 172.21.15.120:0/3296489239 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedbc1ab420 con 0x7fedbc1035a0 2024-09-19T05:24:11.723 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.719+0000 7fedaeffd640 1 -- 172.21.15.120:0/3296489239 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fedb80037a0 con 0x7fedbc1035a0 2024-09-19T05:24:11.723 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.719+0000 7fedc6c24740 1 Processor -- start 2024-09-19T05:24:11.723 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.719+0000 7fedc6c24740 1 -- start start 2024-09-19T05:24:11.723 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.720+0000 7fedc6c24740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d590437af0 0x55d590437ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:11.723 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.720+0000 7fedc6c24740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d590438410 0x55d590442770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:11.723 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.720+0000 7fedc6c24740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d590442cb0 0x55d5904450a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:11.723 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.720+0000 7fedc6c24740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d59039c2f0 con 0x55d590438410 2024-09-19T05:24:11.724 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.720+0000 7fedc6c24740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d590344270 con 0x55d590437af0 2024-09-19T05:24:11.724 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.720+0000 7fedc6c24740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55d5903982b0 con 0x55d590442cb0 2024-09-19T05:24:11.724 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.720+0000 7fedc134a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d590442cb0 0x55d5904450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:11.724 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.720+0000 7fedc134a640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d590442cb0 0x55d5904450a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:55304/0 (socket says 172.21.15.120:55304) 2024-09-19T05:24:11.724 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.720+0000 7fedc1b4b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d590438410 0x55d590442770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:11.724 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.720+0000 7fedc134a640 1 -- 172.21.15.120:0/2148244030 learned_addr learned my addr 172.21.15.120:0/2148244030 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:24:11.724 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.720+0000 7fedc234c640 1 --2- 172.21.15.120:0/2148244030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d590437af0 0x55d590437ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:11.724 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.720+0000 7fedc134a640 1 -- 172.21.15.120:0/2148244030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d590437af0 msgr2=0x55d590437ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:11.724 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.720+0000 7fedc134a640 1 --2- 172.21.15.120:0/2148244030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d590437af0 0x55d590437ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.724 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.720+0000 7fedc134a640 1 -- 172.21.15.120:0/2148244030 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d590438410 msgr2=0x55d590442770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:11.724 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.720+0000 7fedc134a640 1 --2- 172.21.15.120:0/2148244030 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d590438410 0x55d590442770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.724 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.720+0000 7fedc134a640 1 -- 172.21.15.120:0/2148244030 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d590343340 con 0x55d590442cb0 2024-09-19T05:24:11.724 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.720+0000 7fedc1b4b640 1 --2- 172.21.15.120:0/2148244030 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d590438410 0x55d590442770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:24:11.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.720+0000 7fedaeffd640 1 --2- 172.21.15.120:0/3296489239 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7feda80a34e0 0x7feda80a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:11.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.720+0000 7fedc134a640 1 --2- 172.21.15.120:0/2148244030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d590442cb0 0x55d5904450a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fedb80cd490 tx=0x7fedb80d3ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4784445b5b9686 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:11.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.721+0000 7fedc234c640 1 --2- 172.21.15.120:0/3296489239 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7feda80a34e0 0x7feda80a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:11.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.721+0000 7fedaeffd640 1 -- 172.21.15.120:0/3296489239 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fedb80cfe20 con 0x7fedbc1035a0 2024-09-19T05:24:11.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.721+0000 7feda7fff640 1 -- 172.21.15.120:0/2148244030 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb8098350 con 0x55d590442cb0 2024-09-19T05:24:11.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.721+0000 7feda7fff640 1 -- 172.21.15.120:0/2148244030 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fedb8003b10 con 0x55d590442cb0 2024-09-19T05:24:11.725 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.721+0000 7feda7fff640 1 -- 172.21.15.120:0/2148244030 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb809ba10 con 0x55d590442cb0 2024-09-19T05:24:11.729 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.722+0000 7fedc6c24740 1 -- 172.21.15.120:0/2148244030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d590442cb0 msgr2=0x55d5904450a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:11.729 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.722+0000 7fedc234c640 1 --2- 172.21.15.120:0/3296489239 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7feda80a34e0 0x7feda80a59a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fedb00095f0 tx=0x7fedb0005dc0 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:11.729 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.722+0000 7fedc6c24740 1 --2- 172.21.15.120:0/2148244030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d590442cb0 0x55d5904450a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fedb80cd490 tx=0x7fedb80d3ed0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.729 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.722+0000 7fedc6c24740 1 -- 172.21.15.120:0/2148244030 shutdown_connections 2024-09-19T05:24:11.730 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.722+0000 7fedc6c24740 1 --2- 172.21.15.120:0/2148244030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d590442cb0 0x55d5904450a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.730 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.722+0000 7fedc6c24740 1 --2- 172.21.15.120:0/2148244030 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d590438410 0x55d590442770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.730 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.722+0000 7fedc6c24740 1 --2- 172.21.15.120:0/2148244030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d590437af0 0x55d590437ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.730 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.722+0000 7fedc6c24740 1 -- 172.21.15.120:0/2148244030 >> 172.21.15.120:0/2148244030 conn(0x55d590434060 msgr2=0x55d590434440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:11.730 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.722+0000 7fedc6c24740 1 -- 172.21.15.120:0/2148244030 shutdown_connections 2024-09-19T05:24:11.730 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.722+0000 7fedc6c24740 1 -- 172.21.15.120:0/2148244030 wait complete. 2024-09-19T05:24:11.730 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.722+0000 7fedc6c24740 1 -- start start 2024-09-19T05:24:11.730 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.722+0000 7fedc6c24740 1 Processor -- start 2024-09-19T05:24:11.730 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.723+0000 7fedc6c24740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d590437af0 0x55d59043fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:11.730 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.723+0000 7fedc6c24740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d590438410 0x55d590440090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:11.730 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.723+0000 7fedc6c24740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d590442cb0 0x55d5904405d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.723+0000 7fedc6c24740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55d590445880 con 0x55d590437af0 2024-09-19T05:24:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.723+0000 7fedc6c24740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55d590325290 con 0x55d590438410 2024-09-19T05:24:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.723+0000 7fedc6c24740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55d590445a00 con 0x55d590442cb0 2024-09-19T05:24:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.723+0000 7fedc6c24740 10 client.0 _ll_register_callbacks cb 0x55d590356140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:24:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.723+0000 7fedc1b4b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d590437af0 0x55d59043fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.723+0000 7fedc1b4b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d590437af0 0x55d59043fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38094/0 (socket says 172.21.15.120:38094) 2024-09-19T05:24:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.723+0000 7fedc234c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d590442cb0 0x55d5904405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.723+0000 7fedc1b4b640 1 -- 172.21.15.120:0/375574832 learned_addr learned my addr 172.21.15.120:0/375574832 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:24:11.731 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.723+0000 7fedc134a640 1 --2- 172.21.15.120:0/375574832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d590438410 0x55d590440090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.723+0000 7fedc234c640 1 -- 172.21.15.120:0/375574832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d590438410 msgr2=0x55d590440090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.723+0000 7fedc234c640 1 --2- 172.21.15.120:0/375574832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d590438410 0x55d590440090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.723+0000 7fedc234c640 1 -- 172.21.15.120:0/375574832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d590437af0 msgr2=0x55d59043fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.723+0000 7fedc234c640 1 --2- 172.21.15.120:0/375574832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d590437af0 0x55d59043fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.723+0000 7fedc234c640 1 -- 172.21.15.120:0/375574832 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5900af210 con 0x55d590442cb0 2024-09-19T05:24:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.724+0000 7fedc234c640 1 --2- 172.21.15.120:0/375574832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d590442cb0 0x55d5904405d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fedb0031000 tx=0x7fedb002a3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60bb422cc8ff91d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.724+0000 7feda57fa640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:24:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.724+0000 7feda57fa640 1 -- 172.21.15.120:0/375574832 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb0030670 con 0x55d590442cb0 2024-09-19T05:24:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.724+0000 7fedc6c24740 1 -- 172.21.15.120:0/375574832 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d5903a9a20 con 0x55d590442cb0 2024-09-19T05:24:11.732 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.724+0000 7feda57fa640 1 -- 172.21.15.120:0/375574832 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fedb00046c0 con 0x55d590442cb0 2024-09-19T05:24:11.733 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.724+0000 7feda57fa640 1 -- 172.21.15.120:0/375574832 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fedb00048c0 con 0x55d590442cb0 2024-09-19T05:24:11.733 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.724+0000 7fedc6c24740 10 client.25654 fetch_fsmap learned FSMap version 29 2024-09-19T05:24:11.733 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.724+0000 7fedc6c24740 1 -- 172.21.15.120:0/375574832 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d59017b620 con 0x55d590442cb0 2024-09-19T05:24:11.733 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.724+0000 7feda57fa640 1 -- 172.21.15.120:0/375574832 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x55d5903a9a20 con 0x55d590442cb0 2024-09-19T05:24:11.733 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.725+0000 7feda57fa640 1 -- 172.21.15.120:0/375574832 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fedb0052c10 con 0x55d590442cb0 2024-09-19T05:24:11.733 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.725+0000 7fedc6c24740 10 client.25654 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:24:11.733 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.725+0000 7fedc6c24740 10 client.25654 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:24:11.733 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.725+0000 7fedc6c24740 20 client.25654 populate_metadata read hostname 'smithi120' 2024-09-19T05:24:11.733 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.725+0000 7fedc6c24740 1 --2- 172.21.15.120:0/375574832 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55d590452bc0 0x55d590454ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:11.734 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.725+0000 7fedc6c24740 4 client.25654 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:24:11.734 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.725+0000 7fedc6c24740 1 -- 172.21.15.120:0/375574832 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d5903a3d70 con 0x55d590452bc0 2024-09-19T05:24:11.734 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.725+0000 7fedc1b4b640 1 --2- 172.21.15.120:0/375574832 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55d590452bc0 0x55d590454ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:11.734 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.725+0000 7feda57fa640 10 client.25654 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:24:11.734 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.725+0000 7fedc1b4b640 1 --2- 172.21.15.120:0/375574832 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55d590452bc0 0x55d590454ff0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85f5f3ee94ede365 server_cookie=a2df4fbada5c2faa in_seq=0 out_seq=0 2024-09-19T05:24:11.734 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.726+0000 7feda57fa640 1 -- 172.21.15.120:0/375574832 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d5903a3d70 con 0x55d590452bc0 2024-09-19T05:24:11.734 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.726+0000 7feda57fa640 10 client.25654 handle_command_reply: tid=0 2024-09-19T05:24:11.734 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.726+0000 7fedc6c24740 1 client.25654 shutdown 2024-09-19T05:24:11.734 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.726+0000 7fedc6c24740 1 -- 172.21.15.120:0/375574832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d590442cb0 msgr2=0x55d5904405d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:11.735 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.726+0000 7fedc6c24740 1 --2- 172.21.15.120:0/375574832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d590442cb0 0x55d5904405d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fedb0031000 tx=0x7fedb002a3d0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.735 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.727+0000 7fedc6c24740 1 -- 172.21.15.120:0/375574832 shutdown_connections 2024-09-19T05:24:11.735 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.727+0000 7fedc6c24740 1 --2- 172.21.15.120:0/375574832 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55d590452bc0 0x55d590454ff0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.735 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.727+0000 7feda57fa640 0 client.25654 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:24:11.735 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.727+0000 7fedc6c24740 1 --2- 172.21.15.120:0/375574832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d590442cb0 0x55d5904405d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.735 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.727+0000 7fedc6c24740 1 --2- 172.21.15.120:0/375574832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d590438410 0x55d590440090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.735 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.727+0000 7fedc6c24740 1 --2- 172.21.15.120:0/375574832 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d590437af0 0x55d59043fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.735 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.727+0000 7fedc6c24740 1 -- 172.21.15.120:0/375574832 >> 172.21.15.120:0/375574832 conn(0x55d590434060 msgr2=0x55d590439dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:11.735 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.727+0000 7fedc6c24740 1 -- 172.21.15.120:0/375574832 shutdown_connections 2024-09-19T05:24:11.735 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.727+0000 7fedc6c24740 1 -- 172.21.15.120:0/375574832 wait complete. 2024-09-19T05:24:11.736 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.727+0000 7fedc6c24740 20 client.25654 trim_cache size 0 max 16384 2024-09-19T05:24:11.753 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.751+0000 7fedc6c24740 1 Processor -- start 2024-09-19T05:24:11.753 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.751+0000 7fedc6c24740 1 -- start start 2024-09-19T05:24:11.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.751+0000 7fedc6c24740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d590437af0 0x55d5904403d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:11.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.751+0000 7fedc6c24740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d590438410 0x55d59045a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:11.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.751+0000 7fedc6c24740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d590442cb0 0x55d59045ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:11.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.751+0000 7fedc6c24740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc1b6740 con 0x55d590438410 2024-09-19T05:24:11.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.751+0000 7fedc6c24740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc1b4010 con 0x55d590437af0 2024-09-19T05:24:11.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.751+0000 7fedc6c24740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc1b1e60 con 0x55d590442cb0 2024-09-19T05:24:11.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.752+0000 7fedc134a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d590438410 0x55d59045a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:11.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.752+0000 7fedc134a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d590438410 0x55d59045a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:38104/0 (socket says 172.21.15.120:38104) 2024-09-19T05:24:11.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.752+0000 7fedc134a640 1 -- 172.21.15.120:0/2476934125 learned_addr learned my addr 172.21.15.120:0/2476934125 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:24:11.755 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.752+0000 7fedc234c640 1 --2- 172.21.15.120:0/2476934125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d590442cb0 0x55d59045ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:11.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.752+0000 7fedc1b4b640 1 --2- 172.21.15.120:0/2476934125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d590437af0 0x55d5904403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:11.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.752+0000 7fedc134a640 1 -- 172.21.15.120:0/2476934125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d590442cb0 msgr2=0x55d59045ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:11.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.752+0000 7fedc134a640 1 --2- 172.21.15.120:0/2476934125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d590442cb0 0x55d59045ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.752+0000 7fedc134a640 1 -- 172.21.15.120:0/2476934125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d590437af0 msgr2=0x55d5904403d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:11.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.752+0000 7fedc134a640 1 --2- 172.21.15.120:0/2476934125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d590437af0 0x55d5904403d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.752+0000 7fedc134a640 1 -- 172.21.15.120:0/2476934125 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d590433e90 con 0x55d590438410 2024-09-19T05:24:11.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.752+0000 7fedc1b4b640 1 --2- 172.21.15.120:0/2476934125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d590437af0 0x55d5904403d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:24:11.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.752+0000 7fedc134a640 1 --2- 172.21.15.120:0/2476934125 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d590438410 0x55d59045a900 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fedb809bdb0 tx=0x7fedb80cd4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8040df53450a5617 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:11.756 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.752+0000 7feda77fe640 1 -- 172.21.15.120:0/2476934125 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb80b4070 con 0x55d590438410 2024-09-19T05:24:11.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.752+0000 7feda77fe640 1 -- 172.21.15.120:0/2476934125 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fedb809c7b0 con 0x55d590438410 2024-09-19T05:24:11.757 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.752+0000 7feda77fe640 1 -- 172.21.15.120:0/2476934125 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb809bbf0 con 0x55d590438410 2024-09-19T05:24:11.760 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.753+0000 7fedc6c24740 1 -- 172.21.15.120:0/2476934125 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d590438410 msgr2=0x55d59045a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.753+0000 7fedc6c24740 1 --2- 172.21.15.120:0/2476934125 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d590438410 0x55d59045a900 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fedb809bdb0 tx=0x7fedb80cd4c0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.753+0000 7fedc6c24740 1 -- 172.21.15.120:0/2476934125 shutdown_connections 2024-09-19T05:24:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.753+0000 7fedc6c24740 1 --2- 172.21.15.120:0/2476934125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d590442cb0 0x55d59045ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.753+0000 7fedc6c24740 1 --2- 172.21.15.120:0/2476934125 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d590438410 0x55d59045a900 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.753+0000 7fedc6c24740 1 --2- 172.21.15.120:0/2476934125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d590437af0 0x55d5904403d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.753+0000 7fedc6c24740 1 -- 172.21.15.120:0/2476934125 >> 172.21.15.120:0/2476934125 conn(0x55d590434060 msgr2=0x55d590441bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.754+0000 7fedc6c24740 1 -- 172.21.15.120:0/2476934125 shutdown_connections 2024-09-19T05:24:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.754+0000 7fedc6c24740 1 -- 172.21.15.120:0/2476934125 wait complete. 2024-09-19T05:24:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.754+0000 7fedc6c24740 1 -- start start 2024-09-19T05:24:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.754+0000 7fedc6c24740 1 Processor -- start 2024-09-19T05:24:11.761 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.755+0000 7fedc6c24740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d590437af0 0x55d59044b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.755+0000 7fedc6c24740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d590438410 0x55d59043c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.755+0000 7fedc6c24740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d590442cb0 0x55d59043cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.755+0000 7fedc6c24740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc1b24d0 con 0x55d590438410 2024-09-19T05:24:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.755+0000 7fedc6c24740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc1b3940 con 0x55d590437af0 2024-09-19T05:24:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.755+0000 7fedc6c24740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc1b2ba0 con 0x55d590442cb0 2024-09-19T05:24:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.755+0000 7fedc6c24740 10 client.0 _ll_register_callbacks cb 0x7fedb40093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:24:11.762 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.755+0000 7fedc1b4b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d590437af0 0x55d59044b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.755+0000 7fedc134a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d590438410 0x55d59043c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.755+0000 7fedc1b4b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d590437af0 0x55d59044b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:41882/0 (socket says 172.21.15.120:41882) 2024-09-19T05:24:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.755+0000 7fedc1b4b640 1 -- 172.21.15.120:0/2812520120 learned_addr learned my addr 172.21.15.120:0/2812520120 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:24:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.755+0000 7fedc234c640 1 --2- 172.21.15.120:0/2812520120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d590442cb0 0x55d59043cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.755+0000 7fedc1b4b640 1 -- 172.21.15.120:0/2812520120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d590442cb0 msgr2=0x55d59043cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.755+0000 7fedc1b4b640 1 --2- 172.21.15.120:0/2812520120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d590442cb0 0x55d59043cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.755+0000 7fedc1b4b640 1 -- 172.21.15.120:0/2812520120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d590438410 msgr2=0x55d59043c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.755+0000 7fedc1b4b640 1 --2- 172.21.15.120:0/2812520120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d590438410 0x55d59043c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.755+0000 7fedc1b4b640 1 -- 172.21.15.120:0/2812520120 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d59043d1d0 con 0x55d590437af0 2024-09-19T05:24:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.755+0000 7fedc134a640 1 --2- 172.21.15.120:0/2812520120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d590438410 0x55d59043c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:24:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.756+0000 7fedc1b4b640 1 --2- 172.21.15.120:0/2812520120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d590437af0 0x55d59044b1f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fedb40105c0 tx=0x7fedb4010a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee068077a1a20f55 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.756+0000 7feda57fa640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:24:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.756+0000 7feda57fa640 1 -- 172.21.15.120:0/2812520120 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb4004d20 con 0x55d590437af0 2024-09-19T05:24:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.756+0000 7feda57fa640 1 -- 172.21.15.120:0/2812520120 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fedb401d860 con 0x55d590437af0 2024-09-19T05:24:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.756+0000 7fedc6c24740 1 -- 172.21.15.120:0/2812520120 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fedb809c7b0 con 0x55d590437af0 2024-09-19T05:24:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.756+0000 7feda57fa640 1 -- 172.21.15.120:0/2812520120 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fedb401da60 con 0x55d590437af0 2024-09-19T05:24:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.756+0000 7fedc6c24740 10 client.25586 fetch_fsmap learned FSMap version 29 2024-09-19T05:24:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.756+0000 7fedc6c24740 1 -- 172.21.15.120:0/2812520120 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d5904bd750 con 0x55d590437af0 2024-09-19T05:24:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.756+0000 7feda57fa640 1 -- 172.21.15.120:0/2812520120 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fedb401dc00 con 0x55d590437af0 2024-09-19T05:24:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.756+0000 7feda57fa640 1 -- 172.21.15.120:0/2812520120 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fedb4024070 con 0x55d590437af0 2024-09-19T05:24:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.757+0000 7fedc6c24740 10 client.25586 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:24:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.757+0000 7fedc6c24740 10 client.25586 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:24:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.757+0000 7fedc6c24740 20 client.25586 populate_metadata read hostname 'smithi120' 2024-09-19T05:24:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.757+0000 7fedc6c24740 1 --2- 172.21.15.120:0/2812520120 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55d590452bc0 0x55d5904bff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.757+0000 7fedc6c24740 4 client.25586 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:24:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.757+0000 7fedc6c24740 1 -- 172.21.15.120:0/2812520120 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fedb809c7b0 con 0x55d590452bc0 2024-09-19T05:24:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.757+0000 7fedc134a640 1 --2- 172.21.15.120:0/2812520120 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55d590452bc0 0x55d5904bff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:11.765 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.757+0000 7fedc134a640 1 --2- 172.21.15.120:0/2812520120 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55d590452bc0 0x55d5904bff90 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6a9366ee3c751a4 server_cookie=451d497bf712ff56 in_seq=0 out_seq=0 2024-09-19T05:24:11.766 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.757+0000 7feda57fa640 10 client.25586 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:24:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.850+0000 7feda57fa640 1 -- 172.21.15.120:0/2812520120 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fedb809c7b0 con 0x55d590452bc0 2024-09-19T05:24:11.852 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.850+0000 7feda57fa640 10 client.25586 handle_command_reply: tid=0 2024-09-19T05:24:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.850+0000 7fedc6c24740 1 client.25586 shutdown 2024-09-19T05:24:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.851+0000 7fedc6c24740 1 -- 172.21.15.120:0/2812520120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d590437af0 msgr2=0x55d59044b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.851+0000 7fedc6c24740 1 --2- 172.21.15.120:0/2812520120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d590437af0 0x55d59044b1f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fedb40105c0 tx=0x7fedb4010a80 comp rx=0 tx=0).stop 2024-09-19T05:24:11.853 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.851+0000 7fedc6c24740 1 -- 172.21.15.120:0/2812520120 shutdown_connections 2024-09-19T05:24:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.851+0000 7fedc6c24740 1 --2- 172.21.15.120:0/2812520120 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55d590452bc0 0x55d5904bff90 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.851+0000 7fedc6c24740 1 --2- 172.21.15.120:0/2812520120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d590442cb0 0x55d59043cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.851+0000 7fedc6c24740 1 --2- 172.21.15.120:0/2812520120 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55d590438410 0x55d59043c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.851+0000 7fedc6c24740 1 --2- 172.21.15.120:0/2812520120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d590437af0 0x55d59044b1f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.851+0000 7fedc6c24740 1 -- 172.21.15.120:0/2812520120 >> 172.21.15.120:0/2812520120 conn(0x55d590434060 msgr2=0x55d590441bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.851+0000 7feda57fa640 0 client.25586 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:24:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.851+0000 7fedc6c24740 1 -- 172.21.15.120:0/2812520120 shutdown_connections 2024-09-19T05:24:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.851+0000 7fedc6c24740 1 -- 172.21.15.120:0/2812520120 wait complete. 2024-09-19T05:24:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.852+0000 7fedc6c24740 20 client.25586 trim_cache size 0 max 16384 2024-09-19T05:24:11.854 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:24:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:24:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:24:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:24:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.852+0000 7fedc3daf640 1 -- 172.21.15.120:0/3296489239 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7feda80a34e0 msgr2=0x7feda80a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.852+0000 7fedc3daf640 1 --2- 172.21.15.120:0/3296489239 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7feda80a34e0 0x7feda80a59a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fedb00095f0 tx=0x7fedb0005dc0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.852+0000 7fedc3daf640 1 -- 172.21.15.120:0/3296489239 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedbc1035a0 msgr2=0x7fedbc1a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.852+0000 7fedc3daf640 1 --2- 172.21.15.120:0/3296489239 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedbc1035a0 0x7fedbc1a3a40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fedb800e910 tx=0x7fedb800edd0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.855 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.853+0000 7fedc3daf640 1 -- 172.21.15.120:0/3296489239 shutdown_connections 2024-09-19T05:24:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.853+0000 7fedc3daf640 1 --2- 172.21.15.120:0/3296489239 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7feda80a34e0 0x7feda80a59a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.853+0000 7fedc3daf640 1 --2- 172.21.15.120:0/3296489239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedbc10c0d0 0x7fedbc10acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.853+0000 7fedc3daf640 1 --2- 172.21.15.120:0/3296489239 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fedbc1035a0 0x7fedbc1a3a40 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.853+0000 7fedc3daf640 1 --2- 172.21.15.120:0/3296489239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedbc102c80 0x7fedbc1a3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.853+0000 7fedc3daf640 1 -- 172.21.15.120:0/3296489239 >> 172.21.15.120:0/3296489239 conn(0x7fedbc077990 msgr2=0x7fedbc100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.853+0000 7fedc3daf640 1 -- 172.21.15.120:0/3296489239 shutdown_connections 2024-09-19T05:24:11.856 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:11.853+0000 7fedc3daf640 1 -- 172.21.15.120:0/3296489239 wait complete. 2024-09-19T05:24:12.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:12 smithi120 ceph-mon[30956]: pgmap v152: 97 pgs: 97 active+clean; 399 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1.3 MiB/s wr, 113 op/s 2024-09-19T05:24:12.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:12 smithi194 ceph-mon[35228]: pgmap v152: 97 pgs: 97 active+clean; 399 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1.3 MiB/s wr, 113 op/s 2024-09-19T05:24:12.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:12 smithi178 ceph-mon[34347]: pgmap v152: 97 pgs: 97 active+clean; 399 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1.3 MiB/s wr, 113 op/s 2024-09-19T05:24:14.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:14 smithi120 ceph-mon[30956]: pgmap v153: 97 pgs: 97 active+clean; 399 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1.3 MiB/s wr, 113 op/s 2024-09-19T05:24:14.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:14 smithi194 ceph-mon[35228]: pgmap v153: 97 pgs: 97 active+clean; 399 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1.3 MiB/s wr, 113 op/s 2024-09-19T05:24:14.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:14 smithi178 ceph-mon[34347]: pgmap v153: 97 pgs: 97 active+clean; 399 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 915 KiB/s rd, 1.3 MiB/s wr, 113 op/s 2024-09-19T05:24:16.707 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:16 smithi194 ceph-mon[35228]: pgmap v154: 97 pgs: 97 active+clean; 400 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 221 op/s 2024-09-19T05:24:16.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:16 smithi120 ceph-mon[30956]: pgmap v154: 97 pgs: 97 active+clean; 400 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 221 op/s 2024-09-19T05:24:16.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:16 smithi178 ceph-mon[34347]: pgmap v154: 97 pgs: 97 active+clean; 400 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 221 op/s 2024-09-19T05:24:18.315 INFO:tasks.workunit.client.0.smithi120.stdout: 85 13402 70 8480 66 3910 164 2024-09-19T05:24:18.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:18 smithi120 ceph-mon[30956]: pgmap v155: 97 pgs: 97 active+clean; 400 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 198 op/s 2024-09-19T05:24:18.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:18 smithi194 ceph-mon[35228]: pgmap v155: 97 pgs: 97 active+clean; 400 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 198 op/s 2024-09-19T05:24:18.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:18 smithi178 ceph-mon[34347]: pgmap v155: 97 pgs: 97 active+clean; 400 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 198 op/s 2024-09-19T05:24:20.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:20 smithi120 ceph-mon[30956]: pgmap v156: 97 pgs: 97 active+clean; 414 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.4 MiB/s wr, 280 op/s 2024-09-19T05:24:20.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:20 smithi194 ceph-mon[35228]: pgmap v156: 97 pgs: 97 active+clean; 414 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.4 MiB/s wr, 280 op/s 2024-09-19T05:24:20.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:20 smithi178 ceph-mon[34347]: pgmap v156: 97 pgs: 97 active+clean; 414 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.4 MiB/s wr, 280 op/s 2024-09-19T05:24:22.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:22 smithi120 ceph-mon[30956]: pgmap v157: 97 pgs: 97 active+clean; 414 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 189 op/s 2024-09-19T05:24:22.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:22 smithi194 ceph-mon[35228]: pgmap v157: 97 pgs: 97 active+clean; 414 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 189 op/s 2024-09-19T05:24:22.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:22 smithi178 ceph-mon[34347]: pgmap v157: 97 pgs: 97 active+clean; 414 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 189 op/s 2024-09-19T05:24:24.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:24 smithi120 ceph-mon[30956]: pgmap v158: 97 pgs: 97 active+clean; 414 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 189 op/s 2024-09-19T05:24:24.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:24 smithi194 ceph-mon[35228]: pgmap v158: 97 pgs: 97 active+clean; 414 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 189 op/s 2024-09-19T05:24:24.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:24 smithi178 ceph-mon[34347]: pgmap v158: 97 pgs: 97 active+clean; 414 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 189 op/s 2024-09-19T05:24:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.975+0000 7f408e877640 1 -- 172.21.15.120:0/2749082781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4088108cf0 msgr2=0x7f408810cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.975+0000 7f408e877640 1 --2- 172.21.15.120:0/2749082781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4088108cf0 0x7f408810cd30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4070009900 tx=0x7f407002a410 comp rx=0 tx=0).stop 2024-09-19T05:24:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.975+0000 7f408e877640 1 -- 172.21.15.120:0/2749082781 shutdown_connections 2024-09-19T05:24:24.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.975+0000 7f408e877640 1 --2- 172.21.15.120:0/2749082781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f408810d490 0x7f4088114fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:24.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.975+0000 7f408e877640 1 --2- 172.21.15.120:0/2749082781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4088108cf0 0x7f408810cd30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:24.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.975+0000 7f408e877640 1 --2- 172.21.15.120:0/2749082781 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4088108340 0x7f4088108720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:24.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.975+0000 7f408e877640 1 -- 172.21.15.120:0/2749082781 >> 172.21.15.120:0/2749082781 conn(0x7f4088077a40 msgr2=0x7f4088079e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:24.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.975+0000 7f408e877640 1 -- 172.21.15.120:0/2749082781 shutdown_connections 2024-09-19T05:24:24.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.975+0000 7f408e877640 1 -- 172.21.15.120:0/2749082781 wait complete. 2024-09-19T05:24:24.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.976+0000 7f408e877640 1 Processor -- start 2024-09-19T05:24:24.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.976+0000 7f408e877640 1 -- start start 2024-09-19T05:24:24.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.976+0000 7f408e877640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4088108340 0x7f40881a4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.976+0000 7f408e877640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f408810d490 0x7f40881a4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.976+0000 7f408e877640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f408819e6c0 0x7f408819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.976+0000 7f408e877640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f40881183b0 con 0x7f4088108340 2024-09-19T05:24:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.976+0000 7f408e877640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4088118230 con 0x7f408810d490 2024-09-19T05:24:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.976+0000 7f4087fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4088108340 0x7f40881a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.976+0000 7f408e877640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4088118530 con 0x7f408819e6c0 2024-09-19T05:24:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.976+0000 7f4087fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4088108340 0x7f40881a4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60098/0 (socket says 172.21.15.120:60098) 2024-09-19T05:24:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.976+0000 7f4087fff640 1 -- 172.21.15.120:0/834593359 learned_addr learned my addr 172.21.15.120:0/834593359 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:24:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.977+0000 7f408ce14640 1 --2- 172.21.15.120:0/834593359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f408819e6c0 0x7f408819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.977+0000 7f407ffff640 1 --2- 172.21.15.120:0/834593359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f408810d490 0x7f40881a4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.977+0000 7f4087fff640 1 -- 172.21.15.120:0/834593359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f408819e6c0 msgr2=0x7f408819eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:24.980 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.977+0000 7f4087fff640 1 --2- 172.21.15.120:0/834593359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f408819e6c0 0x7f408819eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.977+0000 7f4087fff640 1 -- 172.21.15.120:0/834593359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f408810d490 msgr2=0x7f40881a4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.977+0000 7f4087fff640 1 --2- 172.21.15.120:0/834593359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f408810d490 0x7f40881a4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.977+0000 7f4087fff640 1 -- 172.21.15.120:0/834593359 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f408819f2c0 con 0x7f4088108340 2024-09-19T05:24:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.977+0000 7f4087fff640 1 --2- 172.21.15.120:0/834593359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4088108340 0x7f40881a4600 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f407800e9f0 tx=0x7f407800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.977+0000 7f4085ffb640 1 -- 172.21.15.120:0/834593359 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407800cd80 con 0x7f4088108340 2024-09-19T05:24:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.977+0000 7f4085ffb640 1 -- 172.21.15.120:0/834593359 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f40780108e0 con 0x7f4088108340 2024-09-19T05:24:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.977+0000 7f408e877640 1 -- 172.21.15.120:0/834593359 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40881ab3a0 con 0x7f4088108340 2024-09-19T05:24:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.977+0000 7f4085ffb640 1 -- 172.21.15.120:0/834593359 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4078018920 con 0x7f4088108340 2024-09-19T05:24:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.977+0000 7f408e877640 1 -- 172.21.15.120:0/834593359 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40881ab7a0 con 0x7f4088108340 2024-09-19T05:24:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.981+0000 7f409160b740 1 Processor -- start 2024-09-19T05:24:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.981+0000 7f409160b740 1 -- start start 2024-09-19T05:24:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.981+0000 7f4085ffb640 1 -- 172.21.15.120:0/834593359 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f4078010a90 con 0x7f4088108340 2024-09-19T05:24:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.981+0000 7f409160b740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c62093daf0 0x55c62093ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.981+0000 7f409160b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c62093e410 0x55c620948770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.981+0000 7f409160b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c620948cb0 0x55c62094b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.981+0000 7f409160b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c6208a22f0 con 0x55c62093e410 2024-09-19T05:24:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.981+0000 7f409160b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55c62084a270 con 0x55c620948cb0 2024-09-19T05:24:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.981+0000 7f409160b740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c62089e2b0 con 0x55c62093daf0 2024-09-19T05:24:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.981+0000 7f4087fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c62093e410 0x55c620948770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.981+0000 7f407ffff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c620948cb0 0x55c62094b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.981+0000 7f407ffff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c620948cb0 0x55c62094b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:41902/0 (socket says 172.21.15.120:41902) 2024-09-19T05:24:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.981+0000 7f407ffff640 1 -- 172.21.15.120:0/1935593945 learned_addr learned my addr 172.21.15.120:0/1935593945 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:24:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.982+0000 7f408ce14640 1 --2- 172.21.15.120:0/1935593945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c62093daf0 0x55c62093ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.982+0000 7f4087fff640 1 -- 172.21.15.120:0/1935593945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c62093daf0 msgr2=0x55c62093ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.982+0000 7f4087fff640 1 --2- 172.21.15.120:0/1935593945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c62093daf0 0x55c62093ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:24.986 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.982+0000 7f4087fff640 1 -- 172.21.15.120:0/1935593945 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c620948cb0 msgr2=0x55c62094b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.982+0000 7f4087fff640 1 --2- 172.21.15.120:0/1935593945 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c620948cb0 0x55c62094b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.982+0000 7f4087fff640 1 -- 172.21.15.120:0/1935593945 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c620849340 con 0x55c62093e410 2024-09-19T05:24:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.982+0000 7f407ffff640 1 --2- 172.21.15.120:0/1935593945 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c620948cb0 0x55c62094b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:24:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.982+0000 7f4085ffb640 1 --2- 172.21.15.120:0/834593359 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f40740a34e0 0x7f40740a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.982+0000 7f4087fff640 1 --2- 172.21.15.120:0/1935593945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c62093e410 0x55c620948770 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f40780cd750 tx=0x7f40780d8700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef173cc200f9d9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.982+0000 7f408ce14640 1 --2- 172.21.15.120:0/834593359 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f40740a34e0 0x7f40740a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.982+0000 7f4085ffb640 1 -- 172.21.15.120:0/834593359 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f40780d00b0 con 0x7f4088108340 2024-09-19T05:24:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.983+0000 7f407e7fc640 1 -- 172.21.15.120:0/1935593945 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4078098580 con 0x55c62093e410 2024-09-19T05:24:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.983+0000 7f407e7fc640 1 -- 172.21.15.120:0/1935593945 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4078096e50 con 0x55c62093e410 2024-09-19T05:24:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.983+0000 7f407e7fc640 1 -- 172.21.15.120:0/1935593945 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407809bc40 con 0x55c62093e410 2024-09-19T05:24:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.984+0000 7f409160b740 1 -- 172.21.15.120:0/1935593945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c62093e410 msgr2=0x55c620948770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:24.987 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.984+0000 7f409160b740 1 --2- 172.21.15.120:0/1935593945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c62093e410 0x55c620948770 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f40780cd750 tx=0x7f40780d8700 comp rx=0 tx=0).stop 2024-09-19T05:24:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.984+0000 7f408ce14640 1 --2- 172.21.15.120:0/834593359 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f40740a34e0 0x7f40740a59a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4080005fd0 tx=0x7f4080009500 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.984+0000 7f409160b740 1 -- 172.21.15.120:0/1935593945 shutdown_connections 2024-09-19T05:24:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.984+0000 7f409160b740 1 --2- 172.21.15.120:0/1935593945 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c620948cb0 0x55c62094b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.984+0000 7f409160b740 1 --2- 172.21.15.120:0/1935593945 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c62093e410 0x55c620948770 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.984+0000 7f409160b740 1 --2- 172.21.15.120:0/1935593945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c62093daf0 0x55c62093ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.984+0000 7f409160b740 1 -- 172.21.15.120:0/1935593945 >> 172.21.15.120:0/1935593945 conn(0x55c62093a060 msgr2=0x55c62093a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.984+0000 7f409160b740 1 -- 172.21.15.120:0/1935593945 shutdown_connections 2024-09-19T05:24:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.984+0000 7f409160b740 1 -- 172.21.15.120:0/1935593945 wait complete. 2024-09-19T05:24:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.984+0000 7f409160b740 1 -- start start 2024-09-19T05:24:24.988 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.985+0000 7f409160b740 1 Processor -- start 2024-09-19T05:24:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.985+0000 7f409160b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c62093daf0 0x55c620945bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.985+0000 7f409160b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c62093e410 0x55c620946100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:24.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.985+0000 7f409160b740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c620948cb0 0x55c620946640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.985+0000 7f409160b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55c62094b8d0 con 0x55c62093daf0 2024-09-19T05:24:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.985+0000 7f409160b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55c62082b290 con 0x55c62093e410 2024-09-19T05:24:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.985+0000 7f409160b740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c62094ba50 con 0x55c620948cb0 2024-09-19T05:24:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.985+0000 7f409160b740 10 client.0 _ll_register_callbacks cb 0x55c62085c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:24:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.985+0000 7f408ce14640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c620948cb0 0x55c620946640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.985+0000 7f4087fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c62093daf0 0x55c620945bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.985+0000 7f408ce14640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c620948cb0 0x55c620946640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:59064/0 (socket says 172.21.15.120:59064) 2024-09-19T05:24:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.985+0000 7f4087fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c62093daf0 0x55c620945bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60126/0 (socket says 172.21.15.120:60126) 2024-09-19T05:24:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.985+0000 7f408ce14640 1 -- 172.21.15.120:0/394416427 learned_addr learned my addr 172.21.15.120:0/394416427 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:24:24.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.985+0000 7f407ffff640 1 --2- 172.21.15.120:0/394416427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c62093e410 0x55c620946100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.986+0000 7f408ce14640 1 -- 172.21.15.120:0/394416427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c62093e410 msgr2=0x55c620946100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.986+0000 7f408ce14640 1 --2- 172.21.15.120:0/394416427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c62093e410 0x55c620946100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.986+0000 7f408ce14640 1 -- 172.21.15.120:0/394416427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c62093daf0 msgr2=0x55c620945bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.986+0000 7f408ce14640 1 --2- 172.21.15.120:0/394416427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c62093daf0 0x55c620945bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.986+0000 7f408ce14640 1 -- 172.21.15.120:0/394416427 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6205b5210 con 0x55c620948cb0 2024-09-19T05:24:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.986+0000 7f407ffff640 1 --2- 172.21.15.120:0/394416427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c62093e410 0x55c620946100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:24:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.986+0000 7f408ce14640 1 --2- 172.21.15.120:0/394416427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c620948cb0 0x55c620946640 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4080004040 tx=0x7f4080004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f35cd984dc44250 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.986+0000 7f40677fe640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:24:24.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.986+0000 7f40677fe640 1 -- 172.21.15.120:0/394416427 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4080004b20 con 0x55c620948cb0 2024-09-19T05:24:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.986+0000 7f40677fe640 1 -- 172.21.15.120:0/394416427 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f4080004cc0 con 0x55c620948cb0 2024-09-19T05:24:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.986+0000 7f409160b740 1 -- 172.21.15.120:0/394416427 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4078096e50 con 0x55c620948cb0 2024-09-19T05:24:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.986+0000 7f40677fe640 1 -- 172.21.15.120:0/394416427 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f408000f7d0 con 0x55c620948cb0 2024-09-19T05:24:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.986+0000 7f409160b740 10 client.25672 fetch_fsmap learned FSMap version 29 2024-09-19T05:24:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.986+0000 7f409160b740 1 -- 172.21.15.120:0/394416427 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c620681620 con 0x55c620948cb0 2024-09-19T05:24:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.987+0000 7f40677fe640 1 -- 172.21.15.120:0/394416427 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4078096e50 con 0x55c620948cb0 2024-09-19T05:24:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.987+0000 7f40677fe640 1 -- 172.21.15.120:0/394416427 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4080026030 con 0x55c620948cb0 2024-09-19T05:24:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.987+0000 7f409160b740 10 client.25672 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:24:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.987+0000 7f409160b740 10 client.25672 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:24:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.987+0000 7f409160b740 20 client.25672 populate_metadata read hostname 'smithi120' 2024-09-19T05:24:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.987+0000 7f409160b740 1 --2- 172.21.15.120:0/394416427 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55c620958cd0 0x55c62095b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:24.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.987+0000 7f409160b740 4 client.25672 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:24:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.987+0000 7f409160b740 1 -- 172.21.15.120:0/394416427 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6208afa20 con 0x55c620958cd0 2024-09-19T05:24:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.987+0000 7f4087fff640 1 --2- 172.21.15.120:0/394416427 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55c620958cd0 0x55c62095b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.988+0000 7f40677fe640 10 client.25672 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:24:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.988+0000 7f4087fff640 1 --2- 172.21.15.120:0/394416427 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55c620958cd0 0x55c62095b120 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a933ba7461603ded server_cookie=7f18202e159b69 in_seq=0 out_seq=0 2024-09-19T05:24:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.988+0000 7f40677fe640 1 -- 172.21.15.120:0/394416427 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c6208afa20 con 0x55c620958cd0 2024-09-19T05:24:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.988+0000 7f40677fe640 10 client.25672 handle_command_reply: tid=0 2024-09-19T05:24:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.988+0000 7f409160b740 1 client.25672 shutdown 2024-09-19T05:24:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.989+0000 7f409160b740 1 -- 172.21.15.120:0/394416427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c620948cb0 msgr2=0x55c620946640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:24.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.989+0000 7f409160b740 1 --2- 172.21.15.120:0/394416427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c620948cb0 0x55c620946640 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4080004040 tx=0x7f4080004ab0 comp rx=0 tx=0).stop 2024-09-19T05:24:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.989+0000 7f409160b740 1 -- 172.21.15.120:0/394416427 shutdown_connections 2024-09-19T05:24:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.989+0000 7f409160b740 1 --2- 172.21.15.120:0/394416427 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55c620958cd0 0x55c62095b120 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.989+0000 7f40677fe640 0 client.25672 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:24:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.989+0000 7f409160b740 1 --2- 172.21.15.120:0/394416427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c620948cb0 0x55c620946640 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.989+0000 7f409160b740 1 --2- 172.21.15.120:0/394416427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c62093e410 0x55c620946100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:24.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.989+0000 7f409160b740 1 --2- 172.21.15.120:0/394416427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c62093daf0 0x55c620945bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.989+0000 7f409160b740 1 -- 172.21.15.120:0/394416427 >> 172.21.15.120:0/394416427 conn(0x55c62093a060 msgr2=0x55c62093fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.989+0000 7f409160b740 1 -- 172.21.15.120:0/394416427 shutdown_connections 2024-09-19T05:24:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.989+0000 7f409160b740 1 -- 172.21.15.120:0/394416427 wait complete. 2024-09-19T05:24:24.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:24.989+0000 7f409160b740 20 client.25672 trim_cache size 0 max 16384 2024-09-19T05:24:25.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.011+0000 7f409160b740 1 Processor -- start 2024-09-19T05:24:25.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.011+0000 7f409160b740 1 -- start start 2024-09-19T05:24:25.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.011+0000 7f409160b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c62093daf0 0x55c620946470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:25.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.011+0000 7f409160b740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c62093e410 0x55c620960a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:25.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.011+0000 7f409160b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c620948cb0 0x55c620960f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:25.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.011+0000 7f409160b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f40881b6790 con 0x55c620948cb0 2024-09-19T05:24:25.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.011+0000 7f409160b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f40881b4060 con 0x55c62093daf0 2024-09-19T05:24:25.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.011+0000 7f409160b740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f40881b1eb0 con 0x55c62093e410 2024-09-19T05:24:25.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.011+0000 7f4087fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c62093daf0 0x55c620946470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:25.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.011+0000 7f408ce14640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c620948cb0 0x55c620960f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:25.013 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.011+0000 7f407ffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c62093e410 0x55c620960a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:25.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.011+0000 7f4087fff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c62093daf0 0x55c620946470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:43286/0 (socket says 172.21.15.120:43286) 2024-09-19T05:24:25.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.011+0000 7f4087fff640 1 -- 172.21.15.120:0/1292572353 learned_addr learned my addr 172.21.15.120:0/1292572353 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:24:25.014 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.011+0000 7f407ffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c62093e410 0x55c620960a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:36724/0 (socket says 172.21.15.120:36724) 2024-09-19T05:24:25.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.011+0000 7f4087fff640 1 -- 172.21.15.120:0/1292572353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c62093e410 msgr2=0x55c620960a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:25.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.011+0000 7f4087fff640 1 --2- 172.21.15.120:0/1292572353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c62093e410 0x55c620960a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:25.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.011+0000 7f4087fff640 1 -- 172.21.15.120:0/1292572353 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c620948cb0 msgr2=0x55c620960f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:25.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.011+0000 7f4087fff640 1 --2- 172.21.15.120:0/1292572353 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c620948cb0 0x55c620960f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:25.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.011+0000 7f4087fff640 1 -- 172.21.15.120:0/1292572353 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c620957840 con 0x55c62093daf0 2024-09-19T05:24:25.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.011+0000 7f408ce14640 1 --2- 172.21.15.120:0/1292572353 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c620948cb0 0x55c620960f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:24:25.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.012+0000 7f4087fff640 1 --2- 172.21.15.120:0/1292572353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c62093daf0 0x55c620946470 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f407800c6a0 tx=0x7f40780d3b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9220e0611056ac1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:25.015 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.012+0000 7f407dffb640 1 -- 172.21.15.120:0/1292572353 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407809be20 con 0x55c62093daf0 2024-09-19T05:24:25.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.012+0000 7f407dffb640 1 -- 172.21.15.120:0/1292572353 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4078096e50 con 0x55c62093daf0 2024-09-19T05:24:25.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.012+0000 7f407dffb640 1 -- 172.21.15.120:0/1292572353 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407809c0b0 con 0x55c62093daf0 2024-09-19T05:24:25.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.013+0000 7f409160b740 1 -- 172.21.15.120:0/1292572353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c62093daf0 msgr2=0x55c620946470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:25.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.013+0000 7f409160b740 1 --2- 172.21.15.120:0/1292572353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c62093daf0 0x55c620946470 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f407800c6a0 tx=0x7f40780d3b60 comp rx=0 tx=0).stop 2024-09-19T05:24:25.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.013+0000 7f409160b740 1 -- 172.21.15.120:0/1292572353 shutdown_connections 2024-09-19T05:24:25.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.013+0000 7f409160b740 1 --2- 172.21.15.120:0/1292572353 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c620948cb0 0x55c620960f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:25.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.013+0000 7f409160b740 1 --2- 172.21.15.120:0/1292572353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c62093e410 0x55c620960a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:25.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.013+0000 7f409160b740 1 --2- 172.21.15.120:0/1292572353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c62093daf0 0x55c620946470 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:25.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.013+0000 7f409160b740 1 -- 172.21.15.120:0/1292572353 >> 172.21.15.120:0/1292572353 conn(0x55c62093a060 msgr2=0x55c620947c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:25.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.013+0000 7f409160b740 1 -- 172.21.15.120:0/1292572353 shutdown_connections 2024-09-19T05:24:25.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.013+0000 7f409160b740 1 -- 172.21.15.120:0/1292572353 wait complete. 2024-09-19T05:24:25.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.013+0000 7f409160b740 1 -- start start 2024-09-19T05:24:25.016 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.013+0000 7f409160b740 1 Processor -- start 2024-09-19T05:24:25.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.014+0000 7f409160b740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c62093daf0 0x55c620951270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:25.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.014+0000 7f409160b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c62093e410 0x55c62094c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:25.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.014+0000 7f409160b740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c620948cb0 0x55c62094cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:25.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.014+0000 7f409160b740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f40881b2520 con 0x55c62093daf0 2024-09-19T05:24:25.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.014+0000 7f409160b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f40881b3990 con 0x55c62093e410 2024-09-19T05:24:25.019 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.014+0000 7f409160b740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f40881b2bf0 con 0x55c620948cb0 2024-09-19T05:24:25.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.014+0000 7f409160b740 10 client.0 _ll_register_callbacks cb 0x7f4080009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:24:25.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.014+0000 7f4087fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c62093daf0 0x55c620951270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:25.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.014+0000 7f408ce14640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c620948cb0 0x55c62094cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:25.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.014+0000 7f4087fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c62093daf0 0x55c620951270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:41688/0 (socket says 172.21.15.120:41688) 2024-09-19T05:24:25.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.014+0000 7f408ce14640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c620948cb0 0x55c62094cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:36738/0 (socket says 172.21.15.120:36738) 2024-09-19T05:24:25.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.014+0000 7f4087fff640 1 -- 172.21.15.120:0/2060982944 learned_addr learned my addr 172.21.15.120:0/2060982944 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:24:25.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.014+0000 7f407ffff640 1 --2- 172.21.15.120:0/2060982944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c62093e410 0x55c62094c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:25.020 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.014+0000 7f4087fff640 1 -- 172.21.15.120:0/2060982944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c620948cb0 msgr2=0x55c62094cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.014+0000 7f4087fff640 1 --2- 172.21.15.120:0/2060982944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c620948cb0 0x55c62094cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.014+0000 7f4087fff640 1 -- 172.21.15.120:0/2060982944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c62093e410 msgr2=0x55c62094c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.014+0000 7f4087fff640 1 --2- 172.21.15.120:0/2060982944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c62093e410 0x55c62094c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.014+0000 7f4087fff640 1 -- 172.21.15.120:0/2060982944 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c62094d110 con 0x55c62093daf0 2024-09-19T05:24:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.014+0000 7f408ce14640 1 --2- 172.21.15.120:0/2060982944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c620948cb0 0x55c62094cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:24:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.014+0000 7f407ffff640 1 --2- 172.21.15.120:0/2060982944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c62093e410 0x55c62094c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:24:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.015+0000 7f4087fff640 1 --2- 172.21.15.120:0/2060982944 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c62093daf0 0x55c620951270 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f40780d5040 tx=0x7f4078009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb36e52d15623fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.015+0000 7f40677fe640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:24:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.015+0000 7f40677fe640 1 -- 172.21.15.120:0/2060982944 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40780b4030 con 0x55c62093daf0 2024-09-19T05:24:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.015+0000 7f40677fe640 1 -- 172.21.15.120:0/2060982944 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f407809a5e0 con 0x55c62093daf0 2024-09-19T05:24:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.015+0000 7f409160b740 1 -- 172.21.15.120:0/2060982944 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4078096e50 con 0x55c62093daf0 2024-09-19T05:24:25.021 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.015+0000 7f40677fe640 1 -- 172.21.15.120:0/2060982944 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f407809c0b0 con 0x55c62093daf0 2024-09-19T05:24:25.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.015+0000 7f409160b740 10 client.16152 fetch_fsmap learned FSMap version 29 2024-09-19T05:24:25.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.015+0000 7f409160b740 1 -- 172.21.15.120:0/2060982944 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c6209c3860 con 0x55c62093daf0 2024-09-19T05:24:25.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.015+0000 7f40677fe640 1 -- 172.21.15.120:0/2060982944 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4078096e50 con 0x55c62093daf0 2024-09-19T05:24:25.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.015+0000 7f40677fe640 1 -- 172.21.15.120:0/2060982944 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4078098950 con 0x55c62093daf0 2024-09-19T05:24:25.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.016+0000 7f409160b740 10 client.16152 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:24:25.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.016+0000 7f409160b740 10 client.16152 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:24:25.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.016+0000 7f409160b740 20 client.16152 populate_metadata read hostname 'smithi120' 2024-09-19T05:24:25.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.016+0000 7f409160b740 1 --2- 172.21.15.120:0/2060982944 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55c620958cd0 0x55c6209c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:25.022 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.016+0000 7f409160b740 4 client.16152 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:24:25.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.016+0000 7f409160b740 1 -- 172.21.15.120:0/2060982944 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c6208a9d70 con 0x55c620958cd0 2024-09-19T05:24:25.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.016+0000 7f407ffff640 1 --2- 172.21.15.120:0/2060982944 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55c620958cd0 0x55c6209c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:25.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.016+0000 7f40677fe640 10 client.16152 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:24:25.023 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.016+0000 7f407ffff640 1 --2- 172.21.15.120:0/2060982944 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55c620958cd0 0x55c6209c5af0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be8b2a8bcb02c11c server_cookie=2e6b97297974a169 in_seq=0 out_seq=0 2024-09-19T05:24:25.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.110+0000 7f40677fe640 1 -- 172.21.15.120:0/2060982944 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c6208a9d70 con 0x55c620958cd0 2024-09-19T05:24:25.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.110+0000 7f40677fe640 10 client.16152 handle_command_reply: tid=0 2024-09-19T05:24:25.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.110+0000 7f409160b740 1 client.16152 shutdown 2024-09-19T05:24:25.113 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.111+0000 7f409160b740 1 -- 172.21.15.120:0/2060982944 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c62093daf0 msgr2=0x55c620951270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:25.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.111+0000 7f409160b740 1 --2- 172.21.15.120:0/2060982944 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c62093daf0 0x55c620951270 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f40780d5040 tx=0x7f4078009310 comp rx=0 tx=0).stop 2024-09-19T05:24:25.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.111+0000 7f409160b740 1 -- 172.21.15.120:0/2060982944 shutdown_connections 2024-09-19T05:24:25.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.111+0000 7f409160b740 1 --2- 172.21.15.120:0/2060982944 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55c620958cd0 0x55c6209c5af0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:25.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.111+0000 7f409160b740 1 --2- 172.21.15.120:0/2060982944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c620948cb0 0x55c62094cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:25.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.111+0000 7f40677fe640 0 client.16152 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:24:25.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.111+0000 7f409160b740 1 --2- 172.21.15.120:0/2060982944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c62093e410 0x55c62094c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:25.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.111+0000 7f409160b740 1 --2- 172.21.15.120:0/2060982944 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55c62093daf0 0x55c620951270 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:25.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.111+0000 7f409160b740 1 -- 172.21.15.120:0/2060982944 >> 172.21.15.120:0/2060982944 conn(0x55c62093a060 msgr2=0x55c6209389a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:25.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.111+0000 7f409160b740 1 -- 172.21.15.120:0/2060982944 shutdown_connections 2024-09-19T05:24:25.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.111+0000 7f409160b740 1 -- 172.21.15.120:0/2060982944 wait complete. 2024-09-19T05:24:25.114 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.111+0000 7f409160b740 20 client.16152 trim_cache size 0 max 16384 2024-09-19T05:24:25.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:24:25.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:24:25.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:24:25.115 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:24:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.112+0000 7f408e877640 1 -- 172.21.15.120:0/834593359 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f40740a34e0 msgr2=0x7f40740a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.112+0000 7f408e877640 1 --2- 172.21.15.120:0/834593359 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f40740a34e0 0x7f40740a59a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4080005fd0 tx=0x7f4080009500 comp rx=0 tx=0).stop 2024-09-19T05:24:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.112+0000 7f408e877640 1 -- 172.21.15.120:0/834593359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4088108340 msgr2=0x7f40881a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.112+0000 7f408e877640 1 --2- 172.21.15.120:0/834593359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4088108340 0x7f40881a4600 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f407800e9f0 tx=0x7f407800eeb0 comp rx=0 tx=0).stop 2024-09-19T05:24:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.112+0000 7f408e877640 1 -- 172.21.15.120:0/834593359 shutdown_connections 2024-09-19T05:24:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.112+0000 7f408e877640 1 --2- 172.21.15.120:0/834593359 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f40740a34e0 0x7f40740a59a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.112+0000 7f408e877640 1 --2- 172.21.15.120:0/834593359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f408819e6c0 0x7f408819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.112+0000 7f408e877640 1 --2- 172.21.15.120:0/834593359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f408810d490 0x7f40881a4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.112+0000 7f408e877640 1 --2- 172.21.15.120:0/834593359 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4088108340 0x7f40881a4600 secure :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f407800e9f0 tx=0x7f407800eeb0 comp rx=0 tx=0).stop 2024-09-19T05:24:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.112+0000 7f408e877640 1 -- 172.21.15.120:0/834593359 >> 172.21.15.120:0/834593359 conn(0x7f4088077a40 msgr2=0x7f4088078d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:25.116 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.113+0000 7f408e877640 1 -- 172.21.15.120:0/834593359 shutdown_connections 2024-09-19T05:24:25.117 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:25.113+0000 7f408e877640 1 -- 172.21.15.120:0/834593359 wait complete. 2024-09-19T05:24:26.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:26 smithi120 ceph-mon[30956]: pgmap v159: 97 pgs: 97 active+clean; 415 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.5 MiB/s wr, 295 op/s 2024-09-19T05:24:26.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:26 smithi194 ceph-mon[35228]: pgmap v159: 97 pgs: 97 active+clean; 415 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.5 MiB/s wr, 295 op/s 2024-09-19T05:24:26.944 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:26 smithi178 ceph-mon[34347]: pgmap v159: 97 pgs: 97 active+clean; 415 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.5 MiB/s wr, 295 op/s 2024-09-19T05:24:28.315 INFO:tasks.workunit.client.0.smithi120.stdout: 87 13105 110 8337 62 3337 188 2024-09-19T05:24:28.743 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:28 smithi178 ceph-mon[34347]: pgmap v160: 97 pgs: 97 active+clean; 415 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 187 op/s 2024-09-19T05:24:28.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:28 smithi120 ceph-mon[30956]: pgmap v160: 97 pgs: 97 active+clean; 415 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 187 op/s 2024-09-19T05:24:28.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:28 smithi194 ceph-mon[35228]: pgmap v160: 97 pgs: 97 active+clean; 415 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 187 op/s 2024-09-19T05:24:30.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:30 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:24:30.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:30 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:24:30.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:30 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:24:31.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:31 smithi120 ceph-mon[30956]: pgmap v161: 97 pgs: 97 active+clean; 429 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.5 MiB/s wr, 267 op/s 2024-09-19T05:24:31.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:31 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:24:31.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:31 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:24:31.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:31 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:24:31.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:31 smithi194 ceph-mon[35228]: pgmap v161: 97 pgs: 97 active+clean; 429 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.5 MiB/s wr, 267 op/s 2024-09-19T05:24:31.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:31 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:24:31.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:31 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:24:31.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:31 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:24:31.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:31 smithi178 ceph-mon[34347]: pgmap v161: 97 pgs: 97 active+clean; 429 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.5 MiB/s wr, 267 op/s 2024-09-19T05:24:31.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:31 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:24:31.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:31 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:24:31.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:31 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:24:32.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:32 smithi120 ceph-mon[30956]: pgmap v162: 97 pgs: 97 active+clean; 429 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 185 op/s 2024-09-19T05:24:32.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:32 smithi194 ceph-mon[35228]: pgmap v162: 97 pgs: 97 active+clean; 429 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 185 op/s 2024-09-19T05:24:32.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:32 smithi178 ceph-mon[34347]: pgmap v162: 97 pgs: 97 active+clean; 429 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 185 op/s 2024-09-19T05:24:34.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:34 smithi120 ceph-mon[30956]: pgmap v163: 97 pgs: 97 active+clean; 429 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 185 op/s 2024-09-19T05:24:34.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:34 smithi194 ceph-mon[35228]: pgmap v163: 97 pgs: 97 active+clean; 429 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 185 op/s 2024-09-19T05:24:34.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:34 smithi178 ceph-mon[34347]: pgmap v163: 97 pgs: 97 active+clean; 429 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 185 op/s 2024-09-19T05:24:36.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:36 smithi120 ceph-mon[30956]: pgmap v164: 97 pgs: 97 active+clean; 443 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.5 MiB/s wr, 264 op/s 2024-09-19T05:24:36.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:36 smithi194 ceph-mon[35228]: pgmap v164: 97 pgs: 97 active+clean; 443 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.5 MiB/s wr, 264 op/s 2024-09-19T05:24:36.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:36 smithi178 ceph-mon[34347]: pgmap v164: 97 pgs: 97 active+clean; 443 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.5 MiB/s wr, 264 op/s 2024-09-19T05:24:38.240 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.238+0000 7f35c90ec640 1 -- 172.21.15.120:0/3312625810 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c0031880 con 0x7f35c4107b80 2024-09-19T05:24:38.240 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.239+0000 7f35cc352640 1 -- 172.21.15.120:0/3312625810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35c4107b80 msgr2=0x7f35c4107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:38.240 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.239+0000 7f35cc352640 1 --2- 172.21.15.120:0/3312625810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35c4107b80 0x7f35c4107f60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f35c0009980 tx=0x7f35c002a480 comp rx=0 tx=0).stop 2024-09-19T05:24:38.241 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.239+0000 7f35cc352640 1 -- 172.21.15.120:0/3312625810 shutdown_connections 2024-09-19T05:24:38.241 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.239+0000 7f35cc352640 1 --2- 172.21.15.120:0/3312625810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35c4102480 0x7f35c410e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.241 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.239+0000 7f35cc352640 1 --2- 172.21.15.120:0/3312625810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35c4101ae0 0x7f35c4101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.241 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.239+0000 7f35cc352640 1 --2- 172.21.15.120:0/3312625810 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35c4107b80 0x7f35c4107f60 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.241 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.239+0000 7f35cc352640 1 -- 172.21.15.120:0/3312625810 >> 172.21.15.120:0/3312625810 conn(0x7f35c40fd7e0 msgr2=0x7f35c40ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:38.241 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.239+0000 7f35cc352640 1 -- 172.21.15.120:0/3312625810 shutdown_connections 2024-09-19T05:24:38.241 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.239+0000 7f35cc352640 1 -- 172.21.15.120:0/3312625810 wait complete. 2024-09-19T05:24:38.243 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.240+0000 7f35cc352640 1 Processor -- start 2024-09-19T05:24:38.243 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.240+0000 7f35cc352640 1 -- start start 2024-09-19T05:24:38.243 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.240+0000 7f35cc352640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35c4101ae0 0x7f35c419a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:38.243 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.240+0000 7f35cc352640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35c4102480 0x7f35c419a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:38.243 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.240+0000 7f35cc352640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35c4107b80 0x7f35c419eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:38.243 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.240+0000 7f35cc352640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f35c4113f60 con 0x7f35c4101ae0 2024-09-19T05:24:38.243 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.240+0000 7f35cc352640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f35c4113de0 con 0x7f35c4102480 2024-09-19T05:24:38.243 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.240+0000 7f35cc352640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f35c41140e0 con 0x7f35c4107b80 2024-09-19T05:24:38.243 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.240+0000 7f35ca0ee640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35c4101ae0 0x7f35c419a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:38.243 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.240+0000 7f35c98ed640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35c4102480 0x7f35c419a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:38.244 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.240+0000 7f35ca0ee640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35c4101ae0 0x7f35c419a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36168/0 (socket says 172.21.15.120:36168) 2024-09-19T05:24:38.244 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.240+0000 7f35ca0ee640 1 -- 172.21.15.120:0/1665690660 learned_addr learned my addr 172.21.15.120:0/1665690660 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:24:38.244 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.240+0000 7f35c98ed640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35c4102480 0x7f35c419a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:36736/0 (socket says 172.21.15.120:36736) 2024-09-19T05:24:38.244 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.241+0000 7f35ca8ef640 1 --2- 172.21.15.120:0/1665690660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35c4107b80 0x7f35c419eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:38.244 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.241+0000 7f35c98ed640 1 -- 172.21.15.120:0/1665690660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35c4107b80 msgr2=0x7f35c419eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:38.244 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.241+0000 7f35c98ed640 1 --2- 172.21.15.120:0/1665690660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35c4107b80 0x7f35c419eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.244 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.241+0000 7f35c98ed640 1 -- 172.21.15.120:0/1665690660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35c4101ae0 msgr2=0x7f35c419a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:38.244 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.241+0000 7f35c98ed640 1 --2- 172.21.15.120:0/1665690660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35c4101ae0 0x7f35c419a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.244 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.241+0000 7f35c98ed640 1 -- 172.21.15.120:0/1665690660 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c419f280 con 0x7f35c4102480 2024-09-19T05:24:38.244 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.241+0000 7f35ca0ee640 1 --2- 172.21.15.120:0/1665690660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35c4101ae0 0x7f35c419a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:24:38.244 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.241+0000 7f35c98ed640 1 --2- 172.21.15.120:0/1665690660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35c4102480 0x7f35c419a7d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f35b400e9f0 tx=0x7f35b400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:38.245 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.241+0000 7f35bb7fe640 1 -- 172.21.15.120:0/1665690660 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b400cd80 con 0x7f35c4102480 2024-09-19T05:24:38.245 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.241+0000 7f35cc352640 1 -- 172.21.15.120:0/1665690660 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35c419f570 con 0x7f35c4102480 2024-09-19T05:24:38.245 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.241+0000 7f35bb7fe640 1 -- 172.21.15.120:0/1665690660 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f35b40035f0 con 0x7f35c4102480 2024-09-19T05:24:38.245 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.242+0000 7f35bb7fe640 1 -- 172.21.15.120:0/1665690660 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b4010690 con 0x7f35c4102480 2024-09-19T05:24:38.245 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.242+0000 7f35cc352640 1 -- 172.21.15.120:0/1665690660 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35c41a6e00 con 0x7f35c4102480 2024-09-19T05:24:38.246 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.244+0000 7f35bb7fe640 1 -- 172.21.15.120:0/1665690660 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f35b40037a0 con 0x7f35c4102480 2024-09-19T05:24:38.246 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.245+0000 7f35cf1c9740 1 Processor -- start 2024-09-19T05:24:38.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.245+0000 7f35cf1c9740 1 -- start start 2024-09-19T05:24:38.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.245+0000 7f35cf1c9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f005130af0 0x55f005130ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:38.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.245+0000 7f35cf1c9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f005131410 0x55f00513b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:38.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.245+0000 7f35cf1c9740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f00513bcb0 0x55f00513e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:38.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.245+0000 7f35cf1c9740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f0050952f0 con 0x55f005131410 2024-09-19T05:24:38.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.245+0000 7f35cf1c9740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55f00503d270 con 0x55f005130af0 2024-09-19T05:24:38.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.245+0000 7f35cf1c9740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55f0050912b0 con 0x55f00513bcb0 2024-09-19T05:24:38.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.246+0000 7f35c98ed640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f00513bcb0 0x55f00513e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:38.248 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.246+0000 7f35ca0ee640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f005131410 0x55f00513b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:38.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.246+0000 7f35ca8ef640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f005130af0 0x55f005130ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:38.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.246+0000 7f35ca8ef640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f005130af0 0x55f005130ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:36738/0 (socket says 172.21.15.120:36738) 2024-09-19T05:24:38.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.246+0000 7f35ca8ef640 1 -- 172.21.15.120:0/1507962749 learned_addr learned my addr 172.21.15.120:0/1507962749 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:24:38.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.246+0000 7f35ca0ee640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f005131410 0x55f00513b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36172/0 (socket says 172.21.15.120:36172) 2024-09-19T05:24:38.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.246+0000 7f35ca8ef640 1 -- 172.21.15.120:0/1507962749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f00513bcb0 msgr2=0x55f00513e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:38.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.246+0000 7f35ca8ef640 1 --2- 172.21.15.120:0/1507962749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f00513bcb0 0x55f00513e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.246+0000 7f35ca8ef640 1 -- 172.21.15.120:0/1507962749 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f005131410 msgr2=0x55f00513b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:38.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.246+0000 7f35ca8ef640 1 --2- 172.21.15.120:0/1507962749 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f005131410 0x55f00513b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.246+0000 7f35ca8ef640 1 -- 172.21.15.120:0/1507962749 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f00503c340 con 0x55f005130af0 2024-09-19T05:24:38.249 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.246+0000 7f35bb7fe640 1 --2- 172.21.15.120:0/1665690660 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f35b00a34e0 0x7f35b00a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:38.253 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.246+0000 7f35ca8ef640 1 --2- 172.21.15.120:0/1507962749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f005130af0 0x55f005130ed0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f35bc009f50 tx=0x7f35bc0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f28302f52470050 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:38.253 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.246+0000 7f35ca0ee640 1 --2- 172.21.15.120:0/1665690660 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f35b00a34e0 0x7f35b00a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:38.253 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.246+0000 7f35b8bfe640 1 -- 172.21.15.120:0/1507962749 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc004d20 con 0x55f005130af0 2024-09-19T05:24:38.253 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.247+0000 7f35b8bfe640 1 -- 172.21.15.120:0/1507962749 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f35bc004050 con 0x55f005130af0 2024-09-19T05:24:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.247+0000 7f35b8bfe640 1 -- 172.21.15.120:0/1507962749 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc005280 con 0x55f005130af0 2024-09-19T05:24:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.247+0000 7f35bb7fe640 1 -- 172.21.15.120:0/1665690660 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f35b40cffb0 con 0x7f35c4102480 2024-09-19T05:24:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.247+0000 7f35cf1c9740 1 -- 172.21.15.120:0/1507962749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f005130af0 msgr2=0x55f005130ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.247+0000 7f35ca0ee640 1 --2- 172.21.15.120:0/1665690660 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f35b00a34e0 0x7f35b00a59a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f35c00096c0 tx=0x7f35c000b040 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.247+0000 7f35cf1c9740 1 --2- 172.21.15.120:0/1507962749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f005130af0 0x55f005130ed0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f35bc009f50 tx=0x7f35bc0118d0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.248+0000 7f35cf1c9740 1 -- 172.21.15.120:0/1507962749 shutdown_connections 2024-09-19T05:24:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.248+0000 7f35cf1c9740 1 --2- 172.21.15.120:0/1507962749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f00513bcb0 0x55f00513e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.248+0000 7f35cf1c9740 1 --2- 172.21.15.120:0/1507962749 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f005131410 0x55f00513b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.248+0000 7f35cf1c9740 1 --2- 172.21.15.120:0/1507962749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f005130af0 0x55f005130ed0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.248+0000 7f35cf1c9740 1 -- 172.21.15.120:0/1507962749 >> 172.21.15.120:0/1507962749 conn(0x55f00512d060 msgr2=0x55f00512d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.248+0000 7f35cf1c9740 1 -- 172.21.15.120:0/1507962749 shutdown_connections 2024-09-19T05:24:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.248+0000 7f35cf1c9740 1 -- 172.21.15.120:0/1507962749 wait complete. 2024-09-19T05:24:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.248+0000 7f35cf1c9740 1 -- start start 2024-09-19T05:24:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.248+0000 7f35cf1c9740 1 Processor -- start 2024-09-19T05:24:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.248+0000 7f35cf1c9740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f005130af0 0x55f005138ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.248+0000 7f35cf1c9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f005131410 0x55f0051390e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.249+0000 7f35cf1c9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f00513bcb0 0x55f005139620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.249+0000 7f35cf1c9740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f00513e880 con 0x55f00513bcb0 2024-09-19T05:24:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.249+0000 7f35cf1c9740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55f00501e290 con 0x55f005131410 2024-09-19T05:24:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.249+0000 7f35ca0ee640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f005130af0 0x55f005138ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.249+0000 7f35cf1c9740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55f00513ea00 con 0x55f005130af0 2024-09-19T05:24:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.249+0000 7f35ca0ee640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f005130af0 0x55f005138ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:44888/0 (socket says 172.21.15.120:44888) 2024-09-19T05:24:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.249+0000 7f35ca0ee640 1 -- 172.21.15.120:0/655073526 learned_addr learned my addr 172.21.15.120:0/655073526 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:24:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.249+0000 7f35ca8ef640 1 --2- 172.21.15.120:0/655073526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f00513bcb0 0x55f005139620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.249+0000 7f35cf1c9740 10 client.0 _ll_register_callbacks cb 0x55f00504f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:24:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.249+0000 7f35c98ed640 1 --2- 172.21.15.120:0/655073526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f005131410 0x55f0051390e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.249+0000 7f35ca8ef640 1 -- 172.21.15.120:0/655073526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f005130af0 msgr2=0x55f005138ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.249+0000 7f35ca8ef640 1 --2- 172.21.15.120:0/655073526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f005130af0 0x55f005138ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.249+0000 7f35ca8ef640 1 -- 172.21.15.120:0/655073526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f005131410 msgr2=0x55f0051390e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.249+0000 7f35ca8ef640 1 --2- 172.21.15.120:0/655073526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f005131410 0x55f0051390e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.249+0000 7f35ca8ef640 1 -- 172.21.15.120:0/655073526 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f004da8210 con 0x55f00513bcb0 2024-09-19T05:24:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.249+0000 7f35ca8ef640 1 --2- 172.21.15.120:0/655073526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f00513bcb0 0x55f005139620 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f35bc012fd0 tx=0x7f35bc003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d661f43a184e368 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.249+0000 7f35adffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:24:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.250+0000 7f35adffb640 1 -- 172.21.15.120:0/655073526 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc028030 con 0x55f00513bcb0 2024-09-19T05:24:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.250+0000 7f35cf1c9740 1 -- 172.21.15.120:0/655073526 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35bc004050 con 0x55f00513bcb0 2024-09-19T05:24:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.250+0000 7f35adffb640 1 -- 172.21.15.120:0/655073526 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f35bc004c10 con 0x55f00513bcb0 2024-09-19T05:24:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.250+0000 7f35adffb640 1 -- 172.21.15.120:0/655073526 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f35bc004e10 con 0x55f00513bcb0 2024-09-19T05:24:38.258 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.250+0000 7f35cf1c9740 10 client.16164 fetch_fsmap learned FSMap version 29 2024-09-19T05:24:38.258 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.250+0000 7f35cf1c9740 1 -- 172.21.15.120:0/655073526 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f004e74620 con 0x55f00513bcb0 2024-09-19T05:24:38.258 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.250+0000 7f35adffb640 1 -- 172.21.15.120:0/655073526 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f35bc004050 con 0x55f00513bcb0 2024-09-19T05:24:38.258 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.250+0000 7f35adffb640 1 -- 172.21.15.120:0/655073526 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f35bc024460 con 0x55f00513bcb0 2024-09-19T05:24:38.258 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.250+0000 7f35cf1c9740 10 client.16164 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:24:38.258 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.250+0000 7f35cf1c9740 10 client.16164 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:24:38.258 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.251+0000 7f35cf1c9740 20 client.16164 populate_metadata read hostname 'smithi120' 2024-09-19T05:24:38.258 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.251+0000 7f35cf1c9740 1 --2- 172.21.15.120:0/655073526 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55f0051543a0 0x55f005156790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:38.258 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.251+0000 7f35cf1c9740 4 client.16164 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:24:38.258 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.251+0000 7f35cf1c9740 1 -- 172.21.15.120:0/655073526 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0050a2a20 con 0x55f0051543a0 2024-09-19T05:24:38.258 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.251+0000 7f35ca0ee640 1 --2- 172.21.15.120:0/655073526 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55f0051543a0 0x55f005156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:38.258 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.251+0000 7f35ca0ee640 1 --2- 172.21.15.120:0/655073526 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55f0051543a0 0x55f005156790 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61bbcea45b0953e6 server_cookie=85387ee36b456c75 in_seq=0 out_seq=0 2024-09-19T05:24:38.258 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.251+0000 7f35adffb640 10 client.16164 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:24:38.259 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.252+0000 7f35adffb640 1 -- 172.21.15.120:0/655073526 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f0050a2a20 con 0x55f0051543a0 2024-09-19T05:24:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.252+0000 7f35adffb640 10 client.16164 handle_command_reply: tid=0 2024-09-19T05:24:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.252+0000 7f35cf1c9740 1 client.16164 shutdown 2024-09-19T05:24:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.253+0000 7f35cf1c9740 1 -- 172.21.15.120:0/655073526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f00513bcb0 msgr2=0x55f005139620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.253+0000 7f35cf1c9740 1 --2- 172.21.15.120:0/655073526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f00513bcb0 0x55f005139620 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f35bc012fd0 tx=0x7f35bc003ce0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.253+0000 7f35cf1c9740 1 -- 172.21.15.120:0/655073526 shutdown_connections 2024-09-19T05:24:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.253+0000 7f35cf1c9740 1 --2- 172.21.15.120:0/655073526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f00513bcb0 0x55f005139620 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.253+0000 7f35cf1c9740 1 --2- 172.21.15.120:0/655073526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f005131410 0x55f0051390e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.253+0000 7f35cf1c9740 1 --2- 172.21.15.120:0/655073526 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55f0051543a0 0x55f005156790 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.253+0000 7f35cf1c9740 1 --2- 172.21.15.120:0/655073526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f005130af0 0x55f005138ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.253+0000 7f35adffb640 0 client.16164 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:24:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.253+0000 7f35cf1c9740 1 -- 172.21.15.120:0/655073526 >> 172.21.15.120:0/655073526 conn(0x55f00512d060 msgr2=0x55f005132dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:38.260 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.253+0000 7f35cf1c9740 1 -- 172.21.15.120:0/655073526 shutdown_connections 2024-09-19T05:24:38.261 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.253+0000 7f35cf1c9740 1 -- 172.21.15.120:0/655073526 wait complete. 2024-09-19T05:24:38.261 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.253+0000 7f35cf1c9740 20 client.16164 trim_cache size 0 max 16384 2024-09-19T05:24:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.272+0000 7f35cf1c9740 1 Processor -- start 2024-09-19T05:24:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.272+0000 7f35cf1c9740 1 -- start start 2024-09-19T05:24:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.272+0000 7f35cf1c9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f005130af0 0x55f005150a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.272+0000 7f35cf1c9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f005131410 0x55f005133560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.272+0000 7f35cf1c9740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f00513bcb0 0x55f00515bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.272+0000 7f35cf1c9740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f35c41adf20 con 0x55f005131410 2024-09-19T05:24:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.272+0000 7f35cf1c9740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f35c41ab7f0 con 0x55f005130af0 2024-09-19T05:24:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.272+0000 7f35cf1c9740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f35c41a9660 con 0x55f00513bcb0 2024-09-19T05:24:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.272+0000 7f35c98ed640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f005131410 0x55f005133560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.272+0000 7f35ca0ee640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f005130af0 0x55f005150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.273+0000 7f35ca0ee640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f005130af0 0x55f005150a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:36752/0 (socket says 172.21.15.120:36752) 2024-09-19T05:24:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.273+0000 7f35ca0ee640 1 -- 172.21.15.120:0/2354054333 learned_addr learned my addr 172.21.15.120:0/2354054333 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:24:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.273+0000 7f35ca8ef640 1 --2- 172.21.15.120:0/2354054333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f00513bcb0 0x55f00515bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.273+0000 7f35ca0ee640 1 -- 172.21.15.120:0/2354054333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f00513bcb0 msgr2=0x55f00515bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.273+0000 7f35ca0ee640 1 --2- 172.21.15.120:0/2354054333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f00513bcb0 0x55f00515bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.273+0000 7f35ca0ee640 1 -- 172.21.15.120:0/2354054333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f005131410 msgr2=0x55f005133560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.273+0000 7f35ca0ee640 1 --2- 172.21.15.120:0/2354054333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f005131410 0x55f005133560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.273+0000 7f35ca0ee640 1 -- 172.21.15.120:0/2354054333 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f005137b70 con 0x55f005130af0 2024-09-19T05:24:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.273+0000 7f35ca8ef640 1 --2- 172.21.15.120:0/2354054333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f00513bcb0 0x55f00515bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:24:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.273+0000 7f35ca0ee640 1 --2- 172.21.15.120:0/2354054333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f005130af0 0x55f005150a50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55f005156ea0 tx=0x7f35c0005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac008c1d7fde56a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.273+0000 7f35affff640 1 -- 172.21.15.120:0/2354054333 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c004b070 con 0x55f005130af0 2024-09-19T05:24:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.273+0000 7f35affff640 1 -- 172.21.15.120:0/2354054333 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f35c0003ca0 con 0x55f005130af0 2024-09-19T05:24:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.273+0000 7f35affff640 1 -- 172.21.15.120:0/2354054333 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c0035040 con 0x55f005130af0 2024-09-19T05:24:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.274+0000 7f35cf1c9740 1 -- 172.21.15.120:0/2354054333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f005130af0 msgr2=0x55f005150a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.274+0000 7f35cf1c9740 1 --2- 172.21.15.120:0/2354054333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f005130af0 0x55f005150a50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55f005156ea0 tx=0x7f35c0005fd0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.274+0000 7f35cf1c9740 1 -- 172.21.15.120:0/2354054333 shutdown_connections 2024-09-19T05:24:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.274+0000 7f35cf1c9740 1 --2- 172.21.15.120:0/2354054333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f00513bcb0 0x55f00515bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.274+0000 7f35cf1c9740 1 --2- 172.21.15.120:0/2354054333 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f005131410 0x55f005133560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.274+0000 7f35cf1c9740 1 --2- 172.21.15.120:0/2354054333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f005130af0 0x55f005150a50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.274+0000 7f35cf1c9740 1 -- 172.21.15.120:0/2354054333 >> 172.21.15.120:0/2354054333 conn(0x55f00512d060 msgr2=0x55f00513ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.274+0000 7f35cf1c9740 1 -- 172.21.15.120:0/2354054333 shutdown_connections 2024-09-19T05:24:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.274+0000 7f35cf1c9740 1 -- 172.21.15.120:0/2354054333 wait complete. 2024-09-19T05:24:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.275+0000 7f35cf1c9740 1 -- start start 2024-09-19T05:24:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.275+0000 7f35cf1c9740 1 Processor -- start 2024-09-19T05:24:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.275+0000 7f35cf1c9740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f005130af0 0x55f005135be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.275+0000 7f35cf1c9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f005131410 0x55f005136120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.275+0000 7f35cf1c9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f00513bcb0 0x55f005136660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.275+0000 7f35cf1c9740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f35c41a9cb0 con 0x55f005131410 2024-09-19T05:24:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.275+0000 7f35cf1c9740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f35c41ab120 con 0x55f00513bcb0 2024-09-19T05:24:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.275+0000 7f35cf1c9740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f35c41aa380 con 0x55f005130af0 2024-09-19T05:24:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.275+0000 7f35cf1c9740 10 client.0 _ll_register_callbacks cb 0x7f35b4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:24:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.275+0000 7f35ca0ee640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f005130af0 0x55f005135be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.275+0000 7f35c98ed640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f005131410 0x55f005136120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.275+0000 7f35c98ed640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f005131410 0x55f005136120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:36186/0 (socket says 172.21.15.120:36186) 2024-09-19T05:24:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.275+0000 7f35ca0ee640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f005130af0 0x55f005135be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:44902/0 (socket says 172.21.15.120:44902) 2024-09-19T05:24:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.275+0000 7f35c98ed640 1 -- 172.21.15.120:0/370665417 learned_addr learned my addr 172.21.15.120:0/370665417 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:24:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.275+0000 7f35ca8ef640 1 --2- 172.21.15.120:0/370665417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f00513bcb0 0x55f005136660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.276+0000 7f35c98ed640 1 -- 172.21.15.120:0/370665417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f005130af0 msgr2=0x55f005135be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.276+0000 7f35c98ed640 1 --2- 172.21.15.120:0/370665417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f005130af0 0x55f005135be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.276+0000 7f35c98ed640 1 -- 172.21.15.120:0/370665417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f00513bcb0 msgr2=0x55f005136660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.276+0000 7f35c98ed640 1 --2- 172.21.15.120:0/370665417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f00513bcb0 0x55f005136660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.276+0000 7f35c98ed640 1 -- 172.21.15.120:0/370665417 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0051bded0 con 0x55f005131410 2024-09-19T05:24:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.276+0000 7f35ca8ef640 1 --2- 172.21.15.120:0/370665417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f00513bcb0 0x55f005136660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:24:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.276+0000 7f35c98ed640 1 --2- 172.21.15.120:0/370665417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f005131410 0x55f005136120 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f35b409bf40 tx=0x7f35b409bc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a18548f364de221c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.276+0000 7f35adffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:24:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.276+0000 7f35adffb640 1 -- 172.21.15.120:0/370665417 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b40a05f0 con 0x55f005131410 2024-09-19T05:24:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.276+0000 7f35adffb640 1 -- 172.21.15.120:0/370665417 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f35b40cd930 con 0x55f005131410 2024-09-19T05:24:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.276+0000 7f35cf1c9740 1 -- 172.21.15.120:0/370665417 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35c0003ca0 con 0x55f005131410 2024-09-19T05:24:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.276+0000 7f35adffb640 1 -- 172.21.15.120:0/370665417 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f35b40a4eb0 con 0x55f005131410 2024-09-19T05:24:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.276+0000 7f35cf1c9740 10 client.16170 fetch_fsmap learned FSMap version 29 2024-09-19T05:24:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.276+0000 7f35cf1c9740 1 -- 172.21.15.120:0/370665417 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f0051bf1c0 con 0x55f005131410 2024-09-19T05:24:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.277+0000 7f35adffb640 1 -- 172.21.15.120:0/370665417 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f35c0003ca0 con 0x55f005131410 2024-09-19T05:24:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.277+0000 7f35adffb640 1 -- 172.21.15.120:0/370665417 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f35b40a4a20 con 0x55f005131410 2024-09-19T05:24:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.277+0000 7f35cf1c9740 10 client.16170 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:24:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.277+0000 7f35cf1c9740 10 client.16170 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:24:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.277+0000 7f35cf1c9740 20 client.16170 populate_metadata read hostname 'smithi120' 2024-09-19T05:24:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.277+0000 7f35cf1c9740 1 --2- 172.21.15.120:0/370665417 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55f0051bf950 0x55f0051c1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.277+0000 7f35cf1c9740 4 client.16170 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:24:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.277+0000 7f35cf1c9740 1 -- 172.21.15.120:0/370665417 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f00509cd70 con 0x55f0051bf950 2024-09-19T05:24:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.277+0000 7f35ca0ee640 1 --2- 172.21.15.120:0/370665417 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55f0051bf950 0x55f0051c1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.278+0000 7f35ca0ee640 1 --2- 172.21.15.120:0/370665417 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55f0051bf950 0x55f0051c1d70 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a88704874e5b1e14 server_cookie=5df14fa523841d4d in_seq=0 out_seq=0 2024-09-19T05:24:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.278+0000 7f35adffb640 10 client.16170 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:24:38.315 INFO:tasks.workunit.client.0.smithi120.stdout: 89 12964 144 8488 56 3558 151 2024-09-19T05:24:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.379+0000 7f35adffb640 1 -- 172.21.15.120:0/370665417 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f00509cd70 con 0x55f0051bf950 2024-09-19T05:24:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.379+0000 7f35adffb640 10 client.16170 handle_command_reply: tid=0 2024-09-19T05:24:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.379+0000 7f35cf1c9740 1 client.16170 shutdown 2024-09-19T05:24:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.379+0000 7f35cf1c9740 1 -- 172.21.15.120:0/370665417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f005131410 msgr2=0x55f005136120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.379+0000 7f35cf1c9740 1 --2- 172.21.15.120:0/370665417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f005131410 0x55f005136120 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f35b409bf40 tx=0x7f35b409bc90 comp rx=0 tx=0).stop 2024-09-19T05:24:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.379+0000 7f35cf1c9740 1 -- 172.21.15.120:0/370665417 shutdown_connections 2024-09-19T05:24:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.379+0000 7f35cf1c9740 1 --2- 172.21.15.120:0/370665417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f00513bcb0 0x55f005136660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.382 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.379+0000 7f35cf1c9740 1 --2- 172.21.15.120:0/370665417 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f005131410 0x55f005136120 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.383 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.379+0000 7f35cf1c9740 1 --2- 172.21.15.120:0/370665417 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55f0051bf950 0x55f0051c1d70 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.383 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.379+0000 7f35cf1c9740 1 --2- 172.21.15.120:0/370665417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f005130af0 0x55f005135be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.383 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.379+0000 7f35cf1c9740 1 -- 172.21.15.120:0/370665417 >> 172.21.15.120:0/370665417 conn(0x55f00512d060 msgr2=0x55f00513a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:38.383 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.379+0000 7f35adffb640 0 client.16170 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:24:38.383 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.379+0000 7f35cf1c9740 1 -- 172.21.15.120:0/370665417 shutdown_connections 2024-09-19T05:24:38.383 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.379+0000 7f35cf1c9740 1 -- 172.21.15.120:0/370665417 wait complete. 2024-09-19T05:24:38.383 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.379+0000 7f35cf1c9740 20 client.16170 trim_cache size 0 max 16384 2024-09-19T05:24:38.383 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:24:38.383 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:24:38.384 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:24:38.384 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:24:38.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.380+0000 7f35cc352640 1 -- 172.21.15.120:0/1665690660 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f35b00a34e0 msgr2=0x7f35b00a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:38.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.380+0000 7f35cc352640 1 --2- 172.21.15.120:0/1665690660 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f35b00a34e0 0x7f35b00a59a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f35c00096c0 tx=0x7f35c000b040 comp rx=0 tx=0).stop 2024-09-19T05:24:38.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.380+0000 7f35cc352640 1 -- 172.21.15.120:0/1665690660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35c4102480 msgr2=0x7f35c419a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:38.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.380+0000 7f35cc352640 1 --2- 172.21.15.120:0/1665690660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35c4102480 0x7f35c419a7d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f35b400e9f0 tx=0x7f35b400eeb0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.380+0000 7f35cc352640 1 -- 172.21.15.120:0/1665690660 shutdown_connections 2024-09-19T05:24:38.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.380+0000 7f35cc352640 1 --2- 172.21.15.120:0/1665690660 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f35b00a34e0 0x7f35b00a59a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.385 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.380+0000 7f35cc352640 1 --2- 172.21.15.120:0/1665690660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35c4107b80 0x7f35c419eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.380+0000 7f35cc352640 1 --2- 172.21.15.120:0/1665690660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35c4102480 0x7f35c419a7d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.380+0000 7f35cc352640 1 --2- 172.21.15.120:0/1665690660 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35c4101ae0 0x7f35c419a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.380+0000 7f35cc352640 1 -- 172.21.15.120:0/1665690660 >> 172.21.15.120:0/1665690660 conn(0x7f35c40fd7e0 msgr2=0x7f35c40fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.380+0000 7f35cc352640 1 -- 172.21.15.120:0/1665690660 shutdown_connections 2024-09-19T05:24:38.386 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:38.380+0000 7f35cc352640 1 -- 172.21.15.120:0/1665690660 wait complete. 2024-09-19T05:24:38.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:38 smithi120 ceph-mon[30956]: pgmap v165: 97 pgs: 97 active+clean; 443 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 158 op/s 2024-09-19T05:24:38.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:38 smithi194 ceph-mon[35228]: pgmap v165: 97 pgs: 97 active+clean; 443 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 158 op/s 2024-09-19T05:24:38.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:38 smithi178 ceph-mon[34347]: pgmap v165: 97 pgs: 97 active+clean; 443 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 158 op/s 2024-09-19T05:24:40.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:40 smithi120 ceph-mon[30956]: pgmap v166: 97 pgs: 97 active+clean; 439 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.4 MiB/s wr, 259 op/s 2024-09-19T05:24:40.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:40 smithi194 ceph-mon[35228]: pgmap v166: 97 pgs: 97 active+clean; 439 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.4 MiB/s wr, 259 op/s 2024-09-19T05:24:40.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:40 smithi178 ceph-mon[34347]: pgmap v166: 97 pgs: 97 active+clean; 439 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.4 MiB/s wr, 259 op/s 2024-09-19T05:24:42.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:42 smithi120 ceph-mon[30956]: pgmap v167: 97 pgs: 97 active+clean; 439 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 180 op/s 2024-09-19T05:24:42.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:42 smithi194 ceph-mon[35228]: pgmap v167: 97 pgs: 97 active+clean; 439 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 180 op/s 2024-09-19T05:24:42.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:42 smithi178 ceph-mon[34347]: pgmap v167: 97 pgs: 97 active+clean; 439 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 180 op/s 2024-09-19T05:24:44.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:44 smithi120 ceph-mon[30956]: pgmap v168: 97 pgs: 97 active+clean; 439 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 180 op/s 2024-09-19T05:24:44.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:44 smithi194 ceph-mon[35228]: pgmap v168: 97 pgs: 97 active+clean; 439 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 180 op/s 2024-09-19T05:24:44.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:44 smithi178 ceph-mon[34347]: pgmap v168: 97 pgs: 97 active+clean; 439 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 180 op/s 2024-09-19T05:24:46.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:46 smithi120 ceph-mon[30956]: pgmap v169: 97 pgs: 97 active+clean; 453 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.4 MiB/s wr, 244 op/s 2024-09-19T05:24:46.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:46 smithi194 ceph-mon[35228]: pgmap v169: 97 pgs: 97 active+clean; 453 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.4 MiB/s wr, 244 op/s 2024-09-19T05:24:46.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:46 smithi178 ceph-mon[34347]: pgmap v169: 97 pgs: 97 active+clean; 453 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.4 MiB/s wr, 244 op/s 2024-09-19T05:24:48.315 INFO:tasks.workunit.client.0.smithi120.stdout: 90 13043 70 8011 95 4535 160 2024-09-19T05:24:48.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:48 smithi120 ceph-mon[30956]: pgmap v170: 97 pgs: 97 active+clean; 453 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 165 op/s 2024-09-19T05:24:48.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:48 smithi194 ceph-mon[35228]: pgmap v170: 97 pgs: 97 active+clean; 453 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 165 op/s 2024-09-19T05:24:48.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:48 smithi178 ceph-mon[34347]: pgmap v170: 97 pgs: 97 active+clean; 453 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 165 op/s 2024-09-19T05:24:50.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:50 smithi120 ceph-mon[30956]: pgmap v171: 97 pgs: 97 active+clean; 466 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 235 op/s 2024-09-19T05:24:50.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:50 smithi194 ceph-mon[35228]: pgmap v171: 97 pgs: 97 active+clean; 466 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 235 op/s 2024-09-19T05:24:50.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:50 smithi178 ceph-mon[34347]: pgmap v171: 97 pgs: 97 active+clean; 466 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 235 op/s 2024-09-19T05:24:51.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.508+0000 7f7994fc4640 1 -- 172.21.15.120:0/3408608820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79901009d0 msgr2=0x7f7990100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:51.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.508+0000 7f7994fc4640 1 --2- 172.21.15.120:0/3408608820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79901009d0 0x7f7990100e30 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f7984009930 tx=0x7f798402a420 comp rx=0 tx=0).stop 2024-09-19T05:24:51.514 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.508+0000 7f7994fc4640 1 -- 172.21.15.120:0/3408608820 shutdown_connections 2024-09-19T05:24:51.515 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.508+0000 7f7994fc4640 1 --2- 172.21.15.120:0/3408608820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7990101370 0x7f799010d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.515 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.508+0000 7f7994fc4640 1 --2- 172.21.15.120:0/3408608820 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f79901009d0 0x7f7990100e30 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.515 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.508+0000 7f7994fc4640 1 --2- 172.21.15.120:0/3408608820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79901069e0 0x7f7990106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.515 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.508+0000 7f7994fc4640 1 -- 172.21.15.120:0/3408608820 >> 172.21.15.120:0/3408608820 conn(0x7f79900fc6f0 msgr2=0x7f79900feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:51.516 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.508+0000 7f7994fc4640 1 -- 172.21.15.120:0/3408608820 shutdown_connections 2024-09-19T05:24:51.516 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.508+0000 7f7994fc4640 1 -- 172.21.15.120:0/3408608820 wait complete. 2024-09-19T05:24:51.516 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.509+0000 7f7994fc4640 1 Processor -- start 2024-09-19T05:24:51.516 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.509+0000 7f7994fc4640 1 -- start start 2024-09-19T05:24:51.516 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.509+0000 7f7994fc4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79901009d0 0x7f79900fcd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.509+0000 7f7994fc4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7990101370 0x7f79900fd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.509+0000 7f7994fc4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79901069e0 0x7f79900fd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.509+0000 7f7994fc4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f7990110cd0 con 0x7f7990101370 2024-09-19T05:24:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.509+0000 7f7994fc4640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f7990110b50 con 0x7f79901009d0 2024-09-19T05:24:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.509+0000 7f7994fc4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7990110e50 con 0x7f79901069e0 2024-09-19T05:24:51.517 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.509+0000 7f798e59c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79901009d0 0x7f79900fcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:51.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.509+0000 7f798e59c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79901009d0 0x7f79900fcd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:39370/0 (socket says 172.21.15.120:39370) 2024-09-19T05:24:51.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.509+0000 7f798e59c640 1 -- 172.21.15.120:0/3905899223 learned_addr learned my addr 172.21.15.120:0/3905899223 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:24:51.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.509+0000 7f798ed9d640 1 --2- 172.21.15.120:0/3905899223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79901069e0 0x7f79900fd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:51.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.509+0000 7f798dd9b640 1 --2- 172.21.15.120:0/3905899223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7990101370 0x7f79900fd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:51.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.510+0000 7f798e59c640 1 -- 172.21.15.120:0/3905899223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79901069e0 msgr2=0x7f79900fd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:51.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.510+0000 7f798e59c640 1 --2- 172.21.15.120:0/3905899223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79901069e0 0x7f79900fd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.518 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.510+0000 7f798e59c640 1 -- 172.21.15.120:0/3905899223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7990101370 msgr2=0x7f79900fd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:51.519 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.510+0000 7f798e59c640 1 --2- 172.21.15.120:0/3905899223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7990101370 0x7f79900fd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.519 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.510+0000 7f798e59c640 1 -- 172.21.15.120:0/3905899223 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79901a6820 con 0x7f79901009d0 2024-09-19T05:24:51.519 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.510+0000 7f798ed9d640 1 --2- 172.21.15.120:0/3905899223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79901069e0 0x7f79900fd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:24:51.519 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.510+0000 7f798dd9b640 1 --2- 172.21.15.120:0/3905899223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7990101370 0x7f79900fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:24:51.519 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.510+0000 7f798e59c640 1 --2- 172.21.15.120:0/3905899223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79901009d0 0x7f79900fcd10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f798000e9f0 tx=0x7f798000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:51.519 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.511+0000 7f797f7fe640 1 -- 172.21.15.120:0/3905899223 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798000cd80 con 0x7f79901009d0 2024-09-19T05:24:51.520 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.511+0000 7f797f7fe640 1 -- 172.21.15.120:0/3905899223 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f79800108e0 con 0x7f79901009d0 2024-09-19T05:24:51.520 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.511+0000 7f7994fc4640 1 -- 172.21.15.120:0/3905899223 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79901a6b10 con 0x7f79901009d0 2024-09-19T05:24:51.520 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.511+0000 7f7994fc4640 1 -- 172.21.15.120:0/3905899223 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79901a7030 con 0x7f79901009d0 2024-09-19T05:24:51.520 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.511+0000 7f797f7fe640 1 -- 172.21.15.120:0/3905899223 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7980018920 con 0x7f79901009d0 2024-09-19T05:24:51.527 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.514+0000 7f797f7fe640 1 -- 172.21.15.120:0/3905899223 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f7980010a90 con 0x7f79901009d0 2024-09-19T05:24:51.527 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.514+0000 7f7997e3a740 1 Processor -- start 2024-09-19T05:24:51.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.514+0000 7f7997e3a740 1 -- start start 2024-09-19T05:24:51.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.514+0000 7f7997e3a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a8d5c2af0 0x560a8d5c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:51.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.514+0000 7f7997e3a740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a8d5c3410 0x560a8d5cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:51.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.514+0000 7f7997e3a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5cdcb0 0x560a8d5d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:51.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.515+0000 7f7997e3a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560a8d5272f0 con 0x560a8d5cdcb0 2024-09-19T05:24:51.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.515+0000 7f7997e3a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x560a8d4cf270 con 0x560a8d5c2af0 2024-09-19T05:24:51.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.515+0000 7f7997e3a740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560a8d5232b0 con 0x560a8d5c3410 2024-09-19T05:24:51.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.515+0000 7f798e59c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a8d5c3410 0x560a8d5cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:51.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.515+0000 7f798dd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5cdcb0 0x560a8d5d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:51.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.515+0000 7f798dd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5cdcb0 0x560a8d5d00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39308/0 (socket says 172.21.15.120:39308) 2024-09-19T05:24:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.515+0000 7f798e59c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a8d5c3410 0x560a8d5cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:55370/0 (socket says 172.21.15.120:55370) 2024-09-19T05:24:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.515+0000 7f798dd9b640 1 -- 172.21.15.120:0/1158985970 learned_addr learned my addr 172.21.15.120:0/1158985970 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:24:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.515+0000 7f798ed9d640 1 --2- 172.21.15.120:0/1158985970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a8d5c2af0 0x560a8d5c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.515+0000 7f798dd9b640 1 -- 172.21.15.120:0/1158985970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a8d5c3410 msgr2=0x560a8d5cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.515+0000 7f798dd9b640 1 --2- 172.21.15.120:0/1158985970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a8d5c3410 0x560a8d5cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.515+0000 7f798dd9b640 1 -- 172.21.15.120:0/1158985970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a8d5c2af0 msgr2=0x560a8d5c2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.515+0000 7f798dd9b640 1 --2- 172.21.15.120:0/1158985970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a8d5c2af0 0x560a8d5c2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.515+0000 7f798dd9b640 1 -- 172.21.15.120:0/1158985970 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a8d4ce340 con 0x560a8d5cdcb0 2024-09-19T05:24:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.515+0000 7f798dd9b640 1 --2- 172.21.15.120:0/1158985970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5cdcb0 0x560a8d5d00a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7984006010 tx=0x7f7984032eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74594e9b550d11b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.515+0000 7f797f7fe640 1 --2- 172.21.15.120:0/3905899223 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f79780a34e0 0x7f79780a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.516+0000 7f797cff9640 1 -- 172.21.15.120:0/1158985970 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7984035040 con 0x560a8d5cdcb0 2024-09-19T05:24:51.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.516+0000 7f797f7fe640 1 -- 172.21.15.120:0/3905899223 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f79800d0060 con 0x7f79901009d0 2024-09-19T05:24:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.516+0000 7f798ed9d640 1 --2- 172.21.15.120:0/3905899223 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f79780a34e0 0x7f79780a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.516+0000 7f797cff9640 1 -- 172.21.15.120:0/1158985970 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7984031860 con 0x560a8d5cdcb0 2024-09-19T05:24:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.516+0000 7f797cff9640 1 -- 172.21.15.120:0/1158985970 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7984004a00 con 0x560a8d5cdcb0 2024-09-19T05:24:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.517+0000 7f798ed9d640 1 --2- 172.21.15.120:0/3905899223 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f79780a34e0 0x7f79780a59a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7988009fd0 tx=0x7f7988009500 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.517+0000 7f7997e3a740 1 -- 172.21.15.120:0/1158985970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5cdcb0 msgr2=0x560a8d5d00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.517+0000 7f7997e3a740 1 --2- 172.21.15.120:0/1158985970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5cdcb0 0x560a8d5d00a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7984006010 tx=0x7f7984032eb0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.517+0000 7f7997e3a740 1 -- 172.21.15.120:0/1158985970 shutdown_connections 2024-09-19T05:24:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.517+0000 7f7997e3a740 1 --2- 172.21.15.120:0/1158985970 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5cdcb0 0x560a8d5d00a0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.517+0000 7f7997e3a740 1 --2- 172.21.15.120:0/1158985970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a8d5c3410 0x560a8d5cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.517+0000 7f7997e3a740 1 --2- 172.21.15.120:0/1158985970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a8d5c2af0 0x560a8d5c2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.517+0000 7f7997e3a740 1 -- 172.21.15.120:0/1158985970 >> 172.21.15.120:0/1158985970 conn(0x560a8d5bf060 msgr2=0x560a8d5bf440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:51.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.517+0000 7f7997e3a740 1 -- 172.21.15.120:0/1158985970 shutdown_connections 2024-09-19T05:24:51.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.517+0000 7f7997e3a740 1 -- 172.21.15.120:0/1158985970 wait complete. 2024-09-19T05:24:51.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.517+0000 7f7997e3a740 1 -- start start 2024-09-19T05:24:51.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.517+0000 7f7997e3a740 1 Processor -- start 2024-09-19T05:24:51.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.518+0000 7f7997e3a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a8d5c2af0 0x560a8d5cab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:51.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.518+0000 7f7997e3a740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a8d5c3410 0x560a8d5cb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:51.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.518+0000 7f7997e3a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5cdcb0 0x560a8d5cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:51.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.518+0000 7f7997e3a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x560a8d5d08d0 con 0x560a8d5cdcb0 2024-09-19T05:24:51.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.518+0000 7f7997e3a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x560a8d4b0290 con 0x560a8d5c2af0 2024-09-19T05:24:51.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.518+0000 7f7997e3a740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560a8d5d0a50 con 0x560a8d5c3410 2024-09-19T05:24:51.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.518+0000 7f798ed9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5cdcb0 0x560a8d5cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:51.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.518+0000 7f798e59c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a8d5c2af0 0x560a8d5cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:51.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.518+0000 7f798ed9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5cdcb0 0x560a8d5cb5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39318/0 (socket says 172.21.15.120:39318) 2024-09-19T05:24:51.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.518+0000 7f798ed9d640 1 -- 172.21.15.120:0/1557612617 learned_addr learned my addr 172.21.15.120:0/1557612617 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:24:51.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.518+0000 7f798dd9b640 1 --2- 172.21.15.120:0/1557612617 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a8d5c3410 0x560a8d5cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:51.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.518+0000 7f7997e3a740 10 client.0 _ll_register_callbacks cb 0x560a8d4e1140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:24:51.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.518+0000 7f798e59c640 1 -- 172.21.15.120:0/1557612617 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a8d5c3410 msgr2=0x560a8d5cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:51.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.518+0000 7f798e59c640 1 --2- 172.21.15.120:0/1557612617 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a8d5c3410 0x560a8d5cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.518+0000 7f798e59c640 1 -- 172.21.15.120:0/1557612617 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5cdcb0 msgr2=0x560a8d5cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:51.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.518+0000 7f798e59c640 1 --2- 172.21.15.120:0/1557612617 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5cdcb0 0x560a8d5cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.518+0000 7f798e59c640 1 -- 172.21.15.120:0/1557612617 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a8d23a210 con 0x560a8d5c2af0 2024-09-19T05:24:51.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.518+0000 7f798dd9b640 1 --2- 172.21.15.120:0/1557612617 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a8d5c3410 0x560a8d5cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:24:51.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.518+0000 7f798e59c640 1 --2- 172.21.15.120:0/1557612617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a8d5c2af0 0x560a8d5cab30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f79800cd700 tx=0x7f79800985e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b68e2a02849a34ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:51.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.518+0000 7f7975ffb640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:24:51.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.519+0000 7f7975ffb640 1 -- 172.21.15.120:0/1557612617 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798009bca0 con 0x560a8d5c2af0 2024-09-19T05:24:51.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.519+0000 7f7975ffb640 1 -- 172.21.15.120:0/1557612617 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f79800d3c00 con 0x560a8d5c2af0 2024-09-19T05:24:51.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.519+0000 7f7997e3a740 1 -- 172.21.15.120:0/1557612617 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7984031860 con 0x560a8d5c2af0 2024-09-19T05:24:51.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.519+0000 7f7975ffb640 1 -- 172.21.15.120:0/1557612617 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7980010de0 con 0x560a8d5c2af0 2024-09-19T05:24:51.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.519+0000 7f7997e3a740 10 client.25634 fetch_fsmap learned FSMap version 29 2024-09-19T05:24:51.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.519+0000 7f7997e3a740 1 -- 172.21.15.120:0/1557612617 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560a8d306620 con 0x560a8d5c2af0 2024-09-19T05:24:51.533 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.519+0000 7f7975ffb640 1 -- 172.21.15.120:0/1557612617 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7984031860 con 0x560a8d5c2af0 2024-09-19T05:24:51.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.519+0000 7f7975ffb640 1 -- 172.21.15.120:0/1557612617 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f79800bc0b0 con 0x560a8d5c2af0 2024-09-19T05:24:51.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.519+0000 7f7997e3a740 10 client.25634 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:24:51.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.519+0000 7f7997e3a740 10 client.25634 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:24:51.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.519+0000 7f7997e3a740 20 client.25634 populate_metadata read hostname 'smithi120' 2024-09-19T05:24:51.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.519+0000 7f7997e3a740 1 --2- 172.21.15.120:0/1557612617 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x560a8d5ddb60 0x560a8d5dff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:51.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.519+0000 7f7997e3a740 4 client.25634 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:24:51.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.519+0000 7f7997e3a740 1 -- 172.21.15.120:0/1557612617 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a8d534a20 con 0x560a8d5ddb60 2024-09-19T05:24:51.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.519+0000 7f798dd9b640 1 --2- 172.21.15.120:0/1557612617 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x560a8d5ddb60 0x560a8d5dff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:51.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.520+0000 7f7975ffb640 10 client.25634 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:24:51.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.520+0000 7f798dd9b640 1 --2- 172.21.15.120:0/1557612617 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x560a8d5ddb60 0x560a8d5dff50 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf87bd4153180b16 server_cookie=e3975ee83f55e2a6 in_seq=0 out_seq=0 2024-09-19T05:24:51.534 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.521+0000 7f7975ffb640 1 -- 172.21.15.120:0/1557612617 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560a8d534a20 con 0x560a8d5ddb60 2024-09-19T05:24:51.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.521+0000 7f7975ffb640 10 client.25634 handle_command_reply: tid=0 2024-09-19T05:24:51.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.521+0000 7f7997e3a740 1 client.25634 shutdown 2024-09-19T05:24:51.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.521+0000 7f7997e3a740 1 -- 172.21.15.120:0/1557612617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a8d5c2af0 msgr2=0x560a8d5cab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:51.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.521+0000 7f7997e3a740 1 --2- 172.21.15.120:0/1557612617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a8d5c2af0 0x560a8d5cab30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f79800cd700 tx=0x7f79800985e0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.521+0000 7f7997e3a740 1 -- 172.21.15.120:0/1557612617 shutdown_connections 2024-09-19T05:24:51.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.521+0000 7f7997e3a740 1 --2- 172.21.15.120:0/1557612617 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5cdcb0 0x560a8d5cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.521+0000 7f7997e3a740 1 --2- 172.21.15.120:0/1557612617 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x560a8d5ddb60 0x560a8d5dff50 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.521+0000 7f7997e3a740 1 --2- 172.21.15.120:0/1557612617 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a8d5c3410 0x560a8d5cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.535 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.521+0000 7f7975ffb640 0 client.25634 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:24:51.536 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.521+0000 7f7997e3a740 1 --2- 172.21.15.120:0/1557612617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a8d5c2af0 0x560a8d5cab30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.536 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.521+0000 7f7997e3a740 1 -- 172.21.15.120:0/1557612617 >> 172.21.15.120:0/1557612617 conn(0x560a8d5bf060 msgr2=0x560a8d5c4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:51.536 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.521+0000 7f7997e3a740 1 -- 172.21.15.120:0/1557612617 shutdown_connections 2024-09-19T05:24:51.536 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.521+0000 7f7997e3a740 1 -- 172.21.15.120:0/1557612617 wait complete. 2024-09-19T05:24:51.536 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.521+0000 7f7997e3a740 20 client.25634 trim_cache size 0 max 16384 2024-09-19T05:24:51.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.541+0000 7f7997e3a740 1 Processor -- start 2024-09-19T05:24:51.547 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.541+0000 7f7997e3a740 1 -- start start 2024-09-19T05:24:51.548 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.541+0000 7f7997e3a740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a8d5c2af0 0x560a8d5cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:51.548 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.541+0000 7f7997e3a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5c3410 0x560a8d5e5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:51.548 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.541+0000 7f7997e3a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a8d5cdcb0 0x560a8d5e5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:51.548 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.541+0000 7f7997e3a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f79901b2260 con 0x560a8d5c3410 2024-09-19T05:24:51.548 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.541+0000 7f7997e3a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f79901afb30 con 0x560a8d5cdcb0 2024-09-19T05:24:51.548 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.541+0000 7f7997e3a740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f79901ad980 con 0x560a8d5c2af0 2024-09-19T05:24:51.548 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.541+0000 7f798e59c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a8d5c2af0 0x560a8d5cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:51.548 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.541+0000 7f798dd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5c3410 0x560a8d5e5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:51.548 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.541+0000 7f798e59c640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a8d5c2af0 0x560a8d5cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:55390/0 (socket says 172.21.15.120:55390) 2024-09-19T05:24:51.548 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.541+0000 7f798e59c640 1 -- 172.21.15.120:0/3795206341 learned_addr learned my addr 172.21.15.120:0/3795206341 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:24:51.548 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.541+0000 7f798ed9d640 1 --2- 172.21.15.120:0/3795206341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a8d5cdcb0 0x560a8d5e5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:51.548 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.541+0000 7f798dd9b640 1 -- 172.21.15.120:0/3795206341 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a8d5c2af0 msgr2=0x560a8d5cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:51.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.542+0000 7f798dd9b640 1 --2- 172.21.15.120:0/3795206341 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a8d5c2af0 0x560a8d5cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.542+0000 7f798dd9b640 1 -- 172.21.15.120:0/3795206341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a8d5cdcb0 msgr2=0x560a8d5e5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:51.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.542+0000 7f798dd9b640 1 --2- 172.21.15.120:0/3795206341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a8d5cdcb0 0x560a8d5e5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.542+0000 7f798dd9b640 1 -- 172.21.15.120:0/3795206341 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a8d5e02c0 con 0x560a8d5c3410 2024-09-19T05:24:51.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.542+0000 7f798e59c640 1 --2- 172.21.15.120:0/3795206341 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a8d5c2af0 0x560a8d5cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:24:51.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.542+0000 7f798ed9d640 1 --2- 172.21.15.120:0/3795206341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a8d5cdcb0 0x560a8d5e5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:24:51.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.542+0000 7f798dd9b640 1 --2- 172.21.15.120:0/3795206341 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5c3410 0x560a8d5e5860 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f7984009900 tx=0x7f7984005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3886a76b3e9924db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:51.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.542+0000 7f7977fff640 1 -- 172.21.15.120:0/3795206341 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7984035040 con 0x560a8d5c3410 2024-09-19T05:24:51.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.542+0000 7f7977fff640 1 -- 172.21.15.120:0/3795206341 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7984004220 con 0x560a8d5c3410 2024-09-19T05:24:51.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.542+0000 7f7977fff640 1 -- 172.21.15.120:0/3795206341 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7984003850 con 0x560a8d5c3410 2024-09-19T05:24:51.549 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.543+0000 7f7997e3a740 1 -- 172.21.15.120:0/3795206341 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5c3410 msgr2=0x560a8d5e5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:51.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.543+0000 7f7997e3a740 1 --2- 172.21.15.120:0/3795206341 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5c3410 0x560a8d5e5860 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f7984009900 tx=0x7f7984005e50 comp rx=0 tx=0).stop 2024-09-19T05:24:51.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.543+0000 7f7997e3a740 1 -- 172.21.15.120:0/3795206341 shutdown_connections 2024-09-19T05:24:51.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.543+0000 7f7997e3a740 1 --2- 172.21.15.120:0/3795206341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a8d5cdcb0 0x560a8d5e5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.543+0000 7f7997e3a740 1 --2- 172.21.15.120:0/3795206341 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5c3410 0x560a8d5e5860 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.543+0000 7f7997e3a740 1 --2- 172.21.15.120:0/3795206341 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a8d5c2af0 0x560a8d5cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.543+0000 7f7997e3a740 1 -- 172.21.15.120:0/3795206341 >> 172.21.15.120:0/3795206341 conn(0x560a8d5bf060 msgr2=0x560a8d5ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:51.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.543+0000 7f7997e3a740 1 -- 172.21.15.120:0/3795206341 shutdown_connections 2024-09-19T05:24:51.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.543+0000 7f7997e3a740 1 -- 172.21.15.120:0/3795206341 wait complete. 2024-09-19T05:24:51.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.544+0000 7f7997e3a740 1 -- start start 2024-09-19T05:24:51.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.544+0000 7f7997e3a740 1 Processor -- start 2024-09-19T05:24:51.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.544+0000 7f7997e3a740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a8d5c2af0 0x560a8d5d6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:51.550 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.544+0000 7f7997e3a740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5c3410 0x560a8d5d1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.544+0000 7f7997e3a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a8d5cdcb0 0x560a8d5d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.544+0000 7f7997e3a740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f79901adff0 con 0x560a8d5c3410 2024-09-19T05:24:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.544+0000 7f7997e3a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f79901af460 con 0x560a8d5cdcb0 2024-09-19T05:24:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.544+0000 7f7997e3a740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f79901ae6c0 con 0x560a8d5c2af0 2024-09-19T05:24:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.544+0000 7f7997e3a740 10 client.0 _ll_register_callbacks cb 0x7f798000e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:24:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.544+0000 7f798dd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5c3410 0x560a8d5d1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.544+0000 7f798dd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5c3410 0x560a8d5d1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39326/0 (socket says 172.21.15.120:39326) 2024-09-19T05:24:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.544+0000 7f798dd9b640 1 -- 172.21.15.120:0/92547035 learned_addr learned my addr 172.21.15.120:0/92547035 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:24:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.544+0000 7f798e59c640 1 --2- 172.21.15.120:0/92547035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a8d5c2af0 0x560a8d5d6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.544+0000 7f798ed9d640 1 --2- 172.21.15.120:0/92547035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a8d5cdcb0 0x560a8d5d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.545+0000 7f798dd9b640 1 -- 172.21.15.120:0/92547035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a8d5c2af0 msgr2=0x560a8d5d6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:51.551 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.545+0000 7f798dd9b640 1 --2- 172.21.15.120:0/92547035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a8d5c2af0 0x560a8d5d6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.545+0000 7f798dd9b640 1 -- 172.21.15.120:0/92547035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a8d5cdcb0 msgr2=0x560a8d5d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:24:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.545+0000 7f798dd9b640 1 --2- 172.21.15.120:0/92547035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a8d5cdcb0 0x560a8d5d1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.545+0000 7f798dd9b640 1 -- 172.21.15.120:0/92547035 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a8d5d2110 con 0x560a8d5c3410 2024-09-19T05:24:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.545+0000 7f798e59c640 1 --2- 172.21.15.120:0/92547035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a8d5c2af0 0x560a8d5d6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:24:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.545+0000 7f798ed9d640 1 --2- 172.21.15.120:0/92547035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a8d5cdcb0 0x560a8d5d1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:24:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.545+0000 7f798dd9b640 1 --2- 172.21.15.120:0/92547035 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5c3410 0x560a8d5d1590 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7984009930 tx=0x7f79840314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5abb5fde2073f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:24:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.545+0000 7f7975ffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:24:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.545+0000 7f7975ffb640 1 -- 172.21.15.120:0/92547035 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7984035040 con 0x560a8d5c3410 2024-09-19T05:24:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.545+0000 7f7975ffb640 1 -- 172.21.15.120:0/92547035 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f79840318e0 con 0x560a8d5c3410 2024-09-19T05:24:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.545+0000 7f7997e3a740 1 -- 172.21.15.120:0/92547035 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7984004220 con 0x560a8d5c3410 2024-09-19T05:24:51.552 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.545+0000 7f7975ffb640 1 -- 172.21.15.120:0/92547035 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7984068050 con 0x560a8d5c3410 2024-09-19T05:24:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.545+0000 7f7997e3a740 10 client.16188 fetch_fsmap learned FSMap version 29 2024-09-19T05:24:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.545+0000 7f7997e3a740 1 -- 172.21.15.120:0/92547035 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560a8d648690 con 0x560a8d5c3410 2024-09-19T05:24:51.553 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.546+0000 7f7975ffb640 1 -- 172.21.15.120:0/92547035 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f7984004220 con 0x560a8d5c3410 2024-09-19T05:24:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.546+0000 7f7975ffb640 1 -- 172.21.15.120:0/92547035 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f7984032050 con 0x560a8d5c3410 2024-09-19T05:24:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.546+0000 7f7997e3a740 10 client.16188 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:24:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.546+0000 7f7997e3a740 10 client.16188 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:24:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.546+0000 7f7997e3a740 20 client.16188 populate_metadata read hostname 'smithi120' 2024-09-19T05:24:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.546+0000 7f7997e3a740 1 --2- 172.21.15.120:0/92547035 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x560a8d5ddb60 0x560a8d64a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:24:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.546+0000 7f7997e3a740 4 client.16188 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:24:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.546+0000 7f7997e3a740 1 -- 172.21.15.120:0/92547035 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560a8d52ed70 con 0x560a8d5ddb60 2024-09-19T05:24:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.546+0000 7f798e59c640 1 --2- 172.21.15.120:0/92547035 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x560a8d5ddb60 0x560a8d64a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:24:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.547+0000 7f7975ffb640 10 client.16188 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:24:51.554 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.547+0000 7f798e59c640 1 --2- 172.21.15.120:0/92547035 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x560a8d5ddb60 0x560a8d64a980 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61c26917bdfb13d0 server_cookie=b6d5a63e2dd6d24d in_seq=0 out_seq=0 2024-09-19T05:24:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.667+0000 7f7975ffb640 1 -- 172.21.15.120:0/92547035 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560a8d52ed70 con 0x560a8d5ddb60 2024-09-19T05:24:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.667+0000 7f7975ffb640 10 client.16188 handle_command_reply: tid=0 2024-09-19T05:24:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.667+0000 7f7997e3a740 1 client.16188 shutdown 2024-09-19T05:24:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.668+0000 7f7997e3a740 1 -- 172.21.15.120:0/92547035 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5c3410 msgr2=0x560a8d5d1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.668+0000 7f7997e3a740 1 --2- 172.21.15.120:0/92547035 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5c3410 0x560a8d5d1590 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7984009930 tx=0x7f79840314a0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.668+0000 7f7997e3a740 1 -- 172.21.15.120:0/92547035 shutdown_connections 2024-09-19T05:24:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.668+0000 7f7997e3a740 1 --2- 172.21.15.120:0/92547035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560a8d5cdcb0 0x560a8d5d1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.668+0000 7f7997e3a740 1 --2- 172.21.15.120:0/92547035 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x560a8d5c3410 0x560a8d5d1590 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.668+0000 7f7997e3a740 1 --2- 172.21.15.120:0/92547035 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x560a8d5ddb60 0x560a8d64a980 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.668+0000 7f7997e3a740 1 --2- 172.21.15.120:0/92547035 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a8d5c2af0 0x560a8d5d6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.668+0000 7f7997e3a740 1 -- 172.21.15.120:0/92547035 >> 172.21.15.120:0/92547035 conn(0x560a8d5bf060 msgr2=0x560a8d5bd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.668+0000 7f7975ffb640 0 client.16188 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:24:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.668+0000 7f7997e3a740 1 -- 172.21.15.120:0/92547035 shutdown_connections 2024-09-19T05:24:51.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.668+0000 7f7997e3a740 1 -- 172.21.15.120:0/92547035 wait complete. 2024-09-19T05:24:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.669+0000 7f7997e3a740 20 client.16188 trim_cache size 0 max 16384 2024-09-19T05:24:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:24:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:24:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:24:51.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:24:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.670+0000 7f7994fc4640 1 -- 172.21.15.120:0/3905899223 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f79780a34e0 msgr2=0x7f79780a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.670+0000 7f7994fc4640 1 --2- 172.21.15.120:0/3905899223 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f79780a34e0 0x7f79780a59a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7988009fd0 tx=0x7f7988009500 comp rx=0 tx=0).stop 2024-09-19T05:24:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.670+0000 7f7994fc4640 1 -- 172.21.15.120:0/3905899223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79901009d0 msgr2=0x7f79900fcd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:24:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.670+0000 7f7994fc4640 1 --2- 172.21.15.120:0/3905899223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79901009d0 0x7f79900fcd10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f798000e9f0 tx=0x7f798000eeb0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.670+0000 7f7994fc4640 1 -- 172.21.15.120:0/3905899223 shutdown_connections 2024-09-19T05:24:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.670+0000 7f7994fc4640 1 --2- 172.21.15.120:0/3905899223 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f79780a34e0 0x7f79780a59a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.670+0000 7f7994fc4640 1 --2- 172.21.15.120:0/3905899223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79901069e0 0x7f79900fd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.670+0000 7f7994fc4640 1 --2- 172.21.15.120:0/3905899223 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7990101370 0x7f79900fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.670+0000 7f7994fc4640 1 --2- 172.21.15.120:0/3905899223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79901009d0 0x7f79900fcd10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:24:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.670+0000 7f7994fc4640 1 -- 172.21.15.120:0/3905899223 >> 172.21.15.120:0/3905899223 conn(0x7f79900fc6f0 msgr2=0x7f799006a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:24:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.670+0000 7f7994fc4640 1 -- 172.21.15.120:0/3905899223 shutdown_connections 2024-09-19T05:24:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:24:51.670+0000 7f7994fc4640 1 -- 172.21.15.120:0/3905899223 wait complete. 2024-09-19T05:24:52.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:52 smithi120 ceph-mon[30956]: pgmap v172: 97 pgs: 97 active+clean; 466 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 134 op/s 2024-09-19T05:24:52.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:52 smithi194 ceph-mon[35228]: pgmap v172: 97 pgs: 97 active+clean; 466 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 134 op/s 2024-09-19T05:24:52.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:52 smithi178 ceph-mon[34347]: pgmap v172: 97 pgs: 97 active+clean; 466 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 134 op/s 2024-09-19T05:24:54.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:54 smithi120 ceph-mon[30956]: pgmap v173: 97 pgs: 97 active+clean; 466 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 134 op/s 2024-09-19T05:24:54.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:54 smithi194 ceph-mon[35228]: pgmap v173: 97 pgs: 97 active+clean; 466 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 134 op/s 2024-09-19T05:24:54.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:54 smithi178 ceph-mon[34347]: pgmap v173: 97 pgs: 97 active+clean; 466 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.3 MiB/s wr, 134 op/s 2024-09-19T05:24:56.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:56 smithi120 ceph-mon[30956]: pgmap v174: 97 pgs: 97 active+clean; 469 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.6 MiB/s wr, 351 op/s 2024-09-19T05:24:56.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:56 smithi194 ceph-mon[35228]: pgmap v174: 97 pgs: 97 active+clean; 469 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.6 MiB/s wr, 351 op/s 2024-09-19T05:24:56.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:56 smithi178 ceph-mon[34347]: pgmap v174: 97 pgs: 97 active+clean; 469 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.6 MiB/s wr, 351 op/s 2024-09-19T05:24:58.315 INFO:tasks.workunit.client.0.smithi120.stdout: 92 13455 139 8161 52 4053 133 2024-09-19T05:24:58.743 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:24:58 smithi178 ceph-mon[34347]: pgmap v175: 97 pgs: 97 active+clean; 469 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 287 op/s 2024-09-19T05:24:58.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:24:58 smithi120 ceph-mon[30956]: pgmap v175: 97 pgs: 97 active+clean; 469 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 287 op/s 2024-09-19T05:24:58.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:24:58 smithi194 ceph-mon[35228]: pgmap v175: 97 pgs: 97 active+clean; 469 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 287 op/s 2024-09-19T05:25:00.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:00 smithi120 ceph-mon[30956]: pgmap v176: 97 pgs: 97 active+clean; 482 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.6 MiB/s wr, 448 op/s 2024-09-19T05:25:00.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:00 smithi194 ceph-mon[35228]: pgmap v176: 97 pgs: 97 active+clean; 482 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.6 MiB/s wr, 448 op/s 2024-09-19T05:25:00.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:00 smithi178 ceph-mon[34347]: pgmap v176: 97 pgs: 97 active+clean; 482 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.6 MiB/s wr, 448 op/s 2024-09-19T05:25:03.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:03 smithi120 ceph-mon[30956]: pgmap v177: 97 pgs: 97 active+clean; 482 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 377 op/s 2024-09-19T05:25:03.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:03 smithi194 ceph-mon[35228]: pgmap v177: 97 pgs: 97 active+clean; 482 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 377 op/s 2024-09-19T05:25:03.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:03 smithi178 ceph-mon[34347]: pgmap v177: 97 pgs: 97 active+clean; 482 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 377 op/s 2024-09-19T05:25:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.769+0000 7fc940bcf640 1 -- 172.21.15.120:0/2417574923 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc93c106a00 msgr2=0x7fc93c106de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.769+0000 7fc940bcf640 1 --2- 172.21.15.120:0/2417574923 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc93c106a00 0x7fc93c106de0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009930 tx=0x7fc92c02a420 comp rx=0 tx=0).stop 2024-09-19T05:25:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.769+0000 7fc940bcf640 1 -- 172.21.15.120:0/2417574923 shutdown_connections 2024-09-19T05:25:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.769+0000 7fc940bcf640 1 --2- 172.21.15.120:0/2417574923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc93c101390 0x7fc93c10d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.769+0000 7fc940bcf640 1 --2- 172.21.15.120:0/2417574923 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc93c1009f0 0x7fc93c100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.769+0000 7fc940bcf640 1 --2- 172.21.15.120:0/2417574923 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc93c106a00 0x7fc93c106de0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.769+0000 7fc940bcf640 1 -- 172.21.15.120:0/2417574923 >> 172.21.15.120:0/2417574923 conn(0x7fc93c0fc6b0 msgr2=0x7fc93c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.769+0000 7fc940bcf640 1 -- 172.21.15.120:0/2417574923 shutdown_connections 2024-09-19T05:25:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.769+0000 7fc940bcf640 1 -- 172.21.15.120:0/2417574923 wait complete. 2024-09-19T05:25:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.769+0000 7fc940bcf640 1 Processor -- start 2024-09-19T05:25:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.770+0000 7fc940bcf640 1 -- start start 2024-09-19T05:25:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.770+0000 7fc940bcf640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc93c1009f0 0x7fc93c1025c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.770+0000 7fc940bcf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc93c101390 0x7fc93c102b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.770+0000 7fc940bcf640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc93c106a00 0x7fc93c103040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.770+0000 7fc940bcf640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c110cf0 con 0x7fc93c101390 2024-09-19T05:25:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.770+0000 7fc940bcf640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c110b70 con 0x7fc93c106a00 2024-09-19T05:25:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.770+0000 7fc940bcf640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c110e70 con 0x7fc93c1009f0 2024-09-19T05:25:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.770+0000 7fc931d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc93c101390 0x7fc93c102b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.770+0000 7fc931d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc93c101390 0x7fc93c102b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56842/0 (socket says 172.21.15.120:56842) 2024-09-19T05:25:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.770+0000 7fc931d9b640 1 -- 172.21.15.120:0/622701141 learned_addr learned my addr 172.21.15.120:0/622701141 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:25:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.770+0000 7fc93a59c640 1 --2- 172.21.15.120:0/622701141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc93c1009f0 0x7fc93c1025c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.770+0000 7fc93ad9d640 1 --2- 172.21.15.120:0/622701141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc93c106a00 0x7fc93c103040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.770+0000 7fc931d9b640 1 -- 172.21.15.120:0/622701141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc93c1009f0 msgr2=0x7fc93c1025c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.770+0000 7fc931d9b640 1 --2- 172.21.15.120:0/622701141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc93c1009f0 0x7fc93c1025c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.770+0000 7fc931d9b640 1 -- 172.21.15.120:0/622701141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc93c106a00 msgr2=0x7fc93c103040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.770+0000 7fc931d9b640 1 --2- 172.21.15.120:0/622701141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc93c106a00 0x7fc93c103040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.770+0000 7fc931d9b640 1 -- 172.21.15.120:0/622701141 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93c1a6780 con 0x7fc93c101390 2024-09-19T05:25:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.770+0000 7fc93a59c640 1 --2- 172.21.15.120:0/622701141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc93c1009f0 0x7fc93c1025c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:25:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.771+0000 7fc931d9b640 1 --2- 172.21.15.120:0/622701141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc93c101390 0x7fc93c102b00 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc92400d950 tx=0x7fc92400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.771+0000 7fc933fff640 1 -- 172.21.15.120:0/622701141 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924017070 con 0x7fc93c101390 2024-09-19T05:25:04.776 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.771+0000 7fc940bcf640 1 -- 172.21.15.120:0/622701141 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc93c1a6a70 con 0x7fc93c101390 2024-09-19T05:25:04.777 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.771+0000 7fc933fff640 1 -- 172.21.15.120:0/622701141 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc924009c30 con 0x7fc93c101390 2024-09-19T05:25:04.777 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.771+0000 7fc933fff640 1 -- 172.21.15.120:0/622701141 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92400f620 con 0x7fc93c101390 2024-09-19T05:25:04.777 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.771+0000 7fc940bcf640 1 -- 172.21.15.120:0/622701141 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc93c1a6fc0 con 0x7fc93c101390 2024-09-19T05:25:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.773+0000 7fc933fff640 1 -- 172.21.15.120:0/622701141 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fc9240109a0 con 0x7fc93c101390 2024-09-19T05:25:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.774+0000 7fc943a47740 1 Processor -- start 2024-09-19T05:25:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.774+0000 7fc943a47740 1 -- start start 2024-09-19T05:25:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.774+0000 7fc943a47740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba816af0 0x558aba816ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.774+0000 7fc943a47740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558aba817410 0x558aba821770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.774+0000 7fc943a47740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558aba821cb0 0x558aba8240a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.774+0000 7fc943a47740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558aba77b2f0 con 0x558aba816af0 2024-09-19T05:25:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.774+0000 7fc943a47740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x558aba723270 con 0x558aba817410 2024-09-19T05:25:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.774+0000 7fc943a47740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x558aba7772b0 con 0x558aba821cb0 2024-09-19T05:25:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.774+0000 7fc933fff640 1 --2- 172.21.15.120:0/622701141 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fc9280a3460 0x7fc9280a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.774+0000 7fc93a59c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558aba817410 0x558aba821770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.774+0000 7fc93ad9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba816af0 0x558aba816ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.774+0000 7fc93a59c640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558aba817410 0x558aba821770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:47418/0 (socket says 172.21.15.120:47418) 2024-09-19T05:25:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.774+0000 7fc93a59c640 1 -- 172.21.15.120:0/1012074598 learned_addr learned my addr 172.21.15.120:0/1012074598 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:25:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.775+0000 7fc931d9b640 1 --2- 172.21.15.120:0/1012074598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558aba821cb0 0x558aba8240a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.775+0000 7fc93ad9d640 1 --2- 172.21.15.120:0/622701141 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fc9280a3460 0x7fc9280a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.775+0000 7fc933fff640 1 -- 172.21.15.120:0/622701141 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fc9240cfa70 con 0x7fc93c101390 2024-09-19T05:25:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.775+0000 7fc93a59c640 1 -- 172.21.15.120:0/1012074598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558aba821cb0 msgr2=0x558aba8240a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.775+0000 7fc93a59c640 1 --2- 172.21.15.120:0/1012074598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558aba821cb0 0x558aba8240a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.775+0000 7fc93a59c640 1 -- 172.21.15.120:0/1012074598 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba816af0 msgr2=0x558aba816ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.775+0000 7fc93a59c640 1 --2- 172.21.15.120:0/1012074598 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba816af0 0x558aba816ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.775+0000 7fc93a59c640 1 -- 172.21.15.120:0/1012074598 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558aba722340 con 0x558aba817410 2024-09-19T05:25:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.775+0000 7fc93ad9d640 1 --2- 172.21.15.120:0/1012074598 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba816af0 0x558aba816ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:25:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.775+0000 7fc93ad9d640 1 --2- 172.21.15.120:0/622701141 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fc9280a3460 0x7fc9280a5920 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc934009fd0 tx=0x7fc934004a40 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.775+0000 7fc93a59c640 1 --2- 172.21.15.120:0/1012074598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558aba817410 0x558aba821770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc92c02a940 tx=0x7fc92c032cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b457d01f10e8634 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.775+0000 7fc930d99640 1 -- 172.21.15.120:0/1012074598 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c03f070 con 0x558aba817410 2024-09-19T05:25:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.775+0000 7fc930d99640 1 -- 172.21.15.120:0/1012074598 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc92c0316a0 con 0x558aba817410 2024-09-19T05:25:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.775+0000 7fc930d99640 1 -- 172.21.15.120:0/1012074598 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c035070 con 0x558aba817410 2024-09-19T05:25:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.776+0000 7fc943a47740 1 -- 172.21.15.120:0/1012074598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558aba817410 msgr2=0x558aba821770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.776+0000 7fc943a47740 1 --2- 172.21.15.120:0/1012074598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558aba817410 0x558aba821770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc92c02a940 tx=0x7fc92c032cb0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.776+0000 7fc943a47740 1 -- 172.21.15.120:0/1012074598 shutdown_connections 2024-09-19T05:25:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.776+0000 7fc943a47740 1 --2- 172.21.15.120:0/1012074598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558aba821cb0 0x558aba8240a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.776+0000 7fc943a47740 1 --2- 172.21.15.120:0/1012074598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558aba817410 0x558aba821770 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.776+0000 7fc943a47740 1 --2- 172.21.15.120:0/1012074598 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba816af0 0x558aba816ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.776+0000 7fc943a47740 1 -- 172.21.15.120:0/1012074598 >> 172.21.15.120:0/1012074598 conn(0x558aba813060 msgr2=0x558aba813440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.776+0000 7fc943a47740 1 -- 172.21.15.120:0/1012074598 shutdown_connections 2024-09-19T05:25:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.776+0000 7fc943a47740 1 -- 172.21.15.120:0/1012074598 wait complete. 2024-09-19T05:25:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.777+0000 7fc943a47740 1 -- start start 2024-09-19T05:25:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.777+0000 7fc943a47740 1 Processor -- start 2024-09-19T05:25:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.777+0000 7fc943a47740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba816af0 0x558aba81eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.777+0000 7fc943a47740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558aba817410 0x558aba81f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.777+0000 7fc943a47740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558aba821cb0 0x558aba81f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.777+0000 7fc943a47740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x558aba824880 con 0x558aba816af0 2024-09-19T05:25:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.777+0000 7fc943a47740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x558aba704290 con 0x558aba821cb0 2024-09-19T05:25:04.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.777+0000 7fc943a47740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x558aba824a00 con 0x558aba817410 2024-09-19T05:25:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.777+0000 7fc943a47740 10 client.0 _ll_register_callbacks cb 0x558aba735140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:25:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.777+0000 7fc93a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba816af0 0x558aba81eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.777+0000 7fc93a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba816af0 0x558aba81eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56860/0 (socket says 172.21.15.120:56860) 2024-09-19T05:25:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.777+0000 7fc93a59c640 1 -- 172.21.15.120:0/3093198443 learned_addr learned my addr 172.21.15.120:0/3093198443 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:25:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.777+0000 7fc931d9b640 1 --2- 172.21.15.120:0/3093198443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558aba817410 0x558aba81f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.777+0000 7fc93ad9d640 1 --2- 172.21.15.120:0/3093198443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558aba821cb0 0x558aba81f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.777+0000 7fc93a59c640 1 -- 172.21.15.120:0/3093198443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558aba817410 msgr2=0x558aba81f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.777+0000 7fc93a59c640 1 --2- 172.21.15.120:0/3093198443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558aba817410 0x558aba81f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.777+0000 7fc93a59c640 1 -- 172.21.15.120:0/3093198443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558aba821cb0 msgr2=0x558aba81f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.777+0000 7fc93a59c640 1 --2- 172.21.15.120:0/3093198443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558aba821cb0 0x558aba81f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.777+0000 7fc93a59c640 1 -- 172.21.15.120:0/3093198443 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558aba48e210 con 0x558aba816af0 2024-09-19T05:25:04.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.777+0000 7fc93ad9d640 1 --2- 172.21.15.120:0/3093198443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558aba821cb0 0x558aba81f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:25:04.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.778+0000 7fc93a59c640 1 --2- 172.21.15.120:0/3093198443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba816af0 0x558aba81eb50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0096c0 tx=0x7fc92c009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c57423cb85cb9e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:04.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.778+0000 7fc921ffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:25:04.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.778+0000 7fc921ffb640 1 -- 172.21.15.120:0/3093198443 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c03f070 con 0x558aba816af0 2024-09-19T05:25:04.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.778+0000 7fc943a47740 1 -- 172.21.15.120:0/3093198443 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc92c0316a0 con 0x558aba816af0 2024-09-19T05:25:04.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.778+0000 7fc921ffb640 1 -- 172.21.15.120:0/3093198443 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fc92c004440 con 0x558aba816af0 2024-09-19T05:25:04.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.778+0000 7fc921ffb640 1 -- 172.21.15.120:0/3093198443 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc92c054050 con 0x558aba816af0 2024-09-19T05:25:04.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.778+0000 7fc943a47740 10 client.16200 fetch_fsmap learned FSMap version 29 2024-09-19T05:25:04.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.778+0000 7fc943a47740 1 -- 172.21.15.120:0/3093198443 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558aba55a620 con 0x558aba816af0 2024-09-19T05:25:04.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.778+0000 7fc921ffb640 1 -- 172.21.15.120:0/3093198443 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc92c0316a0 con 0x558aba816af0 2024-09-19T05:25:04.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.778+0000 7fc921ffb640 1 -- 172.21.15.120:0/3093198443 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fc92c004920 con 0x558aba816af0 2024-09-19T05:25:04.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.778+0000 7fc943a47740 10 client.16200 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:25:04.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.778+0000 7fc943a47740 10 client.16200 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:25:04.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.778+0000 7fc943a47740 20 client.16200 populate_metadata read hostname 'smithi120' 2024-09-19T05:25:04.790 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.778+0000 7fc943a47740 1 --2- 172.21.15.120:0/3093198443 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x558aba831a50 0x558aba833e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:04.790 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.778+0000 7fc943a47740 4 client.16200 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:25:04.790 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.778+0000 7fc943a47740 1 -- 172.21.15.120:0/3093198443 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558aba788a20 con 0x558aba831a50 2024-09-19T05:25:04.790 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.779+0000 7fc931d9b640 1 --2- 172.21.15.120:0/3093198443 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x558aba831a50 0x558aba833e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:04.790 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.779+0000 7fc931d9b640 1 --2- 172.21.15.120:0/3093198443 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x558aba831a50 0x558aba833e40 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2be241c37746e66 server_cookie=1a7eb5697f75c9d3 in_seq=0 out_seq=0 2024-09-19T05:25:04.790 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.779+0000 7fc921ffb640 10 client.16200 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:25:04.790 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.780+0000 7fc921ffb640 1 -- 172.21.15.120:0/3093198443 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558aba788a20 con 0x558aba831a50 2024-09-19T05:25:04.790 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.780+0000 7fc921ffb640 10 client.16200 handle_command_reply: tid=0 2024-09-19T05:25:04.790 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.780+0000 7fc943a47740 1 client.16200 shutdown 2024-09-19T05:25:04.790 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.780+0000 7fc943a47740 1 -- 172.21.15.120:0/3093198443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba816af0 msgr2=0x558aba81eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:04.790 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.780+0000 7fc943a47740 1 --2- 172.21.15.120:0/3093198443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba816af0 0x558aba81eb50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0096c0 tx=0x7fc92c009520 comp rx=0 tx=0).stop 2024-09-19T05:25:04.790 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.780+0000 7fc943a47740 1 -- 172.21.15.120:0/3093198443 shutdown_connections 2024-09-19T05:25:04.790 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.780+0000 7fc943a47740 1 --2- 172.21.15.120:0/3093198443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558aba821cb0 0x558aba81f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.791 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.780+0000 7fc943a47740 1 --2- 172.21.15.120:0/3093198443 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x558aba831a50 0x558aba833e40 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.791 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.780+0000 7fc943a47740 1 --2- 172.21.15.120:0/3093198443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558aba817410 0x558aba81f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.791 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.780+0000 7fc943a47740 1 --2- 172.21.15.120:0/3093198443 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba816af0 0x558aba81eb50 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.791 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.780+0000 7fc921ffb640 0 client.16200 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:25:04.791 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.780+0000 7fc943a47740 1 -- 172.21.15.120:0/3093198443 >> 172.21.15.120:0/3093198443 conn(0x558aba813060 msgr2=0x558aba818dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:04.791 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.780+0000 7fc943a47740 1 -- 172.21.15.120:0/3093198443 shutdown_connections 2024-09-19T05:25:04.791 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.780+0000 7fc943a47740 1 -- 172.21.15.120:0/3093198443 wait complete. 2024-09-19T05:25:04.791 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.780+0000 7fc943a47740 20 client.16200 trim_cache size 0 max 16384 2024-09-19T05:25:04.798 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.794+0000 7fc943a47740 1 Processor -- start 2024-09-19T05:25:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.794+0000 7fc943a47740 1 -- start start 2024-09-19T05:25:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.794+0000 7fc943a47740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558aba816af0 0x558aba819560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.794+0000 7fc943a47740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba817410 0x558aba820ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.794+0000 7fc943a47740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558aba821cb0 0x558aba81f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.794+0000 7fc943a47740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c1b22a0 con 0x558aba817410 2024-09-19T05:25:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.794+0000 7fc943a47740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c1afb70 con 0x558aba821cb0 2024-09-19T05:25:04.801 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.794+0000 7fc943a47740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c1ad9c0 con 0x558aba816af0 2024-09-19T05:25:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.795+0000 7fc931d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba817410 0x558aba820ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.795+0000 7fc931d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba817410 0x558aba820ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56874/0 (socket says 172.21.15.120:56874) 2024-09-19T05:25:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.795+0000 7fc931d9b640 1 -- 172.21.15.120:0/1770668086 learned_addr learned my addr 172.21.15.120:0/1770668086 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:25:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.795+0000 7fc93a59c640 1 --2- 172.21.15.120:0/1770668086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558aba816af0 0x558aba819560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.795+0000 7fc93ad9d640 1 --2- 172.21.15.120:0/1770668086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558aba821cb0 0x558aba81f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.795+0000 7fc931d9b640 1 -- 172.21.15.120:0/1770668086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558aba816af0 msgr2=0x558aba819560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.795+0000 7fc931d9b640 1 --2- 172.21.15.120:0/1770668086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558aba816af0 0x558aba819560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.795+0000 7fc931d9b640 1 -- 172.21.15.120:0/1770668086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558aba821cb0 msgr2=0x558aba81f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.795+0000 7fc931d9b640 1 --2- 172.21.15.120:0/1770668086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558aba821cb0 0x558aba81f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.795+0000 7fc931d9b640 1 -- 172.21.15.120:0/1770668086 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558aba816870 con 0x558aba817410 2024-09-19T05:25:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.795+0000 7fc93ad9d640 1 --2- 172.21.15.120:0/1770668086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558aba821cb0 0x558aba81f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:25:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.795+0000 7fc931d9b640 1 --2- 172.21.15.120:0/1770668086 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba817410 0x558aba820ac0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc9240cd220 tx=0x7fc924066640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c03ea22c1f1aba67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.795+0000 7fc923fff640 1 -- 172.21.15.120:0/1770668086 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924020040 con 0x558aba817410 2024-09-19T05:25:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.795+0000 7fc923fff640 1 -- 172.21.15.120:0/1770668086 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc92409bd00 con 0x558aba817410 2024-09-19T05:25:04.803 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.795+0000 7fc923fff640 1 -- 172.21.15.120:0/1770668086 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924098370 con 0x558aba817410 2024-09-19T05:25:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.796+0000 7fc943a47740 1 -- 172.21.15.120:0/1770668086 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba817410 msgr2=0x558aba820ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.796+0000 7fc943a47740 1 --2- 172.21.15.120:0/1770668086 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba817410 0x558aba820ac0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc9240cd220 tx=0x7fc924066640 comp rx=0 tx=0).stop 2024-09-19T05:25:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.796+0000 7fc943a47740 1 -- 172.21.15.120:0/1770668086 shutdown_connections 2024-09-19T05:25:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.796+0000 7fc943a47740 1 --2- 172.21.15.120:0/1770668086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558aba821cb0 0x558aba81f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.796+0000 7fc943a47740 1 --2- 172.21.15.120:0/1770668086 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba817410 0x558aba820ac0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.796+0000 7fc943a47740 1 --2- 172.21.15.120:0/1770668086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558aba816af0 0x558aba819560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.796+0000 7fc943a47740 1 -- 172.21.15.120:0/1770668086 >> 172.21.15.120:0/1770668086 conn(0x558aba813060 msgr2=0x558aba8203b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:04.806 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.796+0000 7fc943a47740 1 -- 172.21.15.120:0/1770668086 shutdown_connections 2024-09-19T05:25:04.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.796+0000 7fc943a47740 1 -- 172.21.15.120:0/1770668086 wait complete. 2024-09-19T05:25:04.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.796+0000 7fc943a47740 1 -- start start 2024-09-19T05:25:04.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.796+0000 7fc943a47740 1 Processor -- start 2024-09-19T05:25:04.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.796+0000 7fc943a47740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba816af0 0x558aba829e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:04.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.796+0000 7fc943a47740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558aba817410 0x558aba82a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:04.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.797+0000 7fc943a47740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558aba821cb0 0x558aba81b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:04.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.797+0000 7fc943a47740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c1ae030 con 0x558aba816af0 2024-09-19T05:25:04.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.797+0000 7fc943a47740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c1af4a0 con 0x558aba817410 2024-09-19T05:25:04.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.797+0000 7fc943a47740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c1ae700 con 0x558aba821cb0 2024-09-19T05:25:04.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.797+0000 7fc943a47740 10 client.0 _ll_register_callbacks cb 0x7fc934009cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:25:04.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.797+0000 7fc93a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba816af0 0x558aba829e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:04.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.797+0000 7fc93a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba816af0 0x558aba829e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56888/0 (socket says 172.21.15.120:56888) 2024-09-19T05:25:04.807 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.797+0000 7fc93a59c640 1 -- 172.21.15.120:0/3912811650 learned_addr learned my addr 172.21.15.120:0/3912811650 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:25:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.797+0000 7fc93ad9d640 1 --2- 172.21.15.120:0/3912811650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558aba821cb0 0x558aba81b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.797+0000 7fc93a59c640 1 -- 172.21.15.120:0/3912811650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558aba821cb0 msgr2=0x558aba81b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.797+0000 7fc93a59c640 1 --2- 172.21.15.120:0/3912811650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558aba821cb0 0x558aba81b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.797+0000 7fc93a59c640 1 -- 172.21.15.120:0/3912811650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558aba817410 msgr2=0x558aba82a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.797+0000 7fc93a59c640 1 --2- 172.21.15.120:0/3912811650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558aba817410 0x558aba82a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.797+0000 7fc93a59c640 1 -- 172.21.15.120:0/3912811650 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558aba81baa0 con 0x558aba816af0 2024-09-19T05:25:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.797+0000 7fc93a59c640 1 --2- 172.21.15.120:0/3912811650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba816af0 0x558aba829e80 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc92c004ee0 tx=0x7fc92c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2568d69177b94b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.797+0000 7fc921ffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:25:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.797+0000 7fc921ffb640 1 -- 172.21.15.120:0/3912811650 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c05d060 con 0x558aba816af0 2024-09-19T05:25:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.797+0000 7fc921ffb640 1 -- 172.21.15.120:0/3912811650 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fc92c004440 con 0x558aba816af0 2024-09-19T05:25:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.797+0000 7fc943a47740 1 -- 172.21.15.120:0/3912811650 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc92409bd00 con 0x558aba816af0 2024-09-19T05:25:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.797+0000 7fc921ffb640 1 -- 172.21.15.120:0/3912811650 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc92c03f040 con 0x558aba816af0 2024-09-19T05:25:04.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.797+0000 7fc943a47740 10 client.16206 fetch_fsmap learned FSMap version 29 2024-09-19T05:25:04.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.797+0000 7fc943a47740 1 -- 172.21.15.120:0/3912811650 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558aba8a44f0 con 0x558aba816af0 2024-09-19T05:25:04.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.798+0000 7fc921ffb640 1 -- 172.21.15.120:0/3912811650 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fc92409bd00 con 0x558aba816af0 2024-09-19T05:25:04.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.798+0000 7fc921ffb640 1 -- 172.21.15.120:0/3912811650 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fc92c0035f0 con 0x558aba816af0 2024-09-19T05:25:04.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.798+0000 7fc943a47740 10 client.16206 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:25:04.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.798+0000 7fc943a47740 10 client.16206 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:25:04.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.798+0000 7fc943a47740 20 client.16206 populate_metadata read hostname 'smithi120' 2024-09-19T05:25:04.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.798+0000 7fc943a47740 1 --2- 172.21.15.120:0/3912811650 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x558aba8a4c80 0x558aba8a70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:04.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.798+0000 7fc943a47740 4 client.16206 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:25:04.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.798+0000 7fc943a47740 1 -- 172.21.15.120:0/3912811650 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558aba782d70 con 0x558aba8a4c80 2024-09-19T05:25:04.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.798+0000 7fc931d9b640 1 --2- 172.21.15.120:0/3912811650 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x558aba8a4c80 0x558aba8a70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:04.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.798+0000 7fc921ffb640 10 client.16206 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:25:04.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.798+0000 7fc931d9b640 1 --2- 172.21.15.120:0/3912811650 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x558aba8a4c80 0x558aba8a70a0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec5a3e4d7ffb6f7a server_cookie=da160bd1526f0f40 in_seq=0 out_seq=0 2024-09-19T05:25:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.871+0000 7fc921ffb640 1 -- 172.21.15.120:0/3912811650 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558aba782d70 con 0x558aba8a4c80 2024-09-19T05:25:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.871+0000 7fc921ffb640 10 client.16206 handle_command_reply: tid=0 2024-09-19T05:25:04.874 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.872+0000 7fc943a47740 1 client.16206 shutdown 2024-09-19T05:25:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.872+0000 7fc943a47740 1 -- 172.21.15.120:0/3912811650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba816af0 msgr2=0x558aba829e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.872+0000 7fc943a47740 1 --2- 172.21.15.120:0/3912811650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba816af0 0x558aba829e80 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc92c004ee0 tx=0x7fc92c000bc0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.872+0000 7fc943a47740 1 -- 172.21.15.120:0/3912811650 shutdown_connections 2024-09-19T05:25:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.872+0000 7fc943a47740 1 --2- 172.21.15.120:0/3912811650 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x558aba8a4c80 0x558aba8a70a0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.872+0000 7fc943a47740 1 --2- 172.21.15.120:0/3912811650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558aba821cb0 0x558aba81b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.872+0000 7fc943a47740 1 --2- 172.21.15.120:0/3912811650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558aba817410 0x558aba82a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.872+0000 7fc921ffb640 0 client.16206 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:25:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.872+0000 7fc943a47740 1 --2- 172.21.15.120:0/3912811650 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x558aba816af0 0x558aba829e80 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.872+0000 7fc943a47740 1 -- 172.21.15.120:0/3912811650 >> 172.21.15.120:0/3912811650 conn(0x558aba813060 msgr2=0x558aba8121c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.872+0000 7fc943a47740 1 -- 172.21.15.120:0/3912811650 shutdown_connections 2024-09-19T05:25:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.872+0000 7fc943a47740 1 -- 172.21.15.120:0/3912811650 wait complete. 2024-09-19T05:25:04.875 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.872+0000 7fc943a47740 20 client.16206 trim_cache size 0 max 16384 2024-09-19T05:25:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:25:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:25:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:25:04.876 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:25:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.873+0000 7fc940bcf640 1 -- 172.21.15.120:0/622701141 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fc9280a3460 msgr2=0x7fc9280a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.873+0000 7fc940bcf640 1 --2- 172.21.15.120:0/622701141 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fc9280a3460 0x7fc9280a5920 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc934009fd0 tx=0x7fc934004a40 comp rx=0 tx=0).stop 2024-09-19T05:25:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.873+0000 7fc940bcf640 1 -- 172.21.15.120:0/622701141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc93c101390 msgr2=0x7fc93c102b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.873+0000 7fc940bcf640 1 --2- 172.21.15.120:0/622701141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc93c101390 0x7fc93c102b00 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc92400d950 tx=0x7fc92400de10 comp rx=0 tx=0).stop 2024-09-19T05:25:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.873+0000 7fc940bcf640 1 -- 172.21.15.120:0/622701141 shutdown_connections 2024-09-19T05:25:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.873+0000 7fc940bcf640 1 --2- 172.21.15.120:0/622701141 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fc9280a3460 0x7fc9280a5920 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.873+0000 7fc940bcf640 1 --2- 172.21.15.120:0/622701141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc93c106a00 0x7fc93c103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.873+0000 7fc940bcf640 1 --2- 172.21.15.120:0/622701141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc93c101390 0x7fc93c102b00 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.877 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.873+0000 7fc940bcf640 1 --2- 172.21.15.120:0/622701141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc93c1009f0 0x7fc93c1025c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.873+0000 7fc940bcf640 1 -- 172.21.15.120:0/622701141 >> 172.21.15.120:0/622701141 conn(0x7fc93c0fc6b0 msgr2=0x7fc93c06a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.873+0000 7fc940bcf640 1 -- 172.21.15.120:0/622701141 shutdown_connections 2024-09-19T05:25:04.878 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:04.873+0000 7fc940bcf640 1 -- 172.21.15.120:0/622701141 wait complete. 2024-09-19T05:25:05.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:05 smithi120 ceph-mon[30956]: pgmap v178: 97 pgs: 97 active+clean; 482 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 377 op/s 2024-09-19T05:25:05.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:05 smithi194 ceph-mon[35228]: pgmap v178: 97 pgs: 97 active+clean; 482 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 377 op/s 2024-09-19T05:25:05.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:05 smithi178 ceph-mon[34347]: pgmap v178: 97 pgs: 97 active+clean; 482 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 377 op/s 2024-09-19T05:25:07.877 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:07 smithi120 ceph-mon[30956]: pgmap v179: 97 pgs: 97 active+clean; 473 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.7 MiB/s wr, 448 op/s 2024-09-19T05:25:07.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:07 smithi194 ceph-mon[35228]: pgmap v179: 97 pgs: 97 active+clean; 473 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.7 MiB/s wr, 448 op/s 2024-09-19T05:25:07.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:07 smithi178 ceph-mon[34347]: pgmap v179: 97 pgs: 97 active+clean; 473 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.7 MiB/s wr, 448 op/s 2024-09-19T05:25:08.315 INFO:tasks.workunit.client.0.smithi120.stdout: 93 6838 52 4401 75 1630 68 2024-09-19T05:25:09.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:09 smithi120 ceph-mon[30956]: pgmap v180: 97 pgs: 97 active+clean; 473 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 231 op/s 2024-09-19T05:25:09.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:09 smithi194 ceph-mon[35228]: pgmap v180: 97 pgs: 97 active+clean; 473 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 231 op/s 2024-09-19T05:25:09.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:09 smithi178 ceph-mon[34347]: pgmap v180: 97 pgs: 97 active+clean; 473 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 231 op/s 2024-09-19T05:25:11.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:11 smithi120 ceph-mon[30956]: pgmap v181: 97 pgs: 97 active+clean; 484 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 315 op/s 2024-09-19T05:25:11.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:11 smithi194 ceph-mon[35228]: pgmap v181: 97 pgs: 97 active+clean; 484 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 315 op/s 2024-09-19T05:25:11.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:11 smithi178 ceph-mon[34347]: pgmap v181: 97 pgs: 97 active+clean; 484 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 315 op/s 2024-09-19T05:25:13.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:13 smithi120 ceph-mon[30956]: pgmap v182: 97 pgs: 97 active+clean; 487 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 175 op/s 2024-09-19T05:25:13.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:13 smithi194 ceph-mon[35228]: pgmap v182: 97 pgs: 97 active+clean; 487 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 175 op/s 2024-09-19T05:25:13.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:13 smithi178 ceph-mon[34347]: pgmap v182: 97 pgs: 97 active+clean; 487 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 175 op/s 2024-09-19T05:25:15.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:15 smithi120 ceph-mon[30956]: pgmap v183: 97 pgs: 97 active+clean; 487 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 175 op/s 2024-09-19T05:25:15.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:15 smithi194 ceph-mon[35228]: pgmap v183: 97 pgs: 97 active+clean; 487 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 175 op/s 2024-09-19T05:25:15.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:15 smithi178 ceph-mon[34347]: pgmap v183: 97 pgs: 97 active+clean; 487 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.5 MiB/s wr, 175 op/s 2024-09-19T05:25:17.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:17 smithi120 ceph-mon[30956]: pgmap v184: 97 pgs: 97 active+clean; 500 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 276 op/s 2024-09-19T05:25:17.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:17 smithi194 ceph-mon[35228]: pgmap v184: 97 pgs: 97 active+clean; 500 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 276 op/s 2024-09-19T05:25:17.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:17 smithi178 ceph-mon[34347]: pgmap v184: 97 pgs: 97 active+clean; 500 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.7 MiB/s wr, 276 op/s 2024-09-19T05:25:17.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.990+0000 7f867da45640 1 -- 172.21.15.120:0/2674523682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86781069c0 msgr2=0x7f8678106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:17.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.990+0000 7f867da45640 1 --2- 172.21.15.120:0/2674523682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86781069c0 0x7f8678106da0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8668009930 tx=0x7f866802a420 comp rx=0 tx=0).stop 2024-09-19T05:25:17.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.990+0000 7f867da45640 1 -- 172.21.15.120:0/2674523682 shutdown_connections 2024-09-19T05:25:17.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.990+0000 7f867da45640 1 --2- 172.21.15.120:0/2674523682 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8678101350 0x7f867810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:17.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.990+0000 7f867da45640 1 --2- 172.21.15.120:0/2674523682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86781009b0 0x7f8678100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:17.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.990+0000 7f867da45640 1 --2- 172.21.15.120:0/2674523682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86781069c0 0x7f8678106da0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:17.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.990+0000 7f867da45640 1 -- 172.21.15.120:0/2674523682 >> 172.21.15.120:0/2674523682 conn(0x7f8678077990 msgr2=0x7f86780fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:17.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.990+0000 7f867da45640 1 -- 172.21.15.120:0/2674523682 shutdown_connections 2024-09-19T05:25:17.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.990+0000 7f867da45640 1 -- 172.21.15.120:0/2674523682 wait complete. 2024-09-19T05:25:17.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.991+0000 7f867da45640 1 Processor -- start 2024-09-19T05:25:17.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.991+0000 7f867da45640 1 -- start start 2024-09-19T05:25:17.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.991+0000 7f867da45640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86781009b0 0x7f867819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:17.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.991+0000 7f867da45640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8678101350 0x7f867819a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:17.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.991+0000 7f867da45640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86781069c0 0x7f867819ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:17.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.991+0000 7f867da45640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f867810fbe0 con 0x7f8678101350 2024-09-19T05:25:17.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.991+0000 7f867da45640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f867810fa60 con 0x7f86781009b0 2024-09-19T05:25:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.991+0000 7f867da45640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f867810fd60 con 0x7f86781069c0 2024-09-19T05:25:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.991+0000 7f8676ffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86781009b0 0x7f867819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.991+0000 7f8676ffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86781009b0 0x7f867819a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:50112/0 (socket says 172.21.15.120:50112) 2024-09-19T05:25:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.991+0000 7f8676ffd640 1 -- 172.21.15.120:0/4127946018 learned_addr learned my addr 172.21.15.120:0/4127946018 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:25:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.991+0000 7f866ffff640 1 --2- 172.21.15.120:0/4127946018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8678101350 0x7f867819a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.992+0000 7f86777fe640 1 --2- 172.21.15.120:0/4127946018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86781069c0 0x7f867819ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.992+0000 7f8676ffd640 1 -- 172.21.15.120:0/4127946018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86781069c0 msgr2=0x7f867819ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.992+0000 7f8676ffd640 1 --2- 172.21.15.120:0/4127946018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86781069c0 0x7f867819ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.992+0000 7f8676ffd640 1 -- 172.21.15.120:0/4127946018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8678101350 msgr2=0x7f867819a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.992+0000 7f8676ffd640 1 --2- 172.21.15.120:0/4127946018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8678101350 0x7f867819a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.992+0000 7f8676ffd640 1 -- 172.21.15.120:0/4127946018 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f867819f4a0 con 0x7f86781009b0 2024-09-19T05:25:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.992+0000 7f86777fe640 1 --2- 172.21.15.120:0/4127946018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86781069c0 0x7f867819ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:25:17.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.992+0000 7f8676ffd640 1 --2- 172.21.15.120:0/4127946018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86781009b0 0x7f867819a4b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8668005ab0 tx=0x7f8668003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:17.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.992+0000 7f867ca43640 1 -- 172.21.15.120:0/4127946018 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866803f070 con 0x7f86781009b0 2024-09-19T05:25:17.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.992+0000 7f867ca43640 1 -- 172.21.15.120:0/4127946018 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8668031b50 con 0x7f86781009b0 2024-09-19T05:25:17.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.992+0000 7f867da45640 1 -- 172.21.15.120:0/4127946018 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f867819f730 con 0x7f86781009b0 2024-09-19T05:25:17.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.992+0000 7f867ca43640 1 -- 172.21.15.120:0/4127946018 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8668035030 con 0x7f86781009b0 2024-09-19T05:25:17.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.993+0000 7f867da45640 1 -- 172.21.15.120:0/4127946018 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86781a7020 con 0x7f86781009b0 2024-09-19T05:25:17.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.996+0000 7f867ca43640 1 -- 172.21.15.120:0/4127946018 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f8668042070 con 0x7f86781009b0 2024-09-19T05:25:17.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.996+0000 7f86807d9740 1 Processor -- start 2024-09-19T05:25:17.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.996+0000 7f86807d9740 1 -- start start 2024-09-19T05:25:17.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.996+0000 7f86807d9740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5609c3c37af0 0x5609c3c37ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:17.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.996+0000 7f86807d9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c38410 0x5609c3c42770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:17.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.996+0000 7f86807d9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609c3c42cb0 0x5609c3c450a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:17.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.996+0000 7f86807d9740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5609c3b9c2f0 con 0x5609c3c38410 2024-09-19T05:25:17.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.996+0000 7f86807d9740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5609c3b44270 con 0x5609c3c42cb0 2024-09-19T05:25:17.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.996+0000 7f86807d9740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5609c3b982b0 con 0x5609c3c37af0 2024-09-19T05:25:18.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.996+0000 7f86777fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5609c3c37af0 0x5609c3c37ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:18.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.996+0000 7f866ffff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609c3c42cb0 0x5609c3c450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:18.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.996+0000 7f8676ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c38410 0x5609c3c42770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:18.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.996+0000 7f866ffff640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609c3c42cb0 0x5609c3c450a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:50122/0 (socket says 172.21.15.120:50122) 2024-09-19T05:25:18.000 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.996+0000 7f8676ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c38410 0x5609c3c42770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39606/0 (socket says 172.21.15.120:39606) 2024-09-19T05:25:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.996+0000 7f866ffff640 1 -- 172.21.15.120:0/969023205 learned_addr learned my addr 172.21.15.120:0/969023205 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:25:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.997+0000 7f866ffff640 1 -- 172.21.15.120:0/969023205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5609c3c37af0 msgr2=0x5609c3c37ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.997+0000 7f866ffff640 1 --2- 172.21.15.120:0/969023205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5609c3c37af0 0x5609c3c37ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.997+0000 7f866ffff640 1 -- 172.21.15.120:0/969023205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c38410 msgr2=0x5609c3c42770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.997+0000 7f866ffff640 1 --2- 172.21.15.120:0/969023205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c38410 0x5609c3c42770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.997+0000 7f866ffff640 1 -- 172.21.15.120:0/969023205 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609c3b43340 con 0x5609c3c42cb0 2024-09-19T05:25:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.997+0000 7f866ffff640 1 --2- 172.21.15.120:0/969023205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609c3c42cb0 0x5609c3c450a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8660009ca0 tx=0x7f8660011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ade0a79438d4bf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.997+0000 7f866dffb640 1 -- 172.21.15.120:0/969023205 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866001e070 con 0x5609c3c42cb0 2024-09-19T05:25:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.997+0000 7f866dffb640 1 -- 172.21.15.120:0/969023205 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8660019ae0 con 0x5609c3c42cb0 2024-09-19T05:25:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.998+0000 7f867ca43640 1 --2- 172.21.15.120:0/4127946018 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f86640a34e0 0x7f86640a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.998+0000 7f866dffb640 1 -- 172.21.15.120:0/969023205 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f866000e9b0 con 0x5609c3c42cb0 2024-09-19T05:25:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.998+0000 7f867ca43640 1 -- 172.21.15.120:0/4127946018 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f86680f03f0 con 0x7f86781009b0 2024-09-19T05:25:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.998+0000 7f86807d9740 1 -- 172.21.15.120:0/969023205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609c3c42cb0 msgr2=0x5609c3c450a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:18.001 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.998+0000 7f86807d9740 1 --2- 172.21.15.120:0/969023205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609c3c42cb0 0x5609c3c450a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8660009ca0 tx=0x7f8660011810 comp rx=0 tx=0).stop 2024-09-19T05:25:18.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.998+0000 7f86777fe640 1 --2- 172.21.15.120:0/4127946018 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f86640a34e0 0x7f86640a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:18.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.998+0000 7f86807d9740 1 -- 172.21.15.120:0/969023205 shutdown_connections 2024-09-19T05:25:18.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.998+0000 7f86807d9740 1 --2- 172.21.15.120:0/969023205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609c3c42cb0 0x5609c3c450a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:18.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.998+0000 7f86807d9740 1 --2- 172.21.15.120:0/969023205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c38410 0x5609c3c42770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:18.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.998+0000 7f86807d9740 1 --2- 172.21.15.120:0/969023205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5609c3c37af0 0x5609c3c37ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:18.002 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.998+0000 7f86807d9740 1 -- 172.21.15.120:0/969023205 >> 172.21.15.120:0/969023205 conn(0x5609c3c34060 msgr2=0x5609c3c34440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:18.005 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.999+0000 7f86807d9740 1 -- 172.21.15.120:0/969023205 shutdown_connections 2024-09-19T05:25:18.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.999+0000 7f86777fe640 1 --2- 172.21.15.120:0/4127946018 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f86640a34e0 0x7f86640a59a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8670005fd0 tx=0x7f8670009500 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:18.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.999+0000 7f86807d9740 1 -- 172.21.15.120:0/969023205 wait complete. 2024-09-19T05:25:18.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.999+0000 7f86807d9740 1 -- start start 2024-09-19T05:25:18.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:17.999+0000 7f86807d9740 1 Processor -- start 2024-09-19T05:25:18.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.000+0000 7f86807d9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609c3c37af0 0x5609c3c3fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:18.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.000+0000 7f86807d9740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5609c3c38410 0x5609c3c40010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:18.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.000+0000 7f86807d9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c42cb0 0x5609c3c40550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:18.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.000+0000 7f86807d9740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5609c3c45920 con 0x5609c3c42cb0 2024-09-19T05:25:18.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.000+0000 7f86807d9740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5609c3b25290 con 0x5609c3c37af0 2024-09-19T05:25:18.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.000+0000 7f86807d9740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5609c3c45aa0 con 0x5609c3c38410 2024-09-19T05:25:18.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.000+0000 7f8676ffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609c3c37af0 0x5609c3c3fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:18.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.000+0000 7f866ffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5609c3c38410 0x5609c3c40010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:18.006 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.000+0000 7f8676ffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609c3c37af0 0x5609c3c3fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:50138/0 (socket says 172.21.15.120:50138) 2024-09-19T05:25:18.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.000+0000 7f8676ffd640 1 -- 172.21.15.120:0/3210180542 learned_addr learned my addr 172.21.15.120:0/3210180542 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:25:18.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.000+0000 7f86807d9740 10 client.0 _ll_register_callbacks cb 0x5609c3b56140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:25:18.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.000+0000 7f86777fe640 1 --2- 172.21.15.120:0/3210180542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c42cb0 0x5609c3c40550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:18.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.000+0000 7f8676ffd640 1 -- 172.21.15.120:0/3210180542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5609c3c38410 msgr2=0x5609c3c40010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:18.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.000+0000 7f8676ffd640 1 --2- 172.21.15.120:0/3210180542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5609c3c38410 0x5609c3c40010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:18.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.000+0000 7f8676ffd640 1 -- 172.21.15.120:0/3210180542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c42cb0 msgr2=0x5609c3c40550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:18.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.000+0000 7f8676ffd640 1 --2- 172.21.15.120:0/3210180542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c42cb0 0x5609c3c40550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:18.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.000+0000 7f8676ffd640 1 -- 172.21.15.120:0/3210180542 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609c38af210 con 0x5609c3c37af0 2024-09-19T05:25:18.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.000+0000 7f86777fe640 1 --2- 172.21.15.120:0/3210180542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c42cb0 0x5609c3c40550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:25:18.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.001+0000 7f8676ffd640 1 --2- 172.21.15.120:0/3210180542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609c3c37af0 0x5609c3c3fad0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8668031440 tx=0x7f8668005b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=130f1e68beeeda8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:18.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.001+0000 7f8656ffd640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:25:18.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.001+0000 7f8656ffd640 1 -- 172.21.15.120:0/3210180542 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8668049070 con 0x5609c3c37af0 2024-09-19T05:25:18.007 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.001+0000 7f8656ffd640 1 -- 172.21.15.120:0/3210180542 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f866803b460 con 0x5609c3c37af0 2024-09-19T05:25:18.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.001+0000 7f86807d9740 1 -- 172.21.15.120:0/3210180542 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8660019ae0 con 0x5609c3c37af0 2024-09-19T05:25:18.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.001+0000 7f8656ffd640 1 -- 172.21.15.120:0/3210180542 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f86680bc160 con 0x5609c3c37af0 2024-09-19T05:25:18.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.001+0000 7f86807d9740 10 client.25661 fetch_fsmap learned FSMap version 29 2024-09-19T05:25:18.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.001+0000 7f86807d9740 1 -- 172.21.15.120:0/3210180542 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5609c397b620 con 0x5609c3c37af0 2024-09-19T05:25:18.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.001+0000 7f8656ffd640 1 -- 172.21.15.120:0/3210180542 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f8660019ae0 con 0x5609c3c37af0 2024-09-19T05:25:18.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.001+0000 7f8656ffd640 1 -- 172.21.15.120:0/3210180542 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f86680edd10 con 0x5609c3c37af0 2024-09-19T05:25:18.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.001+0000 7f86807d9740 10 client.25661 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:25:18.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.001+0000 7f86807d9740 10 client.25661 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:25:18.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.001+0000 7f86807d9740 20 client.25661 populate_metadata read hostname 'smithi120' 2024-09-19T05:25:18.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.001+0000 7f86807d9740 1 --2- 172.21.15.120:0/3210180542 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5609c3c52c20 0x5609c3c55050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:18.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.002+0000 7f86807d9740 4 client.25661 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:25:18.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.002+0000 7f86807d9740 1 -- 172.21.15.120:0/3210180542 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609c3ba9a20 con 0x5609c3c52c20 2024-09-19T05:25:18.008 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.002+0000 7f866ffff640 1 --2- 172.21.15.120:0/3210180542 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5609c3c52c20 0x5609c3c55050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.002+0000 7f8656ffd640 10 client.25661 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:25:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.002+0000 7f866ffff640 1 --2- 172.21.15.120:0/3210180542 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5609c3c52c20 0x5609c3c55050 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8db9384ebf5ccf1b server_cookie=f3e743c9d88dc2b6 in_seq=0 out_seq=0 2024-09-19T05:25:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.003+0000 7f8656ffd640 1 -- 172.21.15.120:0/3210180542 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5609c3ba9a20 con 0x5609c3c52c20 2024-09-19T05:25:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.003+0000 7f8656ffd640 10 client.25661 handle_command_reply: tid=0 2024-09-19T05:25:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.003+0000 7f86807d9740 1 client.25661 shutdown 2024-09-19T05:25:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.003+0000 7f86807d9740 1 -- 172.21.15.120:0/3210180542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609c3c37af0 msgr2=0x5609c3c3fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.003+0000 7f86807d9740 1 --2- 172.21.15.120:0/3210180542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609c3c37af0 0x5609c3c3fad0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8668031440 tx=0x7f8668005b50 comp rx=0 tx=0).stop 2024-09-19T05:25:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.003+0000 7f86807d9740 1 -- 172.21.15.120:0/3210180542 shutdown_connections 2024-09-19T05:25:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.003+0000 7f86807d9740 1 --2- 172.21.15.120:0/3210180542 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c42cb0 0x5609c3c40550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.003+0000 7f86807d9740 1 --2- 172.21.15.120:0/3210180542 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5609c3c52c20 0x5609c3c55050 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.003+0000 7f86807d9740 1 --2- 172.21.15.120:0/3210180542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5609c3c38410 0x5609c3c40010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.003+0000 7f86807d9740 1 --2- 172.21.15.120:0/3210180542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609c3c37af0 0x5609c3c3fad0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.003+0000 7f8656ffd640 0 client.25661 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:25:18.009 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.003+0000 7f86807d9740 1 -- 172.21.15.120:0/3210180542 >> 172.21.15.120:0/3210180542 conn(0x5609c3c34060 msgr2=0x5609c3c39dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.003+0000 7f86807d9740 1 -- 172.21.15.120:0/3210180542 shutdown_connections 2024-09-19T05:25:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.003+0000 7f86807d9740 1 -- 172.21.15.120:0/3210180542 wait complete. 2024-09-19T05:25:18.010 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.003+0000 7f86807d9740 20 client.25661 trim_cache size 0 max 16384 2024-09-19T05:25:18.031 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.028+0000 7f86807d9740 1 Processor -- start 2024-09-19T05:25:18.031 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.028+0000 7f86807d9740 1 -- start start 2024-09-19T05:25:18.031 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.028+0000 7f86807d9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609c3c37af0 0x5609c3c40380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:18.031 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.028+0000 7f86807d9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c38410 0x5609c3c5a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:18.031 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.028+0000 7f86807d9740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5609c3c42cb0 0x5609c3c5aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:18.031 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.028+0000 7f86807d9740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f86781b22e0 con 0x5609c3c38410 2024-09-19T05:25:18.031 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.028+0000 7f86807d9740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f86781afbb0 con 0x5609c3c37af0 2024-09-19T05:25:18.031 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.028+0000 7f86807d9740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f86781ada00 con 0x5609c3c42cb0 2024-09-19T05:25:18.031 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.028+0000 7f866ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c38410 0x5609c3c5a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:18.031 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.028+0000 7f8676ffd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609c3c37af0 0x5609c3c40380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:18.032 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.028+0000 7f866ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c38410 0x5609c3c5a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39626/0 (socket says 172.21.15.120:39626) 2024-09-19T05:25:18.032 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.028+0000 7f866ffff640 1 -- 172.21.15.120:0/2547094229 learned_addr learned my addr 172.21.15.120:0/2547094229 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:25:18.032 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.028+0000 7f86777fe640 1 --2- 172.21.15.120:0/2547094229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5609c3c42cb0 0x5609c3c5aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:18.032 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.028+0000 7f8676ffd640 1 -- 172.21.15.120:0/2547094229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5609c3c42cb0 msgr2=0x5609c3c5aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:18.032 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.028+0000 7f8676ffd640 1 --2- 172.21.15.120:0/2547094229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5609c3c42cb0 0x5609c3c5aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:18.032 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.028+0000 7f8676ffd640 1 -- 172.21.15.120:0/2547094229 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c38410 msgr2=0x5609c3c5a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:18.032 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.028+0000 7f8676ffd640 1 --2- 172.21.15.120:0/2547094229 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c38410 0x5609c3c5a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:18.032 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.028+0000 7f8676ffd640 1 -- 172.21.15.120:0/2547094229 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609c3c33e90 con 0x5609c3c37af0 2024-09-19T05:25:18.032 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.028+0000 7f866ffff640 1 --2- 172.21.15.120:0/2547094229 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c38410 0x5609c3c5a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:25:18.032 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.029+0000 7f8676ffd640 1 --2- 172.21.15.120:0/2547094229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609c3c37af0 0x5609c3c40380 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f86680c4d60 tx=0x7f8668009680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=885aed5771beb934 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:18.032 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.029+0000 7f866d7fa640 1 -- 172.21.15.120:0/2547094229 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8668049070 con 0x5609c3c37af0 2024-09-19T05:25:18.032 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.029+0000 7f866d7fa640 1 -- 172.21.15.120:0/2547094229 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f86680bcd20 con 0x5609c3c37af0 2024-09-19T05:25:18.032 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.029+0000 7f866d7fa640 1 -- 172.21.15.120:0/2547094229 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86680bbf80 con 0x5609c3c37af0 2024-09-19T05:25:18.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.030+0000 7f86807d9740 1 -- 172.21.15.120:0/2547094229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609c3c37af0 msgr2=0x5609c3c40380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:18.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.030+0000 7f86807d9740 1 --2- 172.21.15.120:0/2547094229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609c3c37af0 0x5609c3c40380 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f86680c4d60 tx=0x7f8668009680 comp rx=0 tx=0).stop 2024-09-19T05:25:18.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.030+0000 7f86807d9740 1 -- 172.21.15.120:0/2547094229 shutdown_connections 2024-09-19T05:25:18.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.030+0000 7f86807d9740 1 --2- 172.21.15.120:0/2547094229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5609c3c42cb0 0x5609c3c5aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:18.036 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.030+0000 7f86807d9740 1 --2- 172.21.15.120:0/2547094229 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c38410 0x5609c3c5a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:18.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.030+0000 7f86807d9740 1 --2- 172.21.15.120:0/2547094229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609c3c37af0 0x5609c3c40380 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:18.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.030+0000 7f86807d9740 1 -- 172.21.15.120:0/2547094229 >> 172.21.15.120:0/2547094229 conn(0x5609c3c34060 msgr2=0x5609c3c41b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:18.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.030+0000 7f86807d9740 1 -- 172.21.15.120:0/2547094229 shutdown_connections 2024-09-19T05:25:18.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.030+0000 7f86807d9740 1 -- 172.21.15.120:0/2547094229 wait complete. 2024-09-19T05:25:18.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.030+0000 7f86807d9740 1 -- start start 2024-09-19T05:25:18.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.030+0000 7f86807d9740 1 Processor -- start 2024-09-19T05:25:18.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.031+0000 7f86807d9740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c37af0 0x5609c3c4b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:18.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.031+0000 7f86807d9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609c3c38410 0x5609c3c3c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:18.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.031+0000 7f86807d9740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5609c3c42cb0 0x5609c3c3cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:18.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.031+0000 7f86807d9740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f86781ae070 con 0x5609c3c37af0 2024-09-19T05:25:18.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.031+0000 7f86807d9740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f86781af4e0 con 0x5609c3c38410 2024-09-19T05:25:18.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.031+0000 7f86807d9740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f86781ae740 con 0x5609c3c42cb0 2024-09-19T05:25:18.037 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.031+0000 7f86807d9740 10 client.0 _ll_register_callbacks cb 0x7f8668005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:25:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.031+0000 7f8676ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c37af0 0x5609c3c4b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.031+0000 7f8676ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c37af0 0x5609c3c4b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:39632/0 (socket says 172.21.15.120:39632) 2024-09-19T05:25:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.031+0000 7f8676ffd640 1 -- 172.21.15.120:0/2690788858 learned_addr learned my addr 172.21.15.120:0/2690788858 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:25:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.031+0000 7f86777fe640 1 --2- 172.21.15.120:0/2690788858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5609c3c42cb0 0x5609c3c3cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.031+0000 7f866ffff640 1 --2- 172.21.15.120:0/2690788858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609c3c38410 0x5609c3c3c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.031+0000 7f8676ffd640 1 -- 172.21.15.120:0/2690788858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5609c3c42cb0 msgr2=0x5609c3c3cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.031+0000 7f8676ffd640 1 --2- 172.21.15.120:0/2690788858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5609c3c42cb0 0x5609c3c3cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.031+0000 7f8676ffd640 1 -- 172.21.15.120:0/2690788858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609c3c38410 msgr2=0x5609c3c3c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.031+0000 7f8676ffd640 1 --2- 172.21.15.120:0/2690788858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609c3c38410 0x5609c3c3c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.031+0000 7f8676ffd640 1 -- 172.21.15.120:0/2690788858 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609c3c3d110 con 0x5609c3c37af0 2024-09-19T05:25:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.031+0000 7f86777fe640 1 --2- 172.21.15.120:0/2690788858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5609c3c42cb0 0x5609c3c3cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:25:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.031+0000 7f8676ffd640 1 --2- 172.21.15.120:0/2690788858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c37af0 0x5609c3c4b2d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f86680b8a80 tx=0x7f8668005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97261e52328b61ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:18.038 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.032+0000 7f8656ffd640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:25:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.032+0000 7f8656ffd640 1 -- 172.21.15.120:0/2690788858 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8668049070 con 0x5609c3c37af0 2024-09-19T05:25:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.032+0000 7f8656ffd640 1 -- 172.21.15.120:0/2690788858 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f86680f3ab0 con 0x5609c3c37af0 2024-09-19T05:25:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.032+0000 7f86807d9740 1 -- 172.21.15.120:0/2690788858 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86680bcd20 con 0x5609c3c37af0 2024-09-19T05:25:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.032+0000 7f8656ffd640 1 -- 172.21.15.120:0/2690788858 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f86680c09d0 con 0x5609c3c37af0 2024-09-19T05:25:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.032+0000 7f86807d9740 10 client.16224 fetch_fsmap learned FSMap version 29 2024-09-19T05:25:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.032+0000 7f86807d9740 1 -- 172.21.15.120:0/2690788858 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5609c3c3d110 con 0x5609c3c37af0 2024-09-19T05:25:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.032+0000 7f8656ffd640 1 -- 172.21.15.120:0/2690788858 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f86680bcd20 con 0x5609c3c37af0 2024-09-19T05:25:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.032+0000 7f8656ffd640 1 -- 172.21.15.120:0/2690788858 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f86680bba70 con 0x5609c3c37af0 2024-09-19T05:25:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.032+0000 7f86807d9740 10 client.16224 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:25:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.032+0000 7f86807d9740 10 client.16224 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:25:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.032+0000 7f86807d9740 20 client.16224 populate_metadata read hostname 'smithi120' 2024-09-19T05:25:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.032+0000 7f86807d9740 1 --2- 172.21.15.120:0/2690788858 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5609c3cc6340 0x5609c3cc8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.032+0000 7f86807d9740 4 client.16224 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:25:18.039 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.032+0000 7f86807d9740 1 -- 172.21.15.120:0/2690788858 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5609c3ba3d70 con 0x5609c3cc6340 2024-09-19T05:25:18.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.033+0000 7f866ffff640 1 --2- 172.21.15.120:0/2690788858 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5609c3cc6340 0x5609c3cc8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:18.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.033+0000 7f866ffff640 1 --2- 172.21.15.120:0/2690788858 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5609c3cc6340 0x5609c3cc8760 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6cf0091a5245d72 server_cookie=2237d5bef684eaf6 in_seq=0 out_seq=0 2024-09-19T05:25:18.040 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.033+0000 7f8656ffd640 10 client.16224 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:25:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.168+0000 7f8656ffd640 1 -- 172.21.15.120:0/2690788858 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5609c3ba3d70 con 0x5609c3cc6340 2024-09-19T05:25:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.168+0000 7f8656ffd640 10 client.16224 handle_command_reply: tid=0 2024-09-19T05:25:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.168+0000 7f86807d9740 1 client.16224 shutdown 2024-09-19T05:25:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.168+0000 7f86807d9740 1 -- 172.21.15.120:0/2690788858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c37af0 msgr2=0x5609c3c4b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.168+0000 7f86807d9740 1 --2- 172.21.15.120:0/2690788858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c37af0 0x5609c3c4b2d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f86680b8a80 tx=0x7f8668005b50 comp rx=0 tx=0).stop 2024-09-19T05:25:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.168+0000 7f86807d9740 1 -- 172.21.15.120:0/2690788858 shutdown_connections 2024-09-19T05:25:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.168+0000 7f86807d9740 1 --2- 172.21.15.120:0/2690788858 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5609c3cc6340 0x5609c3cc8760 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.168+0000 7f86807d9740 1 --2- 172.21.15.120:0/2690788858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5609c3c42cb0 0x5609c3c3cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.168+0000 7f86807d9740 1 --2- 172.21.15.120:0/2690788858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5609c3c38410 0x5609c3c3c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.168+0000 7f86807d9740 1 --2- 172.21.15.120:0/2690788858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5609c3c37af0 0x5609c3c4b2d0 secure :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f86680b8a80 tx=0x7f8668005b50 comp rx=0 tx=0).stop 2024-09-19T05:25:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.168+0000 7f86807d9740 1 -- 172.21.15.120:0/2690788858 >> 172.21.15.120:0/2690788858 conn(0x5609c3c34060 msgr2=0x5609c3c395a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.168+0000 7f8656ffd640 0 client.16224 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:25:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.170+0000 7f86807d9740 1 -- 172.21.15.120:0/2690788858 shutdown_connections 2024-09-19T05:25:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.171+0000 7f86807d9740 1 -- 172.21.15.120:0/2690788858 wait complete. 2024-09-19T05:25:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.171+0000 7f86807d9740 20 client.16224 trim_cache size 0 max 16384 2024-09-19T05:25:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:25:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:25:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:25:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:25:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.172+0000 7f867da45640 1 -- 172.21.15.120:0/4127946018 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f86640a34e0 msgr2=0x7f86640a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.172+0000 7f867da45640 1 --2- 172.21.15.120:0/4127946018 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f86640a34e0 0x7f86640a59a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8670005fd0 tx=0x7f8670009500 comp rx=0 tx=0).stop 2024-09-19T05:25:18.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.172+0000 7f867da45640 1 -- 172.21.15.120:0/4127946018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86781009b0 msgr2=0x7f867819a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:18.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.172+0000 7f867da45640 1 --2- 172.21.15.120:0/4127946018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86781009b0 0x7f867819a4b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8668005ab0 tx=0x7f8668003b90 comp rx=0 tx=0).stop 2024-09-19T05:25:18.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.172+0000 7f867da45640 1 -- 172.21.15.120:0/4127946018 shutdown_connections 2024-09-19T05:25:18.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.172+0000 7f867da45640 1 --2- 172.21.15.120:0/4127946018 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f86640a34e0 0x7f86640a59a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:18.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.172+0000 7f867da45640 1 --2- 172.21.15.120:0/4127946018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86781069c0 0x7f867819ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:18.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.172+0000 7f867da45640 1 --2- 172.21.15.120:0/4127946018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8678101350 0x7f867819a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:18.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.172+0000 7f867da45640 1 --2- 172.21.15.120:0/4127946018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86781009b0 0x7f867819a4b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:18.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.172+0000 7f867da45640 1 -- 172.21.15.120:0/4127946018 >> 172.21.15.120:0/4127946018 conn(0x7f8678077990 msgr2=0x7f8678103610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:18.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.172+0000 7f867da45640 1 -- 172.21.15.120:0/4127946018 shutdown_connections 2024-09-19T05:25:18.175 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:18.172+0000 7f867da45640 1 -- 172.21.15.120:0/4127946018 wait complete. 2024-09-19T05:25:18.317 INFO:tasks.workunit.client.0.smithi120.stdout: 95 12354 98 7658 126 3408 131 2024-09-19T05:25:19.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:19 smithi120 ceph-mon[30956]: pgmap v185: 97 pgs: 97 active+clean; 500 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 205 op/s 2024-09-19T05:25:19.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:19 smithi194 ceph-mon[35228]: pgmap v185: 97 pgs: 97 active+clean; 500 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 205 op/s 2024-09-19T05:25:19.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:19 smithi178 ceph-mon[34347]: pgmap v185: 97 pgs: 97 active+clean; 500 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.4 MiB/s wr, 205 op/s 2024-09-19T05:25:21.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:21 smithi120 ceph-mon[30956]: pgmap v186: 97 pgs: 97 active+clean; 497 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 307 op/s 2024-09-19T05:25:21.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:21 smithi194 ceph-mon[35228]: pgmap v186: 97 pgs: 97 active+clean; 497 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 307 op/s 2024-09-19T05:25:21.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:21 smithi178 ceph-mon[34347]: pgmap v186: 97 pgs: 97 active+clean; 497 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 307 op/s 2024-09-19T05:25:23.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:23 smithi120 ceph-mon[30956]: pgmap v187: 97 pgs: 97 active+clean; 491 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 275 op/s 2024-09-19T05:25:23.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:23 smithi194 ceph-mon[35228]: pgmap v187: 97 pgs: 97 active+clean; 491 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 275 op/s 2024-09-19T05:25:23.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:23 smithi178 ceph-mon[34347]: pgmap v187: 97 pgs: 97 active+clean; 491 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 275 op/s 2024-09-19T05:25:25.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:25 smithi120 ceph-mon[30956]: pgmap v188: 97 pgs: 97 active+clean; 491 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.5 MiB/s wr, 255 op/s 2024-09-19T05:25:25.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:25 smithi194 ceph-mon[35228]: pgmap v188: 97 pgs: 97 active+clean; 491 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.5 MiB/s wr, 255 op/s 2024-09-19T05:25:25.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:25 smithi178 ceph-mon[34347]: pgmap v188: 97 pgs: 97 active+clean; 491 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.5 MiB/s wr, 255 op/s 2024-09-19T05:25:27.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:27 smithi120 ceph-mon[30956]: pgmap v189: 97 pgs: 97 active+clean; 505 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.7 MiB/s wr, 346 op/s 2024-09-19T05:25:27.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:27 smithi194 ceph-mon[35228]: pgmap v189: 97 pgs: 97 active+clean; 505 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.7 MiB/s wr, 346 op/s 2024-09-19T05:25:27.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:27 smithi178 ceph-mon[34347]: pgmap v189: 97 pgs: 97 active+clean; 505 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.7 MiB/s wr, 346 op/s 2024-09-19T05:25:28.315 INFO:tasks.workunit.client.0.smithi120.stdout: 97 13183 80 8602 127 4036 109 2024-09-19T05:25:29.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:29 smithi120 ceph-mon[30956]: pgmap v190: 97 pgs: 97 active+clean; 505 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 245 op/s 2024-09-19T05:25:29.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:29 smithi194 ceph-mon[35228]: pgmap v190: 97 pgs: 97 active+clean; 505 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 245 op/s 2024-09-19T05:25:29.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:29 smithi178 ceph-mon[34347]: pgmap v190: 97 pgs: 97 active+clean; 505 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 245 op/s 2024-09-19T05:25:31.295 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.293+0000 7f65e3ea6640 1 -- 172.21.15.120:0/830094471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65dc112970 msgr2=0x7f65dc114d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:31.295 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.293+0000 7f65e3ea6640 1 --2- 172.21.15.120:0/830094471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65dc112970 0x7f65dc114d60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f65d4009ca0 tx=0x7f65d402a8c0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.295 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.293+0000 7f65e3ea6640 1 -- 172.21.15.120:0/830094471 shutdown_connections 2024-09-19T05:25:31.295 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.293+0000 7f65e3ea6640 1 --2- 172.21.15.120:0/830094471 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65dc112970 0x7f65dc114d60 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.295 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.293+0000 7f65e3ea6640 1 --2- 172.21.15.120:0/830094471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65dc077040 0x7f65dc112430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.295 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.293+0000 7f65e3ea6640 1 --2- 172.21.15.120:0/830094471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65dc076720 0x7f65dc076b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.293+0000 7f65e3ea6640 1 -- 172.21.15.120:0/830094471 >> 172.21.15.120:0/830094471 conn(0x7f65dc0ff9b0 msgr2=0x7f65dc101dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:31.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.293+0000 7f65e3ea6640 1 -- 172.21.15.120:0/830094471 shutdown_connections 2024-09-19T05:25:31.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.293+0000 7f65e3ea6640 1 -- 172.21.15.120:0/830094471 wait complete. 2024-09-19T05:25:31.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.294+0000 7f65e3ea6640 1 Processor -- start 2024-09-19T05:25:31.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.294+0000 7f65e3ea6640 1 -- start start 2024-09-19T05:25:31.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.294+0000 7f65e3ea6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65dc076720 0x7f65dc1a45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:31.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.295+0000 7f65e3ea6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65dc077040 0x7f65dc1a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:31.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.295+0000 7f65e3ea6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65dc112970 0x7f65dc19e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:31.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.295+0000 7f65e3ea6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc1183b0 con 0x7f65dc076720 2024-09-19T05:25:31.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.295+0000 7f65e3ea6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc118230 con 0x7f65dc112970 2024-09-19T05:25:31.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.295+0000 7f65e3ea6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc118530 con 0x7f65dc077040 2024-09-19T05:25:31.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.295+0000 7f65e1c42640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65dc076720 0x7f65dc1a45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:31.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.295+0000 7f65e1c42640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65dc076720 0x7f65dc1a45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34366/0 (socket says 172.21.15.120:34366) 2024-09-19T05:25:31.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.295+0000 7f65e1441640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65dc077040 0x7f65dc1a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:31.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.295+0000 7f65e1c42640 1 -- 172.21.15.120:0/932532015 learned_addr learned my addr 172.21.15.120:0/932532015 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:25:31.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.295+0000 7f65e2443640 1 --2- 172.21.15.120:0/932532015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65dc112970 0x7f65dc19e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:31.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.295+0000 7f65e1c42640 1 -- 172.21.15.120:0/932532015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65dc077040 msgr2=0x7f65dc1a4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:31.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.295+0000 7f65e1c42640 1 --2- 172.21.15.120:0/932532015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65dc077040 0x7f65dc1a4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.295+0000 7f65e1c42640 1 -- 172.21.15.120:0/932532015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65dc112970 msgr2=0x7f65dc19e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:31.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.295+0000 7f65e1c42640 1 --2- 172.21.15.120:0/932532015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65dc112970 0x7f65dc19e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.295+0000 7f65e1c42640 1 -- 172.21.15.120:0/932532015 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65dc19ef60 con 0x7f65dc076720 2024-09-19T05:25:31.299 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.295+0000 7f65e1c42640 1 --2- 172.21.15.120:0/932532015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65dc076720 0x7f65dc1a45e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f65d800e9f0 tx=0x7f65d800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:31.299 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.296+0000 7f65d2ffd640 1 -- 172.21.15.120:0/932532015 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d800cd80 con 0x7f65dc076720 2024-09-19T05:25:31.299 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.296+0000 7f65e3ea6640 1 -- 172.21.15.120:0/932532015 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65dc19f250 con 0x7f65dc076720 2024-09-19T05:25:31.299 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.296+0000 7f65e3ea6640 1 -- 172.21.15.120:0/932532015 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65dc1ab560 con 0x7f65dc076720 2024-09-19T05:25:31.299 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.296+0000 7f65d2ffd640 1 -- 172.21.15.120:0/932532015 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f65d80108e0 con 0x7f65dc076720 2024-09-19T05:25:31.299 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.296+0000 7f65d2ffd640 1 -- 172.21.15.120:0/932532015 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d8018920 con 0x7f65dc076720 2024-09-19T05:25:31.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.298+0000 7f65d2ffd640 1 -- 172.21.15.120:0/932532015 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f65d8018ac0 con 0x7f65dc076720 2024-09-19T05:25:31.301 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.299+0000 7f65e6c38740 1 Processor -- start 2024-09-19T05:25:31.301 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.299+0000 7f65e6c38740 1 -- start start 2024-09-19T05:25:31.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.300+0000 7f65d2ffd640 1 --2- 172.21.15.120:0/932532015 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f65c80a34e0 0x7f65c80a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:31.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.300+0000 7f65e6c38740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55caf08d9af0 0x55caf08d9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:31.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.300+0000 7f65e6c38740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55caf08da410 0x55caf08e4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:31.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.300+0000 7f65e6c38740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55caf08e4cb0 0x55caf08e70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:31.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.300+0000 7f65e6c38740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55caf083e2f0 con 0x55caf08da410 2024-09-19T05:25:31.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.300+0000 7f65e6c38740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55caf07e6270 con 0x55caf08e4cb0 2024-09-19T05:25:31.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.300+0000 7f65e6c38740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55caf083a2b0 con 0x55caf08d9af0 2024-09-19T05:25:31.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.300+0000 7f65e1441640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55caf08da410 0x55caf08e4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:31.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.300+0000 7f65e2443640 1 --2- 172.21.15.120:0/932532015 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f65c80a34e0 0x7f65c80a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:31.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.300+0000 7f65d2ffd640 1 -- 172.21.15.120:0/932532015 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f65d80d00f0 con 0x7f65dc076720 2024-09-19T05:25:31.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.300+0000 7f65e1c42640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55caf08d9af0 0x55caf08d9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:31.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.300+0000 7f65e1441640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55caf08da410 0x55caf08e4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34382/0 (socket says 172.21.15.120:34382) 2024-09-19T05:25:31.304 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.300+0000 7f65e1441640 1 -- 172.21.15.120:0/1357937475 learned_addr learned my addr 172.21.15.120:0/1357937475 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:25:31.304 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.301+0000 7f65e2443640 1 --2- 172.21.15.120:0/1357937475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55caf08e4cb0 0x55caf08e70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:31.304 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.301+0000 7f65e1441640 1 -- 172.21.15.120:0/1357937475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55caf08d9af0 msgr2=0x55caf08d9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:31.304 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.301+0000 7f65e1441640 1 --2- 172.21.15.120:0/1357937475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55caf08d9af0 0x55caf08d9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.304 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.301+0000 7f65e1441640 1 -- 172.21.15.120:0/1357937475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55caf08e4cb0 msgr2=0x55caf08e70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:31.304 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.301+0000 7f65e1441640 1 --2- 172.21.15.120:0/1357937475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55caf08e4cb0 0x55caf08e70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.304 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.301+0000 7f65e1441640 1 -- 172.21.15.120:0/1357937475 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55caf07e5340 con 0x55caf08da410 2024-09-19T05:25:31.304 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.301+0000 7f65e1c42640 1 --2- 172.21.15.120:0/1357937475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55caf08d9af0 0x55caf08d9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:25:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.301+0000 7f65e2443640 1 --2- 172.21.15.120:0/1357937475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55caf08e4cb0 0x55caf08e70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:25:31.307 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.301+0000 7f65e1441640 1 --2- 172.21.15.120:0/1357937475 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55caf08da410 0x55caf08e4770 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f65cc00bc30 tx=0x7f65cc0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2dab1749c08add3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.301+0000 7f65c7fff640 1 -- 172.21.15.120:0/1357937475 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc01c480 con 0x55caf08da410 2024-09-19T05:25:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.301+0000 7f65c7fff640 1 -- 172.21.15.120:0/1357937475 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f65cc01cad0 con 0x55caf08da410 2024-09-19T05:25:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.301+0000 7f65c7fff640 1 -- 172.21.15.120:0/1357937475 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65cc011a40 con 0x55caf08da410 2024-09-19T05:25:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.302+0000 7f65e2443640 1 --2- 172.21.15.120:0/932532015 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f65c80a34e0 0x7f65c80a59a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f65d4005e30 tx=0x7f65d4005d80 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.302+0000 7f65e6c38740 1 -- 172.21.15.120:0/1357937475 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55caf08da410 msgr2=0x55caf08e4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.302+0000 7f65e6c38740 1 --2- 172.21.15.120:0/1357937475 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55caf08da410 0x55caf08e4770 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f65cc00bc30 tx=0x7f65cc0107a0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.303+0000 7f65e6c38740 1 -- 172.21.15.120:0/1357937475 shutdown_connections 2024-09-19T05:25:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.303+0000 7f65e6c38740 1 --2- 172.21.15.120:0/1357937475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55caf08e4cb0 0x55caf08e70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.303+0000 7f65e6c38740 1 --2- 172.21.15.120:0/1357937475 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55caf08da410 0x55caf08e4770 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.308 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.303+0000 7f65e6c38740 1 --2- 172.21.15.120:0/1357937475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55caf08d9af0 0x55caf08d9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.303+0000 7f65e6c38740 1 -- 172.21.15.120:0/1357937475 >> 172.21.15.120:0/1357937475 conn(0x55caf08d6060 msgr2=0x55caf08d6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.303+0000 7f65e6c38740 1 -- 172.21.15.120:0/1357937475 shutdown_connections 2024-09-19T05:25:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.303+0000 7f65e6c38740 1 -- 172.21.15.120:0/1357937475 wait complete. 2024-09-19T05:25:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.303+0000 7f65e6c38740 1 -- start start 2024-09-19T05:25:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.303+0000 7f65e6c38740 1 Processor -- start 2024-09-19T05:25:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.304+0000 7f65e6c38740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55caf08d9af0 0x55caf08e1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.304+0000 7f65e6c38740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55caf08da410 0x55caf08e2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.304+0000 7f65e1c42640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55caf08d9af0 0x55caf08e1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.304+0000 7f65e1c42640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55caf08d9af0 0x55caf08e1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:34392/0 (socket says 172.21.15.120:34392) 2024-09-19T05:25:31.309 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.304+0000 7f65e6c38740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55caf08e4cb0 0x55caf08e2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.304+0000 7f65e1c42640 1 -- 172.21.15.120:0/1111616951 learned_addr learned my addr 172.21.15.120:0/1111616951 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:25:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.304+0000 7f65e6c38740 1 -- 172.21.15.120:0/1111616951 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55caf08e7880 con 0x55caf08d9af0 2024-09-19T05:25:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.304+0000 7f65e6c38740 1 -- 172.21.15.120:0/1111616951 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55caf07c7290 con 0x55caf08da410 2024-09-19T05:25:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.304+0000 7f65e6c38740 1 -- 172.21.15.120:0/1111616951 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55caf08e7a00 con 0x55caf08e4cb0 2024-09-19T05:25:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.304+0000 7f65e1441640 1 --2- 172.21.15.120:0/1111616951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55caf08da410 0x55caf08e2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.304+0000 7f65e2443640 1 --2- 172.21.15.120:0/1111616951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55caf08e4cb0 0x55caf08e2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.304+0000 7f65e6c38740 10 client.0 _ll_register_callbacks cb 0x55caf07f8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:25:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.305+0000 7f65e1c42640 1 -- 172.21.15.120:0/1111616951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55caf08e4cb0 msgr2=0x55caf08e2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.305+0000 7f65e1c42640 1 --2- 172.21.15.120:0/1111616951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55caf08e4cb0 0x55caf08e2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.305+0000 7f65e1c42640 1 -- 172.21.15.120:0/1111616951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55caf08da410 msgr2=0x55caf08e2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:31.310 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.305+0000 7f65e1c42640 1 --2- 172.21.15.120:0/1111616951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55caf08da410 0x55caf08e2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.305+0000 7f65e1c42640 1 -- 172.21.15.120:0/1111616951 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55caf0551210 con 0x55caf08d9af0 2024-09-19T05:25:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.305+0000 7f65e1441640 1 --2- 172.21.15.120:0/1111616951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55caf08da410 0x55caf08e2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:25:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.305+0000 7f65e1c42640 1 --2- 172.21.15.120:0/1111616951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55caf08d9af0 0x55caf08e1bf0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f65d80990b0 tx=0x7f65d80106f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cfe234e0d88d697 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.305+0000 7f65c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:25:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.305+0000 7f65c57fa640 1 -- 172.21.15.120:0/1111616951 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d80a4f90 con 0x55caf08d9af0 2024-09-19T05:25:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.305+0000 7f65e6c38740 1 -- 172.21.15.120:0/1111616951 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65cc01cad0 con 0x55caf08d9af0 2024-09-19T05:25:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.305+0000 7f65c57fa640 1 -- 172.21.15.120:0/1111616951 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f65d8083830 con 0x55caf08d9af0 2024-09-19T05:25:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.306+0000 7f65c57fa640 1 -- 172.21.15.120:0/1111616951 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f65d80cda10 con 0x55caf08d9af0 2024-09-19T05:25:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.306+0000 7f65e6c38740 10 client.16236 fetch_fsmap learned FSMap version 29 2024-09-19T05:25:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.306+0000 7f65e6c38740 1 -- 172.21.15.120:0/1111616951 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55caf061d620 con 0x55caf08d9af0 2024-09-19T05:25:31.311 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.306+0000 7f65c57fa640 1 -- 172.21.15.120:0/1111616951 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f65d80cdbb0 con 0x55caf08d9af0 2024-09-19T05:25:31.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.306+0000 7f65c57fa640 1 -- 172.21.15.120:0/1111616951 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f65d80a00c0 con 0x55caf08d9af0 2024-09-19T05:25:31.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.306+0000 7f65e6c38740 10 client.16236 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:25:31.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.306+0000 7f65e6c38740 10 client.16236 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:25:31.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.306+0000 7f65e6c38740 20 client.16236 populate_metadata read hostname 'smithi120' 2024-09-19T05:25:31.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.306+0000 7f65e6c38740 1 --2- 172.21.15.120:0/1111616951 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55caf08f50b0 0x55caf08f7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:31.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.306+0000 7f65e6c38740 4 client.16236 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:25:31.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.306+0000 7f65e6c38740 1 -- 172.21.15.120:0/1111616951 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f65cc01cad0 con 0x55caf08f50b0 2024-09-19T05:25:31.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.306+0000 7f65e1441640 1 --2- 172.21.15.120:0/1111616951 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55caf08f50b0 0x55caf08f7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:31.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.307+0000 7f65e1441640 1 --2- 172.21.15.120:0/1111616951 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55caf08f50b0 0x55caf08f7530 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ee59069e7446b2c server_cookie=3ab053aa31c92e49 in_seq=0 out_seq=0 2024-09-19T05:25:31.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.307+0000 7f65c57fa640 10 client.16236 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:25:31.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.308+0000 7f65c57fa640 1 -- 172.21.15.120:0/1111616951 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f65cc01cad0 con 0x55caf08f50b0 2024-09-19T05:25:31.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.308+0000 7f65c57fa640 10 client.16236 handle_command_reply: tid=0 2024-09-19T05:25:31.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.308+0000 7f65e6c38740 1 client.16236 shutdown 2024-09-19T05:25:31.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.308+0000 7f65e6c38740 1 -- 172.21.15.120:0/1111616951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55caf08d9af0 msgr2=0x55caf08e1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:31.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.308+0000 7f65e6c38740 1 --2- 172.21.15.120:0/1111616951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55caf08d9af0 0x55caf08e1bf0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f65d80990b0 tx=0x7f65d80106f0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.308+0000 7f65e6c38740 1 -- 172.21.15.120:0/1111616951 shutdown_connections 2024-09-19T05:25:31.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.308+0000 7f65e6c38740 1 --2- 172.21.15.120:0/1111616951 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55caf08f50b0 0x55caf08f7530 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.308+0000 7f65e6c38740 1 --2- 172.21.15.120:0/1111616951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55caf08e4cb0 0x55caf08e2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.308+0000 7f65e6c38740 1 --2- 172.21.15.120:0/1111616951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55caf08da410 0x55caf08e2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.308+0000 7f65e6c38740 1 --2- 172.21.15.120:0/1111616951 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55caf08d9af0 0x55caf08e1bf0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.308+0000 7f65e6c38740 1 -- 172.21.15.120:0/1111616951 >> 172.21.15.120:0/1111616951 conn(0x55caf08d6060 msgr2=0x55caf08dbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.308+0000 7f65c57fa640 0 client.16236 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:25:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.309+0000 7f65e6c38740 1 -- 172.21.15.120:0/1111616951 shutdown_connections 2024-09-19T05:25:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.309+0000 7f65e6c38740 1 -- 172.21.15.120:0/1111616951 wait complete. 2024-09-19T05:25:31.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.309+0000 7f65e6c38740 20 client.16236 trim_cache size 0 max 16384 2024-09-19T05:25:31.334 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.332+0000 7f65e6c38740 1 Processor -- start 2024-09-19T05:25:31.334 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.332+0000 7f65e6c38740 1 -- start start 2024-09-19T05:25:31.334 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.332+0000 7f65e6c38740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55caf08d9af0 0x55caf08dc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.332+0000 7f65e6c38740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55caf08da410 0x55caf08e24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.332+0000 7f65e6c38740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55caf08e4cb0 0x55caf08e3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.332+0000 7f65e6c38740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc1b6840 con 0x55caf08da410 2024-09-19T05:25:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.332+0000 7f65e6c38740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc1b4110 con 0x55caf08e4cb0 2024-09-19T05:25:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.332+0000 7f65e6c38740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc1b1f60 con 0x55caf08d9af0 2024-09-19T05:25:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.332+0000 7f65e1c42640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55caf08d9af0 0x55caf08dc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.332+0000 7f65e1c42640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55caf08d9af0 0x55caf08dc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:48384/0 (socket says 172.21.15.120:48384) 2024-09-19T05:25:31.335 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.332+0000 7f65e1c42640 1 -- 172.21.15.120:0/3521419760 learned_addr learned my addr 172.21.15.120:0/3521419760 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:25:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.333+0000 7f65e2443640 1 --2- 172.21.15.120:0/3521419760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55caf08e4cb0 0x55caf08e3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.333+0000 7f65e1441640 1 --2- 172.21.15.120:0/3521419760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55caf08da410 0x55caf08e24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.333+0000 7f65e1c42640 1 -- 172.21.15.120:0/3521419760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55caf08e4cb0 msgr2=0x55caf08e3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.333+0000 7f65e1c42640 1 --2- 172.21.15.120:0/3521419760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55caf08e4cb0 0x55caf08e3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.333+0000 7f65e1c42640 1 -- 172.21.15.120:0/3521419760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55caf08da410 msgr2=0x55caf08e24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.333+0000 7f65e1c42640 1 --2- 172.21.15.120:0/3521419760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55caf08da410 0x55caf08e24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.333+0000 7f65e1c42640 1 -- 172.21.15.120:0/3521419760 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55caf08d9920 con 0x55caf08d9af0 2024-09-19T05:25:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.333+0000 7f65e1c42640 1 --2- 172.21.15.120:0/3521419760 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55caf08d9af0 0x55caf08dc560 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f65d8004740 tx=0x7f65d809c090 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a5e91cde3f4e906 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.333+0000 7f65c77fe640 1 -- 172.21.15.120:0/3521419760 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d80a4f90 con 0x55caf08d9af0 2024-09-19T05:25:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.333+0000 7f65c77fe640 1 -- 172.21.15.120:0/3521419760 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f65d80b9020 con 0x55caf08d9af0 2024-09-19T05:25:31.336 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.333+0000 7f65c77fe640 1 -- 172.21.15.120:0/3521419760 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d809c3b0 con 0x55caf08d9af0 2024-09-19T05:25:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.334+0000 7f65e6c38740 1 -- 172.21.15.120:0/3521419760 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55caf08d9af0 msgr2=0x55caf08dc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.334+0000 7f65e6c38740 1 --2- 172.21.15.120:0/3521419760 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55caf08d9af0 0x55caf08dc560 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f65d8004740 tx=0x7f65d809c090 comp rx=0 tx=0).stop 2024-09-19T05:25:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.334+0000 7f65e6c38740 1 -- 172.21.15.120:0/3521419760 shutdown_connections 2024-09-19T05:25:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.334+0000 7f65e6c38740 1 --2- 172.21.15.120:0/3521419760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55caf08e4cb0 0x55caf08e3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.334+0000 7f65e6c38740 1 --2- 172.21.15.120:0/3521419760 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55caf08da410 0x55caf08e24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.334+0000 7f65e6c38740 1 --2- 172.21.15.120:0/3521419760 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55caf08d9af0 0x55caf08dc560 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.334+0000 7f65e6c38740 1 -- 172.21.15.120:0/3521419760 >> 172.21.15.120:0/3521419760 conn(0x55caf08d6060 msgr2=0x55caf08e3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.335+0000 7f65e6c38740 1 -- 172.21.15.120:0/3521419760 shutdown_connections 2024-09-19T05:25:31.339 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.335+0000 7f65e6c38740 1 -- 172.21.15.120:0/3521419760 wait complete. 2024-09-19T05:25:31.340 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.335+0000 7f65e6c38740 1 -- start start 2024-09-19T05:25:31.340 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.335+0000 7f65e6c38740 1 Processor -- start 2024-09-19T05:25:31.340 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.336+0000 7f65e6c38740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55caf08d9af0 0x55caf08e8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:31.340 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.336+0000 7f65e6c38740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55caf08da410 0x55caf08e8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.336+0000 7f65e6c38740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55caf08e4cb0 0x55caf095de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.336+0000 7f65e6c38740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc1b25d0 con 0x55caf08e4cb0 2024-09-19T05:25:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.336+0000 7f65e6c38740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc1b3a40 con 0x55caf08da410 2024-09-19T05:25:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.336+0000 7f65e6c38740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc1b2ca0 con 0x55caf08d9af0 2024-09-19T05:25:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.336+0000 7f65e6c38740 10 client.0 _ll_register_callbacks cb 0x7f65d809c1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:25:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.336+0000 7f65e1c42640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55caf08d9af0 0x55caf08e8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.336+0000 7f65e1c42640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55caf08d9af0 0x55caf08e8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:48396/0 (socket says 172.21.15.120:48396) 2024-09-19T05:25:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.336+0000 7f65e1c42640 1 -- 172.21.15.120:0/10043252 learned_addr learned my addr 172.21.15.120:0/10043252 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:25:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.336+0000 7f65e1441640 1 --2- 172.21.15.120:0/10043252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55caf08da410 0x55caf08e8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.336+0000 7f65e2443640 1 --2- 172.21.15.120:0/10043252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55caf08e4cb0 0x55caf095de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:31.342 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.336+0000 7f65e1c42640 1 -- 172.21.15.120:0/10043252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55caf08da410 msgr2=0x55caf08e8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.336+0000 7f65e1c42640 1 --2- 172.21.15.120:0/10043252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55caf08da410 0x55caf08e8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.336+0000 7f65e1c42640 1 -- 172.21.15.120:0/10043252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55caf08e4cb0 msgr2=0x55caf095de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.336+0000 7f65e1c42640 1 --2- 172.21.15.120:0/10043252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55caf08e4cb0 0x55caf095de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.336+0000 7f65e1c42640 1 -- 172.21.15.120:0/10043252 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55caf08e4780 con 0x55caf08d9af0 2024-09-19T05:25:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.336+0000 7f65e2443640 1 --2- 172.21.15.120:0/10043252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55caf08e4cb0 0x55caf095de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:25:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.337+0000 7f65e1c42640 1 --2- 172.21.15.120:0/10043252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55caf08d9af0 0x55caf08e8210 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f65d8099010 tx=0x7f65d8086480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87ec94915a6b7be1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.337+0000 7f65c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:25:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.337+0000 7f65c57fa640 1 -- 172.21.15.120:0/10043252 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d80a1a60 con 0x55caf08d9af0 2024-09-19T05:25:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.337+0000 7f65c57fa640 1 -- 172.21.15.120:0/10043252 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f65d80cdbb0 con 0x55caf08d9af0 2024-09-19T05:25:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.337+0000 7f65e6c38740 1 -- 172.21.15.120:0/10043252 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65d80b9020 con 0x55caf08d9af0 2024-09-19T05:25:31.343 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.337+0000 7f65c57fa640 1 -- 172.21.15.120:0/10043252 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f65d80a1c00 con 0x55caf08d9af0 2024-09-19T05:25:31.344 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.337+0000 7f65e6c38740 10 client.25768 fetch_fsmap learned FSMap version 29 2024-09-19T05:25:31.344 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.337+0000 7f65e6c38740 1 -- 172.21.15.120:0/10043252 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55caf08e4780 con 0x55caf08d9af0 2024-09-19T05:25:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.337+0000 7f65c57fa640 1 -- 172.21.15.120:0/10043252 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f65d80b9020 con 0x55caf08d9af0 2024-09-19T05:25:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.338+0000 7f65c57fa640 1 -- 172.21.15.120:0/10043252 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f65d809c3b0 con 0x55caf08d9af0 2024-09-19T05:25:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.338+0000 7f65e6c38740 10 client.25768 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:25:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.338+0000 7f65e6c38740 10 client.25768 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:25:31.345 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.338+0000 7f65e6c38740 20 client.25768 populate_metadata read hostname 'smithi120' 2024-09-19T05:25:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.338+0000 7f65e6c38740 1 --2- 172.21.15.120:0/10043252 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55caf095f6b0 0x55caf0961ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.338+0000 7f65e6c38740 4 client.25768 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:25:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.338+0000 7f65e6c38740 1 -- 172.21.15.120:0/10043252 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55caf084ba20 con 0x55caf095f6b0 2024-09-19T05:25:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.338+0000 7f65e1441640 1 --2- 172.21.15.120:0/10043252 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55caf095f6b0 0x55caf0961ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.339+0000 7f65c57fa640 10 client.25768 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:25:31.346 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.339+0000 7f65e1441640 1 --2- 172.21.15.120:0/10043252 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55caf095f6b0 0x55caf0961ad0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=887986aa230c42ac server_cookie=839f1c73f78fe816 in_seq=0 out_seq=0 2024-09-19T05:25:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.526+0000 7f65c57fa640 1 -- 172.21.15.120:0/10043252 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55caf084ba20 con 0x55caf095f6b0 2024-09-19T05:25:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.526+0000 7f65c57fa640 10 client.25768 handle_command_reply: tid=0 2024-09-19T05:25:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.526+0000 7f65e6c38740 1 client.25768 shutdown 2024-09-19T05:25:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.526+0000 7f65e6c38740 1 -- 172.21.15.120:0/10043252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55caf08d9af0 msgr2=0x55caf08e8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.526+0000 7f65e6c38740 1 --2- 172.21.15.120:0/10043252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55caf08d9af0 0x55caf08e8210 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f65d8099010 tx=0x7f65d8086480 comp rx=0 tx=0).stop 2024-09-19T05:25:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.526+0000 7f65e6c38740 1 -- 172.21.15.120:0/10043252 shutdown_connections 2024-09-19T05:25:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.526+0000 7f65e6c38740 1 --2- 172.21.15.120:0/10043252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55caf08e4cb0 0x55caf095de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.526+0000 7f65e6c38740 1 --2- 172.21.15.120:0/10043252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55caf08da410 0x55caf08e8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.526+0000 7f65e6c38740 1 --2- 172.21.15.120:0/10043252 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55caf095f6b0 0x55caf0961ad0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.526+0000 7f65e6c38740 1 --2- 172.21.15.120:0/10043252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55caf08d9af0 0x55caf08e8210 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.526+0000 7f65e6c38740 1 -- 172.21.15.120:0/10043252 >> 172.21.15.120:0/10043252 conn(0x55caf08d6060 msgr2=0x55caf08e0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.526+0000 7f65c57fa640 0 client.25768 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:25:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.526+0000 7f65e6c38740 1 -- 172.21.15.120:0/10043252 shutdown_connections 2024-09-19T05:25:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.526+0000 7f65e6c38740 1 -- 172.21.15.120:0/10043252 wait complete. 2024-09-19T05:25:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.526+0000 7f65e6c38740 20 client.25768 trim_cache size 0 max 16384 2024-09-19T05:25:31.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:25:31.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:25:31.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:25:31.530 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:25:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.527+0000 7f65e3ea6640 1 -- 172.21.15.120:0/932532015 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f65c80a34e0 msgr2=0x7f65c80a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.528+0000 7f65e3ea6640 1 --2- 172.21.15.120:0/932532015 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f65c80a34e0 0x7f65c80a59a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f65d4005e30 tx=0x7f65d4005d80 comp rx=0 tx=0).stop 2024-09-19T05:25:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.528+0000 7f65e3ea6640 1 -- 172.21.15.120:0/932532015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65dc076720 msgr2=0x7f65dc1a45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:31.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.528+0000 7f65e3ea6640 1 --2- 172.21.15.120:0/932532015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65dc076720 0x7f65dc1a45e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f65d800e9f0 tx=0x7f65d800eeb0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.528+0000 7f65e3ea6640 1 -- 172.21.15.120:0/932532015 shutdown_connections 2024-09-19T05:25:31.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.528+0000 7f65e3ea6640 1 --2- 172.21.15.120:0/932532015 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f65c80a34e0 0x7f65c80a59a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.528+0000 7f65e3ea6640 1 --2- 172.21.15.120:0/932532015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65dc112970 0x7f65dc19e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.528+0000 7f65e3ea6640 1 --2- 172.21.15.120:0/932532015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65dc077040 0x7f65dc1a4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.528+0000 7f65e3ea6640 1 --2- 172.21.15.120:0/932532015 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f65dc076720 0x7f65dc1a45e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:31.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.528+0000 7f65e3ea6640 1 -- 172.21.15.120:0/932532015 >> 172.21.15.120:0/932532015 conn(0x7f65dc0ff9b0 msgr2=0x7f65dc101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:31.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.528+0000 7f65e3ea6640 1 -- 172.21.15.120:0/932532015 shutdown_connections 2024-09-19T05:25:31.532 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:31.529+0000 7f65e3ea6640 1 -- 172.21.15.120:0/932532015 wait complete. 2024-09-19T05:25:31.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:31 smithi120 ceph-mon[30956]: pgmap v191: 97 pgs: 97 active+clean; 516 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.5 MiB/s wr, 298 op/s 2024-09-19T05:25:31.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:31 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:25:31.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:31 smithi194 ceph-mon[35228]: pgmap v191: 97 pgs: 97 active+clean; 516 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.5 MiB/s wr, 298 op/s 2024-09-19T05:25:31.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:31 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:25:31.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:31 smithi178 ceph-mon[34347]: pgmap v191: 97 pgs: 97 active+clean; 516 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.5 MiB/s wr, 298 op/s 2024-09-19T05:25:31.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:31 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:25:32.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:32 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:25:32.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:32 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:25:32.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:32 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:25:32.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:32 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:25:32.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:32 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:25:32.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:32 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:25:32.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:32 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:25:32.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:32 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:25:32.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:32 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:25:33.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:33 smithi120 ceph-mon[30956]: pgmap v192: 97 pgs: 97 active+clean; 519 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 210 op/s 2024-09-19T05:25:33.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:33 smithi194 ceph-mon[35228]: pgmap v192: 97 pgs: 97 active+clean; 519 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 210 op/s 2024-09-19T05:25:33.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:33 smithi178 ceph-mon[34347]: pgmap v192: 97 pgs: 97 active+clean; 519 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.9 MiB/s wr, 210 op/s 2024-09-19T05:25:35.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:35 smithi120 ceph-mon[30956]: pgmap v193: 97 pgs: 97 active+clean; 519 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 157 op/s 2024-09-19T05:25:35.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:35 smithi194 ceph-mon[35228]: pgmap v193: 97 pgs: 97 active+clean; 519 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 157 op/s 2024-09-19T05:25:35.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:35 smithi178 ceph-mon[34347]: pgmap v193: 97 pgs: 97 active+clean; 519 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 157 op/s 2024-09-19T05:25:37.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:37 smithi120 ceph-mon[30956]: pgmap v194: 97 pgs: 97 active+clean; 511 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.7 MiB/s wr, 297 op/s 2024-09-19T05:25:37.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:37 smithi194 ceph-mon[35228]: pgmap v194: 97 pgs: 97 active+clean; 511 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.7 MiB/s wr, 297 op/s 2024-09-19T05:25:37.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:37 smithi178 ceph-mon[34347]: pgmap v194: 97 pgs: 97 active+clean; 511 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.7 MiB/s wr, 297 op/s 2024-09-19T05:25:38.315 INFO:tasks.workunit.client.0.smithi120.stdout: 100 12730 105 8104 137 4033 126 2024-09-19T05:25:39.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:39 smithi120 ceph-mon[30956]: pgmap v195: 97 pgs: 97 active+clean; 511 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.6 MiB/s wr, 206 op/s 2024-09-19T05:25:39.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:39 smithi194 ceph-mon[35228]: pgmap v195: 97 pgs: 97 active+clean; 511 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.6 MiB/s wr, 206 op/s 2024-09-19T05:25:39.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:39 smithi178 ceph-mon[34347]: pgmap v195: 97 pgs: 97 active+clean; 511 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.6 MiB/s wr, 206 op/s 2024-09-19T05:25:41.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:41 smithi120 ceph-mon[30956]: pgmap v196: 97 pgs: 97 active+clean; 522 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.5 MiB/s wr, 374 op/s 2024-09-19T05:25:41.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:41 smithi194 ceph-mon[35228]: pgmap v196: 97 pgs: 97 active+clean; 522 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.5 MiB/s wr, 374 op/s 2024-09-19T05:25:41.911 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T05:25:41.911 INFO:tasks.workunit.client.0.smithi120.stdout:Final score for writes: 100 2024-09-19T05:25:41.911 INFO:tasks.workunit.client.0.smithi120.stdout:Final score for reads : 8407 2024-09-19T05:25:41.911 INFO:tasks.workunit.client.0.smithi120.stdout: 2024-09-19T05:25:41.912 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T05:25:41.913 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T05:25:41.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:41 smithi178 ceph-mon[34347]: pgmap v196: 97 pgs: 97 active+clean; 522 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.5 MiB/s wr, 374 op/s 2024-09-19T05:25:43.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:43 smithi120 ceph-mon[30956]: pgmap v197: 97 pgs: 97 active+clean; 528 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 408 op/s 2024-09-19T05:25:43.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:43 smithi194 ceph-mon[35228]: pgmap v197: 97 pgs: 97 active+clean; 528 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 408 op/s 2024-09-19T05:25:43.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:43 smithi178 ceph-mon[34347]: pgmap v197: 97 pgs: 97 active+clean; 528 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.1 MiB/s wr, 408 op/s 2024-09-19T05:25:44.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.644+0000 7f29bf7e4640 1 -- 172.21.15.120:0/1111248100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29b81095d0 msgr2=0x7f29b8109a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:44.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.644+0000 7f29bf7e4640 1 --2- 172.21.15.120:0/1111248100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29b81095d0 0x7f29b8109a10 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f29a8009900 tx=0x7f29a802a410 comp rx=0 tx=0).stop 2024-09-19T05:25:44.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.644+0000 7f29bf7e4640 1 -- 172.21.15.120:0/1111248100 shutdown_connections 2024-09-19T05:25:44.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.644+0000 7f29bf7e4640 1 --2- 172.21.15.120:0/1111248100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29b811b140 0x7f29b811d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.648 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.644+0000 7f29bf7e4640 1 --2- 172.21.15.120:0/1111248100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29b81095d0 0x7f29b8109a10 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.644+0000 7f29bf7e4640 1 --2- 172.21.15.120:0/1111248100 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29b81091f0 0x7f29b8110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.644+0000 7f29bf7e4640 1 -- 172.21.15.120:0/1111248100 >> 172.21.15.120:0/1111248100 conn(0x7f29b806ce00 msgr2=0x7f29b806d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:44.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.645+0000 7f29bf7e4640 1 -- 172.21.15.120:0/1111248100 shutdown_connections 2024-09-19T05:25:44.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.645+0000 7f29bf7e4640 1 -- 172.21.15.120:0/1111248100 wait complete. 2024-09-19T05:25:44.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.646+0000 7f29bf7e4640 1 Processor -- start 2024-09-19T05:25:44.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.647+0000 7f29bf7e4640 1 -- start start 2024-09-19T05:25:44.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.647+0000 7f29bf7e4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29b81091f0 0x7f29b81a7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:44.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.647+0000 7f29bf7e4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29b811b140 0x7f29b81a7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:44.653 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.647+0000 7f29bf7e4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29b81abac0 0x7f29b81abf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:44.654 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.647+0000 7f29bf7e4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f29b8120b50 con 0x7f29b811b140 2024-09-19T05:25:44.654 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.647+0000 7f29bf7e4640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f29b81209d0 con 0x7f29b81091f0 2024-09-19T05:25:44.654 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.647+0000 7f29bf7e4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f29b8120cd0 con 0x7f29b81abac0 2024-09-19T05:25:44.654 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.647+0000 7f29bd580640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29b81091f0 0x7f29b81a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:44.654 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.647+0000 7f29bd580640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29b81091f0 0x7f29b81a7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:40022/0 (socket says 172.21.15.120:40022) 2024-09-19T05:25:44.654 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.647+0000 7f29bd580640 1 -- 172.21.15.120:0/217559858 learned_addr learned my addr 172.21.15.120:0/217559858 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:25:44.655 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.647+0000 7f29bcd7f640 1 --2- 172.21.15.120:0/217559858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29b811b140 0x7f29b81a7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:44.655 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.648+0000 7f29bd580640 1 -- 172.21.15.120:0/217559858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29b81abac0 msgr2=0x7f29b81abf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:44.655 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.648+0000 7f29bd580640 1 --2- 172.21.15.120:0/217559858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29b81abac0 0x7f29b81abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.655 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.648+0000 7f29bd580640 1 -- 172.21.15.120:0/217559858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29b811b140 msgr2=0x7f29b81a7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:44.655 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.648+0000 7f29bd580640 1 --2- 172.21.15.120:0/217559858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29b811b140 0x7f29b81a7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.656 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.648+0000 7f29bd580640 1 -- 172.21.15.120:0/217559858 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b81ac5b0 con 0x7f29b81091f0 2024-09-19T05:25:44.656 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.648+0000 7f29bd580640 1 --2- 172.21.15.120:0/217559858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29b81091f0 0x7f29b81a7200 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f29b400d950 tx=0x7f29b400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:44.656 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.648+0000 7f29ae7fc640 1 -- 172.21.15.120:0/217559858 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b4017070 con 0x7f29b81091f0 2024-09-19T05:25:44.656 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.648+0000 7f29bf7e4640 1 -- 172.21.15.120:0/217559858 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b81ac8a0 con 0x7f29b81091f0 2024-09-19T05:25:44.656 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.648+0000 7f29ae7fc640 1 -- 172.21.15.120:0/217559858 <== mon.2 v2:172.21.15.178:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f29b4009c30 con 0x7f29b81091f0 2024-09-19T05:25:44.656 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.648+0000 7f29ae7fc640 1 -- 172.21.15.120:0/217559858 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b400f620 con 0x7f29b81091f0 2024-09-19T05:25:44.657 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.648+0000 7f29bf7e4640 1 -- 172.21.15.120:0/217559858 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b81b40b0 con 0x7f29b81091f0 2024-09-19T05:25:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.652+0000 7f29c2658740 1 Processor -- start 2024-09-19T05:25:44.667 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.653+0000 7f29c2658740 1 -- start start 2024-09-19T05:25:44.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.653+0000 7f29c2658740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5643eff56af0 0x5643eff56ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:44.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.653+0000 7f29c2658740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5643eff57410 0x5643eff61770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:44.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.653+0000 7f29c2658740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643eff61cb0 0x5643eff640a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:44.668 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.653+0000 7f29c2658740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5643efebb2f0 con 0x5643eff57410 2024-09-19T05:25:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.653+0000 7f29c2658740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5643efe63270 con 0x5643eff61cb0 2024-09-19T05:25:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.653+0000 7f29c2658740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5643efeb72b0 con 0x5643eff56af0 2024-09-19T05:25:44.669 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.653+0000 7f29ae7fc640 1 -- 172.21.15.120:0/217559858 <== mon.2 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f29b40109a0 con 0x7f29b81091f0 2024-09-19T05:25:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.654+0000 7f29bdd81640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5643eff56af0 0x5643eff56ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.654+0000 7f29bdd81640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5643eff56af0 0x5643eff56ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:46210/0 (socket says 172.21.15.120:46210) 2024-09-19T05:25:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.654+0000 7f29bd580640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5643eff57410 0x5643eff61770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.654+0000 7f29bdd81640 1 -- 172.21.15.120:0/2394785063 learned_addr learned my addr 172.21.15.120:0/2394785063 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:25:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.654+0000 7f29bdd81640 1 -- 172.21.15.120:0/2394785063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643eff61cb0 msgr2=0x5643eff640a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:44.670 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.654+0000 7f29bdd81640 1 --2- 172.21.15.120:0/2394785063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643eff61cb0 0x5643eff640a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.654+0000 7f29bdd81640 1 -- 172.21.15.120:0/2394785063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5643eff57410 msgr2=0x5643eff61770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:44.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.654+0000 7f29bdd81640 1 --2- 172.21.15.120:0/2394785063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5643eff57410 0x5643eff61770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.654+0000 7f29bdd81640 1 -- 172.21.15.120:0/2394785063 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643efe62340 con 0x5643eff56af0 2024-09-19T05:25:44.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.654+0000 7f29bdd81640 1 --2- 172.21.15.120:0/2394785063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5643eff56af0 0x5643eff56ed0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f29b0009ea0 tx=0x7f29b0009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73841721fc06d490 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:44.671 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.655+0000 7f29a37fe640 1 -- 172.21.15.120:0/2394785063 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b0004d20 con 0x5643eff56af0 2024-09-19T05:25:44.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.655+0000 7f29a37fe640 1 -- 172.21.15.120:0/2394785063 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f29b000ee60 con 0x5643eff56af0 2024-09-19T05:25:44.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.655+0000 7f29ae7fc640 1 --2- 172.21.15.120:0/217559858 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f29a40a3560 0x7f29a40a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:44.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.655+0000 7f29ae7fc640 1 -- 172.21.15.120:0/217559858 <== mon.2 v2:172.21.15.178:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f29b40cf990 con 0x7f29b81091f0 2024-09-19T05:25:44.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.656+0000 7f29bd580640 1 --2- 172.21.15.120:0/217559858 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f29a40a3560 0x7f29a40a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:44.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.656+0000 7f29a37fe640 1 -- 172.21.15.120:0/2394785063 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b0010850 con 0x5643eff56af0 2024-09-19T05:25:44.672 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.656+0000 7f29c2658740 1 -- 172.21.15.120:0/2394785063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5643eff56af0 msgr2=0x5643eff56ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.656+0000 7f29c2658740 1 --2- 172.21.15.120:0/2394785063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5643eff56af0 0x5643eff56ed0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f29b0009ea0 tx=0x7f29b0009f90 comp rx=0 tx=0).stop 2024-09-19T05:25:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.656+0000 7f29bd580640 1 --2- 172.21.15.120:0/217559858 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f29a40a3560 0x7f29a40a5a20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x5643eff53ec0 tx=0x7f29b40d5530 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.656+0000 7f29c2658740 1 -- 172.21.15.120:0/2394785063 shutdown_connections 2024-09-19T05:25:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.657+0000 7f29c2658740 1 --2- 172.21.15.120:0/2394785063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643eff61cb0 0x5643eff640a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.673 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.657+0000 7f29c2658740 1 --2- 172.21.15.120:0/2394785063 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5643eff57410 0x5643eff61770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.657+0000 7f29c2658740 1 --2- 172.21.15.120:0/2394785063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5643eff56af0 0x5643eff56ed0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.657+0000 7f29c2658740 1 -- 172.21.15.120:0/2394785063 >> 172.21.15.120:0/2394785063 conn(0x5643eff53060 msgr2=0x5643eff53440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:44.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.657+0000 7f29c2658740 1 -- 172.21.15.120:0/2394785063 shutdown_connections 2024-09-19T05:25:44.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.657+0000 7f29c2658740 1 -- 172.21.15.120:0/2394785063 wait complete. 2024-09-19T05:25:44.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.658+0000 7f29c2658740 1 -- start start 2024-09-19T05:25:44.674 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.658+0000 7f29c2658740 1 Processor -- start 2024-09-19T05:25:44.675 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.659+0000 7f29c2658740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5643eff56af0 0x5643eff5eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:44.675 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.659+0000 7f29c2658740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643eff57410 0x5643eff5f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:44.675 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.659+0000 7f29c2658740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5643eff61cb0 0x5643eff5f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:44.675 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.659+0000 7f29bdd81640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5643eff56af0 0x5643eff5eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:44.675 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.659+0000 7f29c2658740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5643eff64920 con 0x5643eff61cb0 2024-09-19T05:25:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.659+0000 7f29c2658740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5643efe44290 con 0x5643eff57410 2024-09-19T05:25:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.659+0000 7f29c2658740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5643eff64aa0 con 0x5643eff56af0 2024-09-19T05:25:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.659+0000 7f29bdd81640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5643eff56af0 0x5643eff5eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:46226/0 (socket says 172.21.15.120:46226) 2024-09-19T05:25:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.659+0000 7f29bdd81640 1 -- 172.21.15.120:0/3446190064 learned_addr learned my addr 172.21.15.120:0/3446190064 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:25:44.676 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.659+0000 7f29bdd81640 1 --2- 172.21.15.120:0/3446190064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5643eff61cb0 0x5643eff5f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.659+0000 7f29c2658740 10 client.0 _ll_register_callbacks cb 0x5643efe75140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:25:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.660+0000 7f29bdd81640 1 -- 172.21.15.120:0/3446190064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5643eff56af0 msgr2=0x5643eff5eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:44.677 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.660+0000 7f29bdd81640 1 --2- 172.21.15.120:0/3446190064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5643eff56af0 0x5643eff5eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.660+0000 7f29bdd81640 1 -- 172.21.15.120:0/3446190064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643eff57410 msgr2=0x5643eff5f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.660+0000 7f29bdd81640 1 --2- 172.21.15.120:0/3446190064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643eff57410 0x5643eff5f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.660+0000 7f29bdd81640 1 -- 172.21.15.120:0/3446190064 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643efbce210 con 0x5643eff61cb0 2024-09-19T05:25:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.660+0000 7f29c2658740 1 -- 172.21.15.120:0/3446190064 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29b000ee60 con 0x5643eff61cb0 2024-09-19T05:25:44.678 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.660+0000 7f29bdd81640 1 --2- 172.21.15.120:0/3446190064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5643eff61cb0 0x5643eff5f570 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f29b0011ed0 tx=0x7f29b0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef7904f826d129 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.660+0000 7f29a0ff9640 10 client.16254 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:25:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.661+0000 7f29a0ff9640 1 -- 172.21.15.120:0/3446190064 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b0003970 con 0x5643eff61cb0 2024-09-19T05:25:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.661+0000 7f29a0ff9640 1 -- 172.21.15.120:0/3446190064 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f29b0003b10 con 0x5643eff61cb0 2024-09-19T05:25:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.661+0000 7f29a0ff9640 1 -- 172.21.15.120:0/3446190064 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f29b0003d50 con 0x5643eff61cb0 2024-09-19T05:25:44.679 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.661+0000 7f29c2658740 10 client.16254 fetch_fsmap learned FSMap version 29 2024-09-19T05:25:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.661+0000 7f29c2658740 1 -- 172.21.15.120:0/3446190064 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({fsmap=29}) -- 0x5643efc9a620 con 0x5643eff61cb0 2024-09-19T05:25:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.662+0000 7f29a0ff9640 1 -- 172.21.15.120:0/3446190064 <== mon.0 v2:172.21.15.120:3300/0 4 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f29b0019880 con 0x5643eff61cb0 2024-09-19T05:25:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.662+0000 7f29c2658740 10 client.16254 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:25:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.662+0000 7f29c2658740 10 client.16254 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:25:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.662+0000 7f29c2658740 20 client.16254 populate_metadata read hostname 'smithi120' 2024-09-19T05:25:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.662+0000 7f29c2658740 1 --2- 172.21.15.120:0/3446190064 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5643eff719d0 0x5643eff73dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.662+0000 7f29c2658740 4 client.16254 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:25:44.680 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.662+0000 7f29c2658740 1 -- 172.21.15.120:0/3446190064 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643efec8a20 con 0x5643eff719d0 2024-09-19T05:25:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.663+0000 7f29bcd7f640 1 --2- 172.21.15.120:0/3446190064 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5643eff719d0 0x5643eff73dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.664+0000 7f29a0ff9640 10 client.16254 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:25:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.664+0000 7f29bcd7f640 1 --2- 172.21.15.120:0/3446190064 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5643eff719d0 0x5643eff73dc0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=929b07623599ebe6 server_cookie=5e01fdd6317948f in_seq=0 out_seq=0 2024-09-19T05:25:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.665+0000 7f29a0ff9640 1 -- 172.21.15.120:0/3446190064 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5643efec8a20 con 0x5643eff719d0 2024-09-19T05:25:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.665+0000 7f29a0ff9640 10 client.16254 handle_command_reply: tid=0 2024-09-19T05:25:44.681 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.665+0000 7f29c2658740 1 client.16254 shutdown 2024-09-19T05:25:44.682 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.666+0000 7f29c2658740 1 -- 172.21.15.120:0/3446190064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5643eff61cb0 msgr2=0x5643eff5f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:44.682 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.666+0000 7f29c2658740 1 --2- 172.21.15.120:0/3446190064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5643eff61cb0 0x5643eff5f570 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f29b0011ed0 tx=0x7f29b0005fd0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.682 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.666+0000 7f29c2658740 1 -- 172.21.15.120:0/3446190064 shutdown_connections 2024-09-19T05:25:44.682 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.666+0000 7f29c2658740 1 --2- 172.21.15.120:0/3446190064 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5643eff61cb0 0x5643eff5f570 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.682 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.666+0000 7f29c2658740 1 --2- 172.21.15.120:0/3446190064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643eff57410 0x5643eff5f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.682 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.666+0000 7f29c2658740 1 --2- 172.21.15.120:0/3446190064 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5643eff719d0 0x5643eff73dc0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.682 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.666+0000 7f29a0ff9640 0 client.16254 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:25:44.682 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.666+0000 7f29c2658740 1 --2- 172.21.15.120:0/3446190064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5643eff56af0 0x5643eff5eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.682 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.666+0000 7f29c2658740 1 -- 172.21.15.120:0/3446190064 >> 172.21.15.120:0/3446190064 conn(0x5643eff53060 msgr2=0x5643eff58d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:44.682 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.667+0000 7f29c2658740 1 -- 172.21.15.120:0/3446190064 shutdown_connections 2024-09-19T05:25:44.682 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.667+0000 7f29c2658740 1 -- 172.21.15.120:0/3446190064 wait complete. 2024-09-19T05:25:44.683 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.667+0000 7f29c2658740 20 client.16254 trim_cache size 0 max 16384 2024-09-19T05:25:44.697 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.694+0000 7f29c2658740 1 Processor -- start 2024-09-19T05:25:44.698 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.694+0000 7f29c2658740 1 -- start start 2024-09-19T05:25:44.698 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.694+0000 7f29c2658740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5643eff56af0 0x5643eff59560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:44.698 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.694+0000 7f29c2658740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643eff57410 0x5643eff5f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:44.698 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.694+0000 7f29c2658740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5643eff61cb0 0x5643eff79420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:44.698 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.694+0000 7f29c2658740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f29b81bf5e0 con 0x5643eff61cb0 2024-09-19T05:25:44.698 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.695+0000 7f29c2658740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f29b81bceb0 con 0x5643eff57410 2024-09-19T05:25:44.698 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.695+0000 7f29c2658740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f29b81bad00 con 0x5643eff56af0 2024-09-19T05:25:44.698 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.695+0000 7f29bcd7f640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643eff57410 0x5643eff5f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:44.698 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.695+0000 7f29bdd81640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5643eff56af0 0x5643eff59560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:44.698 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.695+0000 7f29bdd81640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5643eff56af0 0x5643eff59560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:46240/0 (socket says 172.21.15.120:46240) 2024-09-19T05:25:44.698 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.695+0000 7f29bdd81640 1 -- 172.21.15.120:0/2979045613 learned_addr learned my addr 172.21.15.120:0/2979045613 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:25:44.698 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.695+0000 7f29bdd81640 1 --2- 172.21.15.120:0/2979045613 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5643eff61cb0 0x5643eff79420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.696+0000 7f29bdd81640 1 -- 172.21.15.120:0/2979045613 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643eff57410 msgr2=0x5643eff5f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.696+0000 7f29bdd81640 1 --2- 172.21.15.120:0/2979045613 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643eff57410 0x5643eff5f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.696+0000 7f29bdd81640 1 -- 172.21.15.120:0/2979045613 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5643eff61cb0 msgr2=0x5643eff79420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.696+0000 7f29bdd81640 1 --2- 172.21.15.120:0/2979045613 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5643eff61cb0 0x5643eff79420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.696+0000 7f29bdd81640 1 -- 172.21.15.120:0/2979045613 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643eff52e90 con 0x5643eff56af0 2024-09-19T05:25:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.696+0000 7f29bdd81640 1 --2- 172.21.15.120:0/2979045613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5643eff56af0 0x5643eff59560 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f29b000ebb0 tx=0x7f29b001d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=795ae16b15a0aea7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.697+0000 7f29a2ffd640 1 -- 172.21.15.120:0/2979045613 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b0011d30 con 0x5643eff56af0 2024-09-19T05:25:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.697+0000 7f29a2ffd640 1 -- 172.21.15.120:0/2979045613 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f29b000ee60 con 0x5643eff56af0 2024-09-19T05:25:44.700 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.697+0000 7f29a2ffd640 1 -- 172.21.15.120:0/2979045613 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b00113a0 con 0x5643eff56af0 2024-09-19T05:25:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.698+0000 7f29c2658740 1 -- 172.21.15.120:0/2979045613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5643eff56af0 msgr2=0x5643eff59560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.698+0000 7f29c2658740 1 --2- 172.21.15.120:0/2979045613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5643eff56af0 0x5643eff59560 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f29b000ebb0 tx=0x7f29b001d000 comp rx=0 tx=0).stop 2024-09-19T05:25:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.698+0000 7f29c2658740 1 -- 172.21.15.120:0/2979045613 shutdown_connections 2024-09-19T05:25:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.698+0000 7f29c2658740 1 --2- 172.21.15.120:0/2979045613 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5643eff61cb0 0x5643eff79420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.698+0000 7f29c2658740 1 --2- 172.21.15.120:0/2979045613 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643eff57410 0x5643eff5f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.698+0000 7f29c2658740 1 --2- 172.21.15.120:0/2979045613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5643eff56af0 0x5643eff59560 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.698+0000 7f29c2658740 1 -- 172.21.15.120:0/2979045613 >> 172.21.15.120:0/2979045613 conn(0x5643eff53060 msgr2=0x5643eff60b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.698+0000 7f29c2658740 1 -- 172.21.15.120:0/2979045613 shutdown_connections 2024-09-19T05:25:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.698+0000 7f29c2658740 1 -- 172.21.15.120:0/2979045613 wait complete. 2024-09-19T05:25:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.699+0000 7f29c2658740 1 -- start start 2024-09-19T05:25:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.699+0000 7f29c2658740 1 Processor -- start 2024-09-19T05:25:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.699+0000 7f29c2658740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643eff56af0 0x5643eff65b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.700+0000 7f29c2658740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5643eff57410 0x5643eff660a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.700+0000 7f29c2658740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5643eff61cb0 0x5643eff665e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.700+0000 7f29bdd81640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643eff56af0 0x5643eff65b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.700+0000 7f29bdd81640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643eff56af0 0x5643eff65b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:40052/0 (socket says 172.21.15.120:40052) 2024-09-19T05:25:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.700+0000 7f29bdd81640 1 -- 172.21.15.120:0/3626052010 learned_addr learned my addr 172.21.15.120:0/3626052010 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:25:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.700+0000 7f29c2658740 1 -- 172.21.15.120:0/3626052010 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f29b81bb370 con 0x5643eff61cb0 2024-09-19T05:25:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.700+0000 7f29c2658740 1 -- 172.21.15.120:0/3626052010 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f29b81bc7e0 con 0x5643eff56af0 2024-09-19T05:25:44.704 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.700+0000 7f29c2658740 1 -- 172.21.15.120:0/3626052010 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f29b81bba40 con 0x5643eff57410 2024-09-19T05:25:44.704 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.700+0000 7f29bcd7f640 1 --2- 172.21.15.120:0/3626052010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5643eff57410 0x5643eff660a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:44.704 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.700+0000 7f29c2658740 10 client.0 _ll_register_callbacks cb 0x7f29b0009da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:25:44.704 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.700+0000 7f29bdd81640 1 --2- 172.21.15.120:0/3626052010 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5643eff61cb0 0x5643eff665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:44.704 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.700+0000 7f29bdd81640 1 -- 172.21.15.120:0/3626052010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5643eff57410 msgr2=0x5643eff660a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:44.704 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.700+0000 7f29bdd81640 1 --2- 172.21.15.120:0/3626052010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5643eff57410 0x5643eff660a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.704 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.700+0000 7f29bdd81640 1 -- 172.21.15.120:0/3626052010 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5643eff61cb0 msgr2=0x5643eff665e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:44.704 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.700+0000 7f29bdd81640 1 --2- 172.21.15.120:0/3626052010 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5643eff61cb0 0x5643eff665e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.704 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.700+0000 7f29bdd81640 1 -- 172.21.15.120:0/3626052010 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643effdb440 con 0x5643eff56af0 2024-09-19T05:25:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.701+0000 7f29bdd81640 1 --2- 172.21.15.120:0/3626052010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643eff56af0 0x5643eff65b60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f29b0003c70 tx=0x7f29b0032040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=501abd8856b8fbb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.701+0000 7f29a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-19T05:25:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.701+0000 7f29a0ff9640 1 -- 172.21.15.120:0/3626052010 <== mon.2 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29b0043030 con 0x5643eff56af0 2024-09-19T05:25:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.701+0000 7f29a0ff9640 1 -- 172.21.15.120:0/3626052010 <== mon.2 v2:172.21.15.178:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7f29b0011260 con 0x5643eff56af0 2024-09-19T05:25:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.701+0000 7f29c2658740 1 -- 172.21.15.120:0/3626052010 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29b000ee60 con 0x5643eff56af0 2024-09-19T05:25:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.701+0000 7f29a0ff9640 1 -- 172.21.15.120:0/3626052010 <== mon.2 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f29b004d050 con 0x5643eff56af0 2024-09-19T05:25:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.701+0000 7f29c2658740 10 client.25691 fetch_fsmap learned FSMap version 29 2024-09-19T05:25:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.701+0000 7f29c2658740 1 -- 172.21.15.120:0/3626052010 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5643effdc6f0 con 0x5643eff56af0 2024-09-19T05:25:44.707 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.702+0000 7f29a0ff9640 1 -- 172.21.15.120:0/3626052010 <== mon.2 v2:172.21.15.178:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f29b000ee60 con 0x5643eff56af0 2024-09-19T05:25:44.707 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.702+0000 7f29a0ff9640 1 -- 172.21.15.120:0/3626052010 <== mon.2 v2:172.21.15.178:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f29b0038040 con 0x5643eff56af0 2024-09-19T05:25:44.707 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.702+0000 7f29c2658740 10 client.25691 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T05:25:44.707 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.702+0000 7f29c2658740 10 client.25691 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:25:44.707 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.702+0000 7f29c2658740 20 client.25691 populate_metadata read hostname 'smithi120' 2024-09-19T05:25:44.707 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.702+0000 7f29c2658740 1 --2- 172.21.15.120:0/3626052010 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5643effdcda0 0x5643effdf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:44.707 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.702+0000 7f29c2658740 4 client.25691 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:25:44.707 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.702+0000 7f29c2658740 1 -- 172.21.15.120:0/3626052010 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5643efec2d70 con 0x5643effdcda0 2024-09-19T05:25:44.707 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.702+0000 7f29bcd7f640 1 --2- 172.21.15.120:0/3626052010 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5643effdcda0 0x5643effdf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:44.707 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.703+0000 7f29bcd7f640 1 --2- 172.21.15.120:0/3626052010 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5643effdcda0 0x5643effdf1c0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2575b16e0e02fd6 server_cookie=2c2adb0332768878 in_seq=0 out_seq=0 2024-09-19T05:25:44.707 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.704+0000 7f29a0ff9640 10 client.25691 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:25:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.864+0000 7f29a0ff9640 1 -- 172.21.15.120:0/3626052010 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5643efec2d70 con 0x5643effdcda0 2024-09-19T05:25:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.864+0000 7f29a0ff9640 10 client.25691 handle_command_reply: tid=0 2024-09-19T05:25:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.864+0000 7f29c2658740 1 client.25691 shutdown 2024-09-19T05:25:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.864+0000 7f29c2658740 1 -- 172.21.15.120:0/3626052010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643eff56af0 msgr2=0x5643eff65b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.865+0000 7f29c2658740 1 --2- 172.21.15.120:0/3626052010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643eff56af0 0x5643eff65b60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f29b0003c70 tx=0x7f29b0032040 comp rx=0 tx=0).stop 2024-09-19T05:25:44.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.865+0000 7f29c2658740 1 -- 172.21.15.120:0/3626052010 shutdown_connections 2024-09-19T05:25:44.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.865+0000 7f29c2658740 1 --2- 172.21.15.120:0/3626052010 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5643eff61cb0 0x5643eff665e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.865+0000 7f29c2658740 1 --2- 172.21.15.120:0/3626052010 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5643effdcda0 0x5643effdf1c0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.865+0000 7f29c2658740 1 --2- 172.21.15.120:0/3626052010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5643eff57410 0x5643eff660a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.868 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.865+0000 7f29a0ff9640 0 client.25691 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:25:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.866+0000 7f29c2658740 1 --2- 172.21.15.120:0/3626052010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5643eff56af0 0x5643eff65b60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.866+0000 7f29c2658740 1 -- 172.21.15.120:0/3626052010 >> 172.21.15.120:0/3626052010 conn(0x5643eff53060 msgr2=0x5643eff519a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.866+0000 7f29c2658740 1 -- 172.21.15.120:0/3626052010 shutdown_connections 2024-09-19T05:25:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.866+0000 7f29c2658740 1 -- 172.21.15.120:0/3626052010 wait complete. 2024-09-19T05:25:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.866+0000 7f29c2658740 20 client.25691 trim_cache size 0 max 16384 2024-09-19T05:25:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:25:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:25:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:25:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:25:44.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.867+0000 7f29bf7e4640 1 -- 172.21.15.120:0/217559858 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f29a40a3560 msgr2=0x7f29a40a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:44.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.867+0000 7f29bf7e4640 1 --2- 172.21.15.120:0/217559858 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f29a40a3560 0x7f29a40a5a20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x5643eff53ec0 tx=0x7f29b40d5530 comp rx=0 tx=0).stop 2024-09-19T05:25:44.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.867+0000 7f29bf7e4640 1 -- 172.21.15.120:0/217559858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29b81091f0 msgr2=0x7f29b81a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:44.870 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.867+0000 7f29bf7e4640 1 --2- 172.21.15.120:0/217559858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29b81091f0 0x7f29b81a7200 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f29b400d950 tx=0x7f29b400de10 comp rx=0 tx=0).stop 2024-09-19T05:25:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.867+0000 7f29bf7e4640 1 -- 172.21.15.120:0/217559858 shutdown_connections 2024-09-19T05:25:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.867+0000 7f29bf7e4640 1 --2- 172.21.15.120:0/217559858 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f29a40a3560 0x7f29a40a5a20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.867+0000 7f29bf7e4640 1 --2- 172.21.15.120:0/217559858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29b81abac0 0x7f29b81abf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.867+0000 7f29bf7e4640 1 --2- 172.21.15.120:0/217559858 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f29b811b140 0x7f29b81a7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.867+0000 7f29bf7e4640 1 --2- 172.21.15.120:0/217559858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29b81091f0 0x7f29b81a7200 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.867+0000 7f29bf7e4640 1 -- 172.21.15.120:0/217559858 >> 172.21.15.120:0/217559858 conn(0x7f29b806ce00 msgr2=0x7f29b811b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.867+0000 7f29bf7e4640 1 -- 172.21.15.120:0/217559858 shutdown_connections 2024-09-19T05:25:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:44.867+0000 7f29bf7e4640 1 -- 172.21.15.120:0/217559858 wait complete. 2024-09-19T05:25:45.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:45 smithi120 ceph-mon[30956]: pgmap v198: 97 pgs: 97 active+clean; 528 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 394 op/s 2024-09-19T05:25:45.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:45 smithi194 ceph-mon[35228]: pgmap v198: 97 pgs: 97 active+clean; 528 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 394 op/s 2024-09-19T05:25:45.945 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:45 smithi178 ceph-mon[34347]: pgmap v198: 97 pgs: 97 active+clean; 528 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.9 MiB/s wr, 394 op/s 2024-09-19T05:25:47.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:47 smithi120 ceph-mon[30956]: pgmap v199: 97 pgs: 97 active+clean; 522 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.9 MiB/s wr, 634 op/s 2024-09-19T05:25:47.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:47 smithi120 ceph-mon[30956]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:25:47.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:47 smithi194 ceph-mon[35228]: pgmap v199: 97 pgs: 97 active+clean; 522 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.9 MiB/s wr, 634 op/s 2024-09-19T05:25:47.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:47 smithi194 ceph-mon[35228]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:25:47.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:47 smithi178 ceph-mon[34347]: pgmap v199: 97 pgs: 97 active+clean; 522 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.9 MiB/s wr, 634 op/s 2024-09-19T05:25:47.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:47 smithi178 ceph-mon[34347]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:25:48.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:48 smithi120 ceph-mon[30956]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:25:48.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:48 smithi194 ceph-mon[35228]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:25:48.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:48 smithi178 ceph-mon[34347]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:25:49.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:49 smithi120 ceph-mon[30956]: pgmap v200: 97 pgs: 97 active+clean; 522 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 494 op/s 2024-09-19T05:25:49.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:49 smithi194 ceph-mon[35228]: pgmap v200: 97 pgs: 97 active+clean; 522 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 494 op/s 2024-09-19T05:25:49.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:49 smithi178 ceph-mon[34347]: pgmap v200: 97 pgs: 97 active+clean; 522 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.5 MiB/s wr, 494 op/s 2024-09-19T05:25:51.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:51 smithi120 ceph-mon[30956]: pgmap v201: 97 pgs: 97 active+clean; 527 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.5 MiB/s wr, 583 op/s 2024-09-19T05:25:51.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:51 smithi194 ceph-mon[35228]: pgmap v201: 97 pgs: 97 active+clean; 527 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.5 MiB/s wr, 583 op/s 2024-09-19T05:25:51.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:51 smithi178 ceph-mon[34347]: pgmap v201: 97 pgs: 97 active+clean; 527 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.5 MiB/s wr, 583 op/s 2024-09-19T05:25:52.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:52 smithi194 ceph-mon[35228]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:25:52.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:52 smithi178 ceph-mon[34347]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:25:53.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:52 smithi120 ceph-mon[30956]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:25:53.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:53 smithi194 ceph-mon[35228]: pgmap v202: 97 pgs: 97 active+clean; 525 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 454 op/s 2024-09-19T05:25:53.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:53 smithi194 ceph-mon[35228]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:25:53.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:53 smithi178 ceph-mon[34347]: pgmap v202: 97 pgs: 97 active+clean; 525 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 454 op/s 2024-09-19T05:25:53.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:53 smithi178 ceph-mon[34347]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:25:54.127 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:53 smithi120 ceph-mon[30956]: pgmap v202: 97 pgs: 97 active+clean; 525 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 454 op/s 2024-09-19T05:25:54.127 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:53 smithi120 ceph-mon[30956]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:25:55.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:55 smithi194 ceph-mon[35228]: pgmap v203: 97 pgs: 97 active+clean; 525 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 367 op/s 2024-09-19T05:25:55.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:55 smithi178 ceph-mon[34347]: pgmap v203: 97 pgs: 97 active+clean; 525 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 367 op/s 2024-09-19T05:25:56.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:55 smithi120 ceph-mon[30956]: pgmap v203: 97 pgs: 97 active+clean; 525 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 367 op/s 2024-09-19T05:25:57.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.957+0000 7fa957b03640 1 -- 172.21.15.120:0/1114500847 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9501009b0 msgr2=0x7fa950100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:57.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.957+0000 7fa957b03640 1 --2- 172.21.15.120:0/1114500847 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9501009b0 0x7fa950100e10 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa940009930 tx=0x7fa94002a420 comp rx=0 tx=0).stop 2024-09-19T05:25:57.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.957+0000 7fa957b03640 1 -- 172.21.15.120:0/1114500847 shutdown_connections 2024-09-19T05:25:57.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.957+0000 7fa957b03640 1 --2- 172.21.15.120:0/1114500847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa950101350 0x7fa95010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:57.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.957+0000 7fa957b03640 1 --2- 172.21.15.120:0/1114500847 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9501009b0 0x7fa950100e10 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:57.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.957+0000 7fa957b03640 1 --2- 172.21.15.120:0/1114500847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9501069c0 0x7fa950106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:57.962 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.957+0000 7fa957b03640 1 -- 172.21.15.120:0/1114500847 >> 172.21.15.120:0/1114500847 conn(0x7fa950077990 msgr2=0x7fa9500fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:57.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.957+0000 7fa957b03640 1 -- 172.21.15.120:0/1114500847 shutdown_connections 2024-09-19T05:25:57.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.957+0000 7fa957b03640 1 -- 172.21.15.120:0/1114500847 wait complete. 2024-09-19T05:25:57.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.958+0000 7fa957b03640 1 Processor -- start 2024-09-19T05:25:57.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.958+0000 7fa957b03640 1 -- start start 2024-09-19T05:25:57.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.958+0000 7fa957b03640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9501009b0 0x7fa950198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:57.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.958+0000 7fa957b03640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa950101350 0x7fa950198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:57.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.958+0000 7fa957b03640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9501069c0 0x7fa95019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:57.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.958+0000 7fa957b03640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa950110cb0 con 0x7fa9501009b0 2024-09-19T05:25:57.963 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.958+0000 7fa957b03640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa950110b30 con 0x7fa9501069c0 2024-09-19T05:25:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.958+0000 7fa957b03640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa950110e30 con 0x7fa950101350 2024-09-19T05:25:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.958+0000 7fa95589f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9501009b0 0x7fa950198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.958+0000 7fa95589f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9501009b0 0x7fa950198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60130/0 (socket says 172.21.15.120:60130) 2024-09-19T05:25:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.958+0000 7fa95589f640 1 -- 172.21.15.120:0/2303953149 learned_addr learned my addr 172.21.15.120:0/2303953149 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:25:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.958+0000 7fa95509e640 1 --2- 172.21.15.120:0/2303953149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa950101350 0x7fa950198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.958+0000 7fa9560a0640 1 --2- 172.21.15.120:0/2303953149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9501069c0 0x7fa95019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.958+0000 7fa95589f640 1 -- 172.21.15.120:0/2303953149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa950101350 msgr2=0x7fa950198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.958+0000 7fa95589f640 1 --2- 172.21.15.120:0/2303953149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa950101350 0x7fa950198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.958+0000 7fa95589f640 1 -- 172.21.15.120:0/2303953149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9501069c0 msgr2=0x7fa95019cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.958+0000 7fa95589f640 1 --2- 172.21.15.120:0/2303953149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9501069c0 0x7fa95019cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:57.964 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.958+0000 7fa95589f640 1 -- 172.21.15.120:0/2303953149 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa95019d320 con 0x7fa9501009b0 2024-09-19T05:25:57.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.959+0000 7fa95589f640 1 --2- 172.21.15.120:0/2303953149 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9501009b0 0x7fa950198330 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00e9f0 tx=0x7fa94c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:57.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.959+0000 7fa946ffd640 1 -- 172.21.15.120:0/2303953149 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94c00cd80 con 0x7fa9501009b0 2024-09-19T05:25:57.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.959+0000 7fa946ffd640 1 -- 172.21.15.120:0/2303953149 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa94c0108e0 con 0x7fa9501009b0 2024-09-19T05:25:57.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.959+0000 7fa957b03640 1 -- 172.21.15.120:0/2303953149 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa95019d610 con 0x7fa9501009b0 2024-09-19T05:25:57.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.959+0000 7fa946ffd640 1 -- 172.21.15.120:0/2303953149 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94c018920 con 0x7fa9501009b0 2024-09-19T05:25:57.965 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.959+0000 7fa957b03640 1 -- 172.21.15.120:0/2303953149 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9501a4ea0 con 0x7fa9501009b0 2024-09-19T05:25:57.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.961+0000 7fa946ffd640 1 -- 172.21.15.120:0/2303953149 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fa94c010a90 con 0x7fa9501009b0 2024-09-19T05:25:57.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.962+0000 7fa95a899740 1 Processor -- start 2024-09-19T05:25:57.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.962+0000 7fa95a899740 1 -- start start 2024-09-19T05:25:57.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.962+0000 7fa95a899740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f34d959af0 0x55f34d959ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:57.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.962+0000 7fa95a899740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d95a410 0x55f34d964770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:57.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.962+0000 7fa95a899740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f34d964cb0 0x55f34d9670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:57.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.962+0000 7fa95a899740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f34d8be2f0 con 0x55f34d95a410 2024-09-19T05:25:57.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.962+0000 7fa95a899740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55f34d866270 con 0x55f34d964cb0 2024-09-19T05:25:57.972 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.962+0000 7fa95a899740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55f34d8ba2b0 con 0x55f34d959af0 2024-09-19T05:25:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.962+0000 7fa95589f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d95a410 0x55f34d964770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.962+0000 7fa946ffd640 1 --2- 172.21.15.120:0/2303953149 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fa93c0a3460 0x7fa93c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.962+0000 7fa9560a0640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f34d959af0 0x55f34d959ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.962+0000 7fa95589f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d95a410 0x55f34d964770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60132/0 (socket says 172.21.15.120:60132) 2024-09-19T05:25:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.962+0000 7fa95589f640 1 -- 172.21.15.120:0/2357464269 learned_addr learned my addr 172.21.15.120:0/2357464269 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:25:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.962+0000 7fa95509e640 1 --2- 172.21.15.120:0/2357464269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f34d964cb0 0x55f34d9670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.962+0000 7fa9560a0640 1 --2- 172.21.15.120:0/2303953149 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fa93c0a3460 0x7fa93c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.963+0000 7fa946ffd640 1 -- 172.21.15.120:0/2303953149 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fa94c0d0000 con 0x7fa9501009b0 2024-09-19T05:25:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.963+0000 7fa9560a0640 1 -- 172.21.15.120:0/2357464269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f34d964cb0 msgr2=0x55f34d9670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.963+0000 7fa9560a0640 1 --2- 172.21.15.120:0/2357464269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f34d964cb0 0x55f34d9670a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.963+0000 7fa9560a0640 1 -- 172.21.15.120:0/2357464269 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d95a410 msgr2=0x55f34d964770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.963+0000 7fa9560a0640 1 --2- 172.21.15.120:0/2357464269 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d95a410 0x55f34d964770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.963+0000 7fa9560a0640 1 -- 172.21.15.120:0/2357464269 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f34d865340 con 0x55f34d959af0 2024-09-19T05:25:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.963+0000 7fa95589f640 1 --2- 172.21.15.120:0/2357464269 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d95a410 0x55f34d964770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:25:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.963+0000 7fa9560a0640 1 --2- 172.21.15.120:0/2303953149 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fa93c0a3460 0x7fa93c0a5920 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa948005fd0 tx=0x7fa94801e000 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.963+0000 7fa9560a0640 1 --2- 172.21.15.120:0/2357464269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f34d959af0 0x55f34d959ed0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa948009fd0 tx=0x7fa9480117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd589793d1300051 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.963+0000 7fa93bfff640 1 -- 172.21.15.120:0/2357464269 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa948023070 con 0x55f34d959af0 2024-09-19T05:25:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.963+0000 7fa93bfff640 1 -- 172.21.15.120:0/2357464269 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa948013910 con 0x55f34d959af0 2024-09-19T05:25:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.963+0000 7fa93bfff640 1 -- 172.21.15.120:0/2357464269 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa948003970 con 0x55f34d959af0 2024-09-19T05:25:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.964+0000 7fa95a899740 1 -- 172.21.15.120:0/2357464269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f34d959af0 msgr2=0x55f34d959ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.964+0000 7fa95a899740 1 --2- 172.21.15.120:0/2357464269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f34d959af0 0x55f34d959ed0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa948009fd0 tx=0x7fa9480117b0 comp rx=0 tx=0).stop 2024-09-19T05:25:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.964+0000 7fa95a899740 1 -- 172.21.15.120:0/2357464269 shutdown_connections 2024-09-19T05:25:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.964+0000 7fa95a899740 1 --2- 172.21.15.120:0/2357464269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f34d964cb0 0x55f34d9670a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.964+0000 7fa95a899740 1 --2- 172.21.15.120:0/2357464269 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d95a410 0x55f34d964770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.964+0000 7fa95a899740 1 --2- 172.21.15.120:0/2357464269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f34d959af0 0x55f34d959ed0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.964+0000 7fa95a899740 1 -- 172.21.15.120:0/2357464269 >> 172.21.15.120:0/2357464269 conn(0x55f34d956060 msgr2=0x55f34d956440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.964+0000 7fa95a899740 1 -- 172.21.15.120:0/2357464269 shutdown_connections 2024-09-19T05:25:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.964+0000 7fa95a899740 1 -- 172.21.15.120:0/2357464269 wait complete. 2024-09-19T05:25:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.964+0000 7fa95a899740 1 -- start start 2024-09-19T05:25:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.964+0000 7fa95a899740 1 Processor -- start 2024-09-19T05:25:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.965+0000 7fa95a899740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d959af0 0x55f34d961ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.965+0000 7fa95a899740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f34d95a410 0x55f34d9620e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.965+0000 7fa95a899740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f34d964cb0 0x55f34d962620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.965+0000 7fa95a899740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x55f34d96bc90 con 0x55f34d959af0 2024-09-19T05:25:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.965+0000 7fa95a899740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x55f34d847290 con 0x55f34d964cb0 2024-09-19T05:25:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.965+0000 7fa95a899740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55f34d96be10 con 0x55f34d95a410 2024-09-19T05:25:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.965+0000 7fa95a899740 10 client.0 _ll_register_callbacks cb 0x55f34d878140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:25:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.965+0000 7fa95589f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d959af0 0x55f34d961ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.965+0000 7fa95589f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d959af0 0x55f34d961ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60142/0 (socket says 172.21.15.120:60142) 2024-09-19T05:25:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.965+0000 7fa95589f640 1 -- 172.21.15.120:0/15873244 learned_addr learned my addr 172.21.15.120:0/15873244 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:25:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.965+0000 7fa9560a0640 1 --2- 172.21.15.120:0/15873244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f34d964cb0 0x55f34d962620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.965+0000 7fa95509e640 1 --2- 172.21.15.120:0/15873244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f34d95a410 0x55f34d9620e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.965+0000 7fa95589f640 1 -- 172.21.15.120:0/15873244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f34d95a410 msgr2=0x55f34d9620e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:57.976 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.965+0000 7fa95589f640 1 --2- 172.21.15.120:0/15873244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f34d95a410 0x55f34d9620e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.965+0000 7fa95589f640 1 -- 172.21.15.120:0/15873244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f34d964cb0 msgr2=0x55f34d962620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.965+0000 7fa95589f640 1 --2- 172.21.15.120:0/15873244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f34d964cb0 0x55f34d962620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.965+0000 7fa95589f640 1 -- 172.21.15.120:0/15873244 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f34d5d1210 con 0x55f34d959af0 2024-09-19T05:25:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.965+0000 7fa95589f640 1 --2- 172.21.15.120:0/15873244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d959af0 0x55f34d961ba0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00c6a0 tx=0x7fa94c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a441a1f910f60da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.965+0000 7fa9397fa640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:25:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.966+0000 7fa9397fa640 1 -- 172.21.15.120:0/15873244 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94c0bc2b0 con 0x55f34d959af0 2024-09-19T05:25:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.966+0000 7fa9397fa640 1 -- 172.21.15.120:0/15873244 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fa94c010430 con 0x55f34d959af0 2024-09-19T05:25:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.966+0000 7fa95a899740 1 -- 172.21.15.120:0/15873244 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa948013910 con 0x55f34d959af0 2024-09-19T05:25:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.966+0000 7fa9397fa640 1 -- 172.21.15.120:0/15873244 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fa94c0d2320 con 0x55f34d959af0 2024-09-19T05:25:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.966+0000 7fa95a899740 10 client.16272 fetch_fsmap learned FSMap version 33 2024-09-19T05:25:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.966+0000 7fa95a899740 1 -- 172.21.15.120:0/15873244 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55f34d69d620 con 0x55f34d959af0 2024-09-19T05:25:57.977 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.966+0000 7fa9397fa640 1 -- 172.21.15.120:0/15873244 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa948013910 con 0x55f34d959af0 2024-09-19T05:25:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.966+0000 7fa9397fa640 1 -- 172.21.15.120:0/15873244 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fa94c09b790 con 0x55f34d959af0 2024-09-19T05:25:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.966+0000 7fa95a899740 10 client.16272 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T05:25:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.966+0000 7fa95a899740 10 client.16272 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:25:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.966+0000 7fa95a899740 20 client.16272 populate_metadata read hostname 'smithi120' 2024-09-19T05:25:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.966+0000 7fa95a899740 1 --2- 172.21.15.120:0/15873244 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55f34d9790c0 0x55f34d97b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.966+0000 7fa95a899740 4 client.16272 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:25:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.966+0000 7fa95a899740 1 -- 172.21.15.120:0/15873244 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f34d8cba20 con 0x55f34d9790c0 2024-09-19T05:25:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.966+0000 7fa95509e640 1 --2- 172.21.15.120:0/15873244 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55f34d9790c0 0x55f34d97b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.967+0000 7fa95509e640 1 --2- 172.21.15.120:0/15873244 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55f34d9790c0 0x55f34d97b4b0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dacca5f9f81a5930 server_cookie=acb5db8b7bec972c in_seq=0 out_seq=0 2024-09-19T05:25:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.967+0000 7fa9397fa640 10 client.16272 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:25:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.967+0000 7fa9397fa640 1 -- 172.21.15.120:0/15873244 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f34d8cba20 con 0x55f34d9790c0 2024-09-19T05:25:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.967+0000 7fa9397fa640 10 client.16272 handle_command_reply: tid=0 2024-09-19T05:25:57.978 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.967+0000 7fa95a899740 1 client.16272 shutdown 2024-09-19T05:25:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.968+0000 7fa95a899740 1 -- 172.21.15.120:0/15873244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d959af0 msgr2=0x55f34d961ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.968+0000 7fa95a899740 1 --2- 172.21.15.120:0/15873244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d959af0 0x55f34d961ba0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00c6a0 tx=0x7fa94c014000 comp rx=0 tx=0).stop 2024-09-19T05:25:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.968+0000 7fa95a899740 1 -- 172.21.15.120:0/15873244 shutdown_connections 2024-09-19T05:25:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.968+0000 7fa95a899740 1 --2- 172.21.15.120:0/15873244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f34d964cb0 0x55f34d962620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.968+0000 7fa95a899740 1 --2- 172.21.15.120:0/15873244 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55f34d9790c0 0x55f34d97b4b0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.968+0000 7fa95a899740 1 --2- 172.21.15.120:0/15873244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f34d95a410 0x55f34d9620e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.968+0000 7fa95a899740 1 --2- 172.21.15.120:0/15873244 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d959af0 0x55f34d961ba0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.968+0000 7fa9397fa640 0 client.16272 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:25:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.968+0000 7fa95a899740 1 -- 172.21.15.120:0/15873244 >> 172.21.15.120:0/15873244 conn(0x55f34d956060 msgr2=0x55f34d9551c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.968+0000 7fa95a899740 1 -- 172.21.15.120:0/15873244 shutdown_connections 2024-09-19T05:25:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.968+0000 7fa95a899740 1 -- 172.21.15.120:0/15873244 wait complete. 2024-09-19T05:25:57.979 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.968+0000 7fa95a899740 20 client.16272 trim_cache size 0 max 16384 2024-09-19T05:25:57.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.983+0000 7fa95a899740 1 Processor -- start 2024-09-19T05:25:57.991 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.983+0000 7fa95a899740 1 -- start start 2024-09-19T05:25:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.983+0000 7fa95a899740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f34d959af0 0x55f34d963b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.983+0000 7fa95a899740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d95a410 0x55f34d980d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.983+0000 7fa95a899740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f34d964cb0 0x55f34d981290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.983+0000 7fa95a899740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa9501adfe0 con 0x55f34d95a410 2024-09-19T05:25:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.983+0000 7fa95a899740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa9501ab7f0 con 0x55f34d959af0 2024-09-19T05:25:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.983+0000 7fa95a899740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa9501a9640 con 0x55f34d964cb0 2024-09-19T05:25:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.983+0000 7fa95509e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d95a410 0x55f34d980d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.983+0000 7fa95509e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d95a410 0x55f34d980d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60154/0 (socket says 172.21.15.120:60154) 2024-09-19T05:25:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.983+0000 7fa95509e640 1 -- 172.21.15.120:0/1769593518 learned_addr learned my addr 172.21.15.120:0/1769593518 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:25:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.983+0000 7fa9560a0640 1 --2- 172.21.15.120:0/1769593518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f34d964cb0 0x55f34d981290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.984+0000 7fa95509e640 1 -- 172.21.15.120:0/1769593518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f34d964cb0 msgr2=0x55f34d981290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.984+0000 7fa95509e640 1 --2- 172.21.15.120:0/1769593518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f34d964cb0 0x55f34d981290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.984+0000 7fa95509e640 1 -- 172.21.15.120:0/1769593518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f34d959af0 msgr2=0x55f34d963b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.984+0000 7fa95589f640 1 --2- 172.21.15.120:0/1769593518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f34d959af0 0x55f34d963b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.984+0000 7fa95509e640 1 --2- 172.21.15.120:0/1769593518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f34d959af0 0x55f34d963b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.984+0000 7fa95509e640 1 -- 172.21.15.120:0/1769593518 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f34d959920 con 0x55f34d95a410 2024-09-19T05:25:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.984+0000 7fa9560a0640 1 --2- 172.21.15.120:0/1769593518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f34d964cb0 0x55f34d981290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:25:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.984+0000 7fa95589f640 1 --2- 172.21.15.120:0/1769593518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f34d959af0 0x55f34d963b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:25:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.984+0000 7fa95509e640 1 --2- 172.21.15.120:0/1769593518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d95a410 0x55f34d980d50 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fa940009900 tx=0x7fa940005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1f5115118dedd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.984+0000 7fa93b7fe640 1 -- 172.21.15.120:0/1769593518 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94004a030 con 0x55f34d95a410 2024-09-19T05:25:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.984+0000 7fa93b7fe640 1 -- 172.21.15.120:0/1769593518 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa9400042b0 con 0x55f34d95a410 2024-09-19T05:25:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.984+0000 7fa93b7fe640 1 -- 172.21.15.120:0/1769593518 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa940035040 con 0x55f34d95a410 2024-09-19T05:25:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.985+0000 7fa95a899740 1 -- 172.21.15.120:0/1769593518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d95a410 msgr2=0x55f34d980d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.985+0000 7fa95a899740 1 --2- 172.21.15.120:0/1769593518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d95a410 0x55f34d980d50 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fa940009900 tx=0x7fa940005fd0 comp rx=0 tx=0).stop 2024-09-19T05:25:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.985+0000 7fa95a899740 1 -- 172.21.15.120:0/1769593518 shutdown_connections 2024-09-19T05:25:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.985+0000 7fa95a899740 1 --2- 172.21.15.120:0/1769593518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f34d964cb0 0x55f34d981290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.985+0000 7fa95a899740 1 --2- 172.21.15.120:0/1769593518 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d95a410 0x55f34d980d50 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.985+0000 7fa95a899740 1 --2- 172.21.15.120:0/1769593518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f34d959af0 0x55f34d963b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.985+0000 7fa95a899740 1 -- 172.21.15.120:0/1769593518 >> 172.21.15.120:0/1769593518 conn(0x55f34d956060 msgr2=0x55f34d963400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.985+0000 7fa95a899740 1 -- 172.21.15.120:0/1769593518 shutdown_connections 2024-09-19T05:25:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.985+0000 7fa95a899740 1 -- 172.21.15.120:0/1769593518 wait complete. 2024-09-19T05:25:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.985+0000 7fa95a899740 1 -- start start 2024-09-19T05:25:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.985+0000 7fa95a899740 1 Processor -- start 2024-09-19T05:25:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa95a899740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f34d959af0 0x55f34d971890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa95a899740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d95a410 0x55f34d95e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa95a899740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f34d964cb0 0x55f34d95ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa95a899740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fa9501a9cb0 con 0x55f34d95a410 2024-09-19T05:25:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa95a899740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fa9501ab120 con 0x55f34d959af0 2024-09-19T05:25:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa95a899740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa9501aa380 con 0x55f34d964cb0 2024-09-19T05:25:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa95a899740 10 client.0 _ll_register_callbacks cb 0x7fa94c00e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:25:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa95509e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d95a410 0x55f34d95e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa95509e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d95a410 0x55f34d95e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60162/0 (socket says 172.21.15.120:60162) 2024-09-19T05:25:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa95509e640 1 -- 172.21.15.120:0/1598066756 learned_addr learned my addr 172.21.15.120:0/1598066756 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:25:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa9560a0640 1 --2- 172.21.15.120:0/1598066756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f34d964cb0 0x55f34d95ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa95589f640 1 --2- 172.21.15.120:0/1598066756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f34d959af0 0x55f34d971890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa95509e640 1 -- 172.21.15.120:0/1598066756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f34d964cb0 msgr2=0x55f34d95ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa95509e640 1 --2- 172.21.15.120:0/1598066756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f34d964cb0 0x55f34d95ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa95509e640 1 -- 172.21.15.120:0/1598066756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f34d959af0 msgr2=0x55f34d971890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:25:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa95509e640 1 --2- 172.21.15.120:0/1598066756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f34d959af0 0x55f34d971890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa95509e640 1 -- 172.21.15.120:0/1598066756 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f34d95f6a0 con 0x55f34d95a410 2024-09-19T05:25:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa95589f640 1 --2- 172.21.15.120:0/1598066756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f34d959af0 0x55f34d971890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:25:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa95509e640 1 --2- 172.21.15.120:0/1598066756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d95a410 0x55f34d95e930 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa9400045d0 tx=0x7fa940004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7404c4a1fa017c14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:25:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa9397fa640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:25:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa9397fa640 1 -- 172.21.15.120:0/1598066756 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa940053070 con 0x55f34d95a410 2024-09-19T05:25:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa9397fa640 1 -- 172.21.15.120:0/1598066756 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8599+0+0 (secure 0 0 0) 0x7fa940005230 con 0x55f34d95a410 2024-09-19T05:25:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa95a899740 1 -- 172.21.15.120:0/1598066756 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9400042b0 con 0x55f34d95a410 2024-09-19T05:25:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa9397fa640 1 -- 172.21.15.120:0/1598066756 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fa94005f050 con 0x55f34d95a410 2024-09-19T05:25:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa95a899740 10 client.16278 fetch_fsmap learned FSMap version 33 2024-09-19T05:25:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.986+0000 7fa95a899740 1 -- 172.21.15.120:0/1598066756 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55f34d9e3cd0 con 0x55f34d95a410 2024-09-19T05:25:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.987+0000 7fa9397fa640 1 -- 172.21.15.120:0/1598066756 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fa9400042b0 con 0x55f34d95a410 2024-09-19T05:25:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.987+0000 7fa9397fa640 1 -- 172.21.15.120:0/1598066756 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7fa9400035f0 con 0x55f34d95a410 2024-09-19T05:25:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.987+0000 7fa95a899740 10 client.16278 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T05:25:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.987+0000 7fa95a899740 10 client.16278 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:25:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.987+0000 7fa95a899740 20 client.16278 populate_metadata read hostname 'smithi120' 2024-09-19T05:25:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.987+0000 7fa95a899740 1 --2- 172.21.15.120:0/1598066756 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55f34d9e4370 0x55f34d9e6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:25:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.987+0000 7fa95a899740 4 client.16278 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:25:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.987+0000 7fa95a899740 1 -- 172.21.15.120:0/1598066756 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f34d8c5d70 con 0x55f34d9e4370 2024-09-19T05:25:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.987+0000 7fa95589f640 1 --2- 172.21.15.120:0/1598066756 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55f34d9e4370 0x55f34d9e6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:25:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.988+0000 7fa9397fa640 10 client.16278 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:25:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:57.988+0000 7fa95589f640 1 --2- 172.21.15.120:0/1598066756 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55f34d9e4370 0x55f34d9e6790 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c39eb723439b3243 server_cookie=9bc040846698df1b in_seq=0 out_seq=0 2024-09-19T05:25:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.185+0000 7fa9397fa640 1 -- 172.21.15.120:0/1598066756 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f34d8c5d70 con 0x55f34d9e4370 2024-09-19T05:25:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.185+0000 7fa9397fa640 10 client.16278 handle_command_reply: tid=0 2024-09-19T05:25:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.185+0000 7fa95a899740 1 client.16278 shutdown 2024-09-19T05:25:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.186+0000 7fa95a899740 1 -- 172.21.15.120:0/1598066756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d95a410 msgr2=0x55f34d95e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.186+0000 7fa95a899740 1 --2- 172.21.15.120:0/1598066756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d95a410 0x55f34d95e930 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa9400045d0 tx=0x7fa940004600 comp rx=0 tx=0).stop 2024-09-19T05:25:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.186+0000 7fa95a899740 1 -- 172.21.15.120:0/1598066756 shutdown_connections 2024-09-19T05:25:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.186+0000 7fa95a899740 1 --2- 172.21.15.120:0/1598066756 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x55f34d9e4370 0x55f34d9e6790 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.186+0000 7fa95a899740 1 --2- 172.21.15.120:0/1598066756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f34d964cb0 0x55f34d95ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.186+0000 7fa9397fa640 0 client.16278 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:25:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.186+0000 7fa95a899740 1 --2- 172.21.15.120:0/1598066756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55f34d95a410 0x55f34d95e930 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.186+0000 7fa95a899740 1 --2- 172.21.15.120:0/1598066756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f34d959af0 0x55f34d971890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.186+0000 7fa95a899740 1 -- 172.21.15.120:0/1598066756 >> 172.21.15.120:0/1598066756 conn(0x55f34d956060 msgr2=0x55f34d9549a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.186+0000 7fa95a899740 1 -- 172.21.15.120:0/1598066756 shutdown_connections 2024-09-19T05:25:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.186+0000 7fa95a899740 1 -- 172.21.15.120:0/1598066756 wait complete. 2024-09-19T05:25:58.193 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.186+0000 7fa95a899740 20 client.16278 trim_cache size 0 max 16384 2024-09-19T05:25:58.193 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:25:58.193 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:25:58.194 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:25:58.194 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:25:58.195 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.187+0000 7fa957b03640 1 -- 172.21.15.120:0/2303953149 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fa93c0a3460 msgr2=0x7fa93c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:58.196 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.187+0000 7fa957b03640 1 --2- 172.21.15.120:0/2303953149 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fa93c0a3460 0x7fa93c0a5920 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa948005fd0 tx=0x7fa94801e000 comp rx=0 tx=0).stop 2024-09-19T05:25:58.196 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.187+0000 7fa957b03640 1 -- 172.21.15.120:0/2303953149 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9501009b0 msgr2=0x7fa950198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:25:58.196 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.187+0000 7fa957b03640 1 --2- 172.21.15.120:0/2303953149 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9501009b0 0x7fa950198330 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00e9f0 tx=0x7fa94c00eeb0 comp rx=0 tx=0).stop 2024-09-19T05:25:58.196 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.187+0000 7fa957b03640 1 -- 172.21.15.120:0/2303953149 shutdown_connections 2024-09-19T05:25:58.196 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.187+0000 7fa957b03640 1 --2- 172.21.15.120:0/2303953149 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fa93c0a3460 0x7fa93c0a5920 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:58.196 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.187+0000 7fa957b03640 1 --2- 172.21.15.120:0/2303953149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9501069c0 0x7fa95019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.187+0000 7fa957b03640 1 --2- 172.21.15.120:0/2303953149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa950101350 0x7fa950198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.187+0000 7fa957b03640 1 --2- 172.21.15.120:0/2303953149 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa9501009b0 0x7fa950198330 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:25:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.187+0000 7fa957b03640 1 -- 172.21.15.120:0/2303953149 >> 172.21.15.120:0/2303953149 conn(0x7fa950077990 msgr2=0x7fa950069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:25:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.187+0000 7fa957b03640 1 -- 172.21.15.120:0/2303953149 shutdown_connections 2024-09-19T05:25:58.198 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:25:58.187+0000 7fa957b03640 1 -- 172.21.15.120:0/2303953149 wait complete. 2024-09-19T05:25:58.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:25:58 smithi120 ceph-mon[30956]: pgmap v204: 97 pgs: 97 active+clean; 532 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 558 op/s 2024-09-19T05:25:58.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:25:58 smithi194 ceph-mon[35228]: pgmap v204: 97 pgs: 97 active+clean; 532 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 558 op/s 2024-09-19T05:25:58.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:25:58 smithi178 ceph-mon[34347]: pgmap v204: 97 pgs: 97 active+clean; 532 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 558 op/s 2024-09-19T05:26:00.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:00 smithi120 ceph-mon[30956]: pgmap v205: 97 pgs: 97 active+clean; 532 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 318 op/s 2024-09-19T05:26:00.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:00 smithi194 ceph-mon[35228]: pgmap v205: 97 pgs: 97 active+clean; 532 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 318 op/s 2024-09-19T05:26:00.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:00 smithi178 ceph-mon[34347]: pgmap v205: 97 pgs: 97 active+clean; 532 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 318 op/s 2024-09-19T05:26:02.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:02 smithi120 ceph-mon[30956]: pgmap v206: 97 pgs: 97 active+clean; 530 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 482 op/s 2024-09-19T05:26:02.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:02 smithi194 ceph-mon[35228]: pgmap v206: 97 pgs: 97 active+clean; 530 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 482 op/s 2024-09-19T05:26:02.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:02 smithi178 ceph-mon[34347]: pgmap v206: 97 pgs: 97 active+clean; 530 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 482 op/s 2024-09-19T05:26:03.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:03 smithi120 ceph-mon[30956]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T05:26:03.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:03 smithi194 ceph-mon[35228]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T05:26:03.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:03 smithi178 ceph-mon[34347]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T05:26:04.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:04 smithi120 ceph-mon[30956]: pgmap v208: 97 pgs: 97 active+clean; 532 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 509 op/s 2024-09-19T05:26:04.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:04 smithi194 ceph-mon[35228]: pgmap v208: 97 pgs: 97 active+clean; 532 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 509 op/s 2024-09-19T05:26:04.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:04 smithi178 ceph-mon[34347]: pgmap v208: 97 pgs: 97 active+clean; 532 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 509 op/s 2024-09-19T05:26:06.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:06 smithi120 ceph-mon[30956]: pgmap v209: 97 pgs: 97 active+clean; 532 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 509 op/s 2024-09-19T05:26:06.408 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:06 smithi194 ceph-mon[35228]: pgmap v209: 97 pgs: 97 active+clean; 532 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 509 op/s 2024-09-19T05:26:06.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:06 smithi178 ceph-mon[34347]: pgmap v209: 97 pgs: 97 active+clean; 532 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 509 op/s 2024-09-19T05:26:08.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:08 smithi120 ceph-mon[30956]: pgmap v210: 97 pgs: 97 active+clean; 542 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 470 op/s 2024-09-19T05:26:08.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:08 smithi194 ceph-mon[35228]: pgmap v210: 97 pgs: 97 active+clean; 542 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 470 op/s 2024-09-19T05:26:08.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:08 smithi178 ceph-mon[34347]: pgmap v210: 97 pgs: 97 active+clean; 542 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 470 op/s 2024-09-19T05:26:10.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:10 smithi120 ceph-mon[30956]: pgmap v211: 97 pgs: 97 active+clean; 542 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 470 op/s 2024-09-19T05:26:10.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:10 smithi194 ceph-mon[35228]: pgmap v211: 97 pgs: 97 active+clean; 542 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 470 op/s 2024-09-19T05:26:10.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:10 smithi178 ceph-mon[34347]: pgmap v211: 97 pgs: 97 active+clean; 542 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 470 op/s 2024-09-19T05:26:11.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.278+0000 7f31fc467640 1 -- 172.21.15.120:0/2642780999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31f41009b0 msgr2=0x7f31f4100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:11.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.278+0000 7f31fc467640 1 --2- 172.21.15.120:0/2642780999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31f41009b0 0x7f31f4100e10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f31e4009930 tx=0x7f31e402a420 comp rx=0 tx=0).stop 2024-09-19T05:26:11.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.279+0000 7f31fc467640 1 -- 172.21.15.120:0/2642780999 shutdown_connections 2024-09-19T05:26:11.283 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.279+0000 7f31fc467640 1 --2- 172.21.15.120:0/2642780999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f4101350 0x7f31f410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.279+0000 7f31fc467640 1 --2- 172.21.15.120:0/2642780999 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31f41009b0 0x7f31f4100e10 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.279+0000 7f31fc467640 1 --2- 172.21.15.120:0/2642780999 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31f41069c0 0x7f31f4106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.279+0000 7f31fc467640 1 -- 172.21.15.120:0/2642780999 >> 172.21.15.120:0/2642780999 conn(0x7f31f4077990 msgr2=0x7f31f40fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.279+0000 7f31fc467640 1 -- 172.21.15.120:0/2642780999 shutdown_connections 2024-09-19T05:26:11.284 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.279+0000 7f31fc467640 1 -- 172.21.15.120:0/2642780999 wait complete. 2024-09-19T05:26:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.279+0000 7f31fc467640 1 Processor -- start 2024-09-19T05:26:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.279+0000 7f31fc467640 1 -- start start 2024-09-19T05:26:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.279+0000 7f31fc467640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31f41009b0 0x7f31f4197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.280+0000 7f31fc467640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f4101350 0x7f31f41976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.280+0000 7f31fc467640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31f41069c0 0x7f31f419ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.280+0000 7f31fc467640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f31f4110d00 con 0x7f31f41069c0 2024-09-19T05:26:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.280+0000 7f31fc467640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f31f4110b80 con 0x7f31f41009b0 2024-09-19T05:26:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.280+0000 7f31fc467640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f31f4110e80 con 0x7f31f4101350 2024-09-19T05:26:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.280+0000 7f31faa04640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31f41069c0 0x7f31f419ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.280+0000 7f31faa04640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31f41069c0 0x7f31f419ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43680/0 (socket says 172.21.15.120:43680) 2024-09-19T05:26:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.280+0000 7f31faa04640 1 -- 172.21.15.120:0/3713205688 learned_addr learned my addr 172.21.15.120:0/3713205688 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:26:11.285 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.280+0000 7f31f9a02640 1 --2- 172.21.15.120:0/3713205688 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f4101350 0x7f31f41976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.280+0000 7f31fa203640 1 --2- 172.21.15.120:0/3713205688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31f41009b0 0x7f31f4197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.280+0000 7f31faa04640 1 -- 172.21.15.120:0/3713205688 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f4101350 msgr2=0x7f31f41976d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.280+0000 7f31faa04640 1 --2- 172.21.15.120:0/3713205688 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f4101350 0x7f31f41976d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.280+0000 7f31faa04640 1 -- 172.21.15.120:0/3713205688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31f41009b0 msgr2=0x7f31f4197190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.280+0000 7f31faa04640 1 --2- 172.21.15.120:0/3713205688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31f41009b0 0x7f31f4197190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.280+0000 7f31faa04640 1 -- 172.21.15.120:0/3713205688 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f419c180 con 0x7f31f41069c0 2024-09-19T05:26:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.280+0000 7f31faa04640 1 --2- 172.21.15.120:0/3713205688 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31f41069c0 0x7f31f419ba50 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f31ec00eb10 tx=0x7f31ec00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.280+0000 7f31eb7fe640 1 -- 172.21.15.120:0/3713205688 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ec004b20 con 0x7f31f41069c0 2024-09-19T05:26:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.280+0000 7f31eb7fe640 1 -- 172.21.15.120:0/3713205688 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f31ec004cc0 con 0x7f31f41069c0 2024-09-19T05:26:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.280+0000 7f31eb7fe640 1 -- 172.21.15.120:0/3713205688 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ec010690 con 0x7f31f41069c0 2024-09-19T05:26:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.280+0000 7f31fc467640 1 -- 172.21.15.120:0/3713205688 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31f419c470 con 0x7f31f41069c0 2024-09-19T05:26:11.286 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.280+0000 7f31fc467640 1 -- 172.21.15.120:0/3713205688 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31f41a3d00 con 0x7f31f41069c0 2024-09-19T05:26:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.282+0000 7f31eb7fe640 1 -- 172.21.15.120:0/3713205688 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f31ec005020 con 0x7f31f41069c0 2024-09-19T05:26:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.283+0000 7f31ff1ff740 1 Processor -- start 2024-09-19T05:26:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.283+0000 7f31ff1ff740 1 -- start start 2024-09-19T05:26:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.283+0000 7f31ff1ff740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f99c990 0x559a5f99cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:11.294 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.284+0000 7f31eb7fe640 1 --2- 172.21.15.120:0/3713205688 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f31e00a3460 0x7f31e00a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.284+0000 7f31ff1ff740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a5f99d2b0 0x559a5f9a9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.284+0000 7f31ff1ff740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a5f9a9ec0 0x559a5f9ac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.284+0000 7f31ff1ff740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559a5f9012f0 con 0x559a5f99c990 2024-09-19T05:26:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.284+0000 7f31ff1ff740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x559a5f8a9270 con 0x559a5f99d2b0 2024-09-19T05:26:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.284+0000 7f31ff1ff740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x559a5f8fd2b0 con 0x559a5f9a9ec0 2024-09-19T05:26:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.284+0000 7f31f9a02640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f99c990 0x559a5f99cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.284+0000 7f31f9a02640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f99c990 0x559a5f99cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43682/0 (socket says 172.21.15.120:43682) 2024-09-19T05:26:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.284+0000 7f31fa203640 1 --2- 172.21.15.120:0/3713205688 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f31e00a3460 0x7f31e00a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.284+0000 7f31f9a02640 1 -- 172.21.15.120:0/588211925 learned_addr learned my addr 172.21.15.120:0/588211925 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:26:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.284+0000 7f31eb7fe640 1 -- 172.21.15.120:0/3713205688 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8643+0+0 (secure 0 0 0) 0x7f31ec0d04f0 con 0x7f31f41069c0 2024-09-19T05:26:11.295 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.284+0000 7f31faa04640 1 --2- 172.21.15.120:0/588211925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a5f9a9ec0 0x559a5f9ac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.284+0000 7f31f9a02640 1 --2- 172.21.15.120:0/588211925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a5f99d2b0 0x559a5f9a9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.284+0000 7f31faa04640 1 -- 172.21.15.120:0/588211925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a5f99d2b0 msgr2=0x559a5f9a9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.284+0000 7f31faa04640 1 --2- 172.21.15.120:0/588211925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a5f99d2b0 0x559a5f9a9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.284+0000 7f31faa04640 1 -- 172.21.15.120:0/588211925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f99c990 msgr2=0x559a5f99cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.284+0000 7f31faa04640 1 --2- 172.21.15.120:0/588211925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f99c990 0x559a5f99cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.284+0000 7f31faa04640 1 -- 172.21.15.120:0/588211925 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a5f8a8340 con 0x559a5f9a9ec0 2024-09-19T05:26:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.284+0000 7f31f9a02640 1 --2- 172.21.15.120:0/588211925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f99c990 0x559a5f99cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:26:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.284+0000 7f31faa04640 1 --2- 172.21.15.120:0/588211925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a5f9a9ec0 0x559a5f9ac2b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f31ec0cdbc0 tx=0x7f31ec098a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83d8f9a7247af20f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.284+0000 7f31fa203640 1 --2- 172.21.15.120:0/3713205688 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f31e00a3460 0x7f31e00a5920 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f31f0005e00 tx=0x7f31f0005c50 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.284+0000 7f31e8bfe640 1 -- 172.21.15.120:0/588211925 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ec09ce50 con 0x559a5f9a9ec0 2024-09-19T05:26:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.284+0000 7f31e8bfe640 1 -- 172.21.15.120:0/588211925 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f31ec09c750 con 0x559a5f9a9ec0 2024-09-19T05:26:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.285+0000 7f31e8bfe640 1 -- 172.21.15.120:0/588211925 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ec098dc0 con 0x559a5f9a9ec0 2024-09-19T05:26:11.296 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.285+0000 7f31ff1ff740 1 -- 172.21.15.120:0/588211925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a5f9a9ec0 msgr2=0x559a5f9ac2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.285+0000 7f31ff1ff740 1 --2- 172.21.15.120:0/588211925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a5f9a9ec0 0x559a5f9ac2b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f31ec0cdbc0 tx=0x7f31ec098a70 comp rx=0 tx=0).stop 2024-09-19T05:26:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.285+0000 7f31ff1ff740 1 -- 172.21.15.120:0/588211925 shutdown_connections 2024-09-19T05:26:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.285+0000 7f31ff1ff740 1 --2- 172.21.15.120:0/588211925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a5f9a9ec0 0x559a5f9ac2b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.285+0000 7f31ff1ff740 1 --2- 172.21.15.120:0/588211925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a5f99d2b0 0x559a5f9a9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.285+0000 7f31ff1ff740 1 --2- 172.21.15.120:0/588211925 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f99c990 0x559a5f99cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.285+0000 7f31ff1ff740 1 -- 172.21.15.120:0/588211925 >> 172.21.15.120:0/588211925 conn(0x559a5f999060 msgr2=0x559a5f999440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:11.297 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.285+0000 7f31ff1ff740 1 -- 172.21.15.120:0/588211925 shutdown_connections 2024-09-19T05:26:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.285+0000 7f31ff1ff740 1 -- 172.21.15.120:0/588211925 wait complete. 2024-09-19T05:26:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.286+0000 7f31ff1ff740 1 -- start start 2024-09-19T05:26:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.286+0000 7f31ff1ff740 1 Processor -- start 2024-09-19T05:26:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.286+0000 7f31ff1ff740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f99c990 0x559a5f9a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.286+0000 7f31ff1ff740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a5f99d2b0 0x559a5f9a7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.286+0000 7f31ff1ff740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a5f9a9ec0 0x559a5f9a7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.286+0000 7f31ff1ff740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x559a5f9acaf0 con 0x559a5f99c990 2024-09-19T05:26:11.298 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.286+0000 7f31ff1ff740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x559a5f88a290 con 0x559a5f9a9ec0 2024-09-19T05:26:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.286+0000 7f31ff1ff740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x559a5f9acc70 con 0x559a5f99d2b0 2024-09-19T05:26:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.286+0000 7f31ff1ff740 10 client.0 _ll_register_callbacks cb 0x559a5f8bb140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:26:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.286+0000 7f31fa203640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f99c990 0x559a5f9a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.286+0000 7f31fa203640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f99c990 0x559a5f9a6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43692/0 (socket says 172.21.15.120:43692) 2024-09-19T05:26:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.286+0000 7f31f9a02640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a5f99d2b0 0x559a5f9a7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.286+0000 7f31fa203640 1 -- 172.21.15.120:0/758019639 learned_addr learned my addr 172.21.15.120:0/758019639 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:26:11.299 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.286+0000 7f31faa04640 1 --2- 172.21.15.120:0/758019639 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a5f9a9ec0 0x559a5f9a7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.286+0000 7f31fa203640 1 -- 172.21.15.120:0/758019639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a5f99d2b0 msgr2=0x559a5f9a7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.286+0000 7f31fa203640 1 --2- 172.21.15.120:0/758019639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a5f99d2b0 0x559a5f9a7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.286+0000 7f31fa203640 1 -- 172.21.15.120:0/758019639 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a5f9a9ec0 msgr2=0x559a5f9a7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.286+0000 7f31fa203640 1 --2- 172.21.15.120:0/758019639 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a5f9a9ec0 0x559a5f9a7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.287+0000 7f31fa203640 1 -- 172.21.15.120:0/758019639 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a5f614210 con 0x559a5f99c990 2024-09-19T05:26:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.287+0000 7f31faa04640 1 --2- 172.21.15.120:0/758019639 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a5f9a9ec0 0x559a5f9a7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:26:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.287+0000 7f31fa203640 1 --2- 172.21.15.120:0/758019639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f99c990 0x559a5f9a6df0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f31f000ffc0 tx=0x7f31f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ebc6059c7cb849 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:11.300 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.287+0000 7f31ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:26:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.287+0000 7f31ddffb640 1 -- 172.21.15.120:0/758019639 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f0022070 con 0x559a5f99c990 2024-09-19T05:26:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.287+0000 7f31ff1ff740 1 -- 172.21.15.120:0/758019639 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31ec09c750 con 0x559a5f99c990 2024-09-19T05:26:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.287+0000 7f31ddffb640 1 -- 172.21.15.120:0/758019639 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8643+0+0 (secure 0 0 0) 0x7f31f001e650 con 0x559a5f99c990 2024-09-19T05:26:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.287+0000 7f31ddffb640 1 -- 172.21.15.120:0/758019639 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f31f002e050 con 0x559a5f99c990 2024-09-19T05:26:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.287+0000 7f31ff1ff740 10 client.16290 fetch_fsmap learned FSMap version 33 2024-09-19T05:26:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.287+0000 7f31ff1ff740 1 -- 172.21.15.120:0/758019639 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x559a5f6e0620 con 0x559a5f99c990 2024-09-19T05:26:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.287+0000 7f31ddffb640 1 -- 172.21.15.120:0/758019639 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f31ec09c750 con 0x559a5f99c990 2024-09-19T05:26:11.301 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.287+0000 7f31ddffb640 1 -- 172.21.15.120:0/758019639 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f31f00109f0 con 0x559a5f99c990 2024-09-19T05:26:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.287+0000 7f31ff1ff740 10 client.16290 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T05:26:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.287+0000 7f31ff1ff740 10 client.16290 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:26:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.287+0000 7f31ff1ff740 20 client.16290 populate_metadata read hostname 'smithi120' 2024-09-19T05:26:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.287+0000 7f31ff1ff740 1 --2- 172.21.15.120:0/758019639 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x559a5f9b9f10 0x559a5f9bc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.287+0000 7f31ff1ff740 4 client.16290 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:26:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.287+0000 7f31ff1ff740 1 -- 172.21.15.120:0/758019639 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a5f90ea20 con 0x559a5f9b9f10 2024-09-19T05:26:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.288+0000 7f31f9a02640 1 --2- 172.21.15.120:0/758019639 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x559a5f9b9f10 0x559a5f9bc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.288+0000 7f31ddffb640 10 client.16290 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:26:11.302 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.288+0000 7f31f9a02640 1 --2- 172.21.15.120:0/758019639 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x559a5f9b9f10 0x559a5f9bc320 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4557859754aa305f server_cookie=12c49e3c09cec63f in_seq=0 out_seq=0 2024-09-19T05:26:11.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.289+0000 7f31ddffb640 1 -- 172.21.15.120:0/758019639 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559a5f90ea20 con 0x559a5f9b9f10 2024-09-19T05:26:11.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.289+0000 7f31ddffb640 10 client.16290 handle_command_reply: tid=0 2024-09-19T05:26:11.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.289+0000 7f31ff1ff740 1 client.16290 shutdown 2024-09-19T05:26:11.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.289+0000 7f31ff1ff740 1 -- 172.21.15.120:0/758019639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f99c990 msgr2=0x559a5f9a6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:11.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.289+0000 7f31ff1ff740 1 --2- 172.21.15.120:0/758019639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f99c990 0x559a5f9a6df0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f31f000ffc0 tx=0x7f31f00046c0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.289+0000 7f31ff1ff740 1 -- 172.21.15.120:0/758019639 shutdown_connections 2024-09-19T05:26:11.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.289+0000 7f31ff1ff740 1 --2- 172.21.15.120:0/758019639 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a5f9a9ec0 0x559a5f9a7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.303 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.289+0000 7f31ff1ff740 1 --2- 172.21.15.120:0/758019639 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x559a5f9b9f10 0x559a5f9bc320 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.304 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.289+0000 7f31ff1ff740 1 --2- 172.21.15.120:0/758019639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a5f99d2b0 0x559a5f9a7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.304 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.289+0000 7f31ff1ff740 1 --2- 172.21.15.120:0/758019639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f99c990 0x559a5f9a6df0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.304 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.289+0000 7f31ff1ff740 1 -- 172.21.15.120:0/758019639 >> 172.21.15.120:0/758019639 conn(0x559a5f999060 msgr2=0x559a5f99ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:11.304 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.289+0000 7f31ddffb640 0 client.16290 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:26:11.304 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.289+0000 7f31ff1ff740 1 -- 172.21.15.120:0/758019639 shutdown_connections 2024-09-19T05:26:11.304 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.289+0000 7f31ff1ff740 1 -- 172.21.15.120:0/758019639 wait complete. 2024-09-19T05:26:11.304 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.289+0000 7f31ff1ff740 20 client.16290 trim_cache size 0 max 16384 2024-09-19T05:26:11.311 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.304+0000 7f31ff1ff740 1 Processor -- start 2024-09-19T05:26:11.312 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.304+0000 7f31ff1ff740 1 -- start start 2024-09-19T05:26:11.312 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.304+0000 7f31ff1ff740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f99c990 0x559a5f9980b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:11.312 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.304+0000 7f31ff1ff740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a5f99d2b0 0x559a5f9c1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:11.312 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.304+0000 7f31ff1ff740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a5f9a9ec0 0x559a5f9c2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:11.312 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.304+0000 7f31ff1ff740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f31f41ae090 con 0x559a5f99c990 2024-09-19T05:26:11.312 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.304+0000 7f31ff1ff740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f31f41ab8a0 con 0x559a5f99d2b0 2024-09-19T05:26:11.312 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.304+0000 7f31ff1ff740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f31f41a9710 con 0x559a5f9a9ec0 2024-09-19T05:26:11.312 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.305+0000 7f31fa203640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f99c990 0x559a5f9980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:11.312 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.305+0000 7f31faa04640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a5f9a9ec0 0x559a5f9c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:11.312 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.305+0000 7f31faa04640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a5f9a9ec0 0x559a5f9c2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:56676/0 (socket says 172.21.15.120:56676) 2024-09-19T05:26:11.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.305+0000 7f31fa203640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f99c990 0x559a5f9980b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43694/0 (socket says 172.21.15.120:43694) 2024-09-19T05:26:11.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.305+0000 7f31faa04640 1 -- 172.21.15.120:0/2721979590 learned_addr learned my addr 172.21.15.120:0/2721979590 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:26:11.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.305+0000 7f31f9a02640 1 --2- 172.21.15.120:0/2721979590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a5f99d2b0 0x559a5f9c1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:11.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.305+0000 7f31faa04640 1 -- 172.21.15.120:0/2721979590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a5f99d2b0 msgr2=0x559a5f9c1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:11.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.305+0000 7f31faa04640 1 --2- 172.21.15.120:0/2721979590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a5f99d2b0 0x559a5f9c1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.305+0000 7f31faa04640 1 -- 172.21.15.120:0/2721979590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f99c990 msgr2=0x559a5f9980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:11.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.305+0000 7f31faa04640 1 --2- 172.21.15.120:0/2721979590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f99c990 0x559a5f9980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.305+0000 7f31faa04640 1 -- 172.21.15.120:0/2721979590 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a5f9b8a80 con 0x559a5f9a9ec0 2024-09-19T05:26:11.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.305+0000 7f31fa203640 1 --2- 172.21.15.120:0/2721979590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f99c990 0x559a5f9980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:26:11.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.305+0000 7f31f9a02640 1 --2- 172.21.15.120:0/2721979590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a5f99d2b0 0x559a5f9c1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:26:11.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.305+0000 7f31faa04640 1 --2- 172.21.15.120:0/2721979590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a5f9a9ec0 0x559a5f9c2170 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f31ec099120 tx=0x7f31ec004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9a0b4a984ea54ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:11.313 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.305+0000 7f31dffff640 1 -- 172.21.15.120:0/2721979590 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ec0a0b00 con 0x559a5f9a9ec0 2024-09-19T05:26:11.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.305+0000 7f31dffff640 1 -- 172.21.15.120:0/2721979590 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f31ec09ce50 con 0x559a5f9a9ec0 2024-09-19T05:26:11.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.305+0000 7f31dffff640 1 -- 172.21.15.120:0/2721979590 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ec005570 con 0x559a5f9a9ec0 2024-09-19T05:26:11.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.306+0000 7f31ff1ff740 1 -- 172.21.15.120:0/2721979590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a5f9a9ec0 msgr2=0x559a5f9c2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:11.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.306+0000 7f31ff1ff740 1 --2- 172.21.15.120:0/2721979590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a5f9a9ec0 0x559a5f9c2170 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f31ec099120 tx=0x7f31ec004ab0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.306+0000 7f31ff1ff740 1 -- 172.21.15.120:0/2721979590 shutdown_connections 2024-09-19T05:26:11.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.306+0000 7f31ff1ff740 1 --2- 172.21.15.120:0/2721979590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a5f9a9ec0 0x559a5f9c2170 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.306+0000 7f31ff1ff740 1 --2- 172.21.15.120:0/2721979590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a5f99d2b0 0x559a5f9c1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.306+0000 7f31ff1ff740 1 --2- 172.21.15.120:0/2721979590 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f99c990 0x559a5f9980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.306+0000 7f31ff1ff740 1 -- 172.21.15.120:0/2721979590 >> 172.21.15.120:0/2721979590 conn(0x559a5f999060 msgr2=0x559a5f9979a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:11.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.306+0000 7f31ff1ff740 1 -- 172.21.15.120:0/2721979590 shutdown_connections 2024-09-19T05:26:11.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.306+0000 7f31ff1ff740 1 -- 172.21.15.120:0/2721979590 wait complete. 2024-09-19T05:26:11.314 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.306+0000 7f31ff1ff740 1 -- start start 2024-09-19T05:26:11.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.306+0000 7f31ff1ff740 1 Processor -- start 2024-09-19T05:26:11.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31ff1ff740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a5f99c990 0x559a5f9b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:11.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31ff1ff740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a5f99d2b0 0x559a5f9b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:11.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31ff1ff740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f9a9ec0 0x559a5f9a3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:11.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31ff1ff740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f31f41a9d60 con 0x559a5f9a9ec0 2024-09-19T05:26:11.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31ff1ff740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f31f41ab1d0 con 0x559a5f99d2b0 2024-09-19T05:26:11.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31ff1ff740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f31f41aa430 con 0x559a5f99c990 2024-09-19T05:26:11.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31ff1ff740 10 client.0 _ll_register_callbacks cb 0x7f31f000fc10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:26:11.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31faa04640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f9a9ec0 0x559a5f9a3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:11.315 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31faa04640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f9a9ec0 0x559a5f9a3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43706/0 (socket says 172.21.15.120:43706) 2024-09-19T05:26:11.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31fa203640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a5f99c990 0x559a5f9b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:11.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31faa04640 1 -- 172.21.15.120:0/1843200943 learned_addr learned my addr 172.21.15.120:0/1843200943 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:26:11.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31f9a02640 1 --2- 172.21.15.120:0/1843200943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a5f99d2b0 0x559a5f9b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:11.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31faa04640 1 -- 172.21.15.120:0/1843200943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a5f99c990 msgr2=0x559a5f9b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:11.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31faa04640 1 --2- 172.21.15.120:0/1843200943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a5f99c990 0x559a5f9b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31faa04640 1 -- 172.21.15.120:0/1843200943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a5f99d2b0 msgr2=0x559a5f9b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:11.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31faa04640 1 --2- 172.21.15.120:0/1843200943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a5f99d2b0 0x559a5f9b25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31faa04640 1 -- 172.21.15.120:0/1843200943 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a5f9a3e20 con 0x559a5f9a9ec0 2024-09-19T05:26:11.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31fa203640 1 --2- 172.21.15.120:0/1843200943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a5f99c990 0x559a5f9b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:26:11.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31f9a02640 1 --2- 172.21.15.120:0/1843200943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a5f99d2b0 0x559a5f9b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:26:11.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31faa04640 1 --2- 172.21.15.120:0/1843200943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f9a9ec0 0x559a5f9a3620 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f31ec098bb0 tx=0x7f31ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da6b4fee0d13bf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:11.316 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:26:11.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31ddffb640 1 -- 172.21.15.120:0/1843200943 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31ec0c1060 con 0x559a5f9a9ec0 2024-09-19T05:26:11.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31ddffb640 1 -- 172.21.15.120:0/1843200943 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8643+0+0 (secure 0 0 0) 0x7f31ec005310 con 0x559a5f9a9ec0 2024-09-19T05:26:11.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31ff1ff740 1 -- 172.21.15.120:0/1843200943 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31ec09ce50 con 0x559a5f9a9ec0 2024-09-19T05:26:11.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31ddffb640 1 -- 172.21.15.120:0/1843200943 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f31ec0bb170 con 0x559a5f9a9ec0 2024-09-19T05:26:11.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31ff1ff740 10 client.16296 fetch_fsmap learned FSMap version 33 2024-09-19T05:26:11.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.307+0000 7f31ff1ff740 1 -- 172.21.15.120:0/1843200943 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x559a5fa24620 con 0x559a5f9a9ec0 2024-09-19T05:26:11.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.308+0000 7f31ddffb640 1 -- 172.21.15.120:0/1843200943 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f31ec09ce50 con 0x559a5f9a9ec0 2024-09-19T05:26:11.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.308+0000 7f31ddffb640 1 -- 172.21.15.120:0/1843200943 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f31ec0672c0 con 0x559a5f9a9ec0 2024-09-19T05:26:11.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.308+0000 7f31ff1ff740 10 client.16296 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T05:26:11.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.308+0000 7f31ff1ff740 10 client.16296 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:26:11.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.308+0000 7f31ff1ff740 20 client.16296 populate_metadata read hostname 'smithi120' 2024-09-19T05:26:11.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.308+0000 7f31ff1ff740 1 --2- 172.21.15.120:0/1843200943 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x559a5fa248a0 0x559a5fa26c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:11.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.308+0000 7f31ff1ff740 4 client.16296 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:26:11.317 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.308+0000 7f31ff1ff740 1 -- 172.21.15.120:0/1843200943 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559a5f908d70 con 0x559a5fa248a0 2024-09-19T05:26:11.318 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.308+0000 7f31fa203640 1 --2- 172.21.15.120:0/1843200943 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x559a5fa248a0 0x559a5fa26c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:11.318 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.308+0000 7f31ddffb640 10 client.16296 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:26:11.318 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.308+0000 7f31fa203640 1 --2- 172.21.15.120:0/1843200943 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x559a5fa248a0 0x559a5fa26c90 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76fdf9d6dc44ff73 server_cookie=1e68ac675a7b2d43 in_seq=0 out_seq=0 2024-09-19T05:26:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.643+0000 7f31ddffb640 1 -- 172.21.15.120:0/1843200943 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559a5f908d70 con 0x559a5fa248a0 2024-09-19T05:26:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.643+0000 7f31ddffb640 10 client.16296 handle_command_reply: tid=0 2024-09-19T05:26:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.643+0000 7f31ff1ff740 1 client.16296 shutdown 2024-09-19T05:26:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.643+0000 7f31ff1ff740 1 -- 172.21.15.120:0/1843200943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f9a9ec0 msgr2=0x559a5f9a3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.643+0000 7f31ff1ff740 1 --2- 172.21.15.120:0/1843200943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f9a9ec0 0x559a5f9a3620 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f31ec098bb0 tx=0x7f31ec004a40 comp rx=0 tx=0).stop 2024-09-19T05:26:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.643+0000 7f31ff1ff740 1 -- 172.21.15.120:0/1843200943 shutdown_connections 2024-09-19T05:26:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.643+0000 7f31ff1ff740 1 --2- 172.21.15.120:0/1843200943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x559a5f9a9ec0 0x559a5f9a3620 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.643+0000 7f31ff1ff740 1 --2- 172.21.15.120:0/1843200943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559a5f99d2b0 0x559a5f9b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.643+0000 7f31ff1ff740 1 --2- 172.21.15.120:0/1843200943 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x559a5fa248a0 0x559a5fa26c90 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.643+0000 7f31ddffb640 0 client.16296 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:26:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.643+0000 7f31ff1ff740 1 --2- 172.21.15.120:0/1843200943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a5f99c990 0x559a5f9b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.643+0000 7f31ff1ff740 1 -- 172.21.15.120:0/1843200943 >> 172.21.15.120:0/1843200943 conn(0x559a5f999060 msgr2=0x559a5f9981c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.643+0000 7f31ff1ff740 1 -- 172.21.15.120:0/1843200943 shutdown_connections 2024-09-19T05:26:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.643+0000 7f31ff1ff740 1 -- 172.21.15.120:0/1843200943 wait complete. 2024-09-19T05:26:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.643+0000 7f31ff1ff740 20 client.16296 trim_cache size 0 max 16384 2024-09-19T05:26:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:26:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:26:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:26:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:26:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.644+0000 7f31fc467640 1 -- 172.21.15.120:0/3713205688 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f31e00a3460 msgr2=0x7f31e00a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.644+0000 7f31fc467640 1 --2- 172.21.15.120:0/3713205688 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f31e00a3460 0x7f31e00a5920 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f31f0005e00 tx=0x7f31f0005c50 comp rx=0 tx=0).stop 2024-09-19T05:26:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.644+0000 7f31fc467640 1 -- 172.21.15.120:0/3713205688 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31f41069c0 msgr2=0x7f31f419ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.644+0000 7f31fc467640 1 --2- 172.21.15.120:0/3713205688 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31f41069c0 0x7f31f419ba50 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f31ec00eb10 tx=0x7f31ec00c2d0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.644+0000 7f31fc467640 1 -- 172.21.15.120:0/3713205688 shutdown_connections 2024-09-19T05:26:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.644+0000 7f31fc467640 1 --2- 172.21.15.120:0/3713205688 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f31e00a3460 0x7f31e00a5920 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.644+0000 7f31fc467640 1 --2- 172.21.15.120:0/3713205688 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f31f41069c0 0x7f31f419ba50 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.644+0000 7f31fc467640 1 --2- 172.21.15.120:0/3713205688 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31f4101350 0x7f31f41976d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.644+0000 7f31fc467640 1 --2- 172.21.15.120:0/3713205688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31f41009b0 0x7f31f4197190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.644+0000 7f31fc467640 1 -- 172.21.15.120:0/3713205688 >> 172.21.15.120:0/3713205688 conn(0x7f31f4077990 msgr2=0x7f31f4103750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.644+0000 7f31fc467640 1 -- 172.21.15.120:0/3713205688 shutdown_connections 2024-09-19T05:26:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:11.644+0000 7f31fc467640 1 -- 172.21.15.120:0/3713205688 wait complete. 2024-09-19T05:26:12.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:12 smithi120 ceph-mon[30956]: pgmap v212: 97 pgs: 97 active+clean; 548 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 398 op/s 2024-09-19T05:26:12.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:12 smithi120 ceph-mon[30956]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T05:26:12.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:12 smithi194 ceph-mon[35228]: pgmap v212: 97 pgs: 97 active+clean; 548 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 398 op/s 2024-09-19T05:26:12.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:12 smithi194 ceph-mon[35228]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T05:26:12.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:12 smithi178 ceph-mon[34347]: pgmap v212: 97 pgs: 97 active+clean; 548 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.8 MiB/s wr, 398 op/s 2024-09-19T05:26:12.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:12 smithi178 ceph-mon[34347]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T05:26:14.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:14 smithi120 ceph-mon[30956]: pgmap v214: 97 pgs: 97 active+clean; 544 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 370 op/s 2024-09-19T05:26:14.411 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:14 smithi194 ceph-mon[35228]: pgmap v214: 97 pgs: 97 active+clean; 544 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 370 op/s 2024-09-19T05:26:14.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:14 smithi178 ceph-mon[34347]: pgmap v214: 97 pgs: 97 active+clean; 544 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 370 op/s 2024-09-19T05:26:16.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:16 smithi120 ceph-mon[30956]: pgmap v215: 97 pgs: 97 active+clean; 544 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 370 op/s 2024-09-19T05:26:16.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:16 smithi194 ceph-mon[35228]: pgmap v215: 97 pgs: 97 active+clean; 544 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 370 op/s 2024-09-19T05:26:16.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:16 smithi178 ceph-mon[34347]: pgmap v215: 97 pgs: 97 active+clean; 544 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 370 op/s 2024-09-19T05:26:18.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:18 smithi120 ceph-mon[30956]: pgmap v216: 97 pgs: 97 active+clean; 546 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 430 op/s 2024-09-19T05:26:18.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:18 smithi194 ceph-mon[35228]: pgmap v216: 97 pgs: 97 active+clean; 546 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 430 op/s 2024-09-19T05:26:18.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:18 smithi178 ceph-mon[34347]: pgmap v216: 97 pgs: 97 active+clean; 546 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 430 op/s 2024-09-19T05:26:20.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:20 smithi120 ceph-mon[30956]: pgmap v217: 97 pgs: 97 active+clean; 546 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 430 op/s 2024-09-19T05:26:20.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:20 smithi194 ceph-mon[35228]: pgmap v217: 97 pgs: 97 active+clean; 546 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 430 op/s 2024-09-19T05:26:20.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:20 smithi178 ceph-mon[34347]: pgmap v217: 97 pgs: 97 active+clean; 546 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.6 MiB/s wr, 430 op/s 2024-09-19T05:26:22.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:22 smithi120 ceph-mon[30956]: pgmap v218: 97 pgs: 97 active+clean; 543 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 418 op/s 2024-09-19T05:26:22.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:22 smithi194 ceph-mon[35228]: pgmap v218: 97 pgs: 97 active+clean; 543 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 418 op/s 2024-09-19T05:26:22.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:22 smithi178 ceph-mon[34347]: pgmap v218: 97 pgs: 97 active+clean; 543 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 418 op/s 2024-09-19T05:26:24.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:24 smithi120 ceph-mon[30956]: pgmap v219: 97 pgs: 97 active+clean; 545 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 367 op/s 2024-09-19T05:26:24.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:24 smithi194 ceph-mon[35228]: pgmap v219: 97 pgs: 97 active+clean; 545 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 367 op/s 2024-09-19T05:26:24.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:24 smithi178 ceph-mon[34347]: pgmap v219: 97 pgs: 97 active+clean; 545 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 367 op/s 2024-09-19T05:26:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.765+0000 7f1a55af1640 1 -- 172.21.15.120:0/1238029020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a5010c0b0 msgr2=0x7f1a5010e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.765+0000 7f1a55af1640 1 --2- 172.21.15.120:0/1238029020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a5010c0b0 0x7f1a5010e550 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1a40009860 tx=0x7f1a4002a3d0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.765+0000 7f1a55af1640 1 -- 172.21.15.120:0/1238029020 shutdown_connections 2024-09-19T05:26:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.765+0000 7f1a55af1640 1 --2- 172.21.15.120:0/1238029020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a5010c0b0 0x7f1a5010e550 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.765+0000 7f1a55af1640 1 --2- 172.21.15.120:0/1238029020 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a50103600 0x7f1a5010bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.765+0000 7f1a55af1640 1 --2- 172.21.15.120:0/1238029020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a50102ce0 0x7f1a501030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.765+0000 7f1a55af1640 1 -- 172.21.15.120:0/1238029020 >> 172.21.15.120:0/1238029020 conn(0x7f1a50077990 msgr2=0x7f1a500fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.765+0000 7f1a55af1640 1 -- 172.21.15.120:0/1238029020 shutdown_connections 2024-09-19T05:26:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.765+0000 7f1a55af1640 1 -- 172.21.15.120:0/1238029020 wait complete. 2024-09-19T05:26:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.766+0000 7f1a55af1640 1 Processor -- start 2024-09-19T05:26:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.766+0000 7f1a55af1640 1 -- start start 2024-09-19T05:26:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.767+0000 7f1a55af1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a50102ce0 0x7f1a5010b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.767+0000 7f1a55af1640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a50103600 0x7f1a501056e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.767+0000 7f1a55af1640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a5010c0b0 0x7f1a50105c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.767+0000 7f1a55af1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5006c4d0 con 0x7f1a50102ce0 2024-09-19T05:26:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.767+0000 7f1a55af1640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5006c350 con 0x7f1a50103600 2024-09-19T05:26:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.767+0000 7f1a55af1640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5006c650 con 0x7f1a5010c0b0 2024-09-19T05:26:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.767+0000 7f1a4ffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a5010c0b0 0x7f1a50105c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.767+0000 7f1a4ffff640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a5010c0b0 0x7f1a50105c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:56520/0 (socket says 172.21.15.120:56520) 2024-09-19T05:26:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.767+0000 7f1a4ffff640 1 -- 172.21.15.120:0/2694370389 learned_addr learned my addr 172.21.15.120:0/2694370389 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:26:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.767+0000 7f1a4f7fe640 1 --2- 172.21.15.120:0/2694370389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a50102ce0 0x7f1a5010b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.767+0000 7f1a4ffff640 1 -- 172.21.15.120:0/2694370389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a50103600 msgr2=0x7f1a501056e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T05:26:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.767+0000 7f1a4ffff640 1 --2- 172.21.15.120:0/2694370389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a50103600 0x7f1a501056e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.767+0000 7f1a4ffff640 1 -- 172.21.15.120:0/2694370389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a50102ce0 msgr2=0x7f1a5010b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.767+0000 7f1a4ffff640 1 --2- 172.21.15.120:0/2694370389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a50102ce0 0x7f1a5010b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.768+0000 7f1a4ffff640 1 -- 172.21.15.120:0/2694370389 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a50106210 con 0x7f1a5010c0b0 2024-09-19T05:26:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.768+0000 7f1a4ffff640 1 --2- 172.21.15.120:0/2694370389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a5010c0b0 0x7f1a50105c20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1a40009980 tx=0x7f1a40030f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.768+0000 7f1a4cff9640 1 -- 172.21.15.120:0/2694370389 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a40040070 con 0x7f1a5010c0b0 2024-09-19T05:26:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.768+0000 7f1a55af1640 1 -- 172.21.15.120:0/2694370389 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a501064a0 con 0x7f1a5010c0b0 2024-09-19T05:26:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.768+0000 7f1a55af1640 1 -- 172.21.15.120:0/2694370389 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a50100b50 con 0x7f1a5010c0b0 2024-09-19T05:26:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.768+0000 7f1a4cff9640 1 -- 172.21.15.120:0/2694370389 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a40005520 con 0x7f1a5010c0b0 2024-09-19T05:26:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.768+0000 7f1a4cff9640 1 -- 172.21.15.120:0/2694370389 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a40004920 con 0x7f1a5010c0b0 2024-09-19T05:26:24.773 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.772+0000 7f1a58892740 1 Processor -- start 2024-09-19T05:26:24.774 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.772+0000 7f1a4cff9640 1 -- 172.21.15.120:0/2694370389 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f1a40043070 con 0x7f1a5010c0b0 2024-09-19T05:26:24.774 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.772+0000 7f1a58892740 1 -- start start 2024-09-19T05:26:24.777 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.772+0000 7f1a58892740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ce3489300 0x556ce34896e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:24.777 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.772+0000 7f1a58892740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ce3489c20 0x556ce3493f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.773+0000 7f1a58892740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ce34944c0 0x556ce34968b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.773+0000 7f1a58892740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556ce33e52f0 con 0x556ce3489c20 2024-09-19T05:26:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.773+0000 7f1a58892740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x556ce338d270 con 0x556ce3489300 2024-09-19T05:26:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.773+0000 7f1a58892740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x556ce33e12b0 con 0x556ce34944c0 2024-09-19T05:26:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.773+0000 7f1a4effd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ce3489300 0x556ce34896e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.773+0000 7f1a4effd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ce34944c0 0x556ce34968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.773+0000 7f1a4effd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ce34944c0 0x556ce34968b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:56528/0 (socket says 172.21.15.120:56528) 2024-09-19T05:26:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.773+0000 7f1a4effd640 1 -- 172.21.15.120:0/3179716284 learned_addr learned my addr 172.21.15.120:0/3179716284 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:26:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.773+0000 7f1a4f7fe640 1 --2- 172.21.15.120:0/3179716284 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ce3489c20 0x556ce3493f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.773+0000 7f1a4cff9640 1 --2- 172.21.15.120:0/2694370389 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1a380a35b0 0x7f1a380a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.773+0000 7f1a4effd640 1 -- 172.21.15.120:0/3179716284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ce3489300 msgr2=0x556ce34896e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.773+0000 7f1a4effd640 1 --2- 172.21.15.120:0/3179716284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ce3489300 0x556ce34896e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.773+0000 7f1a4effd640 1 -- 172.21.15.120:0/3179716284 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ce3489c20 msgr2=0x556ce3493f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.773+0000 7f1a4effd640 1 --2- 172.21.15.120:0/3179716284 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ce3489c20 0x556ce3493f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.773+0000 7f1a4effd640 1 -- 172.21.15.120:0/3179716284 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ce338c340 con 0x556ce34944c0 2024-09-19T05:26:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.773+0000 7f1a4cff9640 1 -- 172.21.15.120:0/2694370389 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8643+0+0 (secure 0 0 0) 0x7f1a400f07e0 con 0x7f1a5010c0b0 2024-09-19T05:26:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.774+0000 7f1a4effd640 1 --2- 172.21.15.120:0/3179716284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ce34944c0 0x556ce34968b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1a44009fd0 tx=0x7f1a44009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f2766b90af5b444 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.774+0000 7f1a4ffff640 1 --2- 172.21.15.120:0/2694370389 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1a380a35b0 0x7f1a380a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.774+0000 7f1a4ffff640 1 --2- 172.21.15.120:0/2694370389 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1a380a35b0 0x7f1a380a5a70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1a400b8e40 tx=0x7f1a4002a3d0 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.775+0000 7f1a35ffb640 1 -- 172.21.15.120:0/3179716284 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44013d30 con 0x556ce34944c0 2024-09-19T05:26:24.779 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.775+0000 7f1a35ffb640 1 -- 172.21.15.120:0/3179716284 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a440054d0 con 0x556ce34944c0 2024-09-19T05:26:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.776+0000 7f1a58892740 1 -- 172.21.15.120:0/3179716284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ce34944c0 msgr2=0x556ce34968b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.776+0000 7f1a58892740 1 --2- 172.21.15.120:0/3179716284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ce34944c0 0x556ce34968b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1a44009fd0 tx=0x7f1a44009260 comp rx=0 tx=0).stop 2024-09-19T05:26:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.776+0000 7f1a58892740 1 -- 172.21.15.120:0/3179716284 shutdown_connections 2024-09-19T05:26:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.776+0000 7f1a58892740 1 --2- 172.21.15.120:0/3179716284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ce34944c0 0x556ce34968b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.776+0000 7f1a58892740 1 --2- 172.21.15.120:0/3179716284 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ce3489c20 0x556ce3493f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.776+0000 7f1a58892740 1 --2- 172.21.15.120:0/3179716284 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ce3489300 0x556ce34896e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.776+0000 7f1a58892740 1 -- 172.21.15.120:0/3179716284 >> 172.21.15.120:0/3179716284 conn(0x556ce3485870 msgr2=0x556ce3485c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.776+0000 7f1a58892740 1 -- 172.21.15.120:0/3179716284 shutdown_connections 2024-09-19T05:26:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.776+0000 7f1a58892740 1 -- 172.21.15.120:0/3179716284 wait complete. 2024-09-19T05:26:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.777+0000 7f1a58892740 1 -- start start 2024-09-19T05:26:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.777+0000 7f1a58892740 1 Processor -- start 2024-09-19T05:26:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.778+0000 7f1a58892740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ce3489300 0x556ce34912d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.778+0000 7f1a58892740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ce3489c20 0x556ce3491810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.778+0000 7f1a58892740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ce34944c0 0x556ce3491d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.778+0000 7f1a58892740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x556ce34970e0 con 0x556ce3489c20 2024-09-19T05:26:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.778+0000 7f1a58892740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x556ce336e290 con 0x556ce3489300 2024-09-19T05:26:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.778+0000 7f1a58892740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x556ce3497260 con 0x556ce34944c0 2024-09-19T05:26:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.778+0000 7f1a58892740 10 client.0 _ll_register_callbacks cb 0x556ce339f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:26:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.778+0000 7f1a4effd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ce3489300 0x556ce34912d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.778+0000 7f1a4effd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ce3489300 0x556ce34912d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.120:45362/0 (socket says 172.21.15.120:45362) 2024-09-19T05:26:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.778+0000 7f1a4effd640 1 -- 172.21.15.120:0/3265740414 learned_addr learned my addr 172.21.15.120:0/3265740414 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:26:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.778+0000 7f1a4f7fe640 1 --2- 172.21.15.120:0/3265740414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ce3489c20 0x556ce3491810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.778+0000 7f1a4effd640 1 --2- 172.21.15.120:0/3265740414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ce34944c0 0x556ce3491d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.779+0000 7f1a4f7fe640 1 -- 172.21.15.120:0/3265740414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ce34944c0 msgr2=0x556ce3491d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.779+0000 7f1a4f7fe640 1 --2- 172.21.15.120:0/3265740414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ce34944c0 0x556ce3491d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.779+0000 7f1a4f7fe640 1 -- 172.21.15.120:0/3265740414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ce3489300 msgr2=0x556ce34912d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.779+0000 7f1a4f7fe640 1 --2- 172.21.15.120:0/3265740414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ce3489300 0x556ce34912d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.779+0000 7f1a4f7fe640 1 -- 172.21.15.120:0/3265740414 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ce30f8210 con 0x556ce3489c20 2024-09-19T05:26:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.779+0000 7f1a4f7fe640 1 --2- 172.21.15.120:0/3265740414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ce3489c20 0x556ce3491810 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1a48005fd0 tx=0x7f1a4800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2539bc714e1ef525 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.779+0000 7f1a2effd640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:26:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.780+0000 7f1a2effd640 1 -- 172.21.15.120:0/3265740414 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a48003970 con 0x556ce3489c20 2024-09-19T05:26:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.780+0000 7f1a2effd640 1 -- 172.21.15.120:0/3265740414 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8643+0+0 (secure 0 0 0) 0x7f1a48003b10 con 0x556ce3489c20 2024-09-19T05:26:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.780+0000 7f1a58892740 1 -- 172.21.15.120:0/3265740414 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a440054d0 con 0x556ce3489c20 2024-09-19T05:26:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.780+0000 7f1a2effd640 1 -- 172.21.15.120:0/3265740414 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1a48003d10 con 0x556ce3489c20 2024-09-19T05:26:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.780+0000 7f1a58892740 10 client.16308 fetch_fsmap learned FSMap version 33 2024-09-19T05:26:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.780+0000 7f1a58892740 1 -- 172.21.15.120:0/3265740414 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x556ce31c4620 con 0x556ce3489c20 2024-09-19T05:26:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.781+0000 7f1a2effd640 1 -- 172.21.15.120:0/3265740414 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a440054d0 con 0x556ce3489c20 2024-09-19T05:26:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.781+0000 7f1a2effd640 1 -- 172.21.15.120:0/3265740414 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f1a48019510 con 0x556ce3489c20 2024-09-19T05:26:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.781+0000 7f1a58892740 10 client.16308 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T05:26:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.781+0000 7f1a58892740 10 client.16308 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:26:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.781+0000 7f1a58892740 20 client.16308 populate_metadata read hostname 'smithi120' 2024-09-19T05:26:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.781+0000 7f1a58892740 1 --2- 172.21.15.120:0/3265740414 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556ce34a4590 0x556ce34a69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.781+0000 7f1a58892740 4 client.16308 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:26:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.781+0000 7f1a58892740 1 -- 172.21.15.120:0/3265740414 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ce33f2a20 con 0x556ce34a4590 2024-09-19T05:26:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.781+0000 7f1a4effd640 1 --2- 172.21.15.120:0/3265740414 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556ce34a4590 0x556ce34a69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.782+0000 7f1a4effd640 1 --2- 172.21.15.120:0/3265740414 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556ce34a4590 0x556ce34a69a0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91fa5bafcf4bf228 server_cookie=f481500a595a4f79 in_seq=0 out_seq=0 2024-09-19T05:26:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.782+0000 7f1a2effd640 10 client.16308 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:26:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.783+0000 7f1a2effd640 1 -- 172.21.15.120:0/3265740414 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556ce33f2a20 con 0x556ce34a4590 2024-09-19T05:26:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.783+0000 7f1a2effd640 10 client.16308 handle_command_reply: tid=0 2024-09-19T05:26:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.783+0000 7f1a58892740 1 client.16308 shutdown 2024-09-19T05:26:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.784+0000 7f1a58892740 1 -- 172.21.15.120:0/3265740414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ce3489c20 msgr2=0x556ce3491810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.784+0000 7f1a58892740 1 --2- 172.21.15.120:0/3265740414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ce3489c20 0x556ce3491810 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1a48005fd0 tx=0x7f1a4800f790 comp rx=0 tx=0).stop 2024-09-19T05:26:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.784+0000 7f1a58892740 1 -- 172.21.15.120:0/3265740414 shutdown_connections 2024-09-19T05:26:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.784+0000 7f1a58892740 1 --2- 172.21.15.120:0/3265740414 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556ce34a4590 0x556ce34a69a0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.784+0000 7f1a2effd640 0 client.16308 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:26:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.784+0000 7f1a58892740 1 --2- 172.21.15.120:0/3265740414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ce34944c0 0x556ce3491d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.784+0000 7f1a58892740 1 --2- 172.21.15.120:0/3265740414 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ce3489c20 0x556ce3491810 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.784+0000 7f1a58892740 1 --2- 172.21.15.120:0/3265740414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ce3489300 0x556ce34912d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.784+0000 7f1a58892740 1 -- 172.21.15.120:0/3265740414 >> 172.21.15.120:0/3265740414 conn(0x556ce3485870 msgr2=0x556ce347c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.784+0000 7f1a58892740 1 -- 172.21.15.120:0/3265740414 shutdown_connections 2024-09-19T05:26:24.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.784+0000 7f1a58892740 1 -- 172.21.15.120:0/3265740414 wait complete. 2024-09-19T05:26:24.789 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.784+0000 7f1a58892740 20 client.16308 trim_cache size 0 max 16384 2024-09-19T05:26:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.804+0000 7f1a58892740 1 Processor -- start 2024-09-19T05:26:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.804+0000 7f1a58892740 1 -- start start 2024-09-19T05:26:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.804+0000 7f1a58892740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ce3489300 0x556ce348fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.804+0000 7f1a58892740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ce3489c20 0x556ce3491b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.804+0000 7f1a58892740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ce34944c0 0x556ce34ac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.804+0000 7f1a58892740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c011420 con 0x556ce3489c20 2024-09-19T05:26:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.804+0000 7f1a58892740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c00ec30 con 0x556ce3489300 2024-09-19T05:26:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.804+0000 7f1a58892740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c00caa0 con 0x556ce34944c0 2024-09-19T05:26:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.804+0000 7f1a4f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ce3489c20 0x556ce3491b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.804+0000 7f1a4f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ce3489c20 0x556ce3491b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:56746/0 (socket says 172.21.15.120:56746) 2024-09-19T05:26:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.804+0000 7f1a4f7fe640 1 -- 172.21.15.120:0/841236708 learned_addr learned my addr 172.21.15.120:0/841236708 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:26:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.804+0000 7f1a4effd640 1 --2- 172.21.15.120:0/841236708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ce3489300 0x556ce348fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.804+0000 7f1a4effd640 1 --2- 172.21.15.120:0/841236708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ce34944c0 0x556ce34ac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.805+0000 7f1a4f7fe640 1 -- 172.21.15.120:0/841236708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ce34944c0 msgr2=0x556ce34ac2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.805+0000 7f1a4f7fe640 1 --2- 172.21.15.120:0/841236708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ce34944c0 0x556ce34ac2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.805+0000 7f1a4f7fe640 1 -- 172.21.15.120:0/841236708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ce3489300 msgr2=0x556ce348fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.805+0000 7f1a4f7fe640 1 --2- 172.21.15.120:0/841236708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ce3489300 0x556ce348fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.805+0000 7f1a4f7fe640 1 -- 172.21.15.120:0/841236708 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ce34856a0 con 0x556ce3489c20 2024-09-19T05:26:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.805+0000 7f1a4f7fe640 1 --2- 172.21.15.120:0/841236708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ce3489c20 0x556ce3491b80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1a48011880 tx=0x7f1a480039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa66ec98ecd56b35 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.805+0000 7f1a357fa640 1 -- 172.21.15.120:0/841236708 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4802f070 con 0x556ce3489c20 2024-09-19T05:26:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.805+0000 7f1a357fa640 1 -- 172.21.15.120:0/841236708 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a48003b60 con 0x556ce3489c20 2024-09-19T05:26:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.805+0000 7f1a357fa640 1 -- 172.21.15.120:0/841236708 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4802ba10 con 0x556ce3489c20 2024-09-19T05:26:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.806+0000 7f1a58892740 1 -- 172.21.15.120:0/841236708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ce3489c20 msgr2=0x556ce3491b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.806+0000 7f1a58892740 1 --2- 172.21.15.120:0/841236708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ce3489c20 0x556ce3491b80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1a48011880 tx=0x7f1a480039f0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.806+0000 7f1a58892740 1 -- 172.21.15.120:0/841236708 shutdown_connections 2024-09-19T05:26:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.806+0000 7f1a58892740 1 --2- 172.21.15.120:0/841236708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ce34944c0 0x556ce34ac2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.806+0000 7f1a58892740 1 --2- 172.21.15.120:0/841236708 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ce3489c20 0x556ce3491b80 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.806+0000 7f1a58892740 1 --2- 172.21.15.120:0/841236708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ce3489300 0x556ce348fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.806+0000 7f1a58892740 1 -- 172.21.15.120:0/841236708 >> 172.21.15.120:0/841236708 conn(0x556ce3485870 msgr2=0x556ce3493350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.806+0000 7f1a58892740 1 -- 172.21.15.120:0/841236708 shutdown_connections 2024-09-19T05:26:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.806+0000 7f1a58892740 1 -- 172.21.15.120:0/841236708 wait complete. 2024-09-19T05:26:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.806+0000 7f1a58892740 1 -- start start 2024-09-19T05:26:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.807+0000 7f1a58892740 1 Processor -- start 2024-09-19T05:26:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.807+0000 7f1a58892740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ce3489300 0x556ce3498240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.807+0000 7f1a58892740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ce3489c20 0x556ce3498780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.807+0000 7f1a58892740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ce34944c0 0x556ce3498cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.807+0000 7f1a58892740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c00d0f0 con 0x556ce34944c0 2024-09-19T05:26:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.807+0000 7f1a58892740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c00e560 con 0x556ce3489c20 2024-09-19T05:26:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.807+0000 7f1a58892740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3c00d7c0 con 0x556ce3489300 2024-09-19T05:26:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.807+0000 7f1a58892740 10 client.0 _ll_register_callbacks cb 0x7f1a480118b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:26:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.807+0000 7f1a4effd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ce34944c0 0x556ce3498cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.807+0000 7f1a4effd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ce3489300 0x556ce3498240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.807+0000 7f1a4effd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ce3489300 0x556ce3498240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:56538/0 (socket says 172.21.15.120:56538) 2024-09-19T05:26:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.807+0000 7f1a4effd640 1 -- 172.21.15.120:0/3272363766 learned_addr learned my addr 172.21.15.120:0/3272363766 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:26:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.807+0000 7f1a4f7fe640 1 --2- 172.21.15.120:0/3272363766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ce3489c20 0x556ce3498780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.807+0000 7f1a4effd640 1 -- 172.21.15.120:0/3272363766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ce3489c20 msgr2=0x556ce3498780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.807+0000 7f1a4effd640 1 --2- 172.21.15.120:0/3272363766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ce3489c20 0x556ce3498780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.807+0000 7f1a4effd640 1 -- 172.21.15.120:0/3272363766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ce34944c0 msgr2=0x556ce3498cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.807+0000 7f1a4effd640 1 --2- 172.21.15.120:0/3272363766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ce34944c0 0x556ce3498cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.807+0000 7f1a4effd640 1 -- 172.21.15.120:0/3272363766 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ce350e280 con 0x556ce3489300 2024-09-19T05:26:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.807+0000 7f1a4f7fe640 1 --2- 172.21.15.120:0/3272363766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ce3489c20 0x556ce3498780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:26:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.807+0000 7f1a4effd640 1 --2- 172.21.15.120:0/3272363766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ce3489300 0x556ce3498240 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1a44004cc0 tx=0x7f1a44020040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=668d25e4df3292fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.807+0000 7f1a2effd640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-09-19T05:26:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.808+0000 7f1a2effd640 1 -- 172.21.15.120:0/3272363766 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44028040 con 0x556ce3489300 2024-09-19T05:26:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.808+0000 7f1a58892740 1 -- 172.21.15.120:0/3272363766 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a48003b60 con 0x556ce3489300 2024-09-19T05:26:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.808+0000 7f1a2effd640 1 -- 172.21.15.120:0/3272363766 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8643+0+0 (secure 0 0 0) 0x7f1a44010910 con 0x556ce3489300 2024-09-19T05:26:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.808+0000 7f1a2effd640 1 -- 172.21.15.120:0/3272363766 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1a44010b10 con 0x556ce3489300 2024-09-19T05:26:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.808+0000 7f1a58892740 10 client.25837 fetch_fsmap learned FSMap version 33 2024-09-19T05:26:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.808+0000 7f1a58892740 1 -- 172.21.15.120:0/3272363766 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x556ce350f490 con 0x556ce3489300 2024-09-19T05:26:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.808+0000 7f1a2effd640 1 -- 172.21.15.120:0/3272363766 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f1a48003b60 con 0x556ce3489300 2024-09-19T05:26:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.808+0000 7f1a2effd640 1 -- 172.21.15.120:0/3272363766 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f1a440303e0 con 0x556ce3489300 2024-09-19T05:26:24.815 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.808+0000 7f1a58892740 10 client.25837 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T05:26:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.808+0000 7f1a58892740 10 client.25837 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:26:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.808+0000 7f1a58892740 20 client.25837 populate_metadata read hostname 'smithi120' 2024-09-19T05:26:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.808+0000 7f1a58892740 1 --2- 172.21.15.120:0/3272363766 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556ce34a4590 0x556ce3511ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.808+0000 7f1a58892740 4 client.25837 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:26:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.808+0000 7f1a58892740 1 -- 172.21.15.120:0/3272363766 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556ce33ecd70 con 0x556ce34a4590 2024-09-19T05:26:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.808+0000 7f1a4f7fe640 1 --2- 172.21.15.120:0/3272363766 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556ce34a4590 0x556ce3511ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.809+0000 7f1a2effd640 10 client.25837 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:26:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.809+0000 7f1a4f7fe640 1 --2- 172.21.15.120:0/3272363766 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556ce34a4590 0x556ce3511ac0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd34c3c671729e45 server_cookie=179774a9527acf59 in_seq=0 out_seq=0 2024-09-19T05:26:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.978+0000 7f1a2effd640 1 -- 172.21.15.120:0/3272363766 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556ce33ecd70 con 0x556ce34a4590 2024-09-19T05:26:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.978+0000 7f1a2effd640 10 client.25837 handle_command_reply: tid=0 2024-09-19T05:26:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.978+0000 7f1a58892740 1 client.25837 shutdown 2024-09-19T05:26:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.978+0000 7f1a58892740 1 -- 172.21.15.120:0/3272363766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ce3489300 msgr2=0x556ce3498240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.978+0000 7f1a58892740 1 --2- 172.21.15.120:0/3272363766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ce3489300 0x556ce3498240 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1a44004cc0 tx=0x7f1a44020040 comp rx=0 tx=0).stop 2024-09-19T05:26:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.978+0000 7f1a58892740 1 -- 172.21.15.120:0/3272363766 shutdown_connections 2024-09-19T05:26:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.978+0000 7f1a58892740 1 --2- 172.21.15.120:0/3272363766 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x556ce34944c0 0x556ce3498cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.978+0000 7f1a58892740 1 --2- 172.21.15.120:0/3272363766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556ce3489c20 0x556ce3498780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.981 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.978+0000 7f1a58892740 1 --2- 172.21.15.120:0/3272363766 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x556ce34a4590 0x556ce3511ac0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.978+0000 7f1a58892740 1 --2- 172.21.15.120:0/3272363766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556ce3489300 0x556ce3498240 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.978+0000 7f1a2effd640 0 client.25837 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:26:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.978+0000 7f1a58892740 1 -- 172.21.15.120:0/3272363766 >> 172.21.15.120:0/3272363766 conn(0x556ce3485870 msgr2=0x556ce347b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.978+0000 7f1a58892740 1 -- 172.21.15.120:0/3272363766 shutdown_connections 2024-09-19T05:26:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.978+0000 7f1a58892740 1 -- 172.21.15.120:0/3272363766 wait complete. 2024-09-19T05:26:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.979+0000 7f1a58892740 20 client.25837 trim_cache size 0 max 16384 2024-09-19T05:26:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:26:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:26:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:26:24.982 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:26:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.979+0000 7f1a55af1640 1 -- 172.21.15.120:0/2694370389 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1a380a35b0 msgr2=0x7f1a380a5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.979+0000 7f1a55af1640 1 --2- 172.21.15.120:0/2694370389 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1a380a35b0 0x7f1a380a5a70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1a400b8e40 tx=0x7f1a4002a3d0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.979+0000 7f1a55af1640 1 -- 172.21.15.120:0/2694370389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a5010c0b0 msgr2=0x7f1a50105c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.979+0000 7f1a55af1640 1 --2- 172.21.15.120:0/2694370389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a5010c0b0 0x7f1a50105c20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1a40009980 tx=0x7f1a40030f10 comp rx=0 tx=0).stop 2024-09-19T05:26:24.983 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.979+0000 7f1a55af1640 1 -- 172.21.15.120:0/2694370389 shutdown_connections 2024-09-19T05:26:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.979+0000 7f1a55af1640 1 --2- 172.21.15.120:0/2694370389 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f1a380a35b0 0x7f1a380a5a70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.979+0000 7f1a55af1640 1 --2- 172.21.15.120:0/2694370389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a5010c0b0 0x7f1a50105c20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.979+0000 7f1a55af1640 1 --2- 172.21.15.120:0/2694370389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a50103600 0x7f1a501056e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.979+0000 7f1a55af1640 1 --2- 172.21.15.120:0/2694370389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1a50102ce0 0x7f1a5010b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.979+0000 7f1a55af1640 1 -- 172.21.15.120:0/2694370389 >> 172.21.15.120:0/2694370389 conn(0x7f1a50077990 msgr2=0x7f1a500fd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.979+0000 7f1a55af1640 1 -- 172.21.15.120:0/2694370389 shutdown_connections 2024-09-19T05:26:24.984 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:24.979+0000 7f1a55af1640 1 -- 172.21.15.120:0/2694370389 wait complete. 2024-09-19T05:26:26.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:26 smithi120 ceph-mon[30956]: pgmap v220: 97 pgs: 97 active+clean; 545 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 347 op/s 2024-09-19T05:26:26.409 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:26 smithi194 ceph-mon[35228]: pgmap v220: 97 pgs: 97 active+clean; 545 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 347 op/s 2024-09-19T05:26:26.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:26 smithi178 ceph-mon[34347]: pgmap v220: 97 pgs: 97 active+clean; 545 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 347 op/s 2024-09-19T05:26:28.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:28 smithi120 ceph-mon[30956]: pgmap v221: 97 pgs: 97 active+clean; 551 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 568 op/s 2024-09-19T05:26:28.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:28 smithi194 ceph-mon[35228]: pgmap v221: 97 pgs: 97 active+clean; 551 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 568 op/s 2024-09-19T05:26:28.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:28 smithi178 ceph-mon[34347]: pgmap v221: 97 pgs: 97 active+clean; 551 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 568 op/s 2024-09-19T05:26:30.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:30 smithi120 ceph-mon[30956]: pgmap v222: 97 pgs: 97 active+clean; 551 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 359 op/s 2024-09-19T05:26:30.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:30 smithi194 ceph-mon[35228]: pgmap v222: 97 pgs: 97 active+clean; 551 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 359 op/s 2024-09-19T05:26:30.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:30 smithi178 ceph-mon[34347]: pgmap v222: 97 pgs: 97 active+clean; 551 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 359 op/s 2024-09-19T05:26:32.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:32 smithi120 ceph-mon[30956]: pgmap v223: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 463 op/s 2024-09-19T05:26:32.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:32 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:26:32.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:32 smithi194 ceph-mon[35228]: pgmap v223: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 463 op/s 2024-09-19T05:26:32.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:32 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:26:32.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:32 smithi178 ceph-mon[34347]: pgmap v223: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 463 op/s 2024-09-19T05:26:32.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:32 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:26:33.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:33 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:26:33.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:33 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:26:33.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:33 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:26:33.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:33 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:26:33.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:33 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:26:33.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:33 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:26:33.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:33 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:26:33.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:33 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:26:33.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:33 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:26:34.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:34 smithi178 ceph-mon[34347]: pgmap v224: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 411 op/s 2024-09-19T05:26:34.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:34 smithi120 ceph-mon[30956]: pgmap v224: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 411 op/s 2024-09-19T05:26:34.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:34 smithi194 ceph-mon[35228]: pgmap v224: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 411 op/s 2024-09-19T05:26:36.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:36 smithi178 ceph-mon[34347]: pgmap v225: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 366 op/s 2024-09-19T05:26:36.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:36 smithi120 ceph-mon[30956]: pgmap v225: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 366 op/s 2024-09-19T05:26:36.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:36 smithi194 ceph-mon[35228]: pgmap v225: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 366 op/s 2024-09-19T05:26:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.068+0000 7f9c893e4640 1 -- 172.21.15.120:0/878120081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c84105520 msgr2=0x7f9c8410d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.068+0000 7f9c893e4640 1 --2- 172.21.15.120:0/878120081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c84105520 0x7f9c8410d070 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c009ca0 tx=0x7f9c7c02a8c0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.068+0000 7f9c893e4640 1 -- 172.21.15.120:0/878120081 shutdown_connections 2024-09-19T05:26:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.068+0000 7f9c893e4640 1 --2- 172.21.15.120:0/878120081 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c84105520 0x7f9c8410d070 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.068+0000 7f9c893e4640 1 --2- 172.21.15.120:0/878120081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c841011e0 0x7f9c84104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.068+0000 7f9c893e4640 1 --2- 172.21.15.120:0/878120081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c84100830 0x7f9c84100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.068+0000 7f9c893e4640 1 -- 172.21.15.120:0/878120081 >> 172.21.15.120:0/878120081 conn(0x7f9c84075f20 msgr2=0x7f9c84076330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.068+0000 7f9c893e4640 1 -- 172.21.15.120:0/878120081 shutdown_connections 2024-09-19T05:26:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.068+0000 7f9c893e4640 1 -- 172.21.15.120:0/878120081 wait complete. 2024-09-19T05:26:38.071 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.069+0000 7f9c893e4640 1 Processor -- start 2024-09-19T05:26:38.072 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.069+0000 7f9c893e4640 1 -- start start 2024-09-19T05:26:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.069+0000 7f9c893e4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c84100830 0x7f9c84198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.069+0000 7f9c893e4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c841011e0 0x7f9c841987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:38.073 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.069+0000 7f9c893e4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c84105520 0x7f9c8419cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.069+0000 7f9c893e4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9c84110440 con 0x7f9c84105520 2024-09-19T05:26:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.069+0000 7f9c893e4640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9c841102c0 con 0x7f9c841011e0 2024-09-19T05:26:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.069+0000 7f9c893e4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9c841105c0 con 0x7f9c84100830 2024-09-19T05:26:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.069+0000 7f9c82ffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c84100830 0x7f9c84198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.069+0000 7f9c82ffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c84100830 0x7f9c84198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:38500/0 (socket says 172.21.15.120:38500) 2024-09-19T05:26:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.069+0000 7f9c82ffd640 1 -- 172.21.15.120:0/2569038431 learned_addr learned my addr 172.21.15.120:0/2569038431 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:26:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.069+0000 7f9c837fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c84105520 0x7f9c8419cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.069+0000 7f9c827fc640 1 --2- 172.21.15.120:0/2569038431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c841011e0 0x7f9c841987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.070+0000 7f9c82ffd640 1 -- 172.21.15.120:0/2569038431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c841011e0 msgr2=0x7f9c841987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.070+0000 7f9c82ffd640 1 --2- 172.21.15.120:0/2569038431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c841011e0 0x7f9c841987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.070+0000 7f9c82ffd640 1 -- 172.21.15.120:0/2569038431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c84105520 msgr2=0x7f9c8419cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:38.074 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.070+0000 7f9c82ffd640 1 --2- 172.21.15.120:0/2569038431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c84105520 0x7f9c8419cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.070+0000 7f9c82ffd640 1 -- 172.21.15.120:0/2569038431 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c8419d260 con 0x7f9c84100830 2024-09-19T05:26:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.070+0000 7f9c837fe640 1 --2- 172.21.15.120:0/2569038431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c84105520 0x7f9c8419cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:26:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.070+0000 7f9c82ffd640 1 --2- 172.21.15.120:0/2569038431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c84100830 0x7f9c84198270 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400e9f0 tx=0x7f9c7400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.070+0000 7f9c6bfff640 1 -- 172.21.15.120:0/2569038431 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7400cd80 con 0x7f9c84100830 2024-09-19T05:26:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.070+0000 7f9c893e4640 1 -- 172.21.15.120:0/2569038431 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c8419d550 con 0x7f9c84100830 2024-09-19T05:26:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.070+0000 7f9c6bfff640 1 -- 172.21.15.120:0/2569038431 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c740054d0 con 0x7f9c84100830 2024-09-19T05:26:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.070+0000 7f9c6bfff640 1 -- 172.21.15.120:0/2569038431 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c74010490 con 0x7f9c84100830 2024-09-19T05:26:38.075 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.070+0000 7f9c893e4640 1 -- 172.21.15.120:0/2569038431 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c841a4de0 con 0x7f9c84100830 2024-09-19T05:26:38.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.073+0000 7f9c8c255740 1 Processor -- start 2024-09-19T05:26:38.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.073+0000 7f9c6bfff640 1 -- 172.21.15.120:0/2569038431 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f9c74005020 con 0x7f9c84100830 2024-09-19T05:26:38.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.073+0000 7f9c8c255740 1 -- start start 2024-09-19T05:26:38.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.073+0000 7f9c8c255740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611546b49d0 0x5611546b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:38.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.073+0000 7f9c8c255740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611546b52f0 0x5611546c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:38.081 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.073+0000 7f9c8c255740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546c40c0 0x5611546c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.073+0000 7f9c8c255740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5611546192f0 con 0x5611546c40c0 2024-09-19T05:26:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.073+0000 7f9c8c255740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5611545c1270 con 0x5611546b49d0 2024-09-19T05:26:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.073+0000 7f9c8c255740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5611546152b0 con 0x5611546b52f0 2024-09-19T05:26:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.073+0000 7f9c82ffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611546b52f0 0x5611546c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.073+0000 7f9c827fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546c40c0 0x5611546c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.073+0000 7f9c82ffd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611546b52f0 0x5611546c3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:38502/0 (socket says 172.21.15.120:38502) 2024-09-19T05:26:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.073+0000 7f9c827fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546c40c0 0x5611546c64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53592/0 (socket says 172.21.15.120:53592) 2024-09-19T05:26:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.073+0000 7f9c82ffd640 1 -- 172.21.15.120:0/4076823514 learned_addr learned my addr 172.21.15.120:0/4076823514 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:26:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.073+0000 7f9c837fe640 1 --2- 172.21.15.120:0/4076823514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611546b49d0 0x5611546b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.073+0000 7f9c82ffd640 1 -- 172.21.15.120:0/4076823514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611546b49d0 msgr2=0x5611546b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:38.082 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.073+0000 7f9c82ffd640 1 --2- 172.21.15.120:0/4076823514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611546b49d0 0x5611546b4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.073+0000 7f9c82ffd640 1 -- 172.21.15.120:0/4076823514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546c40c0 msgr2=0x5611546c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.073+0000 7f9c82ffd640 1 --2- 172.21.15.120:0/4076823514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546c40c0 0x5611546c64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.073+0000 7f9c6bfff640 1 --2- 172.21.15.120:0/2569038431 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f9c6c0a3460 0x7f9c6c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.073+0000 7f9c82ffd640 1 -- 172.21.15.120:0/4076823514 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611545c0340 con 0x5611546b52f0 2024-09-19T05:26:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.073+0000 7f9c827fc640 1 --2- 172.21.15.120:0/4076823514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546c40c0 0x5611546c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:26:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.073+0000 7f9c837fe640 1 --2- 172.21.15.120:0/2569038431 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f9c6c0a3460 0x7f9c6c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.074+0000 7f9c6bfff640 1 -- 172.21.15.120:0/2569038431 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8643+0+0 (secure 0 0 0) 0x7f9c740d0100 con 0x7f9c84100830 2024-09-19T05:26:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.074+0000 7f9c82ffd640 1 --2- 172.21.15.120:0/4076823514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611546b52f0 0x5611546c3b80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9c740cd740 tx=0x7f9c740d3f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a4a44ed1abed85e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.074+0000 7f9c697fa640 1 -- 172.21.15.120:0/4076823514 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7409c130 con 0x5611546b52f0 2024-09-19T05:26:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.074+0000 7f9c697fa640 1 -- 172.21.15.120:0/4076823514 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c74005310 con 0x5611546b52f0 2024-09-19T05:26:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.074+0000 7f9c697fa640 1 -- 172.21.15.120:0/4076823514 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7409bcc0 con 0x5611546b52f0 2024-09-19T05:26:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.074+0000 7f9c8c255740 1 -- 172.21.15.120:0/4076823514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611546b52f0 msgr2=0x5611546c3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.075+0000 7f9c8c255740 1 --2- 172.21.15.120:0/4076823514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611546b52f0 0x5611546c3b80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9c740cd740 tx=0x7f9c740d3f70 comp rx=0 tx=0).stop 2024-09-19T05:26:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.074+0000 7f9c837fe640 1 --2- 172.21.15.120:0/2569038431 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f9c6c0a3460 0x7f9c6c0a5920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c004af0 tx=0x7f9c7c004a40 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.075+0000 7f9c8c255740 1 -- 172.21.15.120:0/4076823514 shutdown_connections 2024-09-19T05:26:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.075+0000 7f9c8c255740 1 --2- 172.21.15.120:0/4076823514 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546c40c0 0x5611546c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.075+0000 7f9c8c255740 1 --2- 172.21.15.120:0/4076823514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611546b52f0 0x5611546c3b80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.075+0000 7f9c8c255740 1 --2- 172.21.15.120:0/4076823514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611546b49d0 0x5611546b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.075+0000 7f9c8c255740 1 -- 172.21.15.120:0/4076823514 >> 172.21.15.120:0/4076823514 conn(0x5611546b1060 msgr2=0x5611546b1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.075+0000 7f9c8c255740 1 -- 172.21.15.120:0/4076823514 shutdown_connections 2024-09-19T05:26:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.075+0000 7f9c8c255740 1 -- 172.21.15.120:0/4076823514 wait complete. 2024-09-19T05:26:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.075+0000 7f9c8c255740 1 -- start start 2024-09-19T05:26:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.075+0000 7f9c8c255740 1 Processor -- start 2024-09-19T05:26:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.075+0000 7f9c8c255740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546b49d0 0x5611546c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.075+0000 7f9c8c255740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611546b52f0 0x5611546c1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.075+0000 7f9c8c255740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611546c40c0 0x5611546c1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.075+0000 7f9c8c255740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x5611546c6cf0 con 0x5611546b49d0 2024-09-19T05:26:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.075+0000 7f9c8c255740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x5611545a2290 con 0x5611546b52f0 2024-09-19T05:26:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.075+0000 7f9c8c255740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5611546c6e70 con 0x5611546c40c0 2024-09-19T05:26:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.075+0000 7f9c8c255740 10 client.0 _ll_register_callbacks cb 0x5611545d3140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:26:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.075+0000 7f9c82ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546b49d0 0x5611546c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.075+0000 7f9c82ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546b49d0 0x5611546c1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53608/0 (socket says 172.21.15.120:53608) 2024-09-19T05:26:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.075+0000 7f9c82ffd640 1 -- 172.21.15.120:0/3011081836 learned_addr learned my addr 172.21.15.120:0/3011081836 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:26:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.075+0000 7f9c837fe640 1 --2- 172.21.15.120:0/3011081836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611546c40c0 0x5611546c1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.076+0000 7f9c827fc640 1 --2- 172.21.15.120:0/3011081836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611546b52f0 0x5611546c1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.076+0000 7f9c82ffd640 1 -- 172.21.15.120:0/3011081836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611546c40c0 msgr2=0x5611546c1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.076+0000 7f9c82ffd640 1 --2- 172.21.15.120:0/3011081836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611546c40c0 0x5611546c1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.076+0000 7f9c82ffd640 1 -- 172.21.15.120:0/3011081836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611546b52f0 msgr2=0x5611546c1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.076+0000 7f9c82ffd640 1 --2- 172.21.15.120:0/3011081836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611546b52f0 0x5611546c1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.076+0000 7f9c82ffd640 1 -- 172.21.15.120:0/3011081836 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56115432c210 con 0x5611546b49d0 2024-09-19T05:26:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.076+0000 7f9c827fc640 1 --2- 172.21.15.120:0/3011081836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611546b52f0 0x5611546c1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:26:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.076+0000 7f9c82ffd640 1 --2- 172.21.15.120:0/3011081836 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546b49d0 0x5611546c1020 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9c740cd880 tx=0x7f9c7400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3bd384ca88420c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.076+0000 7f9c66ff5640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:26:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.076+0000 7f9c66ff5640 1 -- 172.21.15.120:0/3011081836 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7409bea0 con 0x5611546b49d0 2024-09-19T05:26:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.076+0000 7f9c66ff5640 1 -- 172.21.15.120:0/3011081836 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8643+0+0 (secure 0 0 0) 0x7f9c740989d0 con 0x5611546b49d0 2024-09-19T05:26:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.076+0000 7f9c8c255740 1 -- 172.21.15.120:0/3011081836 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561154626a20 con 0x5611546b49d0 2024-09-19T05:26:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.076+0000 7f9c66ff5640 1 -- 172.21.15.120:0/3011081836 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9c7409bcc0 con 0x5611546b49d0 2024-09-19T05:26:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.076+0000 7f9c8c255740 10 client.16326 fetch_fsmap learned FSMap version 33 2024-09-19T05:26:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.076+0000 7f9c8c255740 1 -- 172.21.15.120:0/3011081836 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5611543f8620 con 0x5611546b49d0 2024-09-19T05:26:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.076+0000 7f9c66ff5640 1 -- 172.21.15.120:0/3011081836 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x561154626a20 con 0x5611546b49d0 2024-09-19T05:26:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.076+0000 7f9c66ff5640 1 -- 172.21.15.120:0/3011081836 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f9c7409c5c0 con 0x5611546b49d0 2024-09-19T05:26:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.076+0000 7f9c8c255740 10 client.16326 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T05:26:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.077+0000 7f9c8c255740 10 client.16326 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:26:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.077+0000 7f9c8c255740 20 client.16326 populate_metadata read hostname 'smithi120' 2024-09-19T05:26:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.077+0000 7f9c8c255740 1 --2- 172.21.15.120:0/3011081836 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5611546d3f70 0x5611546d6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.077+0000 7f9c8c255740 4 client.16326 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T05:26:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.077+0000 7f9c8c255740 1 -- 172.21.15.120:0/3011081836 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561154620d70 con 0x5611546d3f70 2024-09-19T05:26:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.077+0000 7f9c827fc640 1 --2- 172.21.15.120:0/3011081836 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5611546d3f70 0x5611546d6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.077+0000 7f9c827fc640 1 --2- 172.21.15.120:0/3011081836 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5611546d3f70 0x5611546d6360 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bac11fd04f1db086 server_cookie=f91d8df62233fe6c in_seq=0 out_seq=0 2024-09-19T05:26:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.077+0000 7f9c66ff5640 10 client.16326 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:26:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.078+0000 7f9c66ff5640 1 -- 172.21.15.120:0/3011081836 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561154620d70 con 0x5611546d3f70 2024-09-19T05:26:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.078+0000 7f9c66ff5640 10 client.16326 handle_command_reply: tid=0 2024-09-19T05:26:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.078+0000 7f9c8c255740 1 client.16326 shutdown 2024-09-19T05:26:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.078+0000 7f9c8c255740 1 -- 172.21.15.120:0/3011081836 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546b49d0 msgr2=0x5611546c1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.078+0000 7f9c8c255740 1 --2- 172.21.15.120:0/3011081836 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546b49d0 0x5611546c1020 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9c740cd880 tx=0x7f9c7400cf20 comp rx=0 tx=0).stop 2024-09-19T05:26:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.078+0000 7f9c8c255740 1 -- 172.21.15.120:0/3011081836 shutdown_connections 2024-09-19T05:26:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.078+0000 7f9c8c255740 1 --2- 172.21.15.120:0/3011081836 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x5611546d3f70 0x5611546d6360 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.078+0000 7f9c8c255740 1 --2- 172.21.15.120:0/3011081836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611546c40c0 0x5611546c1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.078+0000 7f9c8c255740 1 --2- 172.21.15.120:0/3011081836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611546b52f0 0x5611546c1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.078+0000 7f9c66ff5640 0 client.16326 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:26:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.078+0000 7f9c8c255740 1 --2- 172.21.15.120:0/3011081836 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546b49d0 0x5611546c1020 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.078+0000 7f9c8c255740 1 -- 172.21.15.120:0/3011081836 >> 172.21.15.120:0/3011081836 conn(0x5611546b1060 msgr2=0x5611546b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.078+0000 7f9c8c255740 1 -- 172.21.15.120:0/3011081836 shutdown_connections 2024-09-19T05:26:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.078+0000 7f9c8c255740 1 -- 172.21.15.120:0/3011081836 wait complete. 2024-09-19T05:26:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.078+0000 7f9c8c255740 20 client.16326 trim_cache size 0 max 16384 2024-09-19T05:26:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.094+0000 7f9c8c255740 1 Processor -- start 2024-09-19T05:26:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.094+0000 7f9c8c255740 1 -- start start 2024-09-19T05:26:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.094+0000 7f9c8c255740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546b49d0 0x5611546c2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.094+0000 7f9c8c255740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611546b52f0 0x5611546db930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.094+0000 7f9c8c255740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611546c40c0 0x5611546dbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.094+0000 7f9c8c255740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9c841ae0a0 con 0x5611546b49d0 2024-09-19T05:26:38.100 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.094+0000 7f9c8c255740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9c841ab8b0 con 0x5611546c40c0 2024-09-19T05:26:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.094+0000 7f9c8c255740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9c841a9720 con 0x5611546b52f0 2024-09-19T05:26:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.094+0000 7f9c82ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546b49d0 0x5611546c2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.094+0000 7f9c82ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546b49d0 0x5611546c2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:53616/0 (socket says 172.21.15.120:53616) 2024-09-19T05:26:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.094+0000 7f9c82ffd640 1 -- 172.21.15.120:0/3868798365 learned_addr learned my addr 172.21.15.120:0/3868798365 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:26:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.094+0000 7f9c827fc640 1 --2- 172.21.15.120:0/3868798365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611546b52f0 0x5611546db930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.094+0000 7f9c837fe640 1 --2- 172.21.15.120:0/3868798365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611546c40c0 0x5611546dbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.094+0000 7f9c82ffd640 1 -- 172.21.15.120:0/3868798365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611546b52f0 msgr2=0x5611546db930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.094+0000 7f9c82ffd640 1 --2- 172.21.15.120:0/3868798365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611546b52f0 0x5611546db930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.094+0000 7f9c82ffd640 1 -- 172.21.15.120:0/3868798365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611546c40c0 msgr2=0x5611546dbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.094+0000 7f9c82ffd640 1 --2- 172.21.15.120:0/3868798365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611546c40c0 0x5611546dbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.094+0000 7f9c82ffd640 1 -- 172.21.15.120:0/3868798365 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611546ac2d0 con 0x5611546b49d0 2024-09-19T05:26:38.101 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.094+0000 7f9c837fe640 1 --2- 172.21.15.120:0/3868798365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611546c40c0 0x5611546dbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:26:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.094+0000 7f9c82ffd640 1 --2- 172.21.15.120:0/3868798365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546b49d0 0x5611546c2f90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400c6a0 tx=0x7f9c740d0470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e3537f31732a25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.094+0000 7f9c68ff9640 1 -- 172.21.15.120:0/3868798365 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7409c130 con 0x5611546b49d0 2024-09-19T05:26:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.095+0000 7f9c68ff9640 1 -- 172.21.15.120:0/3868798365 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c740b9070 con 0x5611546b49d0 2024-09-19T05:26:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.095+0000 7f9c68ff9640 1 -- 172.21.15.120:0/3868798365 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c740d3a20 con 0x5611546b49d0 2024-09-19T05:26:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.095+0000 7f9c8c255740 1 -- 172.21.15.120:0/3868798365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546b49d0 msgr2=0x5611546c2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.095+0000 7f9c8c255740 1 --2- 172.21.15.120:0/3868798365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546b49d0 0x5611546c2f90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400c6a0 tx=0x7f9c740d0470 comp rx=0 tx=0).stop 2024-09-19T05:26:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.095+0000 7f9c8c255740 1 -- 172.21.15.120:0/3868798365 shutdown_connections 2024-09-19T05:26:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.095+0000 7f9c8c255740 1 --2- 172.21.15.120:0/3868798365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611546c40c0 0x5611546dbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.095+0000 7f9c8c255740 1 --2- 172.21.15.120:0/3868798365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611546b52f0 0x5611546db930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.102 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.095+0000 7f9c8c255740 1 --2- 172.21.15.120:0/3868798365 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546b49d0 0x5611546c2f90 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.095+0000 7f9c8c255740 1 -- 172.21.15.120:0/3868798365 >> 172.21.15.120:0/3868798365 conn(0x5611546b1060 msgr2=0x5611546c2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.095+0000 7f9c8c255740 1 -- 172.21.15.120:0/3868798365 shutdown_connections 2024-09-19T05:26:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.095+0000 7f9c8c255740 1 -- 172.21.15.120:0/3868798365 wait complete. 2024-09-19T05:26:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.095+0000 7f9c8c255740 1 -- start start 2024-09-19T05:26:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.096+0000 7f9c8c255740 1 Processor -- start 2024-09-19T05:26:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.096+0000 7f9c8c255740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546b49d0 0x5611546cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.096+0000 7f9c8c255740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611546b52f0 0x5611546bde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.096+0000 7f9c8c255740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611546c40c0 0x5611546be440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.096+0000 7f9c8c255740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f9c841a9d70 con 0x5611546b49d0 2024-09-19T05:26:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.096+0000 7f9c8c255740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f9c841ab1e0 con 0x5611546b52f0 2024-09-19T05:26:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.096+0000 7f9c8c255740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9c841aa440 con 0x5611546c40c0 2024-09-19T05:26:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.096+0000 7f9c8c255740 10 client.0 _ll_register_callbacks cb 0x7f9c7800a590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T05:26:38.103 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.096+0000 7f9c837fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611546c40c0 0x5611546be440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.096+0000 7f9c82ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546b49d0 0x5611546cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.096+0000 7f9c837fe640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611546c40c0 0x5611546be440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.120:38528/0 (socket says 172.21.15.120:38528) 2024-09-19T05:26:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.096+0000 7f9c837fe640 1 -- 172.21.15.120:0/3505896474 learned_addr learned my addr 172.21.15.120:0/3505896474 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:26:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.096+0000 7f9c827fc640 1 --2- 172.21.15.120:0/3505896474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611546b52f0 0x5611546bde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.096+0000 7f9c82ffd640 1 -- 172.21.15.120:0/3505896474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611546c40c0 msgr2=0x5611546be440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.096+0000 7f9c82ffd640 1 --2- 172.21.15.120:0/3505896474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611546c40c0 0x5611546be440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.096+0000 7f9c82ffd640 1 -- 172.21.15.120:0/3505896474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611546b52f0 msgr2=0x5611546bde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T05:26:38.104 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.096+0000 7f9c82ffd640 1 --2- 172.21.15.120:0/3505896474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611546b52f0 0x5611546bde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.096+0000 7f9c82ffd640 1 -- 172.21.15.120:0/3505896474 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611546bec40 con 0x5611546b49d0 2024-09-19T05:26:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.096+0000 7f9c837fe640 1 --2- 172.21.15.120:0/3505896474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611546c40c0 0x5611546be440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:26:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.096+0000 7f9c82ffd640 1 --2- 172.21.15.120:0/3505896474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546b49d0 0x5611546cc900 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9c740cddd0 tx=0x7f9c7400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d7bf3a773c04b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:26:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.096+0000 7f9c66ff5640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2024-09-19T05:26:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.096+0000 7f9c66ff5640 1 -- 172.21.15.120:0/3505896474 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7409c130 con 0x5611546b49d0 2024-09-19T05:26:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.097+0000 7f9c66ff5640 1 -- 172.21.15.120:0/3505896474 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8643+0+0 (secure 0 0 0) 0x7f9c740b5200 con 0x5611546b49d0 2024-09-19T05:26:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.097+0000 7f9c8c255740 1 -- 172.21.15.120:0/3505896474 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c740b9070 con 0x5611546b49d0 2024-09-19T05:26:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.097+0000 7f9c66ff5640 1 -- 172.21.15.120:0/3505896474 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9c74098430 con 0x5611546b49d0 2024-09-19T05:26:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.097+0000 7f9c8c255740 10 client.16332 fetch_fsmap learned FSMap version 33 2024-09-19T05:26:38.105 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.097+0000 7f9c8c255740 1 -- 172.21.15.120:0/3505896474 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5611546bec40 con 0x5611546b49d0 2024-09-19T05:26:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.097+0000 7f9c66ff5640 1 -- 172.21.15.120:0/3505896474 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f9c740b9070 con 0x5611546b49d0 2024-09-19T05:26:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.097+0000 7f9c66ff5640 1 -- 172.21.15.120:0/3505896474 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f9c740a4b40 con 0x5611546b49d0 2024-09-19T05:26:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.097+0000 7f9c8c255740 10 client.16332 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T05:26:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.097+0000 7f9c8c255740 10 client.16332 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-19T05:26:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.097+0000 7f9c8c255740 20 client.16332 populate_metadata read hostname 'smithi120' 2024-09-19T05:26:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.097+0000 7f9c8c255740 1 --2- 172.21.15.120:0/3505896474 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56115473ec60 0x561154741050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:26:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.097+0000 7f9c8c255740 4 client.16332 mds_command: new command op to 24445 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T05:26:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.097+0000 7f9c8c255740 1 -- 172.21.15.120:0/3505896474 --> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56115459d900 con 0x56115473ec60 2024-09-19T05:26:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.097+0000 7f9c827fc640 1 --2- 172.21.15.120:0/3505896474 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56115473ec60 0x561154741050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:26:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.098+0000 7f9c66ff5640 10 client.16332 ms_handle_connect on v2:172.21.15.194:6838/3817420679 2024-09-19T05:26:38.106 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.098+0000 7f9c827fc640 1 --2- 172.21.15.120:0/3505896474 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56115473ec60 0x561154741050 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edf56910ddb7d823 server_cookie=d24dc15a947f48 in_seq=0 out_seq=0 2024-09-19T05:26:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.140+0000 7f9c66ff5640 1 -- 172.21.15.120:0/3505896474 <== mds.0 v2:172.21.15.194:6838/3817420679 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56115459d900 con 0x56115473ec60 2024-09-19T05:26:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.140+0000 7f9c66ff5640 10 client.16332 handle_command_reply: tid=0 2024-09-19T05:26:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.140+0000 7f9c8c255740 1 client.16332 shutdown 2024-09-19T05:26:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.140+0000 7f9c8c255740 1 -- 172.21.15.120:0/3505896474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546b49d0 msgr2=0x5611546cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.140+0000 7f9c8c255740 1 --2- 172.21.15.120:0/3505896474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546b49d0 0x5611546cc900 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9c740cddd0 tx=0x7f9c7400cf20 comp rx=0 tx=0).stop 2024-09-19T05:26:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.140+0000 7f9c8c255740 1 -- 172.21.15.120:0/3505896474 shutdown_connections 2024-09-19T05:26:38.143 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.140+0000 7f9c8c255740 1 --2- 172.21.15.120:0/3505896474 >> [v2:172.21.15.194:6838/3817420679,v1:172.21.15.194:6839/3817420679] conn(0x56115473ec60 0x561154741050 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.140+0000 7f9c8c255740 1 --2- 172.21.15.120:0/3505896474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611546c40c0 0x5611546be440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.140+0000 7f9c8c255740 1 --2- 172.21.15.120:0/3505896474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611546b52f0 0x5611546bde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.140+0000 7f9c66ff5640 0 client.16332 ms_handle_reset on v2:172.21.15.194:6838/3817420679 2024-09-19T05:26:38.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.140+0000 7f9c8c255740 1 --2- 172.21.15.120:0/3505896474 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x5611546b49d0 0x5611546cc900 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.140+0000 7f9c8c255740 1 -- 172.21.15.120:0/3505896474 >> 172.21.15.120:0/3505896474 conn(0x5611546b1060 msgr2=0x5611546af9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:38.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.140+0000 7f9c8c255740 1 -- 172.21.15.120:0/3505896474 shutdown_connections 2024-09-19T05:26:38.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.140+0000 7f9c8c255740 1 -- 172.21.15.120:0/3505896474 wait complete. 2024-09-19T05:26:38.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.141+0000 7f9c8c255740 20 client.16332 trim_cache size 0 max 16384 2024-09-19T05:26:38.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:{ 2024-09-19T05:26:38.144 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "message": "", 2024-09-19T05:26:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout: "return_code": 0 2024-09-19T05:26:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stdout:} 2024-09-19T05:26:38.145 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.141+0000 7f9c893e4640 1 -- 172.21.15.120:0/2569038431 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f9c6c0a3460 msgr2=0x7f9c6c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:38.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.141+0000 7f9c893e4640 1 --2- 172.21.15.120:0/2569038431 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f9c6c0a3460 0x7f9c6c0a5920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c004af0 tx=0x7f9c7c004a40 comp rx=0 tx=0).stop 2024-09-19T05:26:38.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.141+0000 7f9c893e4640 1 -- 172.21.15.120:0/2569038431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c84100830 msgr2=0x7f9c84198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:26:38.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.141+0000 7f9c893e4640 1 --2- 172.21.15.120:0/2569038431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c84100830 0x7f9c84198270 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400e9f0 tx=0x7f9c7400edf0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.141+0000 7f9c893e4640 1 -- 172.21.15.120:0/2569038431 shutdown_connections 2024-09-19T05:26:38.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.141+0000 7f9c893e4640 1 --2- 172.21.15.120:0/2569038431 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f9c6c0a3460 0x7f9c6c0a5920 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.141+0000 7f9c893e4640 1 --2- 172.21.15.120:0/2569038431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c84105520 0x7f9c8419cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.141+0000 7f9c893e4640 1 --2- 172.21.15.120:0/2569038431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c841011e0 0x7f9c841987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.141+0000 7f9c893e4640 1 --2- 172.21.15.120:0/2569038431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c84100830 0x7f9c84198270 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:26:38.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.141+0000 7f9c893e4640 1 -- 172.21.15.120:0/2569038431 >> 172.21.15.120:0/2569038431 conn(0x7f9c84075f20 msgr2=0x7f9c84069b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:26:38.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.141+0000 7f9c893e4640 1 -- 172.21.15.120:0/2569038431 shutdown_connections 2024-09-19T05:26:38.146 INFO:teuthology.task.background_exec.ubuntu@smithi120.front.sepia.ceph.com.smithi120.stderr:2024-09-19T05:26:38.141+0000 7f9c893e4640 1 -- 172.21.15.120:0/2569038431 wait complete. 2024-09-19T05:26:38.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:38 smithi178 ceph-mon[34347]: pgmap v226: 97 pgs: 97 active+clean; 563 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 415 op/s 2024-09-19T05:26:38.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:38 smithi120 ceph-mon[30956]: pgmap v226: 97 pgs: 97 active+clean; 563 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 415 op/s 2024-09-19T05:26:38.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:38 smithi194 ceph-mon[35228]: pgmap v226: 97 pgs: 97 active+clean; 563 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 415 op/s 2024-09-19T05:26:39.534 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2024-09-19T05:26:39.534 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T05:26:39.855 DEBUG:teuthology.parallel:result is None 2024-09-19T05:26:39.855 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T05:26:39.906 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T05:26:39.906 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-19T05:26:39.921 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi120.front.sepia.ceph.com 2024-09-19T05:26:39.932 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-19T05:26:39.943 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-19T05:26:39.943 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T05:26:39.943 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi120.front.sepia.ceph.com 2024-09-19T05:26:39.943 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-19T05:26:40.002 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-19T05:26:40.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:40 smithi178 ceph-mon[34347]: pgmap v227: 97 pgs: 97 active+clean; 563 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 194 op/s 2024-09-19T05:26:40.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:40 smithi120 ceph-mon[30956]: pgmap v227: 97 pgs: 97 active+clean; 563 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 194 op/s 2024-09-19T05:26:40.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:40 smithi194 ceph-mon[35228]: pgmap v227: 97 pgs: 97 active+clean; 563 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 194 op/s 2024-09-19T05:26:42.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:42 smithi178 ceph-mon[34347]: pgmap v228: 97 pgs: 97 active+clean; 558 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 261 op/s 2024-09-19T05:26:42.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:42 smithi120 ceph-mon[30956]: pgmap v228: 97 pgs: 97 active+clean; 558 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 261 op/s 2024-09-19T05:26:42.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:42 smithi194 ceph-mon[35228]: pgmap v228: 97 pgs: 97 active+clean; 558 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 261 op/s 2024-09-19T05:26:44.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:44 smithi178 ceph-mon[34347]: pgmap v229: 97 pgs: 97 active+clean; 560 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 966 KiB/s wr, 186 op/s 2024-09-19T05:26:44.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:44 smithi120 ceph-mon[30956]: pgmap v229: 97 pgs: 97 active+clean; 560 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 966 KiB/s wr, 186 op/s 2024-09-19T05:26:44.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:44 smithi194 ceph-mon[35228]: pgmap v229: 97 pgs: 97 active+clean; 560 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 966 KiB/s wr, 186 op/s 2024-09-19T05:26:46.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:46 smithi178 ceph-mon[34347]: pgmap v230: 97 pgs: 97 active+clean; 560 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 958 KiB/s wr, 144 op/s 2024-09-19T05:26:46.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:46 smithi120 ceph-mon[30956]: pgmap v230: 97 pgs: 97 active+clean; 560 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 958 KiB/s wr, 144 op/s 2024-09-19T05:26:46.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:46 smithi194 ceph-mon[35228]: pgmap v230: 97 pgs: 97 active+clean; 560 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 958 KiB/s wr, 144 op/s 2024-09-19T05:26:48.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:48 smithi178 ceph-mon[34347]: pgmap v231: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1002 KiB/s wr, 168 op/s 2024-09-19T05:26:48.458 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:48 smithi194 ceph-mon[35228]: pgmap v231: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1002 KiB/s wr, 168 op/s 2024-09-19T05:26:48.630 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:48 smithi120 ceph-mon[30956]: pgmap v231: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1002 KiB/s wr, 168 op/s 2024-09-19T05:26:50.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:50 smithi178 ceph-mon[34347]: pgmap v232: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 832 KiB/s wr, 119 op/s 2024-09-19T05:26:50.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:50 smithi120 ceph-mon[30956]: pgmap v232: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 832 KiB/s wr, 119 op/s 2024-09-19T05:26:50.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:50 smithi194 ceph-mon[35228]: pgmap v232: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 832 KiB/s wr, 119 op/s 2024-09-19T05:26:52.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:52 smithi120 ceph-mon[30956]: pgmap v233: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 841 KiB/s wr, 123 op/s 2024-09-19T05:26:52.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:52 smithi194 ceph-mon[35228]: pgmap v233: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 841 KiB/s wr, 123 op/s 2024-09-19T05:26:52.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:52 smithi178 ceph-mon[34347]: pgmap v233: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 841 KiB/s wr, 123 op/s 2024-09-19T05:26:54.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:54 smithi120 ceph-mon[30956]: pgmap v234: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 616 KiB/s wr, 56 op/s 2024-09-19T05:26:54.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:54 smithi194 ceph-mon[35228]: pgmap v234: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 616 KiB/s wr, 56 op/s 2024-09-19T05:26:54.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:54 smithi178 ceph-mon[34347]: pgmap v234: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 616 KiB/s wr, 56 op/s 2024-09-19T05:26:56.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:56 smithi120 ceph-mon[30956]: pgmap v235: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-09-19T05:26:56.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:56 smithi194 ceph-mon[35228]: pgmap v235: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-09-19T05:26:56.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:56 smithi178 ceph-mon[34347]: pgmap v235: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-09-19T05:26:58.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:26:58 smithi120 ceph-mon[30956]: pgmap v236: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 55 KiB/s wr, 30 op/s 2024-09-19T05:26:58.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:26:58 smithi194 ceph-mon[35228]: pgmap v236: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 55 KiB/s wr, 30 op/s 2024-09-19T05:26:58.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:26:58 smithi178 ceph-mon[34347]: pgmap v236: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 55 KiB/s wr, 30 op/s 2024-09-19T05:27:00.494 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:00 smithi178 ceph-mon[34347]: pgmap v237: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 6 op/s 2024-09-19T05:27:00.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:00 smithi120 ceph-mon[30956]: pgmap v237: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 6 op/s 2024-09-19T05:27:00.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:00 smithi194 ceph-mon[35228]: pgmap v237: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 6 op/s 2024-09-19T05:27:02.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:02 smithi120 ceph-mon[30956]: pgmap v238: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-09-19T05:27:02.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:02 smithi194 ceph-mon[35228]: pgmap v238: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-09-19T05:27:02.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:02 smithi178 ceph-mon[34347]: pgmap v238: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-09-19T05:27:04.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:04 smithi120 ceph-mon[30956]: pgmap v239: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-19T05:27:04.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:04 smithi194 ceph-mon[35228]: pgmap v239: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-19T05:27:04.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:04 smithi178 ceph-mon[34347]: pgmap v239: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-19T05:27:06.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:06 smithi120 ceph-mon[30956]: pgmap v240: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-19T05:27:06.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:06 smithi194 ceph-mon[35228]: pgmap v240: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-19T05:27:06.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:06 smithi178 ceph-mon[34347]: pgmap v240: 97 pgs: 97 active+clean; 561 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-09-19T05:27:08.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:08 smithi120 ceph-mon[30956]: pgmap v241: 97 pgs: 97 active+clean; 561 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 49 KiB/s wr, 25 op/s 2024-09-19T05:27:08.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:08 smithi120 ceph-mon[30956]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T05:27:08.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:08 smithi194 ceph-mon[35228]: pgmap v241: 97 pgs: 97 active+clean; 561 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 49 KiB/s wr, 25 op/s 2024-09-19T05:27:08.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:08 smithi194 ceph-mon[35228]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T05:27:08.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:08 smithi178 ceph-mon[34347]: pgmap v241: 97 pgs: 97 active+clean; 561 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 49 KiB/s wr, 25 op/s 2024-09-19T05:27:08.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:08 smithi178 ceph-mon[34347]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T05:27:10.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:10 smithi120 ceph-mon[30956]: pgmap v243: 97 pgs: 97 active+clean; 561 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 58 KiB/s wr, 27 op/s 2024-09-19T05:27:10.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:10 smithi194 ceph-mon[35228]: pgmap v243: 97 pgs: 97 active+clean; 561 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 58 KiB/s wr, 27 op/s 2024-09-19T05:27:10.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:10 smithi178 ceph-mon[34347]: pgmap v243: 97 pgs: 97 active+clean; 561 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 58 KiB/s wr, 27 op/s 2024-09-19T05:27:12.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:12 smithi120 ceph-mon[30956]: pgmap v244: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 26 op/s 2024-09-19T05:27:12.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:12 smithi194 ceph-mon[35228]: pgmap v244: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 26 op/s 2024-09-19T05:27:12.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:12 smithi178 ceph-mon[34347]: pgmap v244: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 26 op/s 2024-09-19T05:27:14.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:14 smithi120 ceph-mon[30956]: pgmap v245: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 26 op/s 2024-09-19T05:27:14.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:14 smithi194 ceph-mon[35228]: pgmap v245: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 26 op/s 2024-09-19T05:27:14.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:14 smithi178 ceph-mon[34347]: pgmap v245: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 26 op/s 2024-09-19T05:27:16.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:16 smithi120 ceph-mon[30956]: pgmap v246: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 26 op/s 2024-09-19T05:27:16.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:16 smithi120 ceph-mon[30956]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T05:27:16.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:16 smithi194 ceph-mon[35228]: pgmap v246: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 26 op/s 2024-09-19T05:27:16.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:16 smithi194 ceph-mon[35228]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T05:27:16.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:16 smithi178 ceph-mon[34347]: pgmap v246: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 26 op/s 2024-09-19T05:27:16.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:16 smithi178 ceph-mon[34347]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T05:27:18.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:18 smithi120 ceph-mon[30956]: pgmap v248: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-19T05:27:18.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:18 smithi194 ceph-mon[35228]: pgmap v248: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-19T05:27:18.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:18 smithi178 ceph-mon[34347]: pgmap v248: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-19T05:27:20.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:20 smithi120 ceph-mon[30956]: pgmap v249: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-19T05:27:20.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:20 smithi194 ceph-mon[35228]: pgmap v249: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-19T05:27:20.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:20 smithi178 ceph-mon[34347]: pgmap v249: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-19T05:27:22.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:22 smithi120 ceph-mon[30956]: pgmap v250: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T05:27:22.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:22 smithi194 ceph-mon[35228]: pgmap v250: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T05:27:22.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:22 smithi178 ceph-mon[34347]: pgmap v250: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T05:27:24.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:24 smithi120 ceph-mon[30956]: pgmap v251: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T05:27:24.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:24 smithi194 ceph-mon[35228]: pgmap v251: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T05:27:24.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:24 smithi178 ceph-mon[34347]: pgmap v251: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T05:27:26.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:26 smithi120 ceph-mon[30956]: pgmap v252: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T05:27:26.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:26 smithi194 ceph-mon[35228]: pgmap v252: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T05:27:26.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:26 smithi178 ceph-mon[34347]: pgmap v252: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T05:27:28.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:28 smithi120 ceph-mon[30956]: pgmap v253: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T05:27:28.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:28 smithi194 ceph-mon[35228]: pgmap v253: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T05:27:28.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:28 smithi178 ceph-mon[34347]: pgmap v253: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T05:27:30.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:30 smithi120 ceph-mon[30956]: pgmap v254: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:30.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:30 smithi194 ceph-mon[35228]: pgmap v254: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:30.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:30 smithi178 ceph-mon[34347]: pgmap v254: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:32.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:32 smithi120 ceph-mon[30956]: pgmap v255: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:27:32.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:32 smithi194 ceph-mon[35228]: pgmap v255: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:27:32.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:32 smithi178 ceph-mon[34347]: pgmap v255: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:27:33.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:33 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:27:33.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:33 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:27:33.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:33 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:27:33.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:33 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:27:33.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:33 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:27:33.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:33 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:27:33.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:33 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:27:33.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:33 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:27:33.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:33 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:27:33.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:33 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:27:33.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:33 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:27:33.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:33 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:27:34.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:34 smithi120 ceph-mon[30956]: pgmap v256: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:34.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:34 smithi194 ceph-mon[35228]: pgmap v256: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:34.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:34 smithi178 ceph-mon[34347]: pgmap v256: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:36.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:36 smithi120 ceph-mon[30956]: pgmap v257: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:36.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:36 smithi194 ceph-mon[35228]: pgmap v257: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:36.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:36 smithi178 ceph-mon[34347]: pgmap v257: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:38.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:38 smithi120 ceph-mon[30956]: pgmap v258: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:27:38.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:38 smithi194 ceph-mon[35228]: pgmap v258: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:27:38.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:38 smithi178 ceph-mon[34347]: pgmap v258: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:27:40.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:40 smithi120 ceph-mon[30956]: pgmap v259: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:40.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:40 smithi194 ceph-mon[35228]: pgmap v259: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:40.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:40 smithi178 ceph-mon[34347]: pgmap v259: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:42.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:42 smithi120 ceph-mon[30956]: pgmap v260: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:27:42.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:42 smithi194 ceph-mon[35228]: pgmap v260: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:27:42.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:42 smithi178 ceph-mon[34347]: pgmap v260: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:27:44.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:44 smithi120 ceph-mon[30956]: pgmap v261: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:44.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:44 smithi194 ceph-mon[35228]: pgmap v261: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:44.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:44 smithi178 ceph-mon[34347]: pgmap v261: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:46.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:46 smithi120 ceph-mon[30956]: pgmap v262: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:46.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:46 smithi194 ceph-mon[35228]: pgmap v262: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:46.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:46 smithi178 ceph-mon[34347]: pgmap v262: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:48.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:48 smithi120 ceph-mon[30956]: pgmap v263: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:27:48.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:48 smithi194 ceph-mon[35228]: pgmap v263: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:27:48.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:48 smithi178 ceph-mon[34347]: pgmap v263: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:27:50.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:50 smithi120 ceph-mon[30956]: pgmap v264: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:50.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:50 smithi194 ceph-mon[35228]: pgmap v264: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:50.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:50 smithi178 ceph-mon[34347]: pgmap v264: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:52.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:52 smithi120 ceph-mon[30956]: pgmap v265: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:27:52.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:52 smithi194 ceph-mon[35228]: pgmap v265: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:27:52.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:52 smithi178 ceph-mon[34347]: pgmap v265: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:27:54.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:54 smithi120 ceph-mon[30956]: pgmap v266: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:54.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:54 smithi194 ceph-mon[35228]: pgmap v266: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:54.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:54 smithi178 ceph-mon[34347]: pgmap v266: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:56.631 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:56 smithi120 ceph-mon[30956]: pgmap v267: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:56.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:56 smithi194 ceph-mon[35228]: pgmap v267: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:56.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:56 smithi178 ceph-mon[34347]: pgmap v267: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:27:58.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:27:58 smithi120 ceph-mon[30956]: pgmap v268: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:27:58.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:27:58 smithi194 ceph-mon[35228]: pgmap v268: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:27:58.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:27:58 smithi178 ceph-mon[34347]: pgmap v268: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:28:00.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:00 smithi120 ceph-mon[30956]: pgmap v269: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:00.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:00 smithi194 ceph-mon[35228]: pgmap v269: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:00.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:00 smithi178 ceph-mon[34347]: pgmap v269: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:02.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:02 smithi120 ceph-mon[30956]: pgmap v270: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T05:28:02.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:02 smithi194 ceph-mon[35228]: pgmap v270: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T05:28:02.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:02 smithi178 ceph-mon[34347]: pgmap v270: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T05:28:04.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:04 smithi120 ceph-mon[30956]: pgmap v271: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T05:28:04.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:04 smithi194 ceph-mon[35228]: pgmap v271: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T05:28:04.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:04 smithi178 ceph-mon[34347]: pgmap v271: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T05:28:06.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:06 smithi120 ceph-mon[30956]: pgmap v272: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T05:28:06.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:06 smithi194 ceph-mon[35228]: pgmap v272: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T05:28:06.693 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:06 smithi178 ceph-mon[34347]: pgmap v272: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T05:28:08.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:08 smithi120 ceph-mon[30956]: pgmap v273: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T05:28:08.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:08 smithi120 ceph-mon[30956]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T05:28:08.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:08 smithi194 ceph-mon[35228]: pgmap v273: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T05:28:08.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:08 smithi194 ceph-mon[35228]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T05:28:08.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:08 smithi178 ceph-mon[34347]: pgmap v273: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T05:28:08.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:08 smithi178 ceph-mon[34347]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T05:28:10.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:10 smithi120 ceph-mon[30956]: pgmap v275: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T05:28:10.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:10 smithi194 ceph-mon[35228]: pgmap v275: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T05:28:10.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:10 smithi178 ceph-mon[34347]: pgmap v275: 97 pgs: 97 active+clean; 558 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T05:28:12.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:12 smithi120 ceph-mon[30956]: pgmap v276: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T05:28:12.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:12 smithi194 ceph-mon[35228]: pgmap v276: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T05:28:12.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:12 smithi178 ceph-mon[34347]: pgmap v276: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T05:28:14.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:14 smithi120 ceph-mon[30956]: pgmap v277: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T05:28:14.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:14 smithi194 ceph-mon[35228]: pgmap v277: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T05:28:14.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:14 smithi178 ceph-mon[34347]: pgmap v277: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T05:28:16.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:16 smithi120 ceph-mon[30956]: pgmap v278: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T05:28:16.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:16 smithi120 ceph-mon[30956]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T05:28:16.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:16 smithi194 ceph-mon[35228]: pgmap v278: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T05:28:16.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:16 smithi194 ceph-mon[35228]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T05:28:16.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:16 smithi178 ceph-mon[34347]: pgmap v278: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T05:28:16.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:16 smithi178 ceph-mon[34347]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T05:28:18.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:18 smithi120 ceph-mon[30956]: pgmap v280: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 224 B/s wr, 7 op/s 2024-09-19T05:28:18.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:18 smithi194 ceph-mon[35228]: pgmap v280: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 224 B/s wr, 7 op/s 2024-09-19T05:28:18.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:18 smithi178 ceph-mon[34347]: pgmap v280: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 224 B/s wr, 7 op/s 2024-09-19T05:28:20.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:20 smithi120 ceph-mon[30956]: pgmap v281: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T05:28:20.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:20 smithi194 ceph-mon[35228]: pgmap v281: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T05:28:20.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:20 smithi178 ceph-mon[34347]: pgmap v281: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T05:28:22.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:22 smithi120 ceph-mon[30956]: pgmap v282: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-09-19T05:28:22.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:22 smithi194 ceph-mon[35228]: pgmap v282: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-09-19T05:28:22.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:22 smithi178 ceph-mon[34347]: pgmap v282: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-09-19T05:28:24.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:24 smithi120 ceph-mon[30956]: pgmap v283: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-09-19T05:28:24.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:24 smithi194 ceph-mon[35228]: pgmap v283: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-09-19T05:28:24.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:24 smithi178 ceph-mon[34347]: pgmap v283: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-09-19T05:28:26.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:26 smithi120 ceph-mon[30956]: pgmap v284: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-09-19T05:28:26.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:26 smithi194 ceph-mon[35228]: pgmap v284: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-09-19T05:28:26.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:26 smithi178 ceph-mon[34347]: pgmap v284: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-09-19T05:28:28.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:28 smithi120 ceph-mon[30956]: pgmap v285: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T05:28:28.655 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:28 smithi194 ceph-mon[35228]: pgmap v285: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T05:28:28.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:28 smithi178 ceph-mon[34347]: pgmap v285: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T05:28:30.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:30 smithi120 ceph-mon[30956]: pgmap v286: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T05:28:30.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:30 smithi194 ceph-mon[35228]: pgmap v286: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T05:28:30.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:30 smithi178 ceph-mon[34347]: pgmap v286: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T05:28:32.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:32 smithi120 ceph-mon[30956]: pgmap v287: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:28:32.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:32 smithi194 ceph-mon[35228]: pgmap v287: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:28:32.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:32 smithi178 ceph-mon[34347]: pgmap v287: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:28:33.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:33 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:28:33.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:33 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:28:33.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:33 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:28:33.626 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:33 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:28:33.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:33 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:28:33.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:33 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:28:33.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:33 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:28:33.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:33 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:28:33.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:33 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:28:33.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:33 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:28:33.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:33 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:28:33.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:33 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:28:34.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:34 smithi120 ceph-mon[30956]: pgmap v288: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:34.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:34 smithi194 ceph-mon[35228]: pgmap v288: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:34.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:34 smithi178 ceph-mon[34347]: pgmap v288: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:36.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:36 smithi194 ceph-mon[35228]: pgmap v289: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:36.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:36 smithi178 ceph-mon[34347]: pgmap v289: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:36.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:36 smithi120 ceph-mon[30956]: pgmap v289: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:38.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:38 smithi194 ceph-mon[35228]: pgmap v290: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:28:38.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:38 smithi194 ceph-mon[35228]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:28:38.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:38 smithi178 ceph-mon[34347]: pgmap v290: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:28:38.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:38 smithi178 ceph-mon[34347]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:28:38.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:38 smithi120 ceph-mon[30956]: pgmap v290: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:28:38.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:38 smithi120 ceph-mon[30956]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:28:40.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:40 smithi194 ceph-mon[35228]: pgmap v291: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:40.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:40 smithi178 ceph-mon[34347]: pgmap v291: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:40.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:40 smithi120 ceph-mon[30956]: pgmap v291: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:42.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:42 smithi194 ceph-mon[35228]: pgmap v292: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:28:42.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:42 smithi178 ceph-mon[34347]: pgmap v292: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:28:42.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:42 smithi120 ceph-mon[30956]: pgmap v292: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:28:44.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:44 smithi194 ceph-mon[35228]: pgmap v293: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:44.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:44 smithi178 ceph-mon[34347]: pgmap v293: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:44.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:44 smithi120 ceph-mon[30956]: pgmap v293: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:46.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:46 smithi194 ceph-mon[35228]: pgmap v294: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:46.678 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:46 smithi120 ceph-mon[30956]: pgmap v294: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:46.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:46 smithi178 ceph-mon[34347]: pgmap v294: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:48.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:48 smithi194 ceph-mon[35228]: pgmap v295: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:28:48.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:48 smithi178 ceph-mon[34347]: pgmap v295: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:28:48.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:48 smithi120 ceph-mon[30956]: pgmap v295: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:28:50.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:50 smithi194 ceph-mon[35228]: pgmap v296: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:50.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:50 smithi178 ceph-mon[34347]: pgmap v296: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:50.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:50 smithi120 ceph-mon[30956]: pgmap v296: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:52.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:52 smithi194 ceph-mon[35228]: pgmap v297: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:28:52.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:52 smithi178 ceph-mon[34347]: pgmap v297: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:28:52.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:52 smithi120 ceph-mon[30956]: pgmap v297: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:28:54.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:54 smithi178 ceph-mon[34347]: pgmap v298: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:54.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:54 smithi120 ceph-mon[30956]: pgmap v298: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:54.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:54 smithi194 ceph-mon[35228]: pgmap v298: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:56.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:56 smithi178 ceph-mon[34347]: pgmap v299: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:56.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:56 smithi120 ceph-mon[30956]: pgmap v299: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:56.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:56 smithi194 ceph-mon[35228]: pgmap v299: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:28:58.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:58 smithi178 ceph-mon[34347]: pgmap v300: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:28:58.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:28:58 smithi178 ceph-mon[34347]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:28:58.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:58 smithi120 ceph-mon[30956]: pgmap v300: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:28:58.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:28:58 smithi120 ceph-mon[30956]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:28:58.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:58 smithi194 ceph-mon[35228]: pgmap v300: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:28:58.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:28:58 smithi194 ceph-mon[35228]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:29:00.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:00 smithi178 ceph-mon[34347]: pgmap v301: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:29:00.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:00 smithi120 ceph-mon[30956]: pgmap v301: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:29:00.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:00 smithi194 ceph-mon[35228]: pgmap v301: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:29:02.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:02 smithi178 ceph-mon[34347]: pgmap v302: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T05:29:02.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:02 smithi120 ceph-mon[30956]: pgmap v302: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T05:29:02.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:02 smithi194 ceph-mon[35228]: pgmap v302: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T05:29:04.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:04 smithi178 ceph-mon[34347]: pgmap v303: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T05:29:04.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:04 smithi120 ceph-mon[30956]: pgmap v303: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T05:29:04.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:04 smithi194 ceph-mon[35228]: pgmap v303: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T05:29:06.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:06 smithi178 ceph-mon[34347]: pgmap v304: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T05:29:06.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:06 smithi120 ceph-mon[30956]: pgmap v304: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T05:29:06.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:06 smithi194 ceph-mon[35228]: pgmap v304: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T05:29:08.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:08 smithi178 ceph-mon[34347]: pgmap v305: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T05:29:08.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:08 smithi178 ceph-mon[34347]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:29:08.692 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:08 smithi178 ceph-mon[34347]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T05:29:08.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:08 smithi120 ceph-mon[30956]: pgmap v305: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T05:29:08.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:08 smithi120 ceph-mon[30956]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:29:08.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:08 smithi120 ceph-mon[30956]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T05:29:08.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:08 smithi194 ceph-mon[35228]: pgmap v305: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T05:29:08.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:08 smithi194 ceph-mon[35228]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:29:08.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:08 smithi194 ceph-mon[35228]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T05:29:10.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:10 smithi120 ceph-mon[30956]: pgmap v307: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T05:29:10.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:10 smithi194 ceph-mon[35228]: pgmap v307: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T05:29:10.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:10 smithi178 ceph-mon[34347]: pgmap v307: 97 pgs: 97 active+clean; 554 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T05:29:12.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:12 smithi120 ceph-mon[30956]: pgmap v308: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T05:29:12.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:12 smithi194 ceph-mon[35228]: pgmap v308: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T05:29:12.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:12 smithi178 ceph-mon[34347]: pgmap v308: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T05:29:13.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:13 smithi120 ceph-mon[30956]: pgmap v309: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T05:29:13.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:13 smithi194 ceph-mon[35228]: pgmap v309: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T05:29:13.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:13 smithi178 ceph-mon[34347]: pgmap v309: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T05:29:15.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:15 smithi120 ceph-mon[30956]: pgmap v310: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T05:29:15.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:15 smithi194 ceph-mon[35228]: pgmap v310: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T05:29:15.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:15 smithi178 ceph-mon[34347]: pgmap v310: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T05:29:17.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:17 smithi120 ceph-mon[30956]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T05:29:17.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:17 smithi194 ceph-mon[35228]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T05:29:17.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:17 smithi178 ceph-mon[34347]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T05:29:18.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:18 smithi120 ceph-mon[30956]: pgmap v312: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 226 B/s wr, 7 op/s 2024-09-19T05:29:18.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:18 smithi194 ceph-mon[35228]: pgmap v312: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 226 B/s wr, 7 op/s 2024-09-19T05:29:18.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:18 smithi178 ceph-mon[34347]: pgmap v312: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 226 B/s wr, 7 op/s 2024-09-19T05:29:20.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:20 smithi120 ceph-mon[30956]: pgmap v313: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T05:29:20.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:20 smithi194 ceph-mon[35228]: pgmap v313: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T05:29:20.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:20 smithi178 ceph-mon[34347]: pgmap v313: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T05:29:22.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:22 smithi120 ceph-mon[30956]: pgmap v314: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T05:29:22.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:22 smithi194 ceph-mon[35228]: pgmap v314: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T05:29:22.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:22 smithi178 ceph-mon[34347]: pgmap v314: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T05:29:24.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:24 smithi120 ceph-mon[30956]: pgmap v315: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T05:29:24.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:24 smithi194 ceph-mon[35228]: pgmap v315: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T05:29:24.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:24 smithi178 ceph-mon[34347]: pgmap v315: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T05:29:26.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:26 smithi194 ceph-mon[35228]: pgmap v316: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T05:29:26.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:26 smithi178 ceph-mon[34347]: pgmap v316: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T05:29:26.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:26 smithi120 ceph-mon[30956]: pgmap v316: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T05:29:28.070 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T05:29:28.185 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.180+0000 7f4662ae4640 1 -- 172.21.15.120:0/1449475737 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f465c101250 msgr2=0x7f465c107990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:28.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.180+0000 7f4662ae4640 1 --2- 172.21.15.120:0/1449475737 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f465c101250 0x7f465c107990 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f4650009900 tx=0x7f465002a410 comp rx=0 tx=0).stop 2024-09-19T05:29:28.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.180+0000 7f4662ae4640 1 -- 172.21.15.120:0/1449475737 shutdown_connections 2024-09-19T05:29:28.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.180+0000 7f4662ae4640 1 --2- 172.21.15.120:0/1449475737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f465c1080f0 0x7f465c10ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:28.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.180+0000 7f4662ae4640 1 --2- 172.21.15.120:0/1449475737 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f465c101250 0x7f465c107990 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:28.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.180+0000 7f4662ae4640 1 --2- 172.21.15.120:0/1449475737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f465c1008a0 0x7f465c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:28.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.181+0000 7f4662ae4640 1 -- 172.21.15.120:0/1449475737 >> 172.21.15.120:0/1449475737 conn(0x7f465c075ef0 msgr2=0x7f465c076300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:28.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.181+0000 7f4662ae4640 1 -- 172.21.15.120:0/1449475737 shutdown_connections 2024-09-19T05:29:28.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.181+0000 7f4662ae4640 1 -- 172.21.15.120:0/1449475737 wait complete. 2024-09-19T05:29:28.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.181+0000 7f4662ae4640 1 Processor -- start 2024-09-19T05:29:28.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.181+0000 7f4662ae4640 1 -- start start 2024-09-19T05:29:28.186 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.181+0000 7f4662ae4640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f465c1008a0 0x7f465c198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:28.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.181+0000 7f4662ae4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f465c1080f0 0x7f465c198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:28.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.181+0000 7f4662ae4640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f465c19cad0 0x7f465c19cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:28.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.181+0000 7f4662ae4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f465c111dd0 con 0x7f465c1080f0 2024-09-19T05:29:28.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.181+0000 7f4662ae4640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f465c111c50 con 0x7f465c19cad0 2024-09-19T05:29:28.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.181+0000 7f4662ae4640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f465c111f50 con 0x7f465c1008a0 2024-09-19T05:29:28.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.182+0000 7f465bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f465c1080f0 0x7f465c198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:28.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.182+0000 7f465bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f465c1080f0 0x7f465c198750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45628/0 (socket says 172.21.15.120:45628) 2024-09-19T05:29:28.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.182+0000 7f465bfff640 1 -- 172.21.15.120:0/3251640130 learned_addr learned my addr 172.21.15.120:0/3251640130 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:29:28.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.182+0000 7f4661081640 1 --2- 172.21.15.120:0/3251640130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f465c19cad0 0x7f465c19cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:28.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.182+0000 7f4660880640 1 --2- 172.21.15.120:0/3251640130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f465c1008a0 0x7f465c198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:28.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.182+0000 7f465bfff640 1 -- 172.21.15.120:0/3251640130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f465c1008a0 msgr2=0x7f465c198210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:28.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.182+0000 7f465bfff640 1 --2- 172.21.15.120:0/3251640130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f465c1008a0 0x7f465c198210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:28.187 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.182+0000 7f465bfff640 1 -- 172.21.15.120:0/3251640130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f465c19cad0 msgr2=0x7f465c19cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:28.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.182+0000 7f465bfff640 1 --2- 172.21.15.120:0/3251640130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f465c19cad0 0x7f465c19cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:28.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.182+0000 7f465bfff640 1 -- 172.21.15.120:0/3251640130 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f465c19d5c0 con 0x7f465c1080f0 2024-09-19T05:29:28.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.182+0000 7f4661081640 1 --2- 172.21.15.120:0/3251640130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f465c19cad0 0x7f465c19cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T05:29:28.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.182+0000 7f465bfff640 1 --2- 172.21.15.120:0/3251640130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f465c1080f0 0x7f465c198750 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4650004040 tx=0x7f4650004070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:28.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.182+0000 7f4659ffb640 1 -- 172.21.15.120:0/3251640130 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465003f030 con 0x7f465c1080f0 2024-09-19T05:29:28.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.182+0000 7f4659ffb640 1 -- 172.21.15.120:0/3251640130 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f4650003aa0 con 0x7f465c1080f0 2024-09-19T05:29:28.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.182+0000 7f4662ae4640 1 -- 172.21.15.120:0/3251640130 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f465c19d850 con 0x7f465c1080f0 2024-09-19T05:29:28.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.182+0000 7f4659ffb640 1 -- 172.21.15.120:0/3251640130 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4650035070 con 0x7f465c1080f0 2024-09-19T05:29:28.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.183+0000 7f4662ae4640 1 -- 172.21.15.120:0/3251640130 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f465c1a5070 con 0x7f465c1080f0 2024-09-19T05:29:28.188 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.184+0000 7f4662ae4640 1 -- 172.21.15.120:0/3251640130 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f465c100c80 con 0x7f465c1080f0 2024-09-19T05:29:28.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.185+0000 7f4659ffb640 1 -- 172.21.15.120:0/3251640130 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f4650042030 con 0x7f465c1080f0 2024-09-19T05:29:28.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.186+0000 7f4659ffb640 1 --2- 172.21.15.120:0/3251640130 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f46440a34e0 0x7f46440a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:28.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.186+0000 7f4660880640 1 --2- 172.21.15.120:0/3251640130 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f46440a34e0 0x7f46440a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:28.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.186+0000 7f4659ffb640 1 -- 172.21.15.120:0/3251640130 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8643+0+0 (secure 0 0 0) 0x7f46500f0090 con 0x7f465c1080f0 2024-09-19T05:29:28.189 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.186+0000 7f4660880640 1 --2- 172.21.15.120:0/3251640130 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f46440a34e0 0x7f46440a59a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f464c005fd0 tx=0x7f464c00b390 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:28.192 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.191+0000 7f4659ffb640 1 -- 172.21.15.120:0/3251640130 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f46500bc3a0 con 0x7f465c1080f0 2024-09-19T05:29:28.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:28 smithi120 ceph-mon[30956]: pgmap v317: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T05:29:28.380 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.379+0000 7f4662ae4640 1 -- 172.21.15.120:0/3251640130 --> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f465c101250 con 0x7f46440a34e0 2024-09-19T05:29:28.389 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.387+0000 7f4659ffb640 1 -- 172.21.15.120:0/3251640130 <== mgr.15156 v2:172.21.15.120:6800/1306632207 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f465c101250 con 0x7f46440a34e0 2024-09-19T05:29:28.389 INFO:teuthology.orchestra.run.smithi120.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T05:19:25", "first": "2024-09-19T05:20:00", "last": "2024-09-19T05:29:00", "last_pruned": "2024-09-19T05:29:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-19T05:29:28.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.389+0000 7f4662ae4640 1 -- 172.21.15.120:0/3251640130 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f46440a34e0 msgr2=0x7f46440a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:28.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.389+0000 7f4662ae4640 1 --2- 172.21.15.120:0/3251640130 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f46440a34e0 0x7f46440a59a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f464c005fd0 tx=0x7f464c00b390 comp rx=0 tx=0).stop 2024-09-19T05:29:28.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.389+0000 7f4662ae4640 1 -- 172.21.15.120:0/3251640130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f465c1080f0 msgr2=0x7f465c198750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:28.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.389+0000 7f4662ae4640 1 --2- 172.21.15.120:0/3251640130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f465c1080f0 0x7f465c198750 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4650004040 tx=0x7f4650004070 comp rx=0 tx=0).stop 2024-09-19T05:29:28.391 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.389+0000 7f4662ae4640 1 -- 172.21.15.120:0/3251640130 shutdown_connections 2024-09-19T05:29:28.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.389+0000 7f4662ae4640 1 --2- 172.21.15.120:0/3251640130 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f46440a34e0 0x7f46440a59a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:28.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.389+0000 7f4662ae4640 1 --2- 172.21.15.120:0/3251640130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f465c19cad0 0x7f465c19cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:28.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.389+0000 7f4662ae4640 1 --2- 172.21.15.120:0/3251640130 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f465c1080f0 0x7f465c198750 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:28.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.389+0000 7f4662ae4640 1 --2- 172.21.15.120:0/3251640130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f465c1008a0 0x7f465c198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:28.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.389+0000 7f4662ae4640 1 -- 172.21.15.120:0/3251640130 >> 172.21.15.120:0/3251640130 conn(0x7f465c075ef0 msgr2=0x7f465c0ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:28.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.389+0000 7f4662ae4640 1 -- 172.21.15.120:0/3251640130 shutdown_connections 2024-09-19T05:29:28.392 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.389+0000 7f4662ae4640 1 -- 172.21.15.120:0/3251640130 wait complete. 2024-09-19T05:29:28.401 DEBUG:teuthology.orchestra.run.smithi120:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T05:29:28.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:28 smithi194 ceph-mon[35228]: pgmap v317: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T05:29:28.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:28 smithi178 ceph-mon[34347]: pgmap v317: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T05:29:28.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.500+0000 7f14b74e6640 1 -- 172.21.15.120:0/1325139605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14b01069e0 msgr2=0x7f14b0106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:28.504 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.500+0000 7f14b74e6640 1 --2- 172.21.15.120:0/1325139605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14b01069e0 0x7f14b0106dc0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f14ac009930 tx=0x7f14ac02a420 comp rx=0 tx=0).stop 2024-09-19T05:29:28.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.500+0000 7f14b74e6640 1 -- 172.21.15.120:0/1325139605 shutdown_connections 2024-09-19T05:29:28.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.500+0000 7f14b74e6640 1 --2- 172.21.15.120:0/1325139605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14b0101370 0x7f14b010d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:28.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.500+0000 7f14b74e6640 1 --2- 172.21.15.120:0/1325139605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14b01009d0 0x7f14b0100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:28.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.500+0000 7f14b74e6640 1 --2- 172.21.15.120:0/1325139605 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14b01069e0 0x7f14b0106dc0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:28.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.500+0000 7f14b74e6640 1 -- 172.21.15.120:0/1325139605 >> 172.21.15.120:0/1325139605 conn(0x7f14b00fc6b0 msgr2=0x7f14b00fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:28.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.500+0000 7f14b74e6640 1 -- 172.21.15.120:0/1325139605 shutdown_connections 2024-09-19T05:29:28.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.500+0000 7f14b74e6640 1 -- 172.21.15.120:0/1325139605 wait complete. 2024-09-19T05:29:28.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.501+0000 7f14b74e6640 1 Processor -- start 2024-09-19T05:29:28.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.501+0000 7f14b74e6640 1 -- start start 2024-09-19T05:29:28.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.501+0000 7f14b74e6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14b01009d0 0x7f14b01971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:28.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.501+0000 7f14b74e6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14b0101370 0x7f14b01976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:28.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.501+0000 7f14b74e6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14b01069e0 0x7f14b019ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:28.505 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.501+0000 7f14b74e6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f14b0110cd0 con 0x7f14b01069e0 2024-09-19T05:29:28.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.501+0000 7f14b74e6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f14b0110b50 con 0x7f14b0101370 2024-09-19T05:29:28.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.501+0000 7f14b74e6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f14b0110e50 con 0x7f14b01009d0 2024-09-19T05:29:28.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.501+0000 7f14b5a83640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14b01069e0 0x7f14b019ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:28.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.501+0000 7f14b5a83640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14b01069e0 0x7f14b019ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45648/0 (socket says 172.21.15.120:45648) 2024-09-19T05:29:28.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.501+0000 7f14b5a83640 1 -- 172.21.15.120:0/1360153527 learned_addr learned my addr 172.21.15.120:0/1360153527 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:29:28.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.501+0000 7f14b5282640 1 --2- 172.21.15.120:0/1360153527 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14b01009d0 0x7f14b01971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:28.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.501+0000 7f14b4a81640 1 --2- 172.21.15.120:0/1360153527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14b0101370 0x7f14b01976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:28.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.502+0000 7f14b5a83640 1 -- 172.21.15.120:0/1360153527 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14b01009d0 msgr2=0x7f14b01971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:28.506 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.502+0000 7f14b5a83640 1 --2- 172.21.15.120:0/1360153527 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14b01009d0 0x7f14b01971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:28.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.502+0000 7f14b5a83640 1 -- 172.21.15.120:0/1360153527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14b0101370 msgr2=0x7f14b01976e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:28.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.502+0000 7f14b5a83640 1 --2- 172.21.15.120:0/1360153527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14b0101370 0x7f14b01976e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:28.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.502+0000 7f14b5a83640 1 -- 172.21.15.120:0/1360153527 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b019c190 con 0x7f14b01069e0 2024-09-19T05:29:28.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.502+0000 7f14b5a83640 1 --2- 172.21.15.120:0/1360153527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14b01069e0 0x7f14b019ba60 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f14a800eaa0 tx=0x7f14a800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:28.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.502+0000 7f14a67fc640 1 -- 172.21.15.120:0/1360153527 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a800cdb0 con 0x7f14b01069e0 2024-09-19T05:29:28.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.502+0000 7f14a67fc640 1 -- 172.21.15.120:0/1360153527 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f14a8005020 con 0x7f14b01069e0 2024-09-19T05:29:28.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.502+0000 7f14b74e6640 1 -- 172.21.15.120:0/1360153527 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14b019c480 con 0x7f14b01069e0 2024-09-19T05:29:28.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.502+0000 7f14a67fc640 1 -- 172.21.15.120:0/1360153527 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a80116d0 con 0x7f14b01069e0 2024-09-19T05:29:28.507 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.502+0000 7f14b74e6640 1 -- 172.21.15.120:0/1360153527 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14b01a3d10 con 0x7f14b01069e0 2024-09-19T05:29:28.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.503+0000 7f14b74e6640 1 -- 172.21.15.120:0/1360153527 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14b0100e30 con 0x7f14b01069e0 2024-09-19T05:29:28.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.504+0000 7f14a67fc640 1 -- 172.21.15.120:0/1360153527 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f14a80051d0 con 0x7f14b01069e0 2024-09-19T05:29:28.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.505+0000 7f14a67fc640 1 --2- 172.21.15.120:0/1360153527 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f149c0a34e0 0x7f149c0a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:28.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.505+0000 7f14b5282640 1 --2- 172.21.15.120:0/1360153527 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f149c0a34e0 0x7f149c0a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:28.508 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.505+0000 7f14a67fc640 1 -- 172.21.15.120:0/1360153527 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8643+0+0 (secure 0 0 0) 0x7f14a80cfde0 con 0x7f14b01069e0 2024-09-19T05:29:28.509 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.506+0000 7f14b5282640 1 --2- 172.21.15.120:0/1360153527 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f149c0a34e0 0x7f149c0a59a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f14ac009900 tx=0x7f14ac000bc0 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:28.512 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.509+0000 7f14a67fc640 1 -- 172.21.15.120:0/1360153527 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f14a8016030 con 0x7f14b01069e0 2024-09-19T05:29:28.698 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.696+0000 7f14b74e6640 1 -- 172.21.15.120:0/1360153527 --> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f14b0062630 con 0x7f149c0a34e0 2024-09-19T05:29:28.706 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.704+0000 7f14a67fc640 1 -- 172.21.15.120:0/1360153527 <== mgr.15156 v2:172.21.15.120:6800/1306632207 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f14b0062630 con 0x7f149c0a34e0 2024-09-19T05:29:28.706 INFO:teuthology.orchestra.run.smithi120.stdout:/ 1m 6m3h 2024-09-19T05:29:28.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.706+0000 7f14b74e6640 1 -- 172.21.15.120:0/1360153527 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f149c0a34e0 msgr2=0x7f149c0a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:28.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.706+0000 7f14b74e6640 1 --2- 172.21.15.120:0/1360153527 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f149c0a34e0 0x7f149c0a59a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f14ac009900 tx=0x7f14ac000bc0 comp rx=0 tx=0).stop 2024-09-19T05:29:28.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.706+0000 7f14b74e6640 1 -- 172.21.15.120:0/1360153527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14b01069e0 msgr2=0x7f14b019ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:28.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.706+0000 7f14b74e6640 1 --2- 172.21.15.120:0/1360153527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14b01069e0 0x7f14b019ba60 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f14a800eaa0 tx=0x7f14a800ef60 comp rx=0 tx=0).stop 2024-09-19T05:29:28.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.706+0000 7f14b74e6640 1 -- 172.21.15.120:0/1360153527 shutdown_connections 2024-09-19T05:29:28.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.706+0000 7f14b74e6640 1 --2- 172.21.15.120:0/1360153527 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f149c0a34e0 0x7f149c0a59a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:28.708 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.706+0000 7f14b74e6640 1 --2- 172.21.15.120:0/1360153527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14b01069e0 0x7f14b019ba60 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:28.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.706+0000 7f14b74e6640 1 --2- 172.21.15.120:0/1360153527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14b0101370 0x7f14b01976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:28.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.706+0000 7f14b74e6640 1 --2- 172.21.15.120:0/1360153527 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14b01009d0 0x7f14b01971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:28.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.706+0000 7f14b74e6640 1 -- 172.21.15.120:0/1360153527 >> 172.21.15.120:0/1360153527 conn(0x7f14b00fc6b0 msgr2=0x7f14b00fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:28.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.706+0000 7f14b74e6640 1 -- 172.21.15.120:0/1360153527 shutdown_connections 2024-09-19T05:29:28.709 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.706+0000 7f14b74e6640 1 -- 172.21.15.120:0/1360153527 wait complete. 2024-09-19T05:29:28.719 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-19T05:29:28.730 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-19T05:29:28.730 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-09-19T05:29:28.731 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T05:29:28.750 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T05:29:28.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.848+0000 7fca5b89b640 1 -- 172.21.15.120:0/3110987050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca54102c80 msgr2=0x7fca54103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:28.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.848+0000 7fca5b89b640 1 --2- 172.21.15.120:0/3110987050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca54102c80 0x7fca54103060 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fca44009900 tx=0x7fca4402a480 comp rx=0 tx=0).stop 2024-09-19T05:29:28.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.848+0000 7fca5b89b640 1 -- 172.21.15.120:0/3110987050 shutdown_connections 2024-09-19T05:29:28.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.848+0000 7fca5b89b640 1 --2- 172.21.15.120:0/3110987050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca5410c0a0 0x7fca5410e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:28.852 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.848+0000 7fca5b89b640 1 --2- 172.21.15.120:0/3110987050 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca541035a0 0x7fca5410ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:28.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.848+0000 7fca5b89b640 1 --2- 172.21.15.120:0/3110987050 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca54102c80 0x7fca54103060 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:28.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.848+0000 7fca5b89b640 1 -- 172.21.15.120:0/3110987050 >> 172.21.15.120:0/3110987050 conn(0x7fca540fc690 msgr2=0x7fca540feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:28.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.848+0000 7fca5b89b640 1 -- 172.21.15.120:0/3110987050 shutdown_connections 2024-09-19T05:29:28.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.848+0000 7fca5b89b640 1 -- 172.21.15.120:0/3110987050 wait complete. 2024-09-19T05:29:28.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.849+0000 7fca5b89b640 1 Processor -- start 2024-09-19T05:29:28.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.849+0000 7fca5b89b640 1 -- start start 2024-09-19T05:29:28.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.849+0000 7fca5b89b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca54102c80 0x7fca541983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:28.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.849+0000 7fca5b89b640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca541035a0 0x7fca541988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:28.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.849+0000 7fca5b89b640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca5410c0a0 0x7fca5419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:28.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.849+0000 7fca5b89b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fca54111dc0 con 0x7fca54102c80 2024-09-19T05:29:28.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.849+0000 7fca5b89b640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fca54111c40 con 0x7fca5410c0a0 2024-09-19T05:29:28.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.849+0000 7fca5b89b640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fca54111f40 con 0x7fca541035a0 2024-09-19T05:29:28.853 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.849+0000 7fca59637640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca54102c80 0x7fca541983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:28.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.849+0000 7fca59637640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca54102c80 0x7fca541983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45660/0 (socket says 172.21.15.120:45660) 2024-09-19T05:29:28.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.849+0000 7fca59637640 1 -- 172.21.15.120:0/134802929 learned_addr learned my addr 172.21.15.120:0/134802929 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:29:28.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.849+0000 7fca59637640 1 -- 172.21.15.120:0/134802929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca541035a0 msgr2=0x7fca541988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:28.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.849+0000 7fca59637640 1 --2- 172.21.15.120:0/134802929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca541035a0 0x7fca541988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:28.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.849+0000 7fca59637640 1 -- 172.21.15.120:0/134802929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca5410c0a0 msgr2=0x7fca5419cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:28.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.849+0000 7fca59e38640 1 --2- 172.21.15.120:0/134802929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca5410c0a0 0x7fca5419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:28.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.849+0000 7fca59637640 1 --2- 172.21.15.120:0/134802929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca5410c0a0 0x7fca5419cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:28.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.849+0000 7fca59637640 1 -- 172.21.15.120:0/134802929 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5419d3a0 con 0x7fca54102c80 2024-09-19T05:29:28.854 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.849+0000 7fca59e38640 1 --2- 172.21.15.120:0/134802929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca5410c0a0 0x7fca5419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:29:28.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.850+0000 7fca59637640 1 --2- 172.21.15.120:0/134802929 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca54102c80 0x7fca541983b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fca44005ab0 tx=0x7fca44003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:28.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.850+0000 7fca4a7fc640 1 -- 172.21.15.120:0/134802929 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4403f070 con 0x7fca54102c80 2024-09-19T05:29:28.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.850+0000 7fca4a7fc640 1 -- 172.21.15.120:0/134802929 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fca44031d60 con 0x7fca54102c80 2024-09-19T05:29:28.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.850+0000 7fca5b89b640 1 -- 172.21.15.120:0/134802929 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca5419d630 con 0x7fca54102c80 2024-09-19T05:29:28.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.850+0000 7fca4a7fc640 1 -- 172.21.15.120:0/134802929 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44035030 con 0x7fca54102c80 2024-09-19T05:29:28.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.850+0000 7fca5b89b640 1 -- 172.21.15.120:0/134802929 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca541a4f20 con 0x7fca54102c80 2024-09-19T05:29:28.855 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.851+0000 7fca5b89b640 1 -- 172.21.15.120:0/134802929 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca54103060 con 0x7fca54102c80 2024-09-19T05:29:28.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.852+0000 7fca4a7fc640 1 -- 172.21.15.120:0/134802929 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fca44042070 con 0x7fca54102c80 2024-09-19T05:29:28.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.852+0000 7fca4a7fc640 1 --2- 172.21.15.120:0/134802929 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fca400a3440 0x7fca400a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:28.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.853+0000 7fca58e36640 1 --2- 172.21.15.120:0/134802929 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fca400a3440 0x7fca400a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:28.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.853+0000 7fca4a7fc640 1 -- 172.21.15.120:0/134802929 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8643+0+0 (secure 0 0 0) 0x7fca440f06d0 con 0x7fca54102c80 2024-09-19T05:29:28.856 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.853+0000 7fca58e36640 1 --2- 172.21.15.120:0/134802929 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fca400a3440 0x7fca400a5900 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fca50005fd0 tx=0x7fca50005850 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:28.857 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:28.857+0000 7fca4a7fc640 1 -- 172.21.15.120:0/134802929 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fca440bd030 con 0x7fca54102c80 2024-09-19T05:29:29.026 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.025+0000 7fca5b89b640 1 -- 172.21.15.120:0/134802929 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca54107100 con 0x7fca54102c80 2024-09-19T05:29:29.027 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.026+0000 7fca4a7fc640 1 -- 172.21.15.120:0/134802929 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+23442 (secure 0 0 0) 0x7fca440bc930 con 0x7fca54102c80 2024-09-19T05:29:29.028 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:29:29.028 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":93,"fsid":"4e6e3df4-7645-11ef-bceb-c7b262605968","created":"2024-09-19T05:09:55.847220+0000","modified":"2024-09-19T05:29:16.106693+0000","last_up_change":"2024-09-19T05:16:42.808178+0000","last_in_change":"2024-09-19T05:16:18.315940+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T05:13:02.340027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T05:17:26.914416+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T05:17:29.112997+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":92,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"18907a03-1f43-419a-acb6-9fa4cf5020d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6803","nonce":3421474326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6805","nonce":3421474326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6809","nonce":3421474326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":3421474326},{"type":"v1","addr":"172.21.15.120:6807","nonce":3421474326}]},"public_addr":"172.21.15.120:6803/3421474326","cluster_addr":"172.21.15.120:6805/3421474326","heartbeat_back_addr":"172.21.15.120:6809/3421474326","heartbeat_front_addr":"172.21.15.120:6807/3421474326","state":["exists","up"]},{"osd":1,"uuid":"d21e029b-8a60-43f9-9ba7-30cdba19ba57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6801","nonce":1195511218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6803","nonce":1195511218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6807","nonce":1195511218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":1195511218},{"type":"v1","addr":"172.21.15.178:6805","nonce":1195511218}]},"public_addr":"172.21.15.178:6801/1195511218","cluster_addr":"172.21.15.178:6803/1195511218","heartbeat_back_addr":"172.21.15.178:6807/1195511218","heartbeat_front_addr":"172.21.15.178:6805/1195511218","state":["exists","up"]},{"osd":2,"uuid":"26ad9c8d-dbaa-46c2-a346-19717d81cc60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6801","nonce":3752826560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6803","nonce":3752826560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6807","nonce":3752826560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3752826560},{"type":"v1","addr":"172.21.15.194:6805","nonce":3752826560}]},"public_addr":"172.21.15.194:6801/3752826560","cluster_addr":"172.21.15.194:6803/3752826560","heartbeat_back_addr":"172.21.15.194:6807/3752826560","heartbeat_front_addr":"172.21.15.194:6805/3752826560","state":["exists","up"]},{"osd":3,"uuid":"7e266576-8a98-40a8-9532-4b6f4611a908","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6811","nonce":803566783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6813","nonce":803566783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6817","nonce":803566783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":803566783},{"type":"v1","addr":"172.21.15.120:6815","nonce":803566783}]},"public_addr":"172.21.15.120:6811/803566783","cluster_addr":"172.21.15.120:6813/803566783","heartbeat_back_addr":"172.21.15.120:6817/803566783","heartbeat_front_addr":"172.21.15.120:6815/803566783","state":["exists","up"]},{"osd":4,"uuid":"c77d05c5-3b8f-4f7b-91f9-833735221684","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6809","nonce":541165323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6811","nonce":541165323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6815","nonce":541165323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":541165323},{"type":"v1","addr":"172.21.15.178:6813","nonce":541165323}]},"public_addr":"172.21.15.178:6809/541165323","cluster_addr":"172.21.15.178:6811/541165323","heartbeat_back_addr":"172.21.15.178:6815/541165323","heartbeat_front_addr":"172.21.15.178:6813/541165323","state":["exists","up"]},{"osd":5,"uuid":"5f1c394b-e510-411f-969a-2db2b68cf41a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6809","nonce":2631415468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6811","nonce":2631415468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6815","nonce":2631415468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":2631415468},{"type":"v1","addr":"172.21.15.194:6813","nonce":2631415468}]},"public_addr":"172.21.15.194:6809/2631415468","cluster_addr":"172.21.15.194:6811/2631415468","heartbeat_back_addr":"172.21.15.194:6815/2631415468","heartbeat_front_addr":"172.21.15.194:6813/2631415468","state":["exists","up"]},{"osd":6,"uuid":"990af639-099e-49df-a083-05626cee3c3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6819","nonce":388238976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6821","nonce":388238976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6825","nonce":388238976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":388238976},{"type":"v1","addr":"172.21.15.120:6823","nonce":388238976}]},"public_addr":"172.21.15.120:6819/388238976","cluster_addr":"172.21.15.120:6821/388238976","heartbeat_back_addr":"172.21.15.120:6825/388238976","heartbeat_front_addr":"172.21.15.120:6823/388238976","state":["exists","up"]},{"osd":7,"uuid":"6f4aa6ab-b5f4-4c06-9f14-9a51bc195ca9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6817","nonce":1912109177}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6819","nonce":1912109177}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6823","nonce":1912109177}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":1912109177},{"type":"v1","addr":"172.21.15.178:6821","nonce":1912109177}]},"public_addr":"172.21.15.178:6817/1912109177","cluster_addr":"172.21.15.178:6819/1912109177","heartbeat_back_addr":"172.21.15.178:6823/1912109177","heartbeat_front_addr":"172.21.15.178:6821/1912109177","state":["exists","up"]},{"osd":8,"uuid":"707739c9-732a-405c-847a-ce6a06e611b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6817","nonce":596878172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6819","nonce":596878172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6823","nonce":596878172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":596878172},{"type":"v1","addr":"172.21.15.194:6821","nonce":596878172}]},"public_addr":"172.21.15.194:6817/596878172","cluster_addr":"172.21.15.194:6819/596878172","heartbeat_back_addr":"172.21.15.194:6823/596878172","heartbeat_front_addr":"172.21.15.194:6821/596878172","state":["exists","up"]},{"osd":9,"uuid":"9393b018-c924-4d75-99e5-25433d276567","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6827","nonce":3257373801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6829","nonce":3257373801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6833","nonce":3257373801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":3257373801},{"type":"v1","addr":"172.21.15.120:6831","nonce":3257373801}]},"public_addr":"172.21.15.120:6827/3257373801","cluster_addr":"172.21.15.120:6829/3257373801","heartbeat_back_addr":"172.21.15.120:6833/3257373801","heartbeat_front_addr":"172.21.15.120:6831/3257373801","state":["exists","up"]},{"osd":10,"uuid":"45db7f62-87a6-4b2b-a3dc-012e2de505e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6825","nonce":3067822030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6827","nonce":3067822030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6831","nonce":3067822030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":3067822030},{"type":"v1","addr":"172.21.15.178:6829","nonce":3067822030}]},"public_addr":"172.21.15.178:6825/3067822030","cluster_addr":"172.21.15.178:6827/3067822030","heartbeat_back_addr":"172.21.15.178:6831/3067822030","heartbeat_front_addr":"172.21.15.178:6829/3067822030","state":["exists","up"]},{"osd":11,"uuid":"85ea248c-9a36-41cb-a200-87138fb31602","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6825","nonce":2713146974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6827","nonce":2713146974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6831","nonce":2713146974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2713146974},{"type":"v1","addr":"172.21.15.194:6829","nonce":2713146974}]},"public_addr":"172.21.15.194:6825/2713146974","cluster_addr":"172.21.15.194:6827/2713146974","heartbeat_back_addr":"172.21.15.194:6831/2713146974","heartbeat_front_addr":"172.21.15.194:6829/2713146974","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:09.395371+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:33.648930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:12:58.805048+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:23.621459+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:13:48.553860+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:13.506636+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:14:38.520376+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:02.695124+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:27.084956+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:15:50.924128+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:15.396694+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T05:16:40.440416+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":3,"to":8}]},{"pgid":"3.2a","mappings":[{"from":3,"to":6}]},{"pgid":"3.37","mappings":[{"from":1,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.120:0/316867529":"2024-09-20T05:19:14.314860+0000","172.21.15.120:0/1091097763":"2024-09-20T05:19:14.314860+0000","172.21.15.120:6801/955692128":"2024-09-20T05:19:14.314860+0000","172.21.15.120:6800/3412493069":"2024-09-20T05:10:23.348128+0000","172.21.15.120:6801/3412493069":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/4255533863":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/3592867428":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/2867300720":"2024-09-20T05:10:23.348128+0000","172.21.15.120:0/3049956965":"2024-09-20T05:19:14.314860+0000","172.21.15.120:0/4177074351":"2024-09-20T05:10:48.027892+0000","172.21.15.120:6800/50152720":"2024-09-20T05:10:48.027892+0000","172.21.15.120:6801/50152720":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/329623296":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/3419110398":"2024-09-20T05:10:48.027892+0000","172.21.15.120:0/3080806681":"2024-09-20T05:19:14.314860+0000","172.21.15.120:0/1358819866":"2024-09-20T05:19:14.314860+0000","172.21.15.120:6800/955692128":"2024-09-20T05:19:14.314860+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T05:29:29.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.029+0000 7fca5b89b640 1 -- 172.21.15.120:0/134802929 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fca400a3440 msgr2=0x7fca400a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:29.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.029+0000 7fca5b89b640 1 --2- 172.21.15.120:0/134802929 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fca400a3440 0x7fca400a5900 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fca50005fd0 tx=0x7fca50005850 comp rx=0 tx=0).stop 2024-09-19T05:29:29.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.029+0000 7fca5b89b640 1 -- 172.21.15.120:0/134802929 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca54102c80 msgr2=0x7fca541983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:29.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.029+0000 7fca5b89b640 1 --2- 172.21.15.120:0/134802929 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca54102c80 0x7fca541983b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fca44005ab0 tx=0x7fca44003cd0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.029+0000 7fca5b89b640 1 -- 172.21.15.120:0/134802929 shutdown_connections 2024-09-19T05:29:29.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.029+0000 7fca5b89b640 1 --2- 172.21.15.120:0/134802929 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fca400a3440 0x7fca400a5900 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.029+0000 7fca5b89b640 1 --2- 172.21.15.120:0/134802929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca5410c0a0 0x7fca5419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.029+0000 7fca5b89b640 1 --2- 172.21.15.120:0/134802929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca541035a0 0x7fca541988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.029+0000 7fca5b89b640 1 --2- 172.21.15.120:0/134802929 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca54102c80 0x7fca541983b0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.029+0000 7fca5b89b640 1 -- 172.21.15.120:0/134802929 >> 172.21.15.120:0/134802929 conn(0x7fca540fc690 msgr2=0x7fca540fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:29.030 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.029+0000 7fca5b89b640 1 -- 172.21.15.120:0/134802929 shutdown_connections 2024-09-19T05:29:29.031 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.029+0000 7fca5b89b640 1 -- 172.21.15.120:0/134802929 wait complete. 2024-09-19T05:29:29.041 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T05:13:02.340027+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T05:17:26.914416+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T05:17:29.112997+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 92, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T05:29:29.041 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T05:29:29.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.141+0000 7f0f4200e640 1 -- 172.21.15.120:0/2098488848 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f3c101200 msgr2=0x7f0f3c10dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:29.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.141+0000 7f0f4200e640 1 --2- 172.21.15.120:0/2098488848 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f3c101200 0x7f0f3c10dde0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0f30009900 tx=0x7f0f3002a410 comp rx=0 tx=0).stop 2024-09-19T05:29:29.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.141+0000 7f0f4200e640 1 -- 172.21.15.120:0/2098488848 shutdown_connections 2024-09-19T05:29:29.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.141+0000 7f0f4200e640 1 --2- 172.21.15.120:0/2098488848 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f3c10e450 0x7f0f3c110860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.141+0000 7f0f4200e640 1 --2- 172.21.15.120:0/2098488848 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f3c101200 0x7f0f3c10dde0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.141+0000 7f0f4200e640 1 --2- 172.21.15.120:0/2098488848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f3c1008e0 0x7f0f3c100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.146 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.141+0000 7f0f4200e640 1 -- 172.21.15.120:0/2098488848 >> 172.21.15.120:0/2098488848 conn(0x7f0f3c075e00 msgr2=0x7f0f3c076210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:29.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.142+0000 7f0f4200e640 1 -- 172.21.15.120:0/2098488848 shutdown_connections 2024-09-19T05:29:29.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.142+0000 7f0f4200e640 1 -- 172.21.15.120:0/2098488848 wait complete. 2024-09-19T05:29:29.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.142+0000 7f0f4200e640 1 Processor -- start 2024-09-19T05:29:29.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.142+0000 7f0f4200e640 1 -- start start 2024-09-19T05:29:29.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.142+0000 7f0f4200e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f3c1008e0 0x7f0f3c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:29.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.142+0000 7f0f4200e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f3c101200 0x7f0f3c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:29.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.142+0000 7f0f4200e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f3c10e450 0x7f0f3c19ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:29.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.142+0000 7f0f4200e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c114050 con 0x7f0f3c101200 2024-09-19T05:29:29.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.142+0000 7f0f4200e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c113ed0 con 0x7f0f3c1008e0 2024-09-19T05:29:29.147 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.142+0000 7f0f4200e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0f3c1141d0 con 0x7f0f3c10e450 2024-09-19T05:29:29.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.143+0000 7f0f3affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f3c101200 0x7f0f3c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:29.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.143+0000 7f0f3affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f3c101200 0x7f0f3c19ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45674/0 (socket says 172.21.15.120:45674) 2024-09-19T05:29:29.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.143+0000 7f0f3affd640 1 -- 172.21.15.120:0/1250033438 learned_addr learned my addr 172.21.15.120:0/1250033438 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:29:29.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.143+0000 7f0f3bfff640 1 --2- 172.21.15.120:0/1250033438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f3c10e450 0x7f0f3c19ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:29.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.143+0000 7f0f3b7fe640 1 --2- 172.21.15.120:0/1250033438 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f3c1008e0 0x7f0f3c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:29.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.143+0000 7f0f3affd640 1 -- 172.21.15.120:0/1250033438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f3c10e450 msgr2=0x7f0f3c19ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:29.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.143+0000 7f0f3affd640 1 --2- 172.21.15.120:0/1250033438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f3c10e450 0x7f0f3c19ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.143+0000 7f0f3affd640 1 -- 172.21.15.120:0/1250033438 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f3c1008e0 msgr2=0x7f0f3c19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:29.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.143+0000 7f0f3affd640 1 --2- 172.21.15.120:0/1250033438 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f3c1008e0 0x7f0f3c19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.143+0000 7f0f3affd640 1 -- 172.21.15.120:0/1250033438 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3c19f630 con 0x7f0f3c101200 2024-09-19T05:29:29.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.143+0000 7f0f3affd640 1 --2- 172.21.15.120:0/1250033438 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f3c101200 0x7f0f3c19ab80 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0f30005940 tx=0x7f0f300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:29.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.143+0000 7f0f38ff9640 1 -- 172.21.15.120:0/1250033438 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3003f030 con 0x7f0f3c101200 2024-09-19T05:29:29.148 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.143+0000 7f0f38ff9640 1 -- 172.21.15.120:0/1250033438 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0f30003cb0 con 0x7f0f3c101200 2024-09-19T05:29:29.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.143+0000 7f0f4200e640 1 -- 172.21.15.120:0/1250033438 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f3c19f8c0 con 0x7f0f3c101200 2024-09-19T05:29:29.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.143+0000 7f0f38ff9640 1 -- 172.21.15.120:0/1250033438 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f30035070 con 0x7f0f3c101200 2024-09-19T05:29:29.149 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.143+0000 7f0f4200e640 1 -- 172.21.15.120:0/1250033438 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f3c1a71b0 con 0x7f0f3c101200 2024-09-19T05:29:29.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.144+0000 7f0f4200e640 1 -- 172.21.15.120:0/1250033438 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f3c100cc0 con 0x7f0f3c101200 2024-09-19T05:29:29.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.146+0000 7f0f38ff9640 1 -- 172.21.15.120:0/1250033438 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f0f30042030 con 0x7f0f3c101200 2024-09-19T05:29:29.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.146+0000 7f0f38ff9640 1 --2- 172.21.15.120:0/1250033438 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0f240a33c0 0x7f0f240a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:29.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.147+0000 7f0f3b7fe640 1 --2- 172.21.15.120:0/1250033438 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0f240a33c0 0x7f0f240a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:29.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.147+0000 7f0f38ff9640 1 -- 172.21.15.120:0/1250033438 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8643+0+0 (secure 0 0 0) 0x7f0f300f04b0 con 0x7f0f3c101200 2024-09-19T05:29:29.150 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.147+0000 7f0f3b7fe640 1 --2- 172.21.15.120:0/1250033438 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0f240a33c0 0x7f0f240a5880 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c005d00 tx=0x7f0f2c00b410 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:29.152 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.151+0000 7f0f38ff9640 1 -- 172.21.15.120:0/1250033438 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0f300bc7c0 con 0x7f0f3c101200 2024-09-19T05:29:29.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.318+0000 7f0f4200e640 1 -- 172.21.15.120:0/1250033438 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0f3c1094b0 con 0x7f0f3c101200 2024-09-19T05:29:29.320 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.319+0000 7f0f38ff9640 1 -- 172.21.15.120:0/1250033438 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7f0f300c0ac0 con 0x7f0f3c101200 2024-09-19T05:29:29.321 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2024-09-19T05:29:29.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.321+0000 7f0f4200e640 1 -- 172.21.15.120:0/1250033438 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0f240a33c0 msgr2=0x7f0f240a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:29.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.321+0000 7f0f4200e640 1 --2- 172.21.15.120:0/1250033438 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0f240a33c0 0x7f0f240a5880 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c005d00 tx=0x7f0f2c00b410 comp rx=0 tx=0).stop 2024-09-19T05:29:29.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.321+0000 7f0f4200e640 1 -- 172.21.15.120:0/1250033438 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f3c101200 msgr2=0x7f0f3c19ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:29.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.321+0000 7f0f4200e640 1 --2- 172.21.15.120:0/1250033438 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f3c101200 0x7f0f3c19ab80 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0f30005940 tx=0x7f0f300042f0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.321+0000 7f0f4200e640 1 -- 172.21.15.120:0/1250033438 shutdown_connections 2024-09-19T05:29:29.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.321+0000 7f0f4200e640 1 --2- 172.21.15.120:0/1250033438 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0f240a33c0 0x7f0f240a5880 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.323 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.321+0000 7f0f4200e640 1 --2- 172.21.15.120:0/1250033438 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f3c10e450 0x7f0f3c19ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.321+0000 7f0f4200e640 1 --2- 172.21.15.120:0/1250033438 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f3c101200 0x7f0f3c19ab80 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.321+0000 7f0f4200e640 1 --2- 172.21.15.120:0/1250033438 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f3c1008e0 0x7f0f3c19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.321+0000 7f0f4200e640 1 -- 172.21.15.120:0/1250033438 >> 172.21.15.120:0/1250033438 conn(0x7f0f3c075e00 msgr2=0x7f0f3c10ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:29.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.321+0000 7f0f4200e640 1 -- 172.21.15.120:0/1250033438 shutdown_connections 2024-09-19T05:29:29.324 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.321+0000 7f0f4200e640 1 -- 172.21.15.120:0/1250033438 wait complete. 2024-09-19T05:29:29.332 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:29 smithi120 ceph-mon[30956]: from='client.16338 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:29:29.332 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:29 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/134802929' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:29:29.333 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T05:29:29.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:29 smithi194 ceph-mon[35228]: from='client.16338 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:29:29.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:29 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/134802929' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:29:29.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.433+0000 7f4717ce6640 1 -- 172.21.15.120:0/939543877 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47101023a0 msgr2=0x7f4710106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:29.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.433+0000 7f4717ce6640 1 --2- 172.21.15.120:0/939543877 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47101023a0 0x7f4710106840 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f470c009900 tx=0x7f470c02a410 comp rx=0 tx=0).stop 2024-09-19T05:29:29.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.433+0000 7f4717ce6640 1 -- 172.21.15.120:0/939543877 shutdown_connections 2024-09-19T05:29:29.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.433+0000 7f4717ce6640 1 --2- 172.21.15.120:0/939543877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4710106fa0 0x7f471010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.433+0000 7f4717ce6640 1 --2- 172.21.15.120:0/939543877 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47101023a0 0x7f4710106840 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.437 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.433+0000 7f4717ce6640 1 --2- 172.21.15.120:0/939543877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47101019f0 0x7f4710101dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.433+0000 7f4717ce6640 1 -- 172.21.15.120:0/939543877 >> 172.21.15.120:0/939543877 conn(0x7f4710075ea0 msgr2=0x7f47100762b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:29.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.433+0000 7f4717ce6640 1 -- 172.21.15.120:0/939543877 shutdown_connections 2024-09-19T05:29:29.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.433+0000 7f4717ce6640 1 -- 172.21.15.120:0/939543877 wait complete. 2024-09-19T05:29:29.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.433+0000 7f4717ce6640 1 Processor -- start 2024-09-19T05:29:29.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.433+0000 7f4717ce6640 1 -- start start 2024-09-19T05:29:29.438 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.433+0000 7f4717ce6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47101019f0 0x7f4710197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:29.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.433+0000 7f4717ce6640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4710106fa0 0x7f47101978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:29.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.434+0000 7f4717ce6640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f471019bc20 0x7f471019c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:29.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.434+0000 7f4717ce6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f4710110d70 con 0x7f47101019f0 2024-09-19T05:29:29.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.434+0000 7f4717ce6640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f4710110bf0 con 0x7f4710106fa0 2024-09-19T05:29:29.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.434+0000 7f4717ce6640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4710110ef0 con 0x7f471019bc20 2024-09-19T05:29:29.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.434+0000 7f4715a82640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47101019f0 0x7f4710197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:29.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.434+0000 7f4715a82640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47101019f0 0x7f4710197360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45696/0 (socket says 172.21.15.120:45696) 2024-09-19T05:29:29.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.434+0000 7f4715a82640 1 -- 172.21.15.120:0/683044956 learned_addr learned my addr 172.21.15.120:0/683044956 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:29:29.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.434+0000 7f4716283640 1 --2- 172.21.15.120:0/683044956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f471019bc20 0x7f471019c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:29.439 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.434+0000 7f4715a82640 1 -- 172.21.15.120:0/683044956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f471019bc20 msgr2=0x7f471019c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:29.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.434+0000 7f4715a82640 1 --2- 172.21.15.120:0/683044956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f471019bc20 0x7f471019c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.434+0000 7f4715a82640 1 -- 172.21.15.120:0/683044956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4710106fa0 msgr2=0x7f47101978a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T05:29:29.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.434+0000 7f4715a82640 1 --2- 172.21.15.120:0/683044956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4710106fa0 0x7f47101978a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.434+0000 7f4715a82640 1 -- 172.21.15.120:0/683044956 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f471019c710 con 0x7f47101019f0 2024-09-19T05:29:29.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.434+0000 7f4715a82640 1 --2- 172.21.15.120:0/683044956 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47101019f0 0x7f4710197360 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f470400d770 tx=0x7f470400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:29.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.434+0000 7f4702ffd640 1 -- 172.21.15.120:0/683044956 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4704017070 con 0x7f47101019f0 2024-09-19T05:29:29.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.434+0000 7f4702ffd640 1 -- 172.21.15.120:0/683044956 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f47040054d0 con 0x7f47101019f0 2024-09-19T05:29:29.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.434+0000 7f4717ce6640 1 -- 172.21.15.120:0/683044956 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f471019ca00 con 0x7f47101019f0 2024-09-19T05:29:29.440 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.434+0000 7f4702ffd640 1 -- 172.21.15.120:0/683044956 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4704004cf0 con 0x7f47101019f0 2024-09-19T05:29:29.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.434+0000 7f4717ce6640 1 -- 172.21.15.120:0/683044956 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47101a41a0 con 0x7f47101019f0 2024-09-19T05:29:29.441 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.435+0000 7f4717ce6640 1 -- 172.21.15.120:0/683044956 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4710101dd0 con 0x7f47101019f0 2024-09-19T05:29:29.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.437+0000 7f4702ffd640 1 -- 172.21.15.120:0/683044956 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f4704004e90 con 0x7f47101019f0 2024-09-19T05:29:29.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.438+0000 7f4702ffd640 1 --2- 172.21.15.120:0/683044956 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f46fc0a33c0 0x7f46fc0a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:29.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.438+0000 7f4715281640 1 --2- 172.21.15.120:0/683044956 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f46fc0a33c0 0x7f46fc0a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:29.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.438+0000 7f4702ffd640 1 -- 172.21.15.120:0/683044956 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8643+0+0 (secure 0 0 0) 0x7f47040cfca0 con 0x7f47101019f0 2024-09-19T05:29:29.442 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.438+0000 7f4715281640 1 --2- 172.21.15.120:0/683044956 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f46fc0a33c0 0x7f46fc0a5880 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f470c0096c0 tx=0x7f470c000bc0 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:29.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:29 smithi178 ceph-mon[34347]: from='client.16338 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:29:29.443 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:29 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/134802929' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T05:29:29.443 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.441+0000 7f4702ffd640 1 -- 172.21.15.120:0/683044956 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f470409c600 con 0x7f47101019f0 2024-09-19T05:29:29.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.608+0000 7f4717ce6640 1 -- 172.21.15.120:0/683044956 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4710108f90 con 0x7f47101019f0 2024-09-19T05:29:29.611 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.609+0000 7f4702ffd640 1 -- 172.21.15.120:0/683044956 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) ==== 104+0+11 (secure 0 0 0) 0x7f470409bf00 con 0x7f47101019f0 2024-09-19T05:29:29.612 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2024-09-19T05:29:29.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.611+0000 7f4717ce6640 1 -- 172.21.15.120:0/683044956 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f46fc0a33c0 msgr2=0x7f46fc0a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:29.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.611+0000 7f4717ce6640 1 --2- 172.21.15.120:0/683044956 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f46fc0a33c0 0x7f46fc0a5880 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f470c0096c0 tx=0x7f470c000bc0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.611+0000 7f4717ce6640 1 -- 172.21.15.120:0/683044956 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47101019f0 msgr2=0x7f4710197360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:29.614 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.611+0000 7f4717ce6640 1 --2- 172.21.15.120:0/683044956 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47101019f0 0x7f4710197360 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f470400d770 tx=0x7f470400dc30 comp rx=0 tx=0).stop 2024-09-19T05:29:29.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.611+0000 7f4717ce6640 1 -- 172.21.15.120:0/683044956 shutdown_connections 2024-09-19T05:29:29.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.611+0000 7f4717ce6640 1 --2- 172.21.15.120:0/683044956 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f46fc0a33c0 0x7f46fc0a5880 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.611+0000 7f4717ce6640 1 --2- 172.21.15.120:0/683044956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f471019bc20 0x7f471019c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.615 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.611+0000 7f4717ce6640 1 --2- 172.21.15.120:0/683044956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4710106fa0 0x7f47101978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.611+0000 7f4717ce6640 1 --2- 172.21.15.120:0/683044956 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f47101019f0 0x7f4710197360 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.611+0000 7f4717ce6640 1 -- 172.21.15.120:0/683044956 >> 172.21.15.120:0/683044956 conn(0x7f4710075ea0 msgr2=0x7f4710104b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:29.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.611+0000 7f4717ce6640 1 -- 172.21.15.120:0/683044956 shutdown_connections 2024-09-19T05:29:29.616 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.611+0000 7f4717ce6640 1 -- 172.21.15.120:0/683044956 wait complete. 2024-09-19T05:29:29.625 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T05:29:29.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.724+0000 7f0cb2523640 1 -- 172.21.15.120:0/1497261018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0cac101ac0 msgr2=0x7f0cac10d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:29.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.724+0000 7f0cb2523640 1 --2- 172.21.15.120:0/1497261018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0cac101ac0 0x7f0cac10d810 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4009ca0 tx=0x7f0ca402a8c0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.732 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.724+0000 7f0cb2523640 1 -- 172.21.15.120:0/1497261018 shutdown_connections 2024-09-19T05:29:29.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.724+0000 7f0cb2523640 1 --2- 172.21.15.120:0/1497261018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0cac101ac0 0x7f0cac10d810 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.724+0000 7f0cb2523640 1 --2- 172.21.15.120:0/1497261018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cac101140 0x7f0cac101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.724+0000 7f0cb2523640 1 --2- 172.21.15.120:0/1497261018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cac1059a0 0x7f0cac105d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.724+0000 7f0cb2523640 1 -- 172.21.15.120:0/1497261018 >> 172.21.15.120:0/1497261018 conn(0x7f0cac077170 msgr2=0x7f0cac0fe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:29.733 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.724+0000 7f0cb2523640 1 -- 172.21.15.120:0/1497261018 shutdown_connections 2024-09-19T05:29:29.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.724+0000 7f0cb2523640 1 -- 172.21.15.120:0/1497261018 wait complete. 2024-09-19T05:29:29.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.725+0000 7f0cb2523640 1 Processor -- start 2024-09-19T05:29:29.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.725+0000 7f0cb2523640 1 -- start start 2024-09-19T05:29:29.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.725+0000 7f0cb2523640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cac101140 0x7f0cac1991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:29.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.725+0000 7f0cb2523640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cac101ac0 0x7f0cac1996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:29.734 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.725+0000 7f0cb2523640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0cac1059a0 0x7f0cac1a4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:29.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.725+0000 7f0cb2523640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac110d50 con 0x7f0cac1059a0 2024-09-19T05:29:29.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.725+0000 7f0cb2523640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac110bd0 con 0x7f0cac101140 2024-09-19T05:29:29.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.725+0000 7f0cb2523640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac110ed0 con 0x7f0cac101ac0 2024-09-19T05:29:29.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.725+0000 7f0cb0ac0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0cac1059a0 0x7f0cac1a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:29.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.725+0000 7f0cb0ac0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0cac1059a0 0x7f0cac1a4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45720/0 (socket says 172.21.15.120:45720) 2024-09-19T05:29:29.735 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.725+0000 7f0cb0ac0640 1 -- 172.21.15.120:0/1297713425 learned_addr learned my addr 172.21.15.120:0/1297713425 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:29:29.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.725+0000 7f0cabfff640 1 --2- 172.21.15.120:0/1297713425 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cac101140 0x7f0cac1991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:29.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.725+0000 7f0cab7fe640 1 --2- 172.21.15.120:0/1297713425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cac101ac0 0x7f0cac1996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:29.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.726+0000 7f0cb0ac0640 1 -- 172.21.15.120:0/1297713425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cac101ac0 msgr2=0x7f0cac1996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:29.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.726+0000 7f0cb0ac0640 1 --2- 172.21.15.120:0/1297713425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cac101ac0 0x7f0cac1996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.736 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.726+0000 7f0cb0ac0640 1 -- 172.21.15.120:0/1297713425 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cac101140 msgr2=0x7f0cac1991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:29.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.726+0000 7f0cb0ac0640 1 --2- 172.21.15.120:0/1297713425 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cac101140 0x7f0cac1991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.726+0000 7f0cb0ac0640 1 -- 172.21.15.120:0/1297713425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cac1a4760 con 0x7f0cac1059a0 2024-09-19T05:29:29.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.726+0000 7f0cabfff640 1 --2- 172.21.15.120:0/1297713425 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cac101140 0x7f0cac1991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:29:29.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.726+0000 7f0cab7fe640 1 --2- 172.21.15.120:0/1297713425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cac101ac0 0x7f0cac1996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:29:29.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.726+0000 7f0cb0ac0640 1 --2- 172.21.15.120:0/1297713425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0cac1059a0 0x7f0cac1a4220 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4009dc0 tx=0x7f0ca4031680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:29.737 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.726+0000 7f0ca97fa640 1 -- 172.21.15.120:0/1297713425 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca4031e50 con 0x7f0cac1059a0 2024-09-19T05:29:29.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.726+0000 7f0ca97fa640 1 -- 172.21.15.120:0/1297713425 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0ca4040070 con 0x7f0cac1059a0 2024-09-19T05:29:29.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.726+0000 7f0cb2523640 1 -- 172.21.15.120:0/1297713425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cac1a4930 con 0x7f0cac1059a0 2024-09-19T05:29:29.738 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.726+0000 7f0ca97fa640 1 -- 172.21.15.120:0/1297713425 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca40046a0 con 0x7f0cac1059a0 2024-09-19T05:29:29.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.726+0000 7f0cb2523640 1 -- 172.21.15.120:0/1297713425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cac1a4df0 con 0x7f0cac1059a0 2024-09-19T05:29:29.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.727+0000 7f0cb2523640 1 -- 172.21.15.120:0/1297713425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cac101580 con 0x7f0cac1059a0 2024-09-19T05:29:29.739 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.728+0000 7f0ca97fa640 1 -- 172.21.15.120:0/1297713425 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f0ca4004b40 con 0x7f0cac1059a0 2024-09-19T05:29:29.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.729+0000 7f0ca97fa640 1 --2- 172.21.15.120:0/1297713425 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0c940a3560 0x7f0c940a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:29.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.729+0000 7f0cabfff640 1 --2- 172.21.15.120:0/1297713425 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0c940a3560 0x7f0c940a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:29.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.729+0000 7f0ca97fa640 1 -- 172.21.15.120:0/1297713425 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8643+0+0 (secure 0 0 0) 0x7f0ca40f1380 con 0x7f0cac1059a0 2024-09-19T05:29:29.740 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.729+0000 7f0cabfff640 1 --2- 172.21.15.120:0/1297713425 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0c940a3560 0x7f0c940a5a20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c005fd0 tx=0x7f0c9c005850 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:29.741 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.732+0000 7f0ca97fa640 1 -- 172.21.15.120:0/1297713425 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0ca403b430 con 0x7f0cac1059a0 2024-09-19T05:29:29.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.898+0000 7f0cb2523640 1 -- 172.21.15.120:0/1297713425 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0cac108eb0 con 0x7f0cac1059a0 2024-09-19T05:29:29.900 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.898+0000 7f0ca97fa640 1 -- 172.21.15.120:0/1297713425 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) ==== 100+0+11 (secure 0 0 0) 0x7f0ca40bddf0 con 0x7f0cac1059a0 2024-09-19T05:29:29.900 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2024-09-19T05:29:29.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.900+0000 7f0cb2523640 1 -- 172.21.15.120:0/1297713425 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0c940a3560 msgr2=0x7f0c940a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:29.902 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.900+0000 7f0cb2523640 1 --2- 172.21.15.120:0/1297713425 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0c940a3560 0x7f0c940a5a20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c005fd0 tx=0x7f0c9c005850 comp rx=0 tx=0).stop 2024-09-19T05:29:29.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.900+0000 7f0cb2523640 1 -- 172.21.15.120:0/1297713425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0cac1059a0 msgr2=0x7f0cac1a4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:29.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.900+0000 7f0cb2523640 1 --2- 172.21.15.120:0/1297713425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0cac1059a0 0x7f0cac1a4220 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4009dc0 tx=0x7f0ca4031680 comp rx=0 tx=0).stop 2024-09-19T05:29:29.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.900+0000 7f0cb2523640 1 -- 172.21.15.120:0/1297713425 shutdown_connections 2024-09-19T05:29:29.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.900+0000 7f0cb2523640 1 --2- 172.21.15.120:0/1297713425 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f0c940a3560 0x7f0c940a5a20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.900+0000 7f0cb2523640 1 --2- 172.21.15.120:0/1297713425 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0cac1059a0 0x7f0cac1a4220 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.900+0000 7f0cb2523640 1 --2- 172.21.15.120:0/1297713425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cac101ac0 0x7f0cac1996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.900+0000 7f0cb2523640 1 --2- 172.21.15.120:0/1297713425 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cac101140 0x7f0cac1991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:29.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.900+0000 7f0cb2523640 1 -- 172.21.15.120:0/1297713425 >> 172.21.15.120:0/1297713425 conn(0x7f0cac077170 msgr2=0x7f0cac1039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:29.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.900+0000 7f0cb2523640 1 -- 172.21.15.120:0/1297713425 shutdown_connections 2024-09-19T05:29:29.903 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:29.900+0000 7f0cb2523640 1 -- 172.21.15.120:0/1297713425 wait complete. 2024-09-19T05:29:29.913 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T05:29:30.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.010+0000 7f303480e640 1 -- 172.21.15.120:0/3293692588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3030101150 msgr2=0x7f3030101590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:30.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.010+0000 7f303480e640 1 --2- 172.21.15.120:0/3293692588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3030101150 0x7f3030101590 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3018009900 tx=0x7f301802a410 comp rx=0 tx=0).stop 2024-09-19T05:29:30.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.010+0000 7f303480e640 1 -- 172.21.15.120:0/3293692588 shutdown_connections 2024-09-19T05:29:30.015 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.010+0000 7f303480e640 1 --2- 172.21.15.120:0/3293692588 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3030101ad0 0x7f303010d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:30.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.010+0000 7f303480e640 1 --2- 172.21.15.120:0/3293692588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3030101150 0x7f3030101590 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:30.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.010+0000 7f303480e640 1 --2- 172.21.15.120:0/3293692588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30301059b0 0x7f3030105d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:30.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.010+0000 7f303480e640 1 -- 172.21.15.120:0/3293692588 >> 172.21.15.120:0/3293692588 conn(0x7f30300771e0 msgr2=0x7f30300fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:30.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.010+0000 7f303480e640 1 -- 172.21.15.120:0/3293692588 shutdown_connections 2024-09-19T05:29:30.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.010+0000 7f303480e640 1 -- 172.21.15.120:0/3293692588 wait complete. 2024-09-19T05:29:30.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.010+0000 7f303480e640 1 Processor -- start 2024-09-19T05:29:30.016 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.011+0000 7f303480e640 1 -- start start 2024-09-19T05:29:30.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.011+0000 7f303480e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3030101150 0x7f30301982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:30.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.011+0000 7f303480e640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3030101ad0 0x7f3030198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:30.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.011+0000 7f303480e640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30301059b0 0x7f303019cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:30.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.011+0000 7f303480e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f3030110d60 con 0x7f3030101150 2024-09-19T05:29:30.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.011+0000 7f303480e640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f3030110be0 con 0x7f30301059b0 2024-09-19T05:29:30.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.011+0000 7f303480e640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3030110ee0 con 0x7f3030101ad0 2024-09-19T05:29:30.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.011+0000 7f302e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3030101150 0x7f30301982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:30.017 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.011+0000 7f302e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3030101150 0x7f30301982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45744/0 (socket says 172.21.15.120:45744) 2024-09-19T05:29:30.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.011+0000 7f302e59c640 1 -- 172.21.15.120:0/4080899394 learned_addr learned my addr 172.21.15.120:0/4080899394 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:29:30.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.011+0000 7f302dd9b640 1 --2- 172.21.15.120:0/4080899394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3030101ad0 0x7f3030198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:30.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.011+0000 7f302ed9d640 1 --2- 172.21.15.120:0/4080899394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30301059b0 0x7f303019cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:30.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.011+0000 7f302e59c640 1 -- 172.21.15.120:0/4080899394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3030101ad0 msgr2=0x7f3030198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:30.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.011+0000 7f302e59c640 1 --2- 172.21.15.120:0/4080899394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3030101ad0 0x7f3030198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:30.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.011+0000 7f302e59c640 1 -- 172.21.15.120:0/4080899394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30301059b0 msgr2=0x7f303019cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:30.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.011+0000 7f302e59c640 1 --2- 172.21.15.120:0/4080899394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30301059b0 0x7f303019cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:30.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.011+0000 7f302e59c640 1 -- 172.21.15.120:0/4080899394 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f303019d2d0 con 0x7f3030101150 2024-09-19T05:29:30.018 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.011+0000 7f302ed9d640 1 --2- 172.21.15.120:0/4080899394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30301059b0 0x7f303019cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T05:29:30.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.011+0000 7f302e59c640 1 --2- 172.21.15.120:0/4080899394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3030101150 0x7f30301982e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f302000d770 tx=0x7f302000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:30.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.011+0000 7f30277fe640 1 -- 172.21.15.120:0/4080899394 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3020017070 con 0x7f3030101150 2024-09-19T05:29:30.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.011+0000 7f30277fe640 1 -- 172.21.15.120:0/4080899394 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f30200054d0 con 0x7f3030101150 2024-09-19T05:29:30.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.011+0000 7f303480e640 1 -- 172.21.15.120:0/4080899394 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f303019d5c0 con 0x7f3030101150 2024-09-19T05:29:30.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.011+0000 7f30277fe640 1 -- 172.21.15.120:0/4080899394 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3020004cf0 con 0x7f3030101150 2024-09-19T05:29:30.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.012+0000 7f303480e640 1 -- 172.21.15.120:0/4080899394 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30301a4e50 con 0x7f3030101150 2024-09-19T05:29:30.019 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.012+0000 7f303480e640 1 -- 172.21.15.120:0/4080899394 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3030101590 con 0x7f3030101150 2024-09-19T05:29:30.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.014+0000 7f30277fe640 1 -- 172.21.15.120:0/4080899394 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f3020004e90 con 0x7f3030101150 2024-09-19T05:29:30.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.014+0000 7f30277fe640 1 --2- 172.21.15.120:0/4080899394 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f301c0a33c0 0x7f301c0a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:30.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.014+0000 7f302dd9b640 1 --2- 172.21.15.120:0/4080899394 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f301c0a33c0 0x7f301c0a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:30.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.014+0000 7f30277fe640 1 -- 172.21.15.120:0/4080899394 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8643+0+0 (secure 0 0 0) 0x7f30200cfca0 con 0x7f3030101150 2024-09-19T05:29:30.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.015+0000 7f302dd9b640 1 --2- 172.21.15.120:0/4080899394 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f301c0a33c0 0x7f301c0a5880 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3018031440 tx=0x7f30180095f0 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:30.020 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.017+0000 7f30277fe640 1 -- 172.21.15.120:0/4080899394 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f302009c600 con 0x7f3030101150 2024-09-19T05:29:30.238 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.236+0000 7f303480e640 1 -- 172.21.15.120:0/4080899394 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f30301a5020 con 0x7f3030101150 2024-09-19T05:29:30.245 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.243+0000 7f30277fe640 1 -- 172.21.15.120:0/4080899394 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+742882 (secure 0 0 0) 0x7f302009bf00 con 0x7f3030101150 2024-09-19T05:29:30.259 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-19T05:29:30.259 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T05:29:30.259 INFO:teuthology.orchestra.run.smithi120.stdout: "epoch": 25, 2024-09-19T05:29:30.259 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.259 INFO:teuthology.orchestra.run.smithi120.stdout: "active_gid": 15156, 2024-09-19T05:29:30.260 INFO:teuthology.orchestra.run.smithi120.stdout: "active_name": "x", 2024-09-19T05:29:30.260 INFO:teuthology.orchestra.run.smithi120.stdout: "active_addrs": { 2024-09-19T05:29:30.260 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-19T05:29:30.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.260 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-19T05:29:30.260 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6800", 2024-09-19T05:29:30.260 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1306632207 2024-09-19T05:29:30.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.261 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v1", 2024-09-19T05:29:30.261 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:6801", 2024-09-19T05:29:30.261 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1306632207 2024-09-19T05:29:30.261 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.261 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-19T05:29:30.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.261 INFO:teuthology.orchestra.run.smithi120.stdout: "active_addr": "172.21.15.120:6801/1306632207", 2024-09-19T05:29:30.261 INFO:teuthology.orchestra.run.smithi120.stdout: "active_change": "2024-09-19T05:19:14.315089+0000", 2024-09-19T05:29:30.261 INFO:teuthology.orchestra.run.smithi120.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T05:29:30.261 INFO:teuthology.orchestra.run.smithi120.stdout: "available": true, 2024-09-19T05:29:30.261 INFO:teuthology.orchestra.run.smithi120.stdout: "standbys": [ 2024-09-19T05:29:30.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.262 INFO:teuthology.orchestra.run.smithi120.stdout: "gid": 24692, 2024-09-19T05:29:30.262 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "y", 2024-09-19T05:29:30.262 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_features": 4540701547738038271, 2024-09-19T05:29:30.262 INFO:teuthology.orchestra.run.smithi120.stdout: "available_modules": [ 2024-09-19T05:29:30.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.262 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "alerts", 2024-09-19T05:29:30.262 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.262 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.262 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.262 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-09-19T05:29:30.263 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-09-19T05:29:30.263 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.263 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.263 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.263 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-09-19T05:29:30.263 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.263 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.263 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.263 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T05:29:30.263 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.263 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.263 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.264 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.264 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.264 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.264 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.264 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.264 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.264 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.264 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.264 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.264 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.265 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.265 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.265 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.265 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.265 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.265 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.265 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.266 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.266 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.266 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.266 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.266 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.266 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.266 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.266 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.266 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.266 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.267 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_destination": { 2024-09-19T05:29:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_destination", 2024-09-19T05:29:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Email address to send alerts to", 2024-09-19T05:29:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_from_name": { 2024-09-19T05:29:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_from_name", 2024-09-19T05:29:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "Ceph", 2024-09-19T05:29:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Email From: name", 2024-09-19T05:29:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.271 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_host": { 2024-09-19T05:29:30.272 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_host", 2024-09-19T05:29:30.272 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.272 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.272 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.272 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.272 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.272 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.272 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.272 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP server", 2024-09-19T05:29:30.272 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.272 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.272 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.273 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_password": { 2024-09-19T05:29:30.273 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_password", 2024-09-19T05:29:30.273 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.273 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.273 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.273 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.273 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.273 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.273 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.273 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Password to authenticate with", 2024-09-19T05:29:30.273 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.273 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.273 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.274 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_port": { 2024-09-19T05:29:30.274 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_port", 2024-09-19T05:29:30.274 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.274 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.274 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.274 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "465", 2024-09-19T05:29:30.274 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.274 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.274 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.274 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP port", 2024-09-19T05:29:30.274 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.275 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.275 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.275 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_sender": { 2024-09-19T05:29:30.275 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_sender", 2024-09-19T05:29:30.275 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.275 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.275 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.275 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.275 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.275 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.275 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP envelope sender", 2024-09-19T05:29:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_ssl": { 2024-09-19T05:29:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_ssl", 2024-09-19T05:29:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.276 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T05:29:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_user": { 2024-09-19T05:29:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_user", 2024-09-19T05:29:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.277 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "User to authenticate as", 2024-09-19T05:29:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.278 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "balancer", 2024-09-19T05:29:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: "active": { 2024-09-19T05:29:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "active", 2024-09-19T05:29:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.279 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T05:29:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: "begin_time": { 2024-09-19T05:29:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "begin_time", 2024-09-19T05:29:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0000", 2024-09-19T05:29:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.280 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.281 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T05:29:30.281 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T05:29:30.281 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.281 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.281 INFO:teuthology.orchestra.run.smithi120.stdout: "begin_weekday": { 2024-09-19T05:29:30.281 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "begin_weekday", 2024-09-19T05:29:30.281 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-09-19T05:29:30.281 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.281 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.281 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-09-19T05:29:30.281 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0", 2024-09-19T05:29:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "6", 2024-09-19T05:29:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T05:29:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T05:29:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_max_iterations": { 2024-09-19T05:29:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_max_iterations", 2024-09-19T05:29:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-09-19T05:29:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "25", 2024-09-19T05:29:30.282 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2024-09-19T05:29:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "250", 2024-09-19T05:29:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T05:29:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_metrics": { 2024-09-19T05:29:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_metrics", 2024-09-19T05:29:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.283 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T05:29:30.284 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.284 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.284 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.284 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T05:29:30.284 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T05:29:30.284 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.284 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.284 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_step": { 2024-09-19T05:29:30.284 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_step", 2024-09-19T05:29:30.284 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-09-19T05:29:30.284 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.285 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.285 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0.5", 2024-09-19T05:29:30.285 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0.001", 2024-09-19T05:29:30.285 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "0.999", 2024-09-19T05:29:30.285 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.285 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "aggressiveness of optimization", 2024-09-19T05:29:30.285 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T05:29:30.285 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.285 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.285 INFO:teuthology.orchestra.run.smithi120.stdout: "end_time": { 2024-09-19T05:29:30.285 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "end_time", 2024-09-19T05:29:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "2359", 2024-09-19T05:29:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T05:29:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T05:29:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: "end_weekday": { 2024-09-19T05:29:30.286 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "end_weekday", 2024-09-19T05:29:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-09-19T05:29:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-09-19T05:29:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0", 2024-09-19T05:29:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "6", 2024-09-19T05:29:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T05:29:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T05:29:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.287 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.288 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.289 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.289 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.289 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.289 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.289 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.289 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.289 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.289 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.289 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.289 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.289 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.290 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.290 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.290 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.290 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.290 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.290 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.290 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.290 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.290 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.291 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.291 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.291 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.291 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.291 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.291 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.291 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.291 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.291 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.291 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.291 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.292 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.293 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.293 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.293 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.293 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.293 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.293 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.293 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.293 INFO:teuthology.orchestra.run.smithi120.stdout: "min_score": { 2024-09-19T05:29:30.293 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "min_score", 2024-09-19T05:29:30.293 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-09-19T05:29:30.293 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.294 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.294 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-09-19T05:29:30.294 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.294 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.294 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.294 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T05:29:30.294 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.294 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.294 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.294 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": { 2024-09-19T05:29:30.294 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mode", 2024-09-19T05:29:30.294 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.295 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.295 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.295 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "upmap", 2024-09-19T05:29:30.295 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.295 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.295 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.295 INFO:teuthology.orchestra.run.smithi120.stdout: "crush-compat", 2024-09-19T05:29:30.295 INFO:teuthology.orchestra.run.smithi120.stdout: "none", 2024-09-19T05:29:30.295 INFO:teuthology.orchestra.run.smithi120.stdout: "read", 2024-09-19T05:29:30.295 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap", 2024-09-19T05:29:30.295 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap-read" 2024-09-19T05:29:30.295 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.295 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Balancer mode", 2024-09-19T05:29:30.296 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.296 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.296 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.296 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_ids": { 2024-09-19T05:29:30.296 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pool_ids", 2024-09-19T05:29:30.296 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.296 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.296 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.296 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.297 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.297 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.297 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.297 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T05:29:30.297 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.297 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.297 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.297 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-09-19T05:29:30.297 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-09-19T05:29:30.297 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.297 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.298 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.298 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-09-19T05:29:30.298 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.298 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.298 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.298 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T05:29:30.298 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.298 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.298 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.298 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap_max_deviation": { 2024-09-19T05:29:30.298 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "upmap_max_deviation", 2024-09-19T05:29:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-09-19T05:29:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2024-09-19T05:29:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T05:29:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T05:29:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap_max_optimizations": { 2024-09-19T05:29:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "upmap_max_optimizations", 2024-09-19T05:29:30.299 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-09-19T05:29:30.300 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.300 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.300 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-09-19T05:29:30.300 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.300 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.300 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.300 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T05:29:30.300 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.300 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.300 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.301 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cephadm", 2024-09-19T05:29:30.301 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.301 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.301 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.301 INFO:teuthology.orchestra.run.smithi120.stdout: "agent_down_multiplier": { 2024-09-19T05:29:30.301 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "agent_down_multiplier", 2024-09-19T05:29:30.301 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-09-19T05:29:30.301 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.301 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "3.0", 2024-09-19T05:29:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T05:29:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: "agent_refresh_rate": { 2024-09-19T05:29:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "agent_refresh_rate", 2024-09-19T05:29:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.302 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "20", 2024-09-19T05:29:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T05:29:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: "agent_starting_port": { 2024-09-19T05:29:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "agent_starting_port", 2024-09-19T05:29:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.303 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.304 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "4721", 2024-09-19T05:29:30.304 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.304 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.304 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.304 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T05:29:30.304 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.304 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.304 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.305 INFO:teuthology.orchestra.run.smithi120.stdout: "allow_ptrace": { 2024-09-19T05:29:30.305 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "allow_ptrace", 2024-09-19T05:29:30.305 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.305 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.305 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.305 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.305 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.305 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.305 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.305 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T05:29:30.305 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T05:29:30.305 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.306 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.306 INFO:teuthology.orchestra.run.smithi120.stdout: "autotune_interval": { 2024-09-19T05:29:30.306 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "autotune_interval", 2024-09-19T05:29:30.306 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.306 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.306 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.306 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-09-19T05:29:30.306 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.306 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.306 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.306 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T05:29:30.306 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.306 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.307 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.307 INFO:teuthology.orchestra.run.smithi120.stdout: "autotune_memory_target_ratio": { 2024-09-19T05:29:30.307 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T05:29:30.307 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-09-19T05:29:30.307 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.307 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.307 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0.7", 2024-09-19T05:29:30.307 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.307 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.307 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.307 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T05:29:30.307 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: "cephadm_log_destination": { 2024-09-19T05:29:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cephadm_log_destination", 2024-09-19T05:29:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: "file", 2024-09-19T05:29:30.308 INFO:teuthology.orchestra.run.smithi120.stdout: "file,syslog", 2024-09-19T05:29:30.309 INFO:teuthology.orchestra.run.smithi120.stdout: "syslog" 2024-09-19T05:29:30.309 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.309 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T05:29:30.309 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.309 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.309 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.309 INFO:teuthology.orchestra.run.smithi120.stdout: "cgroups_split": { 2024-09-19T05:29:30.309 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cgroups_split", 2024-09-19T05:29:30.309 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.309 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.309 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.309 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.309 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.310 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.310 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.310 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T05:29:30.310 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.310 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.310 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.310 INFO:teuthology.orchestra.run.smithi120.stdout: "config_checks_enabled": { 2024-09-19T05:29:30.310 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "config_checks_enabled", 2024-09-19T05:29:30.310 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.310 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.311 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.311 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.311 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.311 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.311 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.311 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T05:29:30.311 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.312 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.312 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.312 INFO:teuthology.orchestra.run.smithi120.stdout: "config_dashboard": { 2024-09-19T05:29:30.312 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "config_dashboard", 2024-09-19T05:29:30.312 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.312 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.312 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.312 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.313 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.313 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.313 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.313 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T05:29:30.313 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.313 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.313 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.313 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_alertmanager": { 2024-09-19T05:29:30.313 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_alertmanager", 2024-09-19T05:29:30.313 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.313 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.314 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.314 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T05:29:30.314 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.314 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.314 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.314 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Prometheus container image", 2024-09-19T05:29:30.314 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.314 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.314 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.314 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_base": { 2024-09-19T05:29:30.314 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_base", 2024-09-19T05:29:30.315 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.315 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.315 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.315 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T05:29:30.315 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.315 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.315 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.315 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Container image name, without the tag", 2024-09-19T05:29:30.315 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.315 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.315 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.315 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_elasticsearch": { 2024-09-19T05:29:30.315 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_elasticsearch", 2024-09-19T05:29:30.316 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.316 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.316 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.316 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T05:29:30.316 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.316 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.316 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.316 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "elasticsearch container image", 2024-09-19T05:29:30.316 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.316 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.316 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.317 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_grafana": { 2024-09-19T05:29:30.317 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_grafana", 2024-09-19T05:29:30.317 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.317 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.317 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.317 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T05:29:30.317 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.317 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.317 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.317 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Prometheus container image", 2024-09-19T05:29:30.317 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.318 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.318 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.318 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_haproxy": { 2024-09-19T05:29:30.318 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_haproxy", 2024-09-19T05:29:30.318 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.318 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.318 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.318 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T05:29:30.318 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.318 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.318 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "HAproxy container image", 2024-09-19T05:29:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_jaeger_agent": { 2024-09-19T05:29:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_jaeger_agent", 2024-09-19T05:29:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T05:29:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.319 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Jaeger agent container image", 2024-09-19T05:29:30.320 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.320 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.320 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.320 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_jaeger_collector": { 2024-09-19T05:29:30.320 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_jaeger_collector", 2024-09-19T05:29:30.320 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.320 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.320 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.320 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T05:29:30.320 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.320 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.320 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.321 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Jaeger collector container image", 2024-09-19T05:29:30.321 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.321 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.321 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.321 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_jaeger_query": { 2024-09-19T05:29:30.321 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_jaeger_query", 2024-09-19T05:29:30.321 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.321 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.321 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.321 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T05:29:30.321 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.321 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.322 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.322 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Jaeger query container image", 2024-09-19T05:29:30.322 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.322 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.322 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.322 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_keepalived": { 2024-09-19T05:29:30.322 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_keepalived", 2024-09-19T05:29:30.322 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.322 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.322 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.322 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T05:29:30.322 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.323 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.323 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.323 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Keepalived container image", 2024-09-19T05:29:30.323 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.323 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.323 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.323 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_loki": { 2024-09-19T05:29:30.323 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_loki", 2024-09-19T05:29:30.323 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.324 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.324 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.324 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T05:29:30.324 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.324 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.324 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.325 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Loki container image", 2024-09-19T05:29:30.325 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.325 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.325 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.325 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_node_exporter": { 2024-09-19T05:29:30.326 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_node_exporter", 2024-09-19T05:29:30.326 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.326 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.326 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.326 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T05:29:30.326 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.327 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.327 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.327 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Prometheus container image", 2024-09-19T05:29:30.327 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.327 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.327 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.328 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_nvmeof": { 2024-09-19T05:29:30.328 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_nvmeof", 2024-09-19T05:29:30.328 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.329 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.329 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.329 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T05:29:30.329 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.329 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.329 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.330 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Nvme-of container image", 2024-09-19T05:29:30.330 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.330 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.330 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.331 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_prometheus": { 2024-09-19T05:29:30.331 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_prometheus", 2024-09-19T05:29:30.331 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.331 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.331 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.331 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T05:29:30.331 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.331 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.332 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.332 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Prometheus container image", 2024-09-19T05:29:30.332 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.332 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.332 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.332 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_promtail": { 2024-09-19T05:29:30.332 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_promtail", 2024-09-19T05:29:30.333 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.333 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.333 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.333 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T05:29:30.333 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.334 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.334 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.334 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Promtail container image", 2024-09-19T05:29:30.334 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.334 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.334 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.334 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_samba": { 2024-09-19T05:29:30.334 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_samba", 2024-09-19T05:29:30.334 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.335 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.335 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.335 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T05:29:30.335 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.335 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.335 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.335 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Samba/SMB container image", 2024-09-19T05:29:30.335 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.335 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.335 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.335 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_snmp_gateway": { 2024-09-19T05:29:30.336 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_snmp_gateway", 2024-09-19T05:29:30.336 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.336 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.336 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.336 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T05:29:30.336 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.336 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.336 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.336 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SNMP Gateway container image", 2024-09-19T05:29:30.336 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.336 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.336 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.337 INFO:teuthology.orchestra.run.smithi120.stdout: "container_init": { 2024-09-19T05:29:30.337 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_init", 2024-09-19T05:29:30.337 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.337 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.337 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.337 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.337 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.337 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.337 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.338 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T05:29:30.338 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.338 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.338 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.338 INFO:teuthology.orchestra.run.smithi120.stdout: "daemon_cache_timeout": { 2024-09-19T05:29:30.338 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "daemon_cache_timeout", 2024-09-19T05:29:30.338 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.338 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.338 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.338 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-09-19T05:29:30.338 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.338 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.339 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.339 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T05:29:30.339 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.339 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.339 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.339 INFO:teuthology.orchestra.run.smithi120.stdout: "default_cephadm_command_timeout": { 2024-09-19T05:29:30.339 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T05:29:30.339 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.339 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.339 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.339 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "900", 2024-09-19T05:29:30.340 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.340 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.340 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.340 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T05:29:30.340 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.340 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.340 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.340 INFO:teuthology.orchestra.run.smithi120.stdout: "default_registry": { 2024-09-19T05:29:30.340 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "default_registry", 2024-09-19T05:29:30.340 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.340 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.341 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.341 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "docker.io", 2024-09-19T05:29:30.341 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.341 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.341 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.341 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T05:29:30.341 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.341 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.341 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.341 INFO:teuthology.orchestra.run.smithi120.stdout: "device_cache_timeout": { 2024-09-19T05:29:30.341 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "device_cache_timeout", 2024-09-19T05:29:30.342 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.342 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.342 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.342 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1800", 2024-09-19T05:29:30.342 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.342 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.342 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.342 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "seconds to cache device inventory", 2024-09-19T05:29:30.342 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.342 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.343 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.343 INFO:teuthology.orchestra.run.smithi120.stdout: "device_enhanced_scan": { 2024-09-19T05:29:30.343 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "device_enhanced_scan", 2024-09-19T05:29:30.343 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.343 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.343 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.343 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.343 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.343 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.343 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.343 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T05:29:30.343 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.344 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.344 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.344 INFO:teuthology.orchestra.run.smithi120.stdout: "facts_cache_timeout": { 2024-09-19T05:29:30.344 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "facts_cache_timeout", 2024-09-19T05:29:30.344 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.344 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.344 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.344 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-09-19T05:29:30.344 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.344 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.344 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "seconds to cache host facts data", 2024-09-19T05:29:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: "grafana_dashboards_path": { 2024-09-19T05:29:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "grafana_dashboards_path", 2024-09-19T05:29:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.345 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.346 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T05:29:30.346 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.346 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.346 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.346 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T05:29:30.346 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.346 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.346 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.346 INFO:teuthology.orchestra.run.smithi120.stdout: "host_check_interval": { 2024-09-19T05:29:30.347 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "host_check_interval", 2024-09-19T05:29:30.347 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.347 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.347 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.347 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-09-19T05:29:30.347 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.347 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.347 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.347 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to perform a host check", 2024-09-19T05:29:30.347 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.348 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.348 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.348 INFO:teuthology.orchestra.run.smithi120.stdout: "hw_monitoring": { 2024-09-19T05:29:30.348 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "hw_monitoring", 2024-09-19T05:29:30.348 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.348 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.348 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.348 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.348 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.348 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.349 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.349 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T05:29:30.349 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.349 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.349 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.349 INFO:teuthology.orchestra.run.smithi120.stdout: "inventory_list_all": { 2024-09-19T05:29:30.349 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "inventory_list_all", 2024-09-19T05:29:30.349 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.349 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.349 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.350 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.350 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.350 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.350 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.350 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T05:29:30.350 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.350 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.350 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.350 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.350 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.350 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.350 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.350 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.351 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.351 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.351 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.351 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.351 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.351 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.351 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.351 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.351 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.351 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.351 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.351 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.352 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.352 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.352 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.352 INFO:teuthology.orchestra.run.smithi120.stdout: "log_refresh_metadata": { 2024-09-19T05:29:30.352 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_refresh_metadata", 2024-09-19T05:29:30.352 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.352 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.352 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.352 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.352 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.353 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.353 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.353 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T05:29:30.353 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.353 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.353 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.353 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.353 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.353 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.353 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.353 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.353 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.354 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.354 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.354 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.354 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T05:29:30.354 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.354 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.354 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.354 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.354 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.354 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.354 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.355 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.355 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.355 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.355 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.355 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.355 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.355 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.355 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.355 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.355 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.355 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.356 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.356 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.356 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.356 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.356 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.356 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.356 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.356 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.356 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.356 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.356 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.356 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.357 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.357 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.357 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.357 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.357 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.357 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.357 INFO:teuthology.orchestra.run.smithi120.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T05:29:30.357 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T05:29:30.357 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.357 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.357 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.357 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.358 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.358 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.358 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.358 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T05:29:30.358 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.358 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.358 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.358 INFO:teuthology.orchestra.run.smithi120.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T05:29:30.358 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T05:29:30.358 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.358 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.359 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.359 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "*", 2024-09-19T05:29:30.359 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.359 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.359 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.359 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T05:29:30.359 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.359 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.359 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.360 INFO:teuthology.orchestra.run.smithi120.stdout: "max_count_per_host": { 2024-09-19T05:29:30.360 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_count_per_host", 2024-09-19T05:29:30.360 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.360 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.360 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.360 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-09-19T05:29:30.360 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.360 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.360 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.360 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "max number of daemons per service per host", 2024-09-19T05:29:30.361 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.361 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.361 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.361 INFO:teuthology.orchestra.run.smithi120.stdout: "max_osd_draining_count": { 2024-09-19T05:29:30.361 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_osd_draining_count", 2024-09-19T05:29:30.361 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.361 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.361 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.361 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-09-19T05:29:30.361 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.361 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.361 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.361 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T05:29:30.362 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.362 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.362 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.362 INFO:teuthology.orchestra.run.smithi120.stdout: "migration_current": { 2024-09-19T05:29:30.362 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "migration_current", 2024-09-19T05:29:30.362 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.363 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.363 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.363 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.363 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.363 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.363 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.364 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "internal - do not modify", 2024-09-19T05:29:30.364 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.364 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.364 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.364 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": { 2024-09-19T05:29:30.365 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mode", 2024-09-19T05:29:30.365 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.365 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.365 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.365 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "root", 2024-09-19T05:29:30.366 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.366 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.366 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.366 INFO:teuthology.orchestra.run.smithi120.stdout: "cephadm-package", 2024-09-19T05:29:30.366 INFO:teuthology.orchestra.run.smithi120.stdout: "root" 2024-09-19T05:29:30.366 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.367 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T05:29:30.367 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.367 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.367 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.367 INFO:teuthology.orchestra.run.smithi120.stdout: "oob_default_addr": { 2024-09-19T05:29:30.368 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "oob_default_addr", 2024-09-19T05:29:30.368 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.368 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.368 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.368 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "169.254.1.1", 2024-09-19T05:29:30.368 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.368 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.369 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.369 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T05:29:30.369 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.369 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.369 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.370 INFO:teuthology.orchestra.run.smithi120.stdout: "prometheus_alerts_path": { 2024-09-19T05:29:30.370 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prometheus_alerts_path", 2024-09-19T05:29:30.370 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.370 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.370 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.371 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T05:29:30.371 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.371 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.371 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.371 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T05:29:30.371 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.372 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.372 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.372 INFO:teuthology.orchestra.run.smithi120.stdout: "registry_insecure": { 2024-09-19T05:29:30.373 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "registry_insecure", 2024-09-19T05:29:30.373 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.373 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.373 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.373 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.373 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.374 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.374 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.374 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T05:29:30.374 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.374 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.374 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.375 INFO:teuthology.orchestra.run.smithi120.stdout: "registry_password": { 2024-09-19T05:29:30.375 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "registry_password", 2024-09-19T05:29:30.375 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.375 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.375 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.376 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.376 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.376 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.376 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.376 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T05:29:30.377 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.377 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.377 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.377 INFO:teuthology.orchestra.run.smithi120.stdout: "registry_url": { 2024-09-19T05:29:30.377 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "registry_url", 2024-09-19T05:29:30.378 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.378 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.378 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.378 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.378 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.379 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.379 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.379 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T05:29:30.379 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.379 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.379 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.380 INFO:teuthology.orchestra.run.smithi120.stdout: "registry_username": { 2024-09-19T05:29:30.380 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "registry_username", 2024-09-19T05:29:30.380 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.380 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.380 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.381 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.381 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.381 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.381 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.381 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T05:29:30.382 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.382 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.382 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.382 INFO:teuthology.orchestra.run.smithi120.stdout: "secure_monitoring_stack": { 2024-09-19T05:29:30.382 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "secure_monitoring_stack", 2024-09-19T05:29:30.383 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.383 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.383 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.383 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.383 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.383 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.383 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.384 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T05:29:30.384 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.384 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.384 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.384 INFO:teuthology.orchestra.run.smithi120.stdout: "service_discovery_port": { 2024-09-19T05:29:30.385 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "service_discovery_port", 2024-09-19T05:29:30.385 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.385 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.385 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.385 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8765", 2024-09-19T05:29:30.385 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.386 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.386 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.386 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "cephadm service discovery port", 2024-09-19T05:29:30.386 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.386 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.386 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.387 INFO:teuthology.orchestra.run.smithi120.stdout: "ssh_config_file": { 2024-09-19T05:29:30.387 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssh_config_file", 2024-09-19T05:29:30.387 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.387 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.387 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.388 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.388 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.388 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.388 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.388 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T05:29:30.388 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.388 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.389 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.389 INFO:teuthology.orchestra.run.smithi120.stdout: "use_agent": { 2024-09-19T05:29:30.389 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "use_agent", 2024-09-19T05:29:30.389 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.390 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.390 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.390 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.390 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.390 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.390 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.391 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T05:29:30.391 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.391 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.391 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.391 INFO:teuthology.orchestra.run.smithi120.stdout: "use_repo_digest": { 2024-09-19T05:29:30.392 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "use_repo_digest", 2024-09-19T05:29:30.392 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.392 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.392 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.392 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.393 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.393 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.393 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.393 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T05:29:30.393 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.393 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.394 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.394 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_on_failed_host_check": { 2024-09-19T05:29:30.394 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_on_failed_host_check", 2024-09-19T05:29:30.394 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.394 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.395 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.395 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.395 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.395 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.395 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.395 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T05:29:30.396 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.396 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.396 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.396 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_on_stray_daemons": { 2024-09-19T05:29:30.397 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_on_stray_daemons", 2024-09-19T05:29:30.397 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.397 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.397 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.397 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.397 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.398 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.398 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.398 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T05:29:30.398 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.398 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.398 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.399 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_on_stray_hosts": { 2024-09-19T05:29:30.399 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_on_stray_hosts", 2024-09-19T05:29:30.399 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.399 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.400 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.400 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.400 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.400 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.400 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.400 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T05:29:30.401 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.401 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.401 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.401 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.401 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.402 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crash", 2024-09-19T05:29:30.402 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.402 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.403 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.403 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.403 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.403 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.403 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.403 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.404 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.404 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.404 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.404 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.404 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.404 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.405 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.405 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.405 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.405 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.405 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.405 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.406 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.406 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.406 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.406 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.406 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.407 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.407 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.407 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.407 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.407 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.408 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.408 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.408 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.408 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.408 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.408 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.409 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.409 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.409 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.409 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.410 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.410 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.410 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.410 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.412 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.412 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.412 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.412 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.412 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.412 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.413 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.413 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.413 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.413 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.413 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.414 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.414 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.414 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.414 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.414 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.415 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.415 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.415 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.415 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.415 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.415 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.416 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.416 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.416 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.416 INFO:teuthology.orchestra.run.smithi120.stdout: "retain_interval": { 2024-09-19T05:29:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "retain_interval", 2024-09-19T05:29:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "31536000", 2024-09-19T05:29:30.417 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T05:29:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.418 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_recent_interval": { 2024-09-19T05:29:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_recent_interval", 2024-09-19T05:29:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.419 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1209600", 2024-09-19T05:29:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T05:29:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.420 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "dashboard", 2024-09-19T05:29:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T05:29:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T05:29:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.421 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-09-19T05:29:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T05:29:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T05:29:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.422 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T05:29:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T05:29:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.423 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "AUDIT_API_ENABLED": { 2024-09-19T05:29:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T05:29:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.424 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T05:29:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T05:29:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.425 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T05:29:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T05:29:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.426 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T05:29:30.427 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T05:29:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.428 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T05:29:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T05:29:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T05:29:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T05:29:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T05:29:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T05:29:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T05:29:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T05:29:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.432 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T05:29:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T05:29:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.433 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T05:29:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T05:29:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.434 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T05:29:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T05:29:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.435 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T05:29:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T05:29:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2024-09-19T05:29:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.436 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T05:29:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T05:29:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.437 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_URL": { 2024-09-19T05:29:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_URL", 2024-09-19T05:29:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.438 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T05:29:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T05:29:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2024-09-19T05:29:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.439 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T05:29:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T05:29:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.440 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T05:29:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T05:29:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.441 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T05:29:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T05:29:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.442 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T05:29:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T05:29:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.443 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T05:29:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T05:29:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.444 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T05:29:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T05:29:30.445 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T05:29:30.446 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T05:29:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T05:29:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T05:29:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.448 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T05:29:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T05:29:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.449 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T05:29:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T05:29:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.450 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T05:29:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T05:29:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.451 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T05:29:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T05:29:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.452 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T05:29:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T05:29:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.453 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T05:29:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T05:29:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.454 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T05:29:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T05:29:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T05:29:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.455 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T05:29:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T05:29:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-09-19T05:29:30.456 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T05:29:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T05:29:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.457 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8", 2024-09-19T05:29:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T05:29:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T05:29:30.458 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "45", 2024-09-19T05:29:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T05:29:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T05:29:30.459 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T05:29:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T05:29:30.460 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2024-09-19T05:29:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T05:29:30.461 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T05:29:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.462 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T05:29:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T05:29:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T05:29:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T05:29:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-09-19T05:29:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T05:29:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T05:29:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-09-19T05:29:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.465 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T05:29:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T05:29:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-09-19T05:29:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.466 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "cross_origin_url": { 2024-09-19T05:29:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cross_origin_url", 2024-09-19T05:29:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.467 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "crt_file": { 2024-09-19T05:29:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crt_file", 2024-09-19T05:29:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.468 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "debug": { 2024-09-19T05:29:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "debug", 2024-09-19T05:29:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.469 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Enable/disable debug options", 2024-09-19T05:29:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "jwt_token_ttl": { 2024-09-19T05:29:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "jwt_token_ttl", 2024-09-19T05:29:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "28800", 2024-09-19T05:29:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.470 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: "key_file": { 2024-09-19T05:29:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "key_file", 2024-09-19T05:29:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.471 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.472 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: "motd": { 2024-09-19T05:29:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "motd", 2024-09-19T05:29:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "The message of the day", 2024-09-19T05:29:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "redirect_resolve_ip_addr": { 2024-09-19T05:29:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T05:29:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2024-09-19T05:29:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2024-09-19T05:29:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "::", 2024-09-19T05:29:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2024-09-19T05:29:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2024-09-19T05:29:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8080", 2024-09-19T05:29:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl": { 2024-09-19T05:29:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl", 2024-09-19T05:29:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl_server_port": { 2024-09-19T05:29:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl_server_port", 2024-09-19T05:29:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8443", 2024-09-19T05:29:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_behaviour": { 2024-09-19T05:29:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_behaviour", 2024-09-19T05:29:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "redirect", 2024-09-19T05:29:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: "redirect" 2024-09-19T05:29:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_error_status_code": { 2024-09-19T05:29:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_error_status_code", 2024-09-19T05:29:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "500", 2024-09-19T05:29:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "400", 2024-09-19T05:29:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "599", 2024-09-19T05:29:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "url_prefix": { 2024-09-19T05:29:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "url_prefix", 2024-09-19T05:29:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "devicehealth", 2024-09-19T05:29:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "enable_monitoring": { 2024-09-19T05:29:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enable_monitoring", 2024-09-19T05:29:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "monitor device health metrics", 2024-09-19T05:29:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "mark_out_threshold": { 2024-09-19T05:29:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mark_out_threshold", 2024-09-19T05:29:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "2419200", 2024-09-19T05:29:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T05:29:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": { 2024-09-19T05:29:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pool_name", 2024-09-19T05:29:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "device_health_metrics", 2024-09-19T05:29:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T05:29:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: "retention_period": { 2024-09-19T05:29:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "retention_period", 2024-09-19T05:29:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15552000", 2024-09-19T05:29:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long to retain device health metrics", 2024-09-19T05:29:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "scrape_frequency": { 2024-09-19T05:29:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "scrape_frequency", 2024-09-19T05:29:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "86400", 2024-09-19T05:29:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T05:29:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "self_heal": { 2024-09-19T05:29:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "self_heal", 2024-09-19T05:29:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T05:29:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-09-19T05:29:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-09-19T05:29:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-09-19T05:29:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T05:29:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_threshold": { 2024-09-19T05:29:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_threshold", 2024-09-19T05:29:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "7257600", 2024-09-19T05:29:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T05:29:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_local", 2024-09-19T05:29:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "predict_interval": { 2024-09-19T05:29:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "predict_interval", 2024-09-19T05:29:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "86400", 2024-09-19T05:29:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "predictor_model": { 2024-09-19T05:29:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "predictor_model", 2024-09-19T05:29:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "prophetstor", 2024-09-19T05:29:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-09-19T05:29:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-09-19T05:29:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-09-19T05:29:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "influx", 2024-09-19T05:29:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": false, 2024-09-19T05:29:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "influxdb python module not found", 2024-09-19T05:29:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "batch_size": { 2024-09-19T05:29:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "batch_size", 2024-09-19T05:29:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5000", 2024-09-19T05:29:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T05:29:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "database": { 2024-09-19T05:29:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "database", 2024-09-19T05:29:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "ceph", 2024-09-19T05:29:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T05:29:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "hostname": { 2024-09-19T05:29:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "hostname", 2024-09-19T05:29:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "InfluxDB server hostname", 2024-09-19T05:29:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-09-19T05:29:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-09-19T05:29:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "30", 2024-09-19T05:29:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "5", 2024-09-19T05:29:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T05:29:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "password": { 2024-09-19T05:29:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "password", 2024-09-19T05:29:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "password of InfluxDB server user", 2024-09-19T05:29:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: "port": { 2024-09-19T05:29:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "port", 2024-09-19T05:29:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8086", 2024-09-19T05:29:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "InfluxDB server port", 2024-09-19T05:29:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl": { 2024-09-19T05:29:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl", 2024-09-19T05:29:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "false", 2024-09-19T05:29:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T05:29:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: "threads": { 2024-09-19T05:29:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "threads", 2024-09-19T05:29:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-09-19T05:29:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2024-09-19T05:29:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "32", 2024-09-19T05:29:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T05:29:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "username": { 2024-09-19T05:29:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "username", 2024-09-19T05:29:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "username of InfluxDB server user", 2024-09-19T05:29:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: "verify_ssl": { 2024-09-19T05:29:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "verify_ssl", 2024-09-19T05:29:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "true", 2024-09-19T05:29:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T05:29:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "insights", 2024-09-19T05:29:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "iostat", 2024-09-19T05:29:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "k8sevents", 2024-09-19T05:29:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_event_retention_days": { 2024-09-19T05:29:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ceph_event_retention_days", 2024-09-19T05:29:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "7", 2024-09-19T05:29:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T05:29:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "config_check_secs": { 2024-09-19T05:29:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "config_check_secs", 2024-09-19T05:29:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-09-19T05:29:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "10", 2024-09-19T05:29:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T05:29:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "localpool", 2024-09-19T05:29:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: "failure_domain": { 2024-09-19T05:29:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "failure_domain", 2024-09-19T05:29:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "host", 2024-09-19T05:29:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "failure domain for any created local pool", 2024-09-19T05:29:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T05:29:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": { 2024-09-19T05:29:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "min_size", 2024-09-19T05:29:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default min_size for any created local pool", 2024-09-19T05:29:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T05:29:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: "num_rep": { 2024-09-19T05:29:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "num_rep", 2024-09-19T05:29:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "3", 2024-09-19T05:29:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default replica count for any created local pool", 2024-09-19T05:29:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": { 2024-09-19T05:29:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pg_num", 2024-09-19T05:29:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "128", 2024-09-19T05:29:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T05:29:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: "prefix": { 2024-09-19T05:29:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prefix", 2024-09-19T05:29:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "name prefix for any created local pool", 2024-09-19T05:29:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: "subtree": { 2024-09-19T05:29:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "subtree", 2024-09-19T05:29:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "rack", 2024-09-19T05:29:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T05:29:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T05:29:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mds_autoscaler", 2024-09-19T05:29:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mirroring", 2024-09-19T05:29:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "nfs", 2024-09-19T05:29:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "orchestrator", 2024-09-19T05:29:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: "fail_fs": { 2024-09-19T05:29:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "fail_fs", 2024-09-19T05:29:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T05:29:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "orchestrator": { 2024-09-19T05:29:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "orchestrator", 2024-09-19T05:29:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "cephadm", 2024-09-19T05:29:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: "rook", 2024-09-19T05:29:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: "test_orchestrator" 2024-09-19T05:29:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Orchestrator backend", 2024-09-19T05:29:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "osd_perf_query", 2024-09-19T05:29:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "osd_support", 2024-09-19T05:29:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.589 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.590 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.590 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.590 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.590 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.590 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.590 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.590 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.590 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.590 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.590 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.590 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.591 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.592 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.593 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pg_autoscaler", 2024-09-19T05:29:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.594 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.595 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.595 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.595 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.595 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.595 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.595 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.595 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.595 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.595 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.595 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.595 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.595 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.596 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.597 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.598 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.599 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-09-19T05:29:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-09-19T05:29:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-09-19T05:29:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.600 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: "threshold": { 2024-09-19T05:29:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "threshold", 2024-09-19T05:29:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-09-19T05:29:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "3.0", 2024-09-19T05:29:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1.0", 2024-09-19T05:29:30.601 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "scaling threshold", 2024-09-19T05:29:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T05:29:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "progress", 2024-09-19T05:29:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.602 INFO:teuthology.orchestra.run.smithi120.stdout: "allow_pg_recovery_event": { 2024-09-19T05:29:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "allow_pg_recovery_event", 2024-09-19T05:29:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T05:29:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": { 2024-09-19T05:29:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enabled", 2024-09-19T05:29:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.605 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.605 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.605 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.605 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.605 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.605 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.605 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.605 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.605 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.605 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.605 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.605 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.606 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.607 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: "max_completed_events": { 2024-09-19T05:29:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_completed_events", 2024-09-19T05:29:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "50", 2024-09-19T05:29:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "number of past completed events to remember", 2024-09-19T05:29:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.610 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-09-19T05:29:30.611 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-09-19T05:29:30.611 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.611 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.611 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.611 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-09-19T05:29:30.611 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.611 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.611 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.611 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long the module is going to sleep", 2024-09-19T05:29:30.611 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.611 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.611 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prometheus", 2024-09-19T05:29:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: "cache": { 2024-09-19T05:29:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cache", 2024-09-19T05:29:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.612 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: "exclude_perf_counters": { 2024-09-19T05:29:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "exclude_perf_counters", 2024-09-19T05:29:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.613 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T05:29:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T05:29:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.614 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.615 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.616 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.616 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.616 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.616 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.616 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.616 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.616 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.616 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.616 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.616 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.616 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.617 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.618 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.619 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_stats_pools": { 2024-09-19T05:29:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_stats_pools", 2024-09-19T05:29:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.620 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T05:29:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T05:29:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "300", 2024-09-19T05:29:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.621 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: "scrape_interval": { 2024-09-19T05:29:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "scrape_interval", 2024-09-19T05:29:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-09-19T05:29:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15.0", 2024-09-19T05:29:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.622 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2024-09-19T05:29:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2024-09-19T05:29:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "::", 2024-09-19T05:29:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T05:29:30.623 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2024-09-19T05:29:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2024-09-19T05:29:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "9283", 2024-09-19T05:29:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T05:29:30.624 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.625 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.625 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.625 INFO:teuthology.orchestra.run.smithi120.stdout: "stale_cache_strategy": { 2024-09-19T05:29:30.625 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "stale_cache_strategy", 2024-09-19T05:29:30.625 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.625 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.625 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.625 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "log", 2024-09-19T05:29:30.625 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.625 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.625 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.626 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.626 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.626 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.626 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.626 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_behaviour": { 2024-09-19T05:29:30.626 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_behaviour", 2024-09-19T05:29:30.626 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.626 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.626 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.626 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "default", 2024-09-19T05:29:30.626 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: "default", 2024-09-19T05:29:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: "error" 2024-09-19T05:29:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_error_status_code": { 2024-09-19T05:29:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_error_status_code", 2024-09-19T05:29:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.627 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "500", 2024-09-19T05:29:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "400", 2024-09-19T05:29:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "599", 2024-09-19T05:29:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_support", 2024-09-19T05:29:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.629 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.630 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.631 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.632 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.633 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: "max_concurrent_snap_create": { 2024-09-19T05:29:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_concurrent_snap_create", 2024-09-19T05:29:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.634 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-09-19T05:29:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: "mirror_snapshot_schedule": { 2024-09-19T05:29:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T05:29:30.635 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: "trash_purge_schedule": { 2024-09-19T05:29:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "trash_purge_schedule", 2024-09-19T05:29:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "restful", 2024-09-19T05:29:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: "enable_auth": { 2024-09-19T05:29:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enable_auth", 2024-09-19T05:29:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.638 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: "key_file": { 2024-09-19T05:29:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "key_file", 2024-09-19T05:29:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.639 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.640 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.640 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.640 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.640 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.640 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.640 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.640 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.640 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.641 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.642 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.643 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.644 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2024-09-19T05:29:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2024-09-19T05:29:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.645 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2024-09-19T05:29:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2024-09-19T05:29:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.646 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rgw", 2024-09-19T05:29:30.647 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.648 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.648 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.648 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.648 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.648 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.648 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.648 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.648 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.648 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.648 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.648 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.648 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.649 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.650 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.651 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.652 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.653 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.653 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.653 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.653 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.653 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.653 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.653 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.653 INFO:teuthology.orchestra.run.smithi120.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T05:29:30.653 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T05:29:30.653 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-09-19T05:29:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T05:29:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rook", 2024-09-19T05:29:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.655 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.656 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.657 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.658 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.659 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.660 INFO:teuthology.orchestra.run.smithi120.stdout: "storage_class": { 2024-09-19T05:29:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "storage_class", 2024-09-19T05:29:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "local", 2024-09-19T05:29:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T05:29:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.661 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "selftest", 2024-09-19T05:29:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.662 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.663 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.664 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.665 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.666 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.667 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "roption1": { 2024-09-19T05:29:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "roption1", 2024-09-19T05:29:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.668 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "roption2": { 2024-09-19T05:29:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "roption2", 2024-09-19T05:29:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "xyz", 2024-09-19T05:29:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.669 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption1": { 2024-09-19T05:29:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption1", 2024-09-19T05:29:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.670 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption2": { 2024-09-19T05:29:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption2", 2024-09-19T05:29:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.671 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption3": { 2024-09-19T05:29:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption3", 2024-09-19T05:29:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-09-19T05:29:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.672 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption4": { 2024-09-19T05:29:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption4", 2024-09-19T05:29:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.673 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption5": { 2024-09-19T05:29:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption5", 2024-09-19T05:29:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.674 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption6": { 2024-09-19T05:29:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption6", 2024-09-19T05:29:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.675 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption7": { 2024-09-19T05:29:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption7", 2024-09-19T05:29:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.676 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2024-09-19T05:29:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "42", 2024-09-19T05:29:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "testkey": { 2024-09-19T05:29:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testkey", 2024-09-19T05:29:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.677 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "testlkey": { 2024-09-19T05:29:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testlkey", 2024-09-19T05:29:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.678 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "testnewline": { 2024-09-19T05:29:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testnewline", 2024-09-19T05:29:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.679 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "snap_schedule", 2024-09-19T05:29:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.680 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "allow_m_granularity": { 2024-09-19T05:29:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "allow_m_granularity", 2024-09-19T05:29:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T05:29:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.681 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "dump_on_update": { 2024-09-19T05:29:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "dump_on_update", 2024-09-19T05:29:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "dump database to debug log on update", 2024-09-19T05:29:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.682 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.683 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.684 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.685 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.686 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.687 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "stats", 2024-09-19T05:29:30.688 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.689 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.690 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.691 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.692 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.693 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "status", 2024-09-19T05:29:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.694 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.695 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.696 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.697 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.698 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.699 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "telegraf", 2024-09-19T05:29:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.700 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "address": { 2024-09-19T05:29:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "address", 2024-09-19T05:29:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T05:29:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.701 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-09-19T05:29:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-09-19T05:29:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15", 2024-09-19T05:29:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.702 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.703 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.704 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.705 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.706 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.707 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "telemetry", 2024-09-19T05:29:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_basic": { 2024-09-19T05:29:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_basic", 2024-09-19T05:29:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.708 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T05:29:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_crash": { 2024-09-19T05:29:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_crash", 2024-09-19T05:29:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.709 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T05:29:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_device": { 2024-09-19T05:29:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_device", 2024-09-19T05:29:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.710 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T05:29:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_ident": { 2024-09-19T05:29:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_ident", 2024-09-19T05:29:30.711 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T05:29:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_perf": { 2024-09-19T05:29:30.712 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_perf", 2024-09-19T05:29:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T05:29:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.713 INFO:teuthology.orchestra.run.smithi120.stdout: "contact": { 2024-09-19T05:29:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "contact", 2024-09-19T05:29:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.714 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: "description": { 2024-09-19T05:29:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "description", 2024-09-19T05:29:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.715 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: "device_url": { 2024-09-19T05:29:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "device_url", 2024-09-19T05:29:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T05:29:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.716 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": { 2024-09-19T05:29:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enabled", 2024-09-19T05:29:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-09-19T05:29:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-09-19T05:29:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "24", 2024-09-19T05:29:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "8", 2024-09-19T05:29:30.718 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: "last_opt_revision": { 2024-09-19T05:29:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "last_opt_revision", 2024-09-19T05:29:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1", 2024-09-19T05:29:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.719 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: "leaderboard": { 2024-09-19T05:29:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "leaderboard", 2024-09-19T05:29:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.720 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: "leaderboard_description": { 2024-09-19T05:29:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "leaderboard_description", 2024-09-19T05:29:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.721 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.722 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.723 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.724 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.725 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.726 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.727 INFO:teuthology.orchestra.run.smithi120.stdout: "organization": { 2024-09-19T05:29:30.728 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "organization", 2024-09-19T05:29:30.728 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.728 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.728 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.728 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.728 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.728 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.728 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.728 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.728 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.728 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.728 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: "proxy": { 2024-09-19T05:29:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "proxy", 2024-09-19T05:29:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.729 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: "url": { 2024-09-19T05:29:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "url", 2024-09-19T05:29:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T05:29:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.730 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "test_orchestrator", 2024-09-19T05:29:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.731 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.732 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.733 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.733 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.733 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.733 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.733 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.733 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.733 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.733 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.733 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.733 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.733 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.733 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.734 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.735 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "volumes", 2024-09-19T05:29:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.737 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.738 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.739 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.740 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.741 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: "max_concurrent_clones": { 2024-09-19T05:29:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_concurrent_clones", 2024-09-19T05:29:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "4", 2024-09-19T05:29:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.742 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T05:29:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: "periodic_async_work": { 2024-09-19T05:29:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "periodic_async_work", 2024-09-19T05:29:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.743 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Periodically check for async work", 2024-09-19T05:29:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: "snapshot_clone_delay": { 2024-09-19T05:29:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "snapshot_clone_delay", 2024-09-19T05:29:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-09-19T05:29:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.744 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T05:29:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: "snapshot_clone_no_wait": { 2024-09-19T05:29:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T05:29:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.745 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T05:29:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix", 2024-09-19T05:29:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.746 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: "discovery_interval": { 2024-09-19T05:29:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "discovery_interval", 2024-09-19T05:29:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-09-19T05:29:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "100", 2024-09-19T05:29:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.747 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.748 INFO:teuthology.orchestra.run.smithi120.stdout: "identifier": { 2024-09-19T05:29:30.748 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "identifier", 2024-09-19T05:29:30.748 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.748 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.748 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.748 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.748 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.748 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.748 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.748 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.748 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.748 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-09-19T05:29:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-09-19T05:29:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-09-19T05:29:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.750 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.751 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.752 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.752 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.752 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.752 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.752 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.752 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.752 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.752 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.752 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.752 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.752 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.752 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.753 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.754 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.754 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.754 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.754 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.754 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.754 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.754 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.754 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.754 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.754 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.754 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.754 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_host": { 2024-09-19T05:29:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_host", 2024-09-19T05:29:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.755 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_port": { 2024-09-19T05:29:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_port", 2024-09-19T05:29:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10051", 2024-09-19T05:29:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.756 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.757 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.757 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.757 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.757 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.757 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_sender": { 2024-09-19T05:29:30.757 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_sender", 2024-09-19T05:29:30.757 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.757 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.757 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.757 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T05:29:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-19T05:29:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.758 INFO:teuthology.orchestra.run.smithi120.stdout: "gid": 24736, 2024-09-19T05:29:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "z", 2024-09-19T05:29:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr_features": 4540701547738038271, 2024-09-19T05:29:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: "available_modules": [ 2024-09-19T05:29:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "alerts", 2024-09-19T05:29:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-09-19T05:29:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-09-19T05:29:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.759 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-09-19T05:29:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T05:29:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.760 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.761 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.762 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.763 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.764 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.765 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.765 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.765 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.765 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.765 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.765 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.765 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.765 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.765 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.765 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.765 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_destination": { 2024-09-19T05:29:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_destination", 2024-09-19T05:29:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Email address to send alerts to", 2024-09-19T05:29:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_from_name": { 2024-09-19T05:29:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_from_name", 2024-09-19T05:29:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "Ceph", 2024-09-19T05:29:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Email From: name", 2024-09-19T05:29:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.767 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_host": { 2024-09-19T05:29:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_host", 2024-09-19T05:29:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP server", 2024-09-19T05:29:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.768 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_password": { 2024-09-19T05:29:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_password", 2024-09-19T05:29:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Password to authenticate with", 2024-09-19T05:29:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.769 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_port": { 2024-09-19T05:29:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_port", 2024-09-19T05:29:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "465", 2024-09-19T05:29:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP port", 2024-09-19T05:29:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.770 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_sender": { 2024-09-19T05:29:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_sender", 2024-09-19T05:29:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP envelope sender", 2024-09-19T05:29:30.771 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_ssl": { 2024-09-19T05:29:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_ssl", 2024-09-19T05:29:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.772 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T05:29:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_user": { 2024-09-19T05:29:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_user", 2024-09-19T05:29:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.773 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "User to authenticate as", 2024-09-19T05:29:30.774 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.774 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.774 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.774 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.774 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.774 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "balancer", 2024-09-19T05:29:30.774 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.774 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.774 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.774 INFO:teuthology.orchestra.run.smithi120.stdout: "active": { 2024-09-19T05:29:30.774 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "active", 2024-09-19T05:29:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T05:29:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.775 INFO:teuthology.orchestra.run.smithi120.stdout: "begin_time": { 2024-09-19T05:29:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "begin_time", 2024-09-19T05:29:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0000", 2024-09-19T05:29:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T05:29:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T05:29:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.777 INFO:teuthology.orchestra.run.smithi120.stdout: "begin_weekday": { 2024-09-19T05:29:30.777 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "begin_weekday", 2024-09-19T05:29:30.777 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-09-19T05:29:30.777 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.777 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.777 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-09-19T05:29:30.777 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0", 2024-09-19T05:29:30.777 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "6", 2024-09-19T05:29:30.777 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.777 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T05:29:30.777 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T05:29:30.777 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.777 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.778 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_max_iterations": { 2024-09-19T05:29:30.778 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_max_iterations", 2024-09-19T05:29:30.778 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-09-19T05:29:30.778 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.778 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.778 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "25", 2024-09-19T05:29:30.778 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2024-09-19T05:29:30.778 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "250", 2024-09-19T05:29:30.778 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.778 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T05:29:30.778 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.778 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.779 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.779 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_metrics": { 2024-09-19T05:29:30.779 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_metrics", 2024-09-19T05:29:30.779 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.779 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.779 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.779 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T05:29:30.779 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.779 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.779 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.779 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T05:29:30.779 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T05:29:30.779 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.780 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.780 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_step": { 2024-09-19T05:29:30.780 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_step", 2024-09-19T05:29:30.780 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-09-19T05:29:30.780 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.780 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.780 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0.5", 2024-09-19T05:29:30.780 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0.001", 2024-09-19T05:29:30.780 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "0.999", 2024-09-19T05:29:30.780 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.780 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "aggressiveness of optimization", 2024-09-19T05:29:30.780 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T05:29:30.780 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.781 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.781 INFO:teuthology.orchestra.run.smithi120.stdout: "end_time": { 2024-09-19T05:29:30.781 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "end_time", 2024-09-19T05:29:30.781 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.781 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.781 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.781 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "2359", 2024-09-19T05:29:30.781 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.781 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.781 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.781 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T05:29:30.781 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T05:29:30.781 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.782 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.782 INFO:teuthology.orchestra.run.smithi120.stdout: "end_weekday": { 2024-09-19T05:29:30.782 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "end_weekday", 2024-09-19T05:29:30.782 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-09-19T05:29:30.782 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.782 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.782 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-09-19T05:29:30.782 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0", 2024-09-19T05:29:30.782 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "6", 2024-09-19T05:29:30.782 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.782 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T05:29:30.782 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T05:29:30.782 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.783 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.783 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.783 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.783 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.783 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.783 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.783 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.783 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.783 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.783 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.783 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.783 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.783 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.784 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.784 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.784 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.784 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.784 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.784 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.784 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.784 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.784 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.784 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.784 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.785 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.785 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.785 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.785 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.785 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.785 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.785 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.785 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.785 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.785 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.785 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.785 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.786 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.786 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.786 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.786 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.786 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.786 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.786 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.786 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.786 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.786 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.786 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.786 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.786 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.786 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.787 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.787 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.787 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.787 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.787 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.787 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.787 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.787 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.787 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.787 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.787 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.787 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.788 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.788 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.788 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.788 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.788 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.788 INFO:teuthology.orchestra.run.smithi120.stdout: "min_score": { 2024-09-19T05:29:30.788 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "min_score", 2024-09-19T05:29:30.788 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-09-19T05:29:30.788 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.788 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.788 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-09-19T05:29:30.788 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.788 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.788 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.789 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T05:29:30.789 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.789 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.789 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.789 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": { 2024-09-19T05:29:30.789 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mode", 2024-09-19T05:29:30.789 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.789 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.789 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.789 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "upmap", 2024-09-19T05:29:30.789 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.789 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.789 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.790 INFO:teuthology.orchestra.run.smithi120.stdout: "crush-compat", 2024-09-19T05:29:30.790 INFO:teuthology.orchestra.run.smithi120.stdout: "none", 2024-09-19T05:29:30.790 INFO:teuthology.orchestra.run.smithi120.stdout: "read", 2024-09-19T05:29:30.790 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap", 2024-09-19T05:29:30.790 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap-read" 2024-09-19T05:29:30.790 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.790 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Balancer mode", 2024-09-19T05:29:30.790 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.790 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.790 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.790 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_ids": { 2024-09-19T05:29:30.790 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pool_ids", 2024-09-19T05:29:30.791 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.791 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.791 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.791 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.791 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.791 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.791 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.791 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T05:29:30.791 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.791 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.791 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.791 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-09-19T05:29:30.791 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-09-19T05:29:30.792 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.792 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.792 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.792 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-09-19T05:29:30.792 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.792 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.792 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.792 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T05:29:30.792 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.792 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.792 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.792 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap_max_deviation": { 2024-09-19T05:29:30.792 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "upmap_max_deviation", 2024-09-19T05:29:30.792 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.793 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.793 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.793 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-09-19T05:29:30.793 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2024-09-19T05:29:30.793 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.793 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.793 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T05:29:30.793 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T05:29:30.793 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.793 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.793 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap_max_optimizations": { 2024-09-19T05:29:30.793 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "upmap_max_optimizations", 2024-09-19T05:29:30.793 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-09-19T05:29:30.794 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.794 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.794 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-09-19T05:29:30.794 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.794 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.794 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.794 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T05:29:30.794 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.794 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.794 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.794 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.794 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.795 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cephadm", 2024-09-19T05:29:30.795 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.795 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.795 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.795 INFO:teuthology.orchestra.run.smithi120.stdout: "agent_down_multiplier": { 2024-09-19T05:29:30.795 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "agent_down_multiplier", 2024-09-19T05:29:30.795 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-09-19T05:29:30.795 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.795 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.795 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "3.0", 2024-09-19T05:29:30.795 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.795 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.795 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.796 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T05:29:30.796 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.796 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.796 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.796 INFO:teuthology.orchestra.run.smithi120.stdout: "agent_refresh_rate": { 2024-09-19T05:29:30.796 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "agent_refresh_rate", 2024-09-19T05:29:30.796 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.796 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.796 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.796 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "20", 2024-09-19T05:29:30.796 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.796 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.797 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.797 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T05:29:30.797 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.797 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.797 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.797 INFO:teuthology.orchestra.run.smithi120.stdout: "agent_starting_port": { 2024-09-19T05:29:30.797 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "agent_starting_port", 2024-09-19T05:29:30.797 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.797 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.797 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.797 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "4721", 2024-09-19T05:29:30.797 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.797 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.798 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.798 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T05:29:30.798 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.798 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.798 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.798 INFO:teuthology.orchestra.run.smithi120.stdout: "allow_ptrace": { 2024-09-19T05:29:30.798 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "allow_ptrace", 2024-09-19T05:29:30.798 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.798 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.798 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.798 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.798 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.798 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.799 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.799 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T05:29:30.799 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T05:29:30.799 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.799 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.799 INFO:teuthology.orchestra.run.smithi120.stdout: "autotune_interval": { 2024-09-19T05:29:30.799 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "autotune_interval", 2024-09-19T05:29:30.799 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.799 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.799 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.799 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-09-19T05:29:30.799 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.800 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.800 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.800 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T05:29:30.800 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.800 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.800 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.800 INFO:teuthology.orchestra.run.smithi120.stdout: "autotune_memory_target_ratio": { 2024-09-19T05:29:30.800 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T05:29:30.800 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-09-19T05:29:30.800 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.800 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.800 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0.7", 2024-09-19T05:29:30.801 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.801 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.801 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.801 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T05:29:30.801 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.801 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.801 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.801 INFO:teuthology.orchestra.run.smithi120.stdout: "cephadm_log_destination": { 2024-09-19T05:29:30.801 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cephadm_log_destination", 2024-09-19T05:29:30.801 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.801 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.802 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.802 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.802 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.802 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.802 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.802 INFO:teuthology.orchestra.run.smithi120.stdout: "file", 2024-09-19T05:29:30.802 INFO:teuthology.orchestra.run.smithi120.stdout: "file,syslog", 2024-09-19T05:29:30.802 INFO:teuthology.orchestra.run.smithi120.stdout: "syslog" 2024-09-19T05:29:30.802 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.802 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T05:29:30.802 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.802 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.802 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.803 INFO:teuthology.orchestra.run.smithi120.stdout: "cgroups_split": { 2024-09-19T05:29:30.803 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cgroups_split", 2024-09-19T05:29:30.803 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.803 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.803 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.803 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.803 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.803 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.803 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.803 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T05:29:30.803 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.803 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.803 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.804 INFO:teuthology.orchestra.run.smithi120.stdout: "config_checks_enabled": { 2024-09-19T05:29:30.804 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "config_checks_enabled", 2024-09-19T05:29:30.804 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.804 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.804 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.804 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.804 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.804 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.804 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.804 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T05:29:30.804 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.805 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.805 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.805 INFO:teuthology.orchestra.run.smithi120.stdout: "config_dashboard": { 2024-09-19T05:29:30.805 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "config_dashboard", 2024-09-19T05:29:30.805 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.805 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.805 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.805 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.805 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.805 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.805 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.806 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T05:29:30.806 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.806 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.806 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.806 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_alertmanager": { 2024-09-19T05:29:30.806 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_alertmanager", 2024-09-19T05:29:30.806 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.806 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.806 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.806 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T05:29:30.806 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.806 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.807 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.807 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Prometheus container image", 2024-09-19T05:29:30.807 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.807 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.807 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.807 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_base": { 2024-09-19T05:29:30.807 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_base", 2024-09-19T05:29:30.807 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.807 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.807 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.807 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T05:29:30.807 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.808 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.808 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.808 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Container image name, without the tag", 2024-09-19T05:29:30.808 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.808 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.808 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.808 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_elasticsearch": { 2024-09-19T05:29:30.808 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_elasticsearch", 2024-09-19T05:29:30.808 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.808 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.808 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.808 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T05:29:30.808 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "elasticsearch container image", 2024-09-19T05:29:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_grafana": { 2024-09-19T05:29:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_grafana", 2024-09-19T05:29:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.809 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T05:29:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Prometheus container image", 2024-09-19T05:29:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_haproxy": { 2024-09-19T05:29:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_haproxy", 2024-09-19T05:29:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.810 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T05:29:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "HAproxy container image", 2024-09-19T05:29:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_jaeger_agent": { 2024-09-19T05:29:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_jaeger_agent", 2024-09-19T05:29:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.811 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T05:29:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Jaeger agent container image", 2024-09-19T05:29:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_jaeger_collector": { 2024-09-19T05:29:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_jaeger_collector", 2024-09-19T05:29:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.812 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T05:29:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Jaeger collector container image", 2024-09-19T05:29:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_jaeger_query": { 2024-09-19T05:29:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_jaeger_query", 2024-09-19T05:29:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.813 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T05:29:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Jaeger query container image", 2024-09-19T05:29:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_keepalived": { 2024-09-19T05:29:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_keepalived", 2024-09-19T05:29:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.814 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T05:29:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Keepalived container image", 2024-09-19T05:29:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_loki": { 2024-09-19T05:29:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_loki", 2024-09-19T05:29:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.815 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.816 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.816 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T05:29:30.816 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.816 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.816 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.816 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Loki container image", 2024-09-19T05:29:30.816 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.816 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.816 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.816 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_node_exporter": { 2024-09-19T05:29:30.817 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_node_exporter", 2024-09-19T05:29:30.817 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.817 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.817 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.817 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T05:29:30.817 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.817 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.817 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.819 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Prometheus container image", 2024-09-19T05:29:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_nvmeof": { 2024-09-19T05:29:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_nvmeof", 2024-09-19T05:29:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T05:29:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.820 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Nvme-of container image", 2024-09-19T05:29:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_prometheus": { 2024-09-19T05:29:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_prometheus", 2024-09-19T05:29:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T05:29:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.821 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.822 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Prometheus container image", 2024-09-19T05:29:30.822 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.822 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.822 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.822 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_promtail": { 2024-09-19T05:29:30.822 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_promtail", 2024-09-19T05:29:30.822 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.822 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.822 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.822 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T05:29:30.822 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.822 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.823 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.823 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Promtail container image", 2024-09-19T05:29:30.823 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.823 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.823 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.823 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_samba": { 2024-09-19T05:29:30.823 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_samba", 2024-09-19T05:29:30.823 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.823 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.823 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.823 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T05:29:30.823 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.823 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.823 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.824 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Samba/SMB container image", 2024-09-19T05:29:30.824 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.824 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.824 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.824 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_snmp_gateway": { 2024-09-19T05:29:30.824 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_snmp_gateway", 2024-09-19T05:29:30.824 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.824 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.824 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.824 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T05:29:30.824 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.824 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.824 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.824 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SNMP Gateway container image", 2024-09-19T05:29:30.825 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.825 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.825 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.825 INFO:teuthology.orchestra.run.smithi120.stdout: "container_init": { 2024-09-19T05:29:30.825 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_init", 2024-09-19T05:29:30.825 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.825 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.825 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.825 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.825 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.825 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.826 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.826 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T05:29:30.826 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.826 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.826 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.826 INFO:teuthology.orchestra.run.smithi120.stdout: "daemon_cache_timeout": { 2024-09-19T05:29:30.826 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "daemon_cache_timeout", 2024-09-19T05:29:30.826 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.826 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.826 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.826 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-09-19T05:29:30.826 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.827 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.827 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.827 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T05:29:30.827 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.827 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.827 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.827 INFO:teuthology.orchestra.run.smithi120.stdout: "default_cephadm_command_timeout": { 2024-09-19T05:29:30.827 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T05:29:30.827 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.827 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.827 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.827 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "900", 2024-09-19T05:29:30.827 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.828 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.828 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.828 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T05:29:30.828 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.828 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.828 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.828 INFO:teuthology.orchestra.run.smithi120.stdout: "default_registry": { 2024-09-19T05:29:30.828 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "default_registry", 2024-09-19T05:29:30.828 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.828 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.828 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.828 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "docker.io", 2024-09-19T05:29:30.829 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.829 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.829 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.829 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T05:29:30.829 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.829 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.829 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.829 INFO:teuthology.orchestra.run.smithi120.stdout: "device_cache_timeout": { 2024-09-19T05:29:30.829 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "device_cache_timeout", 2024-09-19T05:29:30.829 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.829 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.829 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.830 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1800", 2024-09-19T05:29:30.830 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.830 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.830 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.830 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "seconds to cache device inventory", 2024-09-19T05:29:30.830 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.830 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.830 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.830 INFO:teuthology.orchestra.run.smithi120.stdout: "device_enhanced_scan": { 2024-09-19T05:29:30.830 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "device_enhanced_scan", 2024-09-19T05:29:30.830 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.830 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.831 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.831 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.831 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.831 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.831 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.831 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T05:29:30.831 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.831 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.831 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.831 INFO:teuthology.orchestra.run.smithi120.stdout: "facts_cache_timeout": { 2024-09-19T05:29:30.831 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "facts_cache_timeout", 2024-09-19T05:29:30.831 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.831 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.832 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.832 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-09-19T05:29:30.832 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.832 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.832 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.832 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "seconds to cache host facts data", 2024-09-19T05:29:30.832 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.832 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.832 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.832 INFO:teuthology.orchestra.run.smithi120.stdout: "grafana_dashboards_path": { 2024-09-19T05:29:30.832 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "grafana_dashboards_path", 2024-09-19T05:29:30.833 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.833 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.833 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.833 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T05:29:30.833 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.833 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.833 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.833 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T05:29:30.833 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.833 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.833 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.833 INFO:teuthology.orchestra.run.smithi120.stdout: "host_check_interval": { 2024-09-19T05:29:30.833 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "host_check_interval", 2024-09-19T05:29:30.834 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.834 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.834 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.834 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-09-19T05:29:30.834 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.834 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.834 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.834 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to perform a host check", 2024-09-19T05:29:30.834 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.834 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.834 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.834 INFO:teuthology.orchestra.run.smithi120.stdout: "hw_monitoring": { 2024-09-19T05:29:30.834 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "hw_monitoring", 2024-09-19T05:29:30.835 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.835 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.835 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.835 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.835 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.835 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.835 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.835 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T05:29:30.835 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.835 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.835 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.835 INFO:teuthology.orchestra.run.smithi120.stdout: "inventory_list_all": { 2024-09-19T05:29:30.835 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "inventory_list_all", 2024-09-19T05:29:30.836 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.836 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.836 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.836 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.836 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.836 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.836 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.836 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T05:29:30.836 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.836 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.836 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.836 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.836 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.836 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.837 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.837 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.837 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.837 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.837 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.837 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.837 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.837 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.837 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.837 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.837 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.837 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.837 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.837 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.838 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.838 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.838 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.838 INFO:teuthology.orchestra.run.smithi120.stdout: "log_refresh_metadata": { 2024-09-19T05:29:30.838 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_refresh_metadata", 2024-09-19T05:29:30.838 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.838 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.838 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.838 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.838 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.838 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.838 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.839 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T05:29:30.839 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.839 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.839 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.839 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.839 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.839 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.839 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.839 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.839 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.839 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.839 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.839 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.840 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T05:29:30.840 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.840 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.840 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.840 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.840 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.840 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.840 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.840 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.840 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.840 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.840 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.841 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.841 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.841 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.841 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.841 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.841 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.841 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.841 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.841 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.841 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.841 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.841 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.842 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.842 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.842 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.842 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.842 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.842 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.842 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.842 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.842 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.842 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.842 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.842 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.842 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.843 INFO:teuthology.orchestra.run.smithi120.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T05:29:30.843 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T05:29:30.843 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.843 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.843 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.843 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.843 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.843 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.843 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.843 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T05:29:30.843 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.843 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.843 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.844 INFO:teuthology.orchestra.run.smithi120.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T05:29:30.844 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T05:29:30.844 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.844 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.844 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.844 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "*", 2024-09-19T05:29:30.844 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.844 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.844 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.844 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T05:29:30.844 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.844 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.844 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.845 INFO:teuthology.orchestra.run.smithi120.stdout: "max_count_per_host": { 2024-09-19T05:29:30.845 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_count_per_host", 2024-09-19T05:29:30.845 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.845 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.845 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.845 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-09-19T05:29:30.845 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.845 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.845 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.845 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "max number of daemons per service per host", 2024-09-19T05:29:30.845 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.845 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.845 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.846 INFO:teuthology.orchestra.run.smithi120.stdout: "max_osd_draining_count": { 2024-09-19T05:29:30.846 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_osd_draining_count", 2024-09-19T05:29:30.846 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.846 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.846 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.846 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-09-19T05:29:30.846 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.846 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.846 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.846 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T05:29:30.846 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.846 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.846 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.846 INFO:teuthology.orchestra.run.smithi120.stdout: "migration_current": { 2024-09-19T05:29:30.847 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "migration_current", 2024-09-19T05:29:30.847 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.847 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.847 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.847 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.847 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.847 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.847 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.847 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "internal - do not modify", 2024-09-19T05:29:30.847 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.847 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.847 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.847 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": { 2024-09-19T05:29:30.847 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mode", 2024-09-19T05:29:30.848 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.848 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.848 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.848 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "root", 2024-09-19T05:29:30.848 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.848 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.848 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.848 INFO:teuthology.orchestra.run.smithi120.stdout: "cephadm-package", 2024-09-19T05:29:30.848 INFO:teuthology.orchestra.run.smithi120.stdout: "root" 2024-09-19T05:29:30.848 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.848 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T05:29:30.848 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.848 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.848 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.849 INFO:teuthology.orchestra.run.smithi120.stdout: "oob_default_addr": { 2024-09-19T05:29:30.849 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "oob_default_addr", 2024-09-19T05:29:30.849 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.849 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.849 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.849 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "169.254.1.1", 2024-09-19T05:29:30.849 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.849 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.849 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.849 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T05:29:30.849 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.849 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.849 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.850 INFO:teuthology.orchestra.run.smithi120.stdout: "prometheus_alerts_path": { 2024-09-19T05:29:30.850 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prometheus_alerts_path", 2024-09-19T05:29:30.850 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.850 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.850 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.850 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T05:29:30.850 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.850 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.850 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.850 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T05:29:30.850 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.850 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.850 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.851 INFO:teuthology.orchestra.run.smithi120.stdout: "registry_insecure": { 2024-09-19T05:29:30.851 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "registry_insecure", 2024-09-19T05:29:30.851 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.851 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.851 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.851 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.851 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.851 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.851 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.851 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T05:29:30.851 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.851 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.852 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.852 INFO:teuthology.orchestra.run.smithi120.stdout: "registry_password": { 2024-09-19T05:29:30.852 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "registry_password", 2024-09-19T05:29:30.852 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.852 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.852 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.852 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.852 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.852 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.852 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.852 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T05:29:30.853 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.853 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.853 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.853 INFO:teuthology.orchestra.run.smithi120.stdout: "registry_url": { 2024-09-19T05:29:30.853 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "registry_url", 2024-09-19T05:29:30.853 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.853 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.853 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.853 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.853 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.853 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.853 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.854 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T05:29:30.854 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.854 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.854 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.854 INFO:teuthology.orchestra.run.smithi120.stdout: "registry_username": { 2024-09-19T05:29:30.854 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "registry_username", 2024-09-19T05:29:30.854 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.854 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.854 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.854 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.854 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.855 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.855 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.855 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T05:29:30.855 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.855 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.855 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.855 INFO:teuthology.orchestra.run.smithi120.stdout: "secure_monitoring_stack": { 2024-09-19T05:29:30.855 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "secure_monitoring_stack", 2024-09-19T05:29:30.855 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.855 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.855 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.855 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.855 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.855 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.856 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.856 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T05:29:30.856 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.856 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.856 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.856 INFO:teuthology.orchestra.run.smithi120.stdout: "service_discovery_port": { 2024-09-19T05:29:30.856 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "service_discovery_port", 2024-09-19T05:29:30.856 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.856 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.856 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.856 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8765", 2024-09-19T05:29:30.856 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.856 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.857 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.857 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "cephadm service discovery port", 2024-09-19T05:29:30.857 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.857 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.857 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.857 INFO:teuthology.orchestra.run.smithi120.stdout: "ssh_config_file": { 2024-09-19T05:29:30.857 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssh_config_file", 2024-09-19T05:29:30.857 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.857 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.857 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.857 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.858 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.858 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.858 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.858 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T05:29:30.858 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.858 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.858 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.858 INFO:teuthology.orchestra.run.smithi120.stdout: "use_agent": { 2024-09-19T05:29:30.858 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "use_agent", 2024-09-19T05:29:30.858 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.858 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.858 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.859 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.859 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.859 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.859 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.859 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T05:29:30.859 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.859 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.859 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.859 INFO:teuthology.orchestra.run.smithi120.stdout: "use_repo_digest": { 2024-09-19T05:29:30.859 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "use_repo_digest", 2024-09-19T05:29:30.859 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.860 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.860 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.860 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.860 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.860 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.860 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.860 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T05:29:30.860 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.860 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.860 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.860 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_on_failed_host_check": { 2024-09-19T05:29:30.861 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_on_failed_host_check", 2024-09-19T05:29:30.861 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.861 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.861 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.861 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.861 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.861 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.861 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.861 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T05:29:30.861 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.861 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.861 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.861 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_on_stray_daemons": { 2024-09-19T05:29:30.862 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_on_stray_daemons", 2024-09-19T05:29:30.862 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.862 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.862 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.862 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.862 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.862 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.862 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.862 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T05:29:30.862 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.862 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.862 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.863 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_on_stray_hosts": { 2024-09-19T05:29:30.863 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_on_stray_hosts", 2024-09-19T05:29:30.863 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.863 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.863 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.863 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.863 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.863 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.863 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.863 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T05:29:30.863 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.863 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.863 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.864 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.864 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.864 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crash", 2024-09-19T05:29:30.864 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.864 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.864 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.864 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.865 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.865 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.865 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.865 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.865 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.865 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.865 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.865 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.865 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.865 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.865 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.865 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.866 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.866 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.866 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.866 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.866 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.866 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.866 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.866 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.866 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.866 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.866 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.867 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.867 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.867 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.867 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.867 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.867 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.867 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.867 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.867 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.867 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.867 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.867 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.867 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.868 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.868 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.868 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.868 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.868 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.868 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.868 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.868 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.868 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.868 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.868 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.868 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.869 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.869 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.869 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.869 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.869 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.869 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.869 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.869 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.869 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.869 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.869 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.869 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.870 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.870 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.870 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.870 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.870 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.870 INFO:teuthology.orchestra.run.smithi120.stdout: "retain_interval": { 2024-09-19T05:29:30.870 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "retain_interval", 2024-09-19T05:29:30.870 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.870 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.870 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.870 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "31536000", 2024-09-19T05:29:30.870 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.871 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.871 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.871 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T05:29:30.871 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.871 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.871 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.871 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_recent_interval": { 2024-09-19T05:29:30.871 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_recent_interval", 2024-09-19T05:29:30.871 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.871 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.871 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.871 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1209600", 2024-09-19T05:29:30.872 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.872 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.872 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.872 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T05:29:30.872 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.872 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.872 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.872 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.872 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.872 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "dashboard", 2024-09-19T05:29:30.872 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.873 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.873 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.873 INFO:teuthology.orchestra.run.smithi120.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T05:29:30.873 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T05:29:30.873 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.873 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.873 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.873 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-09-19T05:29:30.873 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.873 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.873 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.873 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.873 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.873 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.874 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.874 INFO:teuthology.orchestra.run.smithi120.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T05:29:30.874 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T05:29:30.874 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.874 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.874 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.874 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.874 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.874 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.874 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.874 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.874 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.875 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.875 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.875 INFO:teuthology.orchestra.run.smithi120.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T05:29:30.875 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T05:29:30.875 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.875 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.875 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.875 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.875 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.875 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.875 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.875 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.875 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.876 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.876 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.876 INFO:teuthology.orchestra.run.smithi120.stdout: "AUDIT_API_ENABLED": { 2024-09-19T05:29:30.876 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T05:29:30.876 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.876 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.876 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.876 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.876 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.876 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.876 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.876 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.876 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.877 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.877 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.877 INFO:teuthology.orchestra.run.smithi120.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T05:29:30.877 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T05:29:30.877 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.877 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.877 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.877 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.877 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.877 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.877 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.877 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.877 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.878 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.878 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.878 INFO:teuthology.orchestra.run.smithi120.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T05:29:30.878 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T05:29:30.878 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.878 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.878 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.878 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.878 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.878 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.878 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.879 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.879 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.879 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.879 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.879 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T05:29:30.879 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T05:29:30.879 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.879 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.879 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.879 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.879 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.879 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.879 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.880 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.880 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.880 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.880 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.880 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T05:29:30.880 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T05:29:30.880 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.880 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.880 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.880 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.880 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.880 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.880 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.881 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.881 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.881 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.881 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.881 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T05:29:30.881 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T05:29:30.881 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.881 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.881 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.881 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.881 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.881 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.882 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.882 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.882 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.882 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.882 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.882 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T05:29:30.882 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T05:29:30.882 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.882 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.882 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.882 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.882 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.882 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.882 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.883 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.883 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.883 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.883 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.883 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T05:29:30.883 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T05:29:30.883 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.883 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.883 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.883 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.883 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.883 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.883 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.884 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.884 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.884 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.884 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.884 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T05:29:30.884 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T05:29:30.884 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.884 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.884 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.884 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.884 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.884 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.885 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.885 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.885 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.885 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.885 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.885 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T05:29:30.885 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T05:29:30.885 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.885 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.885 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.885 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.885 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.885 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.886 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.886 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.886 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.886 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.886 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.886 INFO:teuthology.orchestra.run.smithi120.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T05:29:30.886 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T05:29:30.886 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.886 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.886 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.886 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.886 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.887 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.887 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.887 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.887 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.887 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.887 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.887 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T05:29:30.887 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T05:29:30.887 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.887 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.887 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.888 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2024-09-19T05:29:30.888 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.888 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.888 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.888 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.888 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.888 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.888 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.888 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T05:29:30.888 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T05:29:30.888 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.888 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.889 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.889 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.889 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.889 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.889 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.889 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.889 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.889 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.889 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.889 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_URL": { 2024-09-19T05:29:30.889 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_URL", 2024-09-19T05:29:30.889 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.890 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.890 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.890 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.890 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.890 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.890 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.890 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.890 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.890 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.890 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.890 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T05:29:30.890 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T05:29:30.890 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.891 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.891 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.891 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2024-09-19T05:29:30.891 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.891 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.891 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.891 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.891 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.891 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.891 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.891 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T05:29:30.891 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T05:29:30.891 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.892 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.892 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.892 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.892 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.892 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.892 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.892 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.892 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.892 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.892 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.893 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T05:29:30.893 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T05:29:30.893 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.893 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.893 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.893 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.893 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.893 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.893 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.893 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.893 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.893 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.893 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.894 INFO:teuthology.orchestra.run.smithi120.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T05:29:30.894 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T05:29:30.894 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.894 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.894 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.894 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.894 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.894 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.894 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.894 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.894 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.894 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.894 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T05:29:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T05:29:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T05:29:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T05:29:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T05:29:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T05:29:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T05:29:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T05:29:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T05:29:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T05:29:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.899 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T05:29:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T05:29:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T05:29:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T05:29:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T05:29:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T05:29:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T05:29:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T05:29:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T05:29:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T05:29:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T05:29:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T05:29:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T05:29:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T05:29:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T05:29:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T05:29:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T05:29:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-09-19T05:29:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T05:29:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T05:29:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8", 2024-09-19T05:29:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T05:29:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T05:29:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "45", 2024-09-19T05:29:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T05:29:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T05:29:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T05:29:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T05:29:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2024-09-19T05:29:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T05:29:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T05:29:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T05:29:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T05:29:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T05:29:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T05:29:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-09-19T05:29:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T05:29:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T05:29:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-09-19T05:29:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T05:29:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T05:29:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-09-19T05:29:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "cross_origin_url": { 2024-09-19T05:29:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cross_origin_url", 2024-09-19T05:29:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "crt_file": { 2024-09-19T05:29:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crt_file", 2024-09-19T05:29:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: "debug": { 2024-09-19T05:29:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "debug", 2024-09-19T05:29:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Enable/disable debug options", 2024-09-19T05:29:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "jwt_token_ttl": { 2024-09-19T05:29:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "jwt_token_ttl", 2024-09-19T05:29:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "28800", 2024-09-19T05:29:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "key_file": { 2024-09-19T05:29:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "key_file", 2024-09-19T05:29:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "motd": { 2024-09-19T05:29:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "motd", 2024-09-19T05:29:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "The message of the day", 2024-09-19T05:29:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "redirect_resolve_ip_addr": { 2024-09-19T05:29:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T05:29:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2024-09-19T05:29:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2024-09-19T05:29:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "::", 2024-09-19T05:29:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2024-09-19T05:29:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2024-09-19T05:29:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8080", 2024-09-19T05:29:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl": { 2024-09-19T05:29:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl", 2024-09-19T05:29:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl_server_port": { 2024-09-19T05:29:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl_server_port", 2024-09-19T05:29:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8443", 2024-09-19T05:29:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_behaviour": { 2024-09-19T05:29:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_behaviour", 2024-09-19T05:29:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "redirect", 2024-09-19T05:29:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "redirect" 2024-09-19T05:29:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_error_status_code": { 2024-09-19T05:29:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_error_status_code", 2024-09-19T05:29:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "500", 2024-09-19T05:29:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "400", 2024-09-19T05:29:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "599", 2024-09-19T05:29:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "url_prefix": { 2024-09-19T05:29:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "url_prefix", 2024-09-19T05:29:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "devicehealth", 2024-09-19T05:29:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "enable_monitoring": { 2024-09-19T05:29:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enable_monitoring", 2024-09-19T05:29:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "monitor device health metrics", 2024-09-19T05:29:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "mark_out_threshold": { 2024-09-19T05:29:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mark_out_threshold", 2024-09-19T05:29:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "2419200", 2024-09-19T05:29:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T05:29:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": { 2024-09-19T05:29:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pool_name", 2024-09-19T05:29:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "device_health_metrics", 2024-09-19T05:29:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T05:29:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "retention_period": { 2024-09-19T05:29:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "retention_period", 2024-09-19T05:29:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15552000", 2024-09-19T05:29:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long to retain device health metrics", 2024-09-19T05:29:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "scrape_frequency": { 2024-09-19T05:29:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "scrape_frequency", 2024-09-19T05:29:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "86400", 2024-09-19T05:29:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T05:29:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "self_heal": { 2024-09-19T05:29:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "self_heal", 2024-09-19T05:29:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T05:29:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-09-19T05:29:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-09-19T05:29:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-09-19T05:29:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T05:29:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_threshold": { 2024-09-19T05:29:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_threshold", 2024-09-19T05:29:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "7257600", 2024-09-19T05:29:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T05:29:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_local", 2024-09-19T05:29:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "predict_interval": { 2024-09-19T05:29:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "predict_interval", 2024-09-19T05:29:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "86400", 2024-09-19T05:29:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: "predictor_model": { 2024-09-19T05:29:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "predictor_model", 2024-09-19T05:29:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "prophetstor", 2024-09-19T05:29:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-09-19T05:29:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-09-19T05:29:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-09-19T05:29:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "influx", 2024-09-19T05:29:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": false, 2024-09-19T05:29:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "influxdb python module not found", 2024-09-19T05:29:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "batch_size": { 2024-09-19T05:29:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "batch_size", 2024-09-19T05:29:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5000", 2024-09-19T05:29:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T05:29:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "database": { 2024-09-19T05:29:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "database", 2024-09-19T05:29:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "ceph", 2024-09-19T05:29:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T05:29:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "hostname": { 2024-09-19T05:29:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "hostname", 2024-09-19T05:29:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "InfluxDB server hostname", 2024-09-19T05:29:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-09-19T05:29:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-09-19T05:29:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "30", 2024-09-19T05:29:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "5", 2024-09-19T05:29:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T05:29:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "password": { 2024-09-19T05:29:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "password", 2024-09-19T05:29:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "password of InfluxDB server user", 2024-09-19T05:29:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "port": { 2024-09-19T05:29:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "port", 2024-09-19T05:29:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8086", 2024-09-19T05:29:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "InfluxDB server port", 2024-09-19T05:29:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl": { 2024-09-19T05:29:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl", 2024-09-19T05:29:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "false", 2024-09-19T05:29:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T05:29:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "threads": { 2024-09-19T05:29:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "threads", 2024-09-19T05:29:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-09-19T05:29:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2024-09-19T05:29:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "32", 2024-09-19T05:29:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T05:29:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "username": { 2024-09-19T05:29:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "username", 2024-09-19T05:29:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "username of InfluxDB server user", 2024-09-19T05:29:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "verify_ssl": { 2024-09-19T05:29:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "verify_ssl", 2024-09-19T05:29:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "true", 2024-09-19T05:29:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T05:29:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "insights", 2024-09-19T05:29:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "iostat", 2024-09-19T05:29:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "k8sevents", 2024-09-19T05:29:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_event_retention_days": { 2024-09-19T05:29:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ceph_event_retention_days", 2024-09-19T05:29:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "7", 2024-09-19T05:29:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T05:29:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "config_check_secs": { 2024-09-19T05:29:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "config_check_secs", 2024-09-19T05:29:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-09-19T05:29:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "10", 2024-09-19T05:29:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T05:29:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "localpool", 2024-09-19T05:29:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "failure_domain": { 2024-09-19T05:29:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "failure_domain", 2024-09-19T05:29:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "host", 2024-09-19T05:29:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "failure domain for any created local pool", 2024-09-19T05:29:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T05:29:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": { 2024-09-19T05:29:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "min_size", 2024-09-19T05:29:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default min_size for any created local pool", 2024-09-19T05:29:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T05:29:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "num_rep": { 2024-09-19T05:29:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "num_rep", 2024-09-19T05:29:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "3", 2024-09-19T05:29:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default replica count for any created local pool", 2024-09-19T05:29:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": { 2024-09-19T05:29:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pg_num", 2024-09-19T05:29:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "128", 2024-09-19T05:29:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T05:29:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "prefix": { 2024-09-19T05:29:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prefix", 2024-09-19T05:29:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "name prefix for any created local pool", 2024-09-19T05:29:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "subtree": { 2024-09-19T05:29:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "subtree", 2024-09-19T05:29:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "rack", 2024-09-19T05:29:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T05:29:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T05:29:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mds_autoscaler", 2024-09-19T05:29:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mirroring", 2024-09-19T05:29:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "nfs", 2024-09-19T05:29:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.023 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.025 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.025 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.025 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.025 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.025 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.025 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.025 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.025 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.025 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.025 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.025 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.025 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.025 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.025 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "orchestrator", 2024-09-19T05:29:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: "fail_fs": { 2024-09-19T05:29:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "fail_fs", 2024-09-19T05:29:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T05:29:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: "orchestrator": { 2024-09-19T05:29:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "orchestrator", 2024-09-19T05:29:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: "cephadm", 2024-09-19T05:29:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: "rook", 2024-09-19T05:29:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: "test_orchestrator" 2024-09-19T05:29:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Orchestrator backend", 2024-09-19T05:29:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "osd_perf_query", 2024-09-19T05:29:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "osd_support", 2024-09-19T05:29:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pg_autoscaler", 2024-09-19T05:29:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-09-19T05:29:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-09-19T05:29:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-09-19T05:29:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: "threshold": { 2024-09-19T05:29:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "threshold", 2024-09-19T05:29:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-09-19T05:29:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "3.0", 2024-09-19T05:29:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1.0", 2024-09-19T05:29:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "scaling threshold", 2024-09-19T05:29:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T05:29:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "progress", 2024-09-19T05:29:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: "allow_pg_recovery_event": { 2024-09-19T05:29:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "allow_pg_recovery_event", 2024-09-19T05:29:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T05:29:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": { 2024-09-19T05:29:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enabled", 2024-09-19T05:29:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "max_completed_events": { 2024-09-19T05:29:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_completed_events", 2024-09-19T05:29:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "50", 2024-09-19T05:29:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "number of past completed events to remember", 2024-09-19T05:29:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-09-19T05:29:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-09-19T05:29:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-09-19T05:29:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long the module is going to sleep", 2024-09-19T05:29:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prometheus", 2024-09-19T05:29:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "cache": { 2024-09-19T05:29:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cache", 2024-09-19T05:29:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "exclude_perf_counters": { 2024-09-19T05:29:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "exclude_perf_counters", 2024-09-19T05:29:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T05:29:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T05:29:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_stats_pools": { 2024-09-19T05:29:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_stats_pools", 2024-09-19T05:29:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T05:29:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T05:29:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "300", 2024-09-19T05:29:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "scrape_interval": { 2024-09-19T05:29:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "scrape_interval", 2024-09-19T05:29:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-09-19T05:29:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15.0", 2024-09-19T05:29:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2024-09-19T05:29:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2024-09-19T05:29:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "::", 2024-09-19T05:29:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T05:29:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2024-09-19T05:29:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2024-09-19T05:29:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "9283", 2024-09-19T05:29:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T05:29:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "stale_cache_strategy": { 2024-09-19T05:29:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "stale_cache_strategy", 2024-09-19T05:29:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "log", 2024-09-19T05:29:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_behaviour": { 2024-09-19T05:29:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_behaviour", 2024-09-19T05:29:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "default", 2024-09-19T05:29:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "default", 2024-09-19T05:29:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "error" 2024-09-19T05:29:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_error_status_code": { 2024-09-19T05:29:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_error_status_code", 2024-09-19T05:29:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "500", 2024-09-19T05:29:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "400", 2024-09-19T05:29:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "599", 2024-09-19T05:29:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_support", 2024-09-19T05:29:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "max_concurrent_snap_create": { 2024-09-19T05:29:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_concurrent_snap_create", 2024-09-19T05:29:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-09-19T05:29:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "mirror_snapshot_schedule": { 2024-09-19T05:29:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T05:29:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "trash_purge_schedule": { 2024-09-19T05:29:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "trash_purge_schedule", 2024-09-19T05:29:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "restful", 2024-09-19T05:29:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "enable_auth": { 2024-09-19T05:29:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enable_auth", 2024-09-19T05:29:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "key_file": { 2024-09-19T05:29:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "key_file", 2024-09-19T05:29:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2024-09-19T05:29:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2024-09-19T05:29:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2024-09-19T05:29:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2024-09-19T05:29:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rgw", 2024-09-19T05:29:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T05:29:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T05:29:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-09-19T05:29:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T05:29:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rook", 2024-09-19T05:29:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "storage_class": { 2024-09-19T05:29:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "storage_class", 2024-09-19T05:29:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "local", 2024-09-19T05:29:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T05:29:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "selftest", 2024-09-19T05:29:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.116 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.116 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.116 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.116 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.116 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.116 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.116 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.116 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.116 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.116 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.117 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.117 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.117 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.117 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.117 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.117 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.117 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.117 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.117 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.117 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.117 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.117 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.117 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.118 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.118 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.118 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.118 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.118 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.118 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.118 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.118 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.118 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.118 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.118 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.118 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.118 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.118 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.119 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.119 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.119 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.119 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.119 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.119 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.119 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.119 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.119 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.119 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.119 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.119 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.119 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.120 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.120 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.120 INFO:teuthology.orchestra.run.smithi120.stdout: "roption1": { 2024-09-19T05:29:31.120 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "roption1", 2024-09-19T05:29:31.120 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.120 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.120 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.120 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.120 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.120 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.120 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.120 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.120 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.121 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.121 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.121 INFO:teuthology.orchestra.run.smithi120.stdout: "roption2": { 2024-09-19T05:29:31.121 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "roption2", 2024-09-19T05:29:31.121 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.121 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.121 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.121 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "xyz", 2024-09-19T05:29:31.121 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.121 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.121 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.121 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.121 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption1": { 2024-09-19T05:29:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption1", 2024-09-19T05:29:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.122 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.123 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.123 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.123 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.123 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption2": { 2024-09-19T05:29:31.123 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption2", 2024-09-19T05:29:31.123 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.123 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.123 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.123 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.123 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.123 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.123 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption3": { 2024-09-19T05:29:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption3", 2024-09-19T05:29:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-09-19T05:29:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.124 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption4": { 2024-09-19T05:29:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption4", 2024-09-19T05:29:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.125 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption5": { 2024-09-19T05:29:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption5", 2024-09-19T05:29:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.126 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.127 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.127 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.127 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.127 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.127 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.127 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.127 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption6": { 2024-09-19T05:29:31.127 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption6", 2024-09-19T05:29:31.127 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.127 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.127 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption7": { 2024-09-19T05:29:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption7", 2024-09-19T05:29:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.128 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2024-09-19T05:29:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "42", 2024-09-19T05:29:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: "testkey": { 2024-09-19T05:29:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testkey", 2024-09-19T05:29:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.129 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: "testlkey": { 2024-09-19T05:29:31.130 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testlkey", 2024-09-19T05:29:31.131 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.131 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.131 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.131 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.131 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.131 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.131 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.131 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.131 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.131 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.131 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.131 INFO:teuthology.orchestra.run.smithi120.stdout: "testnewline": { 2024-09-19T05:29:31.132 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testnewline", 2024-09-19T05:29:31.132 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.132 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.132 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.132 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.132 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.132 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.132 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.132 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.132 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.132 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.132 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.132 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.132 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.133 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "snap_schedule", 2024-09-19T05:29:31.133 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.133 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.133 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.133 INFO:teuthology.orchestra.run.smithi120.stdout: "allow_m_granularity": { 2024-09-19T05:29:31.133 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "allow_m_granularity", 2024-09-19T05:29:31.133 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.133 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.133 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.133 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.133 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.133 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.133 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T05:29:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: "dump_on_update": { 2024-09-19T05:29:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "dump_on_update", 2024-09-19T05:29:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.134 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "dump database to debug log on update", 2024-09-19T05:29:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.135 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.136 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.137 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.137 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.137 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.137 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.137 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.137 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.137 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.137 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.137 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.137 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.137 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.137 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.137 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.138 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.138 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.138 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.138 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.138 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.138 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.138 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.138 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.138 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.138 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.138 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.138 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.138 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.138 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.138 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.139 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.139 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.139 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.139 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.139 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.139 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.139 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.139 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.139 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.139 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.139 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.139 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.139 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.140 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.140 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.140 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.140 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.140 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.140 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.140 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "stats", 2024-09-19T05:29:31.140 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.140 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.140 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.140 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.141 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.141 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.141 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.141 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.141 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.141 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.141 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.141 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.141 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.141 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.141 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.141 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.141 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.141 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.142 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.143 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.144 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.144 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.144 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.144 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.144 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.144 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.144 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.144 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.144 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.144 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.144 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.144 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.145 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "status", 2024-09-19T05:29:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.146 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.147 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.148 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.149 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.149 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.149 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.149 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.149 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.149 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.149 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.149 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.149 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.149 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.149 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.149 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.149 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.149 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.150 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "telegraf", 2024-09-19T05:29:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.151 INFO:teuthology.orchestra.run.smithi120.stdout: "address": { 2024-09-19T05:29:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "address", 2024-09-19T05:29:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T05:29:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-09-19T05:29:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-09-19T05:29:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15", 2024-09-19T05:29:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.154 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.155 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.155 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.155 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.155 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.155 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.155 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.155 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.155 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.155 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.155 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.155 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.156 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.157 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.158 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "telemetry", 2024-09-19T05:29:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.159 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_basic": { 2024-09-19T05:29:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_basic", 2024-09-19T05:29:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T05:29:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_crash": { 2024-09-19T05:29:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_crash", 2024-09-19T05:29:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T05:29:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_device": { 2024-09-19T05:29:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_device", 2024-09-19T05:29:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T05:29:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_ident": { 2024-09-19T05:29:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_ident", 2024-09-19T05:29:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T05:29:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.163 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_perf": { 2024-09-19T05:29:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_perf", 2024-09-19T05:29:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T05:29:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.164 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: "contact": { 2024-09-19T05:29:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "contact", 2024-09-19T05:29:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.165 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: "description": { 2024-09-19T05:29:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "description", 2024-09-19T05:29:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.166 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: "device_url": { 2024-09-19T05:29:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "device_url", 2024-09-19T05:29:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T05:29:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.167 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": { 2024-09-19T05:29:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enabled", 2024-09-19T05:29:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.168 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-09-19T05:29:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-09-19T05:29:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "24", 2024-09-19T05:29:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "8", 2024-09-19T05:29:31.169 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: "last_opt_revision": { 2024-09-19T05:29:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "last_opt_revision", 2024-09-19T05:29:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1", 2024-09-19T05:29:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.170 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: "leaderboard": { 2024-09-19T05:29:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "leaderboard", 2024-09-19T05:29:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.171 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: "leaderboard_description": { 2024-09-19T05:29:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "leaderboard_description", 2024-09-19T05:29:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.172 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.173 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.174 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.175 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.176 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.177 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.177 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.177 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.177 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.177 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.177 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.177 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.177 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.177 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.177 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.177 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.177 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.177 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.178 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.178 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.178 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.178 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.178 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.178 INFO:teuthology.orchestra.run.smithi120.stdout: "organization": { 2024-09-19T05:29:31.178 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "organization", 2024-09-19T05:29:31.178 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.178 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.178 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.178 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.178 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.178 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: "proxy": { 2024-09-19T05:29:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "proxy", 2024-09-19T05:29:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.179 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.180 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.180 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.180 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.180 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.180 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.180 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.180 INFO:teuthology.orchestra.run.smithi120.stdout: "url": { 2024-09-19T05:29:31.180 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "url", 2024-09-19T05:29:31.180 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.180 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.180 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.180 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T05:29:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "test_orchestrator", 2024-09-19T05:29:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.181 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.182 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.183 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.184 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.185 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.186 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "volumes", 2024-09-19T05:29:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.187 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.188 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.189 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.190 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.191 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.191 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.191 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.191 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.191 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.191 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.191 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.191 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.191 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.191 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.191 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.192 INFO:teuthology.orchestra.run.smithi120.stdout: "max_concurrent_clones": { 2024-09-19T05:29:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_concurrent_clones", 2024-09-19T05:29:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "4", 2024-09-19T05:29:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T05:29:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: "periodic_async_work": { 2024-09-19T05:29:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "periodic_async_work", 2024-09-19T05:29:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Periodically check for async work", 2024-09-19T05:29:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.194 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: "snapshot_clone_delay": { 2024-09-19T05:29:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "snapshot_clone_delay", 2024-09-19T05:29:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-09-19T05:29:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T05:29:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.195 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: "snapshot_clone_no_wait": { 2024-09-19T05:29:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T05:29:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T05:29:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.196 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix", 2024-09-19T05:29:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: "discovery_interval": { 2024-09-19T05:29:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "discovery_interval", 2024-09-19T05:29:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-09-19T05:29:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.197 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "100", 2024-09-19T05:29:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: "identifier": { 2024-09-19T05:29:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "identifier", 2024-09-19T05:29:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.198 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-09-19T05:29:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-09-19T05:29:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:31.199 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-09-19T05:29:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.200 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.201 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.202 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.202 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.202 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.202 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.202 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.202 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.202 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.202 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.202 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.202 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.202 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.203 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.203 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.203 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.203 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.203 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.203 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.203 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.203 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.203 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.203 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.203 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.204 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.204 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.204 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.204 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.204 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.204 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.204 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.204 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.204 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.204 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.204 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.205 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.206 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.206 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.206 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.206 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.206 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_host": { 2024-09-19T05:29:31.206 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_host", 2024-09-19T05:29:31.206 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.206 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.206 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.206 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.206 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.206 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.206 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_port": { 2024-09-19T05:29:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_port", 2024-09-19T05:29:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10051", 2024-09-19T05:29:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.207 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.208 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.208 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.208 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.208 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.208 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_sender": { 2024-09-19T05:29:31.208 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_sender", 2024-09-19T05:29:31.208 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.208 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.208 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.208 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T05:29:31.208 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.208 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-19T05:29:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: "modules": [ 2024-09-19T05:29:31.209 INFO:teuthology.orchestra.run.smithi120.stdout: "cephadm", 2024-09-19T05:29:31.210 INFO:teuthology.orchestra.run.smithi120.stdout: "dashboard", 2024-09-19T05:29:31.210 INFO:teuthology.orchestra.run.smithi120.stdout: "iostat", 2024-09-19T05:29:31.210 INFO:teuthology.orchestra.run.smithi120.stdout: "nfs", 2024-09-19T05:29:31.210 INFO:teuthology.orchestra.run.smithi120.stdout: "restful", 2024-09-19T05:29:31.210 INFO:teuthology.orchestra.run.smithi120.stdout: "snap_schedule" 2024-09-19T05:29:31.210 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.210 INFO:teuthology.orchestra.run.smithi120.stdout: "available_modules": [ 2024-09-19T05:29:31.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.210 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "alerts", 2024-09-19T05:29:31.210 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.210 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.210 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.210 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-09-19T05:29:31.210 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-09-19T05:29:31.211 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:31.211 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.211 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.211 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-09-19T05:29:31.211 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.211 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.211 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.211 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T05:29:31.211 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.211 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.211 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.211 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.211 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.212 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.212 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.212 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.212 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.212 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.212 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.212 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.212 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.212 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.212 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.212 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.212 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.212 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.212 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.213 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.213 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.213 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.213 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.213 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.213 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.213 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.213 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.213 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.213 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.213 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.213 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.213 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.214 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.215 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.216 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_destination": { 2024-09-19T05:29:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_destination", 2024-09-19T05:29:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Email address to send alerts to", 2024-09-19T05:29:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.217 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_from_name": { 2024-09-19T05:29:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_from_name", 2024-09-19T05:29:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "Ceph", 2024-09-19T05:29:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Email From: name", 2024-09-19T05:29:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_host": { 2024-09-19T05:29:31.218 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_host", 2024-09-19T05:29:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP server", 2024-09-19T05:29:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_password": { 2024-09-19T05:29:31.219 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_password", 2024-09-19T05:29:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Password to authenticate with", 2024-09-19T05:29:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_port": { 2024-09-19T05:29:31.220 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_port", 2024-09-19T05:29:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "465", 2024-09-19T05:29:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP port", 2024-09-19T05:29:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_sender": { 2024-09-19T05:29:31.221 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_sender", 2024-09-19T05:29:31.222 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.222 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.222 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.222 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.222 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.222 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.222 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.222 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SMTP envelope sender", 2024-09-19T05:29:31.222 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.222 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.222 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.222 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_ssl": { 2024-09-19T05:29:31.222 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_ssl", 2024-09-19T05:29:31.223 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.223 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.223 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.223 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.223 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.223 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.223 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.223 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T05:29:31.223 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.223 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.223 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.223 INFO:teuthology.orchestra.run.smithi120.stdout: "smtp_user": { 2024-09-19T05:29:31.223 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "smtp_user", 2024-09-19T05:29:31.224 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.224 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.224 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.224 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.224 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.224 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.224 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.224 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "User to authenticate as", 2024-09-19T05:29:31.224 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.224 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.224 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.224 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.224 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.225 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "balancer", 2024-09-19T05:29:31.225 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.225 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.225 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.225 INFO:teuthology.orchestra.run.smithi120.stdout: "active": { 2024-09-19T05:29:31.225 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "active", 2024-09-19T05:29:31.225 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.225 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.225 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.225 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.225 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.225 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.225 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.226 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T05:29:31.226 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.226 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.226 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.226 INFO:teuthology.orchestra.run.smithi120.stdout: "begin_time": { 2024-09-19T05:29:31.226 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "begin_time", 2024-09-19T05:29:31.226 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.226 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.226 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.226 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0000", 2024-09-19T05:29:31.226 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.226 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.226 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.227 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T05:29:31.227 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T05:29:31.227 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.227 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.227 INFO:teuthology.orchestra.run.smithi120.stdout: "begin_weekday": { 2024-09-19T05:29:31.227 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "begin_weekday", 2024-09-19T05:29:31.227 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-09-19T05:29:31.227 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.227 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.227 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-09-19T05:29:31.227 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0", 2024-09-19T05:29:31.227 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "6", 2024-09-19T05:29:31.227 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.228 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T05:29:31.228 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T05:29:31.228 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.228 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.228 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_max_iterations": { 2024-09-19T05:29:31.228 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_max_iterations", 2024-09-19T05:29:31.228 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-09-19T05:29:31.228 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.228 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.228 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "25", 2024-09-19T05:29:31.228 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2024-09-19T05:29:31.228 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "250", 2024-09-19T05:29:31.228 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.229 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T05:29:31.229 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.229 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.229 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.229 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_metrics": { 2024-09-19T05:29:31.229 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_metrics", 2024-09-19T05:29:31.229 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.229 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.229 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.229 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T05:29:31.229 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.229 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.229 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.230 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T05:29:31.230 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T05:29:31.230 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.230 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.230 INFO:teuthology.orchestra.run.smithi120.stdout: "crush_compat_step": { 2024-09-19T05:29:31.230 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crush_compat_step", 2024-09-19T05:29:31.231 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-09-19T05:29:31.232 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.232 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.232 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0.5", 2024-09-19T05:29:31.232 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0.001", 2024-09-19T05:29:31.232 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "0.999", 2024-09-19T05:29:31.232 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.232 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "aggressiveness of optimization", 2024-09-19T05:29:31.232 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T05:29:31.232 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.232 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.232 INFO:teuthology.orchestra.run.smithi120.stdout: "end_time": { 2024-09-19T05:29:31.232 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "end_time", 2024-09-19T05:29:31.233 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.233 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.233 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.233 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "2359", 2024-09-19T05:29:31.233 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.233 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.233 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.233 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T05:29:31.233 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T05:29:31.233 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.233 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.233 INFO:teuthology.orchestra.run.smithi120.stdout: "end_weekday": { 2024-09-19T05:29:31.233 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "end_weekday", 2024-09-19T05:29:31.234 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-09-19T05:29:31.234 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.234 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.234 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-09-19T05:29:31.234 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "0", 2024-09-19T05:29:31.234 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "6", 2024-09-19T05:29:31.234 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.234 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T05:29:31.234 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T05:29:31.234 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.234 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.234 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.234 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.235 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.235 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.235 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.235 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.235 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.235 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.235 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.235 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.235 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.235 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.235 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.235 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.235 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.235 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.236 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.236 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.236 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.236 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.236 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.236 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.236 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.236 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.236 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.236 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.236 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.236 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.237 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.237 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.237 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.237 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.237 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.237 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.237 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.237 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.237 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.237 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.237 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.237 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.237 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.237 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.238 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.238 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.238 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.238 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.238 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.238 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.238 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.238 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.238 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.238 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.238 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.238 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.239 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.239 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.239 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.239 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.239 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.239 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.239 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.239 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.239 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.239 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.239 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.239 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.239 INFO:teuthology.orchestra.run.smithi120.stdout: "min_score": { 2024-09-19T05:29:31.240 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "min_score", 2024-09-19T05:29:31.240 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-09-19T05:29:31.240 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.240 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.240 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-09-19T05:29:31.240 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.240 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.240 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.240 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T05:29:31.240 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.240 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.240 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.240 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": { 2024-09-19T05:29:31.241 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mode", 2024-09-19T05:29:31.241 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.241 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.241 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.241 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "upmap", 2024-09-19T05:29:31.241 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.241 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.241 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.241 INFO:teuthology.orchestra.run.smithi120.stdout: "crush-compat", 2024-09-19T05:29:31.241 INFO:teuthology.orchestra.run.smithi120.stdout: "none", 2024-09-19T05:29:31.241 INFO:teuthology.orchestra.run.smithi120.stdout: "read", 2024-09-19T05:29:31.241 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap", 2024-09-19T05:29:31.241 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap-read" 2024-09-19T05:29:31.242 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.242 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Balancer mode", 2024-09-19T05:29:31.242 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.242 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.242 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.242 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_ids": { 2024-09-19T05:29:31.242 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pool_ids", 2024-09-19T05:29:31.242 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.242 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.242 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.242 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.242 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.242 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.242 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.243 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T05:29:31.243 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.243 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.243 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.243 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-09-19T05:29:31.243 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-09-19T05:29:31.243 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:31.243 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.243 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.243 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-09-19T05:29:31.243 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.243 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.243 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.244 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T05:29:31.244 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.244 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.244 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.244 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap_max_deviation": { 2024-09-19T05:29:31.244 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "upmap_max_deviation", 2024-09-19T05:29:31.244 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.244 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.244 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.244 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-09-19T05:29:31.244 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2024-09-19T05:29:31.244 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.244 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.245 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T05:29:31.245 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T05:29:31.245 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.245 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.245 INFO:teuthology.orchestra.run.smithi120.stdout: "upmap_max_optimizations": { 2024-09-19T05:29:31.245 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "upmap_max_optimizations", 2024-09-19T05:29:31.245 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-09-19T05:29:31.245 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.245 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.245 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-09-19T05:29:31.245 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.245 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.245 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.246 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T05:29:31.246 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.246 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.246 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.246 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.246 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.246 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cephadm", 2024-09-19T05:29:31.246 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.246 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.246 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.246 INFO:teuthology.orchestra.run.smithi120.stdout: "agent_down_multiplier": { 2024-09-19T05:29:31.246 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "agent_down_multiplier", 2024-09-19T05:29:31.247 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-09-19T05:29:31.247 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.247 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.247 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "3.0", 2024-09-19T05:29:31.247 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.247 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.247 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.247 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T05:29:31.247 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.247 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.247 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.247 INFO:teuthology.orchestra.run.smithi120.stdout: "agent_refresh_rate": { 2024-09-19T05:29:31.247 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "agent_refresh_rate", 2024-09-19T05:29:31.248 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:31.248 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.248 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.248 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "20", 2024-09-19T05:29:31.248 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.248 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.248 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.248 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T05:29:31.248 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.248 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.248 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.248 INFO:teuthology.orchestra.run.smithi120.stdout: "agent_starting_port": { 2024-09-19T05:29:31.248 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "agent_starting_port", 2024-09-19T05:29:31.249 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.249 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.249 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.249 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "4721", 2024-09-19T05:29:31.249 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.249 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.249 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.249 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T05:29:31.249 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.249 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.249 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.249 INFO:teuthology.orchestra.run.smithi120.stdout: "allow_ptrace": { 2024-09-19T05:29:31.249 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "allow_ptrace", 2024-09-19T05:29:31.249 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.250 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.250 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.250 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.250 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.250 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.250 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.250 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T05:29:31.250 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T05:29:31.250 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.250 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.250 INFO:teuthology.orchestra.run.smithi120.stdout: "autotune_interval": { 2024-09-19T05:29:31.251 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "autotune_interval", 2024-09-19T05:29:31.251 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:31.251 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.251 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.251 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-09-19T05:29:31.251 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.251 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.251 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.251 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T05:29:31.251 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.251 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.251 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.252 INFO:teuthology.orchestra.run.smithi120.stdout: "autotune_memory_target_ratio": { 2024-09-19T05:29:31.252 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T05:29:31.252 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-09-19T05:29:31.252 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.252 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.252 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0.7", 2024-09-19T05:29:31.252 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.252 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.252 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.252 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T05:29:31.252 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.252 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.252 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.253 INFO:teuthology.orchestra.run.smithi120.stdout: "cephadm_log_destination": { 2024-09-19T05:29:31.253 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cephadm_log_destination", 2024-09-19T05:29:31.253 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.253 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.253 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.253 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.253 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.253 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.253 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.253 INFO:teuthology.orchestra.run.smithi120.stdout: "file", 2024-09-19T05:29:31.253 INFO:teuthology.orchestra.run.smithi120.stdout: "file,syslog", 2024-09-19T05:29:31.253 INFO:teuthology.orchestra.run.smithi120.stdout: "syslog" 2024-09-19T05:29:31.253 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.254 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T05:29:31.254 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.254 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.254 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.254 INFO:teuthology.orchestra.run.smithi120.stdout: "cgroups_split": { 2024-09-19T05:29:31.254 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cgroups_split", 2024-09-19T05:29:31.254 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.254 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.254 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.254 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.254 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.254 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.254 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.254 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T05:29:31.255 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.255 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.255 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.255 INFO:teuthology.orchestra.run.smithi120.stdout: "config_checks_enabled": { 2024-09-19T05:29:31.255 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "config_checks_enabled", 2024-09-19T05:29:31.255 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.255 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.255 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.255 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.255 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.255 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.256 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.256 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T05:29:31.256 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.256 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.256 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.256 INFO:teuthology.orchestra.run.smithi120.stdout: "config_dashboard": { 2024-09-19T05:29:31.256 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "config_dashboard", 2024-09-19T05:29:31.256 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.256 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.256 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.256 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.256 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.256 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.257 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.257 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T05:29:31.257 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.257 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.257 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.257 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_alertmanager": { 2024-09-19T05:29:31.257 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_alertmanager", 2024-09-19T05:29:31.257 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.257 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.257 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.257 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T05:29:31.257 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.257 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.258 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.258 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Prometheus container image", 2024-09-19T05:29:31.258 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.258 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.258 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.258 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_base": { 2024-09-19T05:29:31.258 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_base", 2024-09-19T05:29:31.258 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.258 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.258 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.258 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T05:29:31.258 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.258 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.259 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.259 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Container image name, without the tag", 2024-09-19T05:29:31.259 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.259 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.259 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.259 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_elasticsearch": { 2024-09-19T05:29:31.259 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_elasticsearch", 2024-09-19T05:29:31.259 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.259 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.259 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.259 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T05:29:31.259 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.259 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.260 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.260 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "elasticsearch container image", 2024-09-19T05:29:31.260 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.260 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.260 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.260 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_grafana": { 2024-09-19T05:29:31.260 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_grafana", 2024-09-19T05:29:31.260 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.260 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.260 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.260 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T05:29:31.260 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.261 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.261 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.261 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Prometheus container image", 2024-09-19T05:29:31.261 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.261 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.261 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.261 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_haproxy": { 2024-09-19T05:29:31.261 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_haproxy", 2024-09-19T05:29:31.261 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.261 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.261 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.262 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T05:29:31.262 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.262 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.262 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.262 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "HAproxy container image", 2024-09-19T05:29:31.262 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.262 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.262 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.262 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_jaeger_agent": { 2024-09-19T05:29:31.262 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_jaeger_agent", 2024-09-19T05:29:31.262 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.263 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.263 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.263 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T05:29:31.263 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.263 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.263 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.263 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Jaeger agent container image", 2024-09-19T05:29:31.263 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.263 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.263 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.263 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_jaeger_collector": { 2024-09-19T05:29:31.263 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_jaeger_collector", 2024-09-19T05:29:31.263 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.264 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.264 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.264 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T05:29:31.264 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.264 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.264 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.264 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Jaeger collector container image", 2024-09-19T05:29:31.264 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.264 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.264 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.264 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_jaeger_query": { 2024-09-19T05:29:31.264 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_jaeger_query", 2024-09-19T05:29:31.265 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.265 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.265 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.265 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T05:29:31.265 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.265 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.265 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.265 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Jaeger query container image", 2024-09-19T05:29:31.265 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.265 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.265 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.266 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_keepalived": { 2024-09-19T05:29:31.266 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_keepalived", 2024-09-19T05:29:31.266 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.266 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.266 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.266 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T05:29:31.266 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.266 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.266 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.266 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Keepalived container image", 2024-09-19T05:29:31.266 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.266 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.266 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.267 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_loki": { 2024-09-19T05:29:31.267 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_loki", 2024-09-19T05:29:31.267 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.267 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.267 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.267 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T05:29:31.267 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.267 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.267 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.267 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Loki container image", 2024-09-19T05:29:31.267 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.267 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.267 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.268 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_node_exporter": { 2024-09-19T05:29:31.268 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_node_exporter", 2024-09-19T05:29:31.268 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.268 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.268 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.268 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T05:29:31.268 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.268 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.268 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.268 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Prometheus container image", 2024-09-19T05:29:31.268 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.268 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.268 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.269 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_nvmeof": { 2024-09-19T05:29:31.269 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_nvmeof", 2024-09-19T05:29:31.269 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.269 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.269 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.269 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T05:29:31.269 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.269 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.269 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.269 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Nvme-of container image", 2024-09-19T05:29:31.269 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.269 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.269 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.270 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_prometheus": { 2024-09-19T05:29:31.270 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_prometheus", 2024-09-19T05:29:31.270 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.270 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.270 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.270 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T05:29:31.270 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.270 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.270 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.270 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Prometheus container image", 2024-09-19T05:29:31.270 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.270 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.270 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.271 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_promtail": { 2024-09-19T05:29:31.271 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_promtail", 2024-09-19T05:29:31.271 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.271 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.271 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.271 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T05:29:31.271 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.271 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.271 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.271 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Promtail container image", 2024-09-19T05:29:31.271 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.271 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.271 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.272 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_samba": { 2024-09-19T05:29:31.272 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_samba", 2024-09-19T05:29:31.272 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.272 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.272 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.272 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T05:29:31.272 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.272 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.272 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.272 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Samba/SMB container image", 2024-09-19T05:29:31.272 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.272 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.272 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.273 INFO:teuthology.orchestra.run.smithi120.stdout: "container_image_snmp_gateway": { 2024-09-19T05:29:31.273 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_image_snmp_gateway", 2024-09-19T05:29:31.273 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.273 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.273 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.273 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T05:29:31.273 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.273 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.273 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.273 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "SNMP Gateway container image", 2024-09-19T05:29:31.273 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.273 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.273 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.274 INFO:teuthology.orchestra.run.smithi120.stdout: "container_init": { 2024-09-19T05:29:31.274 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "container_init", 2024-09-19T05:29:31.274 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.274 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.274 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.274 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.274 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.274 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.274 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.274 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T05:29:31.274 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.274 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.274 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.275 INFO:teuthology.orchestra.run.smithi120.stdout: "daemon_cache_timeout": { 2024-09-19T05:29:31.275 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "daemon_cache_timeout", 2024-09-19T05:29:31.275 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:31.275 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.275 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.275 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-09-19T05:29:31.275 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.275 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.275 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.275 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T05:29:31.275 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.275 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.275 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.276 INFO:teuthology.orchestra.run.smithi120.stdout: "default_cephadm_command_timeout": { 2024-09-19T05:29:31.276 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T05:29:31.276 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.276 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.276 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.276 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "900", 2024-09-19T05:29:31.276 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.276 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.276 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.276 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T05:29:31.276 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.276 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.276 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: "default_registry": { 2024-09-19T05:29:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "default_registry", 2024-09-19T05:29:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "docker.io", 2024-09-19T05:29:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T05:29:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.277 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: "device_cache_timeout": { 2024-09-19T05:29:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "device_cache_timeout", 2024-09-19T05:29:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1800", 2024-09-19T05:29:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "seconds to cache device inventory", 2024-09-19T05:29:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: "device_enhanced_scan": { 2024-09-19T05:29:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "device_enhanced_scan", 2024-09-19T05:29:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T05:29:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.279 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: "facts_cache_timeout": { 2024-09-19T05:29:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "facts_cache_timeout", 2024-09-19T05:29:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-09-19T05:29:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "seconds to cache host facts data", 2024-09-19T05:29:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.280 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: "grafana_dashboards_path": { 2024-09-19T05:29:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "grafana_dashboards_path", 2024-09-19T05:29:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T05:29:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T05:29:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.281 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: "host_check_interval": { 2024-09-19T05:29:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "host_check_interval", 2024-09-19T05:29:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-09-19T05:29:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to perform a host check", 2024-09-19T05:29:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.282 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: "hw_monitoring": { 2024-09-19T05:29:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "hw_monitoring", 2024-09-19T05:29:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T05:29:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.283 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: "inventory_list_all": { 2024-09-19T05:29:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "inventory_list_all", 2024-09-19T05:29:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T05:29:31.284 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.285 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: "log_refresh_metadata": { 2024-09-19T05:29:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_refresh_metadata", 2024-09-19T05:29:31.286 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T05:29:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.287 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.288 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.288 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.288 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.288 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.288 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.288 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.288 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T05:29:31.288 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.288 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.288 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.288 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.289 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.290 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T05:29:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T05:29:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.291 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T05:29:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T05:29:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T05:29:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.292 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "*", 2024-09-19T05:29:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T05:29:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: "max_count_per_host": { 2024-09-19T05:29:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_count_per_host", 2024-09-19T05:29:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.293 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-09-19T05:29:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "max number of daemons per service per host", 2024-09-19T05:29:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: "max_osd_draining_count": { 2024-09-19T05:29:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_osd_draining_count", 2024-09-19T05:29:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.294 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-09-19T05:29:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T05:29:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: "migration_current": { 2024-09-19T05:29:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "migration_current", 2024-09-19T05:29:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.295 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.296 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.296 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.296 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.296 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.296 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "internal - do not modify", 2024-09-19T05:29:31.296 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.296 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.296 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.296 INFO:teuthology.orchestra.run.smithi120.stdout: "mode": { 2024-09-19T05:29:31.296 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mode", 2024-09-19T05:29:31.296 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.297 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.297 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.297 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "root", 2024-09-19T05:29:31.297 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.297 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.297 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.297 INFO:teuthology.orchestra.run.smithi120.stdout: "cephadm-package", 2024-09-19T05:29:31.297 INFO:teuthology.orchestra.run.smithi120.stdout: "root" 2024-09-19T05:29:31.297 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.297 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T05:29:31.297 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.297 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.297 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: "oob_default_addr": { 2024-09-19T05:29:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "oob_default_addr", 2024-09-19T05:29:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "169.254.1.1", 2024-09-19T05:29:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T05:29:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.298 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.299 INFO:teuthology.orchestra.run.smithi120.stdout: "prometheus_alerts_path": { 2024-09-19T05:29:31.299 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prometheus_alerts_path", 2024-09-19T05:29:31.299 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.299 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.299 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.299 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T05:29:31.299 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.299 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.299 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.299 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T05:29:31.299 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.299 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: "registry_insecure": { 2024-09-19T05:29:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "registry_insecure", 2024-09-19T05:29:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T05:29:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.300 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.301 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.301 INFO:teuthology.orchestra.run.smithi120.stdout: "registry_password": { 2024-09-19T05:29:31.301 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "registry_password", 2024-09-19T05:29:31.301 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.301 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.301 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.301 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.301 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.301 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.301 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.301 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T05:29:31.301 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: "registry_url": { 2024-09-19T05:29:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "registry_url", 2024-09-19T05:29:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.302 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T05:29:31.303 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.303 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.303 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.303 INFO:teuthology.orchestra.run.smithi120.stdout: "registry_username": { 2024-09-19T05:29:31.303 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "registry_username", 2024-09-19T05:29:31.303 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.303 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.303 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.303 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.303 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.303 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.303 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.303 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T05:29:31.304 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.304 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.304 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.304 INFO:teuthology.orchestra.run.smithi120.stdout: "secure_monitoring_stack": { 2024-09-19T05:29:31.304 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "secure_monitoring_stack", 2024-09-19T05:29:31.304 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.304 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.304 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.304 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.304 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.304 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.304 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.304 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T05:29:31.305 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.305 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.305 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.305 INFO:teuthology.orchestra.run.smithi120.stdout: "service_discovery_port": { 2024-09-19T05:29:31.305 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "service_discovery_port", 2024-09-19T05:29:31.305 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.305 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.305 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.305 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8765", 2024-09-19T05:29:31.305 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.305 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.305 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.305 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "cephadm service discovery port", 2024-09-19T05:29:31.306 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.306 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.306 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.306 INFO:teuthology.orchestra.run.smithi120.stdout: "ssh_config_file": { 2024-09-19T05:29:31.306 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssh_config_file", 2024-09-19T05:29:31.306 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.306 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.306 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.306 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.306 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.306 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.306 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.306 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T05:29:31.307 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.307 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.307 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.307 INFO:teuthology.orchestra.run.smithi120.stdout: "use_agent": { 2024-09-19T05:29:31.307 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "use_agent", 2024-09-19T05:29:31.307 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.307 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.307 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.307 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.307 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.307 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.307 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.307 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T05:29:31.308 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.308 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.308 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.308 INFO:teuthology.orchestra.run.smithi120.stdout: "use_repo_digest": { 2024-09-19T05:29:31.308 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "use_repo_digest", 2024-09-19T05:29:31.308 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.308 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.308 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.308 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.308 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.308 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.308 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.308 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T05:29:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_on_failed_host_check": { 2024-09-19T05:29:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_on_failed_host_check", 2024-09-19T05:29:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.309 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T05:29:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_on_stray_daemons": { 2024-09-19T05:29:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_on_stray_daemons", 2024-09-19T05:29:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.310 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T05:29:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_on_stray_hosts": { 2024-09-19T05:29:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_on_stray_hosts", 2024-09-19T05:29:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.311 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T05:29:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crash", 2024-09-19T05:29:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.312 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.313 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.314 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.315 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.315 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.315 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.315 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.315 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.315 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.315 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.315 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.315 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.315 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.315 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.315 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: "retain_interval": { 2024-09-19T05:29:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "retain_interval", 2024-09-19T05:29:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "31536000", 2024-09-19T05:29:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T05:29:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_recent_interval": { 2024-09-19T05:29:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_recent_interval", 2024-09-19T05:29:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1209600", 2024-09-19T05:29:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T05:29:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.319 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "dashboard", 2024-09-19T05:29:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T05:29:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T05:29:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.320 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-09-19T05:29:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T05:29:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T05:29:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.321 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T05:29:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T05:29:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.322 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: "AUDIT_API_ENABLED": { 2024-09-19T05:29:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T05:29:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.323 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T05:29:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T05:29:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.324 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T05:29:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T05:29:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.325 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T05:29:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T05:29:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.326 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T05:29:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T05:29:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.327 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T05:29:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T05:29:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.328 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.329 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.329 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.329 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.329 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.329 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.329 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.329 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.329 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.329 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T05:29:31.329 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T05:29:31.329 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.329 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.329 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.329 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T05:29:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T05:29:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.330 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T05:29:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T05:29:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.331 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.332 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.332 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.332 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.332 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.332 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.332 INFO:teuthology.orchestra.run.smithi120.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T05:29:31.332 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T05:29:31.332 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.332 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.332 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.332 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.332 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.332 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.333 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.333 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.333 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.333 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.333 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.333 INFO:teuthology.orchestra.run.smithi120.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T05:29:31.333 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T05:29:31.333 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.333 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.333 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.333 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.334 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.334 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.334 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.334 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.334 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.334 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.334 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.334 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T05:29:31.334 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T05:29:31.334 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.334 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2024-09-19T05:29:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T05:29:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T05:29:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.335 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_URL": { 2024-09-19T05:29:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_URL", 2024-09-19T05:29:31.336 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.337 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.337 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.337 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.337 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.337 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.337 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.337 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.337 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.337 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.337 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.337 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T05:29:31.337 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T05:29:31.338 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.338 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.338 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.338 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2024-09-19T05:29:31.338 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.338 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.338 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.338 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.338 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.338 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.338 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.338 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T05:29:31.338 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T05:29:31.339 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.339 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.339 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.339 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.339 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.339 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.339 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.339 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.339 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.339 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.339 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.339 INFO:teuthology.orchestra.run.smithi120.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T05:29:31.339 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T05:29:31.340 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.340 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.340 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.340 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.340 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.340 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.340 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.340 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.340 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.340 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.340 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.340 INFO:teuthology.orchestra.run.smithi120.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T05:29:31.340 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T05:29:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.341 INFO:teuthology.orchestra.run.smithi120.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T05:29:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T05:29:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.342 INFO:teuthology.orchestra.run.smithi120.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T05:29:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T05:29:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.343 INFO:teuthology.orchestra.run.smithi120.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T05:29:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T05:29:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.345 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T05:29:31.345 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T05:29:31.345 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.345 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.345 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.345 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.345 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.345 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.345 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.345 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.345 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.345 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.345 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.346 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T05:29:31.346 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T05:29:31.346 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.346 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.346 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.346 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.346 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.346 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.346 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.346 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.346 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.346 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.346 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T05:29:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T05:29:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.347 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.348 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.348 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T05:29:31.348 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T05:29:31.348 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.348 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.348 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.348 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.348 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.348 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.348 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.348 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.348 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T05:29:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T05:29:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.349 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T05:29:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T05:29:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.350 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T05:29:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T05:29:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.351 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.352 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.352 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.352 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.352 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.352 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.352 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T05:29:31.352 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T05:29:31.352 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.352 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.352 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.352 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.352 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T05:29:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T05:29:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.353 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T05:29:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T05:29:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T05:29:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.354 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-09-19T05:29:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T05:29:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T05:29:31.355 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.356 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.356 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.356 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8", 2024-09-19T05:29:31.356 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.356 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.356 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.356 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.356 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.356 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.356 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T05:29:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T05:29:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "45", 2024-09-19T05:29:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.357 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T05:29:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T05:29:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.358 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.359 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.359 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.359 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T05:29:31.359 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T05:29:31.359 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.359 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.359 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.359 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "admin", 2024-09-19T05:29:31.359 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.359 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.359 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T05:29:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T05:29:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.360 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T05:29:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T05:29:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.361 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.362 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.362 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.362 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.362 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.362 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.362 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.363 INFO:teuthology.orchestra.run.smithi120.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T05:29:31.363 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T05:29:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-09-19T05:29:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.364 INFO:teuthology.orchestra.run.smithi120.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T05:29:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T05:29:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-09-19T05:29:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T05:29:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T05:29:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-09-19T05:29:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.367 INFO:teuthology.orchestra.run.smithi120.stdout: "cross_origin_url": { 2024-09-19T05:29:31.367 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cross_origin_url", 2024-09-19T05:29:31.367 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.367 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.367 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.367 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.367 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.367 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.367 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.367 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.367 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.367 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.367 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.367 INFO:teuthology.orchestra.run.smithi120.stdout: "crt_file": { 2024-09-19T05:29:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "crt_file", 2024-09-19T05:29:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.369 INFO:teuthology.orchestra.run.smithi120.stdout: "debug": { 2024-09-19T05:29:31.369 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "debug", 2024-09-19T05:29:31.369 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.369 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.369 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.369 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.369 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.369 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.369 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.369 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Enable/disable debug options", 2024-09-19T05:29:31.369 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: "jwt_token_ttl": { 2024-09-19T05:29:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "jwt_token_ttl", 2024-09-19T05:29:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "28800", 2024-09-19T05:29:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.370 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.371 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.371 INFO:teuthology.orchestra.run.smithi120.stdout: "key_file": { 2024-09-19T05:29:31.371 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "key_file", 2024-09-19T05:29:31.371 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.371 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.371 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.371 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.371 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.371 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.371 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.371 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.371 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.372 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.372 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.372 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.372 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.372 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.372 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.372 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.372 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.372 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.372 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.372 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.372 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.373 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.373 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.373 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.373 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.373 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.373 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.373 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.373 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.373 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.373 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.373 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.373 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.373 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.374 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.374 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.374 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.374 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.374 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.374 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.374 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.374 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.374 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.374 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.374 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.374 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.375 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.375 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.375 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.375 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.375 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.375 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.375 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.375 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.375 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.375 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.375 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.375 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.375 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.376 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.376 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.376 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.376 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.376 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.376 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.376 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.376 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.376 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.376 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.376 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.377 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.377 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.377 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.377 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.377 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.377 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.377 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.377 INFO:teuthology.orchestra.run.smithi120.stdout: "motd": { 2024-09-19T05:29:31.377 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "motd", 2024-09-19T05:29:31.377 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.377 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.377 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.378 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.378 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.378 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.378 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.378 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "The message of the day", 2024-09-19T05:29:31.378 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.378 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.378 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.378 INFO:teuthology.orchestra.run.smithi120.stdout: "redirect_resolve_ip_addr": { 2024-09-19T05:29:31.378 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T05:29:31.378 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.378 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.378 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.378 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.379 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.379 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.379 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.379 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.379 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.379 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.379 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.379 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2024-09-19T05:29:31.379 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2024-09-19T05:29:31.379 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.379 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.379 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.379 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "::", 2024-09-19T05:29:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2024-09-19T05:29:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2024-09-19T05:29:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8080", 2024-09-19T05:29:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl": { 2024-09-19T05:29:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl", 2024-09-19T05:29:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl_server_port": { 2024-09-19T05:29:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl_server_port", 2024-09-19T05:29:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.382 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8443", 2024-09-19T05:29:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_behaviour": { 2024-09-19T05:29:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_behaviour", 2024-09-19T05:29:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.383 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "redirect", 2024-09-19T05:29:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: "redirect" 2024-09-19T05:29:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_error_status_code": { 2024-09-19T05:29:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_error_status_code", 2024-09-19T05:29:31.384 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "500", 2024-09-19T05:29:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "400", 2024-09-19T05:29:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "599", 2024-09-19T05:29:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: "url_prefix": { 2024-09-19T05:29:31.385 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "url_prefix", 2024-09-19T05:29:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "devicehealth", 2024-09-19T05:29:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: "enable_monitoring": { 2024-09-19T05:29:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enable_monitoring", 2024-09-19T05:29:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.387 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.388 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "monitor device health metrics", 2024-09-19T05:29:31.388 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.388 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.388 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.388 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.388 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.388 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.388 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.388 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.388 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.388 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.388 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.390 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.391 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.392 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: "mark_out_threshold": { 2024-09-19T05:29:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mark_out_threshold", 2024-09-19T05:29:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:31.393 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "2419200", 2024-09-19T05:29:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T05:29:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: "pool_name": { 2024-09-19T05:29:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pool_name", 2024-09-19T05:29:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.394 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "device_health_metrics", 2024-09-19T05:29:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T05:29:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: "retention_period": { 2024-09-19T05:29:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "retention_period", 2024-09-19T05:29:31.395 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:31.396 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.396 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.396 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15552000", 2024-09-19T05:29:31.396 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.396 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.396 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.396 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long to retain device health metrics", 2024-09-19T05:29:31.396 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.396 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.396 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.396 INFO:teuthology.orchestra.run.smithi120.stdout: "scrape_frequency": { 2024-09-19T05:29:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "scrape_frequency", 2024-09-19T05:29:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "86400", 2024-09-19T05:29:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T05:29:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: "self_heal": { 2024-09-19T05:29:31.397 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "self_heal", 2024-09-19T05:29:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T05:29:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-09-19T05:29:31.398 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-09-19T05:29:31.399 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:31.399 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.399 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.399 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-09-19T05:29:31.399 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.399 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.399 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.399 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T05:29:31.399 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.399 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.399 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.399 INFO:teuthology.orchestra.run.smithi120.stdout: "warn_threshold": { 2024-09-19T05:29:31.399 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "warn_threshold", 2024-09-19T05:29:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "7257600", 2024-09-19T05:29:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T05:29:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "diskprediction_local", 2024-09-19T05:29:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.401 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.402 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.402 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.402 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.402 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.402 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.402 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.402 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.402 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.402 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.402 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.402 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.402 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.402 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.403 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.403 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.403 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.403 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.403 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.403 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.403 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.403 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.403 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.403 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.403 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.404 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.404 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.404 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.404 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.404 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.404 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.404 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.404 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.404 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.404 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.404 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.405 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.405 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.405 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.405 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.405 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.405 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.405 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.405 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.405 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.405 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.405 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.406 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.406 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.406 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.406 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.406 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.406 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.406 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.406 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.406 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.406 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.406 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.406 INFO:teuthology.orchestra.run.smithi120.stdout: "predict_interval": { 2024-09-19T05:29:31.407 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "predict_interval", 2024-09-19T05:29:31.407 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.407 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.407 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.407 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "86400", 2024-09-19T05:29:31.407 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.407 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.407 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.407 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.407 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.407 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.407 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.407 INFO:teuthology.orchestra.run.smithi120.stdout: "predictor_model": { 2024-09-19T05:29:31.408 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "predictor_model", 2024-09-19T05:29:31.408 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.408 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.408 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.408 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "prophetstor", 2024-09-19T05:29:31.408 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.408 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.408 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.408 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.408 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.408 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.408 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.408 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-09-19T05:29:31.409 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-09-19T05:29:31.409 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.409 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.409 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.409 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "600", 2024-09-19T05:29:31.409 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.409 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.409 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.409 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.409 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.409 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.409 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.410 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.410 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.410 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "influx", 2024-09-19T05:29:31.410 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": false, 2024-09-19T05:29:31.410 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "influxdb python module not found", 2024-09-19T05:29:31.410 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.410 INFO:teuthology.orchestra.run.smithi120.stdout: "batch_size": { 2024-09-19T05:29:31.410 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "batch_size", 2024-09-19T05:29:31.410 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.410 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.410 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.410 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5000", 2024-09-19T05:29:31.411 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.411 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.411 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.411 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T05:29:31.411 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.411 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.411 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.411 INFO:teuthology.orchestra.run.smithi120.stdout: "database": { 2024-09-19T05:29:31.411 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "database", 2024-09-19T05:29:31.411 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.411 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.411 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.411 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "ceph", 2024-09-19T05:29:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T05:29:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: "hostname": { 2024-09-19T05:29:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "hostname", 2024-09-19T05:29:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.412 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "InfluxDB server hostname", 2024-09-19T05:29:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-09-19T05:29:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-09-19T05:29:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.413 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "30", 2024-09-19T05:29:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "5", 2024-09-19T05:29:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T05:29:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.414 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.415 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.416 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.417 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.418 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: "password": { 2024-09-19T05:29:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "password", 2024-09-19T05:29:31.419 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "password of InfluxDB server user", 2024-09-19T05:29:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: "port": { 2024-09-19T05:29:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "port", 2024-09-19T05:29:31.420 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "8086", 2024-09-19T05:29:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "InfluxDB server port", 2024-09-19T05:29:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: "ssl": { 2024-09-19T05:29:31.421 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ssl", 2024-09-19T05:29:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "false", 2024-09-19T05:29:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T05:29:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: "threads": { 2024-09-19T05:29:31.422 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "threads", 2024-09-19T05:29:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-09-19T05:29:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2024-09-19T05:29:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "32", 2024-09-19T05:29:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T05:29:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: "username": { 2024-09-19T05:29:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "username", 2024-09-19T05:29:31.423 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "username of InfluxDB server user", 2024-09-19T05:29:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: "verify_ssl": { 2024-09-19T05:29:31.424 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "verify_ssl", 2024-09-19T05:29:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "true", 2024-09-19T05:29:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T05:29:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "insights", 2024-09-19T05:29:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.426 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.427 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.428 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.429 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.430 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "iostat", 2024-09-19T05:29:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.431 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.432 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.433 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.434 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.435 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.436 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.436 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.436 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.436 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.436 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.436 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.436 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.436 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.436 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.436 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.436 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.436 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "k8sevents", 2024-09-19T05:29:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: "ceph_event_retention_days": { 2024-09-19T05:29:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "ceph_event_retention_days", 2024-09-19T05:29:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "7", 2024-09-19T05:29:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.437 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.438 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T05:29:31.438 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.438 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.438 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.438 INFO:teuthology.orchestra.run.smithi120.stdout: "config_check_secs": { 2024-09-19T05:29:31.438 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "config_check_secs", 2024-09-19T05:29:31.438 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.438 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.438 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.438 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-09-19T05:29:31.438 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "10", 2024-09-19T05:29:31.438 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T05:29:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.439 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.440 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.440 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.440 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.440 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.440 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.440 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.440 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.440 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.440 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.440 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.440 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.440 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.442 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.442 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.442 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.442 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.442 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.442 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.442 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.442 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.442 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.442 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.442 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.442 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.442 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.442 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.443 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.443 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.443 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.443 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.443 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.443 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.443 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.443 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.443 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.443 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.443 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.443 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.444 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.444 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.444 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.444 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.444 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.444 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.444 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.444 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.444 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.444 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "localpool", 2024-09-19T05:29:31.444 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.445 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.445 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.445 INFO:teuthology.orchestra.run.smithi120.stdout: "failure_domain": { 2024-09-19T05:29:31.445 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "failure_domain", 2024-09-19T05:29:31.445 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.445 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.445 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.445 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "host", 2024-09-19T05:29:31.445 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.445 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.445 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.445 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "failure domain for any created local pool", 2024-09-19T05:29:31.445 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T05:29:31.446 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.446 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.446 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.446 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.446 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.446 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.446 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.446 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.446 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.446 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.446 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.446 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.446 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.447 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.447 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.447 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.447 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.447 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.447 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.447 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.447 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.447 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.447 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.447 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.447 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.447 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.448 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.449 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.450 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: "min_size": { 2024-09-19T05:29:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "min_size", 2024-09-19T05:29:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default min_size for any created local pool", 2024-09-19T05:29:31.451 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T05:29:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: "num_rep": { 2024-09-19T05:29:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "num_rep", 2024-09-19T05:29:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "3", 2024-09-19T05:29:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.452 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default replica count for any created local pool", 2024-09-19T05:29:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_num": { 2024-09-19T05:29:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pg_num", 2024-09-19T05:29:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "128", 2024-09-19T05:29:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.453 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T05:29:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: "prefix": { 2024-09-19T05:29:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prefix", 2024-09-19T05:29:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.454 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "name prefix for any created local pool", 2024-09-19T05:29:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: "subtree": { 2024-09-19T05:29:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "subtree", 2024-09-19T05:29:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "rack", 2024-09-19T05:29:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.455 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T05:29:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T05:29:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mds_autoscaler", 2024-09-19T05:29:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.456 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.457 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.458 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.459 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.460 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.461 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mirroring", 2024-09-19T05:29:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.462 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.463 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.464 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.465 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.466 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.467 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.468 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.468 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "nfs", 2024-09-19T05:29:31.468 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.468 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.468 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.468 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.468 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.468 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.468 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.469 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.470 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.470 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.470 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.470 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.470 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.470 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.470 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.470 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.470 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.470 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.470 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.471 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.472 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.472 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.472 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.472 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.472 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.472 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.472 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.472 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.472 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.472 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.472 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.473 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.474 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.474 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.474 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "orchestrator", 2024-09-19T05:29:31.474 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.474 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.474 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.474 INFO:teuthology.orchestra.run.smithi120.stdout: "fail_fs": { 2024-09-19T05:29:31.474 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "fail_fs", 2024-09-19T05:29:31.474 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.474 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.474 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T05:29:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.476 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.476 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.476 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.476 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.476 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.476 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.476 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.476 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.476 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.476 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.476 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.476 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.476 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.477 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.477 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.477 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.477 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.477 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.477 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.477 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.477 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.477 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.477 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.477 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.477 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.478 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.478 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.478 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.478 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.478 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.478 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.478 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.478 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.478 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.478 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.478 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.478 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.478 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.479 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.479 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.479 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.479 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.479 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.479 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.479 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.479 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.479 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.479 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.479 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.479 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.479 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.480 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.480 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.480 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.480 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.480 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.480 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.480 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.480 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.480 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.480 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.480 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.480 INFO:teuthology.orchestra.run.smithi120.stdout: "orchestrator": { 2024-09-19T05:29:31.480 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "orchestrator", 2024-09-19T05:29:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: "cephadm", 2024-09-19T05:29:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: "rook", 2024-09-19T05:29:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: "test_orchestrator" 2024-09-19T05:29:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Orchestrator backend", 2024-09-19T05:29:31.481 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "osd_perf_query", 2024-09-19T05:29:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.482 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.483 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.484 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.484 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.484 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.484 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.484 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.484 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.484 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.484 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.484 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.484 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.484 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.484 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.485 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.486 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "osd_support", 2024-09-19T05:29:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.488 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.489 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.490 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.492 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "pg_autoscaler", 2024-09-19T05:29:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.493 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.494 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.495 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.496 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.496 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.496 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.496 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.496 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.496 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.496 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.496 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.496 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.496 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.496 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.497 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-09-19T05:29:31.498 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-09-19T05:29:31.499 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:31.499 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.499 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.499 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-09-19T05:29:31.499 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.499 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.499 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.499 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.499 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.499 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.499 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.500 INFO:teuthology.orchestra.run.smithi120.stdout: "threshold": { 2024-09-19T05:29:31.500 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "threshold", 2024-09-19T05:29:31.500 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-09-19T05:29:31.500 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.500 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.500 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "3.0", 2024-09-19T05:29:31.500 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1.0", 2024-09-19T05:29:31.500 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.500 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.500 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "scaling threshold", 2024-09-19T05:29:31.500 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T05:29:31.500 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "progress", 2024-09-19T05:29:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: "allow_pg_recovery_event": { 2024-09-19T05:29:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "allow_pg_recovery_event", 2024-09-19T05:29:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.501 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T05:29:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": { 2024-09-19T05:29:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enabled", 2024-09-19T05:29:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.502 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.503 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.504 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.506 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.507 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.507 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.507 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.507 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.507 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.507 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.507 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.507 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.507 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.507 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.507 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.507 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: "max_completed_events": { 2024-09-19T05:29:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_completed_events", 2024-09-19T05:29:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.508 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.509 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.509 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "50", 2024-09-19T05:29:31.509 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.509 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.509 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.509 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "number of past completed events to remember", 2024-09-19T05:29:31.509 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.509 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.509 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.509 INFO:teuthology.orchestra.run.smithi120.stdout: "sleep_interval": { 2024-09-19T05:29:31.509 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "sleep_interval", 2024-09-19T05:29:31.509 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:31.510 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.510 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.510 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-09-19T05:29:31.510 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.510 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.510 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.510 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "how long the module is going to sleep", 2024-09-19T05:29:31.510 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.510 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.510 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.510 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.510 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.511 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "prometheus", 2024-09-19T05:29:31.511 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.511 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.511 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.511 INFO:teuthology.orchestra.run.smithi120.stdout: "cache": { 2024-09-19T05:29:31.511 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "cache", 2024-09-19T05:29:31.511 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.511 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.511 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.511 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.511 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.511 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.511 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.512 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.512 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.512 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.512 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.512 INFO:teuthology.orchestra.run.smithi120.stdout: "exclude_perf_counters": { 2024-09-19T05:29:31.512 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "exclude_perf_counters", 2024-09-19T05:29:31.512 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.512 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.512 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.512 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.512 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.512 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.513 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.513 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T05:29:31.513 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T05:29:31.513 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.513 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.513 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.513 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.513 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.513 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.513 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.513 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.513 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.514 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.514 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.514 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.514 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.514 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.514 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.514 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.514 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.514 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.514 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.514 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.514 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.514 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.515 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.516 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.516 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.516 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.516 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.516 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.516 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.516 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.516 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.516 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.516 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.516 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.516 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.516 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.517 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.517 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.517 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.517 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.517 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.517 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.517 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.517 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.517 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.517 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.517 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.517 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.517 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_stats_pools": { 2024-09-19T05:29:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_stats_pools", 2024-09-19T05:29:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T05:29:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T05:29:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "300", 2024-09-19T05:29:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "scrape_interval": { 2024-09-19T05:29:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "scrape_interval", 2024-09-19T05:29:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-09-19T05:29:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15.0", 2024-09-19T05:29:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2024-09-19T05:29:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2024-09-19T05:29:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "::", 2024-09-19T05:29:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T05:29:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2024-09-19T05:29:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2024-09-19T05:29:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "9283", 2024-09-19T05:29:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T05:29:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "stale_cache_strategy": { 2024-09-19T05:29:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "stale_cache_strategy", 2024-09-19T05:29:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "log", 2024-09-19T05:29:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_behaviour": { 2024-09-19T05:29:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_behaviour", 2024-09-19T05:29:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "default", 2024-09-19T05:29:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "default", 2024-09-19T05:29:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "error" 2024-09-19T05:29:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "standby_error_status_code": { 2024-09-19T05:29:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "standby_error_status_code", 2024-09-19T05:29:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "500", 2024-09-19T05:29:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "400", 2024-09-19T05:29:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "599", 2024-09-19T05:29:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_support", 2024-09-19T05:29:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "max_concurrent_snap_create": { 2024-09-19T05:29:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_concurrent_snap_create", 2024-09-19T05:29:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10", 2024-09-19T05:29:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "mirror_snapshot_schedule": { 2024-09-19T05:29:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T05:29:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "trash_purge_schedule": { 2024-09-19T05:29:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "trash_purge_schedule", 2024-09-19T05:29:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "restful", 2024-09-19T05:29:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "enable_auth": { 2024-09-19T05:29:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enable_auth", 2024-09-19T05:29:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "key_file": { 2024-09-19T05:29:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "key_file", 2024-09-19T05:29:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "server_addr": { 2024-09-19T05:29:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_addr", 2024-09-19T05:29:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "server_port": { 2024-09-19T05:29:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "server_port", 2024-09-19T05:29:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rgw", 2024-09-19T05:29:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T05:29:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T05:29:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "5", 2024-09-19T05:29:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T05:29:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rook", 2024-09-19T05:29:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "storage_class": { 2024-09-19T05:29:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "storage_class", 2024-09-19T05:29:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "local", 2024-09-19T05:29:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T05:29:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "selftest", 2024-09-19T05:29:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: "roption1": { 2024-09-19T05:29:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "roption1", 2024-09-19T05:29:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "roption2": { 2024-09-19T05:29:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "roption2", 2024-09-19T05:29:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "xyz", 2024-09-19T05:29:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption1": { 2024-09-19T05:29:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption1", 2024-09-19T05:29:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption2": { 2024-09-19T05:29:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption2", 2024-09-19T05:29:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption3": { 2024-09-19T05:29:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption3", 2024-09-19T05:29:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "float", 2024-09-19T05:29:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption4": { 2024-09-19T05:29:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption4", 2024-09-19T05:29:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption5": { 2024-09-19T05:29:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption5", 2024-09-19T05:29:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption6": { 2024-09-19T05:29:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption6", 2024-09-19T05:29:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "rwoption7": { 2024-09-19T05:29:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rwoption7", 2024-09-19T05:29:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "1", 2024-09-19T05:29:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "42", 2024-09-19T05:29:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "testkey": { 2024-09-19T05:29:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testkey", 2024-09-19T05:29:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "testlkey": { 2024-09-19T05:29:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testlkey", 2024-09-19T05:29:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "testnewline": { 2024-09-19T05:29:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "testnewline", 2024-09-19T05:29:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "snap_schedule", 2024-09-19T05:29:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "allow_m_granularity": { 2024-09-19T05:29:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "allow_m_granularity", 2024-09-19T05:29:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T05:29:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "dump_on_update": { 2024-09-19T05:29:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "dump_on_update", 2024-09-19T05:29:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "dump database to debug log on update", 2024-09-19T05:29:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "stats", 2024-09-19T05:29:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "status", 2024-09-19T05:29:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "telegraf", 2024-09-19T05:29:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "address": { 2024-09-19T05:29:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "address", 2024-09-19T05:29:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T05:29:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-09-19T05:29:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-09-19T05:29:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "15", 2024-09-19T05:29:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "telemetry", 2024-09-19T05:29:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_basic": { 2024-09-19T05:29:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_basic", 2024-09-19T05:29:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T05:29:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_crash": { 2024-09-19T05:29:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_crash", 2024-09-19T05:29:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T05:29:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_device": { 2024-09-19T05:29:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_device", 2024-09-19T05:29:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T05:29:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_ident": { 2024-09-19T05:29:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_ident", 2024-09-19T05:29:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T05:29:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "channel_perf": { 2024-09-19T05:29:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "channel_perf", 2024-09-19T05:29:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T05:29:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "contact": { 2024-09-19T05:29:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "contact", 2024-09-19T05:29:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "description": { 2024-09-19T05:29:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "description", 2024-09-19T05:29:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "device_url": { 2024-09-19T05:29:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "device_url", 2024-09-19T05:29:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T05:29:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "enabled": { 2024-09-19T05:29:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "enabled", 2024-09-19T05:29:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-09-19T05:29:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-09-19T05:29:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "24", 2024-09-19T05:29:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "8", 2024-09-19T05:29:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "last_opt_revision": { 2024-09-19T05:29:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "last_opt_revision", 2024-09-19T05:29:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "1", 2024-09-19T05:29:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "leaderboard": { 2024-09-19T05:29:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "leaderboard", 2024-09-19T05:29:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "leaderboard_description": { 2024-09-19T05:29:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "leaderboard_description", 2024-09-19T05:29:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "organization": { 2024-09-19T05:29:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "organization", 2024-09-19T05:29:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "proxy": { 2024-09-19T05:29:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "proxy", 2024-09-19T05:29:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "url": { 2024-09-19T05:29:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "url", 2024-09-19T05:29:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T05:29:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "test_orchestrator", 2024-09-19T05:29:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "volumes", 2024-09-19T05:29:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "max_concurrent_clones": { 2024-09-19T05:29:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "max_concurrent_clones", 2024-09-19T05:29:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "4", 2024-09-19T05:29:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T05:29:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "periodic_async_work": { 2024-09-19T05:29:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "periodic_async_work", 2024-09-19T05:29:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Periodically check for async work", 2024-09-19T05:29:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "snapshot_clone_delay": { 2024-09-19T05:29:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "snapshot_clone_delay", 2024-09-19T05:29:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "0", 2024-09-19T05:29:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T05:29:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "snapshot_clone_no_wait": { 2024-09-19T05:29:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T05:29:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "True", 2024-09-19T05:29:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T05:29:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix", 2024-09-19T05:29:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "can_run": true, 2024-09-19T05:29:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "error_string": "", 2024-09-19T05:29:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "module_options": { 2024-09-19T05:29:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "discovery_interval": { 2024-09-19T05:29:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "discovery_interval", 2024-09-19T05:29:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "uint", 2024-09-19T05:29:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "100", 2024-09-19T05:29:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "identifier": { 2024-09-19T05:29:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "identifier", 2024-09-19T05:29:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "interval": { 2024-09-19T05:29:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "interval", 2024-09-19T05:29:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "secs", 2024-09-19T05:29:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "60", 2024-09-19T05:29:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "log_level": { 2024-09-19T05:29:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_level", 2024-09-19T05:29:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.644 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.645 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster": { 2024-09-19T05:29:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster", 2024-09-19T05:29:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.646 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_cluster_level": { 2024-09-19T05:29:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_cluster_level", 2024-09-19T05:29:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "info", 2024-09-19T05:29:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [ 2024-09-19T05:29:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "", 2024-09-19T05:29:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "critical", 2024-09-19T05:29:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "debug", 2024-09-19T05:29:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "error", 2024-09-19T05:29:31.647 INFO:teuthology.orchestra.run.smithi120.stdout: "info", 2024-09-19T05:29:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "warning" 2024-09-19T05:29:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "log_to_file": { 2024-09-19T05:29:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "log_to_file", 2024-09-19T05:29:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "bool", 2024-09-19T05:29:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 1, 2024-09-19T05:29:31.648 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "False", 2024-09-19T05:29:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_host": { 2024-09-19T05:29:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_host", 2024-09-19T05:29:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.649 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "", 2024-09-19T05:29:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_port": { 2024-09-19T05:29:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_port", 2024-09-19T05:29:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "int", 2024-09-19T05:29:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.650 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "10051", 2024-09-19T05:29:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "zabbix_sender": { 2024-09-19T05:29:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "zabbix_sender", 2024-09-19T05:29:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "str", 2024-09-19T05:29:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "level": "advanced", 2024-09-19T05:29:31.651 INFO:teuthology.orchestra.run.smithi120.stdout: "flags": 0, 2024-09-19T05:29:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T05:29:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "min": "", 2024-09-19T05:29:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "max": "", 2024-09-19T05:29:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "enum_allowed": [], 2024-09-19T05:29:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "desc": "", 2024-09-19T05:29:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "long_desc": "", 2024-09-19T05:29:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "tags": [], 2024-09-19T05:29:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "see_also": [] 2024-09-19T05:29:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "services": { 2024-09-19T05:29:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "dashboard": "https://172.21.15.120:8443/" 2024-09-19T05:29:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "always_on_modules": { 2024-09-19T05:29:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "octopus": [ 2024-09-19T05:29:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "balancer", 2024-09-19T05:29:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "crash", 2024-09-19T05:29:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "devicehealth", 2024-09-19T05:29:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "orchestrator", 2024-09-19T05:29:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscaler", 2024-09-19T05:29:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "progress", 2024-09-19T05:29:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_support", 2024-09-19T05:29:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "status", 2024-09-19T05:29:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "telemetry", 2024-09-19T05:29:31.653 INFO:teuthology.orchestra.run.smithi120.stdout: "volumes" 2024-09-19T05:29:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "pacific": [ 2024-09-19T05:29:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "balancer", 2024-09-19T05:29:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "crash", 2024-09-19T05:29:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "devicehealth", 2024-09-19T05:29:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "orchestrator", 2024-09-19T05:29:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscaler", 2024-09-19T05:29:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "progress", 2024-09-19T05:29:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_support", 2024-09-19T05:29:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "status", 2024-09-19T05:29:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "telemetry", 2024-09-19T05:29:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "volumes" 2024-09-19T05:29:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.654 INFO:teuthology.orchestra.run.smithi120.stdout: "quincy": [ 2024-09-19T05:29:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "balancer", 2024-09-19T05:29:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "crash", 2024-09-19T05:29:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "devicehealth", 2024-09-19T05:29:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "orchestrator", 2024-09-19T05:29:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscaler", 2024-09-19T05:29:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "progress", 2024-09-19T05:29:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_support", 2024-09-19T05:29:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "status", 2024-09-19T05:29:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "telemetry", 2024-09-19T05:29:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "volumes" 2024-09-19T05:29:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "reef": [ 2024-09-19T05:29:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "balancer", 2024-09-19T05:29:31.655 INFO:teuthology.orchestra.run.smithi120.stdout: "crash", 2024-09-19T05:29:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "devicehealth", 2024-09-19T05:29:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "orchestrator", 2024-09-19T05:29:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscaler", 2024-09-19T05:29:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "progress", 2024-09-19T05:29:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_support", 2024-09-19T05:29:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "status", 2024-09-19T05:29:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "telemetry", 2024-09-19T05:29:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "volumes" 2024-09-19T05:29:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-19T05:29:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "squid": [ 2024-09-19T05:29:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "balancer", 2024-09-19T05:29:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "crash", 2024-09-19T05:29:31.656 INFO:teuthology.orchestra.run.smithi120.stdout: "devicehealth", 2024-09-19T05:29:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "orchestrator", 2024-09-19T05:29:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "pg_autoscaler", 2024-09-19T05:29:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "progress", 2024-09-19T05:29:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "rbd_support", 2024-09-19T05:29:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "status", 2024-09-19T05:29:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "telemetry", 2024-09-19T05:29:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "volumes" 2024-09-19T05:29:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-19T05:29:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "last_failure_osd_epoch": 85, 2024-09-19T05:29:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "active_clients": [ 2024-09-19T05:29:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "devicehealth", 2024-09-19T05:29:31.657 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-19T05:29:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-19T05:29:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:0", 2024-09-19T05:29:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3024557639 2024-09-19T05:29:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-19T05:29:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "libcephsqlite", 2024-09-19T05:29:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-19T05:29:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-19T05:29:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:0", 2024-09-19T05:29:31.658 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3085673194 2024-09-19T05:29:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-19T05:29:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "rbd_support", 2024-09-19T05:29:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-19T05:29:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-19T05:29:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:0", 2024-09-19T05:29:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 1177361966 2024-09-19T05:29:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.659 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-19T05:29:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "snap_schedule", 2024-09-19T05:29:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-19T05:29:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-19T05:29:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:0", 2024-09-19T05:29:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 2568414777 2024-09-19T05:29:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-19T05:29:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "snap_schedule", 2024-09-19T05:29:31.660 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-19T05:29:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-19T05:29:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:0", 2024-09-19T05:29:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 3433209371 2024-09-19T05:29:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-19T05:29:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "name": "volumes", 2024-09-19T05:29:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "addrvec": [ 2024-09-19T05:29:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-19T05:29:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "type": "v2", 2024-09-19T05:29:31.661 INFO:teuthology.orchestra.run.smithi120.stdout: "addr": "172.21.15.120:0", 2024-09-19T05:29:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: "nonce": 517330596 2024-09-19T05:29:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-19T05:29:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:31.662 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-19T05:29:31.662 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T05:29:31.663 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:30 smithi178 ceph-mon[34347]: pgmap v318: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:29:31.664 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:30 smithi178 ceph-mon[34347]: from='client.16344 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:29:31.664 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:30 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1250033438' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T05:29:31.664 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:30 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/683044956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T05:29:31.664 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:30 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1297713425' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T05:29:31.664 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:31 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/4080899394' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T05:29:31.664 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:30 smithi194 ceph-mon[35228]: pgmap v318: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:29:31.664 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:30 smithi194 ceph-mon[35228]: from='client.16344 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:29:31.664 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:30 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1250033438' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T05:29:31.664 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:30 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/683044956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T05:29:31.664 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:30 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1297713425' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T05:29:31.665 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:31 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/4080899394' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T05:29:31.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.248+0000 7f303480e640 1 -- 172.21.15.120:0/4080899394 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f301c0a33c0 msgr2=0x7f301c0a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:31.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.248+0000 7f303480e640 1 --2- 172.21.15.120:0/4080899394 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f301c0a33c0 0x7f301c0a5880 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3018031440 tx=0x7f30180095f0 comp rx=0 tx=0).stop 2024-09-19T05:29:31.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.248+0000 7f303480e640 1 -- 172.21.15.120:0/4080899394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3030101150 msgr2=0x7f30301982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:31.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.248+0000 7f303480e640 1 --2- 172.21.15.120:0/4080899394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3030101150 0x7f30301982e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f302000d770 tx=0x7f302000dc30 comp rx=0 tx=0).stop 2024-09-19T05:29:31.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.248+0000 7f303480e640 1 -- 172.21.15.120:0/4080899394 shutdown_connections 2024-09-19T05:29:31.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.248+0000 7f303480e640 1 --2- 172.21.15.120:0/4080899394 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f301c0a33c0 0x7f301c0a5880 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:31.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.248+0000 7f303480e640 1 --2- 172.21.15.120:0/4080899394 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30301059b0 0x7f303019cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:31.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.248+0000 7f303480e640 1 --2- 172.21.15.120:0/4080899394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3030101ad0 0x7f3030198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:31.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.248+0000 7f303480e640 1 --2- 172.21.15.120:0/4080899394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3030101150 0x7f30301982e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:31.665 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.248+0000 7f303480e640 1 -- 172.21.15.120:0/4080899394 >> 172.21.15.120:0/4080899394 conn(0x7f30300771e0 msgr2=0x7f3030100260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:31.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.248+0000 7f303480e640 1 -- 172.21.15.120:0/4080899394 shutdown_connections 2024-09-19T05:29:31.666 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:30.248+0000 7f303480e640 1 -- 172.21.15.120:0/4080899394 wait complete. 2024-09-19T05:29:31.666 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:30 smithi120 ceph-mon[30956]: pgmap v318: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:29:31.666 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:30 smithi120 ceph-mon[30956]: from='client.16344 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T05:29:31.666 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:30 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1250033438' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T05:29:31.666 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:30 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/683044956' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T05:29:31.666 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:30 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1297713425' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T05:29:31.718 DEBUG:tasks.check_counter:Getting stats from a 2024-09-19T05:29:31.718 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-19T05:29:31.719 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:31 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/4080899394' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T05:29:31.973 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:29:32.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:32 smithi120 ceph-mon[30956]: pgmap v319: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T05:29:32.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:32 smithi194 ceph-mon[35228]: pgmap v319: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T05:29:32.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:32 smithi178 ceph-mon[34347]: pgmap v319: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T05:29:32.539 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T05:29:32.539 INFO:teuthology.orchestra.run.smithi120.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:29:32.539 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_messages": 208, 2024-09-19T05:29:32.540 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages": 198, 2024-09-19T05:29:32.540 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_bytes": 1444544, 2024-09-19T05:29:32.540 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_bytes": 121504, 2024-09-19T05:29:32.540 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_created_connections": 4, 2024-09-19T05:29:32.540 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_active_connections": 0, 2024-09-19T05:29:32.540 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_total_time": 0.036143781, 2024-09-19T05:29:32.540 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_send_time": 0.012043341, 2024-09-19T05:29:32.540 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_recv_time": 0.034271967, 2024-09-19T05:29:32.540 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:29:32.540 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:32.540 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 197, 2024-09-19T05:29:32.540 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.008237215, 2024-09-19T05:29:32.540 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000041813 2024-09-19T05:29:32.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:32.541 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:32.541 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-09-19T05:29:32.541 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-09-19T05:29:32.541 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-09-19T05:29:32.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:32.541 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_encrypted_bytes": 1444544, 2024-09-19T05:29:32.541 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_encrypted_bytes": 121504 2024-09-19T05:29:32.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:32.541 INFO:teuthology.orchestra.run.smithi120.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:29:32.541 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_messages": 2, 2024-09-19T05:29:32.541 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages": 152, 2024-09-19T05:29:32.541 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_bytes": 320, 2024-09-19T05:29:32.542 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_bytes": 183792, 2024-09-19T05:29:32.542 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_created_connections": 5, 2024-09-19T05:29:32.542 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_active_connections": 3, 2024-09-19T05:29:32.542 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_total_time": 0.011395453, 2024-09-19T05:29:32.542 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_send_time": 0.007567507, 2024-09-19T05:29:32.542 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_recv_time": 0.002005358, 2024-09-19T05:29:32.542 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:29:32.542 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:32.542 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 149, 2024-09-19T05:29:32.542 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.010492140, 2024-09-19T05:29:32.542 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000070417 2024-09-19T05:29:32.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:32.542 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:32.542 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-09-19T05:29:32.543 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-09-19T05:29:32.543 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-09-19T05:29:32.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:32.543 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T05:29:32.543 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_encrypted_bytes": 183792 2024-09-19T05:29:32.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:32.543 INFO:teuthology.orchestra.run.smithi120.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:29:32.543 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_messages": 4, 2024-09-19T05:29:32.543 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages": 4, 2024-09-19T05:29:32.543 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_bytes": 2944, 2024-09-19T05:29:32.543 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_bytes": 448, 2024-09-19T05:29:32.543 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_created_connections": 2, 2024-09-19T05:29:32.543 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_active_connections": 1, 2024-09-19T05:29:32.544 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_total_time": 0.002205883, 2024-09-19T05:29:32.544 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_send_time": 0.000029865, 2024-09-19T05:29:32.544 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_recv_time": 0.002153206, 2024-09-19T05:29:32.544 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:29:32.544 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:32.544 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 3, 2024-09-19T05:29:32.544 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.003942399, 2024-09-19T05:29:32.544 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.001314133 2024-09-19T05:29:32.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:32.544 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:32.544 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-09-19T05:29:32.544 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-09-19T05:29:32.544 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-09-19T05:29:32.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:32.545 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-19T05:29:32.545 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T05:29:32.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:32.545 INFO:teuthology.orchestra.run.smithi120.stdout: "cct": { 2024-09-19T05:29:32.545 INFO:teuthology.orchestra.run.smithi120.stdout: "total_workers": 0, 2024-09-19T05:29:32.545 INFO:teuthology.orchestra.run.smithi120.stdout: "unhealthy_workers": 0 2024-09-19T05:29:32.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:32.545 INFO:teuthology.orchestra.run.smithi120.stdout: "mempool": { 2024-09-19T05:29:32.545 INFO:teuthology.orchestra.run.smithi120.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:29:32.545 INFO:teuthology.orchestra.run.smithi120.stdout: "bloom_filter_items": 0, 2024-09-19T05:29:32.545 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:29:32.545 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:29:32.545 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:29:32.546 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:29:32.546 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:29:32.546 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:29:32.546 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:29:32.546 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:29:32.546 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:29:32.546 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:29:32.546 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:29:32.546 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:29:32.546 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:29:32.546 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_extent_items": 0, 2024-09-19T05:29:32.546 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:29:32.546 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_blob_items": 0, 2024-09-19T05:29:32.546 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:29:32.547 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:29:32.547 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:29:32.547 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:29:32.547 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:29:32.547 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:29:32.547 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:29:32.547 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_txc_items": 0, 2024-09-19T05:29:32.547 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:29:32.547 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:29:32.547 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:29:32.547 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_items": 0, 2024-09-19T05:29:32.547 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_bytes": 0, 2024-09-19T05:29:32.547 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_items": 0, 2024-09-19T05:29:32.547 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:29:32.548 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:29:32.548 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:29:32.548 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:29:32.548 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_anon_bytes": 148977, 2024-09-19T05:29:32.548 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_anon_items": 30, 2024-09-19T05:29:32.548 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:29:32.548 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_meta_items": 0, 2024-09-19T05:29:32.548 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_bytes": 0, 2024-09-19T05:29:32.548 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_items": 0, 2024-09-19T05:29:32.548 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:29:32.548 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mapbl_items": 0, 2024-09-19T05:29:32.548 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:29:32.548 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pglog_items": 0, 2024-09-19T05:29:32.549 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_bytes": 0, 2024-09-19T05:29:32.549 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_items": 0, 2024-09-19T05:29:32.549 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:29:32.549 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:29:32.549 INFO:teuthology.orchestra.run.smithi120.stdout: "pgmap_bytes": 0, 2024-09-19T05:29:32.549 INFO:teuthology.orchestra.run.smithi120.stdout: "pgmap_items": 0, 2024-09-19T05:29:32.549 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_co_bytes": 928, 2024-09-19T05:29:32.549 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_co_items": 2, 2024-09-19T05:29:32.549 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_1_bytes": 0, 2024-09-19T05:29:32.549 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_1_items": 0, 2024-09-19T05:29:32.549 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_2_bytes": 0, 2024-09-19T05:29:32.549 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_2_items": 0 2024-09-19T05:29:32.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:32.550 INFO:teuthology.orchestra.run.smithi120.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:29:32.550 INFO:teuthology.orchestra.run.smithi120.stdout: "val": 0, 2024-09-19T05:29:32.550 INFO:teuthology.orchestra.run.smithi120.stdout: "max": 104857600, 2024-09-19T05:29:32.550 INFO:teuthology.orchestra.run.smithi120.stdout: "get_started": 0, 2024-09-19T05:29:32.550 INFO:teuthology.orchestra.run.smithi120.stdout: "get": 210, 2024-09-19T05:29:32.550 INFO:teuthology.orchestra.run.smithi120.stdout: "get_sum": 1415225, 2024-09-19T05:29:32.550 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:32.550 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_success": 210, 2024-09-19T05:29:32.550 INFO:teuthology.orchestra.run.smithi120.stdout: "take": 0, 2024-09-19T05:29:32.550 INFO:teuthology.orchestra.run.smithi120.stdout: "take_sum": 0, 2024-09-19T05:29:32.550 INFO:teuthology.orchestra.run.smithi120.stdout: "put": 210, 2024-09-19T05:29:32.550 INFO:teuthology.orchestra.run.smithi120.stdout: "put_sum": 1415225, 2024-09-19T05:29:32.550 INFO:teuthology.orchestra.run.smithi120.stdout: "wait": { 2024-09-19T05:29:32.550 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-09-19T05:29:32.550 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-09-19T05:29:32.551 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-09-19T05:29:32.551 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:32.551 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:32.551 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T05:29:33.276 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-19T05:29:33.276 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-19T05:29:33.276 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-19T05:29:33.276 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-19T05:29:33.276 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-19T05:29:33.276 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-09-19T05:29:33.276 DEBUG:tasks.check_counter:Getting stats from d 2024-09-19T05:29:33.277 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-19T05:29:33.545 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:29:34.065 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T05:29:34.065 INFO:teuthology.orchestra.run.smithi120.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:29:34.065 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_messages": 213, 2024-09-19T05:29:34.065 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages": 203, 2024-09-19T05:29:34.065 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_bytes": 1445904, 2024-09-19T05:29:34.065 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_bytes": 124704, 2024-09-19T05:29:34.065 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_created_connections": 4, 2024-09-19T05:29:34.065 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_active_connections": 0, 2024-09-19T05:29:34.066 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_total_time": 0.039763149, 2024-09-19T05:29:34.066 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_send_time": 0.013368337, 2024-09-19T05:29:34.066 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_recv_time": 0.037480850, 2024-09-19T05:29:34.066 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:29:34.066 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:34.066 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 202, 2024-09-19T05:29:34.066 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.009466309, 2024-09-19T05:29:34.066 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000046862 2024-09-19T05:29:34.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:34.066 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:34.066 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-09-19T05:29:34.066 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-09-19T05:29:34.066 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-09-19T05:29:34.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:34.067 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_encrypted_bytes": 1445904, 2024-09-19T05:29:34.067 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_encrypted_bytes": 124704 2024-09-19T05:29:34.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:34.067 INFO:teuthology.orchestra.run.smithi120.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:29:34.067 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_messages": 2, 2024-09-19T05:29:34.067 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages": 155, 2024-09-19T05:29:34.067 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_bytes": 320, 2024-09-19T05:29:34.067 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_bytes": 184320, 2024-09-19T05:29:34.067 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_created_connections": 5, 2024-09-19T05:29:34.067 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_active_connections": 3, 2024-09-19T05:29:34.067 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_total_time": 0.011754455, 2024-09-19T05:29:34.067 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_send_time": 0.007864127, 2024-09-19T05:29:34.067 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_recv_time": 0.001996187, 2024-09-19T05:29:34.068 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:29:34.068 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:34.068 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 152, 2024-09-19T05:29:34.068 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.008712595, 2024-09-19T05:29:34.068 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000057319 2024-09-19T05:29:34.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:34.068 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:34.068 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-09-19T05:29:34.068 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-09-19T05:29:34.068 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-09-19T05:29:34.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:34.068 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T05:29:34.068 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_encrypted_bytes": 184320 2024-09-19T05:29:34.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:34.069 INFO:teuthology.orchestra.run.smithi120.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:29:34.069 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_messages": 4, 2024-09-19T05:29:34.069 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages": 4, 2024-09-19T05:29:34.069 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_bytes": 2944, 2024-09-19T05:29:34.069 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_bytes": 448, 2024-09-19T05:29:34.069 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_created_connections": 2, 2024-09-19T05:29:34.069 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_active_connections": 1, 2024-09-19T05:29:34.069 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_total_time": 0.002123856, 2024-09-19T05:29:34.069 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_send_time": 0.000038637, 2024-09-19T05:29:34.069 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_recv_time": 0.002087675, 2024-09-19T05:29:34.069 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:29:34.069 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:34.070 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 3, 2024-09-19T05:29:34.070 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.003882140, 2024-09-19T05:29:34.070 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.001294046 2024-09-19T05:29:34.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:34.070 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:34.070 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-09-19T05:29:34.070 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-09-19T05:29:34.070 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-09-19T05:29:34.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:34.070 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-19T05:29:34.070 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T05:29:34.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:34.070 INFO:teuthology.orchestra.run.smithi120.stdout: "cct": { 2024-09-19T05:29:34.071 INFO:teuthology.orchestra.run.smithi120.stdout: "total_workers": 0, 2024-09-19T05:29:34.071 INFO:teuthology.orchestra.run.smithi120.stdout: "unhealthy_workers": 0 2024-09-19T05:29:34.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:34.071 INFO:teuthology.orchestra.run.smithi120.stdout: "mempool": { 2024-09-19T05:29:34.071 INFO:teuthology.orchestra.run.smithi120.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:29:34.071 INFO:teuthology.orchestra.run.smithi120.stdout: "bloom_filter_items": 0, 2024-09-19T05:29:34.071 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:29:34.071 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:29:34.071 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:29:34.071 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:29:34.071 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:29:34.071 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:29:34.071 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:29:34.072 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:29:34.072 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:29:34.072 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:29:34.072 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:29:34.072 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:29:34.072 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:29:34.072 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_extent_items": 0, 2024-09-19T05:29:34.072 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:29:34.072 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_blob_items": 0, 2024-09-19T05:29:34.072 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:29:34.072 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:29:34.072 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:29:34.072 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:29:34.072 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:29:34.073 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:29:34.073 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:29:34.073 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_txc_items": 0, 2024-09-19T05:29:34.073 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:29:34.073 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:29:34.073 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:29:34.073 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_items": 0, 2024-09-19T05:29:34.073 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_bytes": 0, 2024-09-19T05:29:34.073 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_items": 0, 2024-09-19T05:29:34.073 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:29:34.073 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:29:34.073 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:29:34.073 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:29:34.073 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_anon_bytes": 148955, 2024-09-19T05:29:34.074 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_anon_items": 30, 2024-09-19T05:29:34.074 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:29:34.074 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_meta_items": 0, 2024-09-19T05:29:34.074 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_bytes": 0, 2024-09-19T05:29:34.074 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_items": 0, 2024-09-19T05:29:34.074 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:29:34.074 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mapbl_items": 0, 2024-09-19T05:29:34.074 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:29:34.074 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pglog_items": 0, 2024-09-19T05:29:34.074 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_bytes": 0, 2024-09-19T05:29:34.074 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_items": 0, 2024-09-19T05:29:34.074 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:29:34.074 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:29:34.074 INFO:teuthology.orchestra.run.smithi120.stdout: "pgmap_bytes": 0, 2024-09-19T05:29:34.075 INFO:teuthology.orchestra.run.smithi120.stdout: "pgmap_items": 0, 2024-09-19T05:29:34.075 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_co_bytes": 928, 2024-09-19T05:29:34.075 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_co_items": 2, 2024-09-19T05:29:34.075 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_1_bytes": 0, 2024-09-19T05:29:34.075 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_1_items": 0, 2024-09-19T05:29:34.075 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_2_bytes": 0, 2024-09-19T05:29:34.075 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_2_items": 0 2024-09-19T05:29:34.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:34.075 INFO:teuthology.orchestra.run.smithi120.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:29:34.075 INFO:teuthology.orchestra.run.smithi120.stdout: "val": 0, 2024-09-19T05:29:34.075 INFO:teuthology.orchestra.run.smithi120.stdout: "max": 104857600, 2024-09-19T05:29:34.075 INFO:teuthology.orchestra.run.smithi120.stdout: "get_started": 0, 2024-09-19T05:29:34.075 INFO:teuthology.orchestra.run.smithi120.stdout: "get": 215, 2024-09-19T05:29:34.075 INFO:teuthology.orchestra.run.smithi120.stdout: "get_sum": 1415875, 2024-09-19T05:29:34.076 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:34.076 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_success": 215, 2024-09-19T05:29:34.076 INFO:teuthology.orchestra.run.smithi120.stdout: "take": 0, 2024-09-19T05:29:34.076 INFO:teuthology.orchestra.run.smithi120.stdout: "take_sum": 0, 2024-09-19T05:29:34.076 INFO:teuthology.orchestra.run.smithi120.stdout: "put": 215, 2024-09-19T05:29:34.076 INFO:teuthology.orchestra.run.smithi120.stdout: "put_sum": 1415875, 2024-09-19T05:29:34.076 INFO:teuthology.orchestra.run.smithi120.stdout: "wait": { 2024-09-19T05:29:34.076 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-09-19T05:29:34.076 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-09-19T05:29:34.076 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-09-19T05:29:34.076 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:34.076 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:34.076 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T05:29:34.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:34 smithi120 ceph-mon[30956]: pgmap v320: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T05:29:34.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:34 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:29:34.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:34 smithi194 ceph-mon[35228]: pgmap v320: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T05:29:34.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:34 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:29:34.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:34 smithi178 ceph-mon[34347]: pgmap v320: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T05:29:34.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:34 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T05:29:34.740 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-19T05:29:34.740 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-19T05:29:34.741 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-19T05:29:34.741 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-19T05:29:34.741 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-19T05:29:34.741 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-19T05:29:34.741 DEBUG:tasks.check_counter:Getting stats from g 2024-09-19T05:29:34.741 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-19T05:29:35.663 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:29:36.063 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:35 smithi120 ceph-mon[30956]: pgmap v321: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T05:29:36.063 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:35 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:29:36.063 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:35 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:29:36.063 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:35 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:29:36.063 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:35 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:29:36.064 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:35 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:36.064 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:35 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:36.064 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:35 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:36.064 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:35 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:36.064 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:35 smithi120 ceph-mon[30956]: Adjusting osd_memory_target on smithi178 to 176.0M 2024-09-19T05:29:36.064 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:35 smithi120 ceph-mon[30956]: Unable to set osd_memory_target on smithi178 to 184549478: error parsing value: Value '184549478' is below minimum 939524096 2024-09-19T05:29:36.064 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:35 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:36.064 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:35 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:36.064 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:35 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:36.064 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:35 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:36.064 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:35 smithi120 ceph-mon[30956]: Adjusting osd_memory_target on smithi194 to 176.0M 2024-09-19T05:29:36.064 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:35 smithi120 ceph-mon[30956]: Unable to set osd_memory_target on smithi194 to 184584601: error parsing value: Value '184584601' is below minimum 939524096 2024-09-19T05:29:36.080 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T05:29:36.081 INFO:teuthology.orchestra.run.smithi120.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:29:36.081 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_messages": 0, 2024-09-19T05:29:36.081 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages": 2, 2024-09-19T05:29:36.081 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_bytes": 0, 2024-09-19T05:29:36.081 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_bytes": 0, 2024-09-19T05:29:36.081 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_created_connections": 4, 2024-09-19T05:29:36.081 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_active_connections": 0, 2024-09-19T05:29:36.081 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_total_time": 0.001441171, 2024-09-19T05:29:36.081 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T05:29:36.081 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_recv_time": 0.000396276, 2024-09-19T05:29:36.081 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:29:36.081 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:36.082 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-09-19T05:29:36.082 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-09-19T05:29:36.082 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-09-19T05:29:36.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:36.082 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:36.082 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-09-19T05:29:36.082 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-09-19T05:29:36.082 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-09-19T05:29:36.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:36.082 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T05:29:36.082 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T05:29:36.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:36.082 INFO:teuthology.orchestra.run.smithi120.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:29:36.083 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_messages": 210, 2024-09-19T05:29:36.083 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages": 200, 2024-09-19T05:29:36.083 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_bytes": 1445088, 2024-09-19T05:29:36.083 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_bytes": 122784, 2024-09-19T05:29:36.083 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_created_connections": 2, 2024-09-19T05:29:36.083 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_active_connections": 1, 2024-09-19T05:29:36.083 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_total_time": 0.036948091, 2024-09-19T05:29:36.083 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_send_time": 0.013530722, 2024-09-19T05:29:36.083 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_recv_time": 0.034775637, 2024-09-19T05:29:36.083 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:29:36.084 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:36.084 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 199, 2024-09-19T05:29:36.084 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.009674660, 2024-09-19T05:29:36.084 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000048616 2024-09-19T05:29:36.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:36.084 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:36.084 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-09-19T05:29:36.084 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-09-19T05:29:36.085 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-09-19T05:29:36.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:36.085 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_encrypted_bytes": 1445088, 2024-09-19T05:29:36.085 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_encrypted_bytes": 122784 2024-09-19T05:29:36.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:36.085 INFO:teuthology.orchestra.run.smithi120.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:29:36.085 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_messages": 6, 2024-09-19T05:29:36.085 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages": 155, 2024-09-19T05:29:36.085 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_bytes": 3264, 2024-09-19T05:29:36.085 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_bytes": 184416, 2024-09-19T05:29:36.085 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_created_connections": 5, 2024-09-19T05:29:36.085 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_active_connections": 3, 2024-09-19T05:29:36.085 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_total_time": 0.014547978, 2024-09-19T05:29:36.085 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_send_time": 0.008628747, 2024-09-19T05:29:36.086 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_recv_time": 0.003881023, 2024-09-19T05:29:36.086 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:29:36.086 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:36.086 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 153, 2024-09-19T05:29:36.086 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.012804272, 2024-09-19T05:29:36.086 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000083688 2024-09-19T05:29:36.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:36.086 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:36.086 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-09-19T05:29:36.086 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-09-19T05:29:36.086 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-09-19T05:29:36.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:36.086 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-09-19T05:29:36.086 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_encrypted_bytes": 184416 2024-09-19T05:29:36.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:36.087 INFO:teuthology.orchestra.run.smithi120.stdout: "cct": { 2024-09-19T05:29:36.087 INFO:teuthology.orchestra.run.smithi120.stdout: "total_workers": 0, 2024-09-19T05:29:36.087 INFO:teuthology.orchestra.run.smithi120.stdout: "unhealthy_workers": 0 2024-09-19T05:29:36.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:36.087 INFO:teuthology.orchestra.run.smithi120.stdout: "mempool": { 2024-09-19T05:29:36.087 INFO:teuthology.orchestra.run.smithi120.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:29:36.087 INFO:teuthology.orchestra.run.smithi120.stdout: "bloom_filter_items": 0, 2024-09-19T05:29:36.087 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:29:36.087 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:29:36.087 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:29:36.088 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:29:36.088 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:29:36.088 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:29:36.088 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:29:36.088 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:29:36.088 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:29:36.088 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:29:36.088 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:29:36.088 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:29:36.088 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:29:36.088 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_extent_items": 0, 2024-09-19T05:29:36.088 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:29:36.088 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_blob_items": 0, 2024-09-19T05:29:36.089 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:29:36.089 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:29:36.089 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:29:36.089 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:29:36.089 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:29:36.089 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:29:36.089 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:29:36.089 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_txc_items": 0, 2024-09-19T05:29:36.089 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:29:36.089 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:29:36.089 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:29:36.089 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_items": 0, 2024-09-19T05:29:36.089 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_bytes": 0, 2024-09-19T05:29:36.089 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_items": 0, 2024-09-19T05:29:36.089 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:29:36.090 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:29:36.090 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:29:36.090 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:29:36.090 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_anon_bytes": 149017, 2024-09-19T05:29:36.090 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_anon_items": 31, 2024-09-19T05:29:36.090 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:29:36.090 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_meta_items": 0, 2024-09-19T05:29:36.090 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_bytes": 0, 2024-09-19T05:29:36.090 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_items": 0, 2024-09-19T05:29:36.090 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:29:36.090 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mapbl_items": 0, 2024-09-19T05:29:36.090 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:29:36.090 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pglog_items": 0, 2024-09-19T05:29:36.090 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_bytes": 0, 2024-09-19T05:29:36.091 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_items": 0, 2024-09-19T05:29:36.091 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:29:36.091 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:29:36.091 INFO:teuthology.orchestra.run.smithi120.stdout: "pgmap_bytes": 0, 2024-09-19T05:29:36.091 INFO:teuthology.orchestra.run.smithi120.stdout: "pgmap_items": 0, 2024-09-19T05:29:36.091 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_co_bytes": 928, 2024-09-19T05:29:36.091 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_co_items": 2, 2024-09-19T05:29:36.091 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_1_bytes": 0, 2024-09-19T05:29:36.091 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_1_items": 0, 2024-09-19T05:29:36.091 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_2_bytes": 0, 2024-09-19T05:29:36.091 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_2_items": 0 2024-09-19T05:29:36.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:36.091 INFO:teuthology.orchestra.run.smithi120.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:29:36.091 INFO:teuthology.orchestra.run.smithi120.stdout: "val": 0, 2024-09-19T05:29:36.092 INFO:teuthology.orchestra.run.smithi120.stdout: "max": 104857600, 2024-09-19T05:29:36.092 INFO:teuthology.orchestra.run.smithi120.stdout: "get_started": 0, 2024-09-19T05:29:36.092 INFO:teuthology.orchestra.run.smithi120.stdout: "get": 212, 2024-09-19T05:29:36.092 INFO:teuthology.orchestra.run.smithi120.stdout: "get_sum": 1415485, 2024-09-19T05:29:36.092 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:36.092 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_success": 212, 2024-09-19T05:29:36.092 INFO:teuthology.orchestra.run.smithi120.stdout: "take": 0, 2024-09-19T05:29:36.092 INFO:teuthology.orchestra.run.smithi120.stdout: "take_sum": 0, 2024-09-19T05:29:36.092 INFO:teuthology.orchestra.run.smithi120.stdout: "put": 212, 2024-09-19T05:29:36.092 INFO:teuthology.orchestra.run.smithi120.stdout: "put_sum": 1415485, 2024-09-19T05:29:36.092 INFO:teuthology.orchestra.run.smithi120.stdout: "wait": { 2024-09-19T05:29:36.092 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-09-19T05:29:36.092 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-09-19T05:29:36.092 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-09-19T05:29:36.093 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:36.093 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:36.093 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T05:29:36.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:35 smithi194 ceph-mon[35228]: pgmap v321: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T05:29:36.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:35 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:29:36.157 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:35 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:29:36.157 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:35 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:29:36.157 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:35 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:29:36.157 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:35 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:36.157 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:35 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:36.157 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:35 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:36.157 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:35 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:36.158 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:35 smithi194 ceph-mon[35228]: Adjusting osd_memory_target on smithi178 to 176.0M 2024-09-19T05:29:36.158 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:35 smithi194 ceph-mon[35228]: Unable to set osd_memory_target on smithi178 to 184549478: error parsing value: Value '184549478' is below minimum 939524096 2024-09-19T05:29:36.158 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:35 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:36.159 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:35 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:36.159 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:35 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:36.159 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:35 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:36.159 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:35 smithi194 ceph-mon[35228]: Adjusting osd_memory_target on smithi194 to 176.0M 2024-09-19T05:29:36.159 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:35 smithi194 ceph-mon[35228]: Unable to set osd_memory_target on smithi194 to 184584601: error parsing value: Value '184584601' is below minimum 939524096 2024-09-19T05:29:36.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:35 smithi178 ceph-mon[34347]: pgmap v321: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T05:29:36.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:35 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:29:36.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:35 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:29:36.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:35 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:29:36.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:35 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:29:36.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:35 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:36.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:35 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:36.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:35 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:36.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:35 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:36.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:35 smithi178 ceph-mon[34347]: Adjusting osd_memory_target on smithi178 to 176.0M 2024-09-19T05:29:36.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:35 smithi178 ceph-mon[34347]: Unable to set osd_memory_target on smithi178 to 184549478: error parsing value: Value '184549478' is below minimum 939524096 2024-09-19T05:29:36.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:35 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:36.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:35 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:36.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:35 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:36.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:35 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:36.194 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:35 smithi178 ceph-mon[34347]: Adjusting osd_memory_target on smithi194 to 176.0M 2024-09-19T05:29:36.194 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:35 smithi178 ceph-mon[34347]: Unable to set osd_memory_target on smithi194 to 184584601: error parsing value: Value '184584601' is below minimum 939524096 2024-09-19T05:29:36.795 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-19T05:29:36.796 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-19T05:29:36.796 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-19T05:29:36.796 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-19T05:29:36.796 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-19T05:29:36.796 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-09-19T05:29:36.796 DEBUG:tasks.check_counter:Getting stats from j 2024-09-19T05:29:36.796 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-19T05:29:37.056 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:29:37.554 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-19T05:29:37.555 INFO:teuthology.orchestra.run.smithi120.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:29:37.555 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_messages": 0, 2024-09-19T05:29:37.555 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages": 2, 2024-09-19T05:29:37.555 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_bytes": 0, 2024-09-19T05:29:37.555 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_bytes": 0, 2024-09-19T05:29:37.555 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_created_connections": 4, 2024-09-19T05:29:37.555 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_active_connections": 0, 2024-09-19T05:29:37.555 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_total_time": 0.001147354, 2024-09-19T05:29:37.555 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T05:29:37.555 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_recv_time": 0.000212539, 2024-09-19T05:29:37.555 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:29:37.556 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:37.556 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-09-19T05:29:37.556 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-09-19T05:29:37.556 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-09-19T05:29:37.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:37.556 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:37.556 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-09-19T05:29:37.556 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-09-19T05:29:37.556 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-09-19T05:29:37.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:37.556 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T05:29:37.556 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T05:29:37.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:37.557 INFO:teuthology.orchestra.run.smithi120.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:29:37.557 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_messages": 215, 2024-09-19T05:29:37.557 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages": 205, 2024-09-19T05:29:37.557 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_bytes": 1446448, 2024-09-19T05:29:37.557 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_bytes": 125984, 2024-09-19T05:29:37.557 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_created_connections": 2, 2024-09-19T05:29:37.557 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_active_connections": 1, 2024-09-19T05:29:37.557 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_total_time": 0.041507621, 2024-09-19T05:29:37.557 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_send_time": 0.012266298, 2024-09-19T05:29:37.557 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_recv_time": 0.042095695, 2024-09-19T05:29:37.557 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:29:37.557 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:37.557 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 204, 2024-09-19T05:29:37.558 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.008659135, 2024-09-19T05:29:37.558 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000042446 2024-09-19T05:29:37.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:37.558 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:37.558 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-09-19T05:29:37.558 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-09-19T05:29:37.558 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-09-19T05:29:37.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:37.558 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_encrypted_bytes": 1446448, 2024-09-19T05:29:37.558 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_encrypted_bytes": 125984 2024-09-19T05:29:37.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:37.558 INFO:teuthology.orchestra.run.smithi120.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:29:37.558 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_messages": 6, 2024-09-19T05:29:37.558 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages": 159, 2024-09-19T05:29:37.559 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_bytes": 3264, 2024-09-19T05:29:37.559 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_bytes": 185120, 2024-09-19T05:29:37.559 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_created_connections": 5, 2024-09-19T05:29:37.559 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_active_connections": 3, 2024-09-19T05:29:37.559 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_total_time": 0.014134258, 2024-09-19T05:29:37.559 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_send_time": 0.008203990, 2024-09-19T05:29:37.559 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_recv_time": 0.004116581, 2024-09-19T05:29:37.559 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:29:37.559 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:37.559 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 157, 2024-09-19T05:29:37.559 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.016132859, 2024-09-19T05:29:37.559 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000102757 2024-09-19T05:29:37.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:37.560 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:37.560 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-09-19T05:29:37.560 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-09-19T05:29:37.560 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-09-19T05:29:37.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:37.560 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-09-19T05:29:37.560 INFO:teuthology.orchestra.run.smithi120.stdout: "msgr_send_encrypted_bytes": 185120 2024-09-19T05:29:37.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:37.560 INFO:teuthology.orchestra.run.smithi120.stdout: "cct": { 2024-09-19T05:29:37.560 INFO:teuthology.orchestra.run.smithi120.stdout: "total_workers": 0, 2024-09-19T05:29:37.560 INFO:teuthology.orchestra.run.smithi120.stdout: "unhealthy_workers": 0 2024-09-19T05:29:37.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:37.560 INFO:teuthology.orchestra.run.smithi120.stdout: "mempool": { 2024-09-19T05:29:37.561 INFO:teuthology.orchestra.run.smithi120.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:29:37.561 INFO:teuthology.orchestra.run.smithi120.stdout: "bloom_filter_items": 0, 2024-09-19T05:29:37.561 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:29:37.561 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:29:37.561 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:29:37.561 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:29:37.561 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:29:37.561 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:29:37.561 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:29:37.562 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:29:37.562 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:29:37.562 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:29:37.562 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:29:37.562 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:29:37.562 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:29:37.562 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_extent_items": 0, 2024-09-19T05:29:37.562 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:29:37.562 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_blob_items": 0, 2024-09-19T05:29:37.562 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:29:37.562 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:29:37.562 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:29:37.562 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:29:37.562 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:29:37.563 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:29:37.563 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:29:37.563 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_txc_items": 0, 2024-09-19T05:29:37.563 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:29:37.563 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:29:37.563 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:29:37.563 INFO:teuthology.orchestra.run.smithi120.stdout: "bluestore_writing_items": 0, 2024-09-19T05:29:37.563 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_bytes": 0, 2024-09-19T05:29:37.563 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_items": 0, 2024-09-19T05:29:37.563 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:29:37.563 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:29:37.563 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:29:37.563 INFO:teuthology.orchestra.run.smithi120.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:29:37.563 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_anon_bytes": 148984, 2024-09-19T05:29:37.564 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_anon_items": 30, 2024-09-19T05:29:37.564 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:29:37.564 INFO:teuthology.orchestra.run.smithi120.stdout: "buffer_meta_items": 0, 2024-09-19T05:29:37.564 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_bytes": 0, 2024-09-19T05:29:37.564 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_items": 0, 2024-09-19T05:29:37.564 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:29:37.564 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_mapbl_items": 0, 2024-09-19T05:29:37.564 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:29:37.564 INFO:teuthology.orchestra.run.smithi120.stdout: "osd_pglog_items": 0, 2024-09-19T05:29:37.564 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_bytes": 0, 2024-09-19T05:29:37.564 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_items": 0, 2024-09-19T05:29:37.564 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:29:37.564 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:29:37.565 INFO:teuthology.orchestra.run.smithi120.stdout: "pgmap_bytes": 0, 2024-09-19T05:29:37.565 INFO:teuthology.orchestra.run.smithi120.stdout: "pgmap_items": 0, 2024-09-19T05:29:37.565 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_co_bytes": 928, 2024-09-19T05:29:37.565 INFO:teuthology.orchestra.run.smithi120.stdout: "mds_co_items": 2, 2024-09-19T05:29:37.565 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_1_bytes": 0, 2024-09-19T05:29:37.565 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_1_items": 0, 2024-09-19T05:29:37.566 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_2_bytes": 0, 2024-09-19T05:29:37.566 INFO:teuthology.orchestra.run.smithi120.stdout: "unittest_2_items": 0 2024-09-19T05:29:37.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-19T05:29:37.566 INFO:teuthology.orchestra.run.smithi120.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:29:37.566 INFO:teuthology.orchestra.run.smithi120.stdout: "val": 0, 2024-09-19T05:29:37.566 INFO:teuthology.orchestra.run.smithi120.stdout: "max": 104857600, 2024-09-19T05:29:37.566 INFO:teuthology.orchestra.run.smithi120.stdout: "get_started": 0, 2024-09-19T05:29:37.566 INFO:teuthology.orchestra.run.smithi120.stdout: "get": 217, 2024-09-19T05:29:37.566 INFO:teuthology.orchestra.run.smithi120.stdout: "get_sum": 1416135, 2024-09-19T05:29:37.566 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:37.566 INFO:teuthology.orchestra.run.smithi120.stdout: "get_or_fail_success": 217, 2024-09-19T05:29:37.566 INFO:teuthology.orchestra.run.smithi120.stdout: "take": 0, 2024-09-19T05:29:37.566 INFO:teuthology.orchestra.run.smithi120.stdout: "take_sum": 0, 2024-09-19T05:29:37.566 INFO:teuthology.orchestra.run.smithi120.stdout: "put": 217, 2024-09-19T05:29:37.567 INFO:teuthology.orchestra.run.smithi120.stdout: "put_sum": 1416135, 2024-09-19T05:29:37.567 INFO:teuthology.orchestra.run.smithi120.stdout: "wait": { 2024-09-19T05:29:37.567 INFO:teuthology.orchestra.run.smithi120.stdout: "avgcount": 0, 2024-09-19T05:29:37.567 INFO:teuthology.orchestra.run.smithi120.stdout: "sum": 0.000000000, 2024-09-19T05:29:37.567 INFO:teuthology.orchestra.run.smithi120.stdout: "avgtime": 0.000000000 2024-09-19T05:29:37.567 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:37.567 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-19T05:29:37.567 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-19T05:29:38.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:37 smithi120 ceph-mon[30956]: pgmap v322: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T05:29:38.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:37 smithi120 ceph-mon[30956]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:29:38.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:37 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:29:38.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:37 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:29:38.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:37 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:38.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:37 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:38.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:37 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:38.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:37 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:38.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:37 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:29:38.127 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:37 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:29:38.127 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:37 smithi120 ceph-mon[30956]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:29:38.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:37 smithi194 ceph-mon[35228]: pgmap v322: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T05:29:38.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:37 smithi194 ceph-mon[35228]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:29:38.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:37 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:29:38.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:37 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:29:38.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:37 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:38.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:37 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:38.157 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:37 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:38.157 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:37 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:38.157 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:37 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:29:38.157 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:37 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:29:38.157 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:37 smithi194 ceph-mon[35228]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:29:38.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:37 smithi178 ceph-mon[34347]: pgmap v322: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T05:29:38.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:37 smithi178 ceph-mon[34347]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:29:38.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:37 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:29:38.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:37 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:29:38.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:37 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:38.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:37 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:38.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:37 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:38.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:37 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T05:29:38.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:37 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T05:29:38.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:37 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T05:29:38.193 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:37 smithi178 ceph-mon[34347]: from='mgr.15156 172.21.15.120:0/3902165561' entity='mgr.x' 2024-09-19T05:29:38.261 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-19T05:29:38.261 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-19T05:29:38.261 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-19T05:29:38.261 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-19T05:29:38.261 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-19T05:29:38.261 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-19T05:29:38.262 DEBUG:tasks.check_counter:Getting stats from b 2024-09-19T05:29:38.262 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-19T05:29:38.520 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:29:38.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:38 smithi178 ceph-mon[34347]: Adjusting osd_memory_target on smithi120 to 176.0M 2024-09-19T05:29:38.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:38 smithi178 ceph-mon[34347]: Unable to set osd_memory_target on smithi120 to 184562380: error parsing value: Value '184562380' is below minimum 939524096 2024-09-19T05:29:38.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:38 smithi178 ceph-mon[34347]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:29:39.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:38 smithi120 ceph-mon[30956]: Adjusting osd_memory_target on smithi120 to 176.0M 2024-09-19T05:29:39.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:38 smithi120 ceph-mon[30956]: Unable to set osd_memory_target on smithi120 to 184562380: error parsing value: Value '184562380' is below minimum 939524096 2024-09-19T05:29:39.126 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:38 smithi120 ceph-mon[30956]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:29:39.131 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2024-09-19T05:29:39.131 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:29:39.131 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 362816, 2024-09-19T05:29:39.131 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 113649, 2024-09-19T05:29:39.131 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 123785667, 2024-09-19T05:29:39.131 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 110462008, 2024-09-19T05:29:39.131 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 17, 2024-09-19T05:29:39.131 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 6, 2024-09-19T05:29:39.132 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 12.162184985, 2024-09-19T05:29:39.132 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 4.734431536, 2024-09-19T05:29:39.132 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 10.778341210, 2024-09-19T05:29:39.132 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.154013203, 2024-09-19T05:29:39.132 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:39.132 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 113645, 2024-09-19T05:29:39.132 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 3.732246594, 2024-09-19T05:29:39.132 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000032841 2024-09-19T05:29:39.132 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.132 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:39.132 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 453481, 2024-09-19T05:29:39.132 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.049916872, 2024-09-19T05:29:39.132 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000110 2024-09-19T05:29:39.132 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.133 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T05:29:39.133 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 312272 2024-09-19T05:29:39.133 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.133 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:29:39.133 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 35518, 2024-09-19T05:29:39.133 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 38383, 2024-09-19T05:29:39.133 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 19381442, 2024-09-19T05:29:39.133 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 58263442, 2024-09-19T05:29:39.133 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 12, 2024-09-19T05:29:39.133 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 10, 2024-09-19T05:29:39.133 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 2.058368465, 2024-09-19T05:29:39.133 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.894464558, 2024-09-19T05:29:39.134 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 1.280345999, 2024-09-19T05:29:39.134 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.107981379, 2024-09-19T05:29:39.134 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:39.134 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 38382, 2024-09-19T05:29:39.134 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 1.394373988, 2024-09-19T05:29:39.134 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000036328 2024-09-19T05:29:39.134 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.134 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:39.134 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 64804, 2024-09-19T05:29:39.134 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.008982052, 2024-09-19T05:29:39.134 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000138 2024-09-19T05:29:39.134 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.134 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 1548768, 2024-09-19T05:29:39.135 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 180224 2024-09-19T05:29:39.135 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.135 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:29:39.135 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 10770, 2024-09-19T05:29:39.135 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 11217, 2024-09-19T05:29:39.135 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 4732640, 2024-09-19T05:29:39.135 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 70165551, 2024-09-19T05:29:39.135 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 14, 2024-09-19T05:29:39.135 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 5, 2024-09-19T05:29:39.135 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.766405413, 2024-09-19T05:29:39.135 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.317506111, 2024-09-19T05:29:39.135 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.291569199, 2024-09-19T05:29:39.135 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.161939261, 2024-09-19T05:29:39.136 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:39.136 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 11217, 2024-09-19T05:29:39.136 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.652034807, 2024-09-19T05:29:39.136 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000058129 2024-09-19T05:29:39.136 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.136 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:39.136 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 9451, 2024-09-19T05:29:39.136 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.001405950, 2024-09-19T05:29:39.136 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000148 2024-09-19T05:29:39.136 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.136 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 6800, 2024-09-19T05:29:39.136 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 127376 2024-09-19T05:29:39.136 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.137 INFO:teuthology.orchestra.run.smithi178.stdout: "cct": { 2024-09-19T05:29:39.137 INFO:teuthology.orchestra.run.smithi178.stdout: "total_workers": 1, 2024-09-19T05:29:39.137 INFO:teuthology.orchestra.run.smithi178.stdout: "unhealthy_workers": 0 2024-09-19T05:29:39.137 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.137 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-MDSRank": { 2024-09-19T05:29:39.137 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-09-19T05:29:39.137 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-09-19T05:29:39.137 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 12509, 2024-09-19T05:29:39.137 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 10.770401567, 2024-09-19T05:29:39.138 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000861012 2024-09-19T05:29:39.138 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:39.138 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.138 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-PurgeQueue": { 2024-09-19T05:29:39.138 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-09-19T05:29:39.138 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-09-19T05:29:39.138 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 10734, 2024-09-19T05:29:39.138 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 1.403891876, 2024-09-19T05:29:39.138 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000130789 2024-09-19T05:29:39.138 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:39.138 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.138 INFO:teuthology.orchestra.run.smithi178.stdout: "mds": { 2024-09-19T05:29:39.138 INFO:teuthology.orchestra.run.smithi178.stdout: "request": 80227, 2024-09-19T05:29:39.139 INFO:teuthology.orchestra.run.smithi178.stdout: "reply": 78573, 2024-09-19T05:29:39.139 INFO:teuthology.orchestra.run.smithi178.stdout: "reply_latency": { 2024-09-19T05:29:39.139 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 78573, 2024-09-19T05:29:39.139 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 281.821750486, 2024-09-19T05:29:39.139 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.003586750 2024-09-19T05:29:39.139 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.139 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_reply": 0, 2024-09-19T05:29:39.139 INFO:teuthology.orchestra.run.smithi178.stdout: "forward": 1654, 2024-09-19T05:29:39.139 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_complete": 48, 2024-09-19T05:29:39.139 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_keys": 0, 2024-09-19T05:29:39.139 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_commit": 288, 2024-09-19T05:29:39.139 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_split": 24, 2024-09-19T05:29:39.140 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_merge": 0, 2024-09-19T05:29:39.140 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes": 3615, 2024-09-19T05:29:39.140 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_top": 5, 2024-09-19T05:29:39.140 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_bottom": 3, 2024-09-19T05:29:39.140 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pin_tail": 3607, 2024-09-19T05:29:39.140 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pinned": 3607, 2024-09-19T05:29:39.140 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_expired": 12257, 2024-09-19T05:29:39.140 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_with_caps": 5, 2024-09-19T05:29:39.140 INFO:teuthology.orchestra.run.smithi178.stdout: "caps": 5, 2024-09-19T05:29:39.140 INFO:teuthology.orchestra.run.smithi178.stdout: "subtrees": 4, 2024-09-19T05:29:39.140 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse": 171091, 2024-09-19T05:29:39.140 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_hit": 81106, 2024-09-19T05:29:39.140 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_forward": 1615, 2024-09-19T05:29:39.141 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_discover": 143, 2024-09-19T05:29:39.141 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_dir_fetch": 3, 2024-09-19T05:29:39.141 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_remote_ino": 0, 2024-09-19T05:29:39.141 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_lock": 9, 2024-09-19T05:29:39.141 INFO:teuthology.orchestra.run.smithi178.stdout: "load_cent": 0, 2024-09-19T05:29:39.141 INFO:teuthology.orchestra.run.smithi178.stdout: "q": 0, 2024-09-19T05:29:39.141 INFO:teuthology.orchestra.run.smithi178.stdout: "exported": 210, 2024-09-19T05:29:39.141 INFO:teuthology.orchestra.run.smithi178.stdout: "exported_inodes": 8939, 2024-09-19T05:29:39.141 INFO:teuthology.orchestra.run.smithi178.stdout: "imported": 72, 2024-09-19T05:29:39.141 INFO:teuthology.orchestra.run.smithi178.stdout: "imported_inodes": 8175, 2024-09-19T05:29:39.141 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_dir_fetch": 0, 2024-09-19T05:29:39.141 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_backtrace_fetch": 1616, 2024-09-19T05:29:39.141 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_peer_discover": 0, 2024-09-19T05:29:39.142 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rfiles": 3262, 2024-09-19T05:29:39.142 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rbytes": 63453519, 2024-09-19T05:29:39.142 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rsnaps": 6, 2024-09-19T05:29:39.142 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_fetch": 1616, 2024-09-19T05:29:39.142 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_set_tag": 0, 2024-09-19T05:29:39.142 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T05:29:39.142 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_inotable_repaired": 0, 2024-09-19T05:29:39.142 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_inodes": 0, 2024-09-19T05:29:39.142 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T05:29:39.142 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T05:29:39.142 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_file_inodes": 1616, 2024-09-19T05:29:39.142 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_inode_file_caps": 14, 2024-09-19T05:29:39.142 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_revoke": 2255, 2024-09-19T05:29:39.142 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_grant": 9825, 2024-09-19T05:29:39.143 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T05:29:39.143 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T05:29:39.143 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T05:29:39.143 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps": 276455, 2024-09-19T05:29:39.143 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps_dirty": 1807, 2024-09-19T05:29:39.143 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_cap_release": 183, 2024-09-19T05:29:39.143 INFO:teuthology.orchestra.run.smithi178.stdout: "process_request_cap_release": 18595 2024-09-19T05:29:39.143 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.143 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_cache": { 2024-09-19T05:29:39.143 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update": 0, 2024-09-19T05:29:39.143 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update_receipt": 0, 2024-09-19T05:29:39.143 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_try_discover": 0, 2024-09-19T05:29:39.143 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_send_discover": 195, 2024-09-19T05:29:39.144 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_handle_discover": 158, 2024-09-19T05:29:39.144 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays": 14, 2024-09-19T05:29:39.144 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_delayed": 0, 2024-09-19T05:29:39.144 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_enqueuing": 0, 2024-09-19T05:29:39.144 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_created": 5917, 2024-09-19T05:29:39.144 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_enqueued": 5903, 2024-09-19T05:29:39.144 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_reintegrated": 0, 2024-09-19T05:29:39.144 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_migrated": 0, 2024-09-19T05:29:39.144 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_processing": 0, 2024-09-19T05:29:39.144 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_enqueued": 0, 2024-09-19T05:29:39.144 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_prioritized": 0, 2024-09-19T05:29:39.144 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_started": 0, 2024-09-19T05:29:39.145 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_completed": 0, 2024-09-19T05:29:39.145 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_path": 0, 2024-09-19T05:29:39.145 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_inode": 0, 2024-09-19T05:29:39.145 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T05:29:39.145 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_exportdir": 225, 2024-09-19T05:29:39.145 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_flush": 0, 2024-09-19T05:29:39.145 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragmentdir": 24, 2024-09-19T05:29:39.145 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragstats": 0, 2024-09-19T05:29:39.145 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_inodestats": 0 2024-09-19T05:29:39.145 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.145 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_log": { 2024-09-19T05:29:39.145 INFO:teuthology.orchestra.run.smithi178.stdout: "evlrg": 0, 2024-09-19T05:29:39.146 INFO:teuthology.orchestra.run.smithi178.stdout: "evadd": 126334, 2024-09-19T05:29:39.146 INFO:teuthology.orchestra.run.smithi178.stdout: "evex": 19171, 2024-09-19T05:29:39.146 INFO:teuthology.orchestra.run.smithi178.stdout: "evtrm": 12291, 2024-09-19T05:29:39.146 INFO:teuthology.orchestra.run.smithi178.stdout: "ev": 114043, 2024-09-19T05:29:39.146 INFO:teuthology.orchestra.run.smithi178.stdout: "evexg": 0, 2024-09-19T05:29:39.146 INFO:teuthology.orchestra.run.smithi178.stdout: "evexd": 6880, 2024-09-19T05:29:39.146 INFO:teuthology.orchestra.run.smithi178.stdout: "segadd": 150, 2024-09-19T05:29:39.146 INFO:teuthology.orchestra.run.smithi178.stdout: "segex": 22, 2024-09-19T05:29:39.146 INFO:teuthology.orchestra.run.smithi178.stdout: "segtrm": 15, 2024-09-19T05:29:39.146 INFO:teuthology.orchestra.run.smithi178.stdout: "seg": 135, 2024-09-19T05:29:39.146 INFO:teuthology.orchestra.run.smithi178.stdout: "segmjr": 10, 2024-09-19T05:29:39.146 INFO:teuthology.orchestra.run.smithi178.stdout: "segexg": 0, 2024-09-19T05:29:39.146 INFO:teuthology.orchestra.run.smithi178.stdout: "segexd": 7, 2024-09-19T05:29:39.147 INFO:teuthology.orchestra.run.smithi178.stdout: "expos": 16984969, 2024-09-19T05:29:39.147 INFO:teuthology.orchestra.run.smithi178.stdout: "wrpos": 163199584, 2024-09-19T05:29:39.147 INFO:teuthology.orchestra.run.smithi178.stdout: "rdpos": 0, 2024-09-19T05:29:39.147 INFO:teuthology.orchestra.run.smithi178.stdout: "jlat": { 2024-09-19T05:29:39.147 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 5443, 2024-09-19T05:29:39.147 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 14.907947091, 2024-09-19T05:29:39.147 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.002738921 2024-09-19T05:29:39.147 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.147 INFO:teuthology.orchestra.run.smithi178.stdout: "replayed": 0 2024-09-19T05:29:39.147 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.147 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_mem": { 2024-09-19T05:29:39.147 INFO:teuthology.orchestra.run.smithi178.stdout: "ino": 1715, 2024-09-19T05:29:39.148 INFO:teuthology.orchestra.run.smithi178.stdout: "ino+": 12352, 2024-09-19T05:29:39.148 INFO:teuthology.orchestra.run.smithi178.stdout: "ino-": 10637, 2024-09-19T05:29:39.148 INFO:teuthology.orchestra.run.smithi178.stdout: "dir": 96, 2024-09-19T05:29:39.148 INFO:teuthology.orchestra.run.smithi178.stdout: "dir+": 406, 2024-09-19T05:29:39.148 INFO:teuthology.orchestra.run.smithi178.stdout: "dir-": 310, 2024-09-19T05:29:39.148 INFO:teuthology.orchestra.run.smithi178.stdout: "dn": 3615, 2024-09-19T05:29:39.148 INFO:teuthology.orchestra.run.smithi178.stdout: "dn+": 23581, 2024-09-19T05:29:39.148 INFO:teuthology.orchestra.run.smithi178.stdout: "dn-": 19966, 2024-09-19T05:29:39.148 INFO:teuthology.orchestra.run.smithi178.stdout: "cap": 5, 2024-09-19T05:29:39.148 INFO:teuthology.orchestra.run.smithi178.stdout: "cap+": 6022, 2024-09-19T05:29:39.148 INFO:teuthology.orchestra.run.smithi178.stdout: "cap-": 6017, 2024-09-19T05:29:39.148 INFO:teuthology.orchestra.run.smithi178.stdout: "rss": 107220, 2024-09-19T05:29:39.148 INFO:teuthology.orchestra.run.smithi178.stdout: "heap": 223520 2024-09-19T05:29:39.149 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.149 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_server": { 2024-09-19T05:29:39.149 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_client_request": 96338, 2024-09-19T05:29:39.149 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_server_request": 1267, 2024-09-19T05:29:39.149 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_request": 80227, 2024-09-19T05:29:39.149 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_session": 72, 2024-09-19T05:29:39.149 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_peer_request": 9713, 2024-09-19T05:29:39.149 INFO:teuthology.orchestra.run.smithi178.stdout: "req_create_latency": { 2024-09-19T05:29:39.149 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 1798, 2024-09-19T05:29:39.149 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 61.351608538, 2024-09-19T05:29:39.149 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.034122140 2024-09-19T05:29:39.149 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.149 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getattr_latency": { 2024-09-19T05:29:39.150 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 45, 2024-09-19T05:29:39.150 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 1.659691912, 2024-09-19T05:29:39.150 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.036882042 2024-09-19T05:29:39.150 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.150 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getfilelock_latency": { 2024-09-19T05:29:39.150 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.150 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.150 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.150 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.150 INFO:teuthology.orchestra.run.smithi178.stdout: "req_link_latency": { 2024-09-19T05:29:39.150 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.150 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.151 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.151 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.151 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookup_latency": { 2024-09-19T05:29:39.151 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 67573, 2024-09-19T05:29:39.151 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 137.740377401, 2024-09-19T05:29:39.151 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.002038393 2024-09-19T05:29:39.151 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.151 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookuphash_latency": { 2024-09-19T05:29:39.151 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.151 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.151 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.151 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.151 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupino_latency": { 2024-09-19T05:29:39.151 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.152 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.152 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.152 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.152 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupname_latency": { 2024-09-19T05:29:39.152 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.152 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.152 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.152 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.152 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupparent_latency": { 2024-09-19T05:29:39.152 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.152 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.152 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.152 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.152 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupsnap_latency": { 2024-09-19T05:29:39.153 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.153 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.153 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.153 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.153 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lssnap_latency": { 2024-09-19T05:29:39.153 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.154 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.154 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.154 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.154 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mkdir_latency": { 2024-09-19T05:29:39.154 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.154 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.154 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.154 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.154 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mknod_latency": { 2024-09-19T05:29:39.155 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.155 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.155 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.155 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.155 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mksnap_latency": { 2024-09-19T05:29:39.155 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.155 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.155 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.155 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.155 INFO:teuthology.orchestra.run.smithi178.stdout: "req_open_latency": { 2024-09-19T05:29:39.155 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 1350, 2024-09-19T05:29:39.156 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.485258244, 2024-09-19T05:29:39.156 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000359450 2024-09-19T05:29:39.156 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.156 INFO:teuthology.orchestra.run.smithi178.stdout: "req_readdir_latency": { 2024-09-19T05:29:39.156 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 461, 2024-09-19T05:29:39.156 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.460705530, 2024-09-19T05:29:39.156 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000999361 2024-09-19T05:29:39.156 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.156 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rename_latency": { 2024-09-19T05:29:39.156 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 1806, 2024-09-19T05:29:39.156 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 70.373007132, 2024-09-19T05:29:39.156 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.038966227 2024-09-19T05:29:39.157 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.157 INFO:teuthology.orchestra.run.smithi178.stdout: "req_renamesnap_latency": { 2024-09-19T05:29:39.157 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.157 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.157 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.157 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.157 INFO:teuthology.orchestra.run.smithi178.stdout: "req_snapdiff_latency": { 2024-09-19T05:29:39.157 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.157 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.157 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.157 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.157 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmdir_latency": { 2024-09-19T05:29:39.157 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 15, 2024-09-19T05:29:39.158 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.850403464, 2024-09-19T05:29:39.158 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.056693564 2024-09-19T05:29:39.158 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.158 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmsnap_latency": { 2024-09-19T05:29:39.158 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.158 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.158 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.158 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.158 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmxattr_latency": { 2024-09-19T05:29:39.158 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.158 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.158 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.158 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.159 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setattr_latency": { 2024-09-19T05:29:39.159 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.159 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.159 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.159 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.159 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setdirlayout_latency": { 2024-09-19T05:29:39.159 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.159 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.159 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.159 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.159 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setfilelock_latency": { 2024-09-19T05:29:39.159 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.159 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.159 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.160 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.160 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setlayout_latency": { 2024-09-19T05:29:39.160 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.160 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.160 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.160 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.160 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setxattr_latency": { 2024-09-19T05:29:39.160 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.160 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.160 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.160 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.160 INFO:teuthology.orchestra.run.smithi178.stdout: "req_symlink_latency": { 2024-09-19T05:29:39.161 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.161 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.161 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.161 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.161 INFO:teuthology.orchestra.run.smithi178.stdout: "req_unlink_latency": { 2024-09-19T05:29:39.161 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 5525, 2024-09-19T05:29:39.161 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 8.900698265, 2024-09-19T05:29:39.161 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.001610986 2024-09-19T05:29:39.161 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.161 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_revoke_eviction": 0, 2024-09-19T05:29:39.161 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_acquisition_throttle": 0, 2024-09-19T05:29:39.161 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getvxattr_latency": { 2024-09-19T05:29:39.161 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.162 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.162 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.162 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:39.162 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.162 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_sessions": { 2024-09-19T05:29:39.162 INFO:teuthology.orchestra.run.smithi178.stdout: "session_count": 2, 2024-09-19T05:29:39.162 INFO:teuthology.orchestra.run.smithi178.stdout: "session_add": 4, 2024-09-19T05:29:39.162 INFO:teuthology.orchestra.run.smithi178.stdout: "session_remove": 2, 2024-09-19T05:29:39.162 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_open": 2, 2024-09-19T05:29:39.162 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_stale": 0, 2024-09-19T05:29:39.162 INFO:teuthology.orchestra.run.smithi178.stdout: "total_load": 21254, 2024-09-19T05:29:39.162 INFO:teuthology.orchestra.run.smithi178.stdout: "average_load": 10627, 2024-09-19T05:29:39.162 INFO:teuthology.orchestra.run.smithi178.stdout: "avg_session_uptime": 599, 2024-09-19T05:29:39.163 INFO:teuthology.orchestra.run.smithi178.stdout: "mdthresh_evicted": 0 2024-09-19T05:29:39.163 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.163 INFO:teuthology.orchestra.run.smithi178.stdout: "mempool": { 2024-09-19T05:29:39.163 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:29:39.163 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_items": 0, 2024-09-19T05:29:39.163 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:29:39.163 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:29:39.163 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:29:39.163 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:29:39.163 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:29:39.163 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:29:39.163 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:29:39.163 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:29:39.163 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:29:39.164 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:29:39.164 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:29:39.164 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:29:39.164 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:29:39.164 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_items": 0, 2024-09-19T05:29:39.164 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:29:39.164 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_items": 0, 2024-09-19T05:29:39.164 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:29:39.164 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:29:39.164 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:29:39.164 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:29:39.164 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:29:39.165 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:29:39.165 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:29:39.165 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_items": 0, 2024-09-19T05:29:39.165 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:29:39.165 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:29:39.165 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:29:39.165 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_items": 0, 2024-09-19T05:29:39.165 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_bytes": 0, 2024-09-19T05:29:39.165 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_items": 0, 2024-09-19T05:29:39.165 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:29:39.165 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:29:39.165 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:29:39.165 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:29:39.165 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_bytes": 428699, 2024-09-19T05:29:39.166 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_items": 158, 2024-09-19T05:29:39.166 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:29:39.166 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_items": 0, 2024-09-19T05:29:39.166 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_bytes": 0, 2024-09-19T05:29:39.166 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_items": 0, 2024-09-19T05:29:39.166 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:29:39.166 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_items": 0, 2024-09-19T05:29:39.166 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:29:39.166 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_items": 0, 2024-09-19T05:29:39.166 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_bytes": 8480, 2024-09-19T05:29:39.166 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_items": 186, 2024-09-19T05:29:39.166 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:29:39.166 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:29:39.166 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_bytes": 0, 2024-09-19T05:29:39.167 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_items": 0, 2024-09-19T05:29:39.167 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_bytes": 6432902, 2024-09-19T05:29:39.167 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_items": 36899, 2024-09-19T05:29:39.167 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_bytes": 0, 2024-09-19T05:29:39.167 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_items": 0, 2024-09-19T05:29:39.167 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_bytes": 0, 2024-09-19T05:29:39.167 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_items": 0 2024-09-19T05:29:39.167 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.167 INFO:teuthology.orchestra.run.smithi178.stdout: "objecter": { 2024-09-19T05:29:39.167 INFO:teuthology.orchestra.run.smithi178.stdout: "op_active": 0, 2024-09-19T05:29:39.167 INFO:teuthology.orchestra.run.smithi178.stdout: "op_laggy": 0, 2024-09-19T05:29:39.167 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send": 15946, 2024-09-19T05:29:39.167 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send_bytes": 163962095, 2024-09-19T05:29:39.168 INFO:teuthology.orchestra.run.smithi178.stdout: "op_resend": 32, 2024-09-19T05:29:39.168 INFO:teuthology.orchestra.run.smithi178.stdout: "op_reply": 15946, 2024-09-19T05:29:39.168 INFO:teuthology.orchestra.run.smithi178.stdout: "op_latency": { 2024-09-19T05:29:39.168 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 15946, 2024-09-19T05:29:39.168 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 99.539053054, 2024-09-19T05:29:39.168 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.006242258 2024-09-19T05:29:39.168 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.168 INFO:teuthology.orchestra.run.smithi178.stdout: "op_inflight": 0, 2024-09-19T05:29:39.168 INFO:teuthology.orchestra.run.smithi178.stdout: "oplen_avg": { 2024-09-19T05:29:39.168 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 15946, 2024-09-19T05:29:39.168 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 19659 2024-09-19T05:29:39.168 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.169 INFO:teuthology.orchestra.run.smithi178.stdout: "op": 15946, 2024-09-19T05:29:39.169 INFO:teuthology.orchestra.run.smithi178.stdout: "op_r": 2072, 2024-09-19T05:29:39.169 INFO:teuthology.orchestra.run.smithi178.stdout: "op_w": 13874, 2024-09-19T05:29:39.169 INFO:teuthology.orchestra.run.smithi178.stdout: "op_rmw": 0, 2024-09-19T05:29:39.170 INFO:teuthology.orchestra.run.smithi178.stdout: "op_pg": 0, 2024-09-19T05:29:39.170 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_stat": 73, 2024-09-19T05:29:39.170 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_create": 1304, 2024-09-19T05:29:39.170 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_read": 314, 2024-09-19T05:29:39.170 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_write": 5757, 2024-09-19T05:29:39.170 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writefull": 204, 2024-09-19T05:29:39.170 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writesame": 0, 2024-09-19T05:29:39.170 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_append": 0, 2024-09-19T05:29:39.170 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_zero": 0, 2024-09-19T05:29:39.170 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_truncate": 24, 2024-09-19T05:29:39.170 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_delete": 5963, 2024-09-19T05:29:39.170 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_mapext": 0, 2024-09-19T05:29:39.170 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_sparse_read": 0, 2024-09-19T05:29:39.171 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_clonerange": 0, 2024-09-19T05:29:39.171 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_getxattr": 1617, 2024-09-19T05:29:39.171 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_setxattr": 2608, 2024-09-19T05:29:39.171 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_cmpxattr": 0, 2024-09-19T05:29:39.171 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_rmxattr": 0, 2024-09-19T05:29:39.171 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_resetxattrs": 0, 2024-09-19T05:29:39.171 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_call": 0, 2024-09-19T05:29:39.171 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_watch": 0, 2024-09-19T05:29:39.171 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_notify": 0, 2024-09-19T05:29:39.171 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T05:29:39.171 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls": 0, 2024-09-19T05:29:39.171 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls_filter": 0, 2024-09-19T05:29:39.171 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_other": 0, 2024-09-19T05:29:39.172 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_active": 0, 2024-09-19T05:29:39.172 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_send": 0, 2024-09-19T05:29:39.172 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_resend": 0, 2024-09-19T05:29:39.172 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_ping": 0, 2024-09-19T05:29:39.172 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_active": 0, 2024-09-19T05:29:39.172 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_send": 0, 2024-09-19T05:29:39.172 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_resend": 0, 2024-09-19T05:29:39.172 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_active": 0, 2024-09-19T05:29:39.172 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_send": 0, 2024-09-19T05:29:39.172 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_resend": 0, 2024-09-19T05:29:39.172 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_active": 0, 2024-09-19T05:29:39.172 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_send": 0, 2024-09-19T05:29:39.172 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_resend": 0, 2024-09-19T05:29:39.172 INFO:teuthology.orchestra.run.smithi178.stdout: "command_active": 0, 2024-09-19T05:29:39.173 INFO:teuthology.orchestra.run.smithi178.stdout: "command_send": 0, 2024-09-19T05:29:39.173 INFO:teuthology.orchestra.run.smithi178.stdout: "command_resend": 0, 2024-09-19T05:29:39.173 INFO:teuthology.orchestra.run.smithi178.stdout: "map_epoch": 93, 2024-09-19T05:29:39.173 INFO:teuthology.orchestra.run.smithi178.stdout: "map_full": 0, 2024-09-19T05:29:39.173 INFO:teuthology.orchestra.run.smithi178.stdout: "map_inc": 13, 2024-09-19T05:29:39.173 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_sessions": 12, 2024-09-19T05:29:39.173 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_open": 12, 2024-09-19T05:29:39.173 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_close": 0, 2024-09-19T05:29:39.173 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_laggy": 0, 2024-09-19T05:29:39.173 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_wr": 1206, 2024-09-19T05:29:39.173 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_rd": 190, 2024-09-19T05:29:39.173 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_del": 399 2024-09-19T05:29:39.173 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.174 INFO:teuthology.orchestra.run.smithi178.stdout: "oft": { 2024-09-19T05:29:39.174 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_objs": 1, 2024-09-19T05:29:39.174 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_kv_pairs": 0, 2024-09-19T05:29:39.174 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_updates": 0, 2024-09-19T05:29:39.174 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_removes": 0 2024-09-19T05:29:39.174 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.174 INFO:teuthology.orchestra.run.smithi178.stdout: "osd-slow-ops": { 2024-09-19T05:29:39.174 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_ops_count": 0 2024-09-19T05:29:39.174 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.174 INFO:teuthology.orchestra.run.smithi178.stdout: "purge_queue": { 2024-09-19T05:29:39.174 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops": 0, 2024-09-19T05:29:39.174 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops_high_water": 10, 2024-09-19T05:29:39.174 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing": 0, 2024-09-19T05:29:39.174 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_high_water": 10, 2024-09-19T05:29:39.175 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed_ops": 5911, 2024-09-19T05:29:39.175 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed": 5903, 2024-09-19T05:29:39.175 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_item_in_journal": 0 2024-09-19T05:29:39.175 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.175 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:29:39.175 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-19T05:29:39.175 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-09-19T05:29:39.175 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-19T05:29:39.175 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 409100, 2024-09-19T05:29:39.175 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 111062644, 2024-09-19T05:29:39.175 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:39.175 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 409100, 2024-09-19T05:29:39.175 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-09-19T05:29:39.176 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-09-19T05:29:39.176 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 409100, 2024-09-19T05:29:39.176 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 111062644, 2024-09-19T05:29:39.176 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-19T05:29:39.176 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.176 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.176 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.176 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:39.176 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.176 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_bytes": { 2024-09-19T05:29:39.176 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-19T05:29:39.176 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-09-19T05:29:39.176 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-19T05:29:39.177 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-09-19T05:29:39.177 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-09-19T05:29:39.177 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:39.177 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-09-19T05:29:39.177 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 15946, 2024-09-19T05:29:39.177 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 164711270, 2024-09-19T05:29:39.177 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 15946, 2024-09-19T05:29:39.177 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 164711270, 2024-09-19T05:29:39.177 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-19T05:29:39.177 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.177 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.177 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.177 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:39.178 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.178 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_ops": { 2024-09-19T05:29:39.178 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-19T05:29:39.178 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 1024, 2024-09-19T05:29:39.178 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-19T05:29:39.178 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-09-19T05:29:39.178 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-09-19T05:29:39.178 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:39.178 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-09-19T05:29:39.178 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 15946, 2024-09-19T05:29:39.178 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 15946, 2024-09-19T05:29:39.178 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 15946, 2024-09-19T05:29:39.178 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 15946, 2024-09-19T05:29:39.179 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-19T05:29:39.179 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.179 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.179 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.179 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:39.179 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.179 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle": { 2024-09-19T05:29:39.179 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-19T05:29:39.179 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-09-19T05:29:39.179 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-19T05:29:39.179 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 5903, 2024-09-19T05:29:39.179 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 753155, 2024-09-19T05:29:39.179 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:39.180 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 5903, 2024-09-19T05:29:39.180 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-09-19T05:29:39.180 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-09-19T05:29:39.180 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 314, 2024-09-19T05:29:39.180 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 753155, 2024-09-19T05:29:39.180 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-19T05:29:39.180 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.180 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.180 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.180 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:39.180 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:39.180 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle-0x55f17b5a0960": { 2024-09-19T05:29:39.180 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-19T05:29:39.181 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-09-19T05:29:39.181 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-19T05:29:39.181 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 126334, 2024-09-19T05:29:39.181 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 159005280, 2024-09-19T05:29:39.181 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:39.181 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 126334, 2024-09-19T05:29:39.181 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-09-19T05:29:39.181 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-09-19T05:29:39.181 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 5443, 2024-09-19T05:29:39.181 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 159005280, 2024-09-19T05:29:39.181 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-19T05:29:39.181 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:39.181 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:39.182 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:39.182 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:39.182 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:39.182 INFO:teuthology.orchestra.run.smithi178.stdout:} 2024-09-19T05:29:39.182 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:38 smithi194 ceph-mon[35228]: Adjusting osd_memory_target on smithi120 to 176.0M 2024-09-19T05:29:39.182 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:38 smithi194 ceph-mon[35228]: Unable to set osd_memory_target on smithi120 to 184562380: error parsing value: Value '184562380' is below minimum 939524096 2024-09-19T05:29:39.182 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:38 smithi194 ceph-mon[35228]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:29:39.901 INFO:tasks.check_counter:Daemon mds.b mds.exported=210 2024-09-19T05:29:39.901 INFO:tasks.check_counter:Daemon mds.b mds.imported=72 2024-09-19T05:29:39.901 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-19T05:29:39.902 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=0 2024-09-19T05:29:39.902 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T05:29:39.902 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=24 2024-09-19T05:29:39.902 DEBUG:tasks.check_counter:Getting stats from e 2024-09-19T05:29:39.902 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-19T05:29:39.925 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:39 smithi178 ceph-mon[34347]: pgmap v323: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T05:29:40.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:39 smithi120 ceph-mon[30956]: pgmap v323: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T05:29:40.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:39 smithi194 ceph-mon[35228]: pgmap v323: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-19T05:29:40.159 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:29:40.687 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2024-09-19T05:29:40.687 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:29:40.687 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 950, 2024-09-19T05:29:40.687 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 952, 2024-09-19T05:29:40.688 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 65477097, 2024-09-19T05:29:40.688 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 302164, 2024-09-19T05:29:40.688 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 8, 2024-09-19T05:29:40.688 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 4, 2024-09-19T05:29:40.688 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.105446479, 2024-09-19T05:29:40.688 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.020632181, 2024-09-19T05:29:40.688 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.053526006, 2024-09-19T05:29:40.688 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.024566248, 2024-09-19T05:29:40.688 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:40.688 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 950, 2024-09-19T05:29:40.688 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.032620720, 2024-09-19T05:29:40.688 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000034337 2024-09-19T05:29:40.688 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.689 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:40.689 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.689 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.689 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.689 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.689 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T05:29:40.689 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T05:29:40.689 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.689 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:29:40.689 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 676, 2024-09-19T05:29:40.689 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 777, 2024-09-19T05:29:40.689 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 72945406, 2024-09-19T05:29:40.689 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 578605, 2024-09-19T05:29:40.690 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 5, 2024-09-19T05:29:40.690 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 4, 2024-09-19T05:29:40.690 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.107015821, 2024-09-19T05:29:40.690 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.024496194, 2024-09-19T05:29:40.690 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.085585219, 2024-09-19T05:29:40.690 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.008234029, 2024-09-19T05:29:40.690 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:40.690 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 776, 2024-09-19T05:29:40.690 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.033432261, 2024-09-19T05:29:40.690 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000043082 2024-09-19T05:29:40.690 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.690 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:40.690 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.691 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.691 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.691 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.691 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 1532752, 2024-09-19T05:29:40.691 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 442496 2024-09-19T05:29:40.691 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.691 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:29:40.691 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 1162, 2024-09-19T05:29:40.691 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 1189, 2024-09-19T05:29:40.691 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 59075490, 2024-09-19T05:29:40.691 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 490278, 2024-09-19T05:29:40.691 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 8, 2024-09-19T05:29:40.691 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 6, 2024-09-19T05:29:40.692 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.135554813, 2024-09-19T05:29:40.692 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.031605961, 2024-09-19T05:29:40.692 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.060477775, 2024-09-19T05:29:40.692 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.033314737, 2024-09-19T05:29:40.693 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:40.693 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 1187, 2024-09-19T05:29:40.693 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.050095258, 2024-09-19T05:29:40.693 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000042203 2024-09-19T05:29:40.693 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.693 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:40.693 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.693 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.693 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.694 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.694 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-19T05:29:40.694 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 122352 2024-09-19T05:29:40.694 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.694 INFO:teuthology.orchestra.run.smithi178.stdout: "cct": { 2024-09-19T05:29:40.694 INFO:teuthology.orchestra.run.smithi178.stdout: "total_workers": 1, 2024-09-19T05:29:40.694 INFO:teuthology.orchestra.run.smithi178.stdout: "unhealthy_workers": 0 2024-09-19T05:29:40.694 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.694 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-MDSRank": { 2024-09-19T05:29:40.694 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-09-19T05:29:40.694 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-09-19T05:29:40.694 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 4220, 2024-09-19T05:29:40.694 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.114008381, 2024-09-19T05:29:40.694 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000027016 2024-09-19T05:29:40.695 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:40.695 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.695 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-PurgeQueue": { 2024-09-19T05:29:40.695 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-09-19T05:29:40.695 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-09-19T05:29:40.695 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.695 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.695 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.695 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:40.695 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.695 INFO:teuthology.orchestra.run.smithi178.stdout: "mds": { 2024-09-19T05:29:40.695 INFO:teuthology.orchestra.run.smithi178.stdout: "request": 0, 2024-09-19T05:29:40.695 INFO:teuthology.orchestra.run.smithi178.stdout: "reply": 0, 2024-09-19T05:29:40.696 INFO:teuthology.orchestra.run.smithi178.stdout: "reply_latency": { 2024-09-19T05:29:40.696 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.696 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.696 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.696 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.696 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_reply": 0, 2024-09-19T05:29:40.696 INFO:teuthology.orchestra.run.smithi178.stdout: "forward": 0, 2024-09-19T05:29:40.696 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_complete": 0, 2024-09-19T05:29:40.696 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_keys": 0, 2024-09-19T05:29:40.696 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_commit": 0, 2024-09-19T05:29:40.696 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_split": 0, 2024-09-19T05:29:40.696 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_merge": 0, 2024-09-19T05:29:40.697 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes": 13843, 2024-09-19T05:29:40.697 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_top": 1085, 2024-09-19T05:29:40.697 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_bottom": 12758, 2024-09-19T05:29:40.697 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pin_tail": 0, 2024-09-19T05:29:40.697 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pinned": 12293, 2024-09-19T05:29:40.697 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_expired": 0, 2024-09-19T05:29:40.697 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_with_caps": 0, 2024-09-19T05:29:40.697 INFO:teuthology.orchestra.run.smithi178.stdout: "caps": 0, 2024-09-19T05:29:40.697 INFO:teuthology.orchestra.run.smithi178.stdout: "subtrees": 1, 2024-09-19T05:29:40.697 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse": 0, 2024-09-19T05:29:40.697 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_hit": 0, 2024-09-19T05:29:40.697 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_forward": 0, 2024-09-19T05:29:40.697 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_discover": 0, 2024-09-19T05:29:40.698 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_dir_fetch": 0, 2024-09-19T05:29:40.698 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_remote_ino": 0, 2024-09-19T05:29:40.698 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_lock": 0, 2024-09-19T05:29:40.698 INFO:teuthology.orchestra.run.smithi178.stdout: "load_cent": 0, 2024-09-19T05:29:40.698 INFO:teuthology.orchestra.run.smithi178.stdout: "q": 0, 2024-09-19T05:29:40.698 INFO:teuthology.orchestra.run.smithi178.stdout: "exported": 0, 2024-09-19T05:29:40.698 INFO:teuthology.orchestra.run.smithi178.stdout: "exported_inodes": 0, 2024-09-19T05:29:40.698 INFO:teuthology.orchestra.run.smithi178.stdout: "imported": 0, 2024-09-19T05:29:40.698 INFO:teuthology.orchestra.run.smithi178.stdout: "imported_inodes": 0, 2024-09-19T05:29:40.698 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_dir_fetch": 0, 2024-09-19T05:29:40.698 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_backtrace_fetch": 0, 2024-09-19T05:29:40.698 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_peer_discover": 0, 2024-09-19T05:29:40.698 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rfiles": 0, 2024-09-19T05:29:40.699 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rbytes": 0, 2024-09-19T05:29:40.699 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rsnaps": 0, 2024-09-19T05:29:40.699 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T05:29:40.699 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_set_tag": 0, 2024-09-19T05:29:40.699 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T05:29:40.699 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_inotable_repaired": 0, 2024-09-19T05:29:40.699 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_inodes": 0, 2024-09-19T05:29:40.699 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T05:29:40.699 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T05:29:40.699 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_file_inodes": 0, 2024-09-19T05:29:40.699 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_inode_file_caps": 0, 2024-09-19T05:29:40.699 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T05:29:40.699 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_grant": 0, 2024-09-19T05:29:40.699 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T05:29:40.700 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T05:29:40.700 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T05:29:40.700 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps": 0, 2024-09-19T05:29:40.700 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps_dirty": 0, 2024-09-19T05:29:40.700 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_cap_release": 0, 2024-09-19T05:29:40.700 INFO:teuthology.orchestra.run.smithi178.stdout: "process_request_cap_release": 0 2024-09-19T05:29:40.700 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.700 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_cache": { 2024-09-19T05:29:40.700 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update": 0, 2024-09-19T05:29:40.700 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update_receipt": 0, 2024-09-19T05:29:40.700 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_try_discover": 0, 2024-09-19T05:29:40.700 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_send_discover": 0, 2024-09-19T05:29:40.700 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_handle_discover": 0, 2024-09-19T05:29:40.701 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays": 0, 2024-09-19T05:29:40.701 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_delayed": 0, 2024-09-19T05:29:40.701 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_enqueuing": 0, 2024-09-19T05:29:40.701 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_created": 0, 2024-09-19T05:29:40.701 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_enqueued": 0, 2024-09-19T05:29:40.701 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_reintegrated": 0, 2024-09-19T05:29:40.701 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_migrated": 0, 2024-09-19T05:29:40.701 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_processing": 0, 2024-09-19T05:29:40.701 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_enqueued": 0, 2024-09-19T05:29:40.701 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_prioritized": 0, 2024-09-19T05:29:40.701 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_started": 0, 2024-09-19T05:29:40.701 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_completed": 0, 2024-09-19T05:29:40.701 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_path": 0, 2024-09-19T05:29:40.701 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_inode": 0, 2024-09-19T05:29:40.702 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T05:29:40.702 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_exportdir": 0, 2024-09-19T05:29:40.702 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_flush": 0, 2024-09-19T05:29:40.702 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragmentdir": 0, 2024-09-19T05:29:40.702 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragstats": 0, 2024-09-19T05:29:40.702 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_inodestats": 0 2024-09-19T05:29:40.702 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.702 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_log": { 2024-09-19T05:29:40.702 INFO:teuthology.orchestra.run.smithi178.stdout: "evlrg": 0, 2024-09-19T05:29:40.702 INFO:teuthology.orchestra.run.smithi178.stdout: "evadd": 0, 2024-09-19T05:29:40.702 INFO:teuthology.orchestra.run.smithi178.stdout: "evex": 0, 2024-09-19T05:29:40.702 INFO:teuthology.orchestra.run.smithi178.stdout: "evtrm": 0, 2024-09-19T05:29:40.702 INFO:teuthology.orchestra.run.smithi178.stdout: "ev": 157227, 2024-09-19T05:29:40.702 INFO:teuthology.orchestra.run.smithi178.stdout: "evexg": 0, 2024-09-19T05:29:40.703 INFO:teuthology.orchestra.run.smithi178.stdout: "evexd": 0, 2024-09-19T05:29:40.703 INFO:teuthology.orchestra.run.smithi178.stdout: "segadd": 0, 2024-09-19T05:29:40.703 INFO:teuthology.orchestra.run.smithi178.stdout: "segex": 0, 2024-09-19T05:29:40.703 INFO:teuthology.orchestra.run.smithi178.stdout: "segtrm": 0, 2024-09-19T05:29:40.703 INFO:teuthology.orchestra.run.smithi178.stdout: "seg": 128, 2024-09-19T05:29:40.703 INFO:teuthology.orchestra.run.smithi178.stdout: "segmjr": 14, 2024-09-19T05:29:40.703 INFO:teuthology.orchestra.run.smithi178.stdout: "segexg": 0, 2024-09-19T05:29:40.703 INFO:teuthology.orchestra.run.smithi178.stdout: "segexd": 0, 2024-09-19T05:29:40.703 INFO:teuthology.orchestra.run.smithi178.stdout: "expos": 55480988, 2024-09-19T05:29:40.703 INFO:teuthology.orchestra.run.smithi178.stdout: "wrpos": 199449812, 2024-09-19T05:29:40.703 INFO:teuthology.orchestra.run.smithi178.stdout: "rdpos": 199437327, 2024-09-19T05:29:40.703 INFO:teuthology.orchestra.run.smithi178.stdout: "jlat": { 2024-09-19T05:29:40.703 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.703 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.704 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.704 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.704 INFO:teuthology.orchestra.run.smithi178.stdout: "replayed": 157227 2024-09-19T05:29:40.704 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.704 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_mem": { 2024-09-19T05:29:40.704 INFO:teuthology.orchestra.run.smithi178.stdout: "ino": 3217, 2024-09-19T05:29:40.704 INFO:teuthology.orchestra.run.smithi178.stdout: "ino+": 13607, 2024-09-19T05:29:40.704 INFO:teuthology.orchestra.run.smithi178.stdout: "ino-": 10390, 2024-09-19T05:29:40.704 INFO:teuthology.orchestra.run.smithi178.stdout: "dir": 146, 2024-09-19T05:29:40.704 INFO:teuthology.orchestra.run.smithi178.stdout: "dir+": 388, 2024-09-19T05:29:40.704 INFO:teuthology.orchestra.run.smithi178.stdout: "dir-": 242, 2024-09-19T05:29:40.704 INFO:teuthology.orchestra.run.smithi178.stdout: "dn": 13843, 2024-09-19T05:29:40.704 INFO:teuthology.orchestra.run.smithi178.stdout: "dn+": 24810, 2024-09-19T05:29:40.704 INFO:teuthology.orchestra.run.smithi178.stdout: "dn-": 10967, 2024-09-19T05:29:40.705 INFO:teuthology.orchestra.run.smithi178.stdout: "cap": 0, 2024-09-19T05:29:40.705 INFO:teuthology.orchestra.run.smithi178.stdout: "cap+": 0, 2024-09-19T05:29:40.705 INFO:teuthology.orchestra.run.smithi178.stdout: "cap-": 0, 2024-09-19T05:29:40.705 INFO:teuthology.orchestra.run.smithi178.stdout: "rss": 73396, 2024-09-19T05:29:40.705 INFO:teuthology.orchestra.run.smithi178.stdout: "heap": 215328 2024-09-19T05:29:40.705 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.705 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_server": { 2024-09-19T05:29:40.705 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_client_request": 0, 2024-09-19T05:29:40.705 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_server_request": 0, 2024-09-19T05:29:40.705 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_request": 0, 2024-09-19T05:29:40.705 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_session": 0, 2024-09-19T05:29:40.705 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_peer_request": 0, 2024-09-19T05:29:40.705 INFO:teuthology.orchestra.run.smithi178.stdout: "req_create_latency": { 2024-09-19T05:29:40.705 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.706 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.706 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.706 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.706 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getattr_latency": { 2024-09-19T05:29:40.706 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.706 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.706 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.706 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.706 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getfilelock_latency": { 2024-09-19T05:29:40.706 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.706 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.706 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.706 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.706 INFO:teuthology.orchestra.run.smithi178.stdout: "req_link_latency": { 2024-09-19T05:29:40.707 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.707 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.707 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.707 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.707 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookup_latency": { 2024-09-19T05:29:40.707 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.707 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.707 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.707 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.707 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookuphash_latency": { 2024-09-19T05:29:40.707 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.707 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.707 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.708 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.708 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupino_latency": { 2024-09-19T05:29:40.708 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.708 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.708 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.708 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.708 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupname_latency": { 2024-09-19T05:29:40.708 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.708 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.708 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.708 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.708 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupparent_latency": { 2024-09-19T05:29:40.708 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.708 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.709 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.709 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.709 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupsnap_latency": { 2024-09-19T05:29:40.709 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.709 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.709 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.709 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.709 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lssnap_latency": { 2024-09-19T05:29:40.709 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.709 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.709 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.709 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.710 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mkdir_latency": { 2024-09-19T05:29:40.710 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.710 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.710 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.710 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.710 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mknod_latency": { 2024-09-19T05:29:40.710 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.710 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.710 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.711 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.711 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mksnap_latency": { 2024-09-19T05:29:40.711 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.711 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.711 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.711 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.711 INFO:teuthology.orchestra.run.smithi178.stdout: "req_open_latency": { 2024-09-19T05:29:40.711 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.711 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.711 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.711 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.711 INFO:teuthology.orchestra.run.smithi178.stdout: "req_readdir_latency": { 2024-09-19T05:29:40.711 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.711 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.712 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.712 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.712 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rename_latency": { 2024-09-19T05:29:40.712 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.712 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.712 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.712 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.712 INFO:teuthology.orchestra.run.smithi178.stdout: "req_renamesnap_latency": { 2024-09-19T05:29:40.712 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.712 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.712 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.712 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.712 INFO:teuthology.orchestra.run.smithi178.stdout: "req_snapdiff_latency": { 2024-09-19T05:29:40.713 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.713 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.713 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.713 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.713 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmdir_latency": { 2024-09-19T05:29:40.713 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.713 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.713 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.713 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.713 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmsnap_latency": { 2024-09-19T05:29:40.713 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.713 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.713 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.714 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.714 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmxattr_latency": { 2024-09-19T05:29:40.714 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.714 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.714 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.714 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.714 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setattr_latency": { 2024-09-19T05:29:40.714 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.714 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.714 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.714 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.714 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setdirlayout_latency": { 2024-09-19T05:29:40.714 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.715 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.715 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.715 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.715 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setfilelock_latency": { 2024-09-19T05:29:40.715 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.715 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.715 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.715 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.715 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setlayout_latency": { 2024-09-19T05:29:40.715 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.715 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.715 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.715 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.716 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setxattr_latency": { 2024-09-19T05:29:40.716 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.716 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.716 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.716 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.716 INFO:teuthology.orchestra.run.smithi178.stdout: "req_symlink_latency": { 2024-09-19T05:29:40.716 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.716 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.716 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.716 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.716 INFO:teuthology.orchestra.run.smithi178.stdout: "req_unlink_latency": { 2024-09-19T05:29:40.716 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.716 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.717 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.717 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.717 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_revoke_eviction": 0, 2024-09-19T05:29:40.717 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_acquisition_throttle": 0, 2024-09-19T05:29:40.717 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getvxattr_latency": { 2024-09-19T05:29:40.717 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.717 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.717 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.717 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:40.717 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.717 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_sessions": { 2024-09-19T05:29:40.717 INFO:teuthology.orchestra.run.smithi178.stdout: "session_count": 2, 2024-09-19T05:29:40.717 INFO:teuthology.orchestra.run.smithi178.stdout: "session_add": 3, 2024-09-19T05:29:40.717 INFO:teuthology.orchestra.run.smithi178.stdout: "session_remove": 1, 2024-09-19T05:29:40.718 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_open": 3, 2024-09-19T05:29:40.718 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_stale": 0, 2024-09-19T05:29:40.718 INFO:teuthology.orchestra.run.smithi178.stdout: "total_load": 0, 2024-09-19T05:29:40.718 INFO:teuthology.orchestra.run.smithi178.stdout: "average_load": 0, 2024-09-19T05:29:40.718 INFO:teuthology.orchestra.run.smithi178.stdout: "avg_session_uptime": 2068, 2024-09-19T05:29:40.718 INFO:teuthology.orchestra.run.smithi178.stdout: "mdthresh_evicted": 0 2024-09-19T05:29:40.718 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.718 INFO:teuthology.orchestra.run.smithi178.stdout: "mempool": { 2024-09-19T05:29:40.718 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:29:40.718 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_items": 0, 2024-09-19T05:29:40.718 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:29:40.718 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:29:40.718 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:29:40.718 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:29:40.719 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:29:40.719 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:29:40.719 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:29:40.719 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:29:40.719 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:29:40.719 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:29:40.719 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:29:40.719 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:29:40.719 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:29:40.719 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_items": 0, 2024-09-19T05:29:40.719 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:29:40.719 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_items": 0, 2024-09-19T05:29:40.719 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:29:40.719 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:29:40.720 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:29:40.720 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:29:40.720 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:29:40.720 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:29:40.720 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:29:40.720 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_items": 0, 2024-09-19T05:29:40.720 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:29:40.720 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:29:40.720 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:29:40.720 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_items": 0, 2024-09-19T05:29:40.720 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_bytes": 0, 2024-09-19T05:29:40.720 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_items": 0, 2024-09-19T05:29:40.720 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:29:40.721 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:29:40.721 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:29:40.721 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:29:40.721 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_bytes": 232113, 2024-09-19T05:29:40.721 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_items": 76, 2024-09-19T05:29:40.721 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:29:40.721 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_items": 0, 2024-09-19T05:29:40.721 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_bytes": 0, 2024-09-19T05:29:40.721 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_items": 0, 2024-09-19T05:29:40.721 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:29:40.721 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_items": 0, 2024-09-19T05:29:40.721 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:29:40.721 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_items": 0, 2024-09-19T05:29:40.721 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_bytes": 8480, 2024-09-19T05:29:40.722 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_items": 186, 2024-09-19T05:29:40.722 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:29:40.722 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:29:40.722 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_bytes": 0, 2024-09-19T05:29:40.722 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_items": 0, 2024-09-19T05:29:40.722 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_bytes": 16725830, 2024-09-19T05:29:40.722 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_items": 91114, 2024-09-19T05:29:40.722 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_bytes": 0, 2024-09-19T05:29:40.722 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_items": 0, 2024-09-19T05:29:40.722 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_bytes": 0, 2024-09-19T05:29:40.722 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_items": 0 2024-09-19T05:29:40.722 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.722 INFO:teuthology.orchestra.run.smithi178.stdout: "objecter": { 2024-09-19T05:29:40.722 INFO:teuthology.orchestra.run.smithi178.stdout: "op_active": 0, 2024-09-19T05:29:40.723 INFO:teuthology.orchestra.run.smithi178.stdout: "op_laggy": 0, 2024-09-19T05:29:40.723 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send": 2535, 2024-09-19T05:29:40.723 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send_bytes": 21, 2024-09-19T05:29:40.723 INFO:teuthology.orchestra.run.smithi178.stdout: "op_resend": 3, 2024-09-19T05:29:40.723 INFO:teuthology.orchestra.run.smithi178.stdout: "op_reply": 2535, 2024-09-19T05:29:40.723 INFO:teuthology.orchestra.run.smithi178.stdout: "op_latency": { 2024-09-19T05:29:40.723 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 2535, 2024-09-19T05:29:40.723 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 1.832964209, 2024-09-19T05:29:40.723 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000723062 2024-09-19T05:29:40.723 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.723 INFO:teuthology.orchestra.run.smithi178.stdout: "op_inflight": 0, 2024-09-19T05:29:40.723 INFO:teuthology.orchestra.run.smithi178.stdout: "oplen_avg": { 2024-09-19T05:29:40.723 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 2535, 2024-09-19T05:29:40.723 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 2536 2024-09-19T05:29:40.724 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.724 INFO:teuthology.orchestra.run.smithi178.stdout: "op": 2535, 2024-09-19T05:29:40.724 INFO:teuthology.orchestra.run.smithi178.stdout: "op_r": 2535, 2024-09-19T05:29:40.724 INFO:teuthology.orchestra.run.smithi178.stdout: "op_w": 0, 2024-09-19T05:29:40.724 INFO:teuthology.orchestra.run.smithi178.stdout: "op_rmw": 0, 2024-09-19T05:29:40.724 INFO:teuthology.orchestra.run.smithi178.stdout: "op_pg": 0, 2024-09-19T05:29:40.724 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_stat": 1442, 2024-09-19T05:29:40.724 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_create": 0, 2024-09-19T05:29:40.724 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_read": 1091, 2024-09-19T05:29:40.724 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_write": 0, 2024-09-19T05:29:40.724 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writefull": 0, 2024-09-19T05:29:40.724 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writesame": 0, 2024-09-19T05:29:40.724 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_append": 0, 2024-09-19T05:29:40.725 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_zero": 0, 2024-09-19T05:29:40.725 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_truncate": 0, 2024-09-19T05:29:40.725 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_delete": 0, 2024-09-19T05:29:40.725 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_mapext": 0, 2024-09-19T05:29:40.725 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_sparse_read": 0, 2024-09-19T05:29:40.725 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_clonerange": 0, 2024-09-19T05:29:40.725 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_getxattr": 1, 2024-09-19T05:29:40.725 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_setxattr": 0, 2024-09-19T05:29:40.725 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_cmpxattr": 0, 2024-09-19T05:29:40.725 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_rmxattr": 0, 2024-09-19T05:29:40.725 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_resetxattrs": 0, 2024-09-19T05:29:40.725 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_call": 0, 2024-09-19T05:29:40.725 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_watch": 0, 2024-09-19T05:29:40.726 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_notify": 0, 2024-09-19T05:29:40.726 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T05:29:40.726 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls": 0, 2024-09-19T05:29:40.726 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls_filter": 0, 2024-09-19T05:29:40.726 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_other": 0, 2024-09-19T05:29:40.726 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_active": 0, 2024-09-19T05:29:40.726 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_send": 0, 2024-09-19T05:29:40.726 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_resend": 0, 2024-09-19T05:29:40.726 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_ping": 0, 2024-09-19T05:29:40.726 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_active": 0, 2024-09-19T05:29:40.726 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_send": 0, 2024-09-19T05:29:40.726 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_resend": 0, 2024-09-19T05:29:40.726 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_active": 0, 2024-09-19T05:29:40.727 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_send": 0, 2024-09-19T05:29:40.727 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_resend": 0, 2024-09-19T05:29:40.727 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_active": 0, 2024-09-19T05:29:40.727 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_send": 0, 2024-09-19T05:29:40.727 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_resend": 0, 2024-09-19T05:29:40.727 INFO:teuthology.orchestra.run.smithi178.stdout: "command_active": 0, 2024-09-19T05:29:40.727 INFO:teuthology.orchestra.run.smithi178.stdout: "command_send": 0, 2024-09-19T05:29:40.727 INFO:teuthology.orchestra.run.smithi178.stdout: "command_resend": 0, 2024-09-19T05:29:40.727 INFO:teuthology.orchestra.run.smithi178.stdout: "map_epoch": 93, 2024-09-19T05:29:40.727 INFO:teuthology.orchestra.run.smithi178.stdout: "map_full": 0, 2024-09-19T05:29:40.727 INFO:teuthology.orchestra.run.smithi178.stdout: "map_inc": 13, 2024-09-19T05:29:40.727 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_sessions": 10, 2024-09-19T05:29:40.727 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_open": 10, 2024-09-19T05:29:40.727 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_close": 0, 2024-09-19T05:29:40.728 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_laggy": 0, 2024-09-19T05:29:40.728 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_wr": 0, 2024-09-19T05:29:40.728 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_rd": 2, 2024-09-19T05:29:40.728 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_del": 0 2024-09-19T05:29:40.728 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.728 INFO:teuthology.orchestra.run.smithi178.stdout: "oft": { 2024-09-19T05:29:40.728 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_objs": 0, 2024-09-19T05:29:40.728 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_kv_pairs": 0, 2024-09-19T05:29:40.728 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_updates": 0, 2024-09-19T05:29:40.728 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_removes": 0 2024-09-19T05:29:40.728 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.728 INFO:teuthology.orchestra.run.smithi178.stdout: "osd-slow-ops": { 2024-09-19T05:29:40.728 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_ops_count": 0 2024-09-19T05:29:40.729 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.729 INFO:teuthology.orchestra.run.smithi178.stdout: "purge_queue": { 2024-09-19T05:29:40.729 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops": 0, 2024-09-19T05:29:40.729 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T05:29:40.729 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing": 0, 2024-09-19T05:29:40.729 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_high_water": 0, 2024-09-19T05:29:40.729 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed_ops": 0, 2024-09-19T05:29:40.729 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed": 0, 2024-09-19T05:29:40.729 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_item_in_journal": 0 2024-09-19T05:29:40.729 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.729 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:29:40.729 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-19T05:29:40.729 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-09-19T05:29:40.730 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-19T05:29:40.730 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 2784, 2024-09-19T05:29:40.730 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 197231899, 2024-09-19T05:29:40.730 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:40.730 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 2784, 2024-09-19T05:29:40.730 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-09-19T05:29:40.730 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-09-19T05:29:40.730 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 2784, 2024-09-19T05:29:40.730 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 197231899, 2024-09-19T05:29:40.730 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-19T05:29:40.730 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.730 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.730 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.731 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:40.731 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.731 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_bytes": { 2024-09-19T05:29:40.731 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-19T05:29:40.731 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-09-19T05:29:40.731 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-19T05:29:40.731 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-09-19T05:29:40.731 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-09-19T05:29:40.731 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:40.731 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-09-19T05:29:40.731 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 2535, 2024-09-19T05:29:40.731 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 195256571, 2024-09-19T05:29:40.731 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 2535, 2024-09-19T05:29:40.731 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 195256571, 2024-09-19T05:29:40.732 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-19T05:29:40.732 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.732 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.732 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.732 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:40.732 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.732 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_ops": { 2024-09-19T05:29:40.732 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-19T05:29:40.732 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 1024, 2024-09-19T05:29:40.732 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-19T05:29:40.732 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-09-19T05:29:40.732 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-09-19T05:29:40.732 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:40.733 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-09-19T05:29:40.733 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 2535, 2024-09-19T05:29:40.733 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 2535, 2024-09-19T05:29:40.733 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 2535, 2024-09-19T05:29:40.733 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 2535, 2024-09-19T05:29:40.733 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-19T05:29:40.733 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.733 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.733 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.733 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:40.733 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.733 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle": { 2024-09-19T05:29:40.733 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-19T05:29:40.734 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-09-19T05:29:40.734 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-19T05:29:40.734 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-09-19T05:29:40.734 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-09-19T05:29:40.734 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:40.734 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-09-19T05:29:40.734 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-09-19T05:29:40.734 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-09-19T05:29:40.734 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 0, 2024-09-19T05:29:40.734 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 0, 2024-09-19T05:29:40.734 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-19T05:29:40.734 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.734 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.734 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.735 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:40.735 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:40.735 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle-0x5652795c8b40": { 2024-09-19T05:29:40.735 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-19T05:29:40.735 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-09-19T05:29:40.735 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-19T05:29:40.735 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-09-19T05:29:40.735 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-09-19T05:29:40.735 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:40.735 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-09-19T05:29:40.735 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-09-19T05:29:40.735 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-09-19T05:29:40.735 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 0, 2024-09-19T05:29:40.735 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 0, 2024-09-19T05:29:40.736 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-19T05:29:40.736 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:40.736 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:40.736 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:40.736 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:40.736 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:40.736 INFO:teuthology.orchestra.run.smithi178.stdout:} 2024-09-19T05:29:41.495 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-19T05:29:41.495 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-19T05:29:41.495 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-09-19T05:29:41.495 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-19T05:29:41.495 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T05:29:41.495 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-09-19T05:29:41.496 DEBUG:tasks.check_counter:Getting stats from h 2024-09-19T05:29:41.496 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-19T05:29:41.779 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:29:42.050 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:41 smithi178 ceph-mon[34347]: pgmap v324: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T05:29:42.051 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:41 smithi178 ceph-mon[34347]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:29:42.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:41 smithi120 ceph-mon[30956]: pgmap v324: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T05:29:42.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:41 smithi120 ceph-mon[30956]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:29:42.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:41 smithi194 ceph-mon[35228]: pgmap v324: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-19T05:29:42.156 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:41 smithi194 ceph-mon[35228]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T05:29:42.299 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2024-09-19T05:29:42.299 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:29:42.299 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 1439, 2024-09-19T05:29:42.299 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 1439, 2024-09-19T05:29:42.299 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 50759649, 2024-09-19T05:29:42.299 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 456785, 2024-09-19T05:29:42.299 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 8, 2024-09-19T05:29:42.300 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 4, 2024-09-19T05:29:42.300 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.135403616, 2024-09-19T05:29:42.300 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.038645537, 2024-09-19T05:29:42.300 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.053646739, 2024-09-19T05:29:42.300 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.032790896, 2024-09-19T05:29:42.300 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:42.300 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 1438, 2024-09-19T05:29:42.300 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.051743207, 2024-09-19T05:29:42.300 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000035982 2024-09-19T05:29:42.300 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.300 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:42.300 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.300 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.301 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.301 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.301 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-19T05:29:42.301 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T05:29:42.301 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.301 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:29:42.301 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 554, 2024-09-19T05:29:42.301 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 707, 2024-09-19T05:29:42.301 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 58500828, 2024-09-19T05:29:42.301 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 609566, 2024-09-19T05:29:42.301 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 9, 2024-09-19T05:29:42.301 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 7, 2024-09-19T05:29:42.301 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.072958068, 2024-09-19T05:29:42.302 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.017283192, 2024-09-19T05:29:42.302 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.038526321, 2024-09-19T05:29:42.302 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.011966723, 2024-09-19T05:29:42.302 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:42.302 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 704, 2024-09-19T05:29:42.302 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.025718759, 2024-09-19T05:29:42.304 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000036532 2024-09-19T05:29:42.304 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.304 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:42.304 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.304 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.304 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.304 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.304 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T05:29:42.304 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 433968 2024-09-19T05:29:42.304 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.304 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:29:42.305 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 750, 2024-09-19T05:29:42.305 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 724, 2024-09-19T05:29:42.305 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 51995855, 2024-09-19T05:29:42.305 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 287778, 2024-09-19T05:29:42.305 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 5, 2024-09-19T05:29:42.305 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 4, 2024-09-19T05:29:42.305 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.094837431, 2024-09-19T05:29:42.306 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.023149138, 2024-09-19T05:29:42.306 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.069468663, 2024-09-19T05:29:42.306 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.012286873, 2024-09-19T05:29:42.306 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:42.306 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 723, 2024-09-19T05:29:42.306 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.023807752, 2024-09-19T05:29:42.306 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000032929 2024-09-19T05:29:42.306 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.306 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:42.306 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.306 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.306 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.306 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.307 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 1536672, 2024-09-19T05:29:42.307 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 127824 2024-09-19T05:29:42.307 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.307 INFO:teuthology.orchestra.run.smithi178.stdout: "cct": { 2024-09-19T05:29:42.307 INFO:teuthology.orchestra.run.smithi178.stdout: "total_workers": 1, 2024-09-19T05:29:42.307 INFO:teuthology.orchestra.run.smithi178.stdout: "unhealthy_workers": 0 2024-09-19T05:29:42.307 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.307 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-MDSRank": { 2024-09-19T05:29:42.307 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-09-19T05:29:42.307 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-09-19T05:29:42.307 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 4190, 2024-09-19T05:29:42.307 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.091574446, 2024-09-19T05:29:42.307 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000021855 2024-09-19T05:29:42.308 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:42.308 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.308 INFO:teuthology.orchestra.run.smithi178.stdout: "finisher-PurgeQueue": { 2024-09-19T05:29:42.308 INFO:teuthology.orchestra.run.smithi178.stdout: "queue_len": 0, 2024-09-19T05:29:42.308 INFO:teuthology.orchestra.run.smithi178.stdout: "complete_latency": { 2024-09-19T05:29:42.308 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.308 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.308 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.308 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:42.308 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.308 INFO:teuthology.orchestra.run.smithi178.stdout: "mds": { 2024-09-19T05:29:42.308 INFO:teuthology.orchestra.run.smithi178.stdout: "request": 0, 2024-09-19T05:29:42.308 INFO:teuthology.orchestra.run.smithi178.stdout: "reply": 0, 2024-09-19T05:29:42.308 INFO:teuthology.orchestra.run.smithi178.stdout: "reply_latency": { 2024-09-19T05:29:42.309 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.309 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.309 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.309 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.309 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_reply": 0, 2024-09-19T05:29:42.309 INFO:teuthology.orchestra.run.smithi178.stdout: "forward": 0, 2024-09-19T05:29:42.309 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_complete": 0, 2024-09-19T05:29:42.309 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_fetch_keys": 0, 2024-09-19T05:29:42.309 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_commit": 0, 2024-09-19T05:29:42.309 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_split": 0, 2024-09-19T05:29:42.309 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_merge": 0, 2024-09-19T05:29:42.309 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes": 10001, 2024-09-19T05:29:42.309 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_top": 452, 2024-09-19T05:29:42.310 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_bottom": 9549, 2024-09-19T05:29:42.310 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pin_tail": 0, 2024-09-19T05:29:42.310 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_pinned": 9355, 2024-09-19T05:29:42.310 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_expired": 1, 2024-09-19T05:29:42.310 INFO:teuthology.orchestra.run.smithi178.stdout: "inodes_with_caps": 0, 2024-09-19T05:29:42.310 INFO:teuthology.orchestra.run.smithi178.stdout: "caps": 0, 2024-09-19T05:29:42.310 INFO:teuthology.orchestra.run.smithi178.stdout: "subtrees": 1, 2024-09-19T05:29:42.310 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse": 0, 2024-09-19T05:29:42.310 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_hit": 0, 2024-09-19T05:29:42.311 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_forward": 0, 2024-09-19T05:29:42.311 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_discover": 0, 2024-09-19T05:29:42.311 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_dir_fetch": 0, 2024-09-19T05:29:42.311 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_remote_ino": 0, 2024-09-19T05:29:42.311 INFO:teuthology.orchestra.run.smithi178.stdout: "traverse_lock": 0, 2024-09-19T05:29:42.311 INFO:teuthology.orchestra.run.smithi178.stdout: "load_cent": 0, 2024-09-19T05:29:42.311 INFO:teuthology.orchestra.run.smithi178.stdout: "q": 0, 2024-09-19T05:29:42.311 INFO:teuthology.orchestra.run.smithi178.stdout: "exported": 0, 2024-09-19T05:29:42.311 INFO:teuthology.orchestra.run.smithi178.stdout: "exported_inodes": 0, 2024-09-19T05:29:42.312 INFO:teuthology.orchestra.run.smithi178.stdout: "imported": 0, 2024-09-19T05:29:42.312 INFO:teuthology.orchestra.run.smithi178.stdout: "imported_inodes": 0, 2024-09-19T05:29:42.312 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_dir_fetch": 0, 2024-09-19T05:29:42.312 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_backtrace_fetch": 0, 2024-09-19T05:29:42.312 INFO:teuthology.orchestra.run.smithi178.stdout: "openino_peer_discover": 0, 2024-09-19T05:29:42.312 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rfiles": 0, 2024-09-19T05:29:42.312 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rbytes": 0, 2024-09-19T05:29:42.312 INFO:teuthology.orchestra.run.smithi178.stdout: "root_rsnaps": 0, 2024-09-19T05:29:42.312 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T05:29:42.312 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_set_tag": 0, 2024-09-19T05:29:42.312 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T05:29:42.312 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_inotable_repaired": 0, 2024-09-19T05:29:42.312 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_inodes": 0, 2024-09-19T05:29:42.313 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T05:29:42.313 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T05:29:42.313 INFO:teuthology.orchestra.run.smithi178.stdout: "scrub_file_inodes": 0, 2024-09-19T05:29:42.313 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_inode_file_caps": 0, 2024-09-19T05:29:42.313 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T05:29:42.313 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_grant": 0, 2024-09-19T05:29:42.313 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T05:29:42.313 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T05:29:42.313 INFO:teuthology.orchestra.run.smithi178.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T05:29:42.313 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps": 0, 2024-09-19T05:29:42.313 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_caps_dirty": 0, 2024-09-19T05:29:42.313 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_cap_release": 0, 2024-09-19T05:29:42.313 INFO:teuthology.orchestra.run.smithi178.stdout: "process_request_cap_release": 0 2024-09-19T05:29:42.313 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.314 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_cache": { 2024-09-19T05:29:42.314 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update": 0, 2024-09-19T05:29:42.314 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_update_receipt": 0, 2024-09-19T05:29:42.314 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_try_discover": 0, 2024-09-19T05:29:42.314 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_send_discover": 0, 2024-09-19T05:29:42.314 INFO:teuthology.orchestra.run.smithi178.stdout: "dir_handle_discover": 0, 2024-09-19T05:29:42.314 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays": 0, 2024-09-19T05:29:42.314 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_delayed": 0, 2024-09-19T05:29:42.314 INFO:teuthology.orchestra.run.smithi178.stdout: "num_strays_enqueuing": 0, 2024-09-19T05:29:42.314 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_created": 0, 2024-09-19T05:29:42.314 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_enqueued": 0, 2024-09-19T05:29:42.314 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_reintegrated": 0, 2024-09-19T05:29:42.314 INFO:teuthology.orchestra.run.smithi178.stdout: "strays_migrated": 0, 2024-09-19T05:29:42.314 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_processing": 0, 2024-09-19T05:29:42.315 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_enqueued": 0, 2024-09-19T05:29:42.315 INFO:teuthology.orchestra.run.smithi178.stdout: "num_recovering_prioritized": 0, 2024-09-19T05:29:42.315 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_started": 0, 2024-09-19T05:29:42.315 INFO:teuthology.orchestra.run.smithi178.stdout: "recovery_completed": 0, 2024-09-19T05:29:42.315 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_path": 0, 2024-09-19T05:29:42.315 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_quiesce_inode": 0, 2024-09-19T05:29:42.315 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T05:29:42.315 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_exportdir": 0, 2024-09-19T05:29:42.315 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_flush": 0, 2024-09-19T05:29:42.315 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragmentdir": 0, 2024-09-19T05:29:42.315 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_fragstats": 0, 2024-09-19T05:29:42.315 INFO:teuthology.orchestra.run.smithi178.stdout: "ireq_inodestats": 0 2024-09-19T05:29:42.315 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.315 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_log": { 2024-09-19T05:29:42.316 INFO:teuthology.orchestra.run.smithi178.stdout: "evlrg": 0, 2024-09-19T05:29:42.316 INFO:teuthology.orchestra.run.smithi178.stdout: "evadd": 0, 2024-09-19T05:29:42.316 INFO:teuthology.orchestra.run.smithi178.stdout: "evex": 0, 2024-09-19T05:29:42.316 INFO:teuthology.orchestra.run.smithi178.stdout: "evtrm": 0, 2024-09-19T05:29:42.316 INFO:teuthology.orchestra.run.smithi178.stdout: "ev": 126334, 2024-09-19T05:29:42.316 INFO:teuthology.orchestra.run.smithi178.stdout: "evexg": 0, 2024-09-19T05:29:42.316 INFO:teuthology.orchestra.run.smithi178.stdout: "evexd": 0, 2024-09-19T05:29:42.316 INFO:teuthology.orchestra.run.smithi178.stdout: "segadd": 0, 2024-09-19T05:29:42.316 INFO:teuthology.orchestra.run.smithi178.stdout: "segex": 0, 2024-09-19T05:29:42.316 INFO:teuthology.orchestra.run.smithi178.stdout: "segtrm": 0, 2024-09-19T05:29:42.316 INFO:teuthology.orchestra.run.smithi178.stdout: "seg": 135, 2024-09-19T05:29:42.316 INFO:teuthology.orchestra.run.smithi178.stdout: "segmjr": 12, 2024-09-19T05:29:42.316 INFO:teuthology.orchestra.run.smithi178.stdout: "segexg": 0, 2024-09-19T05:29:42.317 INFO:teuthology.orchestra.run.smithi178.stdout: "segexd": 0, 2024-09-19T05:29:42.317 INFO:teuthology.orchestra.run.smithi178.stdout: "expos": 16984969, 2024-09-19T05:29:42.317 INFO:teuthology.orchestra.run.smithi178.stdout: "wrpos": 163199584, 2024-09-19T05:29:42.317 INFO:teuthology.orchestra.run.smithi178.stdout: "rdpos": 163194385, 2024-09-19T05:29:42.317 INFO:teuthology.orchestra.run.smithi178.stdout: "jlat": { 2024-09-19T05:29:42.317 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.317 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.317 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.317 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.317 INFO:teuthology.orchestra.run.smithi178.stdout: "replayed": 126334 2024-09-19T05:29:42.317 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.317 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_mem": { 2024-09-19T05:29:42.317 INFO:teuthology.orchestra.run.smithi178.stdout: "ino": 1780, 2024-09-19T05:29:42.317 INFO:teuthology.orchestra.run.smithi178.stdout: "ino+": 12135, 2024-09-19T05:29:42.318 INFO:teuthology.orchestra.run.smithi178.stdout: "ino-": 10355, 2024-09-19T05:29:42.318 INFO:teuthology.orchestra.run.smithi178.stdout: "dir": 81, 2024-09-19T05:29:42.318 INFO:teuthology.orchestra.run.smithi178.stdout: "dir+": 372, 2024-09-19T05:29:42.318 INFO:teuthology.orchestra.run.smithi178.stdout: "dir-": 291, 2024-09-19T05:29:42.318 INFO:teuthology.orchestra.run.smithi178.stdout: "dn": 10001, 2024-09-19T05:29:42.318 INFO:teuthology.orchestra.run.smithi178.stdout: "dn+": 22642, 2024-09-19T05:29:42.318 INFO:teuthology.orchestra.run.smithi178.stdout: "dn-": 12641, 2024-09-19T05:29:42.318 INFO:teuthology.orchestra.run.smithi178.stdout: "cap": 0, 2024-09-19T05:29:42.318 INFO:teuthology.orchestra.run.smithi178.stdout: "cap+": 0, 2024-09-19T05:29:42.318 INFO:teuthology.orchestra.run.smithi178.stdout: "cap-": 0, 2024-09-19T05:29:42.318 INFO:teuthology.orchestra.run.smithi178.stdout: "rss": 70012, 2024-09-19T05:29:42.318 INFO:teuthology.orchestra.run.smithi178.stdout: "heap": 215328 2024-09-19T05:29:42.318 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.318 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_server": { 2024-09-19T05:29:42.319 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_client_request": 0, 2024-09-19T05:29:42.319 INFO:teuthology.orchestra.run.smithi178.stdout: "dispatch_server_request": 0, 2024-09-19T05:29:42.319 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_request": 0, 2024-09-19T05:29:42.319 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_client_session": 0, 2024-09-19T05:29:42.319 INFO:teuthology.orchestra.run.smithi178.stdout: "handle_peer_request": 0, 2024-09-19T05:29:42.319 INFO:teuthology.orchestra.run.smithi178.stdout: "req_create_latency": { 2024-09-19T05:29:42.319 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.319 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.319 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.319 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.319 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getattr_latency": { 2024-09-19T05:29:42.319 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.319 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.319 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.320 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.320 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getfilelock_latency": { 2024-09-19T05:29:42.320 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.320 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.320 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.320 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.320 INFO:teuthology.orchestra.run.smithi178.stdout: "req_link_latency": { 2024-09-19T05:29:42.320 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.320 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.320 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.320 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.320 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookup_latency": { 2024-09-19T05:29:42.320 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.321 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.321 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.321 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.321 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookuphash_latency": { 2024-09-19T05:29:42.321 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.321 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.321 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.321 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.321 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupino_latency": { 2024-09-19T05:29:42.321 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.321 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.321 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.321 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.321 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupname_latency": { 2024-09-19T05:29:42.322 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.322 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.322 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.322 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.322 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupparent_latency": { 2024-09-19T05:29:42.322 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.322 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.322 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.322 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.322 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lookupsnap_latency": { 2024-09-19T05:29:42.322 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.322 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.322 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.322 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.323 INFO:teuthology.orchestra.run.smithi178.stdout: "req_lssnap_latency": { 2024-09-19T05:29:42.323 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.323 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.323 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.323 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.323 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mkdir_latency": { 2024-09-19T05:29:42.324 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.324 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.324 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.324 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.324 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mknod_latency": { 2024-09-19T05:29:42.324 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.324 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.324 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.324 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.324 INFO:teuthology.orchestra.run.smithi178.stdout: "req_mksnap_latency": { 2024-09-19T05:29:42.324 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.324 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.325 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.325 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.325 INFO:teuthology.orchestra.run.smithi178.stdout: "req_open_latency": { 2024-09-19T05:29:42.325 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.325 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.325 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.325 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.325 INFO:teuthology.orchestra.run.smithi178.stdout: "req_readdir_latency": { 2024-09-19T05:29:42.325 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.325 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.325 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.325 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.325 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rename_latency": { 2024-09-19T05:29:42.325 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.326 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.326 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.326 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.326 INFO:teuthology.orchestra.run.smithi178.stdout: "req_renamesnap_latency": { 2024-09-19T05:29:42.326 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.326 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.326 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.326 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.326 INFO:teuthology.orchestra.run.smithi178.stdout: "req_snapdiff_latency": { 2024-09-19T05:29:42.326 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.326 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.326 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.326 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.326 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmdir_latency": { 2024-09-19T05:29:42.327 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.327 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.327 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.327 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.327 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmsnap_latency": { 2024-09-19T05:29:42.327 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.327 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.327 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.327 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.327 INFO:teuthology.orchestra.run.smithi178.stdout: "req_rmxattr_latency": { 2024-09-19T05:29:42.327 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.327 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.328 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.328 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.328 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setattr_latency": { 2024-09-19T05:29:42.328 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.328 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.328 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.328 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.328 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setdirlayout_latency": { 2024-09-19T05:29:42.328 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.328 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.328 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.328 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.328 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setfilelock_latency": { 2024-09-19T05:29:42.329 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.329 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.329 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.329 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.329 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setlayout_latency": { 2024-09-19T05:29:42.329 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.329 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.329 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.329 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.329 INFO:teuthology.orchestra.run.smithi178.stdout: "req_setxattr_latency": { 2024-09-19T05:29:42.329 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.329 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.329 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.330 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.330 INFO:teuthology.orchestra.run.smithi178.stdout: "req_symlink_latency": { 2024-09-19T05:29:42.330 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.330 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.330 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.330 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.330 INFO:teuthology.orchestra.run.smithi178.stdout: "req_unlink_latency": { 2024-09-19T05:29:42.330 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.330 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.330 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.330 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.330 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_revoke_eviction": 0, 2024-09-19T05:29:42.330 INFO:teuthology.orchestra.run.smithi178.stdout: "cap_acquisition_throttle": 0, 2024-09-19T05:29:42.331 INFO:teuthology.orchestra.run.smithi178.stdout: "req_getvxattr_latency": { 2024-09-19T05:29:42.331 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.331 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.331 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.331 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:42.331 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.331 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_sessions": { 2024-09-19T05:29:42.331 INFO:teuthology.orchestra.run.smithi178.stdout: "session_count": 2, 2024-09-19T05:29:42.331 INFO:teuthology.orchestra.run.smithi178.stdout: "session_add": 4, 2024-09-19T05:29:42.331 INFO:teuthology.orchestra.run.smithi178.stdout: "session_remove": 2, 2024-09-19T05:29:42.331 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_open": 4, 2024-09-19T05:29:42.331 INFO:teuthology.orchestra.run.smithi178.stdout: "sessions_stale": 0, 2024-09-19T05:29:42.331 INFO:teuthology.orchestra.run.smithi178.stdout: "total_load": 0, 2024-09-19T05:29:42.331 INFO:teuthology.orchestra.run.smithi178.stdout: "average_load": 0, 2024-09-19T05:29:42.332 INFO:teuthology.orchestra.run.smithi178.stdout: "avg_session_uptime": 2552, 2024-09-19T05:29:42.332 INFO:teuthology.orchestra.run.smithi178.stdout: "mdthresh_evicted": 0 2024-09-19T05:29:42.332 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.332 INFO:teuthology.orchestra.run.smithi178.stdout: "mempool": { 2024-09-19T05:29:42.332 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:29:42.332 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_items": 0, 2024-09-19T05:29:42.332 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:29:42.332 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:29:42.332 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:29:42.332 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:29:42.332 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:29:42.332 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:29:42.332 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:29:42.333 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:29:42.333 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:29:42.333 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:29:42.333 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:29:42.333 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:29:42.333 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:29:42.333 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_items": 0, 2024-09-19T05:29:42.333 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:29:42.333 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_items": 0, 2024-09-19T05:29:42.333 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:29:42.333 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:29:42.333 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:29:42.333 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:29:42.333 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:29:42.334 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:29:42.334 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:29:42.334 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_items": 0, 2024-09-19T05:29:42.334 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:29:42.334 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:29:42.334 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:29:42.334 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_items": 0, 2024-09-19T05:29:42.334 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_bytes": 0, 2024-09-19T05:29:42.334 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_items": 0, 2024-09-19T05:29:42.334 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:29:42.334 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:29:42.334 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:29:42.334 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:29:42.335 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_bytes": 240232, 2024-09-19T05:29:42.335 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_items": 81, 2024-09-19T05:29:42.335 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:29:42.335 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_items": 0, 2024-09-19T05:29:42.335 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_bytes": 0, 2024-09-19T05:29:42.335 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_items": 0, 2024-09-19T05:29:42.335 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:29:42.335 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_items": 0, 2024-09-19T05:29:42.335 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:29:42.335 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_items": 0, 2024-09-19T05:29:42.335 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_bytes": 8480, 2024-09-19T05:29:42.335 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_items": 186, 2024-09-19T05:29:42.335 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:29:42.335 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:29:42.336 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_bytes": 0, 2024-09-19T05:29:42.336 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_items": 0, 2024-09-19T05:29:42.336 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_bytes": 10914543, 2024-09-19T05:29:42.336 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_items": 56784, 2024-09-19T05:29:42.336 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_bytes": 0, 2024-09-19T05:29:42.336 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_items": 0, 2024-09-19T05:29:42.336 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_bytes": 0, 2024-09-19T05:29:42.336 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_items": 0 2024-09-19T05:29:42.336 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.336 INFO:teuthology.orchestra.run.smithi178.stdout: "objecter": { 2024-09-19T05:29:42.336 INFO:teuthology.orchestra.run.smithi178.stdout: "op_active": 0, 2024-09-19T05:29:42.336 INFO:teuthology.orchestra.run.smithi178.stdout: "op_laggy": 0, 2024-09-19T05:29:42.336 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send": 2490, 2024-09-19T05:29:42.337 INFO:teuthology.orchestra.run.smithi178.stdout: "op_send_bytes": 21, 2024-09-19T05:29:42.337 INFO:teuthology.orchestra.run.smithi178.stdout: "op_resend": 3, 2024-09-19T05:29:42.337 INFO:teuthology.orchestra.run.smithi178.stdout: "op_reply": 2490, 2024-09-19T05:29:42.337 INFO:teuthology.orchestra.run.smithi178.stdout: "op_latency": { 2024-09-19T05:29:42.337 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 2490, 2024-09-19T05:29:42.337 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 1.415972354, 2024-09-19T05:29:42.337 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000568663 2024-09-19T05:29:42.337 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.337 INFO:teuthology.orchestra.run.smithi178.stdout: "op_inflight": 0, 2024-09-19T05:29:42.337 INFO:teuthology.orchestra.run.smithi178.stdout: "oplen_avg": { 2024-09-19T05:29:42.337 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 2490, 2024-09-19T05:29:42.337 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 2491 2024-09-19T05:29:42.337 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.338 INFO:teuthology.orchestra.run.smithi178.stdout: "op": 2490, 2024-09-19T05:29:42.338 INFO:teuthology.orchestra.run.smithi178.stdout: "op_r": 2490, 2024-09-19T05:29:42.338 INFO:teuthology.orchestra.run.smithi178.stdout: "op_w": 0, 2024-09-19T05:29:42.338 INFO:teuthology.orchestra.run.smithi178.stdout: "op_rmw": 0, 2024-09-19T05:29:42.338 INFO:teuthology.orchestra.run.smithi178.stdout: "op_pg": 0, 2024-09-19T05:29:42.338 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_stat": 1415, 2024-09-19T05:29:42.338 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_create": 0, 2024-09-19T05:29:42.338 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_read": 1073, 2024-09-19T05:29:42.338 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_write": 0, 2024-09-19T05:29:42.338 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writefull": 0, 2024-09-19T05:29:42.338 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_writesame": 0, 2024-09-19T05:29:42.338 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_append": 0, 2024-09-19T05:29:42.338 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_zero": 0, 2024-09-19T05:29:42.338 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_truncate": 0, 2024-09-19T05:29:42.339 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_delete": 0, 2024-09-19T05:29:42.339 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_mapext": 0, 2024-09-19T05:29:42.339 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_sparse_read": 0, 2024-09-19T05:29:42.339 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_clonerange": 0, 2024-09-19T05:29:42.339 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_getxattr": 1, 2024-09-19T05:29:42.339 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_setxattr": 0, 2024-09-19T05:29:42.339 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_cmpxattr": 0, 2024-09-19T05:29:42.339 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_rmxattr": 0, 2024-09-19T05:29:42.339 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_resetxattrs": 0, 2024-09-19T05:29:42.339 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_call": 0, 2024-09-19T05:29:42.339 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_watch": 0, 2024-09-19T05:29:42.339 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_notify": 0, 2024-09-19T05:29:42.339 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T05:29:42.339 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls": 0, 2024-09-19T05:29:42.340 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_pgls_filter": 0, 2024-09-19T05:29:42.340 INFO:teuthology.orchestra.run.smithi178.stdout: "osdop_other": 0, 2024-09-19T05:29:42.340 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_active": 0, 2024-09-19T05:29:42.340 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_send": 0, 2024-09-19T05:29:42.340 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_resend": 0, 2024-09-19T05:29:42.340 INFO:teuthology.orchestra.run.smithi178.stdout: "linger_ping": 0, 2024-09-19T05:29:42.340 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_active": 0, 2024-09-19T05:29:42.340 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_send": 0, 2024-09-19T05:29:42.340 INFO:teuthology.orchestra.run.smithi178.stdout: "poolop_resend": 0, 2024-09-19T05:29:42.340 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_active": 0, 2024-09-19T05:29:42.340 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_send": 0, 2024-09-19T05:29:42.340 INFO:teuthology.orchestra.run.smithi178.stdout: "poolstat_resend": 0, 2024-09-19T05:29:42.340 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_active": 0, 2024-09-19T05:29:42.341 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_send": 0, 2024-09-19T05:29:42.341 INFO:teuthology.orchestra.run.smithi178.stdout: "statfs_resend": 0, 2024-09-19T05:29:42.341 INFO:teuthology.orchestra.run.smithi178.stdout: "command_active": 0, 2024-09-19T05:29:42.341 INFO:teuthology.orchestra.run.smithi178.stdout: "command_send": 0, 2024-09-19T05:29:42.341 INFO:teuthology.orchestra.run.smithi178.stdout: "command_resend": 0, 2024-09-19T05:29:42.341 INFO:teuthology.orchestra.run.smithi178.stdout: "map_epoch": 93, 2024-09-19T05:29:42.341 INFO:teuthology.orchestra.run.smithi178.stdout: "map_full": 0, 2024-09-19T05:29:42.341 INFO:teuthology.orchestra.run.smithi178.stdout: "map_inc": 13, 2024-09-19T05:29:42.341 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_sessions": 11, 2024-09-19T05:29:42.341 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_open": 11, 2024-09-19T05:29:42.341 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_session_close": 0, 2024-09-19T05:29:42.341 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_laggy": 0, 2024-09-19T05:29:42.341 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_wr": 0, 2024-09-19T05:29:42.341 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_rd": 2, 2024-09-19T05:29:42.342 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_del": 0 2024-09-19T05:29:42.342 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.342 INFO:teuthology.orchestra.run.smithi178.stdout: "oft": { 2024-09-19T05:29:42.342 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_objs": 0, 2024-09-19T05:29:42.342 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_kv_pairs": 0, 2024-09-19T05:29:42.342 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_updates": 0, 2024-09-19T05:29:42.342 INFO:teuthology.orchestra.run.smithi178.stdout: "omap_total_removes": 0 2024-09-19T05:29:42.342 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.342 INFO:teuthology.orchestra.run.smithi178.stdout: "osd-slow-ops": { 2024-09-19T05:29:42.342 INFO:teuthology.orchestra.run.smithi178.stdout: "slow_ops_count": 0 2024-09-19T05:29:42.342 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.342 INFO:teuthology.orchestra.run.smithi178.stdout: "purge_queue": { 2024-09-19T05:29:42.342 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops": 0, 2024-09-19T05:29:42.343 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T05:29:42.343 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing": 0, 2024-09-19T05:29:42.343 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executing_high_water": 0, 2024-09-19T05:29:42.343 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed_ops": 0, 2024-09-19T05:29:42.343 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_executed": 0, 2024-09-19T05:29:42.343 INFO:teuthology.orchestra.run.smithi178.stdout: "pq_item_in_journal": 0 2024-09-19T05:29:42.343 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.343 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:29:42.343 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-19T05:29:42.343 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-09-19T05:29:42.343 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-19T05:29:42.343 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 2739, 2024-09-19T05:29:42.343 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 160994287, 2024-09-19T05:29:42.343 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:42.344 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 2739, 2024-09-19T05:29:42.344 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-09-19T05:29:42.344 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-09-19T05:29:42.344 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 2739, 2024-09-19T05:29:42.344 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 160994287, 2024-09-19T05:29:42.344 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-19T05:29:42.344 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.344 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.344 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.344 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:42.344 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.345 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_bytes": { 2024-09-19T05:29:42.345 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-19T05:29:42.345 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-09-19T05:29:42.345 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-19T05:29:42.345 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-09-19T05:29:42.345 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-09-19T05:29:42.345 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:42.345 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-09-19T05:29:42.345 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 2490, 2024-09-19T05:29:42.345 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 159022942, 2024-09-19T05:29:42.346 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 2490, 2024-09-19T05:29:42.346 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 159022942, 2024-09-19T05:29:42.346 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-19T05:29:42.346 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.346 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.346 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.346 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:42.346 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.346 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-objecter_ops": { 2024-09-19T05:29:42.346 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-19T05:29:42.346 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 1024, 2024-09-19T05:29:42.346 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-19T05:29:42.347 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-09-19T05:29:42.347 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-09-19T05:29:42.347 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:42.347 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-09-19T05:29:42.347 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 2490, 2024-09-19T05:29:42.347 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 2490, 2024-09-19T05:29:42.347 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 2490, 2024-09-19T05:29:42.347 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 2490, 2024-09-19T05:29:42.347 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-19T05:29:42.347 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.347 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.347 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.347 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:42.348 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.348 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle": { 2024-09-19T05:29:42.348 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-19T05:29:42.348 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-09-19T05:29:42.348 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-19T05:29:42.348 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-09-19T05:29:42.348 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-09-19T05:29:42.348 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:42.348 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-09-19T05:29:42.348 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-09-19T05:29:42.348 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-09-19T05:29:42.348 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 0, 2024-09-19T05:29:42.348 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 0, 2024-09-19T05:29:42.349 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-19T05:29:42.349 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.349 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.349 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.349 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:42.349 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:42.349 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-write_buf_throttle-0x5621a624cb40": { 2024-09-19T05:29:42.349 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-19T05:29:42.349 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 3758096384, 2024-09-19T05:29:42.349 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-19T05:29:42.349 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 0, 2024-09-19T05:29:42.349 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 0, 2024-09-19T05:29:42.349 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:42.350 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 0, 2024-09-19T05:29:42.350 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-09-19T05:29:42.350 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-09-19T05:29:42.350 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 0, 2024-09-19T05:29:42.350 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 0, 2024-09-19T05:29:42.350 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-19T05:29:42.350 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:42.350 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:42.350 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:42.350 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:42.350 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:42.350 INFO:teuthology.orchestra.run.smithi178.stdout:} 2024-09-19T05:29:43.071 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-19T05:29:43.071 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-19T05:29:43.071 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=0 2024-09-19T05:29:43.071 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-19T05:29:43.071 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T05:29:43.072 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-09-19T05:29:43.072 DEBUG:tasks.check_counter:Getting stats from k 2024-09-19T05:29:43.072 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-19T05:29:43.318 INFO:teuthology.orchestra.run.smithi178.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T05:29:43.758 INFO:teuthology.orchestra.run.smithi178.stdout:{ 2024-09-19T05:29:43.758 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:29:43.758 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 0, 2024-09-19T05:29:43.758 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 2, 2024-09-19T05:29:43.758 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 0, 2024-09-19T05:29:43.758 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 0, 2024-09-19T05:29:43.758 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 4, 2024-09-19T05:29:43.758 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 0, 2024-09-19T05:29:43.758 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.001005860, 2024-09-19T05:29:43.758 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T05:29:43.758 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.000231311, 2024-09-19T05:29:43.759 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:29:43.759 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:43.759 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:43.759 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:43.759 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:43.759 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:43.759 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:43.759 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:43.759 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:43.759 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:43.759 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:43.759 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T05:29:43.759 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T05:29:43.759 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:43.760 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:29:43.760 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 221, 2024-09-19T05:29:43.760 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 209, 2024-09-19T05:29:43.760 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 1449936, 2024-09-19T05:29:43.760 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 127712, 2024-09-19T05:29:43.760 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 2, 2024-09-19T05:29:43.760 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 1, 2024-09-19T05:29:43.760 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.039692055, 2024-09-19T05:29:43.760 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.012619136, 2024-09-19T05:29:43.760 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.040003958, 2024-09-19T05:29:43.760 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:29:43.760 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:43.760 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 209, 2024-09-19T05:29:43.761 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.014638542, 2024-09-19T05:29:43.761 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000070040 2024-09-19T05:29:43.761 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:43.761 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:43.761 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:43.761 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:43.761 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:43.761 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:43.761 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 1449936, 2024-09-19T05:29:43.761 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 127712 2024-09-19T05:29:43.761 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:43.761 INFO:teuthology.orchestra.run.smithi178.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:29:43.761 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_messages": 2, 2024-09-19T05:29:43.761 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages": 159, 2024-09-19T05:29:43.762 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_bytes": 320, 2024-09-19T05:29:43.762 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_bytes": 185024, 2024-09-19T05:29:43.762 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_created_connections": 5, 2024-09-19T05:29:43.762 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_active_connections": 3, 2024-09-19T05:29:43.762 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_total_time": 0.009412113, 2024-09-19T05:29:43.762 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_send_time": 0.006129478, 2024-09-19T05:29:43.762 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_recv_time": 0.001380441, 2024-09-19T05:29:43.762 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:29:43.762 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:43.762 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 156, 2024-09-19T05:29:43.763 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.014512876, 2024-09-19T05:29:43.763 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000093031 2024-09-19T05:29:43.763 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:43.763 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:43.763 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:43.763 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:43.763 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:43.763 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:43.763 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T05:29:43.763 INFO:teuthology.orchestra.run.smithi178.stdout: "msgr_send_encrypted_bytes": 185024 2024-09-19T05:29:43.763 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:43.763 INFO:teuthology.orchestra.run.smithi178.stdout: "cct": { 2024-09-19T05:29:43.763 INFO:teuthology.orchestra.run.smithi178.stdout: "total_workers": 0, 2024-09-19T05:29:43.763 INFO:teuthology.orchestra.run.smithi178.stdout: "unhealthy_workers": 0 2024-09-19T05:29:43.764 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:43.764 INFO:teuthology.orchestra.run.smithi178.stdout: "mempool": { 2024-09-19T05:29:43.764 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:29:43.764 INFO:teuthology.orchestra.run.smithi178.stdout: "bloom_filter_items": 0, 2024-09-19T05:29:43.764 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:29:43.764 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:29:43.764 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:29:43.764 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:29:43.764 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:29:43.764 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:29:43.764 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:29:43.764 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:29:43.764 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:29:43.765 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:29:43.765 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:29:43.765 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:29:43.765 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:29:43.765 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_extent_items": 0, 2024-09-19T05:29:43.765 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:29:43.765 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_blob_items": 0, 2024-09-19T05:29:43.765 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:29:43.765 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:29:43.766 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:29:43.766 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:29:43.766 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:29:43.766 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:29:43.766 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:29:43.766 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_txc_items": 0, 2024-09-19T05:29:43.766 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:29:43.766 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:29:43.766 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:29:43.766 INFO:teuthology.orchestra.run.smithi178.stdout: "bluestore_writing_items": 0, 2024-09-19T05:29:43.766 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_bytes": 0, 2024-09-19T05:29:43.766 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_items": 0, 2024-09-19T05:29:43.766 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:29:43.766 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:29:43.767 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:29:43.767 INFO:teuthology.orchestra.run.smithi178.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:29:43.767 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_bytes": 149007, 2024-09-19T05:29:43.767 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_anon_items": 30, 2024-09-19T05:29:43.767 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:29:43.767 INFO:teuthology.orchestra.run.smithi178.stdout: "buffer_meta_items": 0, 2024-09-19T05:29:43.767 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_bytes": 0, 2024-09-19T05:29:43.767 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_items": 0, 2024-09-19T05:29:43.767 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:29:43.767 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_mapbl_items": 0, 2024-09-19T05:29:43.767 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:29:43.767 INFO:teuthology.orchestra.run.smithi178.stdout: "osd_pglog_items": 0, 2024-09-19T05:29:43.767 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_bytes": 0, 2024-09-19T05:29:43.768 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_items": 0, 2024-09-19T05:29:43.768 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:29:43.768 INFO:teuthology.orchestra.run.smithi178.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:29:43.768 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_bytes": 0, 2024-09-19T05:29:43.768 INFO:teuthology.orchestra.run.smithi178.stdout: "pgmap_items": 0, 2024-09-19T05:29:43.768 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_bytes": 928, 2024-09-19T05:29:43.768 INFO:teuthology.orchestra.run.smithi178.stdout: "mds_co_items": 2, 2024-09-19T05:29:43.768 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_bytes": 0, 2024-09-19T05:29:43.768 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_1_items": 0, 2024-09-19T05:29:43.768 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_bytes": 0, 2024-09-19T05:29:43.768 INFO:teuthology.orchestra.run.smithi178.stdout: "unittest_2_items": 0 2024-09-19T05:29:43.768 INFO:teuthology.orchestra.run.smithi178.stdout: }, 2024-09-19T05:29:43.768 INFO:teuthology.orchestra.run.smithi178.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:29:43.769 INFO:teuthology.orchestra.run.smithi178.stdout: "val": 0, 2024-09-19T05:29:43.769 INFO:teuthology.orchestra.run.smithi178.stdout: "max": 104857600, 2024-09-19T05:29:43.769 INFO:teuthology.orchestra.run.smithi178.stdout: "get_started": 0, 2024-09-19T05:29:43.769 INFO:teuthology.orchestra.run.smithi178.stdout: "get": 219, 2024-09-19T05:29:43.769 INFO:teuthology.orchestra.run.smithi178.stdout: "get_sum": 1416395, 2024-09-19T05:29:43.769 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:43.769 INFO:teuthology.orchestra.run.smithi178.stdout: "get_or_fail_success": 219, 2024-09-19T05:29:43.769 INFO:teuthology.orchestra.run.smithi178.stdout: "take": 0, 2024-09-19T05:29:43.769 INFO:teuthology.orchestra.run.smithi178.stdout: "take_sum": 0, 2024-09-19T05:29:43.769 INFO:teuthology.orchestra.run.smithi178.stdout: "put": 219, 2024-09-19T05:29:43.769 INFO:teuthology.orchestra.run.smithi178.stdout: "put_sum": 1416395, 2024-09-19T05:29:43.769 INFO:teuthology.orchestra.run.smithi178.stdout: "wait": { 2024-09-19T05:29:43.769 INFO:teuthology.orchestra.run.smithi178.stdout: "avgcount": 0, 2024-09-19T05:29:43.770 INFO:teuthology.orchestra.run.smithi178.stdout: "sum": 0.000000000, 2024-09-19T05:29:43.770 INFO:teuthology.orchestra.run.smithi178.stdout: "avgtime": 0.000000000 2024-09-19T05:29:43.770 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:43.770 INFO:teuthology.orchestra.run.smithi178.stdout: } 2024-09-19T05:29:43.770 INFO:teuthology.orchestra.run.smithi178.stdout:} 2024-09-19T05:29:44.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:43 smithi120 ceph-mon[30956]: pgmap v325: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:29:44.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:43 smithi194 ceph-mon[35228]: pgmap v325: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:29:44.176 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:43 smithi178 ceph-mon[34347]: pgmap v325: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:29:44.545 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-19T05:29:44.546 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-19T05:29:44.546 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-19T05:29:44.546 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-19T05:29:44.546 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-19T05:29:44.546 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-09-19T05:29:44.546 DEBUG:tasks.check_counter:Getting stats from c 2024-09-19T05:29:44.546 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-19T05:29:44.807 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:29:45.497 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-19T05:29:45.497 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:29:45.497 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 6811, 2024-09-19T05:29:45.497 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 6826, 2024-09-19T05:29:45.497 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 2363330, 2024-09-19T05:29:45.497 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 65237157, 2024-09-19T05:29:45.498 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 19, 2024-09-19T05:29:45.498 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 3, 2024-09-19T05:29:45.498 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.607734403, 2024-09-19T05:29:45.498 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.270982938, 2024-09-19T05:29:45.498 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.115836478, 2024-09-19T05:29:45.498 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.177703802, 2024-09-19T05:29:45.498 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:45.498 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 6825, 2024-09-19T05:29:45.498 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.826696355, 2024-09-19T05:29:45.498 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000121127 2024-09-19T05:29:45.498 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.498 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:45.498 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 44, 2024-09-19T05:29:45.499 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000006916, 2024-09-19T05:29:45.499 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000157 2024-09-19T05:29:45.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.499 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 5440, 2024-09-19T05:29:45.499 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 6576 2024-09-19T05:29:45.499 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.499 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:29:45.499 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 442708, 2024-09-19T05:29:45.499 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 142295, 2024-09-19T05:29:45.499 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 151043274, 2024-09-19T05:29:45.499 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 176169099, 2024-09-19T05:29:45.499 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 16, 2024-09-19T05:29:45.499 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 9, 2024-09-19T05:29:45.500 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 12.274831933, 2024-09-19T05:29:45.500 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 4.757585448, 2024-09-19T05:29:45.500 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 10.270525424, 2024-09-19T05:29:45.500 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.242157271, 2024-09-19T05:29:45.500 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:45.500 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 142292, 2024-09-19T05:29:45.500 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 3.178485770, 2024-09-19T05:29:45.500 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000022337 2024-09-19T05:29:45.500 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.500 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:45.500 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 557605, 2024-09-19T05:29:45.500 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.057445723, 2024-09-19T05:29:45.500 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000103 2024-09-19T05:29:45.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.501 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T05:29:45.501 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 437584 2024-09-19T05:29:45.501 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.501 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:29:45.501 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 55698, 2024-09-19T05:29:45.501 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 57605, 2024-09-19T05:29:45.501 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 28182953, 2024-09-19T05:29:45.501 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 43033577, 2024-09-19T05:29:45.501 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 7, 2024-09-19T05:29:45.501 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 6, 2024-09-19T05:29:45.501 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 3.255386823, 2024-09-19T05:29:45.502 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 1.486998005, 2024-09-19T05:29:45.502 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 2.034939256, 2024-09-19T05:29:45.502 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.135193720, 2024-09-19T05:29:45.502 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:45.502 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 57604, 2024-09-19T05:29:45.502 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 2.045456686, 2024-09-19T05:29:45.502 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000035508 2024-09-19T05:29:45.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.502 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:45.502 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 101942, 2024-09-19T05:29:45.502 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.015352254, 2024-09-19T05:29:45.502 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000150 2024-09-19T05:29:45.502 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.502 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 1547056, 2024-09-19T05:29:45.503 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 246864 2024-09-19T05:29:45.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.503 INFO:teuthology.orchestra.run.smithi194.stdout: "cct": { 2024-09-19T05:29:45.503 INFO:teuthology.orchestra.run.smithi194.stdout: "total_workers": 1, 2024-09-19T05:29:45.503 INFO:teuthology.orchestra.run.smithi194.stdout: "unhealthy_workers": 0 2024-09-19T05:29:45.503 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.503 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-MDSRank": { 2024-09-19T05:29:45.503 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2024-09-19T05:29:45.504 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2024-09-19T05:29:45.504 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 15599, 2024-09-19T05:29:45.504 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 13.256793274, 2024-09-19T05:29:45.505 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000849848 2024-09-19T05:29:45.505 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:45.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.505 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-PurgeQueue": { 2024-09-19T05:29:45.505 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2024-09-19T05:29:45.505 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2024-09-19T05:29:45.505 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 11468, 2024-09-19T05:29:45.505 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 1.295755788, 2024-09-19T05:29:45.505 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000112988 2024-09-19T05:29:45.505 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:45.505 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.505 INFO:teuthology.orchestra.run.smithi194.stdout: "mds": { 2024-09-19T05:29:45.505 INFO:teuthology.orchestra.run.smithi194.stdout: "request": 102995, 2024-09-19T05:29:45.506 INFO:teuthology.orchestra.run.smithi194.stdout: "reply": 101487, 2024-09-19T05:29:45.506 INFO:teuthology.orchestra.run.smithi194.stdout: "reply_latency": { 2024-09-19T05:29:45.506 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 101487, 2024-09-19T05:29:45.506 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 352.936237138, 2024-09-19T05:29:45.506 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.003477649 2024-09-19T05:29:45.506 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.506 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_reply": 0, 2024-09-19T05:29:45.506 INFO:teuthology.orchestra.run.smithi194.stdout: "forward": 1508, 2024-09-19T05:29:45.506 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_complete": 85, 2024-09-19T05:29:45.506 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_keys": 0, 2024-09-19T05:29:45.506 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_commit": 257, 2024-09-19T05:29:45.506 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_split": 18, 2024-09-19T05:29:45.506 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_merge": 0, 2024-09-19T05:29:45.507 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes": 6419, 2024-09-19T05:29:45.507 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_top": 162, 2024-09-19T05:29:45.507 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_bottom": 4125, 2024-09-19T05:29:45.507 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pin_tail": 2132, 2024-09-19T05:29:45.507 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pinned": 6186, 2024-09-19T05:29:45.507 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_expired": 12369, 2024-09-19T05:29:45.507 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_with_caps": 0, 2024-09-19T05:29:45.507 INFO:teuthology.orchestra.run.smithi194.stdout: "caps": 0, 2024-09-19T05:29:45.507 INFO:teuthology.orchestra.run.smithi194.stdout: "subtrees": 3, 2024-09-19T05:29:45.507 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse": 223444, 2024-09-19T05:29:45.507 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_hit": 96001, 2024-09-19T05:29:45.507 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_forward": 1421, 2024-09-19T05:29:45.507 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_discover": 319, 2024-09-19T05:29:45.508 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_dir_fetch": 2, 2024-09-19T05:29:45.508 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_remote_ino": 0, 2024-09-19T05:29:45.508 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_lock": 9, 2024-09-19T05:29:45.508 INFO:teuthology.orchestra.run.smithi194.stdout: "load_cent": 0, 2024-09-19T05:29:45.508 INFO:teuthology.orchestra.run.smithi194.stdout: "q": 0, 2024-09-19T05:29:45.508 INFO:teuthology.orchestra.run.smithi194.stdout: "exported": 169, 2024-09-19T05:29:45.508 INFO:teuthology.orchestra.run.smithi194.stdout: "exported_inodes": 8296, 2024-09-19T05:29:45.508 INFO:teuthology.orchestra.run.smithi194.stdout: "imported": 148, 2024-09-19T05:29:45.508 INFO:teuthology.orchestra.run.smithi194.stdout: "imported_inodes": 8739, 2024-09-19T05:29:45.508 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_dir_fetch": 0, 2024-09-19T05:29:45.508 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_backtrace_fetch": 2231, 2024-09-19T05:29:45.508 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_peer_discover": 0, 2024-09-19T05:29:45.509 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rfiles": 3262, 2024-09-19T05:29:45.509 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rbytes": 63453519, 2024-09-19T05:29:45.509 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rsnaps": 6, 2024-09-19T05:29:45.509 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_fetch": 2231, 2024-09-19T05:29:45.509 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_set_tag": 0, 2024-09-19T05:29:45.509 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T05:29:45.509 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_inotable_repaired": 0, 2024-09-19T05:29:45.509 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_inodes": 0, 2024-09-19T05:29:45.509 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T05:29:45.509 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T05:29:45.509 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_file_inodes": 2231, 2024-09-19T05:29:45.509 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_inode_file_caps": 24, 2024-09-19T05:29:45.510 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_revoke": 3253, 2024-09-19T05:29:45.510 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_grant": 11016, 2024-09-19T05:29:45.510 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T05:29:45.510 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T05:29:45.510 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T05:29:45.510 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps": 331691, 2024-09-19T05:29:45.510 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps_dirty": 2549, 2024-09-19T05:29:45.510 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_cap_release": 230, 2024-09-19T05:29:45.510 INFO:teuthology.orchestra.run.smithi194.stdout: "process_request_cap_release": 21660 2024-09-19T05:29:45.510 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.510 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_cache": { 2024-09-19T05:29:45.510 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update": 0, 2024-09-19T05:29:45.510 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update_receipt": 0, 2024-09-19T05:29:45.511 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_try_discover": 0, 2024-09-19T05:29:45.511 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_send_discover": 410, 2024-09-19T05:29:45.511 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_handle_discover": 368, 2024-09-19T05:29:45.511 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays": 23, 2024-09-19T05:29:45.511 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_delayed": 0, 2024-09-19T05:29:45.511 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_enqueuing": 0, 2024-09-19T05:29:45.511 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_created": 6167, 2024-09-19T05:29:45.511 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_enqueued": 6144, 2024-09-19T05:29:45.511 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_reintegrated": 0, 2024-09-19T05:29:45.511 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_migrated": 0, 2024-09-19T05:29:45.511 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_processing": 0, 2024-09-19T05:29:45.511 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_enqueued": 0, 2024-09-19T05:29:45.511 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_prioritized": 0, 2024-09-19T05:29:45.511 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_started": 0, 2024-09-19T05:29:45.512 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_completed": 0, 2024-09-19T05:29:45.512 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_quiesce_path": 0, 2024-09-19T05:29:45.512 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_quiesce_inode": 0, 2024-09-19T05:29:45.512 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T05:29:45.512 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_exportdir": 175, 2024-09-19T05:29:45.512 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_flush": 0, 2024-09-19T05:29:45.512 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragmentdir": 18, 2024-09-19T05:29:45.512 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragstats": 0, 2024-09-19T05:29:45.512 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_inodestats": 0 2024-09-19T05:29:45.512 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.512 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_log": { 2024-09-19T05:29:45.512 INFO:teuthology.orchestra.run.smithi194.stdout: "evlrg": 0, 2024-09-19T05:29:45.512 INFO:teuthology.orchestra.run.smithi194.stdout: "evadd": 157227, 2024-09-19T05:29:45.513 INFO:teuthology.orchestra.run.smithi194.stdout: "evex": 49161, 2024-09-19T05:29:45.513 INFO:teuthology.orchestra.run.smithi194.stdout: "evtrm": 49161, 2024-09-19T05:29:45.513 INFO:teuthology.orchestra.run.smithi194.stdout: "ev": 108066, 2024-09-19T05:29:45.513 INFO:teuthology.orchestra.run.smithi194.stdout: "evexg": 0, 2024-09-19T05:29:45.513 INFO:teuthology.orchestra.run.smithi194.stdout: "evexd": 12290, 2024-09-19T05:29:45.513 INFO:teuthology.orchestra.run.smithi194.stdout: "segadd": 184, 2024-09-19T05:29:45.513 INFO:teuthology.orchestra.run.smithi194.stdout: "segex": 56, 2024-09-19T05:29:45.513 INFO:teuthology.orchestra.run.smithi194.stdout: "segtrm": 56, 2024-09-19T05:29:45.513 INFO:teuthology.orchestra.run.smithi194.stdout: "seg": 128, 2024-09-19T05:29:45.513 INFO:teuthology.orchestra.run.smithi194.stdout: "segmjr": 9, 2024-09-19T05:29:45.513 INFO:teuthology.orchestra.run.smithi194.stdout: "segexg": 0, 2024-09-19T05:29:45.513 INFO:teuthology.orchestra.run.smithi194.stdout: "segexd": 14, 2024-09-19T05:29:45.514 INFO:teuthology.orchestra.run.smithi194.stdout: "expos": 55480988, 2024-09-19T05:29:45.514 INFO:teuthology.orchestra.run.smithi194.stdout: "wrpos": 199449812, 2024-09-19T05:29:45.514 INFO:teuthology.orchestra.run.smithi194.stdout: "rdpos": 0, 2024-09-19T05:29:45.514 INFO:teuthology.orchestra.run.smithi194.stdout: "jlat": { 2024-09-19T05:29:45.514 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 6872, 2024-09-19T05:29:45.514 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 22.714161572, 2024-09-19T05:29:45.514 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.003305320 2024-09-19T05:29:45.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.514 INFO:teuthology.orchestra.run.smithi194.stdout: "replayed": 0 2024-09-19T05:29:45.514 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.514 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_mem": { 2024-09-19T05:29:45.515 INFO:teuthology.orchestra.run.smithi194.stdout: "ino": 3200, 2024-09-19T05:29:45.515 INFO:teuthology.orchestra.run.smithi194.stdout: "ino+": 14120, 2024-09-19T05:29:45.515 INFO:teuthology.orchestra.run.smithi194.stdout: "ino-": 10920, 2024-09-19T05:29:45.515 INFO:teuthology.orchestra.run.smithi194.stdout: "dir": 153, 2024-09-19T05:29:45.515 INFO:teuthology.orchestra.run.smithi194.stdout: "dir+": 408, 2024-09-19T05:29:45.515 INFO:teuthology.orchestra.run.smithi194.stdout: "dir-": 255, 2024-09-19T05:29:45.515 INFO:teuthology.orchestra.run.smithi194.stdout: "dn": 6419, 2024-09-19T05:29:45.515 INFO:teuthology.orchestra.run.smithi194.stdout: "dn+": 26281, 2024-09-19T05:29:45.515 INFO:teuthology.orchestra.run.smithi194.stdout: "dn-": 19862, 2024-09-19T05:29:45.515 INFO:teuthology.orchestra.run.smithi194.stdout: "cap": 0, 2024-09-19T05:29:45.515 INFO:teuthology.orchestra.run.smithi194.stdout: "cap+": 6369, 2024-09-19T05:29:45.515 INFO:teuthology.orchestra.run.smithi194.stdout: "cap-": 6369, 2024-09-19T05:29:45.515 INFO:teuthology.orchestra.run.smithi194.stdout: "rss": 101548, 2024-09-19T05:29:45.515 INFO:teuthology.orchestra.run.smithi194.stdout: "heap": 223520 2024-09-19T05:29:45.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.516 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_server": { 2024-09-19T05:29:45.516 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_client_request": 124037, 2024-09-19T05:29:45.516 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_server_request": 3464, 2024-09-19T05:29:45.516 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_request": 102995, 2024-09-19T05:29:45.516 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_session": 173, 2024-09-19T05:29:45.516 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_peer_request": 13220, 2024-09-19T05:29:45.516 INFO:teuthology.orchestra.run.smithi194.stdout: "req_create_latency": { 2024-09-19T05:29:45.516 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 2541, 2024-09-19T05:29:45.516 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 81.155116816, 2024-09-19T05:29:45.516 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.031938259 2024-09-19T05:29:45.516 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.516 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getattr_latency": { 2024-09-19T05:29:45.517 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 59, 2024-09-19T05:29:45.517 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.018642221, 2024-09-19T05:29:45.517 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000315969 2024-09-19T05:29:45.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.517 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getfilelock_latency": { 2024-09-19T05:29:45.517 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.517 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.517 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.517 INFO:teuthology.orchestra.run.smithi194.stdout: "req_link_latency": { 2024-09-19T05:29:45.517 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.517 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.517 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.517 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.518 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookup_latency": { 2024-09-19T05:29:45.518 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 89387, 2024-09-19T05:29:45.518 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 151.381186840, 2024-09-19T05:29:45.518 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.001693548 2024-09-19T05:29:45.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.518 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookuphash_latency": { 2024-09-19T05:29:45.518 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.518 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.518 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.518 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.518 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupino_latency": { 2024-09-19T05:29:45.518 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.518 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.518 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.519 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupname_latency": { 2024-09-19T05:29:45.519 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.519 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.519 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.519 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupparent_latency": { 2024-09-19T05:29:45.519 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.519 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.519 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.519 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.519 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupsnap_latency": { 2024-09-19T05:29:45.519 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.519 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.520 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.520 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lssnap_latency": { 2024-09-19T05:29:45.520 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.520 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.520 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.520 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mkdir_latency": { 2024-09-19T05:29:45.520 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.520 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.520 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.520 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.521 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mknod_latency": { 2024-09-19T05:29:45.521 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.521 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.521 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.521 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mksnap_latency": { 2024-09-19T05:29:45.521 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.521 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.521 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.521 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.521 INFO:teuthology.orchestra.run.smithi194.stdout: "req_open_latency": { 2024-09-19T05:29:45.521 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 1017, 2024-09-19T05:29:45.522 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 10.111266801, 2024-09-19T05:29:45.522 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.009942248 2024-09-19T05:29:45.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.522 INFO:teuthology.orchestra.run.smithi194.stdout: "req_readdir_latency": { 2024-09-19T05:29:45.522 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 429, 2024-09-19T05:29:45.522 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.522309256, 2024-09-19T05:29:45.522 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.001217504 2024-09-19T05:29:45.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.522 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rename_latency": { 2024-09-19T05:29:45.522 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 2534, 2024-09-19T05:29:45.522 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 100.300042931, 2024-09-19T05:29:45.522 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.039581705 2024-09-19T05:29:45.522 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.522 INFO:teuthology.orchestra.run.smithi194.stdout: "req_renamesnap_latency": { 2024-09-19T05:29:45.523 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.523 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.523 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.523 INFO:teuthology.orchestra.run.smithi194.stdout: "req_snapdiff_latency": { 2024-09-19T05:29:45.523 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.523 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.523 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.523 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.523 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmdir_latency": { 2024-09-19T05:29:45.523 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 23, 2024-09-19T05:29:45.523 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 1.260621193, 2024-09-19T05:29:45.523 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.054809617 2024-09-19T05:29:45.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.524 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmsnap_latency": { 2024-09-19T05:29:45.524 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.524 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.524 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.524 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmxattr_latency": { 2024-09-19T05:29:45.524 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.524 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.524 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.524 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.525 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setattr_latency": { 2024-09-19T05:29:45.525 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.525 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.525 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.525 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setdirlayout_latency": { 2024-09-19T05:29:45.525 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.525 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.525 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.525 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.525 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setfilelock_latency": { 2024-09-19T05:29:45.525 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.525 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.526 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.526 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setlayout_latency": { 2024-09-19T05:29:45.526 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.526 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.526 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.526 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setxattr_latency": { 2024-09-19T05:29:45.526 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.526 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.526 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.526 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.526 INFO:teuthology.orchestra.run.smithi194.stdout: "req_symlink_latency": { 2024-09-19T05:29:45.526 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.527 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.527 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.527 INFO:teuthology.orchestra.run.smithi194.stdout: "req_unlink_latency": { 2024-09-19T05:29:45.527 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 5497, 2024-09-19T05:29:45.527 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 8.187051080, 2024-09-19T05:29:45.527 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.001489367 2024-09-19T05:29:45.527 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.527 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_revoke_eviction": 0, 2024-09-19T05:29:45.527 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_acquisition_throttle": 0, 2024-09-19T05:29:45.527 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getvxattr_latency": { 2024-09-19T05:29:45.527 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.527 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.528 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.528 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:45.528 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.528 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_sessions": { 2024-09-19T05:29:45.528 INFO:teuthology.orchestra.run.smithi194.stdout: "session_count": 2, 2024-09-19T05:29:45.528 INFO:teuthology.orchestra.run.smithi194.stdout: "session_add": 3, 2024-09-19T05:29:45.528 INFO:teuthology.orchestra.run.smithi194.stdout: "session_remove": 1, 2024-09-19T05:29:45.528 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_open": 2, 2024-09-19T05:29:45.528 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_stale": 0, 2024-09-19T05:29:45.528 INFO:teuthology.orchestra.run.smithi194.stdout: "total_load": 22278, 2024-09-19T05:29:45.528 INFO:teuthology.orchestra.run.smithi194.stdout: "average_load": 11139, 2024-09-19T05:29:45.528 INFO:teuthology.orchestra.run.smithi194.stdout: "avg_session_uptime": 604, 2024-09-19T05:29:45.528 INFO:teuthology.orchestra.run.smithi194.stdout: "mdthresh_evicted": 0 2024-09-19T05:29:45.529 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.529 INFO:teuthology.orchestra.run.smithi194.stdout: "mempool": { 2024-09-19T05:29:45.529 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:29:45.529 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_items": 0, 2024-09-19T05:29:45.529 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:29:45.529 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:29:45.529 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:29:45.529 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:29:45.529 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:29:45.529 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:29:45.529 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:29:45.529 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:29:45.529 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:29:45.530 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:29:45.530 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:29:45.530 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:29:45.530 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:29:45.530 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_items": 0, 2024-09-19T05:29:45.530 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:29:45.530 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_items": 0, 2024-09-19T05:29:45.530 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:29:45.530 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:29:45.530 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:29:45.530 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:29:45.530 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:29:45.530 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:29:45.531 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:29:45.531 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_items": 0, 2024-09-19T05:29:45.531 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:29:45.531 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:29:45.531 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:29:45.531 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_items": 0, 2024-09-19T05:29:45.531 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_bytes": 0, 2024-09-19T05:29:45.531 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_items": 0, 2024-09-19T05:29:45.531 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:29:45.531 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:29:45.531 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:29:45.531 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:29:45.531 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_bytes": 490460, 2024-09-19T05:29:45.531 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_items": 166, 2024-09-19T05:29:45.532 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:29:45.532 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_items": 0, 2024-09-19T05:29:45.532 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_bytes": 0, 2024-09-19T05:29:45.532 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_items": 0, 2024-09-19T05:29:45.532 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:29:45.532 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_items": 0, 2024-09-19T05:29:45.532 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:29:45.532 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_items": 0, 2024-09-19T05:29:45.532 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_bytes": 8480, 2024-09-19T05:29:45.532 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_items": 186, 2024-09-19T05:29:45.532 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:29:45.532 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:29:45.532 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_bytes": 0, 2024-09-19T05:29:45.533 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_items": 0, 2024-09-19T05:29:45.533 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_bytes": 11654033, 2024-09-19T05:29:45.533 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_items": 64331, 2024-09-19T05:29:45.533 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_bytes": 0, 2024-09-19T05:29:45.533 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_items": 0, 2024-09-19T05:29:45.533 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_bytes": 0, 2024-09-19T05:29:45.533 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_items": 0 2024-09-19T05:29:45.533 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.533 INFO:teuthology.orchestra.run.smithi194.stdout: "objecter": { 2024-09-19T05:29:45.533 INFO:teuthology.orchestra.run.smithi194.stdout: "op_active": 0, 2024-09-19T05:29:45.533 INFO:teuthology.orchestra.run.smithi194.stdout: "op_laggy": 0, 2024-09-19T05:29:45.533 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send": 19091, 2024-09-19T05:29:45.533 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send_bytes": 200193169, 2024-09-19T05:29:45.534 INFO:teuthology.orchestra.run.smithi194.stdout: "op_resend": 30, 2024-09-19T05:29:45.534 INFO:teuthology.orchestra.run.smithi194.stdout: "op_reply": 19091, 2024-09-19T05:29:45.534 INFO:teuthology.orchestra.run.smithi194.stdout: "op_latency": { 2024-09-19T05:29:45.534 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 19091, 2024-09-19T05:29:45.534 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 76.955405742, 2024-09-19T05:29:45.534 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.004030978 2024-09-19T05:29:45.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.534 INFO:teuthology.orchestra.run.smithi194.stdout: "op_inflight": 0, 2024-09-19T05:29:45.534 INFO:teuthology.orchestra.run.smithi194.stdout: "oplen_avg": { 2024-09-19T05:29:45.534 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 19091, 2024-09-19T05:29:45.534 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 23751 2024-09-19T05:29:45.534 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.534 INFO:teuthology.orchestra.run.smithi194.stdout: "op": 19091, 2024-09-19T05:29:45.534 INFO:teuthology.orchestra.run.smithi194.stdout: "op_r": 2954, 2024-09-19T05:29:45.535 INFO:teuthology.orchestra.run.smithi194.stdout: "op_w": 16137, 2024-09-19T05:29:45.535 INFO:teuthology.orchestra.run.smithi194.stdout: "op_rmw": 0, 2024-09-19T05:29:45.535 INFO:teuthology.orchestra.run.smithi194.stdout: "op_pg": 0, 2024-09-19T05:29:45.535 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_stat": 90, 2024-09-19T05:29:45.535 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_create": 1742, 2024-09-19T05:29:45.535 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_read": 428, 2024-09-19T05:29:45.535 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_write": 7300, 2024-09-19T05:29:45.535 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writefull": 266, 2024-09-19T05:29:45.535 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writesame": 0, 2024-09-19T05:29:45.535 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_append": 0, 2024-09-19T05:29:45.535 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_zero": 0, 2024-09-19T05:29:45.535 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_truncate": 18, 2024-09-19T05:29:45.535 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_delete": 6214, 2024-09-19T05:29:45.536 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_mapext": 0, 2024-09-19T05:29:45.536 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_sparse_read": 0, 2024-09-19T05:29:45.536 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_clonerange": 0, 2024-09-19T05:29:45.536 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_getxattr": 2236, 2024-09-19T05:29:45.536 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_setxattr": 3484, 2024-09-19T05:29:45.536 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_cmpxattr": 0, 2024-09-19T05:29:45.536 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_rmxattr": 0, 2024-09-19T05:29:45.536 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_resetxattrs": 0, 2024-09-19T05:29:45.536 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_call": 0, 2024-09-19T05:29:45.536 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_watch": 0, 2024-09-19T05:29:45.536 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_notify": 0, 2024-09-19T05:29:45.536 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T05:29:45.536 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls": 0, 2024-09-19T05:29:45.537 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls_filter": 0, 2024-09-19T05:29:45.537 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_other": 0, 2024-09-19T05:29:45.537 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_active": 0, 2024-09-19T05:29:45.537 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_send": 0, 2024-09-19T05:29:45.537 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_resend": 0, 2024-09-19T05:29:45.537 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_ping": 0, 2024-09-19T05:29:45.537 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_active": 0, 2024-09-19T05:29:45.537 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_send": 0, 2024-09-19T05:29:45.537 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_resend": 0, 2024-09-19T05:29:45.537 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_active": 0, 2024-09-19T05:29:45.537 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_send": 0, 2024-09-19T05:29:45.537 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_resend": 0, 2024-09-19T05:29:45.538 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_active": 0, 2024-09-19T05:29:45.538 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_send": 0, 2024-09-19T05:29:45.538 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_resend": 0, 2024-09-19T05:29:45.538 INFO:teuthology.orchestra.run.smithi194.stdout: "command_active": 0, 2024-09-19T05:29:45.538 INFO:teuthology.orchestra.run.smithi194.stdout: "command_send": 0, 2024-09-19T05:29:45.538 INFO:teuthology.orchestra.run.smithi194.stdout: "command_resend": 0, 2024-09-19T05:29:45.538 INFO:teuthology.orchestra.run.smithi194.stdout: "map_epoch": 93, 2024-09-19T05:29:45.538 INFO:teuthology.orchestra.run.smithi194.stdout: "map_full": 0, 2024-09-19T05:29:45.538 INFO:teuthology.orchestra.run.smithi194.stdout: "map_inc": 13, 2024-09-19T05:29:45.538 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_sessions": 12, 2024-09-19T05:29:45.538 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_open": 12, 2024-09-19T05:29:45.538 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_close": 0, 2024-09-19T05:29:45.538 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_laggy": 0, 2024-09-19T05:29:45.539 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_wr": 1166, 2024-09-19T05:29:45.539 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_rd": 380, 2024-09-19T05:29:45.539 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_del": 427 2024-09-19T05:29:45.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.539 INFO:teuthology.orchestra.run.smithi194.stdout: "oft": { 2024-09-19T05:29:45.539 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_objs": 1, 2024-09-19T05:29:45.539 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_kv_pairs": 0, 2024-09-19T05:29:45.539 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_updates": 0, 2024-09-19T05:29:45.539 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_removes": 0 2024-09-19T05:29:45.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.539 INFO:teuthology.orchestra.run.smithi194.stdout: "osd-slow-ops": { 2024-09-19T05:29:45.539 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_ops_count": 0 2024-09-19T05:29:45.539 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.540 INFO:teuthology.orchestra.run.smithi194.stdout: "purge_queue": { 2024-09-19T05:29:45.540 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops": 0, 2024-09-19T05:29:45.540 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops_high_water": 10, 2024-09-19T05:29:45.540 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing": 0, 2024-09-19T05:29:45.540 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_high_water": 10, 2024-09-19T05:29:45.540 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executed_ops": 6144, 2024-09-19T05:29:45.540 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executed": 6144, 2024-09-19T05:29:45.540 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_item_in_journal": 0 2024-09-19T05:29:45.540 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.540 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:29:45.540 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-19T05:29:45.540 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-09-19T05:29:45.540 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-19T05:29:45.541 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 505213, 2024-09-19T05:29:45.541 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 136102818, 2024-09-19T05:29:45.541 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:45.541 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 505213, 2024-09-19T05:29:45.541 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-19T05:29:45.541 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-19T05:29:45.541 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 505213, 2024-09-19T05:29:45.541 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 136102818, 2024-09-19T05:29:45.541 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-19T05:29:45.541 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.541 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.541 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.541 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:45.542 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.542 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_bytes": { 2024-09-19T05:29:45.542 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-19T05:29:45.542 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-09-19T05:29:45.542 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-19T05:29:45.542 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-19T05:29:45.542 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-19T05:29:45.542 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:45.542 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-19T05:29:45.542 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 19091, 2024-09-19T05:29:45.542 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 200979914, 2024-09-19T05:29:45.542 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 19091, 2024-09-19T05:29:45.542 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 200979914, 2024-09-19T05:29:45.543 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-19T05:29:45.543 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.543 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.543 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.543 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:45.543 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.543 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_ops": { 2024-09-19T05:29:45.543 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-19T05:29:45.543 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 1024, 2024-09-19T05:29:45.543 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-19T05:29:45.543 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-19T05:29:45.543 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-19T05:29:45.543 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:45.544 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-19T05:29:45.544 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 19091, 2024-09-19T05:29:45.544 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 19091, 2024-09-19T05:29:45.544 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 19091, 2024-09-19T05:29:45.544 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 19091, 2024-09-19T05:29:45.544 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-19T05:29:45.544 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.544 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.544 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.544 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:45.544 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.544 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle": { 2024-09-19T05:29:45.544 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-19T05:29:45.544 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2024-09-19T05:29:45.545 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-19T05:29:45.545 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 6144, 2024-09-19T05:29:45.545 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 795272, 2024-09-19T05:29:45.545 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:45.545 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 6144, 2024-09-19T05:29:45.545 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-19T05:29:45.545 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-19T05:29:45.545 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 428, 2024-09-19T05:29:45.545 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 795272, 2024-09-19T05:29:45.545 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-19T05:29:45.545 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.545 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.545 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.546 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:45.546 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:45.546 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle-0x561d2c29c960": { 2024-09-19T05:29:45.546 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-19T05:29:45.546 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2024-09-19T05:29:45.546 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-19T05:29:45.546 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 157227, 2024-09-19T05:29:45.546 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 195255508, 2024-09-19T05:29:45.546 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:45.546 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 157227, 2024-09-19T05:29:45.546 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-19T05:29:45.546 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-19T05:29:45.546 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 6872, 2024-09-19T05:29:45.547 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 195255508, 2024-09-19T05:29:45.547 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-19T05:29:45.547 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:45.547 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:45.547 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:45.547 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:45.547 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:45.547 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-19T05:29:46.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:45 smithi120 ceph-mon[30956]: pgmap v326: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:29:46.155 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:45 smithi194 ceph-mon[35228]: pgmap v326: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:29:46.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:45 smithi178 ceph-mon[34347]: pgmap v326: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:29:46.380 INFO:tasks.check_counter:Daemon mds.c mds.exported=169 2024-09-19T05:29:46.380 INFO:tasks.check_counter:Daemon mds.c mds.imported=148 2024-09-19T05:29:46.380 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-19T05:29:46.380 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-19T05:29:46.380 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T05:29:46.380 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=18 2024-09-19T05:29:46.380 DEBUG:tasks.check_counter:Getting stats from f 2024-09-19T05:29:46.381 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-19T05:29:46.631 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:29:47.175 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-19T05:29:47.175 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:29:47.175 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 1452, 2024-09-19T05:29:47.175 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 1454, 2024-09-19T05:29:47.175 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 143036939, 2024-09-19T05:29:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 461746, 2024-09-19T05:29:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 8, 2024-09-19T05:29:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 4, 2024-09-19T05:29:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.185736590, 2024-09-19T05:29:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.033788379, 2024-09-19T05:29:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.102597575, 2024-09-19T05:29:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.038064439, 2024-09-19T05:29:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 1452, 2024-09-19T05:29:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.045935455, 2024-09-19T05:29:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000031635 2024-09-19T05:29:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.176 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T05:29:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T05:29:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:29:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 917, 2024-09-19T05:29:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 891, 2024-09-19T05:29:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 116900871, 2024-09-19T05:29:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 341436, 2024-09-19T05:29:47.177 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 6, 2024-09-19T05:29:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 5, 2024-09-19T05:29:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.133691909, 2024-09-19T05:29:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.029684173, 2024-09-19T05:29:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.100398867, 2024-09-19T05:29:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.014196671, 2024-09-19T05:29:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 890, 2024-09-19T05:29:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.031706023, 2024-09-19T05:29:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000035624 2024-09-19T05:29:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.178 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 1537376, 2024-09-19T05:29:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 129264 2024-09-19T05:29:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:29:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 726, 2024-09-19T05:29:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 879, 2024-09-19T05:29:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 96654214, 2024-09-19T05:29:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 665345, 2024-09-19T05:29:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 8, 2024-09-19T05:29:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 6, 2024-09-19T05:29:47.179 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.109988655, 2024-09-19T05:29:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.024189683, 2024-09-19T05:29:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.059291028, 2024-09-19T05:29:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.018978272, 2024-09-19T05:29:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 877, 2024-09-19T05:29:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.040220055, 2024-09-19T05:29:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000045860 2024-09-19T05:29:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.180 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-09-19T05:29:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 436384 2024-09-19T05:29:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: "cct": { 2024-09-19T05:29:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: "total_workers": 1, 2024-09-19T05:29:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: "unhealthy_workers": 0 2024-09-19T05:29:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-MDSRank": { 2024-09-19T05:29:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2024-09-19T05:29:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2024-09-19T05:29:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 4604, 2024-09-19T05:29:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.339604163, 2024-09-19T05:29:47.181 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000073762 2024-09-19T05:29:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-PurgeQueue": { 2024-09-19T05:29:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2024-09-19T05:29:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2024-09-19T05:29:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: "mds": { 2024-09-19T05:29:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: "request": 0, 2024-09-19T05:29:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: "reply": 0, 2024-09-19T05:29:47.182 INFO:teuthology.orchestra.run.smithi194.stdout: "reply_latency": { 2024-09-19T05:29:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_reply": 0, 2024-09-19T05:29:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: "forward": 0, 2024-09-19T05:29:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_complete": 0, 2024-09-19T05:29:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_keys": 0, 2024-09-19T05:29:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_commit": 0, 2024-09-19T05:29:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_split": 0, 2024-09-19T05:29:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_merge": 0, 2024-09-19T05:29:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes": 25252, 2024-09-19T05:29:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_top": 17525, 2024-09-19T05:29:47.183 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_bottom": 7727, 2024-09-19T05:29:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pin_tail": 0, 2024-09-19T05:29:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pinned": 217, 2024-09-19T05:29:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_expired": 0, 2024-09-19T05:29:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_with_caps": 0, 2024-09-19T05:29:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: "caps": 0, 2024-09-19T05:29:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: "subtrees": 2, 2024-09-19T05:29:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse": 0, 2024-09-19T05:29:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_hit": 0, 2024-09-19T05:29:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_forward": 0, 2024-09-19T05:29:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_discover": 0, 2024-09-19T05:29:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_dir_fetch": 0, 2024-09-19T05:29:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_remote_ino": 0, 2024-09-19T05:29:47.184 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_lock": 0, 2024-09-19T05:29:47.185 INFO:teuthology.orchestra.run.smithi194.stdout: "load_cent": 0, 2024-09-19T05:29:47.185 INFO:teuthology.orchestra.run.smithi194.stdout: "q": 0, 2024-09-19T05:29:47.185 INFO:teuthology.orchestra.run.smithi194.stdout: "exported": 0, 2024-09-19T05:29:47.185 INFO:teuthology.orchestra.run.smithi194.stdout: "exported_inodes": 0, 2024-09-19T05:29:47.185 INFO:teuthology.orchestra.run.smithi194.stdout: "imported": 0, 2024-09-19T05:29:47.185 INFO:teuthology.orchestra.run.smithi194.stdout: "imported_inodes": 0, 2024-09-19T05:29:47.185 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_dir_fetch": 0, 2024-09-19T05:29:47.185 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_backtrace_fetch": 0, 2024-09-19T05:29:47.185 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_peer_discover": 0, 2024-09-19T05:29:47.185 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rfiles": 4, 2024-09-19T05:29:47.185 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rbytes": 234, 2024-09-19T05:29:47.185 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rsnaps": 6, 2024-09-19T05:29:47.185 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T05:29:47.185 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_set_tag": 0, 2024-09-19T05:29:47.186 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T05:29:47.186 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_inotable_repaired": 0, 2024-09-19T05:29:47.186 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_inodes": 0, 2024-09-19T05:29:47.186 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T05:29:47.186 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T05:29:47.186 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_file_inodes": 0, 2024-09-19T05:29:47.186 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_inode_file_caps": 0, 2024-09-19T05:29:47.186 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T05:29:47.186 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_grant": 0, 2024-09-19T05:29:47.186 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T05:29:47.186 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T05:29:47.186 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T05:29:47.186 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps": 0, 2024-09-19T05:29:47.186 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps_dirty": 0, 2024-09-19T05:29:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_cap_release": 0, 2024-09-19T05:29:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: "process_request_cap_release": 0 2024-09-19T05:29:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_cache": { 2024-09-19T05:29:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update": 0, 2024-09-19T05:29:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update_receipt": 0, 2024-09-19T05:29:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_try_discover": 0, 2024-09-19T05:29:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_send_discover": 0, 2024-09-19T05:29:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_handle_discover": 0, 2024-09-19T05:29:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays": 0, 2024-09-19T05:29:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_delayed": 0, 2024-09-19T05:29:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_enqueuing": 0, 2024-09-19T05:29:47.187 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_created": 0, 2024-09-19T05:29:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_enqueued": 0, 2024-09-19T05:29:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_reintegrated": 0, 2024-09-19T05:29:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_migrated": 0, 2024-09-19T05:29:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_processing": 0, 2024-09-19T05:29:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_enqueued": 0, 2024-09-19T05:29:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_prioritized": 0, 2024-09-19T05:29:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_started": 0, 2024-09-19T05:29:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_completed": 0, 2024-09-19T05:29:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_quiesce_path": 0, 2024-09-19T05:29:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_quiesce_inode": 0, 2024-09-19T05:29:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T05:29:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_exportdir": 0, 2024-09-19T05:29:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_flush": 0, 2024-09-19T05:29:47.188 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragmentdir": 0, 2024-09-19T05:29:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragstats": 0, 2024-09-19T05:29:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_inodestats": 0 2024-09-19T05:29:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_log": { 2024-09-19T05:29:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: "evlrg": 0, 2024-09-19T05:29:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: "evadd": 0, 2024-09-19T05:29:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: "evex": 0, 2024-09-19T05:29:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: "evtrm": 0, 2024-09-19T05:29:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: "ev": 211754, 2024-09-19T05:29:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: "evexg": 0, 2024-09-19T05:29:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: "evexd": 0, 2024-09-19T05:29:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: "segadd": 0, 2024-09-19T05:29:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: "segex": 0, 2024-09-19T05:29:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "segtrm": 0, 2024-09-19T05:29:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "seg": 2, 2024-09-19T05:29:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "segmjr": 34, 2024-09-19T05:29:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "segexg": 0, 2024-09-19T05:29:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "segexd": 0, 2024-09-19T05:29:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "expos": 357880307, 2024-09-19T05:29:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "wrpos": 358460661, 2024-09-19T05:29:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "rdpos": 358460549, 2024-09-19T05:29:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "jlat": { 2024-09-19T05:29:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.190 INFO:teuthology.orchestra.run.smithi194.stdout: "replayed": 211754 2024-09-19T05:29:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_mem": { 2024-09-19T05:29:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "ino": 9197, 2024-09-19T05:29:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "ino+": 21813, 2024-09-19T05:29:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "ino-": 12616, 2024-09-19T05:29:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "dir": 440, 2024-09-19T05:29:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "dir+": 752, 2024-09-19T05:29:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "dir-": 312, 2024-09-19T05:29:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "dn": 25252, 2024-09-19T05:29:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "dn+": 41812, 2024-09-19T05:29:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "dn-": 16560, 2024-09-19T05:29:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "cap": 0, 2024-09-19T05:29:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "cap+": 0, 2024-09-19T05:29:47.191 INFO:teuthology.orchestra.run.smithi194.stdout: "cap-": 0, 2024-09-19T05:29:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "rss": 94572, 2024-09-19T05:29:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "heap": 215328 2024-09-19T05:29:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_server": { 2024-09-19T05:29:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_client_request": 0, 2024-09-19T05:29:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_server_request": 0, 2024-09-19T05:29:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_request": 0, 2024-09-19T05:29:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_session": 0, 2024-09-19T05:29:47.192 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_peer_request": 0, 2024-09-19T05:29:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: "req_create_latency": { 2024-09-19T05:29:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getattr_latency": { 2024-09-19T05:29:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getfilelock_latency": { 2024-09-19T05:29:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.193 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "req_link_latency": { 2024-09-19T05:29:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookup_latency": { 2024-09-19T05:29:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookuphash_latency": { 2024-09-19T05:29:47.194 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupino_latency": { 2024-09-19T05:29:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupname_latency": { 2024-09-19T05:29:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.195 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupparent_latency": { 2024-09-19T05:29:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupsnap_latency": { 2024-09-19T05:29:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lssnap_latency": { 2024-09-19T05:29:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.196 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mkdir_latency": { 2024-09-19T05:29:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.197 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mknod_latency": { 2024-09-19T05:29:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mksnap_latency": { 2024-09-19T05:29:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "req_open_latency": { 2024-09-19T05:29:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.198 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: "req_readdir_latency": { 2024-09-19T05:29:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rename_latency": { 2024-09-19T05:29:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: "req_renamesnap_latency": { 2024-09-19T05:29:47.199 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: "req_snapdiff_latency": { 2024-09-19T05:29:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmdir_latency": { 2024-09-19T05:29:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.200 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmsnap_latency": { 2024-09-19T05:29:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmxattr_latency": { 2024-09-19T05:29:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setattr_latency": { 2024-09-19T05:29:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.201 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setdirlayout_latency": { 2024-09-19T05:29:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setfilelock_latency": { 2024-09-19T05:29:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setlayout_latency": { 2024-09-19T05:29:47.202 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setxattr_latency": { 2024-09-19T05:29:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "req_symlink_latency": { 2024-09-19T05:29:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.203 INFO:teuthology.orchestra.run.smithi194.stdout: "req_unlink_latency": { 2024-09-19T05:29:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_revoke_eviction": 0, 2024-09-19T05:29:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_acquisition_throttle": 0, 2024-09-19T05:29:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getvxattr_latency": { 2024-09-19T05:29:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.204 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_sessions": { 2024-09-19T05:29:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "session_count": 2, 2024-09-19T05:29:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "session_add": 5, 2024-09-19T05:29:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "session_remove": 3, 2024-09-19T05:29:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_open": 4, 2024-09-19T05:29:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_stale": 0, 2024-09-19T05:29:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "total_load": 0, 2024-09-19T05:29:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "average_load": 0, 2024-09-19T05:29:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "avg_session_uptime": 2593, 2024-09-19T05:29:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "mdthresh_evicted": 0 2024-09-19T05:29:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "mempool": { 2024-09-19T05:29:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:29:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_items": 0, 2024-09-19T05:29:47.205 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:29:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:29:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:29:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:29:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:29:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:29:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:29:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:29:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:29:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:29:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:29:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:29:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:29:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_items": 0, 2024-09-19T05:29:47.206 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:29:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_items": 0, 2024-09-19T05:29:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:29:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:29:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:29:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:29:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:29:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:29:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:29:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_items": 0, 2024-09-19T05:29:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:29:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:29:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:29:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_items": 0, 2024-09-19T05:29:47.207 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_bytes": 0, 2024-09-19T05:29:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_items": 0, 2024-09-19T05:29:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:29:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:29:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:29:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:29:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_bytes": 238647, 2024-09-19T05:29:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_items": 76, 2024-09-19T05:29:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:29:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_items": 0, 2024-09-19T05:29:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_bytes": 0, 2024-09-19T05:29:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_items": 0, 2024-09-19T05:29:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:29:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_items": 0, 2024-09-19T05:29:47.208 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:29:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_items": 0, 2024-09-19T05:29:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_bytes": 8480, 2024-09-19T05:29:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_items": 186, 2024-09-19T05:29:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:29:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:29:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_bytes": 0, 2024-09-19T05:29:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_items": 0, 2024-09-19T05:29:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_bytes": 37667036, 2024-09-19T05:29:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_items": 191840, 2024-09-19T05:29:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_bytes": 0, 2024-09-19T05:29:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_items": 0, 2024-09-19T05:29:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_bytes": 0, 2024-09-19T05:29:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_items": 0 2024-09-19T05:29:47.209 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "objecter": { 2024-09-19T05:29:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "op_active": 0, 2024-09-19T05:29:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "op_laggy": 0, 2024-09-19T05:29:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send": 2839, 2024-09-19T05:29:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send_bytes": 26, 2024-09-19T05:29:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "op_resend": 4, 2024-09-19T05:29:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "op_reply": 2839, 2024-09-19T05:29:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "op_latency": { 2024-09-19T05:29:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 2839, 2024-09-19T05:29:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 2.165955131, 2024-09-19T05:29:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000762928 2024-09-19T05:29:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.210 INFO:teuthology.orchestra.run.smithi194.stdout: "op_inflight": 0, 2024-09-19T05:29:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "oplen_avg": { 2024-09-19T05:29:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 2839, 2024-09-19T05:29:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 2840 2024-09-19T05:29:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "op": 2839, 2024-09-19T05:29:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "op_r": 2839, 2024-09-19T05:29:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "op_w": 0, 2024-09-19T05:29:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "op_rmw": 0, 2024-09-19T05:29:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "op_pg": 0, 2024-09-19T05:29:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_stat": 1654, 2024-09-19T05:29:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_create": 0, 2024-09-19T05:29:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_read": 1182, 2024-09-19T05:29:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_write": 0, 2024-09-19T05:29:47.211 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writefull": 0, 2024-09-19T05:29:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writesame": 0, 2024-09-19T05:29:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_append": 0, 2024-09-19T05:29:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_zero": 0, 2024-09-19T05:29:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_truncate": 0, 2024-09-19T05:29:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_delete": 0, 2024-09-19T05:29:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_mapext": 0, 2024-09-19T05:29:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_sparse_read": 0, 2024-09-19T05:29:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_clonerange": 0, 2024-09-19T05:29:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_getxattr": 2, 2024-09-19T05:29:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_setxattr": 0, 2024-09-19T05:29:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_cmpxattr": 0, 2024-09-19T05:29:47.212 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_rmxattr": 0, 2024-09-19T05:29:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_resetxattrs": 0, 2024-09-19T05:29:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_call": 0, 2024-09-19T05:29:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_watch": 0, 2024-09-19T05:29:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_notify": 0, 2024-09-19T05:29:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T05:29:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls": 0, 2024-09-19T05:29:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls_filter": 0, 2024-09-19T05:29:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_other": 0, 2024-09-19T05:29:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_active": 0, 2024-09-19T05:29:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_send": 0, 2024-09-19T05:29:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_resend": 0, 2024-09-19T05:29:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_ping": 0, 2024-09-19T05:29:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_active": 0, 2024-09-19T05:29:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_send": 0, 2024-09-19T05:29:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_resend": 0, 2024-09-19T05:29:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_active": 0, 2024-09-19T05:29:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_send": 0, 2024-09-19T05:29:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_resend": 0, 2024-09-19T05:29:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_active": 0, 2024-09-19T05:29:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_send": 0, 2024-09-19T05:29:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_resend": 0, 2024-09-19T05:29:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "command_active": 0, 2024-09-19T05:29:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "command_send": 0, 2024-09-19T05:29:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "command_resend": 0, 2024-09-19T05:29:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "map_epoch": 93, 2024-09-19T05:29:47.214 INFO:teuthology.orchestra.run.smithi194.stdout: "map_full": 0, 2024-09-19T05:29:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "map_inc": 13, 2024-09-19T05:29:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_sessions": 11, 2024-09-19T05:29:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_open": 11, 2024-09-19T05:29:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_close": 0, 2024-09-19T05:29:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_laggy": 0, 2024-09-19T05:29:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_wr": 0, 2024-09-19T05:29:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_rd": 2, 2024-09-19T05:29:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_del": 0 2024-09-19T05:29:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "oft": { 2024-09-19T05:29:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_objs": 0, 2024-09-19T05:29:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_kv_pairs": 0, 2024-09-19T05:29:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_updates": 0, 2024-09-19T05:29:47.215 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_removes": 0 2024-09-19T05:29:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "osd-slow-ops": { 2024-09-19T05:29:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_ops_count": 0 2024-09-19T05:29:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "purge_queue": { 2024-09-19T05:29:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops": 0, 2024-09-19T05:29:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T05:29:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing": 0, 2024-09-19T05:29:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_high_water": 0, 2024-09-19T05:29:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executed_ops": 0, 2024-09-19T05:29:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executed": 0, 2024-09-19T05:29:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_item_in_journal": 0 2024-09-19T05:29:47.216 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:29:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-19T05:29:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-09-19T05:29:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-19T05:29:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 3091, 2024-09-19T05:29:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 356298149, 2024-09-19T05:29:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 3091, 2024-09-19T05:29:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-19T05:29:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-19T05:29:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 3091, 2024-09-19T05:29:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 356298149, 2024-09-19T05:29:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-19T05:29:47.217 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_bytes": { 2024-09-19T05:29:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-19T05:29:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-09-19T05:29:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-19T05:29:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-19T05:29:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-19T05:29:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-19T05:29:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 2839, 2024-09-19T05:29:47.218 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 354267974, 2024-09-19T05:29:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 2839, 2024-09-19T05:29:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 354267974, 2024-09-19T05:29:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-19T05:29:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_ops": { 2024-09-19T05:29:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-19T05:29:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 1024, 2024-09-19T05:29:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-19T05:29:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-19T05:29:47.219 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-19T05:29:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-19T05:29:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 2839, 2024-09-19T05:29:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 2839, 2024-09-19T05:29:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 2839, 2024-09-19T05:29:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 2839, 2024-09-19T05:29:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-19T05:29:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.220 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle": { 2024-09-19T05:29:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-19T05:29:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2024-09-19T05:29:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-19T05:29:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-19T05:29:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-19T05:29:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-19T05:29:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-19T05:29:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-19T05:29:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 0, 2024-09-19T05:29:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 0, 2024-09-19T05:29:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-19T05:29:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.221 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle-0x5555fccf8b40": { 2024-09-19T05:29:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-19T05:29:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2024-09-19T05:29:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-19T05:29:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-19T05:29:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-19T05:29:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-19T05:29:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-19T05:29:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-19T05:29:47.222 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 0, 2024-09-19T05:29:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 0, 2024-09-19T05:29:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-19T05:29:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:47.223 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:47.223 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-19T05:29:48.012 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-19T05:29:48.012 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-19T05:29:48.012 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-09-19T05:29:48.012 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-19T05:29:48.012 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T05:29:48.012 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-09-19T05:29:48.012 DEBUG:tasks.check_counter:Getting stats from i 2024-09-19T05:29:48.013 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-19T05:29:48.035 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:47 smithi194 ceph-mon[35228]: pgmap v327: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:29:48.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:47 smithi120 ceph-mon[30956]: pgmap v327: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:29:48.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:47 smithi178 ceph-mon[34347]: pgmap v327: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:29:48.257 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:29:48.822 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-19T05:29:48.822 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:29:48.822 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 645210, 2024-09-19T05:29:48.822 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 287909, 2024-09-19T05:29:48.822 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 220324237, 2024-09-19T05:29:48.822 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 239975939, 2024-09-19T05:29:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 97, 2024-09-19T05:29:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 7, 2024-09-19T05:29:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 18.512569671, 2024-09-19T05:29:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 7.164116002, 2024-09-19T05:29:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 15.022569936, 2024-09-19T05:29:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.451133688, 2024-09-19T05:29:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 287903, 2024-09-19T05:29:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 12.110419635, 2024-09-19T05:29:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000042064 2024-09-19T05:29:48.823 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 888264, 2024-09-19T05:29:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.097513733, 2024-09-19T05:29:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000109 2024-09-19T05:29:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 98560, 2024-09-19T05:29:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 31264 2024-09-19T05:29:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:29:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 62938, 2024-09-19T05:29:48.824 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 60682, 2024-09-19T05:29:48.825 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 26891984, 2024-09-19T05:29:48.825 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 165838197, 2024-09-19T05:29:48.825 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 8, 2024-09-19T05:29:48.825 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 6, 2024-09-19T05:29:48.825 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 3.952161828, 2024-09-19T05:29:48.825 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 1.814947576, 2024-09-19T05:29:48.825 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 2.043790963, 2024-09-19T05:29:48.825 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.424810089, 2024-09-19T05:29:48.825 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:48.825 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 60684, 2024-09-19T05:29:48.825 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 14.826895264, 2024-09-19T05:29:48.826 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000244329 2024-09-19T05:29:48.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.826 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:48.826 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 92851, 2024-09-19T05:29:48.826 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.012846806, 2024-09-19T05:29:48.826 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000138 2024-09-19T05:29:48.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.826 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 1559504, 2024-09-19T05:29:48.826 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 459696 2024-09-19T05:29:48.826 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.826 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:29:48.826 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 46488, 2024-09-19T05:29:48.827 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 42998, 2024-09-19T05:29:48.827 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 18956571, 2024-09-19T05:29:48.827 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 123762540, 2024-09-19T05:29:48.827 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 27, 2024-09-19T05:29:48.827 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 6, 2024-09-19T05:29:48.827 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 2.717390517, 2024-09-19T05:29:48.827 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 1.108036000, 2024-09-19T05:29:48.827 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 1.439161796, 2024-09-19T05:29:48.827 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.391327208, 2024-09-19T05:29:48.828 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:48.828 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 42996, 2024-09-19T05:29:48.828 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 8.942911488, 2024-09-19T05:29:48.828 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000207994 2024-09-19T05:29:48.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.828 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:48.828 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 66016, 2024-09-19T05:29:48.828 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.009126652, 2024-09-19T05:29:48.828 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000138 2024-09-19T05:29:48.828 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.828 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 353824, 2024-09-19T05:29:48.828 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 212304 2024-09-19T05:29:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: "cct": { 2024-09-19T05:29:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: "total_workers": 1, 2024-09-19T05:29:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: "unhealthy_workers": 0 2024-09-19T05:29:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-MDSRank": { 2024-09-19T05:29:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2024-09-19T05:29:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2024-09-19T05:29:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 30212, 2024-09-19T05:29:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 49.793827579, 2024-09-19T05:29:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.001648147 2024-09-19T05:29:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:48.829 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-PurgeQueue": { 2024-09-19T05:29:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2024-09-19T05:29:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2024-09-19T05:29:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 8183, 2024-09-19T05:29:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 1.190927931, 2024-09-19T05:29:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000145536 2024-09-19T05:29:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: "mds": { 2024-09-19T05:29:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: "request": 183848, 2024-09-19T05:29:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: "reply": 105808, 2024-09-19T05:29:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: "reply_latency": { 2024-09-19T05:29:48.830 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 105808, 2024-09-19T05:29:48.831 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 638.353627034, 2024-09-19T05:29:48.831 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.006033131 2024-09-19T05:29:48.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.831 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_reply": 0, 2024-09-19T05:29:48.831 INFO:teuthology.orchestra.run.smithi194.stdout: "forward": 78040, 2024-09-19T05:29:48.831 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_complete": 229, 2024-09-19T05:29:48.831 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_keys": 2, 2024-09-19T05:29:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_commit": 2998, 2024-09-19T05:29:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_split": 35, 2024-09-19T05:29:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_merge": 0, 2024-09-19T05:29:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes": 18850, 2024-09-19T05:29:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_top": 11284, 2024-09-19T05:29:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_bottom": 7490, 2024-09-19T05:29:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pin_tail": 76, 2024-09-19T05:29:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pinned": 184, 2024-09-19T05:29:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_expired": 20498, 2024-09-19T05:29:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_with_caps": 2, 2024-09-19T05:29:48.832 INFO:teuthology.orchestra.run.smithi194.stdout: "caps": 3, 2024-09-19T05:29:48.833 INFO:teuthology.orchestra.run.smithi194.stdout: "subtrees": 4, 2024-09-19T05:29:48.833 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse": 273236, 2024-09-19T05:29:48.833 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_hit": 111690, 2024-09-19T05:29:48.833 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_forward": 77437, 2024-09-19T05:29:48.833 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_discover": 365, 2024-09-19T05:29:48.833 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_dir_fetch": 188, 2024-09-19T05:29:48.833 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_remote_ino": 0, 2024-09-19T05:29:48.833 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_lock": 3, 2024-09-19T05:29:48.833 INFO:teuthology.orchestra.run.smithi194.stdout: "load_cent": 0, 2024-09-19T05:29:48.833 INFO:teuthology.orchestra.run.smithi194.stdout: "q": 0, 2024-09-19T05:29:48.833 INFO:teuthology.orchestra.run.smithi194.stdout: "exported": 151, 2024-09-19T05:29:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: "exported_inodes": 13959, 2024-09-19T05:29:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: "imported": 310, 2024-09-19T05:29:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: "imported_inodes": 14280, 2024-09-19T05:29:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_dir_fetch": 0, 2024-09-19T05:29:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_backtrace_fetch": 4694, 2024-09-19T05:29:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_peer_discover": 0, 2024-09-19T05:29:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rfiles": 4, 2024-09-19T05:29:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rbytes": 234, 2024-09-19T05:29:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rsnaps": 6, 2024-09-19T05:29:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_fetch": 4694, 2024-09-19T05:29:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_set_tag": 0, 2024-09-19T05:29:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T05:29:48.834 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_inotable_repaired": 0, 2024-09-19T05:29:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_inodes": 125, 2024-09-19T05:29:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_base_inodes": 4, 2024-09-19T05:29:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dirfrag_rstats": 121, 2024-09-19T05:29:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_file_inodes": 4569, 2024-09-19T05:29:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_inode_file_caps": 0, 2024-09-19T05:29:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_revoke": 24401, 2024-09-19T05:29:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_grant": 20217, 2024-09-19T05:29:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_trunc": 6, 2024-09-19T05:29:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T05:29:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T05:29:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps": 447880, 2024-09-19T05:29:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps_dirty": 12156, 2024-09-19T05:29:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_cap_release": 332, 2024-09-19T05:29:48.835 INFO:teuthology.orchestra.run.smithi194.stdout: "process_request_cap_release": 54128 2024-09-19T05:29:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_cache": { 2024-09-19T05:29:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update": 0, 2024-09-19T05:29:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update_receipt": 0, 2024-09-19T05:29:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_try_discover": 0, 2024-09-19T05:29:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_send_discover": 386, 2024-09-19T05:29:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_handle_discover": 465, 2024-09-19T05:29:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays": 72, 2024-09-19T05:29:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_delayed": 0, 2024-09-19T05:29:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_enqueuing": 0, 2024-09-19T05:29:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_created": 4344, 2024-09-19T05:29:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_enqueued": 4272, 2024-09-19T05:29:48.836 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_reintegrated": 0, 2024-09-19T05:29:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_migrated": 0, 2024-09-19T05:29:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_processing": 0, 2024-09-19T05:29:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_enqueued": 0, 2024-09-19T05:29:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_prioritized": 0, 2024-09-19T05:29:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_started": 0, 2024-09-19T05:29:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_completed": 0, 2024-09-19T05:29:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_quiesce_path": 0, 2024-09-19T05:29:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_quiesce_inode": 0, 2024-09-19T05:29:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_enqueue_scrub": 4, 2024-09-19T05:29:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_exportdir": 166, 2024-09-19T05:29:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_flush": 0, 2024-09-19T05:29:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragmentdir": 35, 2024-09-19T05:29:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragstats": 0, 2024-09-19T05:29:48.837 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_inodestats": 0 2024-09-19T05:29:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_log": { 2024-09-19T05:29:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: "evlrg": 10, 2024-09-19T05:29:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: "evadd": 211754, 2024-09-19T05:29:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: "evex": 211623, 2024-09-19T05:29:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: "evtrm": 211623, 2024-09-19T05:29:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: "ev": 131, 2024-09-19T05:29:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: "evexg": 0, 2024-09-19T05:29:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: "evexd": 40, 2024-09-19T05:29:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: "segadd": 269, 2024-09-19T05:29:48.838 INFO:teuthology.orchestra.run.smithi194.stdout: "segex": 268, 2024-09-19T05:29:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: "segtrm": 268, 2024-09-19T05:29:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: "seg": 1, 2024-09-19T05:29:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: "segmjr": 1, 2024-09-19T05:29:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: "segexg": 0, 2024-09-19T05:29:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: "segexd": 1, 2024-09-19T05:29:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: "expos": 357880307, 2024-09-19T05:29:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: "wrpos": 358460661, 2024-09-19T05:29:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: "rdpos": 0, 2024-09-19T05:29:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: "jlat": { 2024-09-19T05:29:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 14397, 2024-09-19T05:29:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 76.234506492, 2024-09-19T05:29:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.005295166 2024-09-19T05:29:48.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: "replayed": 0 2024-09-19T05:29:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_mem": { 2024-09-19T05:29:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: "ino": 9178, 2024-09-19T05:29:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: "ino+": 22526, 2024-09-19T05:29:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: "ino-": 13348, 2024-09-19T05:29:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: "dir": 455, 2024-09-19T05:29:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: "dir+": 846, 2024-09-19T05:29:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: "dir-": 391, 2024-09-19T05:29:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: "dn": 18850, 2024-09-19T05:29:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: "dn+": 44822, 2024-09-19T05:29:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: "dn-": 25972, 2024-09-19T05:29:48.840 INFO:teuthology.orchestra.run.smithi194.stdout: "cap": 3, 2024-09-19T05:29:48.841 INFO:teuthology.orchestra.run.smithi194.stdout: "cap+": 12446, 2024-09-19T05:29:48.841 INFO:teuthology.orchestra.run.smithi194.stdout: "cap-": 12443, 2024-09-19T05:29:48.841 INFO:teuthology.orchestra.run.smithi194.stdout: "rss": 135372, 2024-09-19T05:29:48.841 INFO:teuthology.orchestra.run.smithi194.stdout: "heap": 231712 2024-09-19T05:29:48.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.841 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_server": { 2024-09-19T05:29:48.841 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_client_request": 200508, 2024-09-19T05:29:48.841 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_server_request": 17385, 2024-09-19T05:29:48.841 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_request": 183848, 2024-09-19T05:29:48.842 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_session": 321, 2024-09-19T05:29:48.842 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_peer_request": 33059, 2024-09-19T05:29:48.842 INFO:teuthology.orchestra.run.smithi194.stdout: "req_create_latency": { 2024-09-19T05:29:48.842 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 11973, 2024-09-19T05:29:48.842 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 75.966126695, 2024-09-19T05:29:48.842 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.006344786 2024-09-19T05:29:48.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.842 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getattr_latency": { 2024-09-19T05:29:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 923, 2024-09-19T05:29:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.225211167, 2024-09-19T05:29:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000243999 2024-09-19T05:29:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getfilelock_latency": { 2024-09-19T05:29:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: "req_link_latency": { 2024-09-19T05:29:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:48.843 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookup_latency": { 2024-09-19T05:29:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 74450, 2024-09-19T05:29:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 365.759614151, 2024-09-19T05:29:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.004912822 2024-09-19T05:29:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookuphash_latency": { 2024-09-19T05:29:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupino_latency": { 2024-09-19T05:29:48.844 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupname_latency": { 2024-09-19T05:29:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupparent_latency": { 2024-09-19T05:29:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:48.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupsnap_latency": { 2024-09-19T05:29:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lssnap_latency": { 2024-09-19T05:29:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 10, 2024-09-19T05:29:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.003035006, 2024-09-19T05:29:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000303500 2024-09-19T05:29:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mkdir_latency": { 2024-09-19T05:29:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 123, 2024-09-19T05:29:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.561072772, 2024-09-19T05:29:48.846 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.004561567 2024-09-19T05:29:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mknod_latency": { 2024-09-19T05:29:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mksnap_latency": { 2024-09-19T05:29:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 10, 2024-09-19T05:29:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 10.030757744, 2024-09-19T05:29:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 1.003075774 2024-09-19T05:29:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: "req_open_latency": { 2024-09-19T05:29:48.847 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 3598, 2024-09-19T05:29:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 7.175471601, 2024-09-19T05:29:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.001994294 2024-09-19T05:29:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: "req_readdir_latency": { 2024-09-19T05:29:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 289, 2024-09-19T05:29:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.597437529, 2024-09-19T05:29:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.002067257 2024-09-19T05:29:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rename_latency": { 2024-09-19T05:29:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 11593, 2024-09-19T05:29:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 172.441398091, 2024-09-19T05:29:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.014874613 2024-09-19T05:29:48.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: "req_renamesnap_latency": { 2024-09-19T05:29:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: "req_snapdiff_latency": { 2024-09-19T05:29:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmdir_latency": { 2024-09-19T05:29:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 79, 2024-09-19T05:29:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 1.895133785, 2024-09-19T05:29:48.849 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.023989035 2024-09-19T05:29:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmsnap_latency": { 2024-09-19T05:29:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 4, 2024-09-19T05:29:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.018440778, 2024-09-19T05:29:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.004610194 2024-09-19T05:29:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmxattr_latency": { 2024-09-19T05:29:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setattr_latency": { 2024-09-19T05:29:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 1, 2024-09-19T05:29:48.850 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.001001852, 2024-09-19T05:29:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.001001852 2024-09-19T05:29:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setdirlayout_latency": { 2024-09-19T05:29:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setfilelock_latency": { 2024-09-19T05:29:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:48.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.852 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setlayout_latency": { 2024-09-19T05:29:48.852 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:48.852 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:48.852 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:48.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.852 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setxattr_latency": { 2024-09-19T05:29:48.852 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 7, 2024-09-19T05:29:48.852 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.019537532, 2024-09-19T05:29:48.852 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.002791076 2024-09-19T05:29:48.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.853 INFO:teuthology.orchestra.run.smithi194.stdout: "req_symlink_latency": { 2024-09-19T05:29:48.853 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 3, 2024-09-19T05:29:48.853 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.002181429, 2024-09-19T05:29:48.853 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000727143 2024-09-19T05:29:48.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.853 INFO:teuthology.orchestra.run.smithi194.stdout: "req_unlink_latency": { 2024-09-19T05:29:48.853 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 2745, 2024-09-19T05:29:48.853 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 3.657206902, 2024-09-19T05:29:48.853 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.001332315 2024-09-19T05:29:48.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_revoke_eviction": 0, 2024-09-19T05:29:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_acquisition_throttle": 0, 2024-09-19T05:29:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getvxattr_latency": { 2024-09-19T05:29:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_sessions": { 2024-09-19T05:29:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: "session_count": 2, 2024-09-19T05:29:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: "session_add": 5, 2024-09-19T05:29:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: "session_remove": 3, 2024-09-19T05:29:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_open": 2, 2024-09-19T05:29:48.854 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_stale": 0, 2024-09-19T05:29:48.855 INFO:teuthology.orchestra.run.smithi194.stdout: "total_load": 3038, 2024-09-19T05:29:48.855 INFO:teuthology.orchestra.run.smithi194.stdout: "average_load": 1519, 2024-09-19T05:29:48.855 INFO:teuthology.orchestra.run.smithi194.stdout: "avg_session_uptime": 609, 2024-09-19T05:29:48.855 INFO:teuthology.orchestra.run.smithi194.stdout: "mdthresh_evicted": 0 2024-09-19T05:29:48.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.855 INFO:teuthology.orchestra.run.smithi194.stdout: "mempool": { 2024-09-19T05:29:48.855 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_bytes": 360, 2024-09-19T05:29:48.856 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_items": 360, 2024-09-19T05:29:48.856 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:29:48.856 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:29:48.856 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:29:48.856 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:29:48.857 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:29:48.857 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:29:48.857 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:29:48.857 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:29:48.857 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:29:48.857 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:29:48.857 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:29:48.857 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:29:48.857 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:29:48.857 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_items": 0, 2024-09-19T05:29:48.857 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:29:48.857 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_items": 0, 2024-09-19T05:29:48.858 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:29:48.858 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:29:48.858 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:29:48.858 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:29:48.858 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:29:48.858 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:29:48.858 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:29:48.858 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_items": 0, 2024-09-19T05:29:48.859 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:29:48.859 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:29:48.859 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:29:48.859 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_items": 0, 2024-09-19T05:29:48.859 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_bytes": 0, 2024-09-19T05:29:48.859 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_items": 0, 2024-09-19T05:29:48.859 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:29:48.859 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:29:48.859 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:29:48.859 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:29:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_bytes": 899755, 2024-09-19T05:29:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_items": 271, 2024-09-19T05:29:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_bytes": 176, 2024-09-19T05:29:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_items": 2, 2024-09-19T05:29:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_bytes": 0, 2024-09-19T05:29:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_items": 0, 2024-09-19T05:29:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:29:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_items": 0, 2024-09-19T05:29:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:29:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_items": 0, 2024-09-19T05:29:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_bytes": 8480, 2024-09-19T05:29:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_items": 186, 2024-09-19T05:29:48.860 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:29:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:29:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_bytes": 0, 2024-09-19T05:29:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_items": 0, 2024-09-19T05:29:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_bytes": 33513184, 2024-09-19T05:29:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_items": 169203, 2024-09-19T05:29:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_bytes": 0, 2024-09-19T05:29:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_items": 0, 2024-09-19T05:29:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_bytes": 0, 2024-09-19T05:29:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_items": 0 2024-09-19T05:29:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: "objecter": { 2024-09-19T05:29:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: "op_active": 0, 2024-09-19T05:29:48.861 INFO:teuthology.orchestra.run.smithi194.stdout: "op_laggy": 0, 2024-09-19T05:29:48.862 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send": 38470, 2024-09-19T05:29:48.862 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send_bytes": 377819730, 2024-09-19T05:29:48.862 INFO:teuthology.orchestra.run.smithi194.stdout: "op_resend": 37, 2024-09-19T05:29:48.862 INFO:teuthology.orchestra.run.smithi194.stdout: "op_reply": 38470, 2024-09-19T05:29:48.862 INFO:teuthology.orchestra.run.smithi194.stdout: "op_latency": { 2024-09-19T05:29:48.862 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 38470, 2024-09-19T05:29:48.862 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 615.151191454, 2024-09-19T05:29:48.862 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.015990413 2024-09-19T05:29:48.862 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.862 INFO:teuthology.orchestra.run.smithi194.stdout: "op_inflight": 0, 2024-09-19T05:29:48.863 INFO:teuthology.orchestra.run.smithi194.stdout: "oplen_avg": { 2024-09-19T05:29:48.863 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 38470, 2024-09-19T05:29:48.863 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 63411 2024-09-19T05:29:48.863 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.863 INFO:teuthology.orchestra.run.smithi194.stdout: "op": 38470, 2024-09-19T05:29:48.863 INFO:teuthology.orchestra.run.smithi194.stdout: "op_r": 5882, 2024-09-19T05:29:48.863 INFO:teuthology.orchestra.run.smithi194.stdout: "op_w": 32588, 2024-09-19T05:29:48.863 INFO:teuthology.orchestra.run.smithi194.stdout: "op_rmw": 0, 2024-09-19T05:29:48.863 INFO:teuthology.orchestra.run.smithi194.stdout: "op_pg": 0, 2024-09-19T05:29:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_stat": 2612, 2024-09-19T05:29:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_create": 8881, 2024-09-19T05:29:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_read": 446, 2024-09-19T05:29:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_write": 14839, 2024-09-19T05:29:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writefull": 415, 2024-09-19T05:29:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writesame": 0, 2024-09-19T05:29:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_append": 0, 2024-09-19T05:29:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_zero": 0, 2024-09-19T05:29:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_truncate": 35, 2024-09-19T05:29:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_delete": 4968, 2024-09-19T05:29:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_mapext": 0, 2024-09-19T05:29:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_sparse_read": 0, 2024-09-19T05:29:48.864 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_clonerange": 0, 2024-09-19T05:29:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_getxattr": 4706, 2024-09-19T05:29:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_setxattr": 17763, 2024-09-19T05:29:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_cmpxattr": 0, 2024-09-19T05:29:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_rmxattr": 0, 2024-09-19T05:29:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_resetxattrs": 0, 2024-09-19T05:29:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_call": 0, 2024-09-19T05:29:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_watch": 0, 2024-09-19T05:29:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_notify": 0, 2024-09-19T05:29:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T05:29:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls": 0, 2024-09-19T05:29:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls_filter": 0, 2024-09-19T05:29:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_other": 6, 2024-09-19T05:29:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_active": 0, 2024-09-19T05:29:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_send": 0, 2024-09-19T05:29:48.866 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_resend": 0, 2024-09-19T05:29:48.866 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_ping": 0, 2024-09-19T05:29:48.866 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_active": 0, 2024-09-19T05:29:48.868 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_send": 0, 2024-09-19T05:29:48.868 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_resend": 0, 2024-09-19T05:29:48.868 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_active": 0, 2024-09-19T05:29:48.868 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_send": 0, 2024-09-19T05:29:48.868 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_resend": 0, 2024-09-19T05:29:48.868 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_active": 0, 2024-09-19T05:29:48.869 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_send": 0, 2024-09-19T05:29:48.869 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_resend": 0, 2024-09-19T05:29:48.869 INFO:teuthology.orchestra.run.smithi194.stdout: "command_active": 0, 2024-09-19T05:29:48.869 INFO:teuthology.orchestra.run.smithi194.stdout: "command_send": 0, 2024-09-19T05:29:48.869 INFO:teuthology.orchestra.run.smithi194.stdout: "command_resend": 0, 2024-09-19T05:29:48.869 INFO:teuthology.orchestra.run.smithi194.stdout: "map_epoch": 93, 2024-09-19T05:29:48.869 INFO:teuthology.orchestra.run.smithi194.stdout: "map_full": 0, 2024-09-19T05:29:48.869 INFO:teuthology.orchestra.run.smithi194.stdout: "map_inc": 13, 2024-09-19T05:29:48.869 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_sessions": 12, 2024-09-19T05:29:48.869 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_open": 12, 2024-09-19T05:29:48.869 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_close": 0, 2024-09-19T05:29:48.870 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_laggy": 0, 2024-09-19T05:29:48.870 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_wr": 6139, 2024-09-19T05:29:48.870 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_rd": 969, 2024-09-19T05:29:48.870 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_del": 1632 2024-09-19T05:29:48.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.870 INFO:teuthology.orchestra.run.smithi194.stdout: "oft": { 2024-09-19T05:29:48.870 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_objs": 1, 2024-09-19T05:29:48.870 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_kv_pairs": 0, 2024-09-19T05:29:48.870 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_updates": 0, 2024-09-19T05:29:48.870 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_removes": 0 2024-09-19T05:29:48.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.870 INFO:teuthology.orchestra.run.smithi194.stdout: "osd-slow-ops": { 2024-09-19T05:29:48.870 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_ops_count": 0 2024-09-19T05:29:48.870 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.871 INFO:teuthology.orchestra.run.smithi194.stdout: "purge_queue": { 2024-09-19T05:29:48.871 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops": 0, 2024-09-19T05:29:48.871 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops_high_water": 18, 2024-09-19T05:29:48.871 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing": 0, 2024-09-19T05:29:48.871 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_high_water": 10, 2024-09-19T05:29:48.871 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executed_ops": 4288, 2024-09-19T05:29:48.871 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executed": 4272, 2024-09-19T05:29:48.871 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_item_in_journal": 0 2024-09-19T05:29:48.871 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.871 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:29:48.871 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-19T05:29:48.871 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-09-19T05:29:48.871 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-19T05:29:48.872 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 754632, 2024-09-19T05:29:48.872 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 198190818, 2024-09-19T05:29:48.872 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:48.872 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 754632, 2024-09-19T05:29:48.872 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-19T05:29:48.872 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-19T05:29:48.872 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 754632, 2024-09-19T05:29:48.872 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 198190818, 2024-09-19T05:29:48.872 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-19T05:29:48.872 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:48.872 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:48.872 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:48.873 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:48.873 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.873 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_bytes": { 2024-09-19T05:29:48.873 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-19T05:29:48.873 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-09-19T05:29:48.873 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-19T05:29:48.874 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-19T05:29:48.874 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-19T05:29:48.874 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:48.874 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-19T05:29:48.874 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 38470, 2024-09-19T05:29:48.874 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 378302492, 2024-09-19T05:29:48.875 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 38470, 2024-09-19T05:29:48.875 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 378302492, 2024-09-19T05:29:48.875 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-19T05:29:48.875 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:48.875 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:48.875 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:48.876 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:48.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.876 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_ops": { 2024-09-19T05:29:48.876 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-19T05:29:48.876 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 1024, 2024-09-19T05:29:48.876 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-19T05:29:48.876 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-09-19T05:29:48.876 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-09-19T05:29:48.877 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:48.877 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-09-19T05:29:48.877 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 38470, 2024-09-19T05:29:48.877 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 38470, 2024-09-19T05:29:48.877 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 38470, 2024-09-19T05:29:48.877 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 38470, 2024-09-19T05:29:48.877 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-19T05:29:48.878 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:48.878 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:48.878 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:48.878 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:48.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.878 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle": { 2024-09-19T05:29:48.878 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-19T05:29:48.878 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2024-09-19T05:29:48.878 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-19T05:29:48.878 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 4272, 2024-09-19T05:29:48.878 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 503712, 2024-09-19T05:29:48.878 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:48.878 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 4272, 2024-09-19T05:29:48.878 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-19T05:29:48.879 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-19T05:29:48.879 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 442, 2024-09-19T05:29:48.879 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 503712, 2024-09-19T05:29:48.879 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-19T05:29:48.879 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:48.879 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:48.879 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:48.879 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:48.879 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:48.879 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle-0x55fcbc552960": { 2024-09-19T05:29:48.879 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-19T05:29:48.879 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2024-09-19T05:29:48.879 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-19T05:29:48.879 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 211754, 2024-09-19T05:29:48.879 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 354266357, 2024-09-19T05:29:48.880 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:48.880 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 211754, 2024-09-19T05:29:48.880 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-19T05:29:48.880 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-19T05:29:48.880 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 14397, 2024-09-19T05:29:48.880 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 354266357, 2024-09-19T05:29:48.880 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-19T05:29:48.880 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:48.880 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:48.880 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:48.880 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:48.880 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:48.880 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-19T05:29:49.621 INFO:tasks.check_counter:Daemon mds.i mds.exported=151 2024-09-19T05:29:49.622 INFO:tasks.check_counter:Daemon mds.i mds.imported=310 2024-09-19T05:29:49.622 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-19T05:29:49.622 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=10 2024-09-19T05:29:49.622 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=4 2024-09-19T05:29:49.622 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=35 2024-09-19T05:29:49.622 DEBUG:tasks.check_counter:Getting stats from l 2024-09-19T05:29:49.622 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-19T05:29:49.905 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:49 smithi194 ceph-mon[35228]: pgmap v328: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:29:49.909 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T05:29:50.125 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:49 smithi120 ceph-mon[30956]: pgmap v328: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:29:50.192 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:49 smithi178 ceph-mon[34347]: pgmap v328: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:29:50.389 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-09-19T05:29:50.389 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T05:29:50.389 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 0, 2024-09-19T05:29:50.389 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 2, 2024-09-19T05:29:50.389 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 0, 2024-09-19T05:29:50.390 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 0, 2024-09-19T05:29:50.390 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 4, 2024-09-19T05:29:50.390 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 0, 2024-09-19T05:29:50.390 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.000983740, 2024-09-19T05:29:50.390 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T05:29:50.390 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.000168682, 2024-09-19T05:29:50.390 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:29:50.390 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:50.390 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:50.391 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:50.391 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:50.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:50.391 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:50.391 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:50.391 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:50.391 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:50.391 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:50.391 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T05:29:50.392 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T05:29:50.392 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:50.392 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T05:29:50.392 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 219, 2024-09-19T05:29:50.392 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 209, 2024-09-19T05:29:50.392 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 1447536, 2024-09-19T05:29:50.392 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 128544, 2024-09-19T05:29:50.392 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 2, 2024-09-19T05:29:50.392 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 1, 2024-09-19T05:29:50.392 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.037549732, 2024-09-19T05:29:50.392 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.012261345, 2024-09-19T05:29:50.392 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.038563617, 2024-09-19T05:29:50.392 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:29:50.393 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:50.393 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 208, 2024-09-19T05:29:50.393 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.009445790, 2024-09-19T05:29:50.393 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000045412 2024-09-19T05:29:50.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:50.393 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:50.393 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:50.393 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:50.393 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:50.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:50.393 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 1447536, 2024-09-19T05:29:50.393 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 128544 2024-09-19T05:29:50.393 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:50.394 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T05:29:50.394 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 6, 2024-09-19T05:29:50.394 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 163, 2024-09-19T05:29:50.394 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 3264, 2024-09-19T05:29:50.394 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 185824, 2024-09-19T05:29:50.394 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 5, 2024-09-19T05:29:50.394 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 3, 2024-09-19T05:29:50.394 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.011615581, 2024-09-19T05:29:50.394 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.006289138, 2024-09-19T05:29:50.394 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.003388154, 2024-09-19T05:29:50.394 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T05:29:50.394 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T05:29:50.394 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 161, 2024-09-19T05:29:50.395 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.014188848, 2024-09-19T05:29:50.395 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000088129 2024-09-19T05:29:50.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:50.395 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-09-19T05:29:50.395 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:50.395 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:50.395 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:50.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:50.395 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-09-19T05:29:50.395 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 185824 2024-09-19T05:29:50.395 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:50.395 INFO:teuthology.orchestra.run.smithi194.stdout: "cct": { 2024-09-19T05:29:50.395 INFO:teuthology.orchestra.run.smithi194.stdout: "total_workers": 0, 2024-09-19T05:29:50.396 INFO:teuthology.orchestra.run.smithi194.stdout: "unhealthy_workers": 0 2024-09-19T05:29:50.396 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:50.396 INFO:teuthology.orchestra.run.smithi194.stdout: "mempool": { 2024-09-19T05:29:50.396 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_bytes": 0, 2024-09-19T05:29:50.396 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_items": 0, 2024-09-19T05:29:50.396 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T05:29:50.396 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_items": 0, 2024-09-19T05:29:50.397 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T05:29:50.397 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_items": 0, 2024-09-19T05:29:50.397 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T05:29:50.397 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T05:29:50.398 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T05:29:50.398 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T05:29:50.398 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T05:29:50.398 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_items": 0, 2024-09-19T05:29:50.398 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T05:29:50.398 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T05:29:50.398 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_bytes": 0, 2024-09-19T05:29:50.398 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_items": 0, 2024-09-19T05:29:50.399 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_bytes": 0, 2024-09-19T05:29:50.399 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_items": 0, 2024-09-19T05:29:50.399 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T05:29:50.399 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T05:29:50.399 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T05:29:50.400 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T05:29:50.400 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T05:29:50.400 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_items": 0, 2024-09-19T05:29:50.400 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_bytes": 0, 2024-09-19T05:29:50.400 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_items": 0, 2024-09-19T05:29:50.400 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T05:29:50.400 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T05:29:50.400 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_bytes": 0, 2024-09-19T05:29:50.400 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_items": 0, 2024-09-19T05:29:50.400 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_bytes": 0, 2024-09-19T05:29:50.400 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_items": 0, 2024-09-19T05:29:50.400 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T05:29:50.401 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_items": 0, 2024-09-19T05:29:50.401 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T05:29:50.401 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_items": 0, 2024-09-19T05:29:50.401 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_bytes": 148945, 2024-09-19T05:29:50.401 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_items": 29, 2024-09-19T05:29:50.401 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_bytes": 0, 2024-09-19T05:29:50.401 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_items": 0, 2024-09-19T05:29:50.401 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_bytes": 0, 2024-09-19T05:29:50.401 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_items": 0, 2024-09-19T05:29:50.401 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_bytes": 0, 2024-09-19T05:29:50.401 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_items": 0, 2024-09-19T05:29:50.402 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_bytes": 0, 2024-09-19T05:29:50.402 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_items": 0, 2024-09-19T05:29:50.402 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_bytes": 0, 2024-09-19T05:29:50.402 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_items": 0, 2024-09-19T05:29:50.402 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T05:29:50.402 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_items": 0, 2024-09-19T05:29:50.402 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_bytes": 0, 2024-09-19T05:29:50.402 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_items": 0, 2024-09-19T05:29:50.402 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_bytes": 928, 2024-09-19T05:29:50.402 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_items": 2, 2024-09-19T05:29:50.402 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_bytes": 0, 2024-09-19T05:29:50.402 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_items": 0, 2024-09-19T05:29:50.402 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_bytes": 0, 2024-09-19T05:29:50.402 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_items": 0 2024-09-19T05:29:50.403 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-09-19T05:29:50.403 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T05:29:50.403 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-09-19T05:29:50.403 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-09-19T05:29:50.403 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-09-19T05:29:50.403 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 221, 2024-09-19T05:29:50.403 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 1416655, 2024-09-19T05:29:50.403 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-09-19T05:29:50.403 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 221, 2024-09-19T05:29:50.403 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-09-19T05:29:50.403 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-09-19T05:29:50.403 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 221, 2024-09-19T05:29:50.403 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 1416655, 2024-09-19T05:29:50.404 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-09-19T05:29:50.404 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-09-19T05:29:50.404 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-09-19T05:29:50.404 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-09-19T05:29:50.404 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:50.404 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-09-19T05:29:50.404 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-09-19T05:29:51.121 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-19T05:29:51.121 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-19T05:29:51.122 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-19T05:29:51.122 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-19T05:29:51.122 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-19T05:29:51.122 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-09-19T05:29:51.122 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-19T05:29:51.135 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-19T05:29:51.136 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T05:29:51.136 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:29:51.160 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T05:29:51.161 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:29:51.220 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T05:29:51.516 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:29:52.221 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:52 smithi120 ceph-mon[30956]: pgmap v329: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:29:52.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.210+0000 7fb311acd640 1 -- 172.21.15.120:0/3348941426 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb30c1036c0 msgr2=0x7fb30c10bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:52.246 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.210+0000 7fb311acd640 1 --2- 172.21.15.120:0/3348941426 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb30c1036c0 0x7fb30c10bbb0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb300009900 tx=0x7fb30002a480 comp rx=0 tx=0).stop 2024-09-19T05:29:52.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.210+0000 7fb311acd640 1 -- 172.21.15.120:0/3348941426 shutdown_connections 2024-09-19T05:29:52.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.210+0000 7fb311acd640 1 --2- 172.21.15.120:0/3348941426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb30c10c180 0x7fb30c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:52.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.210+0000 7fb311acd640 1 --2- 172.21.15.120:0/3348941426 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb30c1036c0 0x7fb30c10bbb0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:52.247 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.210+0000 7fb311acd640 1 --2- 172.21.15.120:0/3348941426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb30c102da0 0x7fb30c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:52.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.210+0000 7fb311acd640 1 -- 172.21.15.120:0/3348941426 >> 172.21.15.120:0/3348941426 conn(0x7fb30c0fc7a0 msgr2=0x7fb30c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:52.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.210+0000 7fb311acd640 1 -- 172.21.15.120:0/3348941426 shutdown_connections 2024-09-19T05:29:52.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.210+0000 7fb311acd640 1 -- 172.21.15.120:0/3348941426 wait complete. 2024-09-19T05:29:52.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.211+0000 7fb311acd640 1 Processor -- start 2024-09-19T05:29:52.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.211+0000 7fb311acd640 1 -- start start 2024-09-19T05:29:52.248 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.211+0000 7fb311acd640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb30c102da0 0x7fb30c198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:52.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.211+0000 7fb311acd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb30c1036c0 0x7fb30c198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:52.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.211+0000 7fb311acd640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb30c10c180 0x7fb30c19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:52.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.211+0000 7fb311acd640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7fb30c111e10 con 0x7fb30c1036c0 2024-09-19T05:29:52.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.211+0000 7fb311acd640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7fb30c111c90 con 0x7fb30c10c180 2024-09-19T05:29:52.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.211+0000 7fb311acd640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb30c111f90 con 0x7fb30c102da0 2024-09-19T05:29:52.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.211+0000 7fb30affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb30c1036c0 0x7fb30c198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:52.249 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.211+0000 7fb30affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb30c1036c0 0x7fb30c198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49492/0 (socket says 172.21.15.120:49492) 2024-09-19T05:29:52.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.211+0000 7fb30affd640 1 -- 172.21.15.120:0/1704419075 learned_addr learned my addr 172.21.15.120:0/1704419075 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:29:52.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.211+0000 7fb30bfff640 1 --2- 172.21.15.120:0/1704419075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb30c10c180 0x7fb30c19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:52.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.211+0000 7fb30b7fe640 1 --2- 172.21.15.120:0/1704419075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb30c102da0 0x7fb30c198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:52.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.212+0000 7fb30affd640 1 -- 172.21.15.120:0/1704419075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb30c102da0 msgr2=0x7fb30c198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:52.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.212+0000 7fb30affd640 1 --2- 172.21.15.120:0/1704419075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb30c102da0 0x7fb30c198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:52.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.212+0000 7fb30affd640 1 -- 172.21.15.120:0/1704419075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb30c10c180 msgr2=0x7fb30c19cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:52.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.212+0000 7fb30affd640 1 --2- 172.21.15.120:0/1704419075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb30c10c180 0x7fb30c19cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:52.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.212+0000 7fb30affd640 1 -- 172.21.15.120:0/1704419075 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30c19d300 con 0x7fb30c1036c0 2024-09-19T05:29:52.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.212+0000 7fb30bfff640 1 --2- 172.21.15.120:0/1704419075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb30c10c180 0x7fb30c19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:29:52.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.212+0000 7fb30b7fe640 1 --2- 172.21.15.120:0/1704419075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb30c102da0 0x7fb30c198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T05:29:52.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.212+0000 7fb30affd640 1 --2- 172.21.15.120:0/1704419075 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb30c1036c0 0x7fb30c198890 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb300005940 tx=0x7fb300004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:52.250 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.212+0000 7fb308ff9640 1 -- 172.21.15.120:0/1704419075 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30003f030 con 0x7fb30c1036c0 2024-09-19T05:29:52.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.212+0000 7fb311acd640 1 -- 172.21.15.120:0/1704419075 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb30c19d590 con 0x7fb30c1036c0 2024-09-19T05:29:52.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.212+0000 7fb308ff9640 1 -- 172.21.15.120:0/1704419075 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7fb300003aa0 con 0x7fb30c1036c0 2024-09-19T05:29:52.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.212+0000 7fb311acd640 1 -- 172.21.15.120:0/1704419075 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb30c1a4ed0 con 0x7fb30c1036c0 2024-09-19T05:29:52.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.212+0000 7fb308ff9640 1 -- 172.21.15.120:0/1704419075 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb300049060 con 0x7fb30c1036c0 2024-09-19T05:29:52.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.213+0000 7fb311acd640 1 -- 172.21.15.120:0/1704419075 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb30c103180 con 0x7fb30c1036c0 2024-09-19T05:29:52.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.214+0000 7fb308ff9640 1 -- 172.21.15.120:0/1704419075 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7fb300042030 con 0x7fb30c1036c0 2024-09-19T05:29:52.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.215+0000 7fb308ff9640 1 --2- 172.21.15.120:0/1704419075 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fb2f40a33b0 0x7fb2f40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:52.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.215+0000 7fb30b7fe640 1 --2- 172.21.15.120:0/1704419075 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fb2f40a33b0 0x7fb2f40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:52.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.215+0000 7fb308ff9640 1 -- 172.21.15.120:0/1704419075 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8643+0+0 (secure 0 0 0) 0x7fb3000f0990 con 0x7fb30c1036c0 2024-09-19T05:29:52.251 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.215+0000 7fb30b7fe640 1 --2- 172.21.15.120:0/1704419075 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fb2f40a33b0 0x7fb2f40a5870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc005fd0 tx=0x7fb2fc00b5f0 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:52.252 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.219+0000 7fb308ff9640 1 -- 172.21.15.120:0/1704419075 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb3000bd2f0 con 0x7fb30c1036c0 2024-09-19T05:29:52.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.398+0000 7fb311acd640 1 -- 172.21.15.120:0/1704419075 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb30c1996b0 con 0x7fb30c1036c0 2024-09-19T05:29:52.401 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.399+0000 7fb308ff9640 1 -- 172.21.15.120:0/1704419075 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v93) ==== 81+0+1013 (secure 0 0 0) 0x7fb30c1996b0 con 0x7fb30c1036c0 2024-09-19T05:29:52.401 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/316867529 2024-09-20T05:19:14.314860+0000 2024-09-19T05:29:52.402 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/1091097763 2024-09-20T05:19:14.314860+0000 2024-09-19T05:29:52.402 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6801/955692128 2024-09-20T05:19:14.314860+0000 2024-09-19T05:29:52.402 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6800/3412493069 2024-09-20T05:10:23.348128+0000 2024-09-19T05:29:52.402 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6801/3412493069 2024-09-20T05:10:23.348128+0000 2024-09-19T05:29:52.402 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/4255533863 2024-09-20T05:10:23.348128+0000 2024-09-19T05:29:52.402 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/3592867428 2024-09-20T05:10:23.348128+0000 2024-09-19T05:29:52.403 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/2867300720 2024-09-20T05:10:23.348128+0000 2024-09-19T05:29:52.403 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/3049956965 2024-09-20T05:19:14.314860+0000 2024-09-19T05:29:52.403 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/4177074351 2024-09-20T05:10:48.027892+0000 2024-09-19T05:29:52.403 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6800/50152720 2024-09-20T05:10:48.027892+0000 2024-09-19T05:29:52.403 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6801/50152720 2024-09-20T05:10:48.027892+0000 2024-09-19T05:29:52.403 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/329623296 2024-09-20T05:10:48.027892+0000 2024-09-19T05:29:52.403 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/3419110398 2024-09-20T05:10:48.027892+0000 2024-09-19T05:29:52.404 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/3080806681 2024-09-20T05:19:14.314860+0000 2024-09-19T05:29:52.404 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/1358819866 2024-09-20T05:19:14.314860+0000 2024-09-19T05:29:52.404 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6800/955692128 2024-09-20T05:19:14.314860+0000 2024-09-19T05:29:52.406 INFO:teuthology.orchestra.run.smithi120.stderr:listed 17 entries 2024-09-19T05:29:52.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.401+0000 7fb311acd640 1 -- 172.21.15.120:0/1704419075 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fb2f40a33b0 msgr2=0x7fb2f40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:52.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.401+0000 7fb311acd640 1 --2- 172.21.15.120:0/1704419075 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fb2f40a33b0 0x7fb2f40a5870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc005fd0 tx=0x7fb2fc00b5f0 comp rx=0 tx=0).stop 2024-09-19T05:29:52.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.401+0000 7fb311acd640 1 -- 172.21.15.120:0/1704419075 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb30c1036c0 msgr2=0x7fb30c198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:52.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.401+0000 7fb311acd640 1 --2- 172.21.15.120:0/1704419075 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb30c1036c0 0x7fb30c198890 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb300005940 tx=0x7fb300004270 comp rx=0 tx=0).stop 2024-09-19T05:29:52.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.401+0000 7fb311acd640 1 -- 172.21.15.120:0/1704419075 shutdown_connections 2024-09-19T05:29:52.406 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.401+0000 7fb311acd640 1 --2- 172.21.15.120:0/1704419075 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7fb2f40a33b0 0x7fb2f40a5870 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:52.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.401+0000 7fb311acd640 1 --2- 172.21.15.120:0/1704419075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb30c10c180 0x7fb30c19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:52.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.401+0000 7fb311acd640 1 --2- 172.21.15.120:0/1704419075 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb30c1036c0 0x7fb30c198890 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:52.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.401+0000 7fb311acd640 1 --2- 172.21.15.120:0/1704419075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb30c102da0 0x7fb30c198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:52.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.401+0000 7fb311acd640 1 -- 172.21.15.120:0/1704419075 >> 172.21.15.120:0/1704419075 conn(0x7fb30c0fc7a0 msgr2=0x7fb30c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:52.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.401+0000 7fb311acd640 1 -- 172.21.15.120:0/1704419075 shutdown_connections 2024-09-19T05:29:52.407 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:52.401+0000 7fb311acd640 1 -- 172.21.15.120:0/1704419075 wait complete. 2024-09-19T05:29:52.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:52 smithi194 ceph-mon[35228]: pgmap v329: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:29:52.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:52 smithi178 ceph-mon[34347]: pgmap v329: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T05:29:53.021 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-19T05:29:53.021 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T05:29:53.039 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T05:29:53.327 INFO:teuthology.orchestra.run.smithi120.stderr:Inferring config /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T05:29:53.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:53 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/1704419075' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T05:29:53.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:53 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/1704419075' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T05:29:53.447 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:53 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/1704419075' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T05:29:53.803 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.772+0000 7f0754f53640 1 -- 172.21.15.120:0/3145119301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0750102ef0 msgr2=0x7f075010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:53.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.772+0000 7f0754f53640 1 --2- 172.21.15.120:0/3145119301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0750102ef0 0x7f075010da40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0748009ca0 tx=0x7f074802a950 comp rx=0 tx=0).stop 2024-09-19T05:29:53.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.772+0000 7f0754f53640 1 -- 172.21.15.120:0/3145119301 shutdown_connections 2024-09-19T05:29:53.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.772+0000 7f0754f53640 1 --2- 172.21.15.120:0/3145119301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0750102ef0 0x7f075010da40 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:53.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.772+0000 7f0754f53640 1 --2- 172.21.15.120:0/3145119301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0750102570 0x7f07501029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:53.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.772+0000 7f0754f53640 1 --2- 172.21.15.120:0/3145119301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0750100e20 0x7f0750101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:53.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.772+0000 7f0754f53640 1 -- 172.21.15.120:0/3145119301 >> 172.21.15.120:0/3145119301 conn(0x7f07500fc7d0 msgr2=0x7f07500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:53.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.772+0000 7f0754f53640 1 -- 172.21.15.120:0/3145119301 shutdown_connections 2024-09-19T05:29:53.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.772+0000 7f0754f53640 1 -- 172.21.15.120:0/3145119301 wait complete. 2024-09-19T05:29:53.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.773+0000 7f0754f53640 1 Processor -- start 2024-09-19T05:29:53.804 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.773+0000 7f0754f53640 1 -- start start 2024-09-19T05:29:53.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.773+0000 7f0754f53640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0750100e20 0x7f0750197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:53.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.773+0000 7f0754f53640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0750102570 0x7f0750197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:53.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.773+0000 7f0754f53640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0750102ef0 0x7f075019bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:53.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.773+0000 7f0754f53640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 -- 0x7f0750110e30 con 0x7f0750102570 2024-09-19T05:29:53.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.773+0000 7f0754f53640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 -- 0x7f0750110cb0 con 0x7f0750102ef0 2024-09-19T05:29:53.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.773+0000 7f0754f53640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0750110fb0 con 0x7f0750100e20 2024-09-19T05:29:53.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.773+0000 7f074dd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0750102570 0x7f0750197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:53.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.773+0000 7f074dd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0750102570 0x7f0750197890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:49508/0 (socket says 172.21.15.120:49508) 2024-09-19T05:29:53.805 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.773+0000 7f074dd9b640 1 -- 172.21.15.120:0/3140188350 learned_addr learned my addr 172.21.15.120:0/3140188350 (peer_addr_for_me v2:172.21.15.120:0/0) 2024-09-19T05:29:53.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.774+0000 7f074e59c640 1 --2- 172.21.15.120:0/3140188350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0750100e20 0x7f0750197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:53.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.774+0000 7f074ed9d640 1 --2- 172.21.15.120:0/3140188350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0750102ef0 0x7f075019bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:53.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.774+0000 7f074dd9b640 1 -- 172.21.15.120:0/3140188350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0750100e20 msgr2=0x7f0750197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:53.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.774+0000 7f074dd9b640 1 --2- 172.21.15.120:0/3140188350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0750100e20 0x7f0750197350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:53.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.774+0000 7f074dd9b640 1 -- 172.21.15.120:0/3140188350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0750102ef0 msgr2=0x7f075019bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:53.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.774+0000 7f074dd9b640 1 --2- 172.21.15.120:0/3140188350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0750102ef0 0x7f075019bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:53.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.774+0000 7f074dd9b640 1 -- 172.21.15.120:0/3140188350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f075019c300 con 0x7f0750102570 2024-09-19T05:29:53.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.774+0000 7f074dd9b640 1 --2- 172.21.15.120:0/3140188350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0750102570 0x7f0750197890 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f074400d950 tx=0x7f074400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:53.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.774+0000 7f073f7fe640 1 -- 172.21.15.120:0/3140188350 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0744017070 con 0x7f0750102570 2024-09-19T05:29:53.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.774+0000 7f073f7fe640 1 -- 172.21.15.120:0/3140188350 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(26 keys) ==== 1102+0+0 (secure 0 0 0) 0x7f0744009c30 con 0x7f0750102570 2024-09-19T05:29:53.806 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.774+0000 7f0754f53640 1 -- 172.21.15.120:0/3140188350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f075019c5f0 con 0x7f0750102570 2024-09-19T05:29:53.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.774+0000 7f073f7fe640 1 -- 172.21.15.120:0/3140188350 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074400f620 con 0x7f0750102570 2024-09-19T05:29:53.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.774+0000 7f0754f53640 1 -- 172.21.15.120:0/3140188350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07501a3ed0 con 0x7f0750102570 2024-09-19T05:29:53.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.775+0000 7f0754f53640 1 -- 172.21.15.120:0/3140188350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0750101200 con 0x7f0750102570 2024-09-19T05:29:53.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.776+0000 7f073f7fe640 1 -- 172.21.15.120:0/3140188350 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 25) ==== 138487+0+0 (secure 0 0 0) 0x7f07440109a0 con 0x7f0750102570 2024-09-19T05:29:53.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.777+0000 7f073f7fe640 1 --2- 172.21.15.120:0/3140188350 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f07380a33b0 0x7f07380a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T05:29:53.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.777+0000 7f074e59c640 1 --2- 172.21.15.120:0/3140188350 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f07380a33b0 0x7f07380a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T05:29:53.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.777+0000 7f073f7fe640 1 -- 172.21.15.120:0/3140188350 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8643+0+0 (secure 0 0 0) 0x7f07440cf980 con 0x7f0750102570 2024-09-19T05:29:53.807 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.777+0000 7f074e59c640 1 --2- 172.21.15.120:0/3140188350 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f07380a33b0 0x7f07380a5870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0740005fd0 tx=0x7f074000b390 comp rx=0 tx=0).ready entity=mgr.15156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T05:29:53.808 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.781+0000 7f073f7fe640 1 -- 172.21.15.120:0/3140188350 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0744009de0 con 0x7f0750102570 2024-09-19T05:29:53.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.960+0000 7f0754f53640 1 -- 172.21.15.120:0/3140188350 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0750109090 con 0x7f0750102570 2024-09-19T05:29:53.962 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.960+0000 7f073f7fe640 1 -- 172.21.15.120:0/3140188350 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v93) ==== 81+0+1013 (secure 0 0 0) 0x7f074409c2e0 con 0x7f0750102570 2024-09-19T05:29:53.962 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/316867529 2024-09-20T05:19:14.314860+0000 2024-09-19T05:29:53.962 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/1091097763 2024-09-20T05:19:14.314860+0000 2024-09-19T05:29:53.962 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6801/955692128 2024-09-20T05:19:14.314860+0000 2024-09-19T05:29:53.963 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6800/3412493069 2024-09-20T05:10:23.348128+0000 2024-09-19T05:29:53.963 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6801/3412493069 2024-09-20T05:10:23.348128+0000 2024-09-19T05:29:53.963 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/4255533863 2024-09-20T05:10:23.348128+0000 2024-09-19T05:29:53.963 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/3592867428 2024-09-20T05:10:23.348128+0000 2024-09-19T05:29:53.963 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/2867300720 2024-09-20T05:10:23.348128+0000 2024-09-19T05:29:53.963 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/3049956965 2024-09-20T05:19:14.314860+0000 2024-09-19T05:29:53.963 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/4177074351 2024-09-20T05:10:48.027892+0000 2024-09-19T05:29:53.963 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6800/50152720 2024-09-20T05:10:48.027892+0000 2024-09-19T05:29:53.963 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6801/50152720 2024-09-20T05:10:48.027892+0000 2024-09-19T05:29:53.963 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/329623296 2024-09-20T05:10:48.027892+0000 2024-09-19T05:29:53.963 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/3419110398 2024-09-20T05:10:48.027892+0000 2024-09-19T05:29:53.963 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/3080806681 2024-09-20T05:19:14.314860+0000 2024-09-19T05:29:53.963 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:0/1358819866 2024-09-20T05:19:14.314860+0000 2024-09-19T05:29:53.964 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120:6800/955692128 2024-09-20T05:19:14.314860+0000 2024-09-19T05:29:53.964 INFO:teuthology.orchestra.run.smithi120.stderr:listed 17 entries 2024-09-19T05:29:53.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.962+0000 7f0754f53640 1 -- 172.21.15.120:0/3140188350 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f07380a33b0 msgr2=0x7f07380a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:53.964 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.962+0000 7f0754f53640 1 --2- 172.21.15.120:0/3140188350 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f07380a33b0 0x7f07380a5870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0740005fd0 tx=0x7f074000b390 comp rx=0 tx=0).stop 2024-09-19T05:29:53.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.962+0000 7f0754f53640 1 -- 172.21.15.120:0/3140188350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0750102570 msgr2=0x7f0750197890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T05:29:53.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.962+0000 7f0754f53640 1 --2- 172.21.15.120:0/3140188350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0750102570 0x7f0750197890 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f074400d950 tx=0x7f074400de10 comp rx=0 tx=0).stop 2024-09-19T05:29:53.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.962+0000 7f0754f53640 1 -- 172.21.15.120:0/3140188350 shutdown_connections 2024-09-19T05:29:53.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.962+0000 7f0754f53640 1 --2- 172.21.15.120:0/3140188350 >> [v2:172.21.15.120:6800/1306632207,v1:172.21.15.120:6801/1306632207] conn(0x7f07380a33b0 0x7f07380a5870 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:53.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.962+0000 7f0754f53640 1 --2- 172.21.15.120:0/3140188350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0750102ef0 0x7f075019bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:53.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.962+0000 7f0754f53640 1 --2- 172.21.15.120:0/3140188350 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0750102570 0x7f0750197890 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:53.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.962+0000 7f0754f53640 1 --2- 172.21.15.120:0/3140188350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0750100e20 0x7f0750197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T05:29:53.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.962+0000 7f0754f53640 1 -- 172.21.15.120:0/3140188350 >> 172.21.15.120:0/3140188350 conn(0x7f07500fc7d0 msgr2=0x7f07500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T05:29:53.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.962+0000 7f0754f53640 1 -- 172.21.15.120:0/3140188350 shutdown_connections 2024-09-19T05:29:53.965 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-19T05:29:53.962+0000 7f0754f53640 1 -- 172.21.15.120:0/3140188350 wait complete. 2024-09-19T05:29:54.332 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:54 smithi120 ceph-mon[30956]: pgmap v330: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:29:54.332 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:54 smithi120 ceph-mon[30956]: from='client.? 172.21.15.120:0/3140188350' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T05:29:54.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:54 smithi194 ceph-mon[35228]: pgmap v330: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:29:54.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:54 smithi194 ceph-mon[35228]: from='client.? 172.21.15.120:0/3140188350' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T05:29:54.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:54 smithi178 ceph-mon[34347]: pgmap v330: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:29:54.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:54 smithi178 ceph-mon[34347]: from='client.? 172.21.15.120:0/3140188350' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T05:29:54.693 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi120.front.sepia.ceph.com... 2024-09-19T05:29:54.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:29:54.694 DEBUG:teuthology.orchestra.run.smithi120:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T05:29:54.722 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T05:29:54.722 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi120.stderr:ceph-fuse[81973]: fuse finished with error 0 and tester_r 0 2024-09-19T05:29:56.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:56 smithi194 ceph-mon[35228]: pgmap v331: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:29:56.444 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:56 smithi178 ceph-mon[34347]: pgmap v331: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:29:56.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:56 smithi120 ceph-mon[30956]: pgmap v331: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T05:29:58.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:29:58 smithi194 ceph-mon[35228]: pgmap v332: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-19T05:29:58.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:29:58 smithi178 ceph-mon[34347]: pgmap v332: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-19T05:29:58.625 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:29:58 smithi120 ceph-mon[30956]: pgmap v332: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-19T05:30:00.375 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:30:00 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-a[30952]: 2024-09-19T05:29:59.999+0000 7fab408dd640 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-09-19T05:30:00.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:30:00 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-a[30952]: 2024-09-19T05:29:59.999+0000 7fab408dd640 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-09-19T05:30:00.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:30:00 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-a[30952]: 2024-09-19T05:29:59.999+0000 7fab408dd640 -1 log_channel(cluster) log [ERR] : mds.c(mds.2): Metadata damage detected 2024-09-19T05:30:00.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:30:00 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-a[30952]: 2024-09-19T05:29:59.999+0000 7fab408dd640 -1 log_channel(cluster) log [ERR] : mds.b(mds.1): Metadata damage detected 2024-09-19T05:30:00.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:30:00 smithi120 ceph-mon[30956]: pgmap v333: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-19T05:30:00.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:30:00 smithi120 ceph-mon[30956]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-09-19T05:30:00.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:30:00 smithi120 ceph-mon[30956]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-09-19T05:30:00.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:30:00 smithi120 ceph-mon[30956]: mds.c(mds.2): Metadata damage detected 2024-09-19T05:30:00.376 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:30:00 smithi120 ceph-mon[30956]: mds.b(mds.1): Metadata damage detected 2024-09-19T05:30:00.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:30:00 smithi194 ceph-mon[35228]: pgmap v333: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-19T05:30:00.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:30:00 smithi194 ceph-mon[35228]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-09-19T05:30:00.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:30:00 smithi194 ceph-mon[35228]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-09-19T05:30:00.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:30:00 smithi194 ceph-mon[35228]: mds.c(mds.2): Metadata damage detected 2024-09-19T05:30:00.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:30:00 smithi194 ceph-mon[35228]: mds.b(mds.1): Metadata damage detected 2024-09-19T05:30:00.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:30:00 smithi178 ceph-mon[34347]: pgmap v333: 97 pgs: 97 active+clean; 551 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-19T05:30:00.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:30:00 smithi178 ceph-mon[34347]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-09-19T05:30:00.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:30:00 smithi178 ceph-mon[34347]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-09-19T05:30:00.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:30:00 smithi178 ceph-mon[34347]: mds.c(mds.2): Metadata damage detected 2024-09-19T05:30:00.442 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:30:00 smithi178 ceph-mon[34347]: mds.b(mds.1): Metadata damage detected 2024-09-19T05:30:00.824 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi120.front.sepia.ceph.com 2024-09-19T05:30:00.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:30:00.824 DEBUG:teuthology.orchestra.run.smithi120:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T05:30:00.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:30:00.845 DEBUG:teuthology.orchestra.run.smithi120:> ip netns list 2024-09-19T05:30:00.902 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T05:30:00.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:30:00.903 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T05:30:00.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T05:30:00.973 DEBUG:teuthology.orchestra.run.smithi120:> sudo ip link delete ceph-brx 2024-09-19T05:30:01.077 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T05:30:01.088 INFO:tasks.cephadm:Teardown begin 2024-09-19T05:30:01.088 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/cephadm.py", line 2236, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-09-19T05:30:01.090 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:30:01.117 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:30:01.150 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:30:01.183 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T05:30:01.183 DEBUG:teuthology.orchestra.run.smithi120:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T05:30:01.199 DEBUG:teuthology.orchestra.run.smithi178:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T05:30:01.215 DEBUG:teuthology.orchestra.run.smithi194:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T05:30:01.241 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T05:30:01.241 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T05:30:01.242 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mon.a 2024-09-19T05:30:01.546 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:30:01 smithi120 systemd[1]: Stopping Ceph mon.a for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:30:01.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:30:01 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-a[30952]: 2024-09-19T05:30:01.544+0000 7fab438e3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:30:01.875 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:30:01 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-a[30952]: 2024-09-19T05:30:01.544+0000 7fab438e3640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T05:30:01.876 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:30:01 smithi120 podman[196555]: 2024-09-19 05:30:01.636537356 +0000 UTC m=+0.209076589 container died a28e9bf433a094a08ba46af8f257dd4bf8535ac96b4ce09600540fefa85ef061 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T05:30:02.331 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:30:02 smithi120 podman[196555]: 2024-09-19 05:30:02.161603076 +0000 UTC m=+0.734142308 container cleanup a28e9bf433a094a08ba46af8f257dd4bf8535ac96b4ce09600540fefa85ef061 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-19T05:30:02.331 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:30:02 smithi120 bash[196555]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-a 2024-09-19T05:30:02.580 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T05:30:02.603 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:30:02 smithi120 podman[196567]: 2024-09-19 05:30:02.329688182 +0000 UTC m=+0.688642886 container remove a28e9bf433a094a08ba46af8f257dd4bf8535ac96b4ce09600540fefa85ef061 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:30:02.603 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:30:02 smithi120 systemd[1]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T05:30:02.603 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:30:02 smithi120 systemd[1]: Stopped Ceph mon.a for 4e6e3df4-7645-11ef-bceb-c7b262605968. 2024-09-19T05:30:02.603 INFO:journalctl@ceph.mon.a.smithi120.stdout:Sep 19 05:30:02 smithi120 systemd[1]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mon.a.service: Consumed 17.657s CPU time. 2024-09-19T05:30:02.626 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:30:02.626 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T05:30:02.626 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T05:30:02.626 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mon.b 2024-09-19T05:30:02.942 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:30:02 smithi178 systemd[1]: Stopping Ceph mon.b for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:30:03.316 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:30:02 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-b[34343]: 2024-09-19T05:30:02.996+0000 7fc1d4104640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:30:03.316 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:30:02 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-b[34343]: 2024-09-19T05:30:02.996+0000 7fc1d4104640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T05:30:03.316 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:30:03 smithi178 podman[70034]: 2024-09-19 05:30:03.027461328 +0000 UTC m=+0.206839022 container died 8be05c7017eae581395e604f28da969655ac5a87dedc0245c0fc1d8da3a3e774 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-b, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T05:30:03.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:30:03 smithi178 podman[70034]: 2024-09-19 05:30:03.413840902 +0000 UTC m=+0.593218605 container cleanup 8be05c7017eae581395e604f28da969655ac5a87dedc0245c0fc1d8da3a3e774 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:30:03.675 INFO:journalctl@ceph.mon.b.smithi178.stdout:Sep 19 05:30:03 smithi178 bash[70034]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-b 2024-09-19T05:30:03.842 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T05:30:03.889 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:30:03.890 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T05:30:03.890 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T05:30:03.890 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mon.c 2024-09-19T05:30:04.214 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:30:03 smithi194 systemd[1]: Stopping Ceph mon.c for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:30:04.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:30:04 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-c[35224]: 2024-09-19T05:30:04.211+0000 7fd1af368640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:30:04.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:30:04 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-c[35224]: 2024-09-19T05:30:04.211+0000 7fd1af368640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T05:30:04.656 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:30:04 smithi194 podman[71227]: 2024-09-19 05:30:04.396402541 +0000 UTC m=+0.301265232 container died f72c2601b83fa5407126a88e77243e19291e2d1956b1ca2f0e24f37dee2c82fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-c, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T05:30:05.049 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:30:04 smithi194 podman[71227]: 2024-09-19 05:30:04.829528209 +0000 UTC m=+0.734390900 container cleanup f72c2601b83fa5407126a88e77243e19291e2d1956b1ca2f0e24f37dee2c82fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T05:30:05.049 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:30:04 smithi194 bash[71227]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-c 2024-09-19T05:30:05.302 INFO:journalctl@ceph.mon.c.smithi194.stdout:Sep 19 05:30:05 smithi194 podman[71238]: 2024-09-19 05:30:05.047777061 +0000 UTC m=+0.648172455 container remove f72c2601b83fa5407126a88e77243e19291e2d1956b1ca2f0e24f37dee2c82fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mon-c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T05:30:05.306 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T05:30:05.352 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:30:05.353 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T05:30:05.353 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T05:30:05.353 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mgr.x 2024-09-19T05:30:05.667 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:30:05 smithi120 systemd[1]: Stopping Ceph mgr.x for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:30:05.951 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:30:05 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:30:05.665+0000 7f1fa84b6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:30:05.951 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:30:05 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x[31184]: 2024-09-19T05:30:05.665+0000 7f1fa84b6640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-19T05:30:05.951 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:30:05 smithi120 podman[196676]: 2024-09-19 05:30:05.696841685 +0000 UTC m=+0.151988383 container died 63d3454a719e2966570606779b94a1342dd950e697a4fb854684cf24c0ffa63c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T05:30:06.327 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:30:06 smithi120 podman[196676]: 2024-09-19 05:30:06.049866456 +0000 UTC m=+0.505013150 container cleanup 63d3454a719e2966570606779b94a1342dd950e697a4fb854684cf24c0ffa63c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-19T05:30:06.328 INFO:journalctl@ceph.mgr.x.smithi120.stdout:Sep 19 05:30:06 smithi120 bash[196676]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-x 2024-09-19T05:30:06.471 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T05:30:06.505 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:30:06.505 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T05:30:06.506 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T05:30:06.506 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mgr.y 2024-09-19T05:30:06.840 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:30:06 smithi178 systemd[1]: Stopping Ceph mgr.y for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:30:07.104 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:30:06 smithi178 podman[70155]: 2024-09-19 05:30:06.838804656 +0000 UTC m=+0.139608276 container died 6a555ecaf92ffe39ecddba851e002b6ef71648baa6c8702fb05b2702c79e93e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T05:30:07.442 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:30:07 smithi178 podman[70155]: 2024-09-19 05:30:07.19379203 +0000 UTC m=+0.494595637 container cleanup 6a555ecaf92ffe39ecddba851e002b6ef71648baa6c8702fb05b2702c79e93e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True) 2024-09-19T05:30:07.442 INFO:journalctl@ceph.mgr.y.smithi178.stdout:Sep 19 05:30:07 smithi178 bash[70155]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-y 2024-09-19T05:30:07.610 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T05:30:07.644 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:30:07.644 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T05:30:07.645 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T05:30:07.645 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mgr.z 2024-09-19T05:30:08.007 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:30:07 smithi194 systemd[1]: Stopping Ceph mgr.z for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:30:08.294 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:30:08 smithi194 podman[71351]: 2024-09-19 05:30:08.006500769 +0000 UTC m=+0.173347533 container died 8c600a6ee54e77435f468277515926c2fe63b03bc30df090c977c8b1a53fd25b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:30:08.653 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:30:08 smithi194 podman[71351]: 2024-09-19 05:30:08.367090098 +0000 UTC m=+0.533936861 container cleanup 8c600a6ee54e77435f468277515926c2fe63b03bc30df090c977c8b1a53fd25b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T05:30:08.653 INFO:journalctl@ceph.mgr.z.smithi194.stdout:Sep 19 05:30:08 smithi194 bash[71351]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mgr-z 2024-09-19T05:30:08.792 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T05:30:08.826 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:30:08.827 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T05:30:08.827 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T05:30:08.827 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.0 2024-09-19T05:30:09.122 INFO:journalctl@ceph.osd.0.smithi120.stdout:Sep 19 05:30:08 smithi120 systemd[1]: Stopping Ceph osd.0 for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:30:09.375 INFO:journalctl@ceph.osd.0.smithi120.stdout:Sep 19 05:30:09 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-0[44696]: 2024-09-19T05:30:09.120+0000 7fcb40869640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:30:09.375 INFO:journalctl@ceph.osd.0.smithi120.stdout:Sep 19 05:30:09 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-0[44696]: 2024-09-19T05:30:09.120+0000 7fcb40869640 -1 osd.0 93 *** Got signal Terminated *** 2024-09-19T05:30:09.375 INFO:journalctl@ceph.osd.0.smithi120.stdout:Sep 19 05:30:09 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-0[44696]: 2024-09-19T05:30:09.120+0000 7fcb40869640 -1 osd.0 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:30:14.873 INFO:journalctl@ceph.osd.0.smithi120.stdout:Sep 19 05:30:14 smithi120 podman[196798]: 2024-09-19 05:30:14.598660181 +0000 UTC m=+5.574797423 container died f116ef2b774bff9493dd1b49f5d68f819afc2f7feb38d446c46ad032b858d856 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-0, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T05:30:15.125 INFO:journalctl@ceph.osd.0.smithi120.stdout:Sep 19 05:30:14 smithi120 podman[196798]: 2024-09-19 05:30:14.962542828 +0000 UTC m=+5.938680054 container cleanup f116ef2b774bff9493dd1b49f5d68f819afc2f7feb38d446c46ad032b858d856 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:30:15.125 INFO:journalctl@ceph.osd.0.smithi120.stdout:Sep 19 05:30:14 smithi120 bash[196798]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-0 2024-09-19T05:30:15.566 INFO:journalctl@ceph.osd.0.smithi120.stdout:Sep 19 05:30:15 smithi120 podman[196814]: 2024-09-19 05:30:15.222240308 +0000 UTC m=+0.619373969 container remove f116ef2b774bff9493dd1b49f5d68f819afc2f7feb38d446c46ad032b858d856 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4) 2024-09-19T05:30:15.875 INFO:journalctl@ceph.osd.0.smithi120.stdout:Sep 19 05:30:15 smithi120 podman[196900]: 2024-09-19 05:30:15.564926376 +0000 UTC m=+0.106536685 container create b0846c194f2d98df6305788caa664a2cf34b894b6875dd6a2f5bf0c9b1f68d6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T05:30:15.875 INFO:journalctl@ceph.osd.0.smithi120.stdout:Sep 19 05:30:15 smithi120 podman[196900]: 2024-09-19 05:30:15.474156349 +0000 UTC m=+0.015766673 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:30:15.875 INFO:journalctl@ceph.osd.0.smithi120.stdout:Sep 19 05:30:15 smithi120 podman[196900]: 2024-09-19 05:30:15.775614895 +0000 UTC m=+0.317225212 container init b0846c194f2d98df6305788caa664a2cf34b894b6875dd6a2f5bf0c9b1f68d6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:30:15.876 INFO:journalctl@ceph.osd.0.smithi120.stdout:Sep 19 05:30:15 smithi120 podman[196900]: 2024-09-19 05:30:15.779078813 +0000 UTC m=+0.320689125 container start b0846c194f2d98df6305788caa664a2cf34b894b6875dd6a2f5bf0c9b1f68d6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T05:30:16.296 INFO:journalctl@ceph.osd.0.smithi120.stdout:Sep 19 05:30:15 smithi120 podman[196900]: 2024-09-19 05:30:15.875630098 +0000 UTC m=+0.417240429 container attach b0846c194f2d98df6305788caa664a2cf34b894b6875dd6a2f5bf0c9b1f68d6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:30:16.297 INFO:journalctl@ceph.osd.0.smithi120.stdout:Sep 19 05:30:15 smithi120 podman[196900]: 2024-09-19 05:30:15.982410024 +0000 UTC m=+0.524020350 container died b0846c194f2d98df6305788caa664a2cf34b894b6875dd6a2f5bf0c9b1f68d6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:30:16.643 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T05:30:16.681 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:30:16.682 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T05:30:16.682 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T05:30:16.682 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.1 2024-09-19T05:30:16.991 INFO:journalctl@ceph.osd.1.smithi178.stdout:Sep 19 05:30:16 smithi178 systemd[1]: Stopping Ceph osd.1 for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:30:17.442 INFO:journalctl@ceph.osd.1.smithi178.stdout:Sep 19 05:30:16 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-1[38821]: 2024-09-19T05:30:16.989+0000 7f38ddcdc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:30:17.442 INFO:journalctl@ceph.osd.1.smithi178.stdout:Sep 19 05:30:16 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-1[38821]: 2024-09-19T05:30:16.989+0000 7f38ddcdc640 -1 osd.1 93 *** Got signal Terminated *** 2024-09-19T05:30:17.442 INFO:journalctl@ceph.osd.1.smithi178.stdout:Sep 19 05:30:16 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-1[38821]: 2024-09-19T05:30:16.989+0000 7f38ddcdc640 -1 osd.1 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:30:22.750 INFO:journalctl@ceph.osd.1.smithi178.stdout:Sep 19 05:30:22 smithi178 podman[70280]: 2024-09-19 05:30:22.468583054 +0000 UTC m=+5.598688683 container died b1cf96166e4642d317743893603fedb0a12cae8b9d287735a0414a1a6202372f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-1, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T05:30:23.084 INFO:journalctl@ceph.osd.1.smithi178.stdout:Sep 19 05:30:22 smithi178 podman[70280]: 2024-09-19 05:30:22.848261902 +0000 UTC m=+5.978367531 container cleanup b1cf96166e4642d317743893603fedb0a12cae8b9d287735a0414a1a6202372f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T05:30:23.084 INFO:journalctl@ceph.osd.1.smithi178.stdout:Sep 19 05:30:22 smithi178 bash[70280]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-1 2024-09-19T05:30:23.422 INFO:journalctl@ceph.osd.1.smithi178.stdout:Sep 19 05:30:23 smithi178 podman[70296]: 2024-09-19 05:30:23.083192815 +0000 UTC m=+0.607923142 container remove b1cf96166e4642d317743893603fedb0a12cae8b9d287735a0414a1a6202372f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T05:30:23.692 INFO:journalctl@ceph.osd.1.smithi178.stdout:Sep 19 05:30:23 smithi178 podman[70386]: 2024-09-19 05:30:23.323243933 +0000 UTC m=+0.015810333 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:30:23.692 INFO:journalctl@ceph.osd.1.smithi178.stdout:Sep 19 05:30:23 smithi178 podman[70386]: 2024-09-19 05:30:23.434225766 +0000 UTC m=+0.126792154 container create 7022bbe575420475704e532c83a942978006666734af83b66e13c9853bbd9ef3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T05:30:23.693 INFO:journalctl@ceph.osd.1.smithi178.stdout:Sep 19 05:30:23 smithi178 podman[70386]: 2024-09-19 05:30:23.645162349 +0000 UTC m=+0.337728740 container init 7022bbe575420475704e532c83a942978006666734af83b66e13c9853bbd9ef3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:30:23.693 INFO:journalctl@ceph.osd.1.smithi178.stdout:Sep 19 05:30:23 smithi178 podman[70386]: 2024-09-19 05:30:23.648474528 +0000 UTC m=+0.341040916 container start 7022bbe575420475704e532c83a942978006666734af83b66e13c9853bbd9ef3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T05:30:24.175 INFO:journalctl@ceph.osd.1.smithi178.stdout:Sep 19 05:30:23 smithi178 podman[70386]: 2024-09-19 05:30:23.720392786 +0000 UTC m=+0.412959180 container attach 7022bbe575420475704e532c83a942978006666734af83b66e13c9853bbd9ef3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-19T05:30:24.175 INFO:journalctl@ceph.osd.1.smithi178.stdout:Sep 19 05:30:23 smithi178 podman[70386]: 2024-09-19 05:30:23.832319022 +0000 UTC m=+0.524885412 container died 7022bbe575420475704e532c83a942978006666734af83b66e13c9853bbd9ef3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:30:24.473 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T05:30:24.513 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:30:24.513 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T05:30:24.513 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T05:30:24.513 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.2 2024-09-19T05:30:24.814 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 19 05:30:24 smithi194 systemd[1]: Stopping Ceph osd.2 for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:30:25.080 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 19 05:30:24 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-2[40189]: 2024-09-19T05:30:24.812+0000 7f5c3014f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:30:25.080 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 19 05:30:24 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-2[40189]: 2024-09-19T05:30:24.812+0000 7f5c3014f640 -1 osd.2 93 *** Got signal Terminated *** 2024-09-19T05:30:25.080 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 19 05:30:24 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-2[40189]: 2024-09-19T05:30:24.812+0000 7f5c3014f640 -1 osd.2 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:30:30.624 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 19 05:30:30 smithi194 podman[71476]: 2024-09-19 05:30:30.34828255 +0000 UTC m=+5.636447688 container died 1802400ad3f8d21f1a248e2e61e297a3fe8835374b94af7ec64fd9368ac2ff11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-19T05:30:30.905 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 19 05:30:30 smithi194 podman[71476]: 2024-09-19 05:30:30.712466744 +0000 UTC m=+6.000631875 container cleanup 1802400ad3f8d21f1a248e2e61e297a3fe8835374b94af7ec64fd9368ac2ff11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T05:30:30.906 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 19 05:30:30 smithi194 bash[71476]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-2 2024-09-19T05:30:31.308 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 19 05:30:30 smithi194 podman[71504]: 2024-09-19 05:30:30.997217464 +0000 UTC m=+0.646702276 container remove 1802400ad3f8d21f1a248e2e61e297a3fe8835374b94af7ec64fd9368ac2ff11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T05:30:31.578 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 19 05:30:31 smithi194 podman[71595]: 2024-09-19 05:30:31.209706779 +0000 UTC m=+0.016012988 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:30:31.579 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 19 05:30:31 smithi194 podman[71595]: 2024-09-19 05:30:31.339965534 +0000 UTC m=+0.146271729 container create ceff8b9e92bdd02013c09bf3f17e86ffef51fd24379bef1a939ce3c78a9b5ec7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:30:31.579 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 19 05:30:31 smithi194 podman[71595]: 2024-09-19 05:30:31.576756376 +0000 UTC m=+0.383062589 container init ceff8b9e92bdd02013c09bf3f17e86ffef51fd24379bef1a939ce3c78a9b5ec7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T05:30:31.906 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 19 05:30:31 smithi194 podman[71595]: 2024-09-19 05:30:31.580906529 +0000 UTC m=+0.387212723 container start ceff8b9e92bdd02013c09bf3f17e86ffef51fd24379bef1a939ce3c78a9b5ec7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T05:30:31.906 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 19 05:30:31 smithi194 podman[71595]: 2024-09-19 05:30:31.66750626 +0000 UTC m=+0.473812452 container attach ceff8b9e92bdd02013c09bf3f17e86ffef51fd24379bef1a939ce3c78a9b5ec7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T05:30:31.906 INFO:journalctl@ceph.osd.2.smithi194.stdout:Sep 19 05:30:31 smithi194 podman[71595]: 2024-09-19 05:30:31.778192482 +0000 UTC m=+0.584498684 container died ceff8b9e92bdd02013c09bf3f17e86ffef51fd24379bef1a939ce3c78a9b5ec7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T05:30:32.459 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T05:30:32.500 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:30:32.500 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T05:30:32.501 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T05:30:32.501 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.3 2024-09-19T05:30:32.801 INFO:journalctl@ceph.osd.3.smithi120.stdout:Sep 19 05:30:32 smithi120 systemd[1]: Stopping Ceph osd.3 for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:30:33.125 INFO:journalctl@ceph.osd.3.smithi120.stdout:Sep 19 05:30:32 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-3[51165]: 2024-09-19T05:30:32.798+0000 7f83b8212640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:30:33.125 INFO:journalctl@ceph.osd.3.smithi120.stdout:Sep 19 05:30:32 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-3[51165]: 2024-09-19T05:30:32.798+0000 7f83b8212640 -1 osd.3 93 *** Got signal Terminated *** 2024-09-19T05:30:33.125 INFO:journalctl@ceph.osd.3.smithi120.stdout:Sep 19 05:30:32 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-3[51165]: 2024-09-19T05:30:32.798+0000 7f83b8212640 -1 osd.3 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:30:35.376 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:35 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:35.053+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:30:35.547 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:35 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:35.217+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:30:35.548 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:35 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:35.044+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:09.123581+0000 front 2024-09-19T05:30:09.123478+0000 (oldest deadline 2024-09-19T05:30:35.023614+0000) 2024-09-19T05:30:36.223 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:36.054+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:09.123581+0000 front 2024-09-19T05:30:09.123478+0000 (oldest deadline 2024-09-19T05:30:35.023614+0000) 2024-09-19T05:30:36.224 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:35 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:35.907+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:30:36.375 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:36 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:36.193+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:30:36.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:36 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:36.066+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:30:36.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:36 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:36.051+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:30:36.655 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:36.222+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:30:37.155 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:37 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:37.025+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:09.123581+0000 front 2024-09-19T05:30:09.123478+0000 (oldest deadline 2024-09-19T05:30:35.023614+0000) 2024-09-19T05:30:37.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:36.891+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:30:37.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:37 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:37.027+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:30:37.376 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:37 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:37.158+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:30:37.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:37 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:37.010+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:30:37.655 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:37 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:37.256+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:30:37.875 INFO:journalctl@ceph.osd.3.smithi120.stdout:Sep 19 05:30:37 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-3[51165]: 2024-09-19T05:30:37.575+0000 7f83b080f640 -1 osd.3 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.451475+0000 front 2024-09-19T05:30:13.451620+0000 (oldest deadline 2024-09-19T05:30:37.551616+0000) 2024-09-19T05:30:38.155 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:38 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:38.048+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:09.123581+0000 front 2024-09-19T05:30:09.123478+0000 (oldest deadline 2024-09-19T05:30:35.023614+0000) 2024-09-19T05:30:38.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:37 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:37.895+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:30:38.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:38 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:38.006+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:30:38.375 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:38 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:38.161+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:30:38.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:38 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:38.053+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:30:38.643 INFO:journalctl@ceph.osd.3.smithi120.stdout:Sep 19 05:30:38 smithi120 podman[197018]: 2024-09-19 05:30:38.388514645 +0000 UTC m=+5.690750911 container died 533663586ee280598f66a83f9cc2f43d0fb7791d81ab2f73c1ab4686c6541ae5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T05:30:38.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:38 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:38.225+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:30:38.973 INFO:journalctl@ceph.osd.3.smithi120.stdout:Sep 19 05:30:38 smithi120 podman[197018]: 2024-09-19 05:30:38.765743742 +0000 UTC m=+6.067979990 container cleanup 533663586ee280598f66a83f9cc2f43d0fb7791d81ab2f73c1ab4686c6541ae5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T05:30:38.973 INFO:journalctl@ceph.osd.3.smithi120.stdout:Sep 19 05:30:38 smithi120 bash[197018]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-3 2024-09-19T05:30:39.156 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:39 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:39.043+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:09.123581+0000 front 2024-09-19T05:30:09.123478+0000 (oldest deadline 2024-09-19T05:30:35.023614+0000) 2024-09-19T05:30:39.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:38 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:38.902+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:30:39.306 INFO:journalctl@ceph.osd.3.smithi120.stdout:Sep 19 05:30:38 smithi120 podman[197033]: 2024-09-19 05:30:38.991867626 +0000 UTC m=+0.604307615 container remove 533663586ee280598f66a83f9cc2f43d0fb7791d81ab2f73c1ab4686c6541ae5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2) 2024-09-19T05:30:39.306 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:38 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:38.971+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:30:39.306 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:39 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:39.172+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:30:39.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:39 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:39.066+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:30:39.571 INFO:journalctl@ceph.osd.3.smithi120.stdout:Sep 19 05:30:39 smithi120 podman[197118]: 2024-09-19 05:30:39.207592347 +0000 UTC m=+0.015744701 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:30:39.571 INFO:journalctl@ceph.osd.3.smithi120.stdout:Sep 19 05:30:39 smithi120 podman[197118]: 2024-09-19 05:30:39.33435208 +0000 UTC m=+0.142504417 container create 1dd84328e32562317d15d2dbce65f314b08cdcf611e68eaf51004b63ce868f2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T05:30:39.571 INFO:journalctl@ceph.osd.3.smithi120.stdout:Sep 19 05:30:39 smithi120 podman[197118]: 2024-09-19 05:30:39.570201104 +0000 UTC m=+0.378353456 container init 1dd84328e32562317d15d2dbce65f314b08cdcf611e68eaf51004b63ce868f2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T05:30:39.655 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:39 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:39.215+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:30:39.875 INFO:journalctl@ceph.osd.3.smithi120.stdout:Sep 19 05:30:39 smithi120 podman[197118]: 2024-09-19 05:30:39.573690408 +0000 UTC m=+0.381842752 container start 1dd84328e32562317d15d2dbce65f314b08cdcf611e68eaf51004b63ce868f2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:30:39.875 INFO:journalctl@ceph.osd.3.smithi120.stdout:Sep 19 05:30:39 smithi120 podman[197118]: 2024-09-19 05:30:39.653585373 +0000 UTC m=+0.461737744 container attach 1dd84328e32562317d15d2dbce65f314b08cdcf611e68eaf51004b63ce868f2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T05:30:39.876 INFO:journalctl@ceph.osd.3.smithi120.stdout:Sep 19 05:30:39 smithi120 podman[197118]: 2024-09-19 05:30:39.763318594 +0000 UTC m=+0.571470937 container died 1dd84328e32562317d15d2dbce65f314b08cdcf611e68eaf51004b63ce868f2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T05:30:40.156 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:40 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:40.003+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:09.123581+0000 front 2024-09-19T05:30:09.123478+0000 (oldest deadline 2024-09-19T05:30:35.023614+0000) 2024-09-19T05:30:40.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:39 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:39.891+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:30:40.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:39 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:39.982+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:30:40.375 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:40 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:40.216+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:30:40.428 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T05:30:40.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:40 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:40.101+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:30:40.466 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:30:40.466 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T05:30:40.466 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T05:30:40.466 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.4 2024-09-19T05:30:40.659 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:40 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:40.185+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:30:40.753 INFO:journalctl@ceph.osd.4.smithi178.stdout:Sep 19 05:30:40 smithi178 systemd[1]: Stopping Ceph osd.4 for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:30:41.119 INFO:journalctl@ceph.osd.4.smithi178.stdout:Sep 19 05:30:40 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-4[45618]: 2024-09-19T05:30:40.751+0000 7fadbd202640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:30:41.119 INFO:journalctl@ceph.osd.4.smithi178.stdout:Sep 19 05:30:40 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-4[45618]: 2024-09-19T05:30:40.751+0000 7fadbd202640 -1 osd.4 93 *** Got signal Terminated *** 2024-09-19T05:30:41.119 INFO:journalctl@ceph.osd.4.smithi178.stdout:Sep 19 05:30:40 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-4[45618]: 2024-09-19T05:30:40.751+0000 7fadbd202640 -1 osd.4 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:30:41.153 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:40 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:40.897+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:30:41.153 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:40 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:40.996+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:09.123581+0000 front 2024-09-19T05:30:09.123478+0000 (oldest deadline 2024-09-19T05:30:35.023614+0000) 2024-09-19T05:30:41.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:41 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:41.009+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:30:41.376 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:41 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:41.209+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:30:41.405 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:41 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:41.151+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:30:41.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:41 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:41.117+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:30:42.180 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:42 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:42.013+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:09.123581+0000 front 2024-09-19T05:30:09.123478+0000 (oldest deadline 2024-09-19T05:30:35.023614+0000) 2024-09-19T05:30:42.181 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:41 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:41.924+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:30:42.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:41 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:41.989+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:30:42.375 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:42 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:42.195+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:30:42.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:42 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:42.161+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:30:42.508 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:42 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:42.178+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:30:43.168 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:42 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:42.996+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:09.123581+0000 front 2024-09-19T05:30:09.123478+0000 (oldest deadline 2024-09-19T05:30:35.023614+0000) 2024-09-19T05:30:43.169 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:42 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:42.908+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:30:43.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:43 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:43.034+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:30:43.375 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:43 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:43.221+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:30:43.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:43 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:43.159+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:30:43.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:43 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:43.159+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:30:43.442 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:43 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:43.006+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:30:43.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:43 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:43.167+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:30:44.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:44 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:44.050+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:30:44.376 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:44 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:44.266+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:30:44.405 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:44 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:44.037+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:09.123581+0000 front 2024-09-19T05:30:09.123478+0000 (oldest deadline 2024-09-19T05:30:35.023614+0000) 2024-09-19T05:30:44.406 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:44 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:44.174+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:30:44.406 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:43 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:43.926+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:30:44.406 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:43 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:43.926+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:30:44.442 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:44 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:44.055+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:30:44.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:44 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:44.154+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:30:44.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:44 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:44.154+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:30:45.221 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:45 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:45.086+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:09.123581+0000 front 2024-09-19T05:30:09.123478+0000 (oldest deadline 2024-09-19T05:30:35.023614+0000) 2024-09-19T05:30:45.222 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:45 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:45.086+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.826361+0000 front 2024-09-19T05:30:21.826197+0000 (oldest deadline 2024-09-19T05:30:44.126343+0000) 2024-09-19T05:30:45.222 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:44 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:44.939+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:30:45.222 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:44 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:44.939+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:30:45.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:45 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:45.097+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:30:45.376 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:45 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:45.097+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.360899+0000 front 2024-09-19T05:30:19.360770+0000 (oldest deadline 2024-09-19T05:30:44.660943+0000) 2024-09-19T05:30:45.376 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:45 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:45.275+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:30:45.376 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:45 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:45.275+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:30:45.442 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:45 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:45.017+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:30:45.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:45 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:45.118+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:30:45.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:45 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:45.118+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:30:45.655 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:45 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:45.220+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:30:45.942 INFO:journalctl@ceph.osd.4.smithi178.stdout:Sep 19 05:30:45 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-4[45618]: 2024-09-19T05:30:45.520+0000 7fadb9807640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.664442+0000 front 2024-09-19T05:30:20.664559+0000 (oldest deadline 2024-09-19T05:30:44.764600+0000) 2024-09-19T05:30:46.254 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:45 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:45.965+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:30:46.254 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:45 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:45.965+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:30:46.254 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:46 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:46.076+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:09.123581+0000 front 2024-09-19T05:30:09.123478+0000 (oldest deadline 2024-09-19T05:30:35.023614+0000) 2024-09-19T05:30:46.254 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:46 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:46.076+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.826361+0000 front 2024-09-19T05:30:21.826197+0000 (oldest deadline 2024-09-19T05:30:44.126343+0000) 2024-09-19T05:30:46.375 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:46 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:46.231+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:30:46.375 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:46 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:46.231+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:30:46.376 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:46 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:46.057+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:30:46.376 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:46 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:46.057+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.360899+0000 front 2024-09-19T05:30:19.360770+0000 (oldest deadline 2024-09-19T05:30:44.660943+0000) 2024-09-19T05:30:46.442 INFO:journalctl@ceph.osd.4.smithi178.stdout:Sep 19 05:30:46 smithi178 podman[70501]: 2024-09-19 05:30:46.189681483 +0000 UTC m=+5.530270340 container died 935fc8d5bf3a59d37b3d852aa5530679cea6132e41d9169508b11c9446a27361 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-19T05:30:46.443 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:45 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:45.998+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:30:46.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:46 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:46.140+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:30:46.444 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:46 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:46.140+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:30:46.655 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:46 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:46.252+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:30:46.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:46 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:46.252+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:30:46.872 INFO:journalctl@ceph.osd.4.smithi178.stdout:Sep 19 05:30:46 smithi178 podman[70501]: 2024-09-19 05:30:46.552437099 +0000 UTC m=+5.893025938 container cleanup 935fc8d5bf3a59d37b3d852aa5530679cea6132e41d9169508b11c9446a27361 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-19T05:30:46.872 INFO:journalctl@ceph.osd.4.smithi178.stdout:Sep 19 05:30:46 smithi178 bash[70501]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-4 2024-09-19T05:30:47.192 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:46 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:46.975+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:30:47.192 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:47 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:47.094+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:30:47.192 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:47 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:47.094+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:30:47.193 INFO:journalctl@ceph.osd.4.smithi178.stdout:Sep 19 05:30:46 smithi178 podman[70518]: 2024-09-19 05:30:46.870771638 +0000 UTC m=+0.683790165 container remove 935fc8d5bf3a59d37b3d852aa5530679cea6132e41d9169508b11c9446a27361 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-19T05:30:47.277 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:47 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:47.011+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:30:47.277 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:47 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:47.011+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.360899+0000 front 2024-09-19T05:30:19.360770+0000 (oldest deadline 2024-09-19T05:30:44.660943+0000) 2024-09-19T05:30:47.277 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:46 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:46.981+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:30:47.277 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:46 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:46.981+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:30:47.278 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:47 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:47.081+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:09.123581+0000 front 2024-09-19T05:30:09.123478+0000 (oldest deadline 2024-09-19T05:30:35.023614+0000) 2024-09-19T05:30:47.278 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:47 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:47.081+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.826361+0000 front 2024-09-19T05:30:21.826197+0000 (oldest deadline 2024-09-19T05:30:44.126343+0000) 2024-09-19T05:30:47.526 INFO:journalctl@ceph.osd.4.smithi178.stdout:Sep 19 05:30:47 smithi178 podman[70607]: 2024-09-19 05:30:47.131527849 +0000 UTC m=+0.015616597 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:30:47.526 INFO:journalctl@ceph.osd.4.smithi178.stdout:Sep 19 05:30:47 smithi178 podman[70607]: 2024-09-19 05:30:47.263452944 +0000 UTC m=+0.147541671 container create 208a864538f7559fd36b75ffaf682d11539a7e06987d1912bf48ed8f880cdc88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:30:47.526 INFO:journalctl@ceph.osd.4.smithi178.stdout:Sep 19 05:30:47 smithi178 podman[70607]: 2024-09-19 05:30:47.524525182 +0000 UTC m=+0.408613926 container init 208a864538f7559fd36b75ffaf682d11539a7e06987d1912bf48ed8f880cdc88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T05:30:47.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:47 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:47.276+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:30:47.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:47 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:47.276+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:30:47.655 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:47 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:47.276+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:30:47.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:47 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:47.276+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:30:47.933 INFO:journalctl@ceph.osd.4.smithi178.stdout:Sep 19 05:30:47 smithi178 podman[70607]: 2024-09-19 05:30:47.527943678 +0000 UTC m=+0.412032414 container start 208a864538f7559fd36b75ffaf682d11539a7e06987d1912bf48ed8f880cdc88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T05:30:47.934 INFO:journalctl@ceph.osd.4.smithi178.stdout:Sep 19 05:30:47 smithi178 podman[70607]: 2024-09-19 05:30:47.582600629 +0000 UTC m=+0.466689367 container attach 208a864538f7559fd36b75ffaf682d11539a7e06987d1912bf48ed8f880cdc88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T05:30:47.934 INFO:journalctl@ceph.osd.4.smithi178.stdout:Sep 19 05:30:47 smithi178 podman[70607]: 2024-09-19 05:30:47.707973596 +0000 UTC m=+0.592062332 container died 208a864538f7559fd36b75ffaf682d11539a7e06987d1912bf48ed8f880cdc88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-4-deactivate, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-19T05:30:48.192 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:47 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:47.931+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:30:48.193 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:48 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:48.108+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:30:48.193 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:48 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:48.108+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:30:48.300 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:48 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:48.049+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:09.123581+0000 front 2024-09-19T05:30:09.123478+0000 (oldest deadline 2024-09-19T05:30:35.023614+0000) 2024-09-19T05:30:48.300 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:48 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:48.049+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.826361+0000 front 2024-09-19T05:30:21.826197+0000 (oldest deadline 2024-09-19T05:30:44.126343+0000) 2024-09-19T05:30:48.300 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:48 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:48.011+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:30:48.300 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:48 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:48.011+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:30:48.312 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T05:30:48.351 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:30:48.351 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T05:30:48.351 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T05:30:48.351 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.5 2024-09-19T05:30:48.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:48 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:48.057+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:30:48.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:48 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:48.057+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.360899+0000 front 2024-09-19T05:30:19.360770+0000 (oldest deadline 2024-09-19T05:30:44.660943+0000) 2024-09-19T05:30:48.376 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:48 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:48.254+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:30:48.376 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:48 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:48.254+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:30:48.657 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:48 smithi194 systemd[1]: Stopping Ceph osd.5 for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:30:48.658 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:48 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:48.298+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:30:48.658 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:48 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:48.298+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:30:48.962 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:48 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:48.656+0000 7f655e3c1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:30:48.963 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:48 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:48.656+0000 7f655e3c1640 -1 osd.5 93 *** Got signal Terminated *** 2024-09-19T05:30:48.963 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:48 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:48.656+0000 7f655e3c1640 -1 osd.5 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:30:49.192 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:48 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:48.920+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:30:49.193 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:49 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:49.083+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:30:49.193 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:49 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:49.083+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:30:49.286 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:49 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:49.010+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:30:49.287 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:49 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:49.010+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.360899+0000 front 2024-09-19T05:30:19.360770+0000 (oldest deadline 2024-09-19T05:30:44.660943+0000) 2024-09-19T05:30:49.312 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:49 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:49.067+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:09.123581+0000 front 2024-09-19T05:30:09.123478+0000 (oldest deadline 2024-09-19T05:30:35.023614+0000) 2024-09-19T05:30:49.312 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:49 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:49.067+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.826361+0000 front 2024-09-19T05:30:21.826197+0000 (oldest deadline 2024-09-19T05:30:44.126343+0000) 2024-09-19T05:30:49.312 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:48 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:48.961+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:30:49.312 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:48 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:48.961+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:30:49.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:49 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:49.284+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:30:49.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:49 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:49.284+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:30:49.655 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:49 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:49.310+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:30:49.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:49 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:49.310+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:30:50.133 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:49 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:49.873+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:30:50.282 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:50 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:50.066+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:09.123581+0000 front 2024-09-19T05:30:09.123478+0000 (oldest deadline 2024-09-19T05:30:35.023614+0000) 2024-09-19T05:30:50.282 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:50 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:50.066+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.826361+0000 front 2024-09-19T05:30:21.826197+0000 (oldest deadline 2024-09-19T05:30:44.126343+0000) 2024-09-19T05:30:50.282 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:49 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:49.980+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:30:50.282 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:49 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:49.980+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:30:50.331 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:50 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:50.005+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:30:50.331 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:50 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:50.005+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.360899+0000 front 2024-09-19T05:30:19.360770+0000 (oldest deadline 2024-09-19T05:30:44.660943+0000) 2024-09-19T05:30:50.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:50 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:50.131+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:30:50.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:50 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:50.131+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:30:50.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:50 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:50.330+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:30:50.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:50 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:50.330+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:30:50.655 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:50 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:50.280+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:30:50.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:50 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:50.280+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:30:51.157 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:50 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:50.827+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:30:51.295 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:51 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:51.075+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:09.123581+0000 front 2024-09-19T05:30:09.123478+0000 (oldest deadline 2024-09-19T05:30:35.023614+0000) 2024-09-19T05:30:51.295 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:51 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:51.075+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.826361+0000 front 2024-09-19T05:30:21.826197+0000 (oldest deadline 2024-09-19T05:30:44.126343+0000) 2024-09-19T05:30:51.295 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:50 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:50.955+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:30:51.295 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:50 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:50.955+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:30:51.295 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:50 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:50.955+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:30:51.349 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:51 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:51.031+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:30:51.349 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:51 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:51.031+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.360899+0000 front 2024-09-19T05:30:19.360770+0000 (oldest deadline 2024-09-19T05:30:44.660943+0000) 2024-09-19T05:30:51.349 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:51 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:51.031+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.361929+0000 front 2024-09-19T05:30:26.362042+0000 (oldest deadline 2024-09-19T05:30:50.461920+0000) 2024-09-19T05:30:51.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:51 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:51.155+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:30:51.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:51 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:51.155+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:30:51.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:51 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:51.348+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:30:51.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:51 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:51.348+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:30:51.655 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:51 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:51.293+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:30:51.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:51 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:51.293+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:30:52.188 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:51 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:51.799+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:30:52.273 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:52 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:52.062+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:09.123581+0000 front 2024-09-19T05:30:09.123478+0000 (oldest deadline 2024-09-19T05:30:35.023614+0000) 2024-09-19T05:30:52.273 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:52 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:52.062+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.826361+0000 front 2024-09-19T05:30:21.826197+0000 (oldest deadline 2024-09-19T05:30:44.126343+0000) 2024-09-19T05:30:52.273 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:51 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:51.935+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:30:52.273 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:51 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:51.935+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:30:52.273 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:51 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:51.935+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:30:52.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:51 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:51.992+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:30:52.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:51 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:51.992+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.360899+0000 front 2024-09-19T05:30:19.360770+0000 (oldest deadline 2024-09-19T05:30:44.660943+0000) 2024-09-19T05:30:52.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:51 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:51.992+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.361929+0000 front 2024-09-19T05:30:26.362042+0000 (oldest deadline 2024-09-19T05:30:50.461920+0000) 2024-09-19T05:30:52.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:52 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:52.186+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:30:52.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:52 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:52.186+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:30:52.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:52 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:52.270+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:30:52.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:52 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:52.270+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:30:52.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:52 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:52.270+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:30:52.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:52 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:52.387+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:30:52.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:52 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:52.387+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:30:53.192 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:52 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:52.764+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:30:53.192 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:52 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:52.764+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:27.925162+0000 front 2024-09-19T05:30:27.925147+0000 (oldest deadline 2024-09-19T05:30:52.625316+0000) 2024-09-19T05:30:53.269 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:53 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:53.029+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:09.123581+0000 front 2024-09-19T05:30:09.123478+0000 (oldest deadline 2024-09-19T05:30:35.023614+0000) 2024-09-19T05:30:53.269 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:53 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5[47094]: 2024-09-19T05:30:53.029+0000 7f65569be640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.826361+0000 front 2024-09-19T05:30:21.826197+0000 (oldest deadline 2024-09-19T05:30:44.126343+0000) 2024-09-19T05:30:53.269 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:52 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:52.914+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:30:53.269 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:52 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:52.914+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:30:53.269 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:52 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:52.914+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:30:53.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:52 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:52.983+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:30:53.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:52 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:52.983+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.360899+0000 front 2024-09-19T05:30:19.360770+0000 (oldest deadline 2024-09-19T05:30:44.660943+0000) 2024-09-19T05:30:53.376 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:52 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:52.983+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.361929+0000 front 2024-09-19T05:30:26.362042+0000 (oldest deadline 2024-09-19T05:30:50.461920+0000) 2024-09-19T05:30:53.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:53 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:53.266+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:30:53.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:53 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:53.266+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:30:53.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:53 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:53.266+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:30:53.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:53 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:53.214+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:30:53.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:53 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:53.214+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:30:53.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:53 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:53.403+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:30:53.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:53 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:53.403+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:30:54.139 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:53 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:53.884+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:30:54.139 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:53 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:53.884+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:30:54.139 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:53 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:53.884+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:30:54.192 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:53 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:53.782+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:30:54.192 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:53 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:53.782+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:27.925162+0000 front 2024-09-19T05:30:27.925147+0000 (oldest deadline 2024-09-19T05:30:52.625316+0000) 2024-09-19T05:30:54.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:53 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:53.976+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:30:54.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:53 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:53.976+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.360899+0000 front 2024-09-19T05:30:19.360770+0000 (oldest deadline 2024-09-19T05:30:44.660943+0000) 2024-09-19T05:30:54.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:53 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:53.976+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.361929+0000 front 2024-09-19T05:30:26.362042+0000 (oldest deadline 2024-09-19T05:30:50.461920+0000) 2024-09-19T05:30:54.405 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:54 smithi194 podman[71697]: 2024-09-19 05:30:54.138073022 +0000 UTC m=+5.590807388 container died 50c87fa44d6373a16600fb57d3b6841da38e035d49a386fc5aab0956b88672a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T05:30:54.406 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:54 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:54.225+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:30:54.406 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:54 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:54.225+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:30:54.406 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:54 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:54.225+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:30:54.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:54 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:54.201+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:30:54.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:54 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:54.201+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:30:54.759 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:54 smithi194 podman[71697]: 2024-09-19 05:30:54.548625079 +0000 UTC m=+6.001359442 container cleanup 50c87fa44d6373a16600fb57d3b6841da38e035d49a386fc5aab0956b88672a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T05:30:54.760 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:54 smithi194 bash[71697]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5 2024-09-19T05:30:54.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:54 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:54.449+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:30:54.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:54 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:54.449+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:30:54.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:54 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:54.449+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:30:55.156 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:54 smithi194 podman[71713]: 2024-09-19 05:30:54.758020834 +0000 UTC m=+0.623322706 container remove 50c87fa44d6373a16600fb57d3b6841da38e035d49a386fc5aab0956b88672a1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-19T05:30:55.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:54 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:54.896+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:30:55.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:54 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:54.896+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:30:55.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:54 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:54.896+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:30:55.192 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:54 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:54.817+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:30:55.192 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:54 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:54.817+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:27.925162+0000 front 2024-09-19T05:30:27.925147+0000 (oldest deadline 2024-09-19T05:30:52.625316+0000) 2024-09-19T05:30:55.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:54 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:54.950+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:30:55.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:54 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:54.950+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.360899+0000 front 2024-09-19T05:30:19.360770+0000 (oldest deadline 2024-09-19T05:30:44.660943+0000) 2024-09-19T05:30:55.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:54 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:54.950+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.361929+0000 front 2024-09-19T05:30:26.362042+0000 (oldest deadline 2024-09-19T05:30:50.461920+0000) 2024-09-19T05:30:55.452 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:55 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:55.180+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:30:55.452 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:55 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:55.180+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:30:55.452 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:55 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:55.180+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:30:55.453 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:55 smithi194 podman[71812]: 2024-09-19 05:30:55.107347333 +0000 UTC m=+0.017598048 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:30:55.453 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:55 smithi194 podman[71812]: 2024-09-19 05:30:55.217233002 +0000 UTC m=+0.127483711 container create ddb28e191909c84ac6064b9b55b0ad24369da01b129d2c05fce375a5a12c3376 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T05:30:55.453 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:55 smithi194 podman[71812]: 2024-09-19 05:30:55.427798281 +0000 UTC m=+0.338048997 container init ddb28e191909c84ac6064b9b55b0ad24369da01b129d2c05fce375a5a12c3376 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T05:30:55.453 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:55 smithi194 podman[71812]: 2024-09-19 05:30:55.431203478 +0000 UTC m=+0.341454189 container start ddb28e191909c84ac6064b9b55b0ad24369da01b129d2c05fce375a5a12c3376 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True) 2024-09-19T05:30:55.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:55 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:55.216+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:30:55.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:55 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:55.216+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:30:55.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:55 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:55.216+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:30:55.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:55 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:55.486+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:30:55.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:55 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:55.486+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:30:55.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:55 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:55.486+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:30:55.900 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:55 smithi194 podman[71812]: 2024-09-19 05:30:55.53656361 +0000 UTC m=+0.446814322 container attach ddb28e191909c84ac6064b9b55b0ad24369da01b129d2c05fce375a5a12c3376 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T05:30:55.900 INFO:journalctl@ceph.osd.5.smithi194.stdout:Sep 19 05:30:55 smithi194 podman[71812]: 2024-09-19 05:30:55.632389177 +0000 UTC m=+0.542639885 container died ddb28e191909c84ac6064b9b55b0ad24369da01b129d2c05fce375a5a12c3376 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T05:30:56.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:55 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:55.898+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:30:56.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:55 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:55.898+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:30:56.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:55 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:55.898+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:30:56.192 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:55 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:55.848+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:30:56.192 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:55 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:55.848+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:27.925162+0000 front 2024-09-19T05:30:27.925147+0000 (oldest deadline 2024-09-19T05:30:52.625316+0000) 2024-09-19T05:30:56.234 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T05:30:56.274 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:30:56.275 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T05:30:56.275 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T05:30:56.275 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.6 2024-09-19T05:30:56.305 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:55 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:55.979+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:30:56.305 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:55 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:55.979+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.360899+0000 front 2024-09-19T05:30:19.360770+0000 (oldest deadline 2024-09-19T05:30:44.660943+0000) 2024-09-19T05:30:56.305 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:55 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:55.979+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.361929+0000 front 2024-09-19T05:30:26.362042+0000 (oldest deadline 2024-09-19T05:30:50.461920+0000) 2024-09-19T05:30:56.585 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:56 smithi120 systemd[1]: Stopping Ceph osd.6 for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:30:56.586 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:56 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:56.583+0000 7f0a16c78640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:30:56.586 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:56 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:56.481+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:30:56.586 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:56 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:56.481+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:30:56.586 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:56 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:56.481+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:30:56.655 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:56 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:56.196+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:30:56.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:56 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:56.196+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:30:56.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:56 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:56.197+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:30:56.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:56 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:56.250+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:30:56.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:56 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:56.250+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:30:56.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:56 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:56.250+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:30:56.875 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:56 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:56.583+0000 7f0a16c78640 -1 osd.6 93 *** Got signal Terminated *** 2024-09-19T05:30:56.875 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:56 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:56.583+0000 7f0a16c78640 -1 osd.6 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:30:57.155 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:56 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:56.893+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:30:57.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:56 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:56.893+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:30:57.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:56 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:56.893+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:30:57.192 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:56 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:56.897+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:30:57.192 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:56 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:56.897+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:27.925162+0000 front 2024-09-19T05:30:27.925147+0000 (oldest deadline 2024-09-19T05:30:52.625316+0000) 2024-09-19T05:30:57.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:57 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:57.029+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:30:57.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:57 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:57.029+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.360899+0000 front 2024-09-19T05:30:19.360770+0000 (oldest deadline 2024-09-19T05:30:44.660943+0000) 2024-09-19T05:30:57.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:57 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:57.029+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.361929+0000 front 2024-09-19T05:30:26.362042+0000 (oldest deadline 2024-09-19T05:30:50.461920+0000) 2024-09-19T05:30:57.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:57 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:57.195+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:30:57.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:57 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:57.195+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:30:57.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:57 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:57.195+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:30:57.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:57 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:57.235+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:30:57.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:57 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:57.235+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:30:57.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:57 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:57.235+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:30:57.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:57 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:57.494+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:30:57.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:57 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:57.494+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:30:57.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:57 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:57.494+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:30:58.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:57 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:57.876+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:30:58.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:57 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:57.876+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:30:58.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:57 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:57.876+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:30:58.192 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:57 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:57.922+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:30:58.192 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:57 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:57.922+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:27.925162+0000 front 2024-09-19T05:30:27.925147+0000 (oldest deadline 2024-09-19T05:30:52.625316+0000) 2024-09-19T05:30:58.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:58 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:58.019+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:30:58.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:58 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:58.019+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.360899+0000 front 2024-09-19T05:30:19.360770+0000 (oldest deadline 2024-09-19T05:30:44.660943+0000) 2024-09-19T05:30:58.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:58 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:58.019+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.361929+0000 front 2024-09-19T05:30:26.362042+0000 (oldest deadline 2024-09-19T05:30:50.461920+0000) 2024-09-19T05:30:58.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:58 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:58.186+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:30:58.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:58 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:58.186+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:30:58.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:58 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:58.186+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:30:58.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:58 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:58.260+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:30:58.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:58 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:58.260+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:30:58.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:58 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:58.260+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:30:58.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:58 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:58.461+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:30:58.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:58 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:58.461+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:30:58.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:58 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:58.461+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:30:59.155 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:58 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:58.857+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:30:59.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:58 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:58.857+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:30:59.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:58 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:58.857+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:30:59.265 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:58 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:58.959+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:30:59.265 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:58 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:58.959+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:27.925162+0000 front 2024-09-19T05:30:27.925147+0000 (oldest deadline 2024-09-19T05:30:52.625316+0000) 2024-09-19T05:30:59.265 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:58 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:58.959+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:32.625829+0000 front 2024-09-19T05:30:32.626014+0000 (oldest deadline 2024-09-19T05:30:58.525900+0000) 2024-09-19T05:30:59.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:59 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:59.052+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:30:59.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:59 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:59.052+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.360899+0000 front 2024-09-19T05:30:19.360770+0000 (oldest deadline 2024-09-19T05:30:44.660943+0000) 2024-09-19T05:30:59.376 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:30:59 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:30:59.052+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.361929+0000 front 2024-09-19T05:30:26.362042+0000 (oldest deadline 2024-09-19T05:30:50.461920+0000) 2024-09-19T05:30:59.655 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:59 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:59.180+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:30:59.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:59 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:59.180+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:30:59.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:30:59 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:30:59.180+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:30:59.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:59 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:59.263+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:30:59.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:59 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:59.263+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:30:59.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:59 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:59.263+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:30:59.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:30:59 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:30:59.263+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:30:59.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:59 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:59.481+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:30:59.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:59 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:59.481+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:30:59.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:30:59 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:30:59.481+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:00.148 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:59 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:59.821+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:31:00.148 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:59 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:59.821+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:31:00.148 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:30:59 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:30:59.821+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:31:00.192 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:59 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:59.938+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:31:00.192 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:59 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:59.938+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:27.925162+0000 front 2024-09-19T05:30:27.925147+0000 (oldest deadline 2024-09-19T05:30:52.625316+0000) 2024-09-19T05:31:00.192 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:30:59 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:30:59.938+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:32.625829+0000 front 2024-09-19T05:30:32.626014+0000 (oldest deadline 2024-09-19T05:30:58.525900+0000) 2024-09-19T05:31:00.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:31:00 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:31:00.051+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:31:00.376 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:31:00 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:31:00.051+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.360899+0000 front 2024-09-19T05:30:19.360770+0000 (oldest deadline 2024-09-19T05:30:44.660943+0000) 2024-09-19T05:31:00.376 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:31:00 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:31:00.051+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.361929+0000 front 2024-09-19T05:30:26.362042+0000 (oldest deadline 2024-09-19T05:30:50.461920+0000) 2024-09-19T05:31:00.406 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:00 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:00.145+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:00.406 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:00 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:00.145+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:00.406 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:00 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:00.145+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:00.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:00 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:00.309+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:00.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:00 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:00.309+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:00.693 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:00 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:00.309+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:00.693 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:00 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:00.309+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:00.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:00 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:00.465+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:31:00.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:00 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:00.465+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:31:00.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:00 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:00.465+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:01.155 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:00 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:00.841+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:31:01.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:00 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:00.841+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:31:01.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:00 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:00.841+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:31:01.293 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:00 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:00.943+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:31:01.293 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:00 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:00.943+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:27.925162+0000 front 2024-09-19T05:30:27.925147+0000 (oldest deadline 2024-09-19T05:30:52.625316+0000) 2024-09-19T05:31:01.294 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:00 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:00.943+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:32.625829+0000 front 2024-09-19T05:30:32.626014+0000 (oldest deadline 2024-09-19T05:30:58.525900+0000) 2024-09-19T05:31:01.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:31:01 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:31:01.098+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.059101+0000 front 2024-09-19T05:30:13.059136+0000 (oldest deadline 2024-09-19T05:30:34.759138+0000) 2024-09-19T05:31:01.375 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:31:01 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:31:01.098+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.360899+0000 front 2024-09-19T05:30:19.360770+0000 (oldest deadline 2024-09-19T05:30:44.660943+0000) 2024-09-19T05:31:01.376 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:31:01 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6[58103]: 2024-09-19T05:31:01.098+0000 7f0a0f275640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.361929+0000 front 2024-09-19T05:30:26.362042+0000 (oldest deadline 2024-09-19T05:30:50.461920+0000) 2024-09-19T05:31:01.655 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:01 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:01.178+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:01.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:01 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:01.178+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:01.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:01 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:01.178+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:01.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:01 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:01.291+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:01.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:01 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:01.291+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:01.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:01 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:01.291+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:01.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:01 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:01.291+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:01.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:01 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:01.507+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:31:01.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:01 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:01.507+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:31:01.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:01 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:01.507+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:01.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:01 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:01.507+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:37.647202+0000 front 2024-09-19T05:30:37.647230+0000 (oldest deadline 2024-09-19T05:31:01.147350+0000) 2024-09-19T05:31:02.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:01 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:01.809+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:31:02.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:01 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:01.809+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:31:02.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:01 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:01.809+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:31:02.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:01 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:01.809+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.940611+0000 front 2024-09-19T05:30:35.940730+0000 (oldest deadline 2024-09-19T05:31:01.141093+0000) 2024-09-19T05:31:02.192 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:01 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:01.899+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:31:02.192 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:01 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:01.899+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:27.925162+0000 front 2024-09-19T05:30:27.925147+0000 (oldest deadline 2024-09-19T05:30:52.625316+0000) 2024-09-19T05:31:02.192 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:01 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:01.899+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:32.625829+0000 front 2024-09-19T05:30:32.626014+0000 (oldest deadline 2024-09-19T05:30:58.525900+0000) 2024-09-19T05:31:02.335 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:31:02 smithi120 podman[197234]: 2024-09-19 05:31:02.002896497 +0000 UTC m=+5.525911735 container died e37d4f8a9368e34bb87b4fb62f635539931af180db370d16f42244b2b4da3755 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T05:31:02.335 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:31:02 smithi120 podman[197234]: 2024-09-19 05:31:02.333897002 +0000 UTC m=+5.856912236 container cleanup e37d4f8a9368e34bb87b4fb62f635539931af180db370d16f42244b2b4da3755 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:31:02.625 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:31:02 smithi120 bash[197234]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6 2024-09-19T05:31:02.625 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:31:02 smithi120 podman[197250]: 2024-09-19 05:31:02.526838842 +0000 UTC m=+0.517490910 container remove e37d4f8a9368e34bb87b4fb62f635539931af180db370d16f42244b2b4da3755 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T05:31:02.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:02 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:02.497+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:31:02.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:02 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:02.497+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:31:02.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:02 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:02.497+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:02.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:02 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:02.497+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:37.647202+0000 front 2024-09-19T05:30:37.647230+0000 (oldest deadline 2024-09-19T05:31:01.147350+0000) 2024-09-19T05:31:02.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:02 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:02.224+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:02.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:02 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:02.224+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:02.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:02 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:02.224+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:02.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:02 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:02.224+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:02.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:02 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:02.259+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:02.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:02 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:02.259+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:02.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:02 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:02.259+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:02.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:02 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:02.259+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:03.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:02 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:02.782+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:31:03.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:02 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:02.782+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:31:03.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:02 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:02.782+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:31:03.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:02 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:02.782+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.940611+0000 front 2024-09-19T05:30:35.940730+0000 (oldest deadline 2024-09-19T05:31:01.141093+0000) 2024-09-19T05:31:03.261 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:02 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:02.946+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:31:03.262 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:02 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:02.946+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:27.925162+0000 front 2024-09-19T05:30:27.925147+0000 (oldest deadline 2024-09-19T05:30:52.625316+0000) 2024-09-19T05:31:03.262 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:02 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:02.946+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:32.625829+0000 front 2024-09-19T05:30:32.626014+0000 (oldest deadline 2024-09-19T05:30:58.525900+0000) 2024-09-19T05:31:03.273 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:31:02 smithi120 podman[197335]: 2024-09-19 05:31:02.865096641 +0000 UTC m=+0.016256711 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:31:03.273 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:31:02 smithi120 podman[197335]: 2024-09-19 05:31:02.985906754 +0000 UTC m=+0.137066869 container create 7502a98c05143e88c5eed0c1aff845094493dfb80cd6224dff91a51b81fea313 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-19T05:31:03.273 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:31:03 smithi120 podman[197335]: 2024-09-19 05:31:03.204843827 +0000 UTC m=+0.356003900 container init 7502a98c05143e88c5eed0c1aff845094493dfb80cd6224dff91a51b81fea313 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T05:31:03.273 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:31:03 smithi120 podman[197335]: 2024-09-19 05:31:03.208028281 +0000 UTC m=+0.359188365 container start 7502a98c05143e88c5eed0c1aff845094493dfb80cd6224dff91a51b81fea313 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T05:31:03.273 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:31:03 smithi120 podman[197335]: 2024-09-19 05:31:03.271283334 +0000 UTC m=+0.422443405 container attach 7502a98c05143e88c5eed0c1aff845094493dfb80cd6224dff91a51b81fea313 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:31:03.625 INFO:journalctl@ceph.osd.6.smithi120.stdout:Sep 19 05:31:03 smithi120 podman[197335]: 2024-09-19 05:31:03.394830297 +0000 UTC m=+0.545990376 container died 7502a98c05143e88c5eed0c1aff845094493dfb80cd6224dff91a51b81fea313 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:31:03.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:03 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:03.461+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:31:03.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:03 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:03.461+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:31:03.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:03 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:03.461+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:03.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:03 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:03.461+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:37.647202+0000 front 2024-09-19T05:30:37.647230+0000 (oldest deadline 2024-09-19T05:31:01.147350+0000) 2024-09-19T05:31:03.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:03 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:03.221+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:03.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:03 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:03.221+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:03.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:03 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:03.221+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:03.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:03 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:03.221+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:03.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:03 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:03.260+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:03.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:03 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:03.260+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:03.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:03 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:03.260+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:03.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:03 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:03.260+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:04.025 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T05:31:04.107 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:31:04.107 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T05:31:04.107 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T05:31:04.107 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.7 2024-09-19T05:31:04.155 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:03 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:03.797+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:31:04.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:03 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:03.797+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:31:04.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:03 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:03.797+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:31:04.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:03 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:03.797+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.940611+0000 front 2024-09-19T05:30:35.940730+0000 (oldest deadline 2024-09-19T05:31:01.141093+0000) 2024-09-19T05:31:04.285 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:03 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:03.976+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:31:04.285 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:03 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:03.976+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:27.925162+0000 front 2024-09-19T05:30:27.925147+0000 (oldest deadline 2024-09-19T05:30:52.625316+0000) 2024-09-19T05:31:04.285 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:03 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:03.976+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:32.625829+0000 front 2024-09-19T05:30:32.626014+0000 (oldest deadline 2024-09-19T05:30:58.525900+0000) 2024-09-19T05:31:04.286 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:04 smithi178 systemd[1]: Stopping Ceph osd.7 for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:31:04.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:04 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:04.449+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:31:04.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:04 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:04.450+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:31:04.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:04 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:04.450+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:04.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:04 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:04.450+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:37.647202+0000 front 2024-09-19T05:30:37.647230+0000 (oldest deadline 2024-09-19T05:31:01.147350+0000) 2024-09-19T05:31:04.655 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:04 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:04.231+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:04.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:04 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:04.231+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:04.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:04 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:04.231+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:04.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:04 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:04.231+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:04.692 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:04 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:04.396+0000 7f0613b46640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:31:04.692 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:04 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:04.396+0000 7f0613b46640 -1 osd.7 93 *** Got signal Terminated *** 2024-09-19T05:31:04.692 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:04 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:04.396+0000 7f0613b46640 -1 osd.7 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:31:04.693 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:04 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:04.283+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:04.693 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:04 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:04.283+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:04.693 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:04 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:04.283+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:04.693 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:04 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:04.283+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:05.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:04 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:04.749+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:31:05.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:04 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:04.749+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:31:05.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:04 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:04.749+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:31:05.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:04 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:04.749+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.940611+0000 front 2024-09-19T05:30:35.940730+0000 (oldest deadline 2024-09-19T05:31:01.141093+0000) 2024-09-19T05:31:05.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:04 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:04.990+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:31:05.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:04 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:04.990+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:27.925162+0000 front 2024-09-19T05:30:27.925147+0000 (oldest deadline 2024-09-19T05:30:52.625316+0000) 2024-09-19T05:31:05.302 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:04 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:04.990+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:32.625829+0000 front 2024-09-19T05:30:32.626014+0000 (oldest deadline 2024-09-19T05:30:58.525900+0000) 2024-09-19T05:31:05.532 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:05 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:05.209+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:05.532 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:05 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:05.209+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:05.532 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:05 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:05.209+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:05.532 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:05 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:05.209+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:05.575 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:05 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:05.300+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:05.576 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:05 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:05.300+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:05.576 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:05 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:05.300+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:05.576 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:05 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:05.300+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:05.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:05 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:05.424+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:31:05.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:05 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:05.424+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:31:05.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:05 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:05.424+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:05.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:05 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:05.424+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:37.647202+0000 front 2024-09-19T05:30:37.647230+0000 (oldest deadline 2024-09-19T05:31:01.147350+0000) 2024-09-19T05:31:05.906 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:05 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:05.766+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:31:05.906 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:05 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:05.766+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:31:05.906 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:05 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:05.766+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:31:05.906 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:05 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:05.766+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.940611+0000 front 2024-09-19T05:30:35.940730+0000 (oldest deadline 2024-09-19T05:31:01.141093+0000) 2024-09-19T05:31:06.278 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:05 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:05.959+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:31:06.279 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:05 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:05.959+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:27.925162+0000 front 2024-09-19T05:30:27.925147+0000 (oldest deadline 2024-09-19T05:30:52.625316+0000) 2024-09-19T05:31:06.279 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:05 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:05.959+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:32.625829+0000 front 2024-09-19T05:30:32.626014+0000 (oldest deadline 2024-09-19T05:30:58.525900+0000) 2024-09-19T05:31:06.545 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:06 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:06.276+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:06.545 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:06 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:06.276+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:06.545 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:06 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:06.276+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:06.545 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:06 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:06.276+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:06.657 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:06 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:06.167+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:06.657 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:06 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:06.167+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:06.657 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:06 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:06.167+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:06.657 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:06 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:06.167+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:06.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:06 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:06.471+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:31:06.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:06 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:06.471+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:31:06.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:06 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:06.471+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:06.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:06 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:06.471+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:37.647202+0000 front 2024-09-19T05:30:37.647230+0000 (oldest deadline 2024-09-19T05:31:01.147350+0000) 2024-09-19T05:31:07.155 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:06 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:06.784+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:31:07.155 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:06 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:06.784+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:31:07.155 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:06 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:06.784+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:31:07.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:06 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:06.784+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.940611+0000 front 2024-09-19T05:30:35.940730+0000 (oldest deadline 2024-09-19T05:31:01.141093+0000) 2024-09-19T05:31:07.192 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:06 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:06.932+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:31:07.192 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:06 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:06.932+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:27.925162+0000 front 2024-09-19T05:30:27.925147+0000 (oldest deadline 2024-09-19T05:30:52.625316+0000) 2024-09-19T05:31:07.193 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:06 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:06.932+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:32.625829+0000 front 2024-09-19T05:30:32.626014+0000 (oldest deadline 2024-09-19T05:30:58.525900+0000) 2024-09-19T05:31:07.193 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:06 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:06.932+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:40.826681+0000 front 2024-09-19T05:30:40.826659+0000 (oldest deadline 2024-09-19T05:31:06.726856+0000) 2024-09-19T05:31:07.406 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:07 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:07.153+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:07.406 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:07 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:07.153+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:07.406 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:07 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:07.153+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:07.406 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:07 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:07.153+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:07.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:07 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:07.257+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:07.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:07 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:07.257+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:07.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:07 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:07.257+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:07.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:07 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:07.257+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:07.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:07 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:07.427+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:31:07.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:07 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:07.427+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:31:07.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:07 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:07.427+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:07.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:07 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:07.427+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:37.647202+0000 front 2024-09-19T05:30:37.647230+0000 (oldest deadline 2024-09-19T05:31:01.147350+0000) 2024-09-19T05:31:08.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:07 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:07.775+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:31:08.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:07 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:07.775+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:31:08.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:07 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:07.775+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:31:08.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:07 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:07.775+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.940611+0000 front 2024-09-19T05:30:35.940730+0000 (oldest deadline 2024-09-19T05:31:01.141093+0000) 2024-09-19T05:31:08.225 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:07 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:07.964+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:31:08.225 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:07 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:07.964+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:27.925162+0000 front 2024-09-19T05:30:27.925147+0000 (oldest deadline 2024-09-19T05:30:52.625316+0000) 2024-09-19T05:31:08.225 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:07 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:07.964+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:32.625829+0000 front 2024-09-19T05:30:32.626014+0000 (oldest deadline 2024-09-19T05:30:58.525900+0000) 2024-09-19T05:31:08.226 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:07 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:07.964+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:40.826681+0000 front 2024-09-19T05:30:40.826659+0000 (oldest deadline 2024-09-19T05:31:06.726856+0000) 2024-09-19T05:31:08.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:08 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:08.200+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:08.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:08 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:08.200+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:08.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:08 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:08.200+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:08.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:08 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:08.200+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:08.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:08 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:08.200+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:08.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:08 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:08.223+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:08.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:08 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:08.223+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:08.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:08 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:08.223+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:08.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:08 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:08.223+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:08.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:08 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:08.430+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:31:08.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:08 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:08.430+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:31:08.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:08 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:08.430+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:08.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:08 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:08.430+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:37.647202+0000 front 2024-09-19T05:30:37.647230+0000 (oldest deadline 2024-09-19T05:31:01.147350+0000) 2024-09-19T05:31:08.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:08 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:08.430+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.648341+0000 front 2024-09-19T05:30:44.648492+0000 (oldest deadline 2024-09-19T05:31:08.148308+0000) 2024-09-19T05:31:09.155 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:08 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:08.783+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:31:09.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:08 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:08.783+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:31:09.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:08 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:08.783+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:31:09.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:08 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:08.783+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.940611+0000 front 2024-09-19T05:30:35.940730+0000 (oldest deadline 2024-09-19T05:31:01.141093+0000) 2024-09-19T05:31:09.253 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:09 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:09.000+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:17.622491+0000 front 2024-09-19T05:30:17.622339+0000 (oldest deadline 2024-09-19T05:30:42.823290+0000) 2024-09-19T05:31:09.253 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:09 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:09.000+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:27.925162+0000 front 2024-09-19T05:30:27.925147+0000 (oldest deadline 2024-09-19T05:30:52.625316+0000) 2024-09-19T05:31:09.253 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:09 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:09.000+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:32.625829+0000 front 2024-09-19T05:30:32.626014+0000 (oldest deadline 2024-09-19T05:30:58.525900+0000) 2024-09-19T05:31:09.253 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:09 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7[52250]: 2024-09-19T05:31:09.000+0000 7f061014b640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:40.826681+0000 front 2024-09-19T05:30:40.826659+0000 (oldest deadline 2024-09-19T05:31:06.726856+0000) 2024-09-19T05:31:09.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:09 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:09.235+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:09.848 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:09 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:09.235+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:09.848 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:09 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:09.235+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:09.848 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:09 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:09.235+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:09.849 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:09 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:09.235+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:09.849 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:09 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:09.251+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:09.849 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:09 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:09.251+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:09.849 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:09 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:09.251+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:09.850 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:09 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:09.251+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:09.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:09 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:09.428+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:31:09.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:09 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:09.428+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:31:09.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:09 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:09.428+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:09.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:09 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:09.428+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:37.647202+0000 front 2024-09-19T05:30:37.647230+0000 (oldest deadline 2024-09-19T05:31:01.147350+0000) 2024-09-19T05:31:09.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:09 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:09.428+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.648341+0000 front 2024-09-19T05:30:44.648492+0000 (oldest deadline 2024-09-19T05:31:08.148308+0000) 2024-09-19T05:31:10.108 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:09 smithi178 podman[70712]: 2024-09-19 05:31:09.826548526 +0000 UTC m=+5.526993938 container died 70f8373f693f9e2d0589b844dcdb28c7f9f5b850b4206b991d48b0e648f40825 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T05:31:10.155 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:09 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:09.806+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:31:10.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:09 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:09.806+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:31:10.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:09 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:09.806+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:31:10.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:09 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:09.806+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.940611+0000 front 2024-09-19T05:30:35.940730+0000 (oldest deadline 2024-09-19T05:31:01.141093+0000) 2024-09-19T05:31:10.442 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:10 smithi178 podman[70712]: 2024-09-19 05:31:10.206204034 +0000 UTC m=+5.906649444 container cleanup 70f8373f693f9e2d0589b844dcdb28c7f9f5b850b4206b991d48b0e648f40825 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731) 2024-09-19T05:31:10.442 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:10 smithi178 bash[70712]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7 2024-09-19T05:31:10.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:10 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:10.218+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:10.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:10 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:10.218+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:10.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:10 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:10.218+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:10.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:10 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:10.218+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:10.655 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:10 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:10.264+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:10.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:10 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:10.264+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:10.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:10 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:10.264+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:10.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:10 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:10.264+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:10.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:10 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:10.264+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:10.751 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:10 smithi178 podman[70739]: 2024-09-19 05:31:10.44085038 +0000 UTC m=+0.603750844 container remove 70f8373f693f9e2d0589b844dcdb28c7f9f5b850b4206b991d48b0e648f40825 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T05:31:10.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:10 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:10.460+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:31:10.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:10 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:10.460+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:31:10.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:10 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:10.460+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:10.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:10 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:10.460+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:37.647202+0000 front 2024-09-19T05:30:37.647230+0000 (oldest deadline 2024-09-19T05:31:01.147350+0000) 2024-09-19T05:31:10.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:10 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:10.460+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.648341+0000 front 2024-09-19T05:30:44.648492+0000 (oldest deadline 2024-09-19T05:31:08.148308+0000) 2024-09-19T05:31:11.062 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:10 smithi178 podman[70831]: 2024-09-19 05:31:10.750110856 +0000 UTC m=+0.112516895 container create b017acccb9f38ed919fe9f6c866a0b98699f0779fa22358ab13842e38705992c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T05:31:11.062 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:10 smithi178 podman[70831]: 2024-09-19 05:31:10.653545915 +0000 UTC m=+0.015951964 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:31:11.062 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:10 smithi178 podman[70831]: 2024-09-19 05:31:10.986465023 +0000 UTC m=+0.348871079 container init b017acccb9f38ed919fe9f6c866a0b98699f0779fa22358ab13842e38705992c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T05:31:11.062 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:10 smithi178 podman[70831]: 2024-09-19 05:31:10.990185081 +0000 UTC m=+0.352591127 container start b017acccb9f38ed919fe9f6c866a0b98699f0779fa22358ab13842e38705992c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True) 2024-09-19T05:31:11.062 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:11 smithi178 podman[70831]: 2024-09-19 05:31:11.060981758 +0000 UTC m=+0.423387812 container attach b017acccb9f38ed919fe9f6c866a0b98699f0779fa22358ab13842e38705992c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7-deactivate, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:31:11.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:10 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:10.791+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:31:11.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:10 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:10.791+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:31:11.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:10 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:10.791+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:31:11.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:10 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:10.791+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.940611+0000 front 2024-09-19T05:30:35.940730+0000 (oldest deadline 2024-09-19T05:31:01.141093+0000) 2024-09-19T05:31:11.442 INFO:journalctl@ceph.osd.7.smithi178.stdout:Sep 19 05:31:11 smithi178 podman[70831]: 2024-09-19 05:31:11.182993612 +0000 UTC m=+0.545399657 container died b017acccb9f38ed919fe9f6c866a0b98699f0779fa22358ab13842e38705992c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:31:11.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:11 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:11.200+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:11.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:11 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:11.200+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:11.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:11 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:11.200+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:11.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:11 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:11.200+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:11.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:11 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:11.200+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.420621+0000 front 2024-09-19T05:30:44.420662+0000 (oldest deadline 2024-09-19T05:31:10.320786+0000) 2024-09-19T05:31:11.655 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:11 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:11.314+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:11.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:11 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:11.314+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:11.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:11 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:11.314+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:11.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:11 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:11.314+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:11.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:11 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:11.314+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:11.810 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T05:31:11.848 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:31:11.848 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T05:31:11.849 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T05:31:11.849 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.8 2024-09-19T05:31:11.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:11 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:11.494+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:31:11.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:11 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:11.494+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:31:11.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:11 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:11.494+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:11.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:11 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:11.494+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:37.647202+0000 front 2024-09-19T05:30:37.647230+0000 (oldest deadline 2024-09-19T05:31:01.147350+0000) 2024-09-19T05:31:11.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:11 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:11.494+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.648341+0000 front 2024-09-19T05:30:44.648492+0000 (oldest deadline 2024-09-19T05:31:08.148308+0000) 2024-09-19T05:31:12.157 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:11 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:11.820+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:31:12.157 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:11 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:11.820+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:31:12.157 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:11 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:11.820+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:31:12.157 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:11 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:11.820+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.940611+0000 front 2024-09-19T05:30:35.940730+0000 (oldest deadline 2024-09-19T05:31:01.141093+0000) 2024-09-19T05:31:12.157 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:11 smithi194 systemd[1]: Stopping Ceph osd.8 for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:31:12.656 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:12 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:12.174+0000 7fb85479d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:31:12.656 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:12 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:12.175+0000 7fb85479d640 -1 osd.8 93 *** Got signal Terminated *** 2024-09-19T05:31:12.656 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:12 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:12.175+0000 7fb85479d640 -1 osd.8 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:31:12.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:12 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:12.270+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:12.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:12 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:12.270+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:12.657 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:12 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:12.270+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:12.657 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:12 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:12.270+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:12.657 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:12 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:12.270+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:12.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:12 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:12.211+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:12.692 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:12 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:12.211+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:12.693 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:12 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:12.211+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:12.693 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:12 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:12.211+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:12.693 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:12 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:12.211+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.420621+0000 front 2024-09-19T05:30:44.420662+0000 (oldest deadline 2024-09-19T05:31:10.320786+0000) 2024-09-19T05:31:12.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:12 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:12.454+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:31:12.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:12 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:12.454+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:31:12.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:12 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:12.454+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:12.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:12 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:12.454+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:37.647202+0000 front 2024-09-19T05:30:37.647230+0000 (oldest deadline 2024-09-19T05:31:01.147350+0000) 2024-09-19T05:31:12.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:12 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:12.454+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.648341+0000 front 2024-09-19T05:30:44.648492+0000 (oldest deadline 2024-09-19T05:31:08.148308+0000) 2024-09-19T05:31:13.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:12 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:12.836+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:31:13.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:12 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:12.836+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:31:13.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:12 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:12.836+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:31:13.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:12 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:12.836+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.940611+0000 front 2024-09-19T05:30:35.940730+0000 (oldest deadline 2024-09-19T05:31:01.141093+0000) 2024-09-19T05:31:13.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:13 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:13.182+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:13.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:13 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:13.182+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:13.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:13 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:13.182+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:13.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:13 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:13.182+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:13.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:13 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:13.182+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.420621+0000 front 2024-09-19T05:30:44.420662+0000 (oldest deadline 2024-09-19T05:31:10.320786+0000) 2024-09-19T05:31:13.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:13 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:13.313+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:13.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:13 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:13.313+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:13.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:13 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:13.313+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:13.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:13 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:13.313+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:13.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:13 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:13.313+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:13.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:13 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:13.424+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:31:13.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:13 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:13.424+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:31:13.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:13 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:13.424+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:13.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:13 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:13.424+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:37.647202+0000 front 2024-09-19T05:30:37.647230+0000 (oldest deadline 2024-09-19T05:31:01.147350+0000) 2024-09-19T05:31:13.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:13 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:13.424+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.648341+0000 front 2024-09-19T05:30:44.648492+0000 (oldest deadline 2024-09-19T05:31:08.148308+0000) 2024-09-19T05:31:14.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:13 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:13.853+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:31:14.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:13 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:13.853+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:31:14.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:13 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:13.853+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:31:14.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:13 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:13.853+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.940611+0000 front 2024-09-19T05:30:35.940730+0000 (oldest deadline 2024-09-19T05:31:01.141093+0000) 2024-09-19T05:31:14.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:14 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:14.136+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:14.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:14 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:14.136+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:14.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:14 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:14.136+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:14.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:14 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:14.136+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:14.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:14 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:14.136+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.420621+0000 front 2024-09-19T05:30:44.420662+0000 (oldest deadline 2024-09-19T05:31:10.320786+0000) 2024-09-19T05:31:14.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:14 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:14.359+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:14.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:14 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:14.359+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:14.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:14 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:14.359+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:14.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:14 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:14.359+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:14.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:14 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:14.359+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:14.745 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:14 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:14.375+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:31:14.745 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:14 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:14.375+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:31:14.745 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:14 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:14.375+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:14.746 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:14 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:14.375+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:37.647202+0000 front 2024-09-19T05:30:37.647230+0000 (oldest deadline 2024-09-19T05:31:01.147350+0000) 2024-09-19T05:31:14.746 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:14 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:14.375+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.648341+0000 front 2024-09-19T05:30:44.648492+0000 (oldest deadline 2024-09-19T05:31:08.148308+0000) 2024-09-19T05:31:15.155 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:14 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:14.834+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:31:15.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:14 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:14.834+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:31:15.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:14 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:14.834+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:31:15.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:14 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:14.834+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.940611+0000 front 2024-09-19T05:30:35.940730+0000 (oldest deadline 2024-09-19T05:31:01.141093+0000) 2024-09-19T05:31:15.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:15 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:15.171+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:15.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:15 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:15.171+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:15.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:15 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:15.171+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:15.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:15 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:15.171+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:15.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:15 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:15.171+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.420621+0000 front 2024-09-19T05:30:44.420662+0000 (oldest deadline 2024-09-19T05:31:10.320786+0000) 2024-09-19T05:31:15.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:15 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:15.171+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:50.321528+0000 front 2024-09-19T05:30:50.321503+0000 (oldest deadline 2024-09-19T05:31:14.421421+0000) 2024-09-19T05:31:15.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:15 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:15.390+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:31:15.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:15 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:15.390+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:31:15.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:15 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:15.390+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:15.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:15 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:15.390+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:37.647202+0000 front 2024-09-19T05:30:37.647230+0000 (oldest deadline 2024-09-19T05:31:01.147350+0000) 2024-09-19T05:31:15.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:15 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:15.390+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.648341+0000 front 2024-09-19T05:30:44.648492+0000 (oldest deadline 2024-09-19T05:31:08.148308+0000) 2024-09-19T05:31:15.655 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:15 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:15.403+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:15.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:15 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:15.403+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:15.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:15 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:15.403+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:15.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:15 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:15.403+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:15.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:15 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:15.403+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:16.155 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:15 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:15.836+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:31:16.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:15 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:15.836+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:31:16.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:15 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:15.836+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:31:16.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:15 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:15.836+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.940611+0000 front 2024-09-19T05:30:35.940730+0000 (oldest deadline 2024-09-19T05:31:01.141093+0000) 2024-09-19T05:31:16.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:15 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:15.836+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:50.843827+0000 front 2024-09-19T05:30:50.843878+0000 (oldest deadline 2024-09-19T05:31:15.543917+0000) 2024-09-19T05:31:16.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:16 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:16.147+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:16.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:16 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:16.147+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:16.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:16 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:16.147+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:16.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:16 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:16.147+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:16.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:16 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:16.147+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.420621+0000 front 2024-09-19T05:30:44.420662+0000 (oldest deadline 2024-09-19T05:31:10.320786+0000) 2024-09-19T05:31:16.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:16 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:16.147+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:50.321528+0000 front 2024-09-19T05:30:50.321503+0000 (oldest deadline 2024-09-19T05:31:14.421421+0000) 2024-09-19T05:31:16.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:16 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:16.366+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:31:16.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:16 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:16.366+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:31:16.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:16 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:16.366+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:16.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:16 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:16.366+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:37.647202+0000 front 2024-09-19T05:30:37.647230+0000 (oldest deadline 2024-09-19T05:31:01.147350+0000) 2024-09-19T05:31:16.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:16 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:16.366+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.648341+0000 front 2024-09-19T05:30:44.648492+0000 (oldest deadline 2024-09-19T05:31:08.148308+0000) 2024-09-19T05:31:16.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:16 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:16.377+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:16.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:16 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:16.377+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:16.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:16 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:16.377+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:16.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:16 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:16.377+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:16.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:16 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:16.377+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:17.155 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:16 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:16.846+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:11.636660+0000 front 2024-09-19T05:30:11.636711+0000 (oldest deadline 2024-09-19T05:30:35.736534+0000) 2024-09-19T05:31:17.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:16 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:16.846+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:18.637848+0000 front 2024-09-19T05:30:18.637865+0000 (oldest deadline 2024-09-19T05:30:43.337655+0000) 2024-09-19T05:31:17.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:16 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:16.846+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:25.539042+0000 front 2024-09-19T05:30:25.538853+0000 (oldest deadline 2024-09-19T05:30:50.838994+0000) 2024-09-19T05:31:17.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:16 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:16.846+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.940611+0000 front 2024-09-19T05:30:35.940730+0000 (oldest deadline 2024-09-19T05:31:01.141093+0000) 2024-09-19T05:31:17.156 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:16 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8[53632]: 2024-09-19T05:31:16.846+0000 7fb84cd9a640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:50.843827+0000 front 2024-09-19T05:30:50.843878+0000 (oldest deadline 2024-09-19T05:31:15.543917+0000) 2024-09-19T05:31:17.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:17 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:17.157+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:17.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:17 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:17.157+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:17.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:17 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:17.157+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:17.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:17 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:17.157+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:17.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:17 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:17.157+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.420621+0000 front 2024-09-19T05:30:44.420662+0000 (oldest deadline 2024-09-19T05:31:10.320786+0000) 2024-09-19T05:31:17.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:17 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:17.157+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:50.321528+0000 front 2024-09-19T05:30:50.321503+0000 (oldest deadline 2024-09-19T05:31:14.421421+0000) 2024-09-19T05:31:17.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:17 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:17.323+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:31:17.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:17 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:17.323+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:31:17.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:17 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:17.323+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:17.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:17 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:17.323+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:37.647202+0000 front 2024-09-19T05:30:37.647230+0000 (oldest deadline 2024-09-19T05:31:01.147350+0000) 2024-09-19T05:31:17.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:17 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:17.323+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.648341+0000 front 2024-09-19T05:30:44.648492+0000 (oldest deadline 2024-09-19T05:31:08.148308+0000) 2024-09-19T05:31:17.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:17 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:17.323+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.049456+0000 front 2024-09-19T05:30:51.049411+0000 (oldest deadline 2024-09-19T05:31:16.949256+0000) 2024-09-19T05:31:17.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:17 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:17.369+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:17.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:17 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:17.369+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:17.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:17 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:17.369+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:17.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:17 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:17.369+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:17.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:17 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:17.369+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:17.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:17 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:17.369+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.959701+0000 front 2024-09-19T05:30:51.959620+0000 (oldest deadline 2024-09-19T05:31:16.560138+0000) 2024-09-19T05:31:18.051 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:17 smithi194 podman[71917]: 2024-09-19 05:31:17.727269919 +0000 UTC m=+5.687585684 container died ab66dd758acbeab0bf5aa88197b50a7ea7ee91def8ffdfc3f0e32d44eb2dc36e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T05:31:18.051 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:18 smithi194 podman[71917]: 2024-09-19 05:31:18.050099906 +0000 UTC m=+6.010415663 container cleanup ab66dd758acbeab0bf5aa88197b50a7ea7ee91def8ffdfc3f0e32d44eb2dc36e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:31:18.350 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:18 smithi194 bash[71917]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8 2024-09-19T05:31:18.351 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:18 smithi194 podman[71934]: 2024-09-19 05:31:18.242998333 +0000 UTC m=+0.517394506 container remove ab66dd758acbeab0bf5aa88197b50a7ea7ee91def8ffdfc3f0e32d44eb2dc36e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:31:18.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:18 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:18.129+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:18.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:18 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:18.129+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:18.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:18 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:18.129+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:18.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:18 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:18.129+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:18.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:18 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:18.129+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.420621+0000 front 2024-09-19T05:30:44.420662+0000 (oldest deadline 2024-09-19T05:31:10.320786+0000) 2024-09-19T05:31:18.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:18 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:18.129+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:50.321528+0000 front 2024-09-19T05:30:50.321503+0000 (oldest deadline 2024-09-19T05:31:14.421421+0000) 2024-09-19T05:31:18.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:18 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:18.329+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:31:18.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:18 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:18.329+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:31:18.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:18 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:18.329+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:18.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:18 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:18.329+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:37.647202+0000 front 2024-09-19T05:30:37.647230+0000 (oldest deadline 2024-09-19T05:31:01.147350+0000) 2024-09-19T05:31:18.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:18 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:18.329+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.648341+0000 front 2024-09-19T05:30:44.648492+0000 (oldest deadline 2024-09-19T05:31:08.148308+0000) 2024-09-19T05:31:18.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:18 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:18.329+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.049456+0000 front 2024-09-19T05:30:51.049411+0000 (oldest deadline 2024-09-19T05:31:16.949256+0000) 2024-09-19T05:31:18.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:18 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:18.348+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:18.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:18 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:18.348+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:18.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:18 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:18.348+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:18.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:18 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:18.348+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:18.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:18 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:18.348+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:18.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:18 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:18.348+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.959701+0000 front 2024-09-19T05:30:51.959620+0000 (oldest deadline 2024-09-19T05:31:16.560138+0000) 2024-09-19T05:31:18.931 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:18 smithi194 podman[72025]: 2024-09-19 05:31:18.568612223 +0000 UTC m=+0.015815527 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:31:18.931 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:18 smithi194 podman[72025]: 2024-09-19 05:31:18.685626307 +0000 UTC m=+0.132829647 container create bd48d347a4a22262ee0c21186a57c2dba5c4548e01b3ac7fa3b7132ddf6c0fc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731) 2024-09-19T05:31:19.336 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:18 smithi194 podman[72025]: 2024-09-19 05:31:18.930094343 +0000 UTC m=+0.377297640 container init bd48d347a4a22262ee0c21186a57c2dba5c4548e01b3ac7fa3b7132ddf6c0fc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T05:31:19.336 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:18 smithi194 podman[72025]: 2024-09-19 05:31:18.933739744 +0000 UTC m=+0.380943048 container start bd48d347a4a22262ee0c21186a57c2dba5c4548e01b3ac7fa3b7132ddf6c0fc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T05:31:19.336 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:19 smithi194 podman[72025]: 2024-09-19 05:31:19.012807469 +0000 UTC m=+0.460010771 container attach bd48d347a4a22262ee0c21186a57c2dba5c4548e01b3ac7fa3b7132ddf6c0fc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T05:31:19.336 INFO:journalctl@ceph.osd.8.smithi194.stdout:Sep 19 05:31:19 smithi194 podman[72025]: 2024-09-19 05:31:19.122444968 +0000 UTC m=+0.569648273 container died bd48d347a4a22262ee0c21186a57c2dba5c4548e01b3ac7fa3b7132ddf6c0fc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-8-deactivate, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T05:31:19.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:19 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:19.110+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:19.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:19 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:19.110+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:19.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:19 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:19.110+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:19.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:19 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:19.110+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:19.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:19 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:19.110+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.420621+0000 front 2024-09-19T05:30:44.420662+0000 (oldest deadline 2024-09-19T05:31:10.320786+0000) 2024-09-19T05:31:19.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:19 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:19.110+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:50.321528+0000 front 2024-09-19T05:30:50.321503+0000 (oldest deadline 2024-09-19T05:31:14.421421+0000) 2024-09-19T05:31:19.613 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:19 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:19.334+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:19.613 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:19 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:19.334+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:19.613 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:19 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:19.334+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:19.613 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:19 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:19.334+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:19.614 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:19 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:19.334+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:19.614 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:19 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:19.334+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.959701+0000 front 2024-09-19T05:30:51.959620+0000 (oldest deadline 2024-09-19T05:31:16.560138+0000) 2024-09-19T05:31:19.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:19 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:19.355+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:31:19.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:19 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:19.355+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:31:19.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:19 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:19.355+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:19.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:19 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:19.355+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:37.647202+0000 front 2024-09-19T05:30:37.647230+0000 (oldest deadline 2024-09-19T05:31:01.147350+0000) 2024-09-19T05:31:19.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:19 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:19.355+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.648341+0000 front 2024-09-19T05:30:44.648492+0000 (oldest deadline 2024-09-19T05:31:08.148308+0000) 2024-09-19T05:31:19.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:19 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:19.355+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.049456+0000 front 2024-09-19T05:30:51.049411+0000 (oldest deadline 2024-09-19T05:31:16.949256+0000) 2024-09-19T05:31:19.746 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T05:31:19.784 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:31:19.785 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T05:31:19.785 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T05:31:19.785 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.9 2024-09-19T05:31:20.090 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:19 smithi120 systemd[1]: Stopping Ceph osd.9 for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:31:20.371 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:20 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:20.088+0000 7efc068ea640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:31:20.371 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:20 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:20.088+0000 7efc068ea640 -1 osd.9 93 *** Got signal Terminated *** 2024-09-19T05:31:20.371 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:20 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:20.088+0000 7efc068ea640 -1 osd.9 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:31:20.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:20 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:20.066+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:20.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:20 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:20.066+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:20.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:20 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:20.066+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:20.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:20 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:20.066+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:20.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:20 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:20.066+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.420621+0000 front 2024-09-19T05:30:44.420662+0000 (oldest deadline 2024-09-19T05:31:10.320786+0000) 2024-09-19T05:31:20.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:20 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:20.066+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:50.321528+0000 front 2024-09-19T05:30:50.321503+0000 (oldest deadline 2024-09-19T05:31:14.421421+0000) 2024-09-19T05:31:20.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:20 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:20.368+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:31:20.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:20 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:20.368+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:31:20.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:20 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:20.368+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:20.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:20 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:20.368+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:37.647202+0000 front 2024-09-19T05:30:37.647230+0000 (oldest deadline 2024-09-19T05:31:01.147350+0000) 2024-09-19T05:31:20.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:20 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:20.368+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.648341+0000 front 2024-09-19T05:30:44.648492+0000 (oldest deadline 2024-09-19T05:31:08.148308+0000) 2024-09-19T05:31:20.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:20 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:20.368+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.049456+0000 front 2024-09-19T05:30:51.049411+0000 (oldest deadline 2024-09-19T05:31:16.949256+0000) 2024-09-19T05:31:20.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:20 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:20.331+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:20.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:20 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:20.331+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:20.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:20 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:20.331+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:20.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:20 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:20.331+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:20.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:20 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:20.331+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:20.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:20 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:20.331+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.959701+0000 front 2024-09-19T05:30:51.959620+0000 (oldest deadline 2024-09-19T05:31:16.560138+0000) 2024-09-19T05:31:21.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:21 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:21.082+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:21.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:21 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:21.082+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:21.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:21 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:21.082+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:21.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:21 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:21.082+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:21.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:21 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:21.082+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.420621+0000 front 2024-09-19T05:30:44.420662+0000 (oldest deadline 2024-09-19T05:31:10.320786+0000) 2024-09-19T05:31:21.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:21 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:21.082+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:50.321528+0000 front 2024-09-19T05:30:50.321503+0000 (oldest deadline 2024-09-19T05:31:14.421421+0000) 2024-09-19T05:31:21.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:21 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:21.356+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:31:21.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:21 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:21.356+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:31:21.625 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:21 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:21.356+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:21.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:21 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:21.356+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:37.647202+0000 front 2024-09-19T05:30:37.647230+0000 (oldest deadline 2024-09-19T05:31:01.147350+0000) 2024-09-19T05:31:21.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:21 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:21.356+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.648341+0000 front 2024-09-19T05:30:44.648492+0000 (oldest deadline 2024-09-19T05:31:08.148308+0000) 2024-09-19T05:31:21.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:21 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:21.356+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.049456+0000 front 2024-09-19T05:30:51.049411+0000 (oldest deadline 2024-09-19T05:31:16.949256+0000) 2024-09-19T05:31:21.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:21 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:21.365+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:21.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:21 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:21.365+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:21.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:21 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:21.365+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:21.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:21 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:21.365+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:21.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:21 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:21.365+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:21.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:21 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:21.365+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.959701+0000 front 2024-09-19T05:30:51.959620+0000 (oldest deadline 2024-09-19T05:31:16.560138+0000) 2024-09-19T05:31:22.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:22 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:22.076+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:22.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:22 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:22.076+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:22.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:22 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:22.076+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:22.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:22 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:22.076+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:22.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:22 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:22.076+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.420621+0000 front 2024-09-19T05:30:44.420662+0000 (oldest deadline 2024-09-19T05:31:10.320786+0000) 2024-09-19T05:31:22.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:22 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:22.076+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:50.321528+0000 front 2024-09-19T05:30:50.321503+0000 (oldest deadline 2024-09-19T05:31:14.421421+0000) 2024-09-19T05:31:22.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:22 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:22.368+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:31:22.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:22 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:22.368+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:31:22.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:22 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:22.368+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:22.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:22 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:22.368+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:37.647202+0000 front 2024-09-19T05:30:37.647230+0000 (oldest deadline 2024-09-19T05:31:01.147350+0000) 2024-09-19T05:31:22.626 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:22 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:22.368+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.648341+0000 front 2024-09-19T05:30:44.648492+0000 (oldest deadline 2024-09-19T05:31:08.148308+0000) 2024-09-19T05:31:22.627 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:22 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:22.368+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.049456+0000 front 2024-09-19T05:30:51.049411+0000 (oldest deadline 2024-09-19T05:31:16.949256+0000) 2024-09-19T05:31:22.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:22 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:22.391+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:22.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:22 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:22.391+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:22.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:22 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:22.391+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:22.657 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:22 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:22.391+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:22.657 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:22 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:22.391+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:22.657 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:22 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:22.391+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.959701+0000 front 2024-09-19T05:30:51.959620+0000 (oldest deadline 2024-09-19T05:31:16.560138+0000) 2024-09-19T05:31:23.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:23 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:23.044+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:23.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:23 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:23.044+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:23.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:23 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:23.044+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:23.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:23 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:23.044+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:23.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:23 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:23.044+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.420621+0000 front 2024-09-19T05:30:44.420662+0000 (oldest deadline 2024-09-19T05:31:10.320786+0000) 2024-09-19T05:31:23.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:23 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:23.044+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:50.321528+0000 front 2024-09-19T05:30:50.321503+0000 (oldest deadline 2024-09-19T05:31:14.421421+0000) 2024-09-19T05:31:23.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:23 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:23.044+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-09-19T05:30:57.922548+0000 front 2024-09-19T05:30:57.922601+0000 (oldest deadline 2024-09-19T05:31:22.622441+0000) 2024-09-19T05:31:23.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:23 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:23.396+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:23.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:23 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:23.396+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:23.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:23 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:23.396+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:23.657 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:23 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:23.396+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:23.657 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:23 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:23.396+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:23.657 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:23 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:23.396+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.959701+0000 front 2024-09-19T05:30:51.959620+0000 (oldest deadline 2024-09-19T05:31:16.560138+0000) 2024-09-19T05:31:23.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:23 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:23.402+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:31:23.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:23 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:23.402+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:31:23.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:23 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:23.402+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:23.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:23 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:23.402+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:37.647202+0000 front 2024-09-19T05:30:37.647230+0000 (oldest deadline 2024-09-19T05:31:01.147350+0000) 2024-09-19T05:31:23.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:23 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:23.402+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.648341+0000 front 2024-09-19T05:30:44.648492+0000 (oldest deadline 2024-09-19T05:31:08.148308+0000) 2024-09-19T05:31:23.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:23 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:23.402+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.049456+0000 front 2024-09-19T05:30:51.049411+0000 (oldest deadline 2024-09-19T05:31:16.949256+0000) 2024-09-19T05:31:24.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:24 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:24.010+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:24.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:24 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:24.010+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:24.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:24 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:24.010+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:24.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:24 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:24.010+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:24.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:24 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:24.010+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.420621+0000 front 2024-09-19T05:30:44.420662+0000 (oldest deadline 2024-09-19T05:31:10.320786+0000) 2024-09-19T05:31:24.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:24 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:24.010+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:50.321528+0000 front 2024-09-19T05:30:50.321503+0000 (oldest deadline 2024-09-19T05:31:14.421421+0000) 2024-09-19T05:31:24.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:24 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:24.010+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-09-19T05:30:57.922548+0000 front 2024-09-19T05:30:57.922601+0000 (oldest deadline 2024-09-19T05:31:22.622441+0000) 2024-09-19T05:31:24.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:24 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:24.372+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:24.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:24 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:24.372+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:24.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:24 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:24.372+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:24.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:24 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:24.372+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:24.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:24 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:24.372+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:24.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:24 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:24.372+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.959701+0000 front 2024-09-19T05:30:51.959620+0000 (oldest deadline 2024-09-19T05:31:16.560138+0000) 2024-09-19T05:31:24.875 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:24 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:24.428+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.343057+0000 front 2024-09-19T05:30:13.342999+0000 (oldest deadline 2024-09-19T05:30:35.043119+0000) 2024-09-19T05:31:24.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:24 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:24.428+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:19.144307+0000 front 2024-09-19T05:30:19.144073+0000 (oldest deadline 2024-09-19T05:30:45.043915+0000) 2024-09-19T05:31:24.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:24 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:24.428+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:28.445378+0000 front 2024-09-19T05:30:28.445582+0000 (oldest deadline 2024-09-19T05:30:53.745370+0000) 2024-09-19T05:31:24.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:24 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:24.428+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:37.647202+0000 front 2024-09-19T05:30:37.647230+0000 (oldest deadline 2024-09-19T05:31:01.147350+0000) 2024-09-19T05:31:24.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:24 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:24.428+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.648341+0000 front 2024-09-19T05:30:44.648492+0000 (oldest deadline 2024-09-19T05:31:08.148308+0000) 2024-09-19T05:31:24.876 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:24 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9[64687]: 2024-09-19T05:31:24.428+0000 7efbfeee7640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.049456+0000 front 2024-09-19T05:30:51.049411+0000 (oldest deadline 2024-09-19T05:31:16.949256+0000) 2024-09-19T05:31:25.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:25 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:25.027+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:25.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:25 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:25.027+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:25.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:25 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:25.027+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:25.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:25 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:25.027+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:25.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:25 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:25.027+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.420621+0000 front 2024-09-19T05:30:44.420662+0000 (oldest deadline 2024-09-19T05:31:10.320786+0000) 2024-09-19T05:31:25.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:25 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:25.027+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:50.321528+0000 front 2024-09-19T05:30:50.321503+0000 (oldest deadline 2024-09-19T05:31:14.421421+0000) 2024-09-19T05:31:25.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:25 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:25.027+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-09-19T05:30:57.922548+0000 front 2024-09-19T05:30:57.922601+0000 (oldest deadline 2024-09-19T05:31:22.622441+0000) 2024-09-19T05:31:25.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:25 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:25.338+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:25.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:25 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:25.338+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:25.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:25 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:25.338+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:25.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:25 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:25.338+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:25.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:25 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:25.338+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:25.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:25 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:25.338+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.959701+0000 front 2024-09-19T05:30:51.959620+0000 (oldest deadline 2024-09-19T05:31:16.560138+0000) 2024-09-19T05:31:25.903 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:25 smithi120 podman[197461]: 2024-09-19 05:31:25.635487362 +0000 UTC m=+5.655723526 container died 3136ecb318b9228e4a9ff7cafead90a0fdacc24432eff29e0f24b566c2eef9c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T05:31:26.237 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:25 smithi120 podman[197461]: 2024-09-19 05:31:25.984945345 +0000 UTC m=+6.005181501 container cleanup 3136ecb318b9228e4a9ff7cafead90a0fdacc24432eff29e0f24b566c2eef9c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-19T05:31:26.237 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:25 smithi120 bash[197461]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9 2024-09-19T05:31:26.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:26 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:26.001+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:26.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:26 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:26.001+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:26.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:26 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:26.001+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:26.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:26 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:26.001+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:26.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:26 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:26.001+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.420621+0000 front 2024-09-19T05:30:44.420662+0000 (oldest deadline 2024-09-19T05:31:10.320786+0000) 2024-09-19T05:31:26.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:26 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:26.001+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:50.321528+0000 front 2024-09-19T05:30:50.321503+0000 (oldest deadline 2024-09-19T05:31:14.421421+0000) 2024-09-19T05:31:26.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:26 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:26.001+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-09-19T05:30:57.922548+0000 front 2024-09-19T05:30:57.922601+0000 (oldest deadline 2024-09-19T05:31:22.622441+0000) 2024-09-19T05:31:26.554 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:26 smithi120 podman[197478]: 2024-09-19 05:31:26.235986833 +0000 UTC m=+0.596051360 container remove 3136ecb318b9228e4a9ff7cafead90a0fdacc24432eff29e0f24b566c2eef9c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:31:26.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:26 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:26.298+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:26.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:26 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:26.298+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:26.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:26 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:26.298+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:26.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:26 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:26.298+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:26.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:26 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:26.298+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:26.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:26 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:26.298+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.959701+0000 front 2024-09-19T05:30:51.959620+0000 (oldest deadline 2024-09-19T05:31:16.560138+0000) 2024-09-19T05:31:26.832 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:26 smithi120 podman[197569]: 2024-09-19 05:31:26.456069271 +0000 UTC m=+0.015740107 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:31:26.832 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:26 smithi120 podman[197569]: 2024-09-19 05:31:26.56181195 +0000 UTC m=+0.121482777 container create 83f10ffeb856ab3629500e42b2e0675a0689d1319b171edccdbf10e1585784ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2) 2024-09-19T05:31:26.832 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:26 smithi120 podman[197569]: 2024-09-19 05:31:26.756144914 +0000 UTC m=+0.315815748 container init 83f10ffeb856ab3629500e42b2e0675a0689d1319b171edccdbf10e1585784ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-19T05:31:26.833 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:26 smithi120 podman[197569]: 2024-09-19 05:31:26.759584874 +0000 UTC m=+0.319255701 container start 83f10ffeb856ab3629500e42b2e0675a0689d1319b171edccdbf10e1585784ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T05:31:26.833 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:26 smithi120 podman[197569]: 2024-09-19 05:31:26.830882513 +0000 UTC m=+0.390553349 container attach 83f10ffeb856ab3629500e42b2e0675a0689d1319b171edccdbf10e1585784ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T05:31:27.125 INFO:journalctl@ceph.osd.9.smithi120.stdout:Sep 19 05:31:26 smithi120 podman[197569]: 2024-09-19 05:31:26.950952036 +0000 UTC m=+0.510622872 container died 83f10ffeb856ab3629500e42b2e0675a0689d1319b171edccdbf10e1585784ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:31:27.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:27 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:27.041+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:27.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:27 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:27.041+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:27.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:27 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:27.041+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:27.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:27 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:27.041+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:27.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:27 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:27.041+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.420621+0000 front 2024-09-19T05:30:44.420662+0000 (oldest deadline 2024-09-19T05:31:10.320786+0000) 2024-09-19T05:31:27.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:27 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:27.041+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:50.321528+0000 front 2024-09-19T05:30:50.321503+0000 (oldest deadline 2024-09-19T05:31:14.421421+0000) 2024-09-19T05:31:27.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:27 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:27.041+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-09-19T05:30:57.922548+0000 front 2024-09-19T05:30:57.922601+0000 (oldest deadline 2024-09-19T05:31:22.622441+0000) 2024-09-19T05:31:27.511 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T05:31:27.550 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:31:27.551 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T05:31:27.551 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T05:31:27.551 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.10 2024-09-19T05:31:27.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:27 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:27.283+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:27.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:27 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:27.283+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:27.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:27 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:27.283+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:27.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:27 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:27.283+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:27.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:27 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:27.283+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:27.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:27 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:27.283+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.959701+0000 front 2024-09-19T05:30:51.959620+0000 (oldest deadline 2024-09-19T05:31:16.560138+0000) 2024-09-19T05:31:27.852 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:27 smithi178 systemd[1]: Stopping Ceph osd.10 for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:31:27.853 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:27 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:27.849+0000 7f414552d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:31:27.853 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:27 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:27.849+0000 7f414552d640 -1 osd.10 93 *** Got signal Terminated *** 2024-09-19T05:31:27.853 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:27 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:27.849+0000 7f414552d640 -1 osd.10 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:31:28.192 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:28 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:28.054+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:28.192 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:28 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:28.054+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:28.192 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:28 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:28.054+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:28.193 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:28 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:28.054+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:28.193 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:28 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:28.054+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.420621+0000 front 2024-09-19T05:30:44.420662+0000 (oldest deadline 2024-09-19T05:31:10.320786+0000) 2024-09-19T05:31:28.193 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:28 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:28.054+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:50.321528+0000 front 2024-09-19T05:30:50.321503+0000 (oldest deadline 2024-09-19T05:31:14.421421+0000) 2024-09-19T05:31:28.193 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:28 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:28.054+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-09-19T05:30:57.922548+0000 front 2024-09-19T05:30:57.922601+0000 (oldest deadline 2024-09-19T05:31:22.622441+0000) 2024-09-19T05:31:28.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:28 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:28.286+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:28.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:28 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:28.286+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:28.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:28 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:28.286+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:28.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:28 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:28.286+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:28.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:28 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:28.286+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:28.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:28 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:28.286+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.959701+0000 front 2024-09-19T05:30:51.959620+0000 (oldest deadline 2024-09-19T05:31:16.560138+0000) 2024-09-19T05:31:29.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:29 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:29.085+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:29.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:29 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:29.085+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:29.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:29 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:29.085+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:29.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:29 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:29.085+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:29.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:29 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:29.085+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.420621+0000 front 2024-09-19T05:30:44.420662+0000 (oldest deadline 2024-09-19T05:31:10.320786+0000) 2024-09-19T05:31:29.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:29 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:29.085+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:50.321528+0000 front 2024-09-19T05:30:50.321503+0000 (oldest deadline 2024-09-19T05:31:14.421421+0000) 2024-09-19T05:31:29.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:29 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:29.085+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-09-19T05:30:57.922548+0000 front 2024-09-19T05:30:57.922601+0000 (oldest deadline 2024-09-19T05:31:22.622441+0000) 2024-09-19T05:31:29.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:29 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:29.263+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:29.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:29 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:29.263+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:29.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:29 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:29.263+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:29.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:29 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:29.263+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:29.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:29 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:29.263+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:29.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:29 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:29.263+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.959701+0000 front 2024-09-19T05:30:51.959620+0000 (oldest deadline 2024-09-19T05:31:16.560138+0000) 2024-09-19T05:31:30.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:30 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:30.056+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:30.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:30 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:30.056+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:30.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:30 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:30.056+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:30.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:30 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:30.056+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:30.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:30 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:30.056+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.420621+0000 front 2024-09-19T05:30:44.420662+0000 (oldest deadline 2024-09-19T05:31:10.320786+0000) 2024-09-19T05:31:30.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:30 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:30.056+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:50.321528+0000 front 2024-09-19T05:30:50.321503+0000 (oldest deadline 2024-09-19T05:31:14.421421+0000) 2024-09-19T05:31:30.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:30 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:30.056+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-09-19T05:30:57.922548+0000 front 2024-09-19T05:30:57.922601+0000 (oldest deadline 2024-09-19T05:31:22.622441+0000) 2024-09-19T05:31:30.655 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:30 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:30.271+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:30.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:30 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:30.271+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:30.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:30 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:30.271+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:30.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:30 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:30.271+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:30.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:30 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:30.271+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:30.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:30 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:30.271+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.959701+0000 front 2024-09-19T05:30:51.959620+0000 (oldest deadline 2024-09-19T05:31:16.560138+0000) 2024-09-19T05:31:31.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:31 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:31.040+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:31.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:31 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:31.040+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:31.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:31 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:31.040+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:31.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:31 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:31.040+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:31.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:31 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:31.040+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.420621+0000 front 2024-09-19T05:30:44.420662+0000 (oldest deadline 2024-09-19T05:31:10.320786+0000) 2024-09-19T05:31:31.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:31 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:31.040+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:50.321528+0000 front 2024-09-19T05:30:50.321503+0000 (oldest deadline 2024-09-19T05:31:14.421421+0000) 2024-09-19T05:31:31.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:31 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:31.040+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-09-19T05:30:57.922548+0000 front 2024-09-19T05:30:57.922601+0000 (oldest deadline 2024-09-19T05:31:22.622441+0000) 2024-09-19T05:31:31.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:31 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:31.299+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:31.657 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:31 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:31.299+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:31.657 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:31 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:31.299+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:31.657 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:31 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:31.299+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:31.657 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:31 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:31.299+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:31.657 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:31 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:31.299+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.959701+0000 front 2024-09-19T05:30:51.959620+0000 (oldest deadline 2024-09-19T05:31:16.560138+0000) 2024-09-19T05:31:32.442 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:32 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:32.042+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:10.615708+0000 front 2024-09-19T05:30:10.615793+0000 (oldest deadline 2024-09-19T05:30:35.315815+0000) 2024-09-19T05:31:32.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:32 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:32.042+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:21.216609+0000 front 2024-09-19T05:30:21.216734+0000 (oldest deadline 2024-09-19T05:30:42.916773+0000) 2024-09-19T05:31:32.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:32 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:32.042+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:29.719546+0000 front 2024-09-19T05:30:29.719401+0000 (oldest deadline 2024-09-19T05:30:55.019320+0000) 2024-09-19T05:31:32.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:32 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:32.042+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:35.019899+0000 front 2024-09-19T05:30:35.019968+0000 (oldest deadline 2024-09-19T05:30:59.119922+0000) 2024-09-19T05:31:32.443 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:32 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:32.042+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:44.420621+0000 front 2024-09-19T05:30:44.420662+0000 (oldest deadline 2024-09-19T05:31:10.320786+0000) 2024-09-19T05:31:32.444 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:32 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:32.042+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:50.321528+0000 front 2024-09-19T05:30:50.321503+0000 (oldest deadline 2024-09-19T05:31:14.421421+0000) 2024-09-19T05:31:32.444 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:32 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10[59082]: 2024-09-19T05:31:32.042+0000 7f413db2a640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.120:6822 osd.6 since back 2024-09-19T05:30:57.922548+0000 front 2024-09-19T05:30:57.922601+0000 (oldest deadline 2024-09-19T05:31:22.622441+0000) 2024-09-19T05:31:32.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:32 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:32.310+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:32.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:32 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:32.310+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:32.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:32 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:32.310+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:32.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:32 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:32.310+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:32.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:32 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:32.310+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:32.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:32 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:32.310+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.959701+0000 front 2024-09-19T05:30:51.959620+0000 (oldest deadline 2024-09-19T05:31:16.560138+0000) 2024-09-19T05:31:33.552 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:33 smithi178 podman[70934]: 2024-09-19 05:31:33.27364756 +0000 UTC m=+5.525490291 container died 69577b5eb05039f868c3d1732590ee64433c3a3dfb2884b81c2d1422e0fbe7c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-19T05:31:33.655 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:33 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:33.343+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:33.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:33 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:33.343+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:33.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:33 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:33.343+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:33.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:33 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:33.343+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:33.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:33 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:33.343+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:33.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:33 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:33.343+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.959701+0000 front 2024-09-19T05:30:51.959620+0000 (oldest deadline 2024-09-19T05:31:16.560138+0000) 2024-09-19T05:31:33.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:33 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:33.343+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6820 osd.7 since back 2024-09-19T05:31:06.561785+0000 front 2024-09-19T05:31:06.561702+0000 (oldest deadline 2024-09-19T05:31:32.461523+0000) 2024-09-19T05:31:33.886 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:33 smithi178 podman[70934]: 2024-09-19 05:31:33.642153822 +0000 UTC m=+5.893996542 container cleanup 69577b5eb05039f868c3d1732590ee64433c3a3dfb2884b81c2d1422e0fbe7c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T05:31:33.887 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:33 smithi178 bash[70934]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10 2024-09-19T05:31:34.192 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:33 smithi178 podman[70952]: 2024-09-19 05:31:33.885532634 +0000 UTC m=+0.612828830 container remove 69577b5eb05039f868c3d1732590ee64433c3a3dfb2884b81c2d1422e0fbe7c9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2) 2024-09-19T05:31:34.540 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:34 smithi178 podman[71042]: 2024-09-19 05:31:34.109134486 +0000 UTC m=+0.015900855 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:31:34.540 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:34 smithi178 podman[71042]: 2024-09-19 05:31:34.244853644 +0000 UTC m=+0.151619998 container create 6b5412cc711c136aeece7827ad3cfeb995f6e9a1ca33168afdbc1985c9fbd0eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:31:34.540 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:34 smithi178 podman[71042]: 2024-09-19 05:31:34.438838629 +0000 UTC m=+0.345604984 container init 6b5412cc711c136aeece7827ad3cfeb995f6e9a1ca33168afdbc1985c9fbd0eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T05:31:34.541 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:34 smithi178 podman[71042]: 2024-09-19 05:31:34.442032907 +0000 UTC m=+0.348799262 container start 6b5412cc711c136aeece7827ad3cfeb995f6e9a1ca33168afdbc1985c9fbd0eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T05:31:34.541 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:34 smithi178 podman[71042]: 2024-09-19 05:31:34.538830448 +0000 UTC m=+0.445596821 container attach 6b5412cc711c136aeece7827ad3cfeb995f6e9a1ca33168afdbc1985c9fbd0eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T05:31:34.611 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:34 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:34.358+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:34.611 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:34 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:34.358+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:34.611 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:34 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:34.358+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:34.612 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:34 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:34.358+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:34.612 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:34 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:34.358+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:34.612 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:34 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:34.358+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.959701+0000 front 2024-09-19T05:30:51.959620+0000 (oldest deadline 2024-09-19T05:31:16.560138+0000) 2024-09-19T05:31:34.612 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:34 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:34.358+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6820 osd.7 since back 2024-09-19T05:31:06.561785+0000 front 2024-09-19T05:31:06.561702+0000 (oldest deadline 2024-09-19T05:31:32.461523+0000) 2024-09-19T05:31:34.910 INFO:journalctl@ceph.osd.10.smithi178.stdout:Sep 19 05:31:34 smithi178 podman[71042]: 2024-09-19 05:31:34.626036915 +0000 UTC m=+0.532803273 container died 6b5412cc711c136aeece7827ad3cfeb995f6e9a1ca33168afdbc1985c9fbd0eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T05:31:35.213 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T05:31:35.251 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:31:35.251 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T05:31:35.251 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T05:31:35.251 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.11 2024-09-19T05:31:35.579 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:35 smithi194 systemd[1]: Stopping Ceph osd.11 for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:31:35.579 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:35 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:35.407+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:35.579 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:35 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:35.407+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:35.579 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:35 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:35.407+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:35.579 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:35 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:35.407+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:35.579 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:35 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:35.407+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:35.580 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:35 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:35.407+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.959701+0000 front 2024-09-19T05:30:51.959620+0000 (oldest deadline 2024-09-19T05:31:16.560138+0000) 2024-09-19T05:31:35.580 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:35 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:35.407+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6820 osd.7 since back 2024-09-19T05:31:06.561785+0000 front 2024-09-19T05:31:06.561702+0000 (oldest deadline 2024-09-19T05:31:32.461523+0000) 2024-09-19T05:31:35.580 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:35 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:35.576+0000 7f8a391c8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:31:35.580 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:35 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:35.576+0000 7f8a391c8640 -1 osd.11 93 *** Got signal Terminated *** 2024-09-19T05:31:35.580 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:35 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:35.576+0000 7f8a391c8640 -1 osd.11 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T05:31:36.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:36.393+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:36.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:36.393+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:36.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:36.393+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:36.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:36.393+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:36.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:36.393+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:36.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:36.393+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.959701+0000 front 2024-09-19T05:30:51.959620+0000 (oldest deadline 2024-09-19T05:31:16.560138+0000) 2024-09-19T05:31:36.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:36 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:36.393+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6820 osd.7 since back 2024-09-19T05:31:06.561785+0000 front 2024-09-19T05:31:06.561702+0000 (oldest deadline 2024-09-19T05:31:32.461523+0000) 2024-09-19T05:31:37.906 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:37 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:37.412+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:37.906 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:37 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:37.412+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:37.906 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:37 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:37.412+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:37.906 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:37 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:37.412+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:37.906 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:37 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:37.412+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:37.906 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:37 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:37.412+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.959701+0000 front 2024-09-19T05:30:51.959620+0000 (oldest deadline 2024-09-19T05:31:16.560138+0000) 2024-09-19T05:31:37.906 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:37 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:37.412+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6820 osd.7 since back 2024-09-19T05:31:06.561785+0000 front 2024-09-19T05:31:06.561702+0000 (oldest deadline 2024-09-19T05:31:32.461523+0000) 2024-09-19T05:31:38.905 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:38 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:38.412+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:38.906 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:38 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:38.412+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:38.906 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:38 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:38.412+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:38.906 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:38 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:38.412+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:38.906 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:38 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:38.412+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:38.906 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:38 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:38.412+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.959701+0000 front 2024-09-19T05:30:51.959620+0000 (oldest deadline 2024-09-19T05:31:16.560138+0000) 2024-09-19T05:31:38.906 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:38 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:38.412+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6820 osd.7 since back 2024-09-19T05:31:06.561785+0000 front 2024-09-19T05:31:06.561702+0000 (oldest deadline 2024-09-19T05:31:32.461523+0000) 2024-09-19T05:31:39.906 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:39 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:39.412+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:39.906 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:39 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:39.412+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:39.906 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:39 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:39.412+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:39.906 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:39 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:39.412+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:39.906 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:39 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:39.412+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:39.906 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:39 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:39.412+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.959701+0000 front 2024-09-19T05:30:51.959620+0000 (oldest deadline 2024-09-19T05:31:16.560138+0000) 2024-09-19T05:31:39.906 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:39 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:39.412+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6820 osd.7 since back 2024-09-19T05:31:06.561785+0000 front 2024-09-19T05:31:06.561702+0000 (oldest deadline 2024-09-19T05:31:32.461523+0000) 2024-09-19T05:31:40.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:40 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:40.370+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6806 osd.0 since back 2024-09-19T05:30:13.855783+0000 front 2024-09-19T05:30:13.855797+0000 (oldest deadline 2024-09-19T05:30:35.555768+0000) 2024-09-19T05:31:40.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:40 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:40.370+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6804 osd.1 since back 2024-09-19T05:30:20.856902+0000 front 2024-09-19T05:30:20.856867+0000 (oldest deadline 2024-09-19T05:30:46.156796+0000) 2024-09-19T05:31:40.656 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:40 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:40.370+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-09-19T05:30:26.157332+0000 front 2024-09-19T05:30:26.157194+0000 (oldest deadline 2024-09-19T05:30:51.457243+0000) 2024-09-19T05:31:40.657 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:40 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:40.370+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.120:6814 osd.3 since back 2024-09-19T05:30:36.058492+0000 front 2024-09-19T05:30:36.058583+0000 (oldest deadline 2024-09-19T05:31:01.958482+0000) 2024-09-19T05:31:40.657 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:40 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:40.370+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6812 osd.4 since back 2024-09-19T05:30:41.959036+0000 front 2024-09-19T05:30:41.958947+0000 (oldest deadline 2024-09-19T05:31:07.858888+0000) 2024-09-19T05:31:40.657 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:40 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:40.370+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-09-19T05:30:51.959701+0000 front 2024-09-19T05:30:51.959620+0000 (oldest deadline 2024-09-19T05:31:16.560138+0000) 2024-09-19T05:31:40.657 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:40 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:40.370+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.178:6820 osd.7 since back 2024-09-19T05:31:06.561785+0000 front 2024-09-19T05:31:06.561702+0000 (oldest deadline 2024-09-19T05:31:32.461523+0000) 2024-09-19T05:31:40.657 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:40 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11[60477]: 2024-09-19T05:31:40.370+0000 7f8a317c5640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.194:6820 osd.8 since back 2024-09-19T05:31:14.762322+0000 front 2024-09-19T05:31:14.762336+0000 (oldest deadline 2024-09-19T05:31:40.062333+0000) 2024-09-19T05:31:41.246 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:40 smithi194 podman[72140]: 2024-09-19 05:31:40.981561864 +0000 UTC m=+5.529969640 container died db651754b57dcbd98ba011f3fff74968fc8d0af66cfbd13506d0adbfac9d4d2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T05:31:41.620 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:41 smithi194 podman[72140]: 2024-09-19 05:31:41.335082064 +0000 UTC m=+5.883489903 container cleanup db651754b57dcbd98ba011f3fff74968fc8d0af66cfbd13506d0adbfac9d4d2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T05:31:41.621 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:41 smithi194 bash[72140]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11 2024-09-19T05:31:41.905 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:41 smithi194 podman[72155]: 2024-09-19 05:31:41.619685027 +0000 UTC m=+0.633492466 container remove db651754b57dcbd98ba011f3fff74968fc8d0af66cfbd13506d0adbfac9d4d2d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T05:31:42.274 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:41 smithi194 podman[72244]: 2024-09-19 05:31:41.85214495 +0000 UTC m=+0.015401943 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T05:31:42.274 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:41 smithi194 podman[72244]: 2024-09-19 05:31:41.962145419 +0000 UTC m=+0.125402449 container create 992d0f31dcaacbbefc88883c577d652adce58c2aa0f95fe35c01f0e99ec01103 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T05:31:42.274 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:42 smithi194 podman[72244]: 2024-09-19 05:31:42.189593028 +0000 UTC m=+0.352850023 container init 992d0f31dcaacbbefc88883c577d652adce58c2aa0f95fe35c01f0e99ec01103 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T05:31:42.274 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:42 smithi194 podman[72244]: 2024-09-19 05:31:42.193793504 +0000 UTC m=+0.357050489 container start 992d0f31dcaacbbefc88883c577d652adce58c2aa0f95fe35c01f0e99ec01103 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-19T05:31:42.274 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:42 smithi194 podman[72244]: 2024-09-19 05:31:42.272952407 +0000 UTC m=+0.436209408 container attach 992d0f31dcaacbbefc88883c577d652adce58c2aa0f95fe35c01f0e99ec01103 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11-deactivate, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:31:42.657 INFO:journalctl@ceph.osd.11.smithi194.stdout:Sep 19 05:31:42 smithi194 podman[72244]: 2024-09-19 05:31:42.385327642 +0000 UTC m=+0.548584629 container died 992d0f31dcaacbbefc88883c577d652adce58c2aa0f95fe35c01f0e99ec01103 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T05:31:43.074 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T05:31:43.115 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:31:43.116 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T05:31:43.116 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T05:31:43.116 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.a 2024-09-19T05:31:43.479 INFO:journalctl@ceph.mds.a.smithi120.stdout:Sep 19 05:31:43 smithi120 systemd[1]: Stopping Ceph mds.a for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:31:43.875 INFO:journalctl@ceph.mds.a.smithi120.stdout:Sep 19 05:31:43 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-a[71730]: 2024-09-19T05:31:43.477+0000 7fe94d6e2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:31:43.875 INFO:journalctl@ceph.mds.a.smithi120.stdout:Sep 19 05:31:43 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-a[71730]: 2024-09-19T05:31:43.477+0000 7fe94d6e2640 -1 mds.a *** got signal Terminated *** 2024-09-19T05:31:46.621 INFO:journalctl@ceph.mds.a.smithi120.stdout:Sep 19 05:31:46 smithi120 podman[197672]: 2024-09-19 05:31:46.25379102 +0000 UTC m=+2.943573672 container died e341cc103103c7a94cfa6dd8fc5b344f98524d949b493d95f4b3baca9f3dd9d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2) 2024-09-19T05:31:46.875 INFO:journalctl@ceph.mds.a.smithi120.stdout:Sep 19 05:31:46 smithi120 podman[197672]: 2024-09-19 05:31:46.701758365 +0000 UTC m=+3.391541006 container cleanup e341cc103103c7a94cfa6dd8fc5b344f98524d949b493d95f4b3baca9f3dd9d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-a, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-19T05:31:46.875 INFO:journalctl@ceph.mds.a.smithi120.stdout:Sep 19 05:31:46 smithi120 bash[197672]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-a 2024-09-19T05:31:47.131 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T05:31:47.166 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:31:47.167 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T05:31:47.167 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T05:31:47.167 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.d 2024-09-19T05:31:47.625 INFO:journalctl@ceph.mds.d.smithi120.stdout:Sep 19 05:31:47 smithi120 systemd[1]: Stopping Ceph mds.d for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:31:47.625 INFO:journalctl@ceph.mds.d.smithi120.stdout:Sep 19 05:31:47 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-d[70550]: 2024-09-19T05:31:47.488+0000 7f70059e4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:31:47.625 INFO:journalctl@ceph.mds.d.smithi120.stdout:Sep 19 05:31:47 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-d[70550]: 2024-09-19T05:31:47.488+0000 7f70059e4640 -1 mds.d *** got signal Terminated *** 2024-09-19T05:31:51.766 INFO:journalctl@ceph.mds.d.smithi120.stdout:Sep 19 05:31:51 smithi120 podman[197794]: 2024-09-19 05:31:51.494132961 +0000 UTC m=+4.104447499 container died d255bfc1aa022d3e1587702646cecab972d9ae742c2cf47dc89f6eeb93cb822b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-d, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T05:31:52.125 INFO:journalctl@ceph.mds.d.smithi120.stdout:Sep 19 05:31:51 smithi120 podman[197794]: 2024-09-19 05:31:51.94746739 +0000 UTC m=+4.557781923 container cleanup d255bfc1aa022d3e1587702646cecab972d9ae742c2cf47dc89f6eeb93cb822b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-d, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T05:31:52.125 INFO:journalctl@ceph.mds.d.smithi120.stdout:Sep 19 05:31:51 smithi120 bash[197794]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-d 2024-09-19T05:31:52.377 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T05:31:52.411 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:31:52.411 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T05:31:52.412 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T05:31:52.412 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.g 2024-09-19T05:31:52.736 INFO:journalctl@ceph.mds.g.smithi120.stdout:Sep 19 05:31:52 smithi120 systemd[1]: Stopping Ceph mds.g for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:31:53.126 INFO:journalctl@ceph.mds.g.smithi120.stdout:Sep 19 05:31:52 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-g[71311]: 2024-09-19T05:31:52.734+0000 7f9370bc5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:31:53.126 INFO:journalctl@ceph.mds.g.smithi120.stdout:Sep 19 05:31:52 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-g[71311]: 2024-09-19T05:31:52.734+0000 7f9370bc5640 -1 mds.g *** got signal Terminated *** 2024-09-19T05:31:54.978 INFO:journalctl@ceph.mds.g.smithi120.stdout:Sep 19 05:31:54 smithi120 podman[197927]: 2024-09-19 05:31:54.716455038 +0000 UTC m=+2.084723538 container died 7ef4a9e45083483e8a57a3bc66819875e1319a6fc407871d20e9951536744520 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True) 2024-09-19T05:31:55.237 INFO:journalctl@ceph.mds.g.smithi120.stdout:Sep 19 05:31:55 smithi120 podman[197927]: 2024-09-19 05:31:55.051605376 +0000 UTC m=+2.419873875 container cleanup 7ef4a9e45083483e8a57a3bc66819875e1319a6fc407871d20e9951536744520 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-g, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T05:31:55.237 INFO:journalctl@ceph.mds.g.smithi120.stdout:Sep 19 05:31:55 smithi120 bash[197927]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-g 2024-09-19T05:31:55.484 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T05:31:55.506 INFO:journalctl@ceph.mds.g.smithi120.stdout:Sep 19 05:31:55 smithi120 podman[197939]: 2024-09-19 05:31:55.235948663 +0000 UTC m=+0.518239374 container remove 7ef4a9e45083483e8a57a3bc66819875e1319a6fc407871d20e9951536744520 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-g, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T05:31:55.506 INFO:journalctl@ceph.mds.g.smithi120.stdout:Sep 19 05:31:55 smithi120 systemd[1]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.g.service: Deactivated successfully. 2024-09-19T05:31:55.506 INFO:journalctl@ceph.mds.g.smithi120.stdout:Sep 19 05:31:55 smithi120 systemd[1]: Stopped Ceph mds.g for 4e6e3df4-7645-11ef-bceb-c7b262605968. 2024-09-19T05:31:55.506 INFO:journalctl@ceph.mds.g.smithi120.stdout:Sep 19 05:31:55 smithi120 systemd[1]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.g.service: Consumed 1.002s CPU time. 2024-09-19T05:31:55.518 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:31:55.518 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T05:31:55.518 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T05:31:55.519 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.j 2024-09-19T05:31:55.823 INFO:journalctl@ceph.mds.j.smithi120.stdout:Sep 19 05:31:55 smithi120 systemd[1]: Stopping Ceph mds.j for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:31:56.125 INFO:journalctl@ceph.mds.j.smithi120.stdout:Sep 19 05:31:55 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-j[70125]: 2024-09-19T05:31:55.821+0000 7fcb1a5d8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:31:56.125 INFO:journalctl@ceph.mds.j.smithi120.stdout:Sep 19 05:31:55 smithi120 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-j[70125]: 2024-09-19T05:31:55.821+0000 7fcb1a5d8640 -1 mds.j *** got signal Terminated *** 2024-09-19T05:32:00.103 INFO:journalctl@ceph.mds.j.smithi120.stdout:Sep 19 05:31:59 smithi120 podman[198047]: 2024-09-19 05:31:59.835142002 +0000 UTC m=+4.105372336 container died 47518e55f38851355a3ae45710225a2e0200d2f804ee57e75c987e1032551170 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-j, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-19T05:32:00.375 INFO:journalctl@ceph.mds.j.smithi120.stdout:Sep 19 05:32:00 smithi120 podman[198047]: 2024-09-19 05:32:00.196416709 +0000 UTC m=+4.466647043 container cleanup 47518e55f38851355a3ae45710225a2e0200d2f804ee57e75c987e1032551170 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T05:32:00.375 INFO:journalctl@ceph.mds.j.smithi120.stdout:Sep 19 05:32:00 smithi120 bash[198047]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-j 2024-09-19T05:32:00.623 DEBUG:teuthology.orchestra.run.smithi120:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T05:32:00.655 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:32:00.655 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T05:32:00.655 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T05:32:00.655 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.b 2024-09-19T05:32:00.942 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:32:00 smithi178 systemd[1]: Stopping Ceph mds.b for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:32:01.442 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:32:00 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:32:00.985+0000 7fbfa69bb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:32:01.442 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:32:00 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b[64283]: 2024-09-19T05:32:00.985+0000 7fbfa69bb640 -1 mds.b *** got signal Terminated *** 2024-09-19T05:32:03.654 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:32:03 smithi178 podman[71156]: 2024-09-19 05:32:03.350887137 +0000 UTC m=+2.493505071 container died 7e1e4df1a12dc1bd9d03e3980beb58b4152c125e65266365b9e8bbf325ca4a05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T05:32:03.942 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:32:03 smithi178 podman[71156]: 2024-09-19 05:32:03.743244635 +0000 UTC m=+2.885862576 container cleanup 7e1e4df1a12dc1bd9d03e3980beb58b4152c125e65266365b9e8bbf325ca4a05 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:32:03.942 INFO:journalctl@ceph.mds.b.smithi178.stdout:Sep 19 05:32:03 smithi178 bash[71156]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-b 2024-09-19T05:32:04.148 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T05:32:04.184 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:32:04.184 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T05:32:04.184 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T05:32:04.184 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.e 2024-09-19T05:32:04.692 INFO:journalctl@ceph.mds.e.smithi178.stdout:Sep 19 05:32:04 smithi178 systemd[1]: Stopping Ceph mds.e for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:32:04.692 INFO:journalctl@ceph.mds.e.smithi178.stdout:Sep 19 05:32:04 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-e[63681]: 2024-09-19T05:32:04.505+0000 7f78cb443640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:32:04.692 INFO:journalctl@ceph.mds.e.smithi178.stdout:Sep 19 05:32:04 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-e[63681]: 2024-09-19T05:32:04.505+0000 7f78cb443640 -1 mds.e *** got signal Terminated *** 2024-09-19T05:32:06.691 INFO:journalctl@ceph.mds.e.smithi178.stdout:Sep 19 05:32:06 smithi178 podman[71278]: 2024-09-19 05:32:06.428640523 +0000 UTC m=+2.018932917 container died 55528f7ef26f7c08f6bf883f69bfe89c428f3f7e42d178eedb47abd6eb1cec59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T05:32:06.942 INFO:journalctl@ceph.mds.e.smithi178.stdout:Sep 19 05:32:06 smithi178 podman[71278]: 2024-09-19 05:32:06.789568702 +0000 UTC m=+2.379861094 container cleanup 55528f7ef26f7c08f6bf883f69bfe89c428f3f7e42d178eedb47abd6eb1cec59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T05:32:06.942 INFO:journalctl@ceph.mds.e.smithi178.stdout:Sep 19 05:32:06 smithi178 bash[71278]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-e 2024-09-19T05:32:07.227 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T05:32:07.259 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:32:07.259 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T05:32:07.260 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T05:32:07.260 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.h 2024-09-19T05:32:07.595 INFO:journalctl@ceph.mds.h.smithi178.stdout:Sep 19 05:32:07 smithi178 systemd[1]: Stopping Ceph mds.h for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:32:07.942 INFO:journalctl@ceph.mds.h.smithi178.stdout:Sep 19 05:32:07 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-h[63981]: 2024-09-19T05:32:07.593+0000 7f557a0a5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:32:07.942 INFO:journalctl@ceph.mds.h.smithi178.stdout:Sep 19 05:32:07 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-h[63981]: 2024-09-19T05:32:07.593+0000 7f557a0a5640 -1 mds.h *** got signal Terminated *** 2024-09-19T05:32:10.020 INFO:journalctl@ceph.mds.h.smithi178.stdout:Sep 19 05:32:09 smithi178 podman[71399]: 2024-09-19 05:32:09.754023715 +0000 UTC m=+2.271336209 container died 068f7e61a423aa661b0312bb13213049a013dd36548ed685fec30fcec551b0b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T05:32:10.379 INFO:journalctl@ceph.mds.h.smithi178.stdout:Sep 19 05:32:10 smithi178 podman[71399]: 2024-09-19 05:32:10.110038843 +0000 UTC m=+2.627351327 container cleanup 068f7e61a423aa661b0312bb13213049a013dd36548ed685fec30fcec551b0b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-h, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:32:10.379 INFO:journalctl@ceph.mds.h.smithi178.stdout:Sep 19 05:32:10 smithi178 bash[71399]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-h 2024-09-19T05:32:10.536 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T05:32:10.569 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:32:10.570 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T05:32:10.570 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T05:32:10.570 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.k 2024-09-19T05:32:10.942 INFO:journalctl@ceph.mds.k.smithi178.stdout:Sep 19 05:32:10 smithi178 systemd[1]: Stopping Ceph mds.k for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:32:10.942 INFO:journalctl@ceph.mds.k.smithi178.stdout:Sep 19 05:32:10 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-k[63365]: 2024-09-19T05:32:10.854+0000 7f7652405640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:32:10.942 INFO:journalctl@ceph.mds.k.smithi178.stdout:Sep 19 05:32:10 smithi178 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-k[63365]: 2024-09-19T05:32:10.854+0000 7f7652405640 -1 mds.k *** got signal Terminated *** 2024-09-19T05:32:13.442 INFO:journalctl@ceph.mds.k.smithi178.stdout:Sep 19 05:32:13 smithi178 podman[71516]: 2024-09-19 05:32:13.130131538 +0000 UTC m=+2.350116554 container died dd4e17833d8b595208c09a51249cc1dea7f069f1313ec54878d2ba94f851ff73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-k, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-19T05:32:13.833 INFO:journalctl@ceph.mds.k.smithi178.stdout:Sep 19 05:32:13 smithi178 podman[71516]: 2024-09-19 05:32:13.622727376 +0000 UTC m=+2.842712384 container cleanup dd4e17833d8b595208c09a51249cc1dea7f069f1313ec54878d2ba94f851ff73 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-k, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T05:32:13.833 INFO:journalctl@ceph.mds.k.smithi178.stdout:Sep 19 05:32:13 smithi178 bash[71516]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-k 2024-09-19T05:32:13.983 DEBUG:teuthology.orchestra.run.smithi178:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T05:32:14.014 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:32:14.014 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T05:32:14.014 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T05:32:14.014 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.c 2024-09-19T05:32:14.294 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:32:14 smithi194 systemd[1]: Stopping Ceph mds.c for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:32:14.558 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:32:14 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:32:14.292+0000 7fe3e84dc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:32:14.558 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:32:14 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c[65319]: 2024-09-19T05:32:14.292+0000 7fe3e84dc640 -1 mds.c *** got signal Terminated *** 2024-09-19T05:32:16.656 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:32:16 smithi194 podman[72346]: 2024-09-19 05:32:16.39022217 +0000 UTC m=+2.188460011 container died c2b87ad7e1676f6108b9033a221018bb9a35de8afea30cbe32b63260949978f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:32:17.012 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:32:16 smithi194 podman[72346]: 2024-09-19 05:32:16.767800541 +0000 UTC m=+2.566038386 container cleanup c2b87ad7e1676f6108b9033a221018bb9a35de8afea30cbe32b63260949978f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:32:17.012 INFO:journalctl@ceph.mds.c.smithi194.stdout:Sep 19 05:32:16 smithi194 bash[72346]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-c 2024-09-19T05:32:17.144 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T05:32:17.179 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:32:17.180 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T05:32:17.180 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T05:32:17.180 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.f 2024-09-19T05:32:17.405 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 19 05:32:17 smithi194 systemd[1]: Stopping Ceph mds.f for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:32:17.906 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 19 05:32:17 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-f[65018]: 2024-09-19T05:32:17.521+0000 7fab096e7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:32:17.906 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 19 05:32:17 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-f[65018]: 2024-09-19T05:32:17.521+0000 7fab096e7640 -1 mds.f *** got signal Terminated *** 2024-09-19T05:32:21.074 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 19 05:32:20 smithi194 podman[72477]: 2024-09-19 05:32:20.758705466 +0000 UTC m=+3.361333506 container died 364681e2b771e5c340072d322ddc6d92aa14d6c91dcebd7f8310d2cc0a8594d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-f, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T05:32:21.405 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 19 05:32:21 smithi194 podman[72477]: 2024-09-19 05:32:21.171265617 +0000 UTC m=+3.773893659 container cleanup 364681e2b771e5c340072d322ddc6d92aa14d6c91dcebd7f8310d2cc0a8594d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-f, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-19T05:32:21.406 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 19 05:32:21 smithi194 bash[72477]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-f 2024-09-19T05:32:21.661 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T05:32:21.682 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 19 05:32:21 smithi194 podman[72489]: 2024-09-19 05:32:21.422435417 +0000 UTC m=+0.652814983 container remove 364681e2b771e5c340072d322ddc6d92aa14d6c91dcebd7f8310d2cc0a8594d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T05:32:21.682 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 19 05:32:21 smithi194 systemd[1]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.f.service: Deactivated successfully. 2024-09-19T05:32:21.682 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 19 05:32:21 smithi194 systemd[1]: Stopped Ceph mds.f for 4e6e3df4-7645-11ef-bceb-c7b262605968. 2024-09-19T05:32:21.682 INFO:journalctl@ceph.mds.f.smithi194.stdout:Sep 19 05:32:21 smithi194 systemd[1]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.f.service: Consumed 20.842s CPU time. 2024-09-19T05:32:21.693 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:32:21.694 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T05:32:21.694 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T05:32:21.694 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.i 2024-09-19T05:32:22.035 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 19 05:32:21 smithi194 systemd[1]: Stopping Ceph mds.i for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:32:22.405 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 19 05:32:22 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-i[65624]: 2024-09-19T05:32:22.032+0000 7f1b935cc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:32:22.405 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 19 05:32:22 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-i[65624]: 2024-09-19T05:32:22.032+0000 7f1b935cc640 -1 mds.i *** got signal Terminated *** 2024-09-19T05:32:27.759 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 19 05:32:27 smithi194 podman[72598]: 2024-09-19 05:32:27.42423663 +0000 UTC m=+5.514413384 container died c87510e3837ecc49942cde4005fb08e6df469575ebaadd4ac61704e27d59df7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-i, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T05:32:27.759 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 19 05:32:27 smithi194 podman[72598]: 2024-09-19 05:32:27.758251053 +0000 UTC m=+5.848427799 container cleanup c87510e3837ecc49942cde4005fb08e6df469575ebaadd4ac61704e27d59df7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-i, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T05:32:28.155 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 19 05:32:27 smithi194 bash[72598]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-i 2024-09-19T05:32:28.156 INFO:journalctl@ceph.mds.i.smithi194.stdout:Sep 19 05:32:27 smithi194 podman[72611]: 2024-09-19 05:32:27.934373093 +0000 UTC m=+0.504573189 container remove c87510e3837ecc49942cde4005fb08e6df469575ebaadd4ac61704e27d59df7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-i, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True) 2024-09-19T05:32:28.188 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T05:32:28.221 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:32:28.221 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T05:32:28.222 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T05:32:28.222 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.l 2024-09-19T05:32:28.538 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 19 05:32:28 smithi194 systemd[1]: Stopping Ceph mds.l for 4e6e3df4-7645-11ef-bceb-c7b262605968... 2024-09-19T05:32:28.905 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 19 05:32:28 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-l[64718]: 2024-09-19T05:32:28.536+0000 7f0deed58640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T05:32:28.905 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 19 05:32:28 smithi194 ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-l[64718]: 2024-09-19T05:32:28.536+0000 7f0deed58640 -1 mds.l *** got signal Terminated *** 2024-09-19T05:32:30.889 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 19 05:32:30 smithi194 podman[72722]: 2024-09-19 05:32:30.595320481 +0000 UTC m=+2.155414570 container died 43f3dcfea02e2abd89b2708c0ff778f9a0ba35098f8f6da63bf48cffdd5371d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-l, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T05:32:31.156 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 19 05:32:30 smithi194 podman[72722]: 2024-09-19 05:32:30.969712273 +0000 UTC m=+2.529806351 container cleanup 43f3dcfea02e2abd89b2708c0ff778f9a0ba35098f8f6da63bf48cffdd5371d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-l, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T05:32:31.156 INFO:journalctl@ceph.mds.l.smithi194.stdout:Sep 19 05:32:30 smithi194 bash[72722]: ceph-4e6e3df4-7645-11ef-bceb-c7b262605968-mds-l 2024-09-19T05:32:31.347 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4e6e3df4-7645-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T05:32:31.378 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T05:32:31.378 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T05:32:31.379 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T05:32:31.587 INFO:teuthology.orchestra.run.smithi120.stdout:Deleting cluster with fsid: 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:32:34.213 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T05:32:34.416 INFO:teuthology.orchestra.run.smithi178.stdout:Deleting cluster with fsid: 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:32:36.826 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T05:32:37.026 INFO:teuthology.orchestra.run.smithi194.stdout:Deleting cluster with fsid: 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:32:39.421 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:32:39.454 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:32:39.482 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T05:32:39.509 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T05:32:39.511 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911661/remote/smithi120/crash 2024-09-19T05:32:39.512 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/crash -- . 2024-09-19T05:32:39.540 INFO:teuthology.orchestra.run.smithi120.stderr:tar: /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T05:32:39.541 INFO:teuthology.orchestra.run.smithi120.stderr:tar: Error is not recoverable: exiting now 2024-09-19T05:32:39.543 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911661/remote/smithi178/crash 2024-09-19T05:32:39.543 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/crash -- . 2024-09-19T05:32:39.647 INFO:teuthology.orchestra.run.smithi178.stderr:tar: /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T05:32:39.647 INFO:teuthology.orchestra.run.smithi178.stderr:tar: Error is not recoverable: exiting now 2024-09-19T05:32:39.649 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911661/remote/smithi194/crash 2024-09-19T05:32:39.650 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/crash -- . 2024-09-19T05:32:39.683 INFO:teuthology.orchestra.run.smithi194.stderr:tar: /var/lib/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T05:32:39.683 INFO:teuthology.orchestra.run.smithi194.stderr:tar: Error is not recoverable: exiting now 2024-09-19T05:32:39.684 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T05:32:39.684 DEBUG:teuthology.orchestra.run.smithi120:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T05:32:39.737 INFO:teuthology.orchestra.run.smithi120.stdout:2024-09-19T05:21:36.221998+0000 mds.c (mds.2) 4 : cluster [WRN] Scrub error on inode 0x10000001e22 (/volumes/qa/sv_0/a415fa0b-c3dd-4e11-a8fc-38d15375e70f/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-59/picture-10.jpg) see mds.c log and `damage ls` output for details 2024-09-19T05:32:39.738 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-19T05:32:39.738 INFO:tasks.cephadm:Compressing logs... 2024-09-19T05:32:39.738 DEBUG:teuthology.orchestra.run.smithi120:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T05:32:39.740 DEBUG:teuthology.orchestra.run.smithi178:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T05:32:39.743 DEBUG:teuthology.orchestra.run.smithi194:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T05:32:39.764 INFO:teuthology.orchestra.run.smithi120.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T05:32:39.764 INFO:teuthology.orchestra.run.smithi120.stderr:: No such file or directory 2024-09-19T05:32:39.769 INFO:teuthology.orchestra.run.smithi178.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T05:32:39.769 INFO:teuthology.orchestra.run.smithi178.stderr:: No such file or directory 2024-09-19T05:32:39.769 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T05:32:39.769 INFO:teuthology.orchestra.run.smithi178.stderr:gzip/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.10.log: -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T05:32:39.769 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T05:32:39.769 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T05:32:39.769 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T05:32:39.769 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T05:32:39.771 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T05:32:39.775 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T05:32:39.775 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T05:32:39.775 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T05:32:39.775 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T05:32:39.775 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T05:32:39.775 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T05:32:39.775 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T05:32:39.775 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mon.a.log: 84.6%gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T05:32:39.775 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T05:32:39.775 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.g.log: -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.log 2024-09-19T05:32:39.776 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.6.log: 90.4% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T05:32:39.776 INFO:teuthology.orchestra.run.smithi120.stderr: 94.6% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T05:32:39.776 INFO:teuthology.orchestra.run.smithi120.stderr: 94.6% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T05:32:39.776 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T05:32:39.776 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T05:32:39.776 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T05:32:39.778 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.4.log: 94.5% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T05:32:39.778 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mgr.x.log: 89.9% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T05:32:39.778 INFO:teuthology.orchestra.run.smithi120.stderr: 94.6% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T05:32:39.783 INFO:teuthology.orchestra.run.smithi194.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T05:32:39.783 INFO:teuthology.orchestra.run.smithi194.stderr:: No such file or directory 2024-09-19T05:32:39.783 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T05:32:39.783 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T05:32:39.783 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T05:32:39.783 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T05:32:39.784 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T05:32:39.784 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T05:32:39.784 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 82.1% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T05:32:39.784 INFO:teuthology.orchestra.run.smithi194.stderr: --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T05:32:39.784 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.log 2024-09-19T05:32:39.784 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T05:32:39.784 INFO:teuthology.orchestra.run.smithi194.stderr: 90.6% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T05:32:39.784 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T05:32:39.784 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.l.log: 89.9% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T05:32:39.784 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T05:32:39.784 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.8.log: 94.6% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T05:32:39.784 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T05:32:39.784 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mgr.z.log: 91.0% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T05:32:39.787 INFO:teuthology.orchestra.run.smithi120.stderr: 91.1% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T05:32:39.787 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T05:32:39.788 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-19T05:32:39.788 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T05:32:39.788 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.0.log: 94.6% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T05:32:39.788 INFO:teuthology.orchestra.run.smithi178.stderr: 90.8% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T05:32:39.788 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T05:32:39.788 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T05:32:39.788 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.cephadm.log: 82.2% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T05:32:39.788 INFO:teuthology.orchestra.run.smithi178.stderr: 90.6% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T05:32:39.788 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.log 2024-09-19T05:32:39.790 INFO:teuthology.orchestra.run.smithi194.stderr: 91.9% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T05:32:39.790 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T05:32:39.790 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T05:32:39.794 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mgr.y.log: 91.8% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T05:32:39.794 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T05:32:39.798 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.log: 89.9% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T05:32:39.799 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T05:32:39.801 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/cephadm.log: 93.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T05:32:39.802 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T05:32:39.812 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T05:32:39.834 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T05:32:39.867 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T05:32:40.129 INFO:teuthology.orchestra.run.smithi120.stderr: 90.2% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T05:32:40.204 INFO:teuthology.orchestra.run.smithi194.stderr: 91.7% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T05:32:40.238 INFO:teuthology.orchestra.run.smithi178.stderr: 91.8% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T05:32:40.877 INFO:teuthology.orchestra.run.smithi120.stderr: 90.5% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T05:32:42.451 INFO:teuthology.orchestra.run.smithi178.stderr: 93.6% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T05:32:43.403 INFO:teuthology.orchestra.run.smithi194.stderr: 93.6% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T05:32:43.641 INFO:teuthology.orchestra.run.smithi120.stderr: 93.5% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T05:32:44.019 INFO:teuthology.orchestra.run.smithi120.stderr: 93.6% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T05:32:44.270 INFO:teuthology.orchestra.run.smithi120.stderr: 93.6% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T05:32:44.486 INFO:teuthology.orchestra.run.smithi178.stderr: 93.7% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T05:32:44.609 INFO:teuthology.orchestra.run.smithi194.stderr: 93.6% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T05:32:44.674 INFO:teuthology.orchestra.run.smithi178.stderr: 93.9% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T05:32:44.682 INFO:teuthology.orchestra.run.smithi178.stderr: 93.6% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T05:32:45.231 INFO:teuthology.orchestra.run.smithi120.stderr: 93.6% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T05:32:45.526 INFO:teuthology.orchestra.run.smithi178.stderr: 93.7% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T05:32:45.570 INFO:teuthology.orchestra.run.smithi178.stderr: 93.7% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T05:32:45.798 INFO:teuthology.orchestra.run.smithi194.stderr: 93.7% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T05:32:46.065 INFO:teuthology.orchestra.run.smithi194.stderr: 93.7% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T05:32:47.358 INFO:teuthology.orchestra.run.smithi194.stderr: 93.7% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T05:33:31.691 INFO:teuthology.orchestra.run.smithi178.stderr: 94.0% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T05:33:31.693 INFO:teuthology.orchestra.run.smithi178.stderr: 2024-09-19T05:33:31.693 INFO:teuthology.orchestra.run.smithi178.stderr:real 0m51.937s 2024-09-19T05:33:31.693 INFO:teuthology.orchestra.run.smithi178.stderr:user 1m17.244s 2024-09-19T05:33:31.693 INFO:teuthology.orchestra.run.smithi178.stderr:sys 0m2.499s 2024-09-19T05:33:44.419 INFO:teuthology.orchestra.run.smithi194.stderr: 94.0% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T05:34:27.765 INFO:teuthology.orchestra.run.smithi194.stderr: 93.7% -- replaced with /var/log/ceph/4e6e3df4-7645-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T05:34:27.767 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-09-19T05:34:27.767 INFO:teuthology.orchestra.run.smithi194.stderr:real 1m48.009s 2024-09-19T05:34:27.767 INFO:teuthology.orchestra.run.smithi194.stderr:user 3m14.680s 2024-09-19T05:34:27.767 INFO:teuthology.orchestra.run.smithi194.stderr:sys 0m6.273s 2024-09-19T05:34:59.129 INFO:teuthology.orchestra.run.smithi120.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-19T05:34:59.131 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-19T05:34:59.131 INFO:teuthology.orchestra.run.smithi120.stderr:real 2m19.377s 2024-09-19T05:34:59.132 INFO:teuthology.orchestra.run.smithi120.stderr:user 2m33.711s 2024-09-19T05:34:59.132 INFO:teuthology.orchestra.run.smithi120.stderr:sys 0m4.950s 2024-09-19T05:34:59.133 INFO:tasks.cephadm:Archiving logs... 2024-09-19T05:34:59.134 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911661/remote/smithi120/log 2024-09-19T05:34:59.135 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T05:35:25.558 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911661/remote/smithi178/log 2024-09-19T05:35:25.560 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T05:35:36.320 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911661/remote/smithi194/log 2024-09-19T05:35:36.321 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T05:36:02.538 INFO:tasks.cephadm:Removing cluster... 2024-09-19T05:36:02.538 DEBUG:teuthology.orchestra.run.smithi120:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 --force 2024-09-19T05:36:02.740 INFO:teuthology.orchestra.run.smithi120.stdout:Deleting cluster with fsid: 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:36:03.018 DEBUG:teuthology.orchestra.run.smithi178:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 --force 2024-09-19T05:36:03.218 INFO:teuthology.orchestra.run.smithi178.stdout:Deleting cluster with fsid: 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:36:03.553 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4e6e3df4-7645-11ef-bceb-c7b262605968 --force 2024-09-19T05:36:03.755 INFO:teuthology.orchestra.run.smithi194.stdout:Deleting cluster with fsid: 4e6e3df4-7645-11ef-bceb-c7b262605968 2024-09-19T05:36:04.228 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T05:36:04.229 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T05:36:04.247 DEBUG:teuthology.orchestra.run.smithi178:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T05:36:04.265 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T05:36:04.280 INFO:tasks.cephadm:Teardown complete 2024-09-19T05:36:04.281 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T05:36:04.294 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-09-19T05:36:04.295 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T05:36:04.295 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T05:36:04.298 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T05:36:04.308 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T05:36:04.414 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T05:36:04.428 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T05:36:04.429 DEBUG:teuthology.orchestra.run.smithi120:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:36:04.431 DEBUG:teuthology.orchestra.run.smithi178:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:36:04.434 DEBUG:teuthology.orchestra.run.smithi194:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T05:36:04.446 INFO:teuthology.orchestra.run.smithi120.stderr:bash: line 1: ntpq: command not found 2024-09-19T05:36:04.448 INFO:teuthology.orchestra.run.smithi178.stderr:bash: line 1: ntpq: command not found 2024-09-19T05:36:04.449 INFO:teuthology.orchestra.run.smithi194.stderr:bash: line 1: ntpq: command not found 2024-09-19T05:36:04.451 INFO:teuthology.orchestra.run.smithi120.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T05:36:04.451 INFO:teuthology.orchestra.run.smithi120.stdout:=============================================================================== 2024-09-19T05:36:04.451 INFO:teuthology.orchestra.run.smithi120.stdout:^* hv01.front.sepia.ceph.com 3 6 377 29 -149us[ -135us] +/- 46ms 2024-09-19T05:36:04.451 INFO:teuthology.orchestra.run.smithi120.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 24 +421us[ +421us] +/- 61ms 2024-09-19T05:36:04.451 INFO:teuthology.orchestra.run.smithi120.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 24 -333us[ -333us] +/- 85ms 2024-09-19T05:36:04.451 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:36:04.454 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T05:36:04.454 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2024-09-19T05:36:04.454 INFO:teuthology.orchestra.run.smithi194.stdout:^* hv01.front.sepia.ceph.com 3 6 377 25 -134us[ -127us] +/- 46ms 2024-09-19T05:36:04.454 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 23 +415us[ +415us] +/- 61ms 2024-09-19T05:36:04.454 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 -330us[ -330us] +/- 85ms 2024-09-19T05:36:04.454 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:36:04.454 INFO:teuthology.orchestra.run.smithi178.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T05:36:04.454 INFO:teuthology.orchestra.run.smithi178.stdout:=============================================================================== 2024-09-19T05:36:04.454 INFO:teuthology.orchestra.run.smithi178.stdout:^* hv01.front.sepia.ceph.com 3 6 377 27 -131us[ -123us] +/- 46ms 2024-09-19T05:36:04.454 INFO:teuthology.orchestra.run.smithi178.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 23 +418us[ +418us] +/- 61ms 2024-09-19T05:36:04.454 INFO:teuthology.orchestra.run.smithi178.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 -327us[ -320us] +/- 85ms 2024-09-19T05:36:04.454 INFO:teuthology.orchestra.run.smithi178.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T05:36:04.455 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T05:36:04.467 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T05:36:04.468 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T05:36:04.485 DEBUG:teuthology.orchestra.run.smithi120:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T05:36:04.574 DEBUG:teuthology.orchestra.run.smithi178:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T05:36:04.647 DEBUG:teuthology.orchestra.run.smithi194:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T05:36:04.714 DEBUG:teuthology.orchestra.run.smithi120:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:36:04.745 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:36:04.745 DEBUG:teuthology.orchestra.run.smithi178:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:36:04.774 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:36:04.775 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T05:36:04.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:36:04.803 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T05:36:04.817 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T05:36:04.834 INFO:teuthology.task.internal:Duration was 1944.675671 seconds 2024-09-19T05:36:04.834 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T05:36:04.850 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T05:36:04.850 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T05:36:04.853 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T05:36:04.855 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T05:36:04.891 INFO:teuthology.orchestra.run.smithi120.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:36:04.892 INFO:teuthology.orchestra.run.smithi178.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:36:04.893 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T05:36:05.229 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T05:36:05.229 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi120.front.sepia.ceph.com 2024-09-19T05:36:05.230 DEBUG:teuthology.orchestra.run.smithi120:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T05:36:05.250 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi178.front.sepia.ceph.com 2024-09-19T05:36:05.250 DEBUG:teuthology.orchestra.run.smithi178:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T05:36:05.295 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi194.front.sepia.ceph.com 2024-09-19T05:36:05.295 DEBUG:teuthology.orchestra.run.smithi194:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T05:36:05.319 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T05:36:05.319 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T05:36:05.321 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T05:36:05.338 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T05:36:05.385 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T05:36:05.386 DEBUG:teuthology.orchestra.run.smithi120:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T05:36:05.388 DEBUG:teuthology.orchestra.run.smithi178:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T05:36:05.405 DEBUG:teuthology.orchestra.run.smithi194:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T05:36:06.041 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T05:36:06.056 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T05:36:06.056 DEBUG:teuthology.orchestra.run.smithi120:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T05:36:06.081 DEBUG:teuthology.orchestra.run.smithi178:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T05:36:06.106 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T05:36:06.133 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T05:36:06.147 DEBUG:teuthology.orchestra.run.smithi120:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T05:36:06.149 DEBUG:teuthology.orchestra.run.smithi178:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T05:36:06.151 DEBUG:teuthology.orchestra.run.smithi194:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T05:36:06.170 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = core 2024-09-19T05:36:06.172 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = core 2024-09-19T05:36:06.196 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = core 2024-09-19T05:36:06.227 DEBUG:teuthology.orchestra.run.smithi120:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T05:36:06.242 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:36:06.242 DEBUG:teuthology.orchestra.run.smithi178:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T05:36:06.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:36:06.257 DEBUG:teuthology.orchestra.run.smithi194:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T05:36:06.282 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T05:36:06.282 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T05:36:06.297 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T05:36:06.298 DEBUG:teuthology.misc:Transferring archived files from smithi120:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911661/remote/smithi120 2024-09-19T05:36:06.298 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T05:36:06.346 DEBUG:teuthology.misc:Transferring archived files from smithi178:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911661/remote/smithi178 2024-09-19T05:36:06.346 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T05:36:06.385 DEBUG:teuthology.misc:Transferring archived files from smithi194:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911661/remote/smithi194 2024-09-19T05:36:06.385 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T05:36:06.423 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T05:36:06.423 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T05:36:06.425 DEBUG:teuthology.orchestra.run.smithi178:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T05:36:06.428 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T05:36:06.472 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T05:36:06.486 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T05:36:06.486 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T05:36:06.498 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T05:36:06.498 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T05:36:06.500 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T05:36:06.503 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T05:36:06.513 INFO:teuthology.orchestra.run.smithi120.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 05:36 /home/ubuntu/cephtest 2024-09-19T05:36:06.515 INFO:teuthology.orchestra.run.smithi178.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 05:36 /home/ubuntu/cephtest 2024-09-19T05:36:06.528 INFO:teuthology.orchestra.run.smithi194.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 05:36 /home/ubuntu/cephtest 2024-09-19T05:36:06.529 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T05:36:06.543 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T05:36:06.557 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-09-19T05:36:06.560 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/blogbench}} duration: 1944.6756711006165 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-09-19T05:36:06.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T05:36:06.647 INFO:teuthology.run:FAIL